SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.005999	0.0193201	3420228
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.010997	0.0202821	3420130
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.010997	0.018984	3420132
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.109982	0.110684	3420212
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.159975	0.16134	3419734
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	0.447931	0.449385	3419682
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	0.510922	0.510706	3419684
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.578911	0.581579	3419988
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	0.608907	0.610312	3419990
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	0.760883	0.761597	3420004
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	0.769882	0.788884	3419982
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	0.953854	0.956217	3420124
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	1.04284	1.04381	3420108
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	2.56661	2.56859	3419994
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	2.76458	2.76463	3419978
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	2.91056	2.91284	3420250
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	2.97955	2.98842	3420216
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	3.62245	3.62291	3420002
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	3.9214	3.9224	3419980
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	4.00339	4.00411	3420248
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	4.10737	4.10889	3419944
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	4.34234	4.34344	3419968
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	5.40918	5.42061	3419790
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	5.52116	5.52274	3419986
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	6.22505	6.23133	3420122
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	12.1602	12.1602	3419942
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	12.7181	12.7182	3419954
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	12.957	12.9582	3419680
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	13.366	13.3668	3419930
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	13.7979	13.7996	3419852
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	15.0828	7.61881	3419926
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	17.1474	17.1481	3419948
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	18.0832	18.0835	3420246
manol-pipe-c6bidw_i.cnf	UNSAT	19.711	19.7195	3419722
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	21.2828	21.2878	3419906
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	23.8904	23.8917	3420102
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	25.5701	25.5692	3420164
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	32.3341	32.3338	3419786
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	32.4061	32.4071	3420006
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	36.5744	36.5737	3420166
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	38.1182	38.1187	3420234
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	40.9788	40.9809	3419792
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	41.1217	41.1201	3419652
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	44.7962	44.795	3420136
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	60.9577	60.959	3420106
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	63.7933	63.7956	3419984
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	78.5721	78.572	3419778
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	79.3799	79.3797	3419776
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	91.817	91.8149	3419934
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	92.067	92.0669	3419858
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	98.0161	98.0167	3419992
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	100.864	100.861	3419782
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	110.579	110.577	3420222
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	120.82	120.818	3419668
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	194.622	194.62	3419908
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	218.453	218.45	3420050
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	272.69	272.698	3420010
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	288.018	288.016	3420016
manol-pipe-c10nidw.cnf	UNSAT	289.427	289.42	3419718
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	309.692	309.685	3420024
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	314.931	314.927	3420014
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	323.714	323.705	3420026
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	359.905	359.903	3420022
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	402.269	402.277	3419800
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	440.727	440.722	3420120
velev-pipe-o-uns-1.0-7.cnf	UNSAT	497.165	497.151	3419832
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	534.001	533.994	3419900
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	540.442	540.45	3419918
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	644.436	644.428	3419922
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	659.325	659.314	3419998
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	738.814	738.796	3420218
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	938.594	938.566	3420210
velev-pipe-o-uns-1.1-6.cnf	UNSAT	965.619	965.583	3419830
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	1109.74	1109.72	3420236
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	1195.66	1195.63	3420238
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	1234.72	1234.67	3419758
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	UNSAT	1291.73	1291.69	3419814
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	1455.4	1455.36	3419848
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	1477.67	1477.62	3420154
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	1489.34	1489.32	3420214
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	1495.54	1495.49	3419762
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1572.89	1572.84	3419672
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1754.4	1754.4	3419940
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	1787	1787.05	3419696
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	1910.03	1910.01	3419692
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	1943.93	1943.88	3419732
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	1981.37	1981.29	3419898
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	2064.84	2064.79	3419798
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	2119.35	2119.41	3420152
manol-pipe-f7nidw.cnf	UNSAT	2139.04	2138.96	3419726
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	2507.51	2507.45	3420202
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	2599.16	2599.13	3419698
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	2621.47	2621.41	3420000
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	2676.85	2676.79	3419976
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	2778	2778.04	3419870
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	3061.29	3061.24	3419694
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	3454.79	3454.75	3419700
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	3706.17	3706.08	3420048
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	4239.39	4239.29	3420204

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.002998	0.0233931	3420192
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.002998	0.0193649	3420190
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.004998	0.0187741	3420200
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.007998	0.019249	3420194
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.007998	0.0192281	3420224
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.013997	0.019203	3420196
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.022995	0.023592	3420094
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.089986	0.0912901	3420226
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	0.298953	0.302703	3420092
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.354945	0.355361	3420208
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	0.377942	0.37862	3419836
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	0.463929	0.480202	3419932
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	0.537917	0.554654	3419844
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	0.772882	0.774371	3419820
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	0.78688	0.789376	3419840
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	0.881865	0.881846	3419952
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	0.960853	0.965821	3419794
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.09283	1.09286	3419816
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	1.23081	1.23717	3419946
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	1.24481	1.24468	3419950
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	1.35379	1.35296	3419962
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.40479	1.40948	3420158
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	1.50277	1.50283	3419960
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	1.9497	1.94999	3419956
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	2.39764	2.39749	3419854
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	3.9304	3.93201	3419838
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	4.49032	4.49098	3420182
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	4.83726	4.83792	3419812
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	5.55715	5.55952	3419842
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	5.69413	7.36863	3419850
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	6.33704	6.35402	3419916
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	6.82396	6.8257	3419764
application/manthey/ traffic/traffic_r_sat.cnf	SAT	9.35658	9.35919	3420020
ibm-2002-21r-k95.cnf	SAT	10.1944	10.1962	3419834
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	10.4504	10.4549	3419864
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	11.0693	11.0723	3419714
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	13.7149	13.7156	3419770
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	18.4052	18.4065	3419920
ibm-2004-01-k90.cnf	SAT	18.4752	18.4761	3419730
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	18.5232	18.5234	3420112
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	20.8898	20.8903	3419904
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	21.5497	21.55	3419846
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	29.1236	29.126	3419784
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	29.4385	29.4769	3419914
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	39.777	39.8024	3419712
ibm-2002-30r-k85.cnf	SAT	39.8859	39.9044	3419728
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	41.5287	41.528	3420174
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	48.1037	48.1073	3419868
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	49.1345	49.1398	3419702
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	52.789	52.8071	3420176
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT	54.7107	54.7279	3419780
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	55.2126	55.212	3419710
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	63.2864	63.2847	3420232
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	65.95	65.9661	3419708
velev-npe-1.0-9dlx-b71.cnf	SAT	66.6699	66.6686	3419826
velev-pipe-sat-1.0-b9.cnf	SAT	75.1896	75.1868	3419828
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	79.4099	79.4086	3420110
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	79.6519	79.6511	3420118
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	79.7029	79.7017	3419808
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	80.3998	80.4009	3420134
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	80.8987	80.935	3419810
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	80.9997	81.0178	3419928
ibm-2004-23-k100.cnf	SAT	82.8864	82.8891	3419724
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	91.1631	91.1631	3420088
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	99.5779	99.5769	3420104
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	106.687	106.688	3420012
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	109.359	109.361	3419924
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	118.542	118.54	3420018
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	142.266	142.263	3419874
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	207.099	207.095	3420198
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	239.776	239.779	3420180
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	261.665	261.66	3420054
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	306.656	306.649	3419774
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	340.583	340.583	3419802
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	365.103	365.098	3419788
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	369.602	369.67	3420116
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	423.065	423.054	3420062
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	506.33	506.357	3420230
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	544.075	544.067	3419656
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	580.617	580.608	3420058
mizh-sha0-36-4.cnf	SAT	636.643	636.621	3419720
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	826.061	826.044	3419704
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	847.939	847.912	3420028
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	886.666	886.649	3420100
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	933.23	933.228	3419910
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	983.942	983.922	3419678
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	1213.83	1213.83	3419690
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	SAT	1296.5	1296.5	3419876
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	SAT	1474.65	1474.69	3419888
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	2232.08	2232.01	3419822
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	2742.59	2742.53	3419804
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	2922.3	2922.24	3419938
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	3238.33	3238.24	3419884
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT	3973.74	3973.76	3419862
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	SAT	4972.16	4972	3420188

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	5000.03	4999.92	3419766
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.03	5000.02	3420206
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.03	4999.92	3420098
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	5000.04	4999.93	3420138
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.04	4999.93	3420064
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	? (TO)	5000.04	5000.03	3419772
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	5000.04	4999.93	3419974
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000.04	5000.04	3420032
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000.04	4999.92	3420090
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.04	4999.93	3420042
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.05	4999.94	3419892
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.05	4999.92	3419742
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.05	4999.93	3420040
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	5000.05	4999.94	3419666
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000.05	5000.13	3420076
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	5000.05	4999.93	3420140
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.05	4999.94	3420074
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	5000.06	4999.93	3420178
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	5000.06	4999.93	3420186
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	5000.06	4999.93	3420142
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	5000.06	4999.95	3419676
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.06	4999.93	3420078
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	5000.06	4999.94	3419660
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.06	4999.93	3419674
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	5000.06	4999.95	3420160
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.06	4999.93	3419740
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.07	4999.92	3420162
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	5000.07	4999.92	3420144
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	5000.07	4999.94	3419662
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.07	5000.04	3420146
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.07	4999.92	3420084
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.07	4999.93	3420068
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.07	4999.93	3420046
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.07	5000.23	3420044
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	5000.07	4999.93	3419996
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	? (TO)	5000.07	4999.92	3419966
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000.08	4999.93	3420036
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.08	4999.92	3419738
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	5000.08	4999.96	3420008
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	5000.08	5000.03	3420184
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	5000.09	4999.94	3419964
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.09	5000.02	3419670
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.09	4999.92	3420150
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	5000.09	4999.94	3419972
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.09	5000.13	3420066
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.09	4999.95	3419754
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.09	5000.04	3419818
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.09	4999.93	3419744
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000.09	4999.94	3419958
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	5000.09	4999.94	3419756
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	? (TO)	5000.09	5000.02	3419688
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.09	4999.93	3420082
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.1	4999.93	3420070
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.1	5000.43	3419824
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	5000.1	4999.96	3419750
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	5000.1	4999.95	3419736
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.1	5000.02	3420096
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.1	5000.02	3420148
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.1	5000.03	3419768
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.11	5000.03	3419760
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	5000.11	5000.03	3420220
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	5000.11	5000.03	3420114
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.11	5000.03	3420072
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.11	5000.03	3420052
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.12	4999.93	3420086
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	5000.12	5000.13	3420056
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.12	5000.14	3420030
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.12	5000.03	3419686
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.12	4999.93	3420080
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.12	5000.05	3419882
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.13	5000.05	3420156
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.13	5000.03	3419752
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	5000.13	5000.03	3419970
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.13	5000.23	3420034
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.13	5000.03	3420038
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.13	5000.03	3420060
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.14	5000.04	3419746
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.14	5000.03	3419748
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.15	5000.9	3420128
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	5000.15	5000	3419796
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	? (TO)	5000.16	5000.21	3419806
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	? (TO)	5000.16	5000.19	3419936
velev-vliw-uns-4.0-9-i1.cnf	? (TO)	5000.17	5000.06	3419716
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.19	5000.11	3419664
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	5000.19	5000.01	3420126
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (TO)	5000.2	5000.06	3420170
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.21	5000.07	3419866
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	? (TO)	5000.23	5000.1	3419658
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	5000.23	5000.1	3420168
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.24	5000.1	3419872
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.24	5000.12	3419890
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	5000.24	5000.13	3420172
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	5000.25	5000.33	3420240
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (TO)	5000.26	5000.18	3419706
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.27	5000.2	3419894
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.27	5000.19	3420242
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.29	5000.15	3419654
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (TO)	5000.3	5000.11	3419878
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	5000.32	5000.24	3419880
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	5000.39	5000.45	3419896
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	5000.4	5000.32	3419856
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	5000.41	5000.31	3419860

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (problem)	4092.18	4092.07	3419902
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (problem)	4541.56	4541.45	3419912
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (problem)	4682.14	4682.02	3420244
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (problem)	4822.75	4822.58	3419886

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver minisat hack reference: minisat 2.2.0 (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (99 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (95 runs) [Show/Hide]

Solver timed out (no solution given) (102 runs) [Show/Hide]

No recognized solution line (4 runs) [Show/Hide]