SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.020996	0.025567	3309178
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.025995	0.031795	3309031
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.030994	0.0316179	3309034
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.173973	0.174169	3309154
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.18897	0.188837	3308818
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.333948	0.335496	3308437
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.414936	0.414679	3308785
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	0.894863	0.894705	3309160
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	1.13183	1.13556	3308359
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	1.3248	1.32672	3308362
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.71774	1.71777	3308821
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	1.86172	1.86201	3308842
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	2.11668	2.12205	3308809
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	3.51946	3.52345	3308998
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	4.5713	4.581	3308803
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	4.6143	4.61506	3309022
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	6.08108	6.09107	3309211
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	6.45602	6.46117	3308827
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	8.50471	8.50522	3308839
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	9.38657	9.38749	3308806
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	10.6184	10.6178	3308815
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	13.8859	13.8866	3309082
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	14.4708	14.4751	3308989
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	16.8504	16.8512	3308788
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	17.3424	17.3474	3308521
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	20.7688	20.7697	3309208
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	22.8355	22.8366	3308767
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	24.3273	24.3315	3309157
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	26.523	26.5239	3308374
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	28.7566	28.7569	3308314
manol-pipe-c6bidw_i.cnf	UNSAT	31.5782	31.5846	3308419
manol-pipe-f7nidw.cnf	UNSAT	31.5822	31.5896	3308425
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	34.1178	34.1206	3308698
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	34.2548	34.2571	3309085
velev-pipe-o-uns-1.1-6.cnf	UNSAT	34.4078	34.4081	3308581
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	34.5217	34.5218	3308614
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	35.3516	35.3515	3308695
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	39.159	39.158	3308503
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	45.3771	45.3814	3308524
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	45.4201	45.4194	3308995
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	45.5171	45.5231	3309040
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	51.1602	51.1613	3308758
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	55.6175	55.6272	3308356
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	57.7432	57.747	3309019
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	58.0512	58.0494	3308731
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	71.4281	71.4252	3309187
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	73.5408	73.5473	3308515
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	79.068	79.0948	3308713
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	88.2506	88.6945	3308752
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	95.6275	95.6227	3308845
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	97.9791	97.9841	3308473
velev-pipe-o-uns-1.0-7.cnf	UNSAT	103.634	103.632	3308584
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	116.515	116.516	3308749
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	117.182	117.179	3308812
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	121.144	121.14	3309169
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	143.969	149.336	3308719
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	146.289	146.286	3308500
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	146.505	146.557	3308908
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	161.454	161.45	3308737
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	188.957	188.953	3308623
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	202.969	202.967	3309205
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	208.988	208.986	3308746
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	209.089	209.086	3308824
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	234.365	234.365	3308740
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	248.862	248.852	3308686
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	264.378	264.366	3308725
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	288.439	288.44	3308911
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	323.948	323.949	3308872
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	327.329	327.326	3308536
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	352.791	352.783	3308833
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	382.449	382.436	3309151
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	383.923	383.924	3308857
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	387.286	387.285	3308851
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	388.39	388.393	3308869
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	397.795	397.784	3308338
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	400.097	400.088	3308509
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	420.193	420.183	3308860
manol-pipe-c10nidw.cnf	UNSAT	432.598	432.584	3308413
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	435.034	435.029	3308875
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	454.45	454.462	3308683
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	546.066	546.054	3308653
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	601.894	602.012	3308836
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	639.449	639.445	3308641
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	799.288	799.274	3309016
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	1116.05	1116.06	3308800
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	UNSAT	1166.09	1166.07	3308794
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	1250.97	1250.96	3309139
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	1260.05	1260.02	3309067

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.002999	0.00603197	3309121
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.002999	0.00606791	3309124
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.005999	0.00610798	3309136
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.007998	0.0107781	3309127
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.039993	0.039748	3308977
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.043993	0.0494371	3309130
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.048992	0.0542699	3309172
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.236963	0.244352	3309175
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.697893	0.69775	3309148
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	1.15782	1.17284	3308590
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	1.26881	1.26992	3308974
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.35879	1.36046	3308560
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.49077	1.49577	3309073
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	1.62475	1.65096	3308602
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.69874	1.69857	3308566
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	2.42063	2.44687	3308596
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	2.89456	2.94632	3308779
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	2.91556	3.00169	3308764
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	2.94555	2.95319	3308734
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	3.55746	3.64213	3308776
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	4.5813	4.64886	3308761
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	4.90725	4.98908	3308755
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	4.94025	5.02191	3308770
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	5.72313	5.73972	3308593
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	6.596	6.62484	3308527
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	6.75097	6.81609	3308617
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	7.74982	7.83458	3308605
ibm-2002-21r-k95.cnf	SAT	10.7054	10.7597	3308587
ibm-2004-01-k90.cnf	SAT	13.33	13.3684	3308431
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	16.6115	16.6878	3308599
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	17.4783	17.4785	3309004
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	SAT	17.8123	17.8126	3309076
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	20.9508	21.0125	3308554
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	22.7605	22.7988	3308407
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	24.1823	24.3787	3308611
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	35.2896	35.2967	3308482
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	36.0715	36.1143	3309097
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	36.8334	36.843	3308491
velev-pipe-sat-1.0-b9.cnf	SAT	41.6847	41.7259	3308578
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	42.0946	42.0954	3309001
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	44.9162	44.96	3309100
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	48.1427	48.1612	3308710
application/manthey/ traffic/traffic_r_sat.cnf	SAT	49.7704	49.7955	3308866
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	55.2396	55.2382	3309013
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	57.4233	57.4236	3309109
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	76.4244	76.5023	3308551
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	93.2028	93.2324	3308548
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	99.8888	99.9939	3308716
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	104.836	104.902	3308512
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	111.49	111.523	3308728
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	124.178	124.209	3308743
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	133.041	133.27	3308701
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	152.002	151.997	3309037
ibm-2004-23-k100.cnf	SAT	155.19	155.252	3308422
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	162.683	162.688	3308494
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	169.075	169.163	3308539
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	194.519	194.557	3308863
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	200.398	200.625	3308692
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	200.89	201.031	3308401
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	206.17	206.24	3308722
ibm-2002-30r-k85.cnf	SAT	211.16	211.196	3308428
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	218.363	218.373	3309184
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	232.225	232.438	3308638
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	240.513	240.717	3308707
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	255.312	255.569	3308647
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	302.049	302.197	3308398
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	346.141	346.214	3308632
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	375.397	375.39	3308968
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	379.083	379.149	3308518
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	423.822	423.831	3309010
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	437.106	437.093	3308992
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	485.576	485.651	3308392
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	559.292	559.364	3308320
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	576.171	576.443	3308662
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	694.871	694.902	3308389
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	1009.43	1009.41	3308917
velev-npe-1.0-9dlx-b71.cnf	SAT	1092.44	1092.66	3308575
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	1095.92	1095.96	3308497
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	SAT	1226.02	1226.03	3308626

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	1284.77	1300.3	3308350
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	1296.45	1300.04	3309199
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	1299.37	1300.02	3308386
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	1299.52	1300.02	3308383
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	1299.93	1300.01	3308932
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	1299.94	1300.01	3308983
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	1299.94	1300.02	3308659
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	1299.95	1300.01	3308563
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	? (TO)	1299.96	1300.01	3308986
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	1299.97	1300.01	3308914
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	1299.98	1300.01	3308557
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	1299.98	1300.01	3308902
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	1299.98	1300.01	3309052
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	1299.98	1300.01	3308335
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	1299.98	1300.01	3308347
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	1299.99	1300.02	3308884
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	? (TO)	1299.99	1300.03	3308434
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (TO)	1299.99	1300.03	3309202
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	1299.99	1300.01	3308893
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	1299.99	1300.01	3308926
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	1300	1300.01	3308479
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	1300	1300.03	3309070
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	1300	1300.01	3308572
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	1300.01	1300.02	3309118
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	? (TO)	1300.01	1300.03	3309064
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	1300.01	1300.01	3308887
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	1300.01	1300.01	3308326
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	1300.01	1300.01	3308905
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	1300.01	1300.01	3308956
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	1300.02	1300.01	3308443
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	1300.02	1300.04	3308530
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	1300.02	1300.01	3309061
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	1300.02	1300.01	3309166
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	1300.02	1300.01	3309142
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	1300.03	1300.01	3308965
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	1300.03	1300.01	3309046
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	1300.03	1300.01	3309049
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	1300.03	1300.01	3308941
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	1300.03	1300.01	3309145
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	1300.03	1300.01	3308920
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	1300.03	1300.01	3308446
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	1300.03	1300.04	3308671
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	1300.03	1300.02	3308773
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	1300.03	1300.02	3308452
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	1300.04	1300.01	3308935
velev-vliw-uns-4.0-9-i1.cnf	? (TO)	1300.04	1300.04	3308410
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	1300.04	1300.01	3309007
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	1300.04	1300.03	3308440
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	? (TO)	1300.04	1300.01	3308923
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	1300.04	1300.01	3309043
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	1300.04	1300.02	3308959
SAT_RACE08/Q1/ SAT_dat.k85.cnf	? (TO)	1300.04	1300.02	3308404
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	1300.04	1300.01	3308953
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	1300.04	1300.01	3308341
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	1300.04	1300.01	3308878
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	1300.04	1300.01	3308464
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	1300.04	1300.01	3308488
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	1300.04	1300.01	3309163
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	1300.05	1300.02	3308791
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (TO)	1300.05	1300.05	3309193
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	? (TO)	1300.05	1300.04	3309133
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	1300.05	1300.01	3309112
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	1300.05	1300.02	3308944
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	1300.05	1300.02	3308938
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	? (TO)	1300.05	1300.02	3308929
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	1300.05	1300.01	3308896
application/manthey/traffic/ traffic_r_uc_sat.cnf	? (TO)	1300.05	1300.04	3308854
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	1300.05	1300.02	3308830
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	1300.05	1300.04	3309196
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	1300.05	1300.02	3308782
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	1300.05	1300.01	3309079
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	1300.05	1300.03	3308644
application/fuhs/ AProVE11/AProVE11-06.cnf	? (TO)	1300.05	1300.02	3308608
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	? (TO)	1300.05	1300.02	3308569
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	1300.05	1300.01	3308329
industrial/fuhs/hard/ AProVE07-03.cnf	? (TO)	1300.05	1300.01	3308344
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	1300.05	1300.02	3308377
mizh-sha0-36-4.cnf	? (TO)	1300.05	1300.03	3308416
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	1300.05	1300.03	3308458
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	1300.05	1300.03	3308461
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	1300.05	1300.02	3308470
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	1300.05	1300.01	3308476
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	? (TO)	1300.06	1300.01	3309106
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	1300.06	1300.04	3308677
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	1300.06	1300.01	3308485
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	1300.06	1300.01	3308797
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	1300.06	1300.04	3308848
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	? (TO)	1300.06	1300.05	3308533
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	1300.06	1300.01	3309115
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	1300.06	1300.03	3308332
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	1300.06	1300.03	3308467
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	1300.06	1300.01	3308962
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	1300.06	1300.01	3308971
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	1300.06	1300.01	3308365
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	1300.06	1300.03	3308455
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	1300.06	1300.02	3308380
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	1300.06	1300.02	3309055
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	1300.06	1300.01	3308449
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	1300.07	1300.03	3309028
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	1300.07	1300.01	3308950
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	1300.07	1300.02	3308674
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	? (TO)	1300.07	1300.01	3308368
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	1300.07	1300.02	3309103
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	1300.07	1300.01	3308980
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	1300.07	1300.03	3309025
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	1300.07	1300.02	3308881
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	1300.07	1300.02	3308890
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	1300.07	1300.01	3308899
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	1300.08	1300.05	3309088
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (TO)	1300.08	1300.04	3308395
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	1300.08	1300.04	3309058
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	1300.08	1300.02	3308947
industrial/crypto/ mizh-sha0-36-2.cnf	? (TO)	1300.08	1300.02	3308371
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (TO)	1300.08	1300.04	3308665
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	? (TO)	1300.08	1300.06	3308542
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	? (TO)	1300.08	1300.04	3308545
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	1300.09	1300.05	3308317
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	? (TO)	1300.09	1300.03	3309181
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	1300.09	1300.04	3308635
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (TO)	1300.09	1300.03	3309091
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	? (TO)	1300.1	1300.04	3308323
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	1300.1	1300.07	3308704
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	1300.11	1300.05	3309094
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	1300.11	1300.06	3308629
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (TO)	1300.12	1300.06	3309190
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	1300.12	1300.08	3308650
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	1300.13	1300.09	3308689
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (TO)	1300.13	1300.08	3308668
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	1300.14	1300.13	3308680
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	1300.14	1300.12	3308620
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	1300.16	1300.1	3308656

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	Signal 6	96.2454	96.245	3308506
industrial/palacios/medium/ cube-11-h14-sat.cnf	Signal 6	454.24	454.249	3308353

SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Result page for solver SAT09 reference solver:precosat 236 (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (88 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (79 runs) [Show/Hide]

Solver timed out (no solution given) (131 runs) [Show/Hide]

Solver was terminated by a signal (2 runs) [Show/Hide]