SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.239963	0.0434401	3321228
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.293955	0.0525141	3321229
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.384941	0.060416	3321277
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	4.19136	0.561361	3321030
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	7.14191	0.968231	3321157
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	7.76682	1.16231	3321004
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	7.81481	0.99702	3321271
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	10.0105	1.39095	3321225
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	10.1695	1.35268	3321217
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	11.1873	1.43345	3321269
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	23.5354	3.19359	3321005
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	26.16	3.99862	3321214
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	42.8025	5.65881	3321224
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	47.1688	6.4915	3321270
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	47.4308	6.12783	3321188
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	77.2083	9.74095	3321216
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	80.9107	12.5628	3321245
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	99.8988	12.8802	3321158
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	109.508	14.2581	3321165
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	110.482	14.2705	3321154
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	113.607	14.2387	3321272
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	119.011	15.9682	3321288
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	128.765	16.5511	3321160
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	135.427	19.2077	3321128
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	137.549	19.2193	3321126
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	140.529	18.7588	3321268
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	140.8	17.8463	3321246
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	152.977	20.0949	3320989
velev-pipe-o-uns-1.1-6.cnf	UNSAT	155.939	21.5455	3321078
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	156.411	20.065	3321152
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	174.253	23.2696	3321116
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	198.53	28.8675	3321153
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	203.255	28.4035	3321058
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	225.465	29.8063	3321287
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	230.526	29.076	3321164
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	233.766	29.3526	3321187
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	258.086	32.9323	3321042
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	284.447	35.8755	3321156
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	311.764	41.0757	3321147
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	323.276	44.3713	3321231
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	348.22	45.004	3321155
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	352.342	48.0066	3321166
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	352.351	44.2931	3321117
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	371.584	47.4675	3321052
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	409.358	51.2654	3320997
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	413.22	51.9511	3321059
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	416.72	59.2694	3321089
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	420.607	54.9043	3321130
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	UNSAT	426.865	53.4752	3321233
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	430.233	53.9062	3321146
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	478.687	65.643	3321286
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	485.86	61.3788	3321140
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	504.949	67.5214	3321122
velev-pipe-o-uns-1.0-7.cnf	UNSAT	513.496	69.252	3321079
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	522.573	65.7846	3321003
manol-pipe-c6bidw_i.cnf	UNSAT	562.372	70.7669	3321024
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	577.162	72.4979	3321056
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	589.443	75.2249	3321159
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	598.157	78.0022	3321092
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	606.369	84.4338	3321134
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	797.546	100.662	3321135
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	828.199	110.271	3321137
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	845.154	107.726	3321163
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	858.298	107.614	3321133
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	868.532	109.041	3321280
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	874.58	109.977	3321124
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	924.406	120.054	3321009
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	1349.45	169.233	3321162
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	1357.14	173.231	3321151
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	1513.68	189.405	3321234
manol-pipe-f7nidw.cnf	UNSAT	1587.42	199.492	3321026
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1677.93	210.045	3320999
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	1846.06	231.081	3321051
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	2071.46	259.699	3321063
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	2219.57	283.689	3321011
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT	2280.83	285.562	3321148
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	2291.47	286.989	3321131
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	2397.91	310.38	3321113
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	2554.63	323.981	3321062
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	2560.73	379.697	3321264
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	2591.04	324.441	3321041
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	2639.7	353.607	3321054
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	UNSAT	2666.52	333.778	3321193
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	2809.53	373.936	3321013
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	UNSAT	2838.61	665.872	3321266
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	2912.27	375.676	3321102
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	3034.81	400.368	3321010
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	3051.47	400.094	3321171
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	3136.88	411.75	3321168
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	3186.08	424.922	3321174
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	3284.3	443.788	3321175
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT	3318.17	417.551	3321235
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	3349.97	455.123	3321170
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	3437.29	433.909	3321220
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	3566.16	446.21	3321223
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	3808.78	524.593	3321176
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	3828.28	638.098	3321012
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	3837.25	480.671	3321274
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	4088.11	515.205	3321112
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	4258.18	703.05	3321285
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	4514.89	642.878	3321248
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	5685.18	711.453	3321007
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	5954.34	758.544	3321098
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT	7228.53	1483.27	3321016
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	7247.9	907.249	3320996
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	8536.45	1992.85	3321265
velev-vliw-uns-4.0-9-i1.cnf	UNSAT	9514.57	1239.63	3321021
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	10083.4	1262.06	3321240
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	10135.9	1289.54	3321029
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	UNSAT	10711.9	1347.79	3321031
manol-pipe-c10nidw.cnf	UNSAT	10750.7	1347.15	3321022
APPLICATIONS/bitverif/ maxor/maxor128.cnf	UNSAT	12487.7	1566.79	3321038
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	12995	1626.32	3321061
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	13193.4	2383.28	3321282
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	UNSAT	13822	2016.24	3321247
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	UNSAT	15706.6	1982.07	3321283
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	UNSAT	16550.6	2071.2	3321180
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	17581.3	2199.86	3321044
industrial/fuhs/hard/ AProVE07-01.cnf	UNSAT	17823.9	2230.52	3320998
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	17961.7	3370.21	3321281
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	UNSAT	18155.6	2757.44	3321249
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	UNSAT	20093.8	2513.63	3321244
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	20775.6	2600.78	3320993
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	UNSAT	28768.5	3600.18	3321185
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	30129.5	3770.98	3321239
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	UNSAT	30713.3	3843.96	3321036
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	UNSAT	32219.4	4031.47	3321149

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.18897	0.0333269	3321260
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.199969	0.0358601	3321259
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.221965	0.039442	3321263
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.228964	0.039334	3321210
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.292954	0.050107	3321261
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.45193	0.071079	3321258
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.485925	0.072767	3321275
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	3.32849	0.535615	3321267
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	3.9204	0.516866	3321276
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	7.45487	0.984769	3321254
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	12.7401	1.76819	3321073
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	14.2708	1.80014	3321209
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	14.5708	2.19315	3321071
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	22.1206	2.93944	3321081
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	41.3517	5.39965	3321082
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	41.7656	5.42554	3321048
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	47.3388	6.39757	3321074
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	53.1389	6.96368	3321129
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	60.7738	7.89902	3321085
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	70.8792	9.92932	3321219
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	77.7862	9.97561	3321083
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	82.1445	10.8849	3321090
application/manthey/ traffic/traffic_r_sat.cnf	SAT	95.8604	16.8798	3321173
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	98.499	12.7019	3321213
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	116.106	15.5262	3321060
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	132.788	17.3866	3321138
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	133.633	17.9896	3321144
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	136.575	18.113	3321086
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	145.831	22.3134	3321139
mizh-sha0-36-4.cnf	SAT	155.156	19.6698	3321023
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	200.361	27.7401	3321069
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	204.788	28.9118	3321143
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	213.831	27.6467	3321141
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	220.751	29.7624	3321251
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	221.847	29.7348	3321250
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	224.593	28.8096	3321084
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	227.08	32.2852	3321125
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	228.779	30.5782	3321088
ibm-2004-01-k90.cnf	SAT	231.166	31.3745	3321028
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	233.37	30.0298	3321123
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	242.157	31.0581	3321008
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	256.164	36.4922	3321020
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	267.815	34.5771	3321127
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	278.318	35.0523	3321045
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	279.677	36.3215	3321105
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	298.769	41.1906	3321115
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	327.779	47.1101	3321279
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	361.208	45.3817	3321067
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	374.099	57.7517	3321121
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	382.801	52.347	3321097
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	421.278	56.9914	3321100
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	479.692	60.7265	3321095
ibm-2002-21r-k95.cnf	SAT	500.959	63.3319	3321080
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	522.823	68.6247	3321120
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	562.38	71.8765	3321278
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	657.389	83.5342	3321068
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	752.061	96.8143	3321218
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	802.946	111.621	3321064
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	804.43	100.995	3321253
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	874.988	110.037	3321132
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	1007.94	127.95	3321050
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT	1033.04	129.382	3321191
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	1090.85	136.602	3321255
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	1183.14	152.57	3320991
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	1330.44	166.902	3321190
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	1354.99	170.569	3321172
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	1402.01	180.603	3321055
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	1424.16	178.377	3321194
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	1630.51	209.367	3321018
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	1648.1	210.558	3321192
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	1709.28	227.882	3321215
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	SAT	1804.28	236.532	3320990
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	1879.05	237.384	3320992
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	2070.08	277.913	3321230
ibm-2004-23-k100.cnf	SAT	2136.38	274.231	3321025
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	2473.52	309.649	3321177
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	2493.94	313.659	3321057
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	2592.66	426.397	3321017
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	2627.95	363.58	3321222
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	2797.25	369.139	3321002
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	SAT	2977.46	372.712	3321186
velev-pipe-sat-1.0-b9.cnf	SAT	3016.31	416.584	3321077
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	3724.65	484.959	3321169
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	4457.56	558.419	3321065
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	5038.73	647.762	3321262
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	SAT	5369.9	672.074	3321046
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	6869.73	859.802	3321049
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	6904.14	867.006	3321019
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	7511.91	951.46	3321207
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	10248.8	1282.81	3321015
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	10364.9	1297.64	3321066
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	14548.9	1822.57	3321252
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	14978.6	1874.33	3321014
ibm-2002-30r-k85.cnf	SAT	19334.2	2419.4	3321027
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	19887.9	2622.11	3321221
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	SAT	24177.7	3055.89	3321184
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	SAT	24379.4	3051.81	3321103

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
velev-npe-1.0-9dlx-b71.cnf	? (TO)	11534.5	5100.7	3321076
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	34610.3	5100.52	3321284
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	40000.2	5005.38	3321032
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	? (TO)	40000.3	5003.98	3321242
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	40000.3	5005.11	3321039
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	40000.3	5005.06	3321072
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	40000.3	5004.59	3321142
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	40000.3	5004.39	3321047
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	40000.4	5005.23	3321000
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	40000.4	5004.6	3321196
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	40000.4	5005.42	3321206
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	40000.4	5003.79	3321006
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	40000.4	5003.79	3321211
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	40000.5	5005.42	3321202
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	40000.5	5005.36	3321208
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	40000.5	5010.6	3321001
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	40000.6	5005.9	3321195
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	40000.6	5004.79	3321034
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	40000.6	5007.65	3321040
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	40000.6	5005.49	3321273
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	40000.6	5005.11	3321257
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	40000.6	5005.16	3321241
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	40000.6	5004.21	3321161
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	40000.6	5005.64	3321183
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	40000.7	5005.65	3321204
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	40000.7	5005.43	3321201
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	40000.7	5004.57	3321182
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	40000.7	5005.67	3321205
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	40000.8	5005	3321212
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	40000.8	5004.4	3321256
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	40000.8	5006.95	3321075
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	40000.8	5003.82	3321070
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	40000.8	5005.33	3321203
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	40000.9	5005.64	3321199
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	40000.9	5005.23	3321033
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	40000.9	5005.68	3321035
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	40000.9	5005.52	3321043
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	40000.9	5004.11	3321145
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	40000.9	5006.49	3321178
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	40000.9	5003.79	3321232
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	40000.9	5005.89	3321237
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	40000.9	5005.83	3321243
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	40001	5004.34	3321238
application/fuhs/ AProVE11/AProVE11-06.cnf	? (TO)	40001	5006.52	3321087
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	40001	5004.19	3321150
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	40001	5007.69	3321111
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	40001	5006.25	3321179
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	? (TO)	40001	5006.57	3321136
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	40001	5005.29	3321189
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	40001.1	5004.75	3321198
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	40001.1	5006.22	3321226
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	40001.1	5004.61	3321236
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	40001.1	5005.57	3321037
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	40001.1	5005.7	3321200
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	40001.1	5005.91	3320995
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	40001.1	5004.74	3321197
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	40001.2	5004.84	3321227
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	40001.2	5006.08	3321181
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	40001.2	5005.96	3321093
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	40001.3	5007.23	3321091

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	? (MO)	166.467	30.3935	3321053
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	? (MO)	1270.77	164.546	3321118
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (MO)	1414.36	181.37	3321096
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (MO)	1506.23	194.536	3321108
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (MO)	1523.91	195.319	3321099
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (MO)	1605.83	206.651	3321110
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (MO)	1662.93	217.149	3321106
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (MO)	1698.19	220.526	3321094
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (MO)	1992.23	258.414	3321107
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (MO)	2124.68	275.978	3321114
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (MO)	8488.84	1063.73	3321109
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (MO)	10990.4	1380.38	3321104

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	Signal 6	283.665	38.1107	3321167
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	Signal 6	432.592	57.9815	3320994
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	Signal 6	1864.54	684.538	3321101
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	Signal 6	1969.74	843.302	3321119

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (127 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (97 runs) [Show/Hide]

Solver timed out (no solution given) (60 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (12 runs) [Show/Hide]

Solver was terminated by a signal (4 runs) [Show/Hide]