SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.024995	0.0263851	3309931
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.024995	0.026751	3309934
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.051992	0.0521279	3310078
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.736887	0.737203	3310054
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.819874	0.821528	3309718
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	0.823874	0.824652	3310060
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	1.22681	1.22721	3309337
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	1.27081	1.27126	3309262
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	1.79273	1.79203	3310111
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	2.49862	2.4987	3309922
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	2.5896	2.58998	3309259
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	2.87956	2.88059	3309898
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	3.88641	3.88678	3309685
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	3.99439	3.99463	3309982
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	5.48317	5.4849	3309721
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	5.77712	5.77725	3310057
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	5.97209	5.97241	3309709
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	6.17106	6.17108	3309742
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	8.60069	8.60131	3309421
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	10.0455	10.0451	3309919
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	12.4201	12.4221	3309703
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	13.239	13.2385	3309739
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	13.7119	13.719	3309985
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	16.0786	16.0792	3309214
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	16.6165	16.6171	3309727
velev-pipe-o-uns-1.1-6.cnf	UNSAT	17.8153	17.8171	3309481
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	18.6632	18.6643	3309715
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	19.1241	19.1238	3310108
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	19.3651	19.3655	3309688
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT	20.9168	20.9163	3310066
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	24.4343	24.4364	3309706
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	24.6862	24.6868	3309595
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	27.6918	27.6912	3309631
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	33.065	33.0648	3309256
manol-pipe-c6bidw_i.cnf	UNSAT	36.5334	36.5327	3309319
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	37.3123	37.313	3309940
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	38.2622	38.2634	3309424
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	38.3972	38.3998	3309415
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	38.6601	38.6597	3309667
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	39.49	39.4935	3309895
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	39.571	39.572	3309274
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	41.9426	41.9439	3309514
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	42.1276	42.126	3309649
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	42.8855	42.8842	3309889
manol-pipe-f7nidw.cnf	UNSAT	46.5519	46.5529	3309325
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	47.1058	47.1047	3309712
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	50.0564	50.0557	3310087
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	59.334	59.3324	3309745
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	61.5636	61.564	3309403
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	66.4899	66.4933	3309652
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	67.2428	67.2414	3310051
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	76.3394	76.3389	3309523
velev-pipe-o-uns-1.0-7.cnf	UNSAT	87.4047	87.4049	3309484
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	88.7355	88.7344	3309637
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	90.5952	90.5927	3309658
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	100.871	100.868	3310105
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	112.698	112.696	3309724
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	127.771	127.77	3309598
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	129.037	129.033	3309811
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	134.767	134.761	3309400
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	148.325	148.319	3309238
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	149.679	149.674	3309373
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	160.692	160.691	3309733
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	163.28	163.281	3309736
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	173.583	173.577	3309436
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	176.032	176.028	3309613
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	188.835	188.831	3309619
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	243.956	243.949	3310069
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	262.666	262.773	3309409
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	270.724	270.719	3309646
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	270.903	270.902	3309769
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	287	286.992	3309772
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	295.749	295.739	3309757
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	306.158	306.149	3309751
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	314.138	314.129	3309760
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	329.991	329.982	3309775
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	347.53	347.518	3309700
manol-pipe-c10nidw.cnf	UNSAT	389.748	389.738	3309313
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	518.263	518.246	3309244
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	537.91	537.894	3309586
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	609.42	609.405	3310102
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	615.548	615.533	3309433
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	654.999	654.981	3310039
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	722.95	722.928	3309808
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	744.758	744.739	3309583
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	811.835	811.797	3309991
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	857.048	857.023	3309640
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	UNSAT	900.357	900.332	3309730
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	920.037	920.011	3309967
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	962.197	962.172	3309916
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	1060.14	1060.12	3310093
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT	1104.34	1104.31	3309295
velev-vliw-uns-4.0-9-i1.cnf	UNSAT	1113.08	1113.05	3309310
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	1337.31	1337.26	3309541
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	1421.05	1421	3309949
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	1501.01	1500.99	3309268
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	UNSAT	1524.75	1524.71	3309943
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	1543.03	1542.99	3310090
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	1764.76	1764.71	3309370
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	UNSAT	1822.45	1822.37	3309988
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	1827.79	1827.73	3309430
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT	1838.21	1838.16	3309952
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	1976.6	1976.54	3309553
APPLICATIONS/bitverif/ maxor/maxor128.cnf	UNSAT	2128.96	2128.87	3309361
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	UNSAT	2133.18	2133.13	3309697
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	UNSAT	2200.85	2200.82	3310096
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	2533.06	2532.98	3309229
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	UNSAT	2650.06	2650.01	3309994
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	2667.89	2667.77	3309907
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT	3205.13	3205.01	3309691
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	3456.84	3456.74	3309508
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	3834.2	3834.08	3309964
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	4059.89	4059.8	3309334
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	4300.53	4300.37	3309235
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	UNSAT	4526.79	4526.68	3309925
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	4599.27	4599.11	3309226
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	UNSAT	4787.03	4786.89	3309340

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.009997	0.0100221	3310021
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.009998	0.010172	3310036
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.011997	0.011914	3310024
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.027994	0.0280129	3310027
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.083986	0.084403	3309877
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.115982	0.116768	3310030
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.163975	0.164798	3310072
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	0.574912	0.57554	3309874
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.856869	0.857809	3310075
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.11683	1.11777	3309466
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.2848	1.28657	3309460
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	1.9677	1.96755	3310048
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	3.77842	3.79292	3309427
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	4.32434	4.32806	3309490
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	4.6093	4.65277	3309664
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	4.89825	4.8982	3309973
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	7.9088	7.94752	3309454
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	8.62569	8.63271	3309502
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	9.40157	9.43166	3309679
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	12.3091	12.3222	3309496
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	14.3938	14.4515	3309532
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	15.0047	15.0473	3309676
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	15.7616	15.7893	3309661
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	18.2062	18.2092	3309391
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	18.3622	18.3855	3309997
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	18.8281	18.8937	3309670
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	19.868	19.8752	3309493
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	23.5414	23.5692	3309517
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	24.5863	24.5976	3309307
velev-pipe-sat-1.0-b9.cnf	SAT	24.6283	24.6431	3309478
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	31.7182	31.7701	3309505
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	38.1962	38.1986	3309904
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	39.9839	40.0191	3309499
application/manthey/ traffic/traffic_r_sat.cnf	SAT	40.6548	40.6651	3309766
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	41.5787	41.5797	3309634
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	43.4554	43.4794	3310000
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	44.5242	44.5225	3309469
ibm-2004-01-k90.cnf	SAT	47.7967	47.7987	3309331
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	48.5976	48.5966	3309892
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	49.8324	49.9474	3309511
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	50.2294	50.3506	3309607
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	51.4362	51.4354	3309382
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	55.2716	55.2693	3310009
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	56.8963	56.9133	3309448
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	58.6251	58.7417	3309298
ibm-2002-21r-k95.cnf	SAT	59.6409	59.6674	3309487
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	59.8149	59.8225	3309913
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	61.1397	61.2957	3309547
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	61.6556	61.666	3309610
velev-npe-1.0-9dlx-b71.cnf	SAT	64.0533	64.2372	3309475
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	67.4577	67.6126	3309538
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	68.6086	68.6455	3309412
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	69.4594	69.571	3309592
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	71.6521	71.7059	3309451
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	73.0639	73.0804	3309628
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	89.0335	89.215	3309301
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	95.6625	95.662	3309901
mizh-sha0-36-4.cnf	SAT	96.4663	96.4675	3309316
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	124.934	124.935	3310084
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	136.092	136.097	3310081
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT	136.984	141.302	3309406
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	141.871	141.932	3309616
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	142.102	142.108	3309937
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	184.772	184.814	3309622
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	216.36	216.391	3309439
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	217.083	217.101	3309763
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	246.651	246.686	3309418
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	281.493	281.562	3309220
ibm-2004-23-k100.cnf	SAT	360.507	360.526	3309322
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	377.201	377.201	3309829
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	400.035	400.017	3310006
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	486.293	486.278	3309271
ibm-2002-30r-k85.cnf	SAT	486.729	486.742	3309328
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	506.564	506.551	3309910
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	583.454	583.801	3310033
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	589.477	589.47	3309643
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	614.037	614.023	3309397
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	675.135	675.125	3309823
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	798.506	798.56	3309754
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	1270.61	1270.63	3309655
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	1397.37	1397.41	3309442
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	SAT	1430.75	1430.71	3309385
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	1495.77	1495.95	3309601
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	SAT	1506.52	1506.48	3309976
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	1548.59	1548.56	3309292
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	1734.82	1734.78	3309886
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	2384.27	2384.25	3309289
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	2464.5	2464.49	3309445
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	3337.62	3337.6	3309562
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	SAT	4038.87	4038.85	3309250
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	4885.98	4885.82	3309394

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.02	4999.91	3309880
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.02	4999.91	3309883
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.02	4999.91	3309865
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.03	4999.91	3309343
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.03	4999.91	3309349
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.03	4999.91	3309388
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.03	4999.92	3309979
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.03	4999.92	3309265
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000.03	4999.91	3309673
SAT_RACE08/Q1/ SAT_dat.k85.cnf	? (TO)	5000.03	4999.92	3309304
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	5000.04	4999.93	3309580
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000.04	4999.91	3309871
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.04	4999.92	3309232
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.04	4999.91	3309862
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	5000.04	4999.92	3309520
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.04	4999.93	3309802
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.05	4999.93	3309847
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.05	4999.93	3309247
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	5000.05	4999.92	3309277
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	5000.05	4999.82	3309457
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	5000.05	4999.92	3309748
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.05	4999.83	3309805
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.05	4999.93	3309832
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.05	4999.93	3309841
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.05	4999.92	3309853
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	? (TO)	5000.05	4999.91	3309868
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	5000.05	4999.82	3310018
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.05	4999.93	3310099
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.06	4999.94	3309844
industrial/palacios/medium/ cube-11-h14-sat.cnf	? (TO)	5000.06	4999.92	3309253
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (TO)	5000.06	4999.94	3309565
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	? (TO)	5000.06	4999.93	3309817
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.06	4999.95	3309571
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	5000.06	4999.91	3310015
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	5000.07	5000.02	3310012
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.07	4999.92	3309463
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.07	4999.91	3309376
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.07	4999.93	3310045
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.07	4999.92	3309346
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	5000.07	4999.84	3310042
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	5000.07	4999.93	3310063
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	5000.07	4999.92	3309280
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	5000.07	4999.93	3309682
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.07	4999.94	3309781
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000.07	4999.92	3309784
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.08	4999.93	3309796
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.08	4999.93	3309787
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	5000.08	4999.93	3309820
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.08	4999.92	3309859
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.08	4999.95	3309577
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.08	4999.91	3309472
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.08	4999.92	3309217
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000.08	4999.92	3309790
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.08	4999.92	3309961
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.09	4999.92	3309358
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (TO)	5000.09	4999.98	3309568
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.09	4999.93	3309838
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	? (TO)	5000.09	4999.93	3309223
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.09	4999.96	3309355
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.09	4999.85	3309364
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	5000.09	4999.91	3309379
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.09	4999.92	3309352
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	? (TO)	5000.1	4999.87	3309625
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000.1	4999.92	3309850
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	5000.1	4999.99	3309529
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.1	4999.92	3309928
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	5000.1	4999.94	3309946
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	5000.1	4999.97	3309550
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.1	4999.94	3309799
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.1	4999.95	3309793
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.11	5000	3309958
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.11	5000.02	3309826
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.11	4999.91	3309856
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.11	4999.96	3309367
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.11	4999.93	3309835
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	5000.11	5000.01	3310003
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	5000.11	4999.92	3309286
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	5000.12	5000.02	3309283
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.12	4999.97	3309955
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.12	4999.94	3309814
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.13	4999.93	3309241
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	5000.13	4999.94	3309778
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	5000.13	5000.05	3309526
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.14	4999.99	3309970
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.14	5000	3309574
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.15	4999.98	3309544
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.15	4999.96	3309535
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	5000.16	5000.04	3309589
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	5000.17	5000.01	3309556
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	5000.18	5000.01	3309604
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.2	5000.01	3309559

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver Lingeling 587 [DEPRECATED] (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (117 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (91 runs) [Show/Hide]

Solver timed out (no solution given) (91 runs) [Show/Hide]

Solver was terminated by a signal (1 run) [Show/Hide]