SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.014996	0.016245	3309180
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.032994	0.033982	3309033
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.073988	0.0789421	3309036
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.200969	0.203057	3309156
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.379941	0.380441	3308439
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.404937	0.409818	3308787
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	0.660899	0.662517	3309024
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	1.26181	1.26337	3308361
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	1.44178	1.64077	3308820
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.61675	1.61967	3308823
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	1.83472	1.83562	3309162
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	1.83572	1.84265	3309000
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	1.91771	1.91912	3308844
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	2.54561	2.5459	3308811
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	3.17352	3.17385	3308364
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	3.9604	3.96484	3308805
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	5.53016	5.54994	3308829
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	7.99678	8.00404	3308841
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	8.96464	8.97113	3308808
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	9.97348	9.97807	3308790
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	10.0855	10.0863	3308523
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	10.6114	10.6136	3308817
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	12.7761	12.7826	3309021
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	13.6749	13.6812	3309213
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	14.2198	14.2263	3308727
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	15.0127	31.9204	3308358
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	16.0936	16.0967	3309210
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	20.1059	20.113	3308697
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	20.5079	20.5134	3308733
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	22.0526	22.0586	3308616
manol-pipe-c6bidw_i.cnf	UNSAT	23.7744	23.7875	3308421
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	33.5269	33.5339	3309042
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	33.6819	33.6845	3309087
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	36.5104	36.5169	3308769
velev-pipe-o-uns-1.1-6.cnf	UNSAT	39.444	39.445	3308583
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	41.7557	41.7595	3309084
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	42.1736	42.1777	3309189
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	42.5615	42.6333	3308991
manol-pipe-f7nidw.cnf	UNSAT	43.5814	43.8291	3308427
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	44.3183	44.327	3308316
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	48.3896	48.3909	3308517
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	63.3044	63.3135	3308847
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	69.4964	69.5033	3308526
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	73.8268	73.8302	3309171
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	77.2913	77.293	3308997
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	80.8417	80.8431	3308376
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	83.4213	83.4505	3308505
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	113.913	113.915	3308826
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	130.465	130.467	3308340
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	134.2	134.202	3308814
velev-pipe-o-uns-1.0-7.cnf	UNSAT	159.27	159.308	3308586
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	180.905	180.906	3308502
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	184.888	184.896	3308751
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	197.388	197.388	3308511
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	215.5	215.499	3308700
manol-pipe-c10nidw.cnf	UNSAT	308.734	308.725	3308415
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	370.738	370.734	3308715
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	372.265	372.264	3308760
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	486.687	486.732	3308862
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	525.137	525.133	3308853
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	530.926	530.924	3308721
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	561.738	561.746	3308874
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	563.938	563.926	3308871
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	575.104	576.508	3308688
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	585.899	585.887	3308859
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	664.134	664.12	3308538
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	680.131	680.168	3308877
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	828.713	828.712	3308913
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	848.228	848.238	3308802
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	884.583	884.562	3308835
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	1030.21	1030.18	3309159

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.005998	0.00873695	3309138
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.007997	0.00828104	3309126
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.016996	0.0181981	3309174
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.017996	0.0204571	3309129
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.037993	0.0382129	3309132
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.071988	0.0734761	3308979
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.230964	0.2348	3309177
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.531918	0.531472	3309150
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	1.01184	1.01355	3308592
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.21181	1.21496	3308562
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	1.53277	3.23208	3308736
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	2.25266	2.25987	3308604
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	2.55361	2.55873	3308529
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	2.5976	2.60411	3308598
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	3.67244	3.6792	3308781
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	5.05823	5.07309	3308778
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	6.13207	6.14001	3308619
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	6.541	6.55092	3308601
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	6.75597	6.76063	3308763
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	6.90995	6.91624	3308772
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	9.23959	9.24778	3308556
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	9.8775	9.90976	3308613
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	11.3493	11.3754	3308607
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	11.5132	11.521	3308595
application/manthey/ traffic/traffic_r_sat.cnf	SAT	14.3108	14.3375	3308868
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	15.9846	15.9879	3308766
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	17.5653	17.5699	3309006
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	18.9531	18.9714	3308493
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	19.797	19.8078	3309102
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	22.1946	22.1974	3309099
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	27.4428	27.4434	3308976
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	32.4991	32.5087	3308409
ibm-2004-01-k90.cnf	SAT	37.9522	37.9555	3308433
ibm-2002-21r-k95.cnf	SAT	38.3322	38.3401	3308589
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	49.4605	49.4744	3308514
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	50.0764	50.0833	3308484
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	59.442	59.4458	3308634
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	64.5912	64.5909	3309111
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	88.6575	88.6686	3308550
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	90.6552	90.6746	3308730
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	109.035	109.038	3308718
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	111.301	111.336	3308553
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	122.449	122.449	3308712
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	148.149	148.16	3309003
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	188.557	188.554	3309015
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	203.806	203.858	3308865
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	230.43	230.427	3309039
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	239.45	239.457	3308391
ibm-2004-23-k100.cnf	SAT	307.04	307.036	3308424
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	528.147	528.16	3308520
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	530.834	530.851	3308394
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	561.774	561.765	3308994
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	572.898	572.889	3309108
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	613.133	613.155	3308541
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	665.745	665.733	3308499
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	865.034	865.028	3308856
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1031.99	1031.96	3308568
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	1138.58	1138.57	3308322
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	1240.24	1241.09	3308355
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	1254.43	1254.45	3309012

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	1299.93	1300.01	3309048
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	? (TO)	1299.93	1300.01	3308919
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	1299.93	1300.01	3308937
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	1299.93	1300.01	3308532
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	1299.94	1300.01	3308775
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	? (TO)	1299.94	1300.01	3308475
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	1299.94	1300.01	3308451
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	? (TO)	1299.95	1300.01	3308370
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	1299.95	1300.01	3308673
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (TO)	1299.95	1300.01	3308670
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	? (TO)	1299.95	1300.01	3309066
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	1299.95	1300.01	3308448
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	1299.95	1300.01	3308382
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	? (TO)	1299.96	1300.01	3308436
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	1299.96	1300.01	3309045
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	1299.96	1300.01	3309027
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	1299.96	1300.01	3308946
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (TO)	1299.97	1300.01	3308397
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	1299.97	1300.01	3309054
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	1299.97	1300.02	3308352
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	? (TO)	1299.97	1300.02	3308988
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	1299.98	1300.01	3309168
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	1299.99	1300.01	3308469
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	1299.99	1300.01	3308952
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	1299.99	1300.01	3309165
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	1299.99	1300.01	3308658
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	1299.99	1300.03	3308379
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	1299.99	1300.01	3308457
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	1299.99	1300.01	3308646
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	? (TO)	1299.99	1300.01	3308748
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	? (TO)	1300	1300.01	3308664
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	1300	1300.01	3308622
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	1300	1300.01	3308574
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (TO)	1300	1300.01	3309093
velev-vliw-uns-4.0-9-i1.cnf	? (TO)	1300	1300.01	3308412
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	1300	1300.01	3308388
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	? (TO)	1300	1300.01	3309075
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	1300.01	1300.01	3308319
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	? (TO)	1300.01	1300.01	3308925
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (TO)	1300.01	1300.01	3308667
application/fuhs/ AProVE11/AProVE11-06.cnf	? (TO)	1300.01	1300.01	3308610
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	1300.01	1300.01	3309201
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	? (TO)	1300.01	1300.01	3309153
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	1300.01	1300.01	3309147
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	1300.01	1300.01	3309114
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	1300.01	1300.01	3309051
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	? (TO)	1300.01	1300.01	3309018
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	1300.01	1300.01	3308985
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	? (TO)	1300.01	1300.01	3308931
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	1300.01	1300.01	3308922
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	? (TO)	1300.01	1300.01	3308910
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	1300.01	1300.01	3308895
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	1300.01	1300.01	3308832
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	1300.01	1300.01	3308799
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	1300.01	1300.01	3308796
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	1300.01	1300.01	3308784
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	? (TO)	1300.01	1300.01	3308745
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	1300.01	1300.01	3308679
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	1300.01	1300.01	3308676
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	1300.01	1300.01	3308661
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (TO)	1300.01	1300.01	3308655
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	1300.01	1300.01	3308628
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	? (TO)	1300.01	1300.01	3308742
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	1300.01	1300.01	3308565
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	1300.01	1300.01	3308559
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	? (TO)	1300.01	1300.01	3308535
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	1300.01	1300.01	3309072
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	1300.01	1300.01	3308328
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	1300.01	1300.01	3308334
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	1300.01	1300.01	3308349
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	1300.01	1300.01	3308367
SAT_RACE08/Q1/ SAT_dat.k85.cnf	? (TO)	1300.01	1300.01	3308406
mizh-sha0-36-4.cnf	? (TO)	1300.01	1300.01	3308418
ibm-2002-30r-k85.cnf	? (TO)	1300.01	1300.01	3308430
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	1300.01	1300.01	3308442
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	1300.01	1300.01	3308460
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	1300.01	1300.01	3308472
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	1300.02	1300.01	3308478
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	1300.02	1300.01	3308850
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	1300.02	1300.01	3308955
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	1300.02	1300.01	3308964
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	1300.02	1300.01	3309060
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	? (TO)	1300.02	1300.01	3308970
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	1300.02	1300.01	3309063
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	1300.02	1300.01	3308940
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	1300.02	1300.01	3308973
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	1300.02	1300.01	3308934
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	? (TO)	1300.02	1300.01	3309069
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	1300.02	1300.01	3308928
industrial/crypto/ mizh-sha0-36-2.cnf	? (TO)	1300.02	1300.01	3308373
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	1300.02	1300.01	3309009
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	1300.02	1300.01	3308916
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	1300.02	1300.01	3308883
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	1300.02	1300.01	3308907
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	1300.02	1300.01	3308904
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	1300.02	1300.01	3308901
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	1300.02	1300.01	3308898
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	1300.02	1300.01	3308886
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	1300.02	1300.01	3308889
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	1300.02	1300.01	3309030
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	? (TO)	1300.02	1300.01	3308757
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	? (TO)	1300.02	1300.02	3308754
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	1300.02	1300.01	3309057
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	1300.02	1300.01	3309117
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	? (TO)	1300.02	1300.01	3309186
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (TO)	1300.02	1300.01	3309195
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	1300.02	1300.01	3308385
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	? (TO)	1300.02	1300.01	3308571
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	1300.02	1300.01	3309198
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	1300.02	1300.01	3308454
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	? (TO)	1300.02	1300.01	3308547
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	? (TO)	1300.02	1300.01	3308544
industrial/fuhs/hard/ AProVE07-03.cnf	? (TO)	1300.02	1300.01	3308346
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	1300.02	1300.01	3309096
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	? (TO)	1300.02	1300.01	3308703
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	1300.02	1300.01	3308892
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	? (TO)	1300.02	1300.01	3308325
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	1300.02	1300.01	3308463
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	1300.02	1300.01	3308793
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	1300.02	1300.01	3308466
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	? (TO)	1300.02	1300.01	3308685
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	1300.02	1300.01	3308343
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	1300.02	1300.01	3308967
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	? (TO)	1300.02	1300.01	3309183
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	? (TO)	1300.02	1300.01	3309141
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	1300.03	1300.01	3309144
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	1300.03	1300.02	3308691
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	1300.03	1300.01	3308682
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	1300.03	1300.01	3309078
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	? (TO)	1300.03	1300.01	3308643
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	1300.03	1300.01	3308637
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	1300.03	1300.01	3308445
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	1300.03	1300.01	3309081
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	? (TO)	1300.03	1300.01	3308838
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	1300.03	1300.01	3309090
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	1300.03	1300.01	3308481
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	1300.03	1300.01	3308331
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	1300.03	1300.01	3308337
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	1300.03	1300.01	3309105
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	1300.03	1300.01	3308961
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	1300.03	1300.01	3308958
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	1300.03	1300.01	3308949
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	1300.03	1300.01	3308943
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	1300.03	1300.01	3309120
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	? (TO)	1300.03	1300.01	3309135
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	1300.03	1300.01	3308880
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	1300.04	1300.02	3308631
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	1300.04	1300.01	3308652
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (TO)	1300.04	1300.01	3309192
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	1300.04	1300.01	3308982
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	1300.04	1300.01	3308706
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	? (TO)	1300.05	1300.01	3308496
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	1300.05	1300.01	3308487
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	1300.05	1300.01	3308490

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	? (exit code)	0.005998	0.00778809	3309123
velev-pipe-sat-1.0-b9.cnf	? (exit code)	10.4304	10.435	3308580
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	? (exit code)	27.3298	27.3304	3309207
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	? (exit code)	29.3925	29.3936	3308694
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	? (exit code)	47.5618	47.5612	3308709
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	? (exit code)	50.0174	50.0172	3308403
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	? (exit code)	85.9369	85.9365	3308508
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	? (exit code)	94.2727	94.2736	3308649
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	? (exit code)	116.533	116.536	3308400
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	? (exit code)	118.285	118.283	3308625
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	? (exit code)	122.846	122.853	3308739
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	? (exit code)	139.644	139.642	3308640
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	? (exit code)	214.504	214.507	3308724
velev-npe-1.0-9dlx-b71.cnf	? (exit code)	357.748	357.742	3308577
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (exit code)	601.361	601.356	3309204

SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Result page for solver SAT09 reference solver:LySAT i/2009-03-20 (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (71 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (60 runs) [Show/Hide]

Solver timed out (no solution given) (154 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (15 runs) [Show/Hide]