SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	3.01054	1.24776	3322721
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	4.38633	1.6733	3321372
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	5.2542	1.46361	3322725
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	8.06277	4.44599	3321663
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	8.95064	7.21028	3322543
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	16.3095	6.58831	3322527
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	17.0124	11.653	3321687
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	30.6253	14.9709	3321701
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	35.7966	15.819	3321679
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	41.4527	29.5036	3321320
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT	43.9053	12.0526	3322729
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	47.1818	8.52421	3322521
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	54.5397	10.5214	3322629
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	64.1522	9.00317	3322723
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	65.3361	10.5228	3322541
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	81.0217	67.1648	3321322
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	84.1882	49.5514	3321675
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	97.7081	29.7464	3321699
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	104.099	49.7107	3321691
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	123.277	19.0322	3322525
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	129.436	27.4089	3321665
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	140.795	56.5865	3321683
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	146.56	108.086	3321433
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	165.239	23.6338	3322631
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	174.615	46.4391	3321289
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	178.718	25.1212	3322347
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	208.372	71.2659	3321317
velev-pipe-o-uns-1.1-6.cnf	UNSAT	222.433	39.1351	3321524
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	238.441	53.9105	3321677
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	251.315	201.577	3322757
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	270.266	35.1399	3322719
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	272.014	113.146	3321627
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	289.811	66.709	3321605
manol-pipe-c6bidw_i.cnf	UNSAT	294.219	55.0149	3321360
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	296.585	45.1136	3321623
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	297.541	56.7221	3321681
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	309.282	62.1266	3321703
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	312.181	125.684	3321639
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	318.173	65.2606	3321549
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	320.639	75.6383	3321421
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	340.971	200.357	3321641
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	351.099	99.1873	3322743
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	371.431	62.3909	3322586
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	392.829	194.734	3321603
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	398.411	210.021	3321651
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	438.083	145.674	3321330
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	465.321	59.3002	3322727
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	466.363	60.3942	3321396
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	474.246	100.426	3321429
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	476.701	402.136	3322759
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	505.3	110.76	3321435
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	532.3	92.9795	3321615
manol-pipe-f7nidw.cnf	UNSAT	553.085	190.71	3321364
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	562.309	246.775	3321631
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	656.539	319.83	3321645
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	713.699	90.3838	3321305
velev-pipe-o-uns-1.0-7.cnf	UNSAT	714.322	116.003	3321526
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	778.858	104.688	3322731
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	974.982	163.784	3321697
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1073.44	139.388	3321637
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	1199.86	649.617	3321555
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	1233.65	169.04	3321689
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	1314.64	195.035	3321419
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	1368.11	181.36	3321619
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	1577.42	220.466	3322345
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	UNSAT	1604.3	203.712	3322590
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	1673.76	228.058	3321695
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	1936.61	258.348	3321673
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	1993.23	383.49	3321597
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	2038.07	255.797	3322711
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	UNSAT	2095.06	263.218	3322715
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	2097.17	328.062	3321443
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	2380.18	610.495	3321425
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	2382.84	327.365	3321633
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	2760.07	371.762	3321721
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	2771.14	423.933	3321719
manol-pipe-c10nidw.cnf	UNSAT	2813.47	575.033	3321356
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	2819.23	382.182	3321707
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	2841.59	381.044	3321711
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	2980.2	402.359	3321713
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	3259.88	463.602	3322713
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	3528.26	462.441	3321723
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	3734.58	570.365	3321441
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	4495.53	604.811	3321575
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	4580.05	1143.93	3321595
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	4745.69	4686.42	3322755
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	6563.81	823.071	3321309
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	7341.85	1178.55	3322635
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	8229.55	1035.13	3322539
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT	8273.21	1042.22	3321667
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	8374.4	1051.52	3322592
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	8547.03	1078.04	3321394
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	8547.75	1080.82	3322533
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	UNSAT	8927.65	1121.87	3322357
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	9280.15	1329.74	3322753
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	14646	1914.72	3321299
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	16405.3	2092.11	3321303
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	19025.2	2424.47	3321370
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	UNSAT	21251.4	2756.81	3321374
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	UNSAT	21654.4	2728.95	3321669
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	21933.3	2749.31	3321326
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT	27321.7	3428.77	3322594
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	31811.5	4109.1	3321297
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	33541.8	4306.96	3321439
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	34046	4281.42	3321400

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	1.08283	0.984964	3322693
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	4.22636	1.83265	3322735
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	4.74228	4.12452	3322717
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	8.78366	6.58625	3321463
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	9.71852	9.03658	3321459
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	11.1333	2.21569	3322511
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	13.042	10.4484	3321629
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	14.8067	9.27746	3321533
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	16.7195	13.1571	3322623
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	24.2203	5.77571	3322679
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	41.7636	31.5311	3321437
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	45.829	18.3439	3321541
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	46.3639	17.7157	3321535
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	53.9298	13.1398	3322531
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	54.3207	11.1043	3321408
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	62.2825	24.5743	3321537
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	77.7712	51.1457	3321659
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	92.322	59.3219	3321647
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	103.334	74.9896	3321657
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	118.14	106.921	3321653
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	121.66	109.612	3321649
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	139.522	47.1187	3322537
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	152.701	89.8256	3321551
ibm-2004-01-k90.cnf	SAT	162.584	32.631	3321368
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	166.607	45.3132	3321352
application/manthey/ traffic/traffic_r_sat.cnf	SAT	167.311	144.449	3321717
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	170.037	119.171	3321455
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	177.183	31.7432	3322739
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	194.896	170.558	3322639
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	196.558	57.2677	3321613
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	199.188	29.3823	3321402
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	206.245	176.33	3322641
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	211.928	41.6871	3322741
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	245.335	108.409	3321539
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	254.165	180.82	3321561
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	258.321	59.9802	3322553
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	271.936	150.549	3321543
mizh-sha0-36-4.cnf	SAT	282.666	45.2642	3321358
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	288.762	40.4466	3321412
ibm-2002-21r-k95.cnf	SAT	293.228	94.873	3321528
velev-pipe-sat-1.0-b9.cnf	SAT	341.503	303.402	3321522
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	347.476	215.395	3321617
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	412.557	146.028	3321625
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	420.025	73.847	3322523
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	464.789	73.7676	3322529
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	524.203	369.514	3321547
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	529.142	102.004	3321451
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	549.007	226.946	3321643
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	SAT	578.703	99.9639	3322625
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	666.574	87.2461	3322677
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	705.217	293.425	3321621
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	738.997	171.76	3321427
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	743.279	167.632	3321453
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	780.225	164.907	3321715
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	793.872	181.827	3321445
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	826.876	761.162	3321348
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	SAT	858.592	245.653	3321291
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	873.737	126.151	3321465
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	884.982	767.299	3321346
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	936.799	130.932	3321328
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	1056.84	143.79	3321635
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	1168.59	855.538	3321601
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	1168.67	237.666	3321295
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	1187.16	162.218	3322325
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	1215.29	259.705	3321293
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	1239.6	160.262	3322681
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	1412.8	257.817	3322535
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	1425.02	214.611	3322351
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	1544.3	937.203	3321611
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	1585.26	1053.43	3321565
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	1671.72	1005.19	3321571
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	1799.14	307.424	3321350
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	1828.17	611.399	3321709
ibm-2004-23-k100.cnf	SAT	2031.66	323.009	3321362
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	2491.39	380.398	3321431
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	2952.61	389.626	3322359
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	SAT	3141.43	397.747	3321406
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	3373.76	426.577	3321410
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	4235.98	531.475	3322507
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	5394.67	780.11	3321447
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	5604.37	792.235	3321342
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	5654.22	713.851	3322675
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT	6197.85	875.65	3322353
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	6434.95	3394.17	3322695
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	7340.75	1024.49	3321449
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	8556.15	1120.17	3321340
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	9943.04	1262.57	3322355
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	SAT	10034.3	1268.31	3322343
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	SAT	10532.9	1578.07	3321553
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	SAT	10914.8	1296.08	3321557
ibm-2002-30r-k85.cnf	SAT	13710.9	1775.41	3321366

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	? (TO)	5099.3	5100.22	3321423
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	? (TO)	8448.6	5100.04	3322519
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	35783.6	5100.13	3322365
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	36368.9	5100.15	3322495
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	39908.2	5100.17	3321655
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	40000.1	5025.85	3322339
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	40000.1	5034.76	3321386
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	40000.1	5020.63	3321336
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	40000.1	5018.37	3321376
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	40000.2	5030.16	3321398
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	40000.2	5060.17	3321301
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	40000.2	5017.15	3322499
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	40000.2	5016.94	3322505
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	40000.2	5027.55	3322683
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	40000.3	5020.13	3322361
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	40000.3	5018.74	3321457
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	40000.3	5027.46	3321338
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	40000.3	5016.25	3322517
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	40000.3	5064.86	3321693
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	40000.3	5016.95	3322509
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	40000.3	5027.19	3322327
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	40000.3	5020.55	3322685
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	40000.3	5025.07	3322337
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	40000.3	5024.56	3322341
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	40000.3	5016.44	3321380
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	40000.4	5025.58	3322371
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	40000.4	5026.45	3322367
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	40000.4	5020.05	3322349
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	40000.4	5019.96	3321461
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	40000.4	5021.73	3322598
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	40000.4	5032.76	3322329
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	40000.4	5018.84	3322331
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	40000.4	5058.16	3321671
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	40000.4	5022.65	3322501
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	40000.4	5018.55	3321404
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	40000.5	5015.95	3321390
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	40000.5	5022.85	3322335
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	40000.5	5019.64	3322363
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	40000.6	5024.14	3322369
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	40000.6	5024.66	3321332
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	40000.6	5015.83	3321324
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	40000.6	5017.63	3322497
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	40000.6	5016.85	3322627
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	40000.6	5016.34	3322515
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	40000.6	5023.94	3321382
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	40000.7	5034.96	3321384
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	40000.7	5032.07	3321378
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	40000.7	5070.76	3321705
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	40000.8	5018.14	3322588
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	40000.8	5019.25	3321467
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	40000.8	5015.75	3322600
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	40000.8	5027.64	3322333
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	40000.8	5036.57	3321661
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	40000.8	5018.05	3321307
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	40000.8	5017.26	3322503
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	40000.8	5021.94	3321334
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	40000.9	5020.54	3322596

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (MO)	1847.14	285.607	3321587
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	? (MO)	2114.9	891.911	3321607
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	? (MO)	2132.65	689.63	3321581
velev-npe-1.0-9dlx-b71.cnf	? (MO)	2227.73	1515.54	3321520
industrial/palacios/medium/ cube-11-h14-sat.cnf	? (MO)	2278.61	586.57	3321315
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (MO)	2360.68	363.378	3321563
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (MO)	2518.89	1001.44	3321583
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (MO)	2592.9	489.607	3321313
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (MO)	2794.41	387.081	3321569
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (MO)	3123.76	427.485	3321591
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (MO)	3387.05	1453.93	3321559
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (MO)	3423.22	1134.91	3322745
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (MO)	3804.24	1972.74	3321609
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (MO)	4017.89	528.159	3321311
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (MO)	4169.33	2304.99	3321573
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (MO)	4287.4	726.48	3322751
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (MO)	4513.4	1055.05	3322637
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (MO)	4601.78	1141.11	3322747
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (MO)	5151.68	3431.48	3321599
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (MO)	5219.74	3370.45	3321585
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (MO)	5636.46	1037.65	3322633
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	? (MO)	5943.2	1210.35	3321567
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (MO)	6554.82	1076.95	3321344
velev-vliw-uns-4.0-9-i1.cnf	? (MO)	10371.9	1413.56	3321354
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (MO)	11823.2	1615.95	3322749
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	? (MO)	13007	2689.55	3322602
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (MO)	13264	1756.45	3321593
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (MO)	13688.8	1997.69	3321577
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (MO)	20277.7	2563.12	3321589
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	? (MO)	20458.8	2797.38	3322604
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (MO)	21017	2655.42	3321579
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (MO)	22802.6	2951.34	3322606
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (MO)	26398.7	3454.57	3322547
application/fuhs/ AProVE11/AProVE11-06.cnf	? (MO)	26531.3	3450.77	3321545
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (MO)	27588.8	3516.16	3321388
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (MO)	28939.1	3761.08	3322545
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (MO)	32879	4178.65	3321392

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	? (exit code)	0.756884	0.95945	3322687
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	? (exit code)	0.763883	0.781425	3322689
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	? (exit code)	0.905861	0.974986	3322709
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	? (exit code)	0.961852	0.813517	3322737
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	? (exit code)	0.97985	0.897065	3322691
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	? (exit code)	1.04784	0.980481	3322513
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	? (exit code)	1.06884	1.02031	3322733
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	? (exit code)	2.89556	2.97069	3322549
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	? (exit code)	2.94955	3.35741	3322551
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	? (exit code)	10.1345	9.48325	3321685

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver borg-sat 11.03.02-industrial [DEPRECATED] (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (105 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (91 runs) [Show/Hide]

Solver timed out (no solution given) (57 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (37 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (10 runs) [Show/Hide]