SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.006998	0.016844	3422627
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.009997	0.017817	3422531
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.010997	0.017825	3422529
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.117982	0.119324	3422611
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.166973	0.168198	3422133
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	0.448931	0.449822	3422081
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	0.508922	0.509713	3422083
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.574912	0.576211	3422387
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	0.612906	0.613486	3422389
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	0.744886	0.747046	3422381
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	0.754885	0.754955	3422403
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	0.964853	0.964327	3422523
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	1.60176	1.60188	3422507
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	2.04569	2.04776	3422615
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	2.29565	2.29753	3422377
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	2.91156	2.91148	3422649
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	3.06253	3.06341	3422393
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	3.88941	3.88941	3422343
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	4.05938	4.06025	3422401
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	4.21336	4.21421	3422647
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	4.28835	4.28871	3422189
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	4.33734	4.3381	3422367
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	4.62829	4.62975	3422385
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	5.9091	5.91011	3422379
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	6.53301	6.53395	3422521
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	8.73467	8.7352	3422563
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	9.8835	9.88935	3422341
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	10.4274	10.4276	3422325
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	10.5224	10.5237	3422329
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	11.5262	11.5255	3422353
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	11.7682	11.7699	3422251
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	12.1042	12.1201	3422079
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	16.6035	16.6028	3422305
manol-pipe-c6bidw_i.cnf	UNSAT	18.6752	18.6751	3422121
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	19.0111	19.011	3422501
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	19.2641	19.273	3422645
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	19.656	19.6553	3422347
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	29.2416	29.2413	3422405
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	35.8226	35.8241	3422633
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	41.0888	41.0936	3422383
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	41.8136	41.8131	3422185
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	45.4501	45.4493	3422191
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	45.997	45.9966	3422535
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	47.7487	47.7527	3422505
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	48.0727	48.0778	3422565
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	51.2062	51.2182	3422051
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	60.0129	60.0141	3422333
manol-pipe-f7nidw.cnf	UNSAT	71.4151	71.4224	3422125
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	77.9921	77.9911	3422177
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	88.0456	88.0481	3422391
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	96.4893	96.4889	3422175
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	144.373	144.369	3422257
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	151.305	151.304	3422181
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	185.219	185.259	3422091
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	204.072	204.071	3422307
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	214.199	214.191	3422421
velev-pipe-o-uns-1.0-7.cnf	UNSAT	236.376	236.37	3422231
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	238.698	238.718	3422621
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	249.414	249.427	3422409
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	254.564	254.558	3422423
manol-pipe-c10nidw.cnf	UNSAT	271.414	271.416	3422117
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	273.454	273.444	3422613
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	274.566	274.559	3422067
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	289.017	289.007	3422425
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	293.909	293.921	3422199
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	295.904	295.894	3422415
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	311.29	311.281	3422413
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	330.882	330.873	3422317
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	332.897	332.891	3422449
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	396.665	396.651	3422617
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	437.883	439.037	3422397
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	438.324	438.334	3422299
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	620.462	620.451	3422321
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	649.768	649.848	3422519
velev-pipe-o-uns-1.1-6.cnf	UNSAT	675.169	675.175	3422229
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	845.26	845.238	3422447
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	885.053	885.028	3422637
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	1259.73	1259.7	3422635
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	1408.17	1408.15	3422197
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	UNSAT	1433.54	1433.5	3422213
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	1543.91	1543.9	3422161
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	1691.84	1691.78	3422131
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	1720.49	1720.44	3422157
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	1731.35	1731.3	3422247
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	1733.93	1733.87	3422553
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	1804.09	1804.06	3422551
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1841.54	1841.68	3422339
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	1872.04	1872.04	3422609
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	1877.94	1877.88	3422297
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	1992.98	1992.89	3422269
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	2471.29	2471.23	3422097
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	2561.68	2561.57	3422601
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	2865.52	2865.46	3422375
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	2961.09	2960.98	3422095
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	3537.2	3537.14	3422099
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	3643.85	3643.79	3422093
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	4288.48	4288.38	3422603
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	4962.99	4962.91	3422335

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.000999	0.016767	3422589
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.004998	0.015816	3422599
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.004998	0.016503	3422591
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.006998	0.016337	3422593
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.007998	0.018047	3422623
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.014996	0.0160551	3422595
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.015996	0.016896	3422493
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.137978	0.154153	3422625
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.360945	0.361928	3422607
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	0.370943	0.370543	3422235
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	0.393939	0.395346	3422331
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	0.610906	0.610902	3422243
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	0.777881	0.778789	3422219
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	0.875865	0.878938	3422239
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	0.890863	0.892666	3422351
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	1.07583	1.07653	3422193
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.09683	1.10207	3422215
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	1.23881	1.23859	3422349
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	1.24881	1.24902	3422345
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	1.37479	1.37481	3422361
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.45378	1.45749	3422557
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	1.51677	1.51756	3422359
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	1.55076	1.55171	3422581
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	1.92071	1.92017	3422253
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	1.9677	1.97099	3422355
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	3.43448	3.43555	3422237
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	3.98639	3.98838	3422211
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	4.17337	4.17496	3422245
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	4.72228	4.72372	3422249
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	4.95925	4.96368	3422491
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	6.33004	6.34598	3422241
application/manthey/ traffic/traffic_r_sat.cnf	SAT	9.42057	9.44166	3422419
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	13.6669	13.6671	3422113
ibm-2002-21r-k95.cnf	SAT	13.7189	13.7195	3422233
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	14.2698	14.2712	3422207
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	15.9636	15.9639	3422169
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	17.0124	17.0139	3422511
ibm-2004-01-k90.cnf	SAT	17.3054	17.3094	3422129
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	23.7384	23.7385	3422183
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	24.1893	24.1908	3422303
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	28.7366	28.7407	3422273
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	29.3515	29.3526	3422263
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	37.6253	37.6941	3422313
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	41.7846	44.2245	3422319
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	42.5285	42.5325	3422327
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	43.1564	43.1568	3422575
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	44.5352	44.5384	3422573
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT	59.5859	59.6035	3422179
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	59.6959	59.6959	3422163
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	64.3782	64.3775	3422107
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	65.0171	65.0175	3422533
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	69.0105	69.0088	3422267
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	73.5358	73.5335	3422109
mizh-sha0-36-4.cnf	SAT	76.0884	76.0886	3422119
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	76.5954	76.5947	3422323
velev-pipe-sat-1.0-b9.cnf	SAT	77.2782	77.2852	3422227
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	77.4412	77.4399	3422579
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	83.6513	83.6675	3422209
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	83.7923	83.7908	3422509
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	84.5881	84.5874	3422103
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	85.0481	85.0459	3422517
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	99.0889	99.2554	3422089
ibm-2004-23-k100.cnf	SAT	107.78	107.778	3422123
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	125.338	125.336	3422315
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	170.933	170.926	3422597
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	184.943	185.045	3422631
velev-npe-1.0-9dlx-b71.cnf	SAT	226.537	226.532	3422225
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	227.34	227.334	3422173
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	228.247	228.26	3422201
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	260.195	260.193	3422055
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	332.911	332.903	3422515
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	354.409	354.4	3422503
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	362.99	362.981	3422629
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	410.919	410.906	3422187
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	415.992	415.979	3422057
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	507.077	507.081	3422101
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	540.3	540.282	3422417
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	580.658	580.829	3422283
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	836.943	836.925	3422111
ibm-2002-30r-k85.cnf	SAT	838.475	838.453	3422127
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	938.798	938.769	3422077
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	1000.25	1000.23	3422499
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	1149.58	1149.62	3422221
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	1202.56	1202.53	3422487
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	SAT	1310.08	1310.04	3422165
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	1311.41	1311.37	3422427
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	1352.96	1352.93	3422457
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	1402.42	1402.97	3422411
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	1720.85	1720.79	3422309
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	1789.19	1789.17	3422583
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	SAT	2082.64	2082.6	3422259
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	2865.07	2864.98	3422461
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	3086.85	3086.92	3422453
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	3254.49	3254.39	3422205
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	SAT	3543.66	3543.58	3422285
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	3617.25	3617.12	3422577
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	4010.27	4010.14	3422203
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT	4017.5	4017.45	3422261

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.03	5000.03	3422217
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.04	4999.93	3422471
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000.04	4999.83	3422475
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.04	4999.92	3422141
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	5000.04	4999.93	3422369
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	5000.04	4999.93	3422539
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.04	4999.93	3422459
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.04	4999.92	3422479
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.05	4999.93	3422473
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.05	4999.93	3422223
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	5000.05	4999.95	3422559
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.05	4999.93	3422467
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	5000.05	4999.92	3422541
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	5000.05	4999.93	3422395
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.05	4999.93	3422437
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.05	5000.82	3422441
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.05	4999.93	3422443
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.05	4999.93	3422477
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	5000.06	4999.83	3422065
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.06	4999.84	3422481
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	5000.06	4999.95	3422059
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000.06	5000.04	3422431
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.06	4999.82	3422137
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.06	4999.91	3422605
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	5000.06	4999.93	3422587
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	5000.06	4999.93	3422585
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.06	4999.93	3422465
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.06	4999.93	3422143
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.06	4999.94	3422281
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.06	4999.94	3422547
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.06	4999.92	3422495
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	5000.06	4999.92	3422543
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	5000.07	4999.95	3422135
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.07	4999.92	3422429
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	5000.07	4999.93	3422619
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.07	4999.93	3422463
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000.07	4999.94	3422357
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.07	4999.95	3422555
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	5000.07	5000.03	3422155
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.07	5000.28	3422153
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.07	5000.13	3422151
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	5000.07	4999.95	3422149
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.07	5000.04	3422147
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.07	4999.93	3422073
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.07	4999.92	3422069
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.08	4999.92	3422085
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	? (TO)	5000.08	5000.03	3422171
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	? (TO)	5000.08	4999.93	3422365
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	5000.08	4999.94	3422363
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.08	4999.92	3422485
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.08	4999.91	3422549
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.08	4999.92	3422451
industrial/fuhs/hard/ AProVE07-03.cnf	? (TO)	5000.08	4999.93	3422071
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.09	4999.93	3422145
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.09	4999.92	3422561
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	5000.09	4999.93	3422371
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.09	5000.12	3422497
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	5000.09	5000.13	3422513
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.09	4999.93	3422469
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.1	5000.02	3422483
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.1	4999.99	3422291
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.1	4999.94	3422545
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	? (TO)	5000.1	5000.02	3422087
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	? (TO)	5000.1	4999.94	3422399
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.1	4999.93	3422433
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	5000.1	5000.13	3422373
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000.11	4999.93	3422489
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.11	4999.93	3422159
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.11	4999.93	3422139
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	? (TO)	5000.11	4999.95	3422337
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.12	5000.03	3422439
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000.12	4999.93	3422435
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	5000.12	4999.93	3422537
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.12	5000.22	3422167
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	5000.12	5000.04	3422061
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	5000.12	4999.93	3422455
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.13	5000.03	3422445
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.14	5000.01	3422063
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	5000.15	4999.96	3422407
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.15	5000.29	3422527
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	5000.15	5000.25	3422075
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	5000.17	4999.99	3422195
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	5000.17	5000.01	3422525
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (TO)	5000.19	5000.03	3422105
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.21	4999.98	3422289
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.21	5000.09	3422293
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (TO)	5000.22	5000.05	3422569
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	5000.23	5000.06	3422567
velev-vliw-uns-4.0-9-i1.cnf	? (TO)	5000.24	5000.05	3422115
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.24	5000	3422265
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	5000.25	5000.11	3422639
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (TO)	5000.25	5000.09	3422277
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.25	5000.1	3422641
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.27	5000.03	3422053
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	5000.28	5000.14	3422279
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	5000.29	5000.2	3422571
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.32	5000.22	3422271
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (TO)	5000.39	5000.31	3422643
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	5000.41	5000.18	3422295
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	5000.42	5000.32	3422255

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (problem)	3662.42	3662.31	3422311
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (problem)	3950.96	3950.86	3422301
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (problem)	4031.31	4031.16	3422287
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (problem)	4228.21	4228.12	3422275

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver minisat hack: EBMiniSAT 2011-03-02 (incomplete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (98 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (98 runs) [Show/Hide]

Solver timed out (no solution given) (100 runs) [Show/Hide]

No recognized solution line (4 runs) [Show/Hide]