SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.006998	0.0112181	3291152
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.006998	0.00765595	3291106
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.011997	0.012976	3293360
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.185971	0.186277	3292992
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.342947	0.34286	3281998
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.907861	0.913433	3287334
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	1.19582	1.19555	3287840
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.40579	1.40862	3287886
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	1.63675	1.63983	3288208
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	1.72474	1.72491	3287702
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	2.06169	2.06274	3293084
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	2.29965	2.29988	3280848
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	2.53361	2.53424	3280802
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	2.93455	2.93541	3290968
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	3.67544	3.67549	3290600
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	5.13822	5.13777	3287610
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	5.70513	5.70625	3290462
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	6.50001	6.50652	3287978
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	8.59169	8.62303	3291888
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	9.28559	9.2881	3293820
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	9.40957	9.41019	3287058
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	10.2394	10.2392	3288162
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	11.2363	11.2356	3283286
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	11.7942	11.7952	3293866
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	11.9812	11.9813	3290922
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	13.114	13.1206	3287380
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	13.6109	13.611	3287794
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	18.9561	19.0203	3293774
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	20.1969	20.1977	3286828
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	21.7867	21.7872	3286782
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	24.3853	24.3856	3285954
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	26.578	26.5777	3287656
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	29.8015	29.8057	3284712
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	29.9145	29.9135	3286414
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	30.5034	30.5057	3290554
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	31.5042	31.5045	3286506
velev-pipe-o-uns-1.1-6.cnf	UNSAT	34.7677	34.7758	3284206
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	34.9487	34.9482	3286920
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	37.1634	37.1624	3291244
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	40.9728	40.9748	3280756
manol-pipe-c6bidw_i.cnf	UNSAT	41.4717	41.4706	3281722
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	44.0633	44.0678	3291934
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	45.6371	45.6375	3280112
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	47.0269	47.0307	3283194
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	60.8507	60.8497	3283332
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	65.614	65.6151	3293038
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	70.3623	70.3656	3288254
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	75.8925	75.891	3289266
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	81.3986	81.3998	3293498
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	90.0233	90.0244	3287748
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	101.864	101.859	3286598
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	158.927	158.927	3280480
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	167.17	167.168	3284850
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	185.894	185.893	3282964
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	205.856	205.852	3283010
velev-pipe-o-uns-1.0-7.cnf	UNSAT	257.954	257.947	3284252
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	270.336	270.337	3287932
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	280.891	280.892	3289220
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	281.38	281.374	3283102
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	284.185	284.177	3281032
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	379.153	379.143	3282550
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT	383.093	383.087	3293176
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	395.855	395.845	3292946
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	466.063	466.052	3293130
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	516.174	516.163	3283516
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	566.265	566.25	3288714
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	575.361	575.35	3288438
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	578.391	578.369	3286000
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	581.831	581.816	3288346
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	594.486	594.481	3288668
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	623.241	623.226	3286230
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	629.664	629.649	3288484
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	632.906	632.887	3288622
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	634.39	634.379	3292762
manol-pipe-f7nidw.cnf	UNSAT	699.266	699.256	3281814
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	777.371	777.348	3286322
manol-pipe-c10nidw.cnf	UNSAT	809.241	809.22	3281630
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	812.625	812.595	3293222
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	939.454	939.431	3290738
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	1207.51	1207.5	3290876
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	1226.58	1226.53	3285816

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.008997	0.0107919	3290278
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.051991	0.052668	3292624
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.260959	0.260668	3293314
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.495924	0.498441	3292900
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	0.978851	0.97882	3284344
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	1.44678	1.44657	3286552
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.47278	1.47454	3291750
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	1.66875	1.6701	3284528
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	2.27865	2.28192	3284436
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	2.88556	2.89502	3283378
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	4.74428	4.75136	3292118
velev-pipe-sat-1.0-b9.cnf	SAT	4.76227	4.76477	3284160
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	4.92625	4.93235	3287196
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	4.99024	4.99814	3287242
application/manthey/ traffic/traffic_r_sat.cnf	SAT	5.71913	5.71975	3288576
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	6.08507	6.09229	3284758
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	9.23259	9.23566	3284390
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	9.41857	9.42319	3287104
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	9.71952	9.73279	3286966
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	9.8355	9.84965	3283792
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	11.3943	11.4067	3284482
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	15.3837	15.3869	3284666
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	15.8346	15.8514	3284574
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	15.9086	15.9101	3290692
ibm-2004-01-k90.cnf	SAT	20.0879	20.0875	3281906
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	20.5839	20.5868	3283746
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	22.6036	22.6041	3281446
ibm-2002-21r-k95.cnf	SAT	22.8395	22.8443	3284298
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	28.2958	14.2067	3290232
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	28.9496	28.952	3290646
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	32.3951	32.4013	3292164
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	33.5929	33.6089	3286276
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	34.2018	34.2073	3281538
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	35.4886	35.4929	3282826
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	41.0128	41.0285	3284988
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	41.3447	41.3791	3285908
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	42.9415	42.9419	3292302
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	43.4354	43.467	3286138
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	59.197	59.1989	3285218
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	83.0124	83.0491	3285080
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	85.489	85.4936	3283700
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	103.967	103.976	3283148
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	123.626	123.626	3282688
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	132.537	132.565	3281400
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	135.022	135.035	3286368
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	150.844	150.843	3292256
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	176.286	176.283	3292348
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	190.099	190.096	3290830
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	199.683	199.68	3291198
velev-npe-1.0-9dlx-b71.cnf	SAT	267.421	267.458	3284114
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	377.745	377.748	3288392
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	SAT	380.1	380.093	3282734
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	380.114	380.106	3290508
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	383.675	383.675	3283562
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	430.547	430.537	3286184
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	529.736	529.724	3290784
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	574.991	574.978	3280250
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	659.082	659.06	3293406
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	670.277	670.378	3292210
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	707.768	707.743	3286460
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	838.068	838.056	3283240
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	1094.67	1094.63	3293452
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	1280.81	1280.77	3284022

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	1292.57	1300.06	3291980
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	1299.99	1300.03	3282458
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	? (TO)	1299.99	1300.03	3281262
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	? (TO)	1299.99	1300.01	3282872
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	1300	1300.04	3285402
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	? (TO)	1300	1300.01	3280940
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	1300	1300.02	3291290
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	1300	1300.02	3281170
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	? (TO)	1300.01	1300.02	3289358
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	1300.01	1300.04	3290002
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	1300.01	1300.04	3285678
application/fuhs/ AProVE11/AProVE11-06.cnf	? (TO)	1300.02	1300.03	3284620
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	1300.02	1300.03	3282274
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	1300.02	1300.01	3282412
industrial/fuhs/hard/ AProVE07-03.cnf	? (TO)	1300.02	1300.01	3280572
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	1300.03	1300.01	3292854
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	1300.03	1300.02	3287472
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	1300.03	1300.01	3291566
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	1300.03	1300.02	3283930
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	1300.04	1300.02	3291428
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	1300.04	1300.04	3289956
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	1300.04	1300.01	3280894
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	? (TO)	1300.04	1300.02	3286690
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	? (TO)	1300.04	1300.01	3282918
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	1300.04	1300.02	3287518
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	? (TO)	1300.04	1300.02	3287564
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	1300.04	1300.02	3291474
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	1300.04	1300.02	3291520
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	1300.04	1300.02	3292394
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	1300.04	1300.02	3292440
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	1300.04	1300.01	3292808
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	1300.04	1300.01	3282182
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	1300.04	1300.01	3282780
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (TO)	1300.04	1300.07	3293728
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	1300.04	1300.01	3289496
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	1300.04	1300.06	3293636
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	? (TO)	1300.04	1300.02	3289450
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	1300.04	1300.02	3289588
industrial/crypto/ mizh-sha0-36-2.cnf	? (TO)	1300.05	1300.02	3280986
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	1300.05	1300.02	3288944
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	1300.05	1300.02	3288990
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	1300.05	1300.02	3289404
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	1300.05	1300.02	3289082
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	1300.05	1300.02	3289036
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	1300.05	1300.02	3282596
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	1300.05	1300.01	3291336
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	? (TO)	1300.05	1300.04	3291612
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	1300.05	1300.01	3282228
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	? (TO)	1300.05	1300.06	3292670
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	1300.05	1300.01	3282090
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	1300.05	1300.02	3282642
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	1300.05	1300.01	3288898
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	1300.05	1300.01	3291382
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	1300.05	1300.02	3282504
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	1300.05	1300.01	3291842
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	1300.05	1300.02	3288024
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	? (TO)	1300.05	1300.02	3288070
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	1300.05	1300.02	3288806
mizh-sha0-36-4.cnf	? (TO)	1300.06	1300.02	3281676
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	1300.06	1300.04	3285034
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	1300.06	1300.04	3285172
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	1300.06	1300.04	3285586
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	? (TO)	1300.06	1300.02	3288116
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	1300.06	1300.02	3289818
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	? (TO)	1300.06	1300.03	3290416
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	? (TO)	1300.06	1300.02	3290140
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	1300.06	1300.03	3290048
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	1300.06	1300.05	3289864
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	1300.06	1300.02	3289312
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	1300.06	1300.02	3289174
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	1300.06	1300.02	3289128
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	1300.06	1300.02	3288852
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	1300.06	1300.02	3288760
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	1300.06	1300.07	3286092
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	? (TO)	1300.06	1300.05	3286046
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	1300.06	1300.01	3287426
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	1300.06	1300.02	3280434
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	1300.06	1300.01	3280526
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	1300.06	1300.02	3280618
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	1300.06	1300.02	3281078
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	1300.06	1300.02	3281124
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	1300.06	1300.02	3281216
ibm-2002-30r-k85.cnf	? (TO)	1300.06	1300.03	3281860
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	1300.06	1300.02	3282136
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	1300.06	1300.03	3282320
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	1300.06	1300.04	3282366
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (TO)	1300.07	1300.07	3281354
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	1300.07	1300.03	3291704
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (TO)	1300.07	1300.05	3285494
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	1300.07	1300.03	3287150
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	1300.07	1300.03	3280664
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	? (TO)	1300.07	1300.05	3285126
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	1300.07	1300.03	3290324
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	1300.07	1300.03	3290370
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	1300.07	1300.05	3284942
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	? (TO)	1300.07	1300.05	3285448
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	1300.07	1300.05	3285632
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	? (TO)	1300.07	1300.02	3286736
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	1300.07	1300.02	3283838
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	1300.07	1300.04	3282044
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	1300.07	1300.04	3290094
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	1300.07	1300.02	3289726
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	1300.07	1300.02	3289634
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	? (TO)	1300.07	1300.04	3281952
SAT_RACE08/Q1/ SAT_dat.k85.cnf	? (TO)	1300.07	1300.03	3281492
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	1300.07	1300.04	3280296
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	1300.07	1300.03	3280342
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (TO)	1300.07	1300.07	3292026
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	1300.08	1300.05	3280388
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (TO)	1300.08	1300.06	3285540
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	1300.08	1300.07	3292072
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	1300.08	1300.04	3289910
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	1300.08	1300.05	3285356
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	1300.08	1300.03	3287288
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	? (TO)	1300.08	1300.03	3286874
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	1300.08	1300.04	3290186
industrial/palacios/medium/ cube-11-h14-sat.cnf	? (TO)	1300.08	1300.04	3280710
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	? (TO)	1300.08	1300.04	3291658
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	1300.08	1300.03	3284068
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	1300.08	1300.02	3289680
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	1300.08	1300.02	3289772
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	1300.08	1300.05	3293682
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	1300.08	1300.05	3288300
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	1300.08	1300.04	3291796
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (TO)	1300.08	1300.04	3285310
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	? (TO)	1300.09	1300.05	3280204
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	? (TO)	1300.09	1300.05	3286644
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	1300.09	1300.05	3280158
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	1300.09	1300.06	3291014
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	1300.09	1300.05	3283424
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	? (TO)	1300.09	1300.05	3283608
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	1300.09	1300.06	3285264
velev-vliw-uns-4.0-9-i1.cnf	? (TO)	1300.1	1300.06	3281584
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	? (TO)	1300.1	1300.06	3283470
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	? (TO)	1300.1	1300.06	3285770
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	1300.1	1300.05	3284896
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	1300.1	1300.06	3285862
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	? (TO)	1300.1	1300.06	3283654
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (TO)	1300.1	1300.07	3293590
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (TO)	1300.11	1300.06	3293544
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	1300.11	1300.06	3284804
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	1300.11	1300.07	3291060
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	1300.11	1300.07	3285724

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	No Cert.	0.004998	0.00632603	3292486
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	No Cert.	0.005998	0.00882997	3292716
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	No Cert.	0.006998	0.00913206	3292532
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	No Cert.	0.016996	0.017621	3293268
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	No Cert.	0.022995	0.0248929	3292578
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	No Cert.	0.729889	0.734051	3283976
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	No Cert.	1.10883	1.11109	3283884
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	No Cert.	7.38688	7.3907	3287012
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	No Cert.	45.836	45.8626	3283056

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ibm-2004-23-k100.cnf	Wrong Cert.	208.307	208.311	3281768
application/manthey/traffic/ traffic_3_uc_sat.cnf	Wrong Cert.	215.339	215.338	3288530
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	Wrong Cert.	318.484	318.499	3281308
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	Wrong Cert.	425.041	425.038	3289542

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3500_3500_30f1.shuffled.cnf	UNSAT	0.006998	0.00793093	3266183
crafted/skvortsov/battleship/ battleship-5-8-unsat.cnf	UNSAT	0.05499	0.0552251	3261255
SAT05/crafted/sorge05/QG8/ gensys-ukn007.shuffled-as.sat05-3586.cnf	UNSAT	0.374942	0.375999	3266007
crafted/skvortsov/battleship/ battleship-6-9-unsat.cnf	UNSAT	0.640901	0.642056	3261519
SAT05/crafted/sabharwal05/counting/php/unsat/ easier/php-010-008.shuffled-as.sat05-1171.cnf	UNSAT	1.38279	1.38296	3265171
SAT05/crafted/sabharwal05/planning/logistics/unsat/ logistics-rotate-07t5.shuffled-as.sat05-1137.cnf	UNSAT	1.44878	1.44935	3265083
SAT05/crafted/sabharwal05/ordering/gt-ordering/ sat/gt-030.shuffled-as.sat05-1295.cnf	UNSAT	1.68574	1.68521	3265435
crafted/skvortsov/battleship/ battleship-10-10-unsat.cnf	UNSAT	5.08323	5.0842	3261123
SAT03/handmade/bevan/cnf/ marg3x3add8.shuffled-as.sat03-1449.cnf	UNSAT	8.20675	8.20878	3263983
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3900_3900_060.shuffled.cnf	UNSAT	9.14861	9.14922	3266227
SAT03/handmade/bevan/cnf/ marg3x3add8ch.shuffled-as.sat03-1448.cnf	UNSAT	15.0977	15.1033	3264027
SAT05/crafted/sabharwal05/pebbling/grid-pebbling/unsat/ grid-pbl-0250.shuffled-as.sat05-1349.shuffled-as.sat05-1349.cnf	UNSAT	34.2998	34.2992	3265391
crafted/skvortsov/battleship/ battleship-11-11-unsat.cnf	UNSAT	157.194	157.191	3260991
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-12_135.cnf	UNSAT	166.116	166.126	3262663
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-19_348.cnf	UNSAT	212.458	212.453	3262135
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-20_381.cnf	UNSAT	219.583	219.575	3262267
crafted/skvortsov/ automata-synchronization/rnd_100_28_u.cnf	UNSAT	259.085	259.079	3260683
crafted/skvortsov/ automata-synchronization/rnd_150_29_u.cnf	UNSAT	358.352	358.344	3260815
SAT05/crafted/sorge05/QG6/ dead-dnd002.shuffled-as.sat05-2713.cnf	UNSAT	382.696	382.685	3266095
crafted/skvortsov/battleship/ battleship-12-12-unsat.cnf	UNSAT	388.016	388.006	3261387
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-5_528.cnf	UNSAT	415.696	415.688	3261871
crafted/skvortsov/battleship/ battleship-7-12-unsat.cnf	UNSAT	530.627	530.617	3261343
SAT05/crafted/sorge05/QG7/ dead-dnd003.shuffled-as.sat05-3109.cnf	UNSAT	600.528	600.512	3265963
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_401.cnf	UNSAT	777.258	777.23	3262223
SAT03/handmade/markstrom/UNSATISFIABLE/ mm-2x2-6-6-s.1.shuffled-as.sat03-1499.cnf	UNSAT	921.813	921.784	3263939
SAT02/handmade/chu-min-li/urquhart/ urquhart3_25bis.shuffled.cnf	UNSAT	935.533	935.517	3266623
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-20_390.cnf	UNSAT	1172.74	1172.71	3262311

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/skvortsov/battleship/ battleship-10-17-sat.cnf	SAT	0.008997	0.00889692	3260903
crafted/skvortsov/battleship/ battleship-10-19-sat.cnf	SAT	0.008998	0.00969703	3261607
crafted/skvortsov/battleship/ battleship-10-18-sat.cnf	SAT	0.018996	0.019794	3261167
crafted/skvortsov/battleship/ battleship-9-17-sat.cnf	SAT	0.027995	0.0294191	3261783
SAT05/crafted/sorge05/QG7/ iso-ukn004.shuffled-as.sat05-3385.cnf	SAT	0.05499	0.0593121	3265875
crafted/mosoi/ 289/289-sat-12x15.cnf	SAT	0.074987	0.076667	3260023
SAT04/handmade/anton/l4k4/ lksat-n900-m6174-k4-l4-s819398222.used-as.sat04-929.cnf	SAT	0.664898	0.665624	3264379
crafted/spence/sgen/ sgen3-n120-s12930489-sat.cnf	SAT	0.944855	0.950959	3274063
crafted/skvortsov/battleship/ battleship-14-27-sat.cnf	SAT	2.12268	2.12559	3261475
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q225-n25-p15-s58217873.cnf	SAT	3.75643	3.75783	3266799
SAT04/handmade/anton/l5k3/ lksat-n900-m3357-k3-l5-s950595579.used-as.sat04-938.cnf	SAT	4.23835	4.23927	3264335
SAT05/crafted/sorge05/QG7a/ gensys-brn002.shuffled-as.sat05-3935.cnf	SAT	6.27105	6.27141	3265611
crafted/skvortsov/ automata-synchronization/rnd_100_28_s.cnf	SAT	9.11161	9.11526	3260551
crafted/spence/sgen/ sgen3-n180-s34713902-sat.cnf	SAT	10.6334	10.6346	3273546
SAT04/handmade/andrew/composite/ Composite-024BitPrimes-1.used-as.sat04-861.cnf	SAT	13.297	13.2981	3264599
SAT04/handmade/anton/l5k3/ lksat-n1100-m4103-k3-l5-s558351420.used-as.sat04-934.cnf	SAT	15.0517	15.0516	3264291
crafted/spence/sgen/ sgen3-n140-s18527668-sat.cnf	SAT	16.8164	16.8173	3274204
crafted/skvortsov/ automata-synchronization/rnd_100_27_s.cnf	SAT	25.0312	25.0307	3260771
crafted/skvortsov/battleship/ battleship-16-31-sat.cnf	SAT	33.9178	33.9216	3260947
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-5_527.cnf	SAT	45.6531	45.6583	3261827
CRAFTED/ edgematching/all/em_8_4_5_all.cnf	SAT	49.7374	49.7425	3257427
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_4300_4300_110.shuffled.cnf	SAT	51.7361	51.7365	3266359
crafted/skvortsov/battleship/ battleship-15-29-sat.cnf	SAT	54.9626	54.9671	3261695
crafted/skvortsov/ automata-synchronization/rnd_100_32_s.cnf	SAT	97.7741	97.7722	3260859
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g5.cnf	SAT	102.351	102.353	3257955
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_505.cnf	SAT	107.686	107.689	3262487
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_404.cnf	SAT	157.044	157.041	3262091
crafted/spence/sgen/ sgen3-n160-s40283905-sat.cnf	SAT	205.61	205.609	3273405
SAT04/handmade/kexu/frb-0.8/ frb45-21-1.used-as.sat04-883.cnf	SAT	402.374	402.363	3264159
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	SAT	415.628	415.622	3259759
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes5.cnf	SAT	478.9	478.882	3259231
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_399.cnf	SAT	516.055	516.044	3261915
crafted/skvortsov/battleship/ battleship-14-26-sat.cnf	SAT	569.828	569.818	3261299
SAT03/handmade/anton/SAT/ SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf	SAT	631.767	631.754	3263719
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q369.75-n30-p15-s59317012.cnf	SAT	651.725	651.704	3266887
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g7.cnf	SAT	706.127	706.12	3258131
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_443.cnf	SAT	1014.74	1014.73	3262355

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/crafted/sabharwal05/counting/fphp/unsat/ harder/fphp-020-019.shuffled-as.sat05-1232.cnf	? (TO)	1299.43	1300.01	3265347
CRAFTED/rbsat/random/unforced/ rbsat-v2400c266431g3.cnf	? (TO)	1299.5	1300.03	3257735
crafted/mosoi/289/ 289-unsat-21x39.cnf	? (TO)	1299.82	1300.06	3249769
SAT05/crafted/roussel05/visbmc-PHNF/ phnf-size10-exclusive-philo.used-as.sat04-988.shuffled-as.sat05-4195.cnf	? (TO)	1299.85	1300.04	3265523
SAT05/crafted/sorge05/QG7a/ gensys-ukn004.shuffled-as.sat05-3844.cnf	? (TO)	1299.95	1300.01	3265787
CRAFTED/rbsat/random/unforced/ rbsat-v2100c215164g9.cnf	? (TO)	1299.95	1300.02	3257999
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g7.cnf	? (TO)	1299.96	1300.02	3258307
SAT04/handmade/kexu/frb-0.8/ frb59-26-2.used-as.sat04-892.cnf	? (TO)	1299.96	1300.02	3264203
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g3.cnf	? (TO)	1299.97	1300.01	3258087
SAT03/handmade/anton/UNSAT/ SGI_30_70_19_80_8-log.shuffled-as.sat03-143.cnf	? (TO)	1299.98	1300.02	3262883
CRAFTED/rbsat/crafted/unforced/ rbsat-v945c61409g3.cnf	? (TO)	1299.98	1300.01	3259055
SAT03/handmade/anton/UNSAT/ SGI_30_70_18_80_10-dir.shuffled-as.sat03-140.cnf	? (TO)	1299.98	1300.02	3263235
SAT03/handmade/gomes/bqwh/ bqwh.50.825.shuffled-as.sat03-1648.cnf	? (TO)	1299.98	1300.02	3262707
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_506.cnf	? (TO)	1299.99	1300.03	3262179
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes5.cnf	? (TO)	1299.99	1300.03	3258659
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf	? (TO)	1299.99	1300.03	3250561
SAT05/crafted/sabharwal05/counting/php/unsat/ harder/php-020-019.shuffled-as.sat05-1190.cnf	? (TO)	1299.99	1300.01	3265259
crafted/spence/sgen/ sgen3-n200-s39840374-sat.cnf	? (TO)	1299.99	1300.01	3273593
CRAFTED/rbsat/crafted/ forced/rbsat-v2100c215164gyes4.cnf	? (TO)	1300	1300.02	3259407
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes10.cnf	? (TO)	1300	1300.03	3259671
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q585-n40-p15-s54275047.cnf	? (TO)	1300	1300.03	3251529
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-5_4231.cnf	? (TO)	1300.01	1300.04	3250253
SAT04/handmade/hirsch03/ hgen8-n320-01-S1432474240.shuffled-as.sat03-890.used-as.sat04-841.cnf	? (TO)	1300.01	1300.01	3264555
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q742.5-n45-p30-s17570390.cnf	? (TO)	1300.01	1300.03	3251133
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q585-n40-p30-s19690873.cnf	? (TO)	1300.01	1300.03	3251705
SAT03/handmade/anton/UNSAT/ SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf	? (TO)	1300.01	1300.01	3263543
SAT02/handmade/simon/ satex-challenges/c6288.shuffled.cnf	? (TO)	1300.01	1300.01	3266447
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf	? (TO)	1300.01	1300.02	3250957
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_1-log.shuffled-as.sat03-107.cnf	? (TO)	1300.02	1300.02	3263015
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-6_2071.cnf	? (TO)	1300.02	1300.04	3250429
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-5-5_34308.cnf	? (TO)	1300.02	1300.07	3250297
SAT03/handmade/anton/UNSAT/ SGI_30_80_28_70_8-dir.shuffled-as.sat03-215.cnf	? (TO)	1300.02	1300.02	3262971
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	? (TO)	1300.02	1300.03	3257647
crafted/skvortsov/ automata-synchronization/crn_20_361_s.cnf	? (TO)	1300.02	1300.02	3249901
SAT03/handmade/stanion/hwb/ hwb-n28-01-S136611085.shuffled-as.sat03-1627.cnf	? (TO)	1300.02	1300.06	3263895
crafted/spence/sgen/ sgen3-n300-s12830984-sat.cnf	? (TO)	1300.03	1300.01	3273452
crafted/skvortsov/battleship/ battleship-15-15-unsat.cnf	? (TO)	1300.03	1300.01	3250077
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q255-n25-p15-s2076598.cnf	? (TO)	1300.03	1300.01	3266931
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_508.cnf	? (TO)	1300.03	1300.03	3250517
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf	? (TO)	1300.03	1300.05	3251265
crafted/skvortsov/ automata-synchronization/crn_11_100_s.cnf	? (TO)	1300.03	1300.01	3260639
CRAFTED/rbsat/crafted/ forced/rbsat-v1560c133795gyes1.cnf	? (TO)	1300.03	1300.02	3259583
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g9.cnf	? (TO)	1300.04	1300.01	3258967
SAT03/handmade/anton/UNSAT/ SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf	? (TO)	1300.04	1300.02	3262927
crafted/skvortsov/ automata-synchronization/crn_20_360_u.cnf	? (TO)	1300.04	1300.02	3249813
CRAFTED/rbsat/random/unforced/ rbsat-v2100c215164g4.cnf	? (TO)	1300.04	1300.02	3258175
crafted/skvortsov/ automata-synchronization/crn_11_99_u.cnf	? (TO)	1300.04	1300.01	3260727
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q326.25-n30-p15-s44266159.cnf	? (TO)	1300.04	1300.02	3266975
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q225-n25-p30-s70617701.cnf	? (TO)	1300.04	1300.01	3266711
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	? (TO)	1300.04	1300.01	3259847
SAT03/handmade/anton/UNSAT/ SGI_30_70_26_60_1-dir.shuffled-as.sat03-167.cnf	? (TO)	1300.04	1300.02	3263191
CRAFTED/rbsat/random/unforced/ rbsat-v1375c111739g4.cnf	? (TO)	1300.04	1300.02	3258263
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1327.5-n60-p30-s52708253.cnf	? (TO)	1300.04	1300.05	3250869
CRAFTED/rbsat/random/forced/ rbsat-v1375c111739gyes10.cnf	? (TO)	1300.04	1300.02	3258615
crafted/spence/sgen/ sgen3-n220-s24359701-sat.cnf	? (TO)	1300.04	1300.01	3273781
crafted/spence/sgen/ sgen3-n280-s93756482-sat.cnf	? (TO)	1300.04	1300.01	3273922
SAT03/handmade/gomes/bqwh/ bqwh.60.1152.shuffled-as.sat03-1650.cnf	? (TO)	1300.04	1300.02	3262751
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g2.cnf	? (TO)	1300.04	1300.01	3259187
SAT03/handmade/anton/UNSAT/ SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf	? (TO)	1300.04	1300.02	3263455
CRAFTED/rbsat/random/unforced/ rbsat-v1375c111739g6.cnf	? (TO)	1300.04	1300.02	3258219
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes6.cnf	? (TO)	1300.04	1300.03	3258483
CRAFTED/edgematching/ compact/em_7_3_6_cmp.cnf	? (TO)	1300.04	1300.03	3257295
CRAFTED/edgematching/ compact/em_11_3_4_cmp.cnf	? (TO)	1300.04	1300.02	3257383
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf	? (TO)	1300.04	1300.02	3251309
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes6.cnf	? (TO)	1300.04	1300.01	3259495
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes1.cnf	? (TO)	1300.04	1300.02	3259539
SAT03/handmade/anton/UNSAT/ SGI_30_70_20_70_1-dir.shuffled-as.sat03-146.cnf	? (TO)	1300.04	1300.02	3263323
SAT05/crafted/sorge05/QG7a/ gensys-ukn006.shuffled-as.sat05-3846.cnf	? (TO)	1300.04	1300.01	3265743
crafted/skvortsov/battleship/ battleship-14-14-unsat.cnf	? (TO)	1300.04	1300.01	3249989
SAT05/crafted/sorge05/QG7a/ gensys-icl005.shuffled-as.sat05-3826.cnf	? (TO)	1300.04	1300.01	3265699
SAT05/crafted/sorge05/QG7a/ gensys-ukn009.shuffled-as.sat05-3849.cnf	? (TO)	1300.04	1300.01	3265655
crafted/skvortsov/battleship/ battleship-13-13-unsat.cnf	? (TO)	1300.04	1300.01	3261211
crafted/skvortsov/battleship/ battleship-16-16-unsat.cnf	? (TO)	1300.04	1300.01	3250033
SAT05/crafted/sabharwal05/counting/fphp/unsat/ harder/fphp-030-029.shuffled-as.sat05-1234.cnf	? (TO)	1300.04	1300.02	3265303
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q255-n25-p30-s39712998.cnf	? (TO)	1300.04	1300.01	3266755
SAT05/crafted/sorge05/QG7/ gensys-icl007.shuffled-as.sat05-3133.cnf	? (TO)	1300.05	1300.01	3265919
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g7.cnf	? (TO)	1300.05	1300.02	3257911
crafted/spence/sgen/ sgen3-n240-s78945233-sat.cnf	? (TO)	1300.05	1300.01	3274157
crafted/spence/sgen/ sgen3-n260-s62321009-sat.cnf	? (TO)	1300.05	1300.01	3274110
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g1.cnf	? (TO)	1300.05	1300.02	3257867
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	? (TO)	1300.05	1300.02	3257559
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes5.cnf	? (TO)	1300.05	1300.01	3258439
CRAFTED/edgematching/ compact/em_12_2_4_cmp.cnf	? (TO)	1300.05	1300.04	3257339
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g6.cnf	? (TO)	1300.05	1300.02	3259011
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes7.cnf	? (TO)	1300.05	1300.02	3258527
SAT05/crafted/markstrom05/eulcbip/ eulcbip-7-UNSAT.shuffled-as.sat05-3936.cnf	? (TO)	1300.05	1300.07	3265567
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes1.cnf	? (TO)	1300.05	1300.03	3258571
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_5-log.shuffled-as.sat03-111.cnf	? (TO)	1300.05	1300.02	3263147
SAT03/handmade/anton/UNSAT/ SGI_30_70_20_60_10-dir.shuffled-as.sat03-144.cnf	? (TO)	1300.05	1300.01	3263279
SAT03/handmade/anton/UNSAT/ SGI_30_70_21_60_7-log.shuffled-as.sat03-151.cnf	? (TO)	1300.05	1300.02	3263411
CRAFTED/edgematching/ fbcolors/em_8_4_5_fbc.cnf	? (TO)	1300.05	1300.02	3257471
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g7.cnf	? (TO)	1300.05	1300.01	3259099
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf	? (TO)	1300.05	1300.02	3266667
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes7.cnf	? (TO)	1300.05	1300.01	3259275
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g6.cnf	? (TO)	1300.05	1300.01	3258043
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes8.cnf	? (TO)	1300.05	1300.01	3259451
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g4.cnf	? (TO)	1300.05	1300.01	3257823
SAT05/crafted/sorge05/QG7a/ gensys-ukn003.shuffled-as.sat05-3843.cnf	? (TO)	1300.05	1300.01	3265831
CRAFTED/rbsat/crafted/unforced/ rbsat-v1820c171155g5.cnf	? (TO)	1300.05	1300.02	3258923
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_507.cnf	? (TO)	1300.05	1300.03	3262047
SAT03/handmade/anton/UNSAT/ SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf	? (TO)	1300.05	1300.02	3262839
SAT03/handmade/anton/UNSAT/ SGI_30_60_24_40_2-log.shuffled-as.sat03-119.cnf	? (TO)	1300.05	1300.02	3262795
SAT03/handmade/anton/UNSAT/ SGI_30_60_28_40_7-log.shuffled-as.sat03-127.cnf	? (TO)	1300.05	1300.02	3263367
SAT04/handmade/kexu/frb-0.8/ frb59-26-1.used-as.sat04-891.cnf	? (TO)	1300.05	1300.02	3264247
SAT04/handmade/kexu/frb-0.6/ frb75-13-2.used-as.sat04-878.cnf	? (TO)	1300.05	1300.01	3264071
CRAFTED/rbsat/random/ forced/rbsat-v1150c84314gyes1.cnf	? (TO)	1300.05	1300.01	3258879
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_3-log.shuffled-as.sat03-109.cnf	? (TO)	1300.05	1300.02	3263675
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-20_388.cnf	? (TO)	1300.05	1300.03	3250781
SAT04/handmade/kexu/frb-0.6/ frb80-14-2.used-as.sat04-880.cnf	? (TO)	1300.05	1300.01	3264115
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes2.cnf	? (TO)	1300.06	1300.03	3258351
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes7.cnf	? (TO)	1300.06	1300.03	3258395
CRAFTED/rbsat/crafted/ forced/rbsat-v2400c266431gyes3.cnf	? (TO)	1300.06	1300.03	3259319
SAT04/handmade/marijn/equilarge-l/ equilarge_l4.used-as.sat04-896.cnf	? (TO)	1300.06	1300.03	3264687
SAT03/handmade/anton/UNSAT/ SGI_30_60_29_30_6-dir.shuffled-as.sat03-130.cnf	? (TO)	1300.06	1300.02	3263587
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520.cnf	? (TO)	1300.06	1300.03	3264775
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q742.5-n45-p15-s28972035.cnf	? (TO)	1300.06	1300.03	3251089
CRAFTED/rbsat/random/unforced/ rbsat-v2400c266431g10.cnf	? (TO)	1300.06	1300.02	3257779
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf	? (TO)	1300.06	1300.02	3251617
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q663-n40-p15-s72490337.cnf	? (TO)	1300.06	1300.03	3251485
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q663-n40-p30-s67876261.cnf	? (TO)	1300.06	1300.03	3251441
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q326.25-n30-p30-s48700942.cnf	? (TO)	1300.06	1300.02	3266843
SAT02/handmade/simon/satex-challenges/ par32-3.shuffled.cnf	? (TO)	1300.06	1300.02	3266491
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-230-3.shuffled-as.sat05-2505.cnf	? (TO)	1300.06	1300.03	3264995
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-240-2.shuffled-as.sat05-2519.cnf	? (TO)	1300.06	1300.03	3264951
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-220-3.shuffled-as.sat05-2490.cnf	? (TO)	1300.06	1300.03	3264907
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535.cnf	? (TO)	1300.06	1300.03	3264863
SAT04/handmade/connamacher/connm-d0.02/ connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf	? (TO)	1300.06	1300.02	3264423
SAT03/handmade/anton/UNSAT/ SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf	? (TO)	1300.06	1300.02	3263631
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf	? (TO)	1300.06	1300.03	3250825
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf	? (TO)	1300.06	1300.03	3262619
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-13_160.cnf	? (TO)	1300.06	1300.03	3262575
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-20_389.cnf	? (TO)	1300.06	1300.04	3250605
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_462.cnf	? (TO)	1300.06	1300.03	3262531
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_406.cnf	? (TO)	1300.06	1300.03	3262399
crafted/manthey/sudoku-single-hard/ sudoku_81x81_unknown.cnf	? (TO)	1300.06	1300.02	3250121
SAT03/handmade/anton/UNSAT/ SGI_30_70_29_50_3-dir.shuffled-as.sat03-179.cnf	? (TO)	1300.06	1300.02	3263499
crafted/mosoi/289/ 289-unsat-17x30.cnf	? (TO)	1300.06	1300.06	3249505
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_464.cnf	? (TO)	1300.06	1300.03	3262003
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-24_567.cnf	? (TO)	1300.06	1300.03	3261959
CRAFTED/rbsat/crafted/ forced/rbsat-v2400c266431gyes2.cnf	? (TO)	1300.06	1300.03	3259715
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes10.cnf	? (TO)	1300.06	1300.01	3259363
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes2.cnf	? (TO)	1300.06	1300.02	3258835
CRAFTED/rbsat/random/forced/ rbsat-v2640c305320gyes10.cnf	? (TO)	1300.06	1300.03	3258791
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes3.cnf	? (TO)	1300.06	1300.03	3258747
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	? (TO)	1300.06	1300.02	3257603
crafted/spence/sgen/ sgen3-n150-s89334302-unsat.cnf	? (TO)	1300.07	1300.05	3273640
SAT03/handmade/anton/UNSAT/ SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf	? (TO)	1300.07	1300.02	3263059
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-19_349.cnf	? (TO)	1300.07	1300.04	3250693
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3900_3900_220.shuffled.cnf	? (TO)	1300.07	1300.06	3266315
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf	? (TO)	1300.07	1300.02	3251177
SAT05/crafted/sabharwal05/counting/php/unsat/ easier/php-045-035.shuffled-as.sat05-1181.cnf	? (TO)	1300.07	1300.02	3265127
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-2.shuffled-as.sat05-2534.cnf	? (TO)	1300.07	1300.04	3264819
SAT05/crafted/lynce05/social-golfer-problem/ sgp_5-6-8.shuffled-as.sat05-2669.cnf	? (TO)	1300.07	1300.04	3265479
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes3.cnf	? (TO)	1300.07	1300.03	3259627
SAT05/crafted/sabharwal05/counting/php/unsat/ harder/php-040-039.shuffled-as.sat05-1194.cnf	? (TO)	1300.07	1300.02	3265215
crafted/spence/ hard/s113-100.cnf	? (TO)	1300.07	1300.06	3257251
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q918.75-n50-p15-s98191766.cnf	? (TO)	1300.07	1300.04	3251661
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf	? (TO)	1300.07	1300.05	3251353
CRAFTED/rbsat/random/ forced/rbsat-v1820c171155gyes3.cnf	? (TO)	1300.07	1300.02	3258703
crafted/spence/sgen/ sgen3-n140-s20078956-unsat.cnf	? (TO)	1300.07	1300.05	3273969
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-15_218.cnf	? (TO)	1300.07	1300.03	3250737
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-18_312.cnf	? (TO)	1300.07	1300.04	3250649
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_445.cnf	? (TO)	1300.07	1300.02	3262443
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g9.cnf	? (TO)	1300.07	1300.02	3259143
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-6_2072.cnf	? (TO)	1300.07	1300.04	3250165
SAT03/handmade/anton/UNSAT/ SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf	? (TO)	1300.07	1300.03	3263103
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q918.75-n50-p30-s52376212.cnf	? (TO)	1300.08	1300.04	3250913
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	? (TO)	1300.08	1300.03	3259803
SAT03/handmade/stanion/hwb/ hwb-n32-02-S1478512323.shuffled-as.sat03-1638.cnf	? (TO)	1300.08	1300.05	3263807
crafted/spence/sgen/ sgen3-n130-s30940966-unsat.cnf	? (TO)	1300.08	1300.05	3273875
crafted/spence/sgen/ sgen3-n120-s55656844-unsat.cnf	? (TO)	1300.08	1300.05	3273828
crafted/spence/sgen/ sgen3-n170-s56409011-unsat.cnf	? (TO)	1300.08	1300.05	3273734
crafted/spence/sgen/ sgen3-n160-s73223945-unsat.cnf	? (TO)	1300.08	1300.05	3273687
SAT04/handmade/connamacher/connm-d0.04/ connm-ue-csp-sat-n800-d0.04-s1788334438.used-as.sat04-976.cnf	? (TO)	1300.08	1300.02	3264467
crafted/spence/sgen/ sgen3-n180-s33098896-unsat.cnf	? (TO)	1300.08	1300.05	3273499
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-1.shuffled-as.sat05-2533.cnf	? (TO)	1300.08	1300.04	3265039
SAT02/handmade/simon/ satex-challenges/f600.shuffled.cnf	? (TO)	1300.08	1300.04	3266403
crafted/skvortsov/automata-synchronization/ crn_40_1521_s.cnf	? (TO)	1300.08	1300.06	3249857
crafted/skvortsov/automata-synchronization/ crn_40_1520_u.cnf	? (TO)	1300.08	1300.05	3249945
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf	? (TO)	1300.08	1300.04	3251001
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1504.5-n60-p15-s80450670.cnf	? (TO)	1300.08	1300.05	3251045
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q841.5-n45-p15-s16393788.cnf	? (TO)	1300.08	1300.03	3251397
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q1041.25-n50-p15-s99099953.cnf	? (TO)	1300.08	1300.04	3251573
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q841.5-n45-p30-s84954709.cnf	? (TO)	1300.08	1300.04	3251221
crafted/spence/sgen/ sgen3-n200-s00813792-unsat.cnf	? (TO)	1300.08	1300.05	3274016
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-4_512.cnf	? (TO)	1300.08	1300.04	3250209
SAT04/handmade/marijn/equilarge-l/ equilarge_l2.used-as.sat04-894.cnf	? (TO)	1300.08	1300.03	3264643
crafted/mosoi/289/ 289-unsat-21x14.cnf	? (TO)	1300.09	1300.06	3249417
crafted/spence/sgen/ sgen3-n190-s29985700-unsat.cnf	? (TO)	1300.09	1300.05	3274251
SAT05/crafted/jarvisalo05/mod2-rand3bip-sat/ mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf	? (TO)	1300.09	1300.05	3264731
crafted/mosoi/289/ 289-unsat-14x38.cnf	? (TO)	1300.09	1300.06	3249681
SAT04/handmade/connamacher/connm-d-0.02/ connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf	? (TO)	1300.09	1300.03	3264511
crafted/mosoi/289/ 289-unsat-17x27.cnf	? (TO)	1300.09	1300.06	3249549
crafted/mosoi/289/ 289-unsat-14x34.cnf	? (TO)	1300.09	1300.07	3249725
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-4_511.cnf	? (TO)	1300.09	1300.04	3250341
SAT03/handmade/stanion/hwb/ hwb-n28-02-S818962541.shuffled-as.sat03-1628.cnf	? (TO)	1300.09	1300.05	3263763
crafted/mosoi/289/ 289-unsat-6x40.cnf	? (TO)	1300.1	1300.07	3249637
crafted/mosoi/289/ 289-unsat-5x41.cnf	? (TO)	1300.1	1300.07	3249285
crafted/mosoi/289/ 289-unsat-13x32.cnf	? (TO)	1300.1	1300.06	3249197
crafted/mosoi/289/ 289-unsat-21x33.cnf	? (TO)	1300.1	1300.06	3249329
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-5_4232.cnf	? (TO)	1300.1	1300.05	3250473
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_4300_4300_170.shuffled.cnf	? (TO)	1300.1	1300.06	3266271
SAT02/handmade/zhang-lintao/ xor-chain/x1_40.shuffled.cnf	? (TO)	1300.1	1300.07	3266579
SAT03/handmade/stanion/hwb/ hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf	? (TO)	1300.1	1300.06	3263851
crafted/mosoi/289/ 289-unsat-9x32.cnf	? (TO)	1300.1	1300.08	3249593
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-5-5_34309.cnf	? (TO)	1300.11	1300.07	3250385
crafted/mosoi/289/ 289-unsat-21x40.cnf	? (TO)	1300.11	1300.08	3249373
crafted/mosoi/289/ 289-unsat-6x34.cnf	? (TO)	1300.13	1300.09	3249153
crafted/mosoi/289/ 289-unsat-7x39.cnf	? (TO)	1300.13	1300.08	3249461
SAT02/handmade/zhang-lintao/ xor-chain/x1_80.shuffled.cnf	? (TO)	1300.15	1300.12	3266535

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/skvortsov/battleship/ battleship-8-15-sat.cnf	No Cert.	0.001999	0.00647808	3261035
crafted/mosoi/289/ 289-sat-5x8.cnf	No Cert.	0.002999	0.00619192	3260287
crafted/mosoi/ 289/289-sat-11x4.cnf	No Cert.	0.003998	0.00617704	3260375
crafted/mosoi/289/ 289-sat-6x8.cnf	No Cert.	0.003998	0.00601291	3260419
crafted/skvortsov/battleship/ battleship-7-13-sat.cnf	No Cert.	0.003998	0.00588891	3261651
crafted/mosoi/289/ 289-sat-7x6.cnf	No Cert.	0.003998	0.00652003	3260243
crafted/mosoi/289/ 289-sat-4x8.cnf	No Cert.	0.003998	0.00695108	3259935
crafted/mosoi/289/ 289-sat-6x9.cnf	No Cert.	0.004999	0.0062459	3260507
crafted/skvortsov/battleship/ battleship-12-23-sat.cnf	No Cert.	0.005998	0.00821695	3261431
crafted/mosoi/ 289/289-sat-11x9.cnf	No Cert.	0.015997	0.0184619	3260463
crafted/mosoi/ 289/289-sat-11x10.cnf	No Cert.	0.018996	0.022845	3260199
crafted/mosoi/ 289/289-sat-6x19.cnf	No Cert.	0.018996	0.019683	3259891
crafted/mosoi/ 289/289-sat-14x8.cnf	No Cert.	0.018996	0.0205179	3260067
SAT02/handmade/pehoushek/twentyvars/ 7cnf20_90000_90000_7.shuffled.cnf	No Cert.	0.019996	0.020549	3266139
crafted/mosoi/ 289/289-sat-6x20.cnf	No Cert.	0.021995	0.0220991	3260111
crafted/mosoi/ 289/289-sat-9x13.cnf	No Cert.	0.022995	0.0234989	3260155
CRAFTED/sgi/ satsgi-n26himBHm28-p0-q293.cnf	No Cert.	0.022995	0.0235269	3257691
crafted/mosoi/ 289/289-sat-4x35.cnf	No Cert.	0.025995	0.026536	3259979
crafted/skvortsov/battleship/ battleship-11-21-sat.cnf	No Cert.	0.031994	0.032778	3261739
crafted/mosoi/ 289/289-sat-12x14.cnf	No Cert.	0.053991	0.0561099	3260331
SAT05/crafted/sorge05/QG8/ iso-ukn009.shuffled-as.sat05-3632.cnf	No Cert.	0.05499	0.0560769	3266051
crafted/skvortsov/battleship/ battleship-24-57-sat.cnf	No Cert.	0.168973	0.168817	3261079
crafted/mosoi/289/ 289-unsat-6x30.cnf	No Cert.	0.225965	0.227693	3249241
CRAFTED/ramseycube/ Q3inK10.cnf	No Cert.	45.6251	45.6297	3257515
crafted/skvortsov/ automata-synchronization/rnd_150_42_s.cnf	No Cert.	71.7171	71.8998	3260595
crafted/skvortsov/battleship/ battleship-17-33-sat.cnf	No Cert.	391.843	391.847	3261563

SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Result page for solver SApperloT2010 2011-03-04 [DEPRECATED] (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (81 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (63 runs) [Show/Hide]

Solver timed out (no solution given) (143 runs) [Show/Hide]

Solver answered SATISFIABLE but gave no complete certificate (9 runs) [Show/Hide]

Solver gave a wrong solution (4 runs) [Show/Hide]

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (27 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (37 runs) [Show/Hide]

Solver timed out (no solution given) (210 runs) [Show/Hide]

Solver answered SATISFIABLE but gave no complete certificate (26 runs) [Show/Hide]