SAT 2011 Competition: 32 cores track: results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
claspmt 2.0-R4095-patched (fixed) (complete)
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)
Plingeling 587f (fixed) (complete)
ppfolio par (complete)

Bench name	Best results on this instance	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/ fuhs/AProVE11/ AProVE11-02.cnf	SAT TT=31.008	SAT TT=61.659	SAT TT=680.663	SAT TT=94.252	SAT TT=31.008
application/ fuhs/AProVE11/ AProVE11-06.cnf	UNSAT TT=85900.7	UNSAT TT=85900.7	? (TO) TT=160003	UNSAT TT=144379	UNSAT TT=156644
application/ fuhs/AProVE11/ AProVE11-07.cnf	SAT TT=46.863	SAT TT=61.099	SAT TT=1491.09	SAT TT=639.508	SAT TT=46.863
application/ fuhs/AProVE11/ AProVE11-09.cnf	SAT TT=6.096	SAT TT=28.888	SAT TT=423.85	SAT TT=32.428	SAT TT=6.096
application/ fuhs/AProVE11/ AProVE11-10.cnf	SAT TT=33.506	SAT TT=79.399	SAT TT=1097.85	SAT TT=259.8	SAT TT=33.506
application/ fuhs/AProVE11/ AProVE11-11.cnf	UNSAT TT=666.374	UNSAT TT=666.374	UNSAT TT=1439.37	UNSAT TT=1342.56	UNSAT TT=1020.78
application/ fuhs/AProVE11/ AProVE11-12.cnf	SAT TT=4.975	SAT TT=14.755	SAT TT=205.21	SAT TT=50.248	SAT TT=4.975
application/ fuhs/AProVE11/ AProVE11-13.cnf	SAT TT=36.662	SAT TT=236.698	SAT TT=1997.09	SAT TT=127.496	SAT TT=36.662
application/ fuhs/AProVE11/ AProVE11-15.cnf	SAT TT=35.716	SAT TT=35.716	SAT TT=308.429	SAT TT=380.964	SAT TT=51.802
application/ fuhs/AProVE11/ AProVE11-16.cnf	SAT TT=17.55	SAT TT=30.366	SAT TT=566.275	SAT TT=126.044	SAT TT=17.55
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT TT=245.137	UNSAT TT=608.166	UNSAT TT=245.137	UNSAT TT=969.706	UNSAT TT=1142.21
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT TT=915.033	UNSAT TT=915.033	UNSAT TT=950.855	UNSAT TT=3310.78	UNSAT TT=3260.04
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	UNSAT TT=6468.32	UNSAT TT=16617.2	UNSAT TT=6468.32	UNSAT TT=51465.9	UNSAT TT=20229.9
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	UNSAT TT=58120.8	? (TO) TT=160003	UNSAT TT=58120.8	? (TO) TT=160003	? (TO) TT=160003
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf		? (TO) TT=160005	? (TO) TT=160003	? (TO) TT=160003	? (TO) TT=160002
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf		? (TO) TT=160005	? (TO) TT=160004	? (TO) TT=160004	? (TO) TT=156501
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf		? (TO) TT=160005	? (TO) TT=160005	? (TO) TT=160003	? (TO) TT=156092
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf		? (TO) TT=160006	? (TO) TT=160003	? (TO) TT=160004	? (TO) TT=156392
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf		? (TO) TT=160004	? (TO) TT=160005	? (TO) TT=160002	? (TO) TT=156455
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf		? (TO) TT=160003	? (TO) TT=160004	? (TO) TT=160004	? (TO) TT=156163
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf		? (TO) TT=160005	? (TO) TT=160006	? (TO) TT=160004	? (TO) TT=156406
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf		? (TO) TT=160006	? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=156290
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf		? (TO) TT=160004	? (TO) TT=160006	? (TO) TT=160002	? (TO) TT=156417
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf		? (TO) TT=160004	? (TO) TT=160004	? (TO) TT=160001	? (TO) TT=156110
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf		? (TO) TT=160018	? (TO) TT=160003	? (TO) TT=160004	? (TO) TT=156290
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	UNSAT TT=83796	? (TO) TT=160005	UNSAT TT=83796	? (TO) TT=160003	? (TO) TT=156498
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top22.cnf		? (TO) TT=160005	? (TO) TT=160006	? (TO) TT=160004	? (TO) TT=155978
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	SAT TT=38269.3	? (TO) TT=160004	SAT TT=38269.3	? (TO) TT=160005	? (TO) TT=156095
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	SAT TT=4562.96	SAT TT=61786.2	SAT TT=4562.96	? (TO) TT=160002	? (TO) TT=156229
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT TT=6133.97	SAT TT=79100.4	SAT TT=6133.97	SAT TT=25991.1	SAT TT=36291.7
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT TT=4363.07	SAT TT=16167	SAT TT=8176.1	SAT TT=4363.07	SAT TT=13033.7
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT TT=5714.58	SAT TT=15592.4	SAT TT=7501.12	SAT TT=10608.6	SAT TT=5714.58
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT TT=3348.83	SAT TT=20671.7	SAT TT=4415.1	SAT TT=3348.83	SAT TT=4871.27
application/fuhs/ slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT TT=459.618	SAT TT=459.618	SAT TT=4988.06	SAT TT=5075.55	SAT TT=8185.15
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT TT=2613.64	UNSAT TT=2613.64	UNSAT TT=2934.52	UNSAT TT=5697.34	UNSAT TT=7234.36
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT TT=3409.96	UNSAT TT=5276.51	UNSAT TT=3409.96	UNSAT TT=3929.72	UNSAT TT=4263.68
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT TT=1036.55	SAT TT=1036.55	SAT TT=1996.1	SAT TT=6299.19	SAT TT=1958.72
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT TT=413.653	UNSAT TT=413.653	UNSAT TT=1704.3	UNSAT TT=821.179	UNSAT TT=497.783
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT TT=265.047	SAT TT=470.142	SAT TT=663.856	SAT TT=941.251	SAT TT=265.047
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT TT=80.884	UNSAT TT=925.982	UNSAT TT=969.06	UNSAT TT=559.149	UNSAT TT=80.884
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT TT=817.196	SAT TT=1269.29	SAT TT=1653	SAT TT=1167.57	SAT TT=817.196
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT TT=450.455	UNSAT TT=2983.63	UNSAT TT=2420.93	UNSAT TT=1950.78	UNSAT TT=450.455
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT TT=958.862	SAT TT=3694.92	SAT TT=1937.8	SAT TT=3262.93	SAT TT=958.862
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT TT=258.426	UNSAT TT=89751.1	UNSAT TT=414.878	UNSAT TT=775.062	UNSAT TT=258.426
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-rovers-18-step12.cnf	SAT TT=6.725	SAT TT=21.01	SAT TT=450.558	SAT TT=8.065	SAT TT=6.725
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT TT=6000.93	UNSAT TT=6000.93	UNSAT TT=7717.17	UNSAT TT=19958.2	UNSAT TT=10089.3
application/jarvisalo/ AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT TT=566.532	SAT TT=566.532	SAT TT=1031.48	SAT TT=2232.41	SAT TT=717.616
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT TT=12.331	UNSAT TT=13.167	UNSAT TT=607.791	UNSAT TT=30.984	UNSAT TT=12.331
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT TT=809.361	UNSAT TT=809.361	UNSAT TT=1696.24	UNSAT TT=3394.83	UNSAT TT=5306.17
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT TT=5926.9	? (TO) TT=160005	UNSAT TT=5926.9	UNSAT TT=68794	UNSAT TT=67557.2
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT TT=5055.9	UNSAT TT=14446	UNSAT TT=6711.48	UNSAT TT=5055.9	UNSAT TT=8102.75
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	UNSAT TT=70467.6	? (TO) TT=160004	UNSAT TT=70467.6	UNSAT TT=75738.9	? (TO) TT=160001
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT TT=30.54	UNSAT TT=50.102	UNSAT TT=1103.23	UNSAT TT=286.022	UNSAT TT=30.54
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT TT=131.514	UNSAT TT=131.514	UNSAT TT=1635.68	UNSAT TT=730.604	UNSAT TT=449.597
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT TT=100.686	UNSAT TT=100.686	UNSAT TT=1323.5	UNSAT TT=446.721	UNSAT TT=321.923
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT TT=753.096	UNSAT TT=753.096	UNSAT TT=2040.9	UNSAT TT=1096.95	UNSAT TT=1529.77
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	UNSAT TT=31478.4	? (TO) TT=160004	? (TO) TT=160005	UNSAT TT=31478.4	? (TO) TT=160001
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT TT=3474.22	UNSAT TT=7424.74	UNSAT TT=4436.47	UNSAT TT=3474.22	UNSAT TT=4902
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT TT=9.055	UNSAT TT=16.047	UNSAT TT=669.96	UNSAT TT=65.12	UNSAT TT=9.055
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT TT=9.814	UNSAT TT=15.031	UNSAT TT=663.094	UNSAT TT=76.507	UNSAT TT=9.814
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT TT=235.625	UNSAT TT=235.625	UNSAT TT=1514.43	UNSAT TT=624.189	UNSAT TT=600.608
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	UNSAT TT=18047.5	UNSAT TT=18047.5	UNSAT TT=27172.7	? (TO) TT=160002	? (TO) TT=160003
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT TT=5.942	UNSAT TT=7.168	UNSAT TT=67.744	UNSAT TT=7.713	UNSAT TT=5.942
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT TT=4851.74	UNSAT TT=4851.74	UNSAT TT=6000.29	UNSAT TT=8319.61	UNSAT TT=16368.1
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT TT=77.76	UNSAT TT=85.043	UNSAT TT=864.992	UNSAT TT=678.093	UNSAT TT=77.76
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT TT=1027.5	UNSAT TT=1027.5	UNSAT TT=2015.45	UNSAT TT=1231.89	UNSAT TT=1373.34
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT TT=166.111	UNSAT TT=166.111	UNSAT TT=873.503	UNSAT TT=786.976	UNSAT TT=734.354
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	UNSAT TT=35489.3	? (TO) TT=160022	? (TO) TT=160005	UNSAT TT=35489.3	? (TO) TT=160001
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT TT=13.437	SAT TT=46.608	SAT TT=1412.52	SAT TT=264.622	SAT TT=13.437
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT TT=16.637	Signal TT=68.766	SAT TT=1531.55	SAT TT=442.404	SAT TT=16.637
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT TT=12.459	Signal TT=41.084	SAT TT=808.839	SAT TT=265.002	SAT TT=12.459
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	UNSAT TT=122099	? (TO) TT=160006	? (TO) TT=160003	UNSAT TT=122099	? (TO) TT=160003
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT TT=4.349	UNSAT TT=11.742	UNSAT TT=2455.37	UNSAT TT=167.865	UNSAT TT=4.349
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT TT=35.609	UNSAT TT=76.121	UNSAT TT=4388.99	UNSAT TT=934.674	UNSAT TT=35.609
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT TT=481.092	UNSAT TT=481.092	UNSAT TT=2573.32	UNSAT TT=600.457	UNSAT TT=964.899
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT TT=120.724	UNSAT TT=120.724	UNSAT TT=4130.8	UNSAT TT=1177.95	UNSAT TT=277.576
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT TT=73.05	UNSAT TT=88.653	UNSAT TT=3287.59	UNSAT TT=610.083	UNSAT TT=73.05
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT TT=7.521	SAT TT=25.497	SAT TT=939.953	SAT TT=50.049	SAT TT=7.521
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT TT=9.686	SAT TT=32.562	? (TO) TT=160005	SAT TT=1256.26	SAT TT=9.686
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT TT=10.776	SAT TT=46.155	SAT TT=924.647	SAT TT=69.743	SAT TT=10.776
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/jarvisalo/ smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf		? (TO) TT=160014	? (TO) TT=160004	? (TO) TT=160004	? (TO) TT=160002
application/kullmann/ AES/Benchmarks/128/ aes_128_10_keyfind_1.cnf		? (TO) TT=160006	? (TO) TT=160002	? (TO) TT=160003	? (TO) TT=160002
application/kullmann/ AES/Benchmarks/128/ aes_128_1_keyfind_1.cnf		? (TO) TT=160003	? (TO) TT=160003	? (TO) TT=160003	? (TO) TT=160003
application/kullmann/ AES/Benchmarks/128/ aes_128_2_keyfind_1.cnf		? (TO) TT=160003	? (TO) TT=160005	? (TO) TT=160001	? (TO) TT=160001
application/kullmann/ AES/Benchmarks/128/ aes_128_3_keyfind_1.cnf		? (TO) TT=160003	? (TO) TT=160003	? (TO) TT=160002	? (TO) TT=160002
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT TT=0.131	SAT TT=0.131	SAT TT=6.308	SAT TT=3.246	SAT TT=0.151
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT TT=9.644	SAT TT=9.644	SAT TT=65.221	SAT TT=30.447	SAT TT=15.475
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT TT=740.572	SAT TT=2582.64	SAT TT=7643.01	SAT TT=740.572	SAT TT=6235.56
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf		? (TO) TT=160003	? (TO) TT=160002	? (TO) TT=160004	? (TO) TT=160001
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	SAT TT=66518.3	SAT TT=66518.3	? (TO) TT=160003	? (TO) TT=160004	? (TO) TT=160002
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT TT=1252.79	SAT TT=1252.79	SAT TT=5298.94	SAT TT=2150.4	SAT TT=20810.1
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf		? (TO) TT=160004	? (TO) TT=160005	? (TO) TT=160003	? (TO) TT=160002
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf		? (TO) TT=160003	? (TO) TT=160002	? (TO) TT=160005	? (TO) TT=160004
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf		? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=160001	? (TO) TT=160002
application/leberre/ 2dimensionalstrippacking/ E00N23.cnf		? (TO) TT=158260	? (TO) TT=160005	? (TO) TT=160002	? (TO) TT=160002
application/leberre/ 2dimensionalstrippacking/ E00X23.cnf		? (TO) TT=158322	? (TO) TT=160006	? (TO) TT=160003	? (TO) TT=160004
application/leberre/ 2dimensionalstrippacking/ E02F17.cnf	UNSAT TT=195.187	UNSAT TT=195.187	UNSAT TT=316.895	UNSAT TT=598.451	UNSAT TT=789.23
application/leberre/ 2dimensionalstrippacking/ E02F20.cnf	SAT TT=697.813	SAT TT=697.813	SAT TT=7760.67	SAT TT=2691.12	SAT TT=844.694
application/leberre/ 2dimensionalstrippacking/ E02F22.cnf	SAT TT=3777.08	SAT TT=3777.08	SAT TT=51049.2	SAT TT=5897.94	SAT TT=4544.43
application/leberre/ 2dimensionalstrippacking/ E03N17.cnf	UNSAT TT=8.253	UNSAT TT=14.842	UNSAT TT=100.301	UNSAT TT=49.887	UNSAT TT=8.253
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/leberre/ 2dimensionalstrippacking/ E04F19.cnf	SAT TT=639.158	SAT TT=639.158	SAT TT=3518.22	SAT TT=1042.11	SAT TT=646.007
application/leberre/ 2dimensionalstrippacking/ E04F20.cnf	SAT TT=353.935	SAT TT=353.935	SAT TT=4101.8	SAT TT=1316.51	SAT TT=1489.42
application/leberre/ 2dimensionalstrippacking/ E04N18.cnf	UNSAT TT=7.889	UNSAT TT=8.438	UNSAT TT=103.921	UNSAT TT=7.889	UNSAT TT=24.606
application/leberre/ 2dimensionalstrippacking/ E05F18.cnf	SAT TT=188.113	SAT TT=224.798	SAT TT=253.914	SAT TT=188.113	SAT TT=194.941
application/leberre/ 2dimensionalstrippacking/ E05F20.cnf	SAT TT=731.075	SAT TT=780.386	SAT TT=7038.78	SAT TT=731.075	SAT TT=1148.83
application/leberre/ 2dimensionalstrippacking/ E05X15.cnf	UNSAT TT=205.686	UNSAT TT=225.024	UNSAT TT=205.686	UNSAT TT=217.09	UNSAT TT=229.912
application/leberre/ 2dimensionalstrippacking/ E07N15.cnf	UNSAT TT=0.055	UNSAT TT=0.055	UNSAT TT=3.117	UNSAT TT=1.14	UNSAT TT=0.175
application/leberre/ 2dimensionalstrippacking/ E15N15.cnf	UNSAT TT=0.059	UNSAT TT=0.059	UNSAT TT=4.104	UNSAT TT=1.242	UNSAT TT=0.109
application/leberre/ 2dimensionalstrippacking/ korf-15.cnf	UNSAT TT=100.517	UNSAT TT=110.63	UNSAT TT=100.517	UNSAT TT=270.842	UNSAT TT=165.604
application/leberre/ 2dimensionalstrippacking/ korf-17.cnf	UNSAT TT=4721.17	UNSAT TT=4721.17	UNSAT TT=12542.5	UNSAT TT=30495.3	UNSAT TT=18059.3
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/leberre/ 2dimensionalstrippacking/ korf-18.cnf	UNSAT TT=10532	UNSAT TT=19309.9	UNSAT TT=10532	UNSAT TT=54316.6	UNSAT TT=53265
application/manthey/ traffic/ traffic_3b_unknown.cnf	UNSAT TT=2932.51	UNSAT TT=2932.51	UNSAT TT=19004.1	UNSAT TT=7515.38	UNSAT TT=14463.5
application/manthey/ traffic/ traffic_3_uc_sat.cnf	SAT TT=1011.01	SAT TT=1497.07	SAT TT=1072.47	SAT TT=1011.01	SAT TT=2524.82
application/manthey/ traffic/ traffic_b_unsat.cnf	UNSAT TT=2684.29	UNSAT TT=2684.29	UNSAT TT=16695.4	UNSAT TT=6798.8	UNSAT TT=13009.1
application/manthey/ traffic/ traffic_fb_unknown.cnf	UNSAT TT=2592.97	UNSAT TT=2592.97	UNSAT TT=16649.1	UNSAT TT=6122.8	UNSAT TT=12245.7
application/manthey/ traffic/ traffic_f_unknown.cnf	UNSAT TT=3137.1	UNSAT TT=3137.1	UNSAT TT=16794.6	UNSAT TT=7341.15	UNSAT TT=11177.9
application/manthey/ traffic/ traffic_kkb_unknown.cnf	UNSAT TT=2815.09	UNSAT TT=2815.09	UNSAT TT=16780.4	UNSAT TT=6878.21	UNSAT TT=12335.5
application/manthey/ traffic/ traffic_pcb_unknown.cnf	UNSAT TT=3081.42	UNSAT TT=3081.42	UNSAT TT=16436.9	UNSAT TT=6598.04	UNSAT TT=12575.9
application/manthey/ traffic/ traffic_r_sat.cnf	SAT TT=98.983	SAT TT=372.015	SAT TT=1062.58	SAT TT=183.335	SAT TT=98.983
application/manthey/ traffic/ traffic_r_uc_sat.cnf	SAT TT=8923.25	SAT TT=10298	SAT TT=12111.2	SAT TT=8923.25	SAT TT=9416.12
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/rintanen/ SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT TT=15030	UNSAT TT=15030	UNSAT TT=29142.3	UNSAT TT=66839	UNSAT TT=44086.2
application/rintanen/ SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT TT=145.681	SAT TT=3788.14	SAT TT=2656.56	SAT TT=1347.5	SAT TT=145.681
application/rintanen/ SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT TT=460.893	SAT TT=4176.09	SAT TT=2693.04	SAT TT=1347.96	SAT TT=460.893
application/rintanen/ SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT TT=258.713	SAT TT=5604.44	SAT TT=3017.79	SAT TT=806.597	SAT TT=258.713
application/rintanen/ SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT TT=1219.65	UNSAT TT=2985.24	UNSAT TT=4572.64	UNSAT TT=4329.66	UNSAT TT=1219.65
application/rintanen/ SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT TT=11749.7	UNSAT TT=11749.7	UNSAT TT=19373.4	UNSAT TT=31678	UNSAT TT=28074.7
application/rintanen/ SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT TT=341.683	SAT TT=4144.58	SAT TT=3278.34	SAT TT=1945.57	SAT TT=341.683
application/rintanen/ SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT TT=6881.08	UNSAT TT=8636.26	UNSAT TT=8874.13	UNSAT TT=15547.3	UNSAT TT=6881.08
application/rintanen/ SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT TT=85.142	UNSAT TT=5436.75	UNSAT TT=1157.23	UNSAT TT=949.652	UNSAT TT=85.142
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	UNSAT TT=50676.1	? (TO) TT=160046	UNSAT TT=50676.1	? (TO) TT=160004	? (TO) TT=160003
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf		? (TO) TT=158956	? (TO) TT=159679	? (TO) TT=158935	? (TO) TT=160002
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf		? (TO) TT=156488	? (TO) TT=150500	? (TO) TT=158742	? (TO) TT=160003
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	UNSAT TT=56366.2	? (TO) TT=160004	UNSAT TT=56366.2	? (TO) TT=160006	? (TO) TT=160003
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf		? (TO) TT=158916	? (TO) TT=159880	? (TO) TT=158322	? (TO) TT=160001
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf		? (TO) TT=156344	? (TO) TT=149982	? (TO) TT=158720	? (TO) TT=160003
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT TT=542.332	SAT TT=3625.89	SAT TT=1179.6	SAT TT=542.332	SAT TT=751.904
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT TT=637.149	UNSAT TT=637.149	UNSAT TT=1730.84	UNSAT TT=1721.64	UNSAT TT=651.142
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT TT=12701.5	UNSAT TT=41632.7	UNSAT TT=12701.5	UNSAT TT=93754.6	UNSAT TT=15587.5
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	SAT TT=36639.2	? (TO) TT=159480	SAT TT=41830.1	? (TO) TT=160002	SAT TT=36639.2
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	SAT TT=18152.8	? (TO) TT=158327	SAT TT=77569.1	? (TO) TT=160002	SAT TT=18152.8
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	SAT TT=24553.6	? (TO) TT=157155	? (TO) TT=160005	? (TO) TT=160003	SAT TT=24553.6
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	SAT TT=26196.5	? (TO) TT=155952	SAT TT=27788.9	? (TO) TT=160003	SAT TT=26196.5
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT TT=2239.87	SAT TT=3636.74	? (MO) TT=19698.8	SAT TT=13201.3	SAT TT=2239.87
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT TT=12088.2	SAT TT=22369.4	? (MO) TT=63442.1	SAT TT=105621	SAT TT=12088.2
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	SAT TT=20626.8	SAT TT=41104.6	? (MO) TT=23716.5	? (TO) TT=158596	SAT TT=20626.8
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	SAT TT=5148.61	? (TO) TT=21869.7	? (MO) TT=85328	? (TO) TT=157765	SAT TT=5148.61
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	SAT TT=2339.87	SAT TT=44630.4	SAT TT=2339.87	SAT TT=101061	SAT TT=7534.32
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT TT=98266.1	? (TO) TT=58689.8	? (MO) TT=101948	? (TO) TT=159276	SAT TT=98266.1
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf		? (TO) TT=20522	? (MO) TT=29287.9	? (TO) TT=157895	? (TO) TT=149771
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT TT=1856.09	SAT TT=4094.56	SAT TT=1856.09	SAT TT=12890.2	SAT TT=2292.5
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT TT=3533.27	UNSAT TT=3533.27	UNSAT TT=9170.97	UNSAT TT=9024.97	UNSAT TT=6743.87
APPLICATIONS/ bioinfo/ q_query_3_l46_lambda.cnf	UNSAT TT=2101.44	UNSAT TT=2101.44	UNSAT TT=7877.05	UNSAT TT=3729.84	UNSAT TT=5068.2
APPLICATIONS/ bioinfo/ q_query_3_L70_coli.sat.cnf	SAT TT=1027.79	SAT TT=1027.79	SAT TT=3916.48	SAT TT=2069.22	SAT TT=1143.18
APPLICATIONS/bitverif/ countbitsarray/ countbitsarray04_32.cnf		? (TO) TT=160005	? (TO) TT=160002	? (TO) TT=160002	? (TO) TT=160003
APPLICATIONS/bitverif/ countbitsrotate/ countbitsrotate032.cnf		? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=160002	? (TO) TT=160004
APPLICATIONS/bitverif/ countbitssrl/ countbitssrl064.cnf		? (TO) TT=160006	? (TO) TT=160004	? (TO) TT=160004	? (TO) TT=160001
APPLICATIONS/bitverif/ countbitswegner/ countbitswegner128.cnf	UNSAT TT=129083	? (TO) TT=160055	UNSAT TT=159186	UNSAT TT=129083	? (TO) TT=160004
APPLICATIONS/ bitverif/maxor/ maxor128.cnf	UNSAT TT=26416.7	UNSAT TT=59814.8	UNSAT TT=42567.9	UNSAT TT=26416.7	UNSAT TT=43963.3
APPLICATIONS/ bitverif/maxxor/ maxxor032.cnf	UNSAT TT=949.053	UNSAT TT=21358.7	UNSAT TT=949.053	UNSAT TT=3228.92	UNSAT TT=5142.56
APPLICATIONS/ bitverif/maxxor/ maxxor064.cnf	UNSAT TT=10303	? (TO) TT=160005	UNSAT TT=10303	UNSAT TT=52440.1	UNSAT TT=46604.4
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
APPLICATIONS/ bitverif/maxxor/ maxxor128.cnf	UNSAT TT=148113	? (TO) TT=160005	UNSAT TT=148113	? (TO) TT=160004	? (TO) TT=160002
APPLICATIONS/bitverif/ maxxororand/ maxxororand064.cnf	UNSAT TT=83265.2	UNSAT TT=108289	UNSAT TT=83265.2	? (TO) TT=160005	? (TO) TT=160004
APPLICATIONS/bitverif/ minandmaxor/ minandmaxor016.cnf	UNSAT TT=1.4	UNSAT TT=3.796	UNSAT TT=43.825	UNSAT TT=48.368	UNSAT TT=1.4
APPLICATIONS/bitverif/ minandmaxor/ minandmaxor128.cnf	UNSAT TT=13686.4	UNSAT TT=13686.4	UNSAT TT=39076	UNSAT TT=31210.7	UNSAT TT=56799.7
APPLICATIONS/bitverif/ minxorminand/ minxorminand128.cnf	UNSAT TT=1620.42	UNSAT TT=1620.42	UNSAT TT=41380.3	UNSAT TT=67419.5	UNSAT TT=105032
APPLICATIONS/ bitverif/mulhs/ mulhs016.cnf		? (TO) TT=160002	? (TO) TT=160004	? (TO) TT=160001	? (TO) TT=160002
APPLICATIONS/ bitverif/smulo/ smulo064.cnf		? (TO) TT=160003	? (TO) TT=160005	? (TO) TT=160004	? (TO) TT=157865
APPLICATIONS/ c32sat/ post-c32s-gcdm16-23.cnf	UNSAT TT=151.673	UNSAT TT=151.673	UNSAT TT=2015.6	UNSAT TT=1313.46	UNSAT TT=1530.31
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT TT=101.689	? (TO) TT=21390.7	SAT TT=52922.7	SAT TT=5992.18	SAT TT=101.689
APPLICATIONS/ crypto/desgen/ gss-14-s100.cnf	SAT TT=25.174	SAT TT=79.187	SAT TT=152.549	SAT TT=25.174	SAT TT=179.542
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
APPLICATIONS/ crypto/desgen/ gss-16-s100.cnf	SAT TT=121.177	SAT TT=121.177	SAT TT=1080.15	SAT TT=202.628	SAT TT=256.795
APPLICATIONS/ crypto/desgen/ gss-19-s100.cnf	SAT TT=264.064	SAT TT=1219.38	SAT TT=3003.62	SAT TT=1242.11	SAT TT=264.064
APPLICATIONS/ crypto/desgen/ gss-21-s100.cnf	SAT TT=921.837	SAT TT=13389.9	SAT TT=15280	SAT TT=921.837	SAT TT=3929.5
APPLICATIONS/ crypto/desgen/ gss-22-s100.cnf	SAT TT=968.413	SAT TT=4037.81	SAT TT=29488.9	SAT TT=968.413	SAT TT=3006.07
APPLICATIONS/ crypto/desgen/ gss-27-s100.cnf	SAT TT=22271.7	? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=160001	SAT TT=22271.7
APPLICATIONS/ crypto/md5gen/ gus-md5-11.cnf	UNSAT TT=74749.9	? (TO) TT=160004	UNSAT TT=74749.9	? (TO) TT=160002	UNSAT TT=87819.6
APPLICATIONS/ crypto/md5gen/ gus-md5-12.cnf		? (TO) TT=160004	? (TO) TT=160002	? (TO) TT=160004	? (TO) TT=160004
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT TT=631.091	UNSAT TT=763.346	UNSAT TT=3119.7	UNSAT TT=631.091	UNSAT TT=667.38
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT TT=896.431	SAT TT=1178.03	SAT TT=2955.71	SAT TT=896.431	SAT TT=996.794
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT TT=3363.87	UNSAT TT=3857.32	UNSAT TT=7668.35	UNSAT TT=3363.87	UNSAT TT=5341.81
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT TT=4060.69	SAT TT=4969.94	SAT TT=9591.82	SAT TT=4060.69	SAT TT=6411.87
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT TT=535.574	UNSAT TT=801.381	UNSAT TT=2189.1	UNSAT TT=655.987	UNSAT TT=535.574
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT TT=2293.42	SAT TT=2293.42	SAT TT=2556.57	SAT TT=2314.17	SAT TT=2667.62
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT TT=592.465	SAT TT=976.561	SAT TT=1991.48	SAT TT=697.101	SAT TT=592.465
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT TT=39858.6	UNSAT TT=39858.6	UNSAT TT=44695.2	UNSAT TT=75342.7	UNSAT TT=89511.9
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT TT=33195.3	SAT TT=72511.3	SAT TT=37209.6	SAT TT=33195.3	SAT TT=113266
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT TT=7.88	SAT TT=45.07	SAT TT=756.923	SAT TT=36.422	SAT TT=7.88
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT TT=11502.2	UNSAT TT=11529.2	UNSAT TT=12771	UNSAT TT=11502.2	UNSAT TT=18372.5
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT TT=16806.3	SAT TT=31793.8	SAT TT=16806.3	SAT TT=24794.5	SAT TT=38926.7
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT TT=46.718	UNSAT TT=140.42	UNSAT TT=1478.55	UNSAT TT=232.881	UNSAT TT=46.718
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT TT=35.742	SAT TT=132.375	SAT TT=1462.74	SAT TT=151.305	SAT TT=35.742
APPLICATIONS/ satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT TT=162.569	? (TO) TT=160005	SAT TT=332.216	SAT TT=216.14	SAT TT=162.569
APPLICATIONS/ satComp09_BioInstances/rbcl_xits_08_UNSAT.cnf	UNSAT TT=17681.4	UNSAT TT=17681.4	? (TO) TT=160002	? (TO) TT=160002	UNSAT TT=137812
APPLICATIONS/ satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf		? (TO) TT=160006	? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=160002
APPLICATIONS/ satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT TT=27.678	Signal TT=13.824	SAT TT=102.604	SAT TT=45.593	SAT TT=27.678
APPLICATIONS/ satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT TT=6.931	SAT TT=6.931	SAT TT=109.466	SAT TT=59.104	SAT TT=11.774
APPLICATIONS/ satComp09_BioInstances/rpoc_xits_09_UNSAT.cnf	UNSAT TT=140865	UNSAT TT=140865	? (TO) TT=160004	? (TO) TT=160002	? (TO) TT=160003
ibm-2002-21r-k95.cnf	SAT TT=27.063	SAT TT=172.135	SAT TT=2411.54	SAT TT=565.602	SAT TT=27.063
ibm-2002-30r-k85.cnf	SAT TT=8836.06	SAT TT=43956.8	SAT TT=26535.6	SAT TT=9934.42	SAT TT=8836.06
ibm-2004-01-k90.cnf	SAT TT=278.096	SAT TT=278.096	SAT TT=530.542	SAT TT=566.413	SAT TT=622.949
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
ibm-2004-23-k100.cnf	SAT TT=3010.78	SAT TT=3010.78	SAT TT=6618.26	SAT TT=9419.83	SAT TT=7166.58
industrial/anbulagan/ hard-sat/ partial-10-13-s.cnf	SAT TT=1688	SAT TT=1688	SAT TT=3443.64	SAT TT=9263.69	SAT TT=21569.3
industrial/anbulagan/ hard-sat/ partial-10-15-s.cnf	SAT TT=2275.48	SAT TT=15505.4	SAT TT=3750.63	SAT TT=2275.48	SAT TT=7520.47
industrial/anbulagan/ hard-sat/ partial-10-17-s.cnf	SAT TT=10968	SAT TT=17008	SAT TT=10968	SAT TT=72829.2	SAT TT=41531
industrial/anbulagan/ hard-unsat/ dated-10-17-u.cnf	UNSAT TT=23515.2	UNSAT TT=23515.2	UNSAT TT=30836.9	UNSAT TT=71548.4	UNSAT TT=55541.2
industrial/anbulagan/ hard-unsat/ dated-5-13-u.cnf	UNSAT TT=20077.9	UNSAT TT=23492.9	UNSAT TT=20077.9	UNSAT TT=105888	UNSAT TT=106137
industrial/anbulagan/ hard-unsat/ partial-5-11-u.cnf		? (TO) TT=160005	? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=160002
industrial/anbulagan/ hard-unsat/ total-10-17-u.cnf	UNSAT TT=21390.5	UNSAT TT=21390.5	UNSAT TT=44540	UNSAT TT=112718	UNSAT TT=81308.4
industrial/anbulagan/ medium-unsat/ dated-5-11-u.cnf	UNSAT TT=241.061	UNSAT TT=241.061	UNSAT TT=645.57	UNSAT TT=505.763	UNSAT TT=302.528
industrial/babic/ dspam/ dspam_dump_vc949.cnf	UNSAT TT=1.032	UNSAT TT=1.032	UNSAT TT=100.602	UNSAT TT=15.823	UNSAT TT=6.27
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
industrial/babic/ hsatv17/ hsat_vc12062.cnf	UNSAT TT=1.155	UNSAT TT=1.155	UNSAT TT=202.637	UNSAT TT=76.193	UNSAT TT=7.595
industrial/ crypto/ mizh-sha0-36-2.cnf	SAT TT=1185.47	SAT TT=2027.14	SAT TT=1308.43	SAT TT=1629.79	SAT TT=1185.47
industrial/ fuhs/hard/ AProVE07-01.cnf	UNSAT TT=57347.5	UNSAT TT=91676.5	UNSAT TT=57347.5	? (TO) TT=160003	? (TO) TT=160001
industrial/ fuhs/hard/ AProVE07-03.cnf	UNSAT TT=4935.91	UNSAT TT=4935.91	UNSAT TT=7298.23	UNSAT TT=16630.1	UNSAT TT=19129.6
industrial/ fuhs/medium/ AProVE07-21.cnf	UNSAT TT=565.95	UNSAT TT=565.95	UNSAT TT=1003.22	UNSAT TT=2740.67	UNSAT TT=3415.9
industrial/ IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT TT=4897.74	? (TO) TT=160004	UNSAT TT=4897.74	? (TO) TT=160003	? (TO) TT=160003
industrial/ IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT TT=6733.2	? (TO) TT=160004	UNSAT TT=6733.2	? (TO) TT=160003	? (TO) TT=160002
industrial/ IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT TT=6444.1	? (TO) TT=160003	UNSAT TT=6444.1	? (TO) TT=160002	? (TO) TT=160004
industrial/ IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT TT=6390.7	? (TO) TT=160006	UNSAT TT=6390.7	? (TO) TT=160001	? (TO) TT=160003
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT TT=2621.59	SAT TT=9440.2	SAT TT=5230.98	SAT TT=2621.59	SAT TT=8124.06
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT TT=10964.5	SAT TT=15310.6	SAT TT=36549.8	SAT TT=10964.5	SAT TT=13246.1
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT TT=9306	UNSAT TT=9306	UNSAT TT=16493.4	UNSAT TT=53960.6	UNSAT TT=39031.1
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	UNSAT TT=81294.6	UNSAT TT=81294.6	UNSAT TT=106346	? (TO) TT=160003	? (TO) TT=160003
industrial/ manolios/ manol-pipe-f7idw.cnf	UNSAT TT=581.254	UNSAT TT=581.254	UNSAT TT=5930.63	UNSAT TT=1414.91	UNSAT TT=1193.47
industrial/palacios/ hard/ sortnet-7-ipc5-h15-unsat.cnf		? (TO) TT=160004	? (TO) TT=160006	? (TO) TT=160002	? (TO) TT=160001
industrial/palacios/ hard/ sortnet-8-ipc5-h19-sat.cnf	SAT TT=98394.4	? (TO) TT=160005	? (TO) TT=159185	SAT TT=124681	SAT TT=98394.4
industrial/palacios/ medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT TT=345.399	UNSAT TT=345.399	UNSAT TT=3389.48	UNSAT TT=1053.86	UNSAT TT=808.519
industrial/palacios/ medium/ cube-11-h14-sat.cnf	SAT TT=2054.91	SAT TT=2054.91	SAT TT=10452.5	SAT TT=3672.99	SAT TT=47787.4
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT TT=84.677	? (TO) TT=20430.1	SAT TT=10902.3	SAT TT=2457.58	SAT TT=84.677
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT TT=37.144	? (TO) TT=20429.6	SAT TT=5320.01	SAT TT=2563.97	SAT TT=37.144
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
industrial/ vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT TT=33409.7	UNSAT TT=41888.9	UNSAT TT=33409.7	UNSAT TT=56679	UNSAT TT=40393.2
manol-pipe-c10nidw.cnf	UNSAT TT=9412.51	UNSAT TT=11354.8	UNSAT TT=61334.7	UNSAT TT=16387.9	UNSAT TT=9412.51
manol-pipe-c6bidw_i.cnf	UNSAT TT=634.837	UNSAT TT=634.837	UNSAT TT=3297.63	UNSAT TT=1368.03	UNSAT TT=1157.96
manol-pipe-f7nidw.cnf	UNSAT TT=895.205	UNSAT TT=895.205	UNSAT TT=9796.03	UNSAT TT=1821.47	UNSAT TT=1396.58
mizh-sha0-36-4.cnf	SAT TT=593.866	SAT TT=708.386	SAT TT=1030.09	SAT TT=593.866	SAT TT=603.471
SAT02/industrial/ aloul/Bart/ bart17.shuffled.cnf	SAT TT=0.061	SAT TT=0.413	SAT TT=2.377	SAT TT=0.812	SAT TT=0.061
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT TT=1135.07	UNSAT TT=1135.07	UNSAT TT=13109	UNSAT TT=11768.5	UNSAT TT=1745.8
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT TT=2164.56	UNSAT TT=2164.56	UNSAT TT=34416.6	UNSAT TT=6091.91	UNSAT TT=11631.5
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	UNSAT TT=4399.34	UNSAT TT=4399.34	UNSAT TT=11760.9	UNSAT TT=118423	UNSAT TT=14511.8
SAT02/industrial/ biere/dinphil/ dp04s04.shuffled.cnf	SAT TT=0.089	SAT TT=0.089	SAT TT=5.188	SAT TT=0.692	SAT TT=0.102
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
SAT02/industrial/ biere/dinphil/ dp04u03.shuffled.cnf	UNSAT TT=0.083	Signal TT=0.083	UNSAT TT=4.732	UNSAT TT=0.751	UNSAT TT=0.083
SAT02/industrial/ biere/dinphil/ dp10s10.shuffled.cnf	SAT TT=2.144	Signal TT=2.854	SAT TT=37.653	SAT TT=20.374	SAT TT=2.144
SAT02/industrial/ dellacherie/comb/ comb1.shuffled.cnf	UNSAT TT=291.751	UNSAT TT=2479.27	UNSAT TT=291.751	? (TO) TT=160003	UNSAT TT=1066.94
SAT02/industrial/goldberg/ fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT TT=3.556	SAT TT=6.943	SAT TT=43.133	SAT TT=63.18	SAT TT=3.556
SAT02/industrial/goldberg/ rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT TT=4.741	UNSAT TT=4.741	UNSAT TT=58.475	UNSAT TT=34.745	UNSAT TT=42.159
SAT02/industrial/goldberg/ rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT TT=1.915	UNSAT TT=1.915	UNSAT TT=107.811	UNSAT TT=20.763	UNSAT TT=5.081
SAT02/industrial/goldberg/ rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT TT=139.72	UNSAT TT=139.72	UNSAT TT=180.784	UNSAT TT=145.297	UNSAT TT=642.035
SAT02/industrial/goldberg/ rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT TT=510.183	UNSAT TT=510.183	UNSAT TT=510.343	UNSAT TT=1369.61	UNSAT TT=4384.51
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT TT=161.91	UNSAT TT=74130	UNSAT TT=153572	UNSAT TT=203.543	UNSAT TT=161.91
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT TT=702.513	UNSAT TT=919.853	UNSAT TT=702.513	UNSAT TT=1845.09	UNSAT TT=1576.93
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
SAT03/industrial/goldberg/ hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	UNSAT TT=1149.74	? (TO) TT=160004	UNSAT TT=1149.74	? (TO) TT=160005	UNSAT TT=8484.6
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT TT=5940.8	UNSAT TT=27577	UNSAT TT=5940.8	UNSAT TT=69552	UNSAT TT=99794.6
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT TT=2279.68	UNSAT TT=36726	UNSAT TT=2279.68	UNSAT TT=36708.4	UNSAT TT=26771.1
SAT03/industrial/kukula/ addm_bench/ am_7_7.shuffled-as.sat03-363.cnf		? (TO) TT=160005	? (TO) TT=160004	? (TO) TT=160003	? (TO) TT=160002
SAT03/industrial/li/ li-exam/ li-exam-61.shuffled-as.sat03-366.cnf		? (TO) TT=160005	? (TO) TT=160003	? (TO) TT=160005	? (TO) TT=160002
SAT03/industrial/li/ li-test4/ li-test4-100.shuffled-as.sat03-370.cnf		? (TO) TT=160006	? (TO) TT=160007	? (TO) TT=160004	? (TO) TT=160002
SAT03/industrial/maris/ CNF/ gripper13u.shuffled-as.sat03-395.cnf	UNSAT TT=21500.1	UNSAT TT=21500.1	? (TO) TT=160002	UNSAT TT=86259.8	UNSAT TT=136783
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT TT=7644.84	UNSAT TT=7644.84	UNSAT TT=45169.5	UNSAT TT=16223	UNSAT TT=21162.2
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf		? (TO) TT=153028	? (TO) TT=160005	? (TO) TT=160005	? (TO) TT=160002
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT TT=70944.7	UNSAT TT=70944.7	UNSAT TT=136073	UNSAT TT=126337	UNSAT TT=74468.5
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT TT=273.379	UNSAT TT=273.379	UNSAT TT=978.369	UNSAT TT=1137.22	UNSAT TT=1224.89
SAT04/industrial/ hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT TT=257.733	UNSAT TT=257.733	UNSAT TT=789.321	UNSAT TT=328.279	UNSAT TT=657.366
SAT04/industrial/ hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT TT=24.534	UNSAT TT=24.534	UNSAT TT=402.293	UNSAT TT=147.213	UNSAT TT=234.112
SAT04/industrial/vangelder/ cnf-color/ abb313GPIA-9-c.used-as.sat04-317.cnf	SAT TT=13959.4	SAT TT=20298.5	? (TO) TT=160005	SAT TT=16132.6	SAT TT=13959.4
SAT04/industrial/vangelder/ cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT TT=11.876	SAT TT=19.936	SAT TT=9694.57	SAT TT=203.632	SAT TT=11.876
SAT04/industrial/vangelder/ cnf-color/ myciel6-tr.used-as.sat04-320.cnf	UNSAT TT=1029.96	UNSAT TT=1029.96	UNSAT TT=32929.9	? (TO) TT=160002	UNSAT TT=6989.04
SAT04/industrial/velev/ pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT TT=157.206	SAT TT=162.887	SAT TT=1476.02	SAT TT=157.206	SAT TT=237.556
SAT04/industrial/velev/ pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT TT=155.353	SAT TT=155.353	SAT TT=1399.33	SAT TT=255.753	SAT TT=265.653
SAT04/industrial/velev/ vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT TT=22161.3	UNSAT TT=24770.2	UNSAT TT=22161.3	UNSAT TT=38380.2	UNSAT TT=39451
SAT04/industrial/velev/ vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	UNSAT TT=63687.7	UNSAT TT=80934.4	UNSAT TT=63687.7	UNSAT TT=101492	UNSAT TT=103519
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
SAT04/industrial/velev/ vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	UNSAT TT=84323.6	? (TO) TT=117275	UNSAT TT=84323.6	UNSAT TT=141851	UNSAT TT=149441
SAT05/industrial/grieu05/ vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT TT=74.009	SAT TT=74.525	SAT TT=98.791	SAT TT=74.009	SAT TT=94.462
SAT05/industrial/grieu05/ vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT TT=434.703	SAT TT=434.703	SAT TT=1294.26	SAT TT=5901.75	SAT TT=765.889
SAT05/industrial/grieu05/ vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT TT=1714.43	SAT TT=1714.43	SAT TT=2154.52	SAT TT=4950.31	SAT TT=1827.72
SAT05/industrial/grieu05/ vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT TT=2669.83	SAT TT=2669.83	SAT TT=8305.38	SAT TT=22850.6	SAT TT=18942.6
SAT05/industrial/grieu05/ vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	SAT TT=258.795	SAT TT=10431.1	SAT TT=77578.6	SAT TT=41057.6	SAT TT=258.795
SAT05/industrial/grieu05/ vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	SAT TT=18891.4	? (TO) TT=160004	? (TO) TT=160004	SAT TT=18891.4	SAT TT=27429.2
SAT05/industrial/maris05/ DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT TT=0.021	SAT TT=0.024	SAT TT=2.114	SAT TT=0.453	SAT TT=0.021
SAT05/industrial/maris05/ DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT TT=0.025	SAT TT=0.025	SAT TT=1.463	SAT TT=0.67	SAT TT=0.04
SAT05/industrial/maris05/ Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT TT=0.237	SAT TT=0.237	SAT TT=5.03	SAT TT=4.056	SAT TT=0.257
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
SAT05/industrial/maris05/ Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT TT=0.058	SAT TT=0.058	SAT TT=2.442	SAT TT=0.44	SAT TT=0.086
SAT05/industrial/narain05/ vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT TT=9235.08	SAT TT=17993.1	SAT TT=30694.6	SAT TT=15246.5	SAT TT=9235.08
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT TT=263.092	SAT TT=263.092	SAT TT=1129.23	SAT TT=741.311	SAT TT=475.603
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT TT=4576.88	SAT TT=11402.3	SAT TT=84083	SAT TT=6864.47	SAT TT=4576.88
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT TT=522.488	SAT TT=1085.81	SAT TT=522.488	SAT TT=1595.11	SAT TT=1694.19
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT TT=862.21	SAT TT=1654.03	SAT TT=2026.58	SAT TT=1084.93	SAT TT=862.21
SAT-Race-2010-CNF/ hardware-verification/manolios/c10idw_i.cnf	UNSAT TT=865.262	UNSAT TT=865.262	UNSAT TT=5202.83	UNSAT TT=2119.59	UNSAT TT=1351.17
SAT-Race-2010-CNF/ hardware-verification/ velev/11pipe_11_ooo.cnf	UNSAT TT=46232.8	UNSAT TT=135488	UNSAT TT=46232.8	UNSAT TT=60322.2	? (TO) TT=160002
SAT-Race-2010-CNF/ hardware-verification/ velev/11pipe_k.cnf	UNSAT TT=12795.7	UNSAT TT=13543.5	UNSAT TT=15462.9	UNSAT TT=12795.7	UNSAT TT=30319.1
SAT-Race-2010-CNF/ hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT TT=29539.1	UNSAT TT=29539.1	? (TO) TT=34533.5	UNSAT TT=45972.8	UNSAT TT=51626.1
Bench name	Best results	claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
SAT-Race-2010-CNF/ hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT TT=40091.3	UNSAT TT=40091.3	? (TO) TT=71994.6	UNSAT TT=55924.6	UNSAT TT=53963.6
SAT-Race-2010-CNF/ hardware-verification/velev/ 2dlx_ca_bp_f_liveness.cnf		? (TO) TT=155888	? (TO) TT=105539	? (TO) TT=160005	? (TO) TT=160003
SAT-Race-2010-CNF/ software-verification/ nec/hard-18-U-10652.cnf	UNSAT TT=135.399	UNSAT TT=10030.6	UNSAT TT=3775.79	UNSAT TT=1367.39	UNSAT TT=135.399
SAT-Race-2010-CNF/ software-verification/ nec/hard-25-U-7061.cnf	UNSAT TT=4.912	UNSAT TT=4.912	UNSAT TT=1013.65	UNSAT TT=93.287	UNSAT TT=22.613
SAT-Race-2010-CNF/ software-verification/nec/hard-6-U-7061.cnf	UNSAT TT=47.74	UNSAT TT=125.186	UNSAT TT=1605.73	UNSAT TT=385.983	UNSAT TT=47.74
velev-npe-1.0-9dlx-b71.cnf	SAT TT=264.451	? (TO) TT=20467.7	? (TO) TT=33705.6	SAT TT=3251.84	SAT TT=264.451
velev-pipe-o-uns-1.0-7.cnf	UNSAT TT=1825.13	UNSAT TT=1825.13	UNSAT TT=1858.98	UNSAT TT=2214.24	UNSAT TT=4797.1
velev-pipe-o-uns-1.1-6.cnf	UNSAT TT=383.181	UNSAT TT=383.181	UNSAT TT=680.201	UNSAT TT=579.616	UNSAT TT=936.302
velev-pipe-sat-1.0-b9.cnf	SAT TT=194.519	SAT TT=556.057	SAT TT=17998.7	SAT TT=1161.68	SAT TT=194.519
velev-vliw-uns-4.0-9-i1.cnf	UNSAT TT=35846.4	UNSAT TT=35846.4	UNSAT TT=43270.1	UNSAT TT=61593.4	UNSAT TT=57216.2

Statistics		claspmt 2.0-R4095-patched (fixed) (complete)	CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	Plingeling 587f (fixed) (complete)	ppfolio par (complete)
Number of times the solver is able to give the best known answer		219	236	228	235
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		101	42	33	82