SAT 2007 Competition Phase 2: ranking of solvers

This page presents the ranking of the different solvers. Solvers are ranked on the number of solved instances. Ties are broken by considering the minimum total solution time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

Category "crafted instances" (CRAFTED)

Rank SolverVersionNumber of
solved instances
Cumulated CPU time
on solved instances
Average CPU time
per solved instance
1minisatSAT 20079883316.21850.17
2SATzillaCRAFTED9477016.39819.32
3MiraXTv37876613.85982.23
4MXC2007-02-087781862.981063.16
5CMUSAT2007-02-086652328.27792.85
6picosat5356047242.52787.38
7Rsat2007-02-085570061.641273.85
8March KS2007-02-084745097.02959.51
9TTS4.04213592.84323.64

Category "industrial instances" (INDUST)

Rank SolverVersionNumber of
solved instances
Cumulated CPU time
on solved instances
Average CPU time
per solved instance
1Rsat2007-02-08139134755.87969.47
2picosat535139171834.641236.22
3minisatSAT 2007132173418.611313.78
4TiniSatELite2007-02-08130115106.36885.43
5MiraXTv3126147447.081170.21
6CMUSAT2007-02-08123162428.761320.56
7SiegeV4122141903.821163.15
8MXC2007-02-08116165955.291430.65
9SATzillaCRAFTED114152176.61334.88
10SAT72007-02-08114212015.891859.79

Category "random instances" (RANDOM)

Rank SolverVersionNumber of
solved instances
Cumulated CPU time
on solved instances
Average CPU time
per solved instance
1March KS2007-02-08257177511.15690.7
2adaptg2wsat+2007-02-0825291386.75362.65
3adaptg2wsat02007-02-0824890805.99366.15
4SATzillaRANDOM248119823.47483.16
5ranov2007-02-0824295353.84394.02
6gnovelty+2007-02-08242124438.83514.21
7adaptnovelty2007-02-08240103076.65429.49
8KCNFS2004237179672.01758.11
9sapsrt2007-02-0818837415.96199.02
10minisatSAT 2007140155874.011113.39
11MXC2007-02-08135116819.9865.33
12SAT72007-02-08122100769.43825.98
13DEWSATZ 1A2007-02-08121110654.19914.5
14MiraXTv310694180.5888.5