SAT 2011 Competition: main competition (phase 2): results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver gave a definitive answer (SAT or UNSAT)
textthe solver performed better than the other ones on that instance
textthe solver was ended by a signal
textthe solver gave an incomplete answer
textthe solver was disqualified in the category
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
adaptg2wsat2011 2011-03-02 (incomplete)
borg-sat 11.03.02-industrial [DEPRECATED] (complete)
borg-sat 11.03.02-par-industrial (fixed) (complete)
borg-sat 11.03.02-par-random (fixed) (complete)
borg-sat 11.03.02-random [DEPRECATED] (complete)
borg-sat 11.03.02-seq-industrial (fixed) (complete)
borg-sat 11.03.02-seq-random (fixed) (complete)
clasp 2.0-R4092-crafted (complete)
claspmt 2.0-R4095 [DEPRECATED] (complete)
claspmt 2.0-R4095-patched (fixed) (complete)
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete)
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)
CryptoMiniSat Strange-Night2-st (fixed) (complete)
csls pnorm-8cores (incomplete)
EagleUP 1.565.350 (incomplete)
EBGlucose 1.0 (incomplete)
glucose 2 (complete)
glueminisat 2.2.5 (complete)
jMiniSat 2011 (complete)
Lingeling 587 [DEPRECATED] (complete)
Lingeling 587f (fixed) (complete)
march_rw 2011-03-02 (complete)
minisat hack: cir_minisat 2011-05-13 (simp) (complete)
minisat hack: contrasat 2011-03-02 (complete)
minisat hack: EBMiniSAT 2011-03-02 (incomplete)
minisat hack: LR_GL_SHR 2011-03-02 (complete)
minisat hack: MiniSAT 2.2.0-agile-26 (complete)
minisat hack: minisat_psm 2011-04-01 (complete)
minisat hack reference: minisat 2.2.0 (complete)
MPhaseSAT 2011-02-15 (complete)
MPhaseSAT64 2011-05-14 (fixed) (complete)
MPhaseSAT_M 2011-02-16 (complete)
PicoSAT 941 (complete)
Plingeling 587 [DEPRECATED] (complete)
Plingeling 587f (fixed) (complete)
ppfolio par (complete)
ppfolio seq (complete)
priss 1.0 (complete)
QuteRSat 2011-05-12 (fixed) (complete)
rcl 2011-04-01 (complete)
RestartSAT B95 (complete)
SApperloT2010 2011-05-15 (fixed) (complete)
SArTagnan 2011-05-15 (fixed) (complete)
SAT07 reference solver: minisat SAT 2007 (complete)
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete)
SAT09 reference solver:glucose 1.0 (complete)
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete)
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)
SAT09 reference solver: march_hi hi (complete)
SAT09 reference solver:precosat 236 (complete)
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete)
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete)
SAT09 reference solver: TNM 2009-03-22 (incomplete)
sathys 2011-04-01 (complete)
Satisfiability Solver Selector 2011-03-18 (complete)
sattime 2011-03-02 (incomplete)
sattime+ 2011-03-02 (incomplete)
sattime2011 2011-03-02 (incomplete)
Sol 2011-04-04 (complete)
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete)

Bench nameBest results
on this
instance
adaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/
fuhs/AProVE11/
AProVE11-02.cnf
SAT
TT=1.921

No dataSAT
TT=152.701

SAT
TT=138.822

No dataNo dataSAT
TT=97.838

No dataNo dataSAT
TT=7.37

SAT
TT=7.426

SAT
TT=82.145

SAT
TT=72.8

SAT
TT=7.645

No dataNo dataSAT
TT=4.284

SAT
TT=4.253

SAT
TT=2.226

No dataSAT
TT=23.541

SAT
TT=23.579

No dataSAT
TT=2.711

SAT
TT=2.29

SAT
TT=1.921

SAT
TT=2.575

SAT
TT=2.516

SAT
TT=3.58

SAT
TT=2.398

No dataSAT
TT=16.607

No dataNo dataSAT
TT=44.951

SAT
TT=14.384

SAT
TT=28.961

No dataNo dataSAT
TT=18.212

SAT
TT=4.496

SAT
TT=3.53

No dataNo dataNo dataNo dataSAT
TT=5.877

No dataSAT
TT=6.58

No dataSAT
TT=6.912

No dataNo dataNo dataNo dataSAT
TT=91.84

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-06.cnf
UNSAT
TT=1455.4

No data? (MO)
TT=26531.3

? (MO)
TT=35997.2

No dataNo data? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=18821.7

UNSAT
TT=20135.8

? (TO)
TT=40001

? (TO)
TT=40001.1

? (TO)
TT=5000.14

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=3764.88

UNSAT
TT=2605.08

No dataUNSAT
TT=3456.84

UNSAT
TT=3425.26

No dataUNSAT
TT=2723.85

UNSAT
TT=3173.19

UNSAT
TT=1731.35

UNSAT
TT=2764.54

UNSAT
TT=1501.44

UNSAT
TT=4455.05

UNSAT
TT=1455.4

No dataUNSAT
TT=3880.6

No dataNo dataUNSAT
TT=34574.7

UNSAT
TT=30005

UNSAT
TT=36572.6

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=4093.08

UNSAT
TT=2063.36

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataUNSAT
TT=4910.02

No dataUNSAT
TT=2329.02

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-07.cnf
SAT
TT=4.114

No dataSAT
TT=245.335

SAT
TT=119.273

No dataNo dataSAT
TT=109.62

No dataNo dataSAT
TT=6.915

SAT
TT=7.584

SAT
TT=224.593

SAT
TT=203.296

SAT
TT=113.956

No dataNo dataSAT
TT=4.327

SAT
TT=4.806

SAT
TT=5.007

No dataSAT
TT=39.984

SAT
TT=40.066

No dataSAT
TT=4.114

SAT
TT=5.452

SAT
TT=6.33

SAT
TT=4.533

SAT
TT=5.62

SAT
TT=6.483

SAT
TT=5.557

No dataSAT
TT=19.966

No dataNo dataSAT
TT=115.327

SAT
TT=145.454

SAT
TT=50.643

No dataNo dataSAT
TT=18.461

SAT
TT=7.179

SAT
TT=6.282

No dataNo dataNo dataNo dataSAT
TT=5.392

No dataSAT
TT=8.534

No dataSAT
TT=16.555

No dataNo dataNo dataNo dataSAT
TT=124.1

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-09.cnf
SAT
TT=0.538

No dataSAT
TT=45.829

SAT
TT=34.787

No dataNo dataSAT
TT=20.399

No dataNo dataSAT
TT=3.306

SAT
TT=3.223

SAT
TT=60.774

SAT
TT=59.169

SAT
TT=6.169

No dataNo dataSAT
TT=1.197

SAT
TT=1.046

SAT
TT=0.585

No dataSAT
TT=8.626

SAT
TT=8.658

No dataSAT
TT=0.586

SAT
TT=0.563

SAT
TT=0.611

SAT
TT=0.577

SAT
TT=0.543

SAT
TT=1.125

SAT
TT=0.538

No dataSAT
TT=7.033

No dataNo dataSAT
TT=2.651

SAT
TT=2.601

SAT
TT=6.01

No dataNo dataSAT
TT=7.132

SAT
TT=1.204

SAT
TT=0.747

No dataNo dataNo dataNo dataSAT
TT=1.166

No dataSAT
TT=2.135

No dataSAT
TT=1.522

No dataNo dataNo dataNo dataSAT
TT=34.31

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-10.cnf
SAT
TT=3.609

No dataSAT
TT=271.936

SAT
TT=237.001

No dataNo dataSAT
TT=173.724

No dataNo dataSAT
TT=10.084

SAT
TT=8.354

SAT
TT=136.575

SAT
TT=112.442

SAT
TT=13.904

No dataNo dataSAT
TT=9.025

SAT
TT=5.249

SAT
TT=5.5

No dataSAT
TT=31.718

SAT
TT=34.965

No dataSAT
TT=14.782

SAT
TT=7.62

SAT
TT=4.173

SAT
TT=3.609

SAT
TT=9.829

SAT
TT=37.329

SAT
TT=21.55

No dataSAT
TT=34.264

No dataNo dataSAT
TT=101.833

SAT
TT=19.22

SAT
TT=37.74

No dataNo dataSAT
TT=17.692

SAT
TT=5.714

SAT
TT=6.557

No dataNo dataNo dataNo dataSAT
TT=539.476

No dataSAT
TT=7.949

No dataSAT
TT=7.347

No dataNo dataNo dataNo dataSAT
TT=115.03

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-11.cnf
UNSAT
TT=11.768

No dataUNSAT
TT=318.173

UNSAT
TT=334.222

No dataNo dataUNSAT
TT=84.124

No dataNo dataUNSAT
TT=161.354

UNSAT
TT=178.254

UNSAT
TT=416.72

UNSAT
TT=367.32

UNSAT
TT=58.639

No dataNo dataUNSAT
TT=17.547

UNSAT
TT=12.761

UNSAT
TT=13.346

No dataUNSAT
TT=41.943

UNSAT
TT=41.797

No dataUNSAT
TT=17.461

UNSAT
TT=22.212

UNSAT
TT=11.768

UNSAT
TT=15.237

UNSAT
TT=12.652

UNSAT
TT=19.033

UNSAT
TT=13.798

No dataUNSAT
TT=44.619

No dataNo dataUNSAT
TT=301.63

UNSAT
TT=303.831

UNSAT
TT=211.235

No dataNo dataUNSAT
TT=40.069

UNSAT
TT=15.951

UNSAT
TT=15.306

No dataNo dataNo dataNo dataUNSAT
TT=21.981

No dataUNSAT
TT=41.278

No dataUNSAT
TT=31.369

No dataNo dataNo dataNo dataUNSAT
TT=112.32

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-12.cnf
SAT
TT=0.371

No dataSAT
TT=14.807

SAT
TT=12.515

No dataNo dataSAT
TT=11.711

No dataNo dataSAT
TT=0.942

SAT
TT=1.624

SAT
TT=22.121

SAT
TT=21.354

SAT
TT=2.344

No dataNo dataSAT
TT=0.799

SAT
TT=0.674

SAT
TT=0.389

No dataSAT
TT=4.324

SAT
TT=4.332

No dataSAT
TT=0.476

SAT
TT=0.396

SAT
TT=0.371

SAT
TT=0.387

SAT
TT=0.382

SAT
TT=0.656

SAT
TT=0.378

No dataSAT
TT=3.558

No dataNo dataSAT
TT=3.789

SAT
TT=4.737

SAT
TT=5.317

No dataNo dataSAT
TT=2.312

SAT
TT=0.758

SAT
TT=0.42

No dataNo dataNo dataNo dataSAT
TT=2.43

No dataSAT
TT=1.325

No dataSAT
TT=1.037

No dataNo dataNo dataNo dataSAT
TT=21.94

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-13.cnf
SAT
TT=4.722

No dataSAT
TT=524.203

SAT
TT=507.233

No dataNo dataSAT
TT=369.07

No dataNo dataSAT
TT=37.873

SAT
TT=40.134

SAT
TT=228.779

SAT
TT=209.983

SAT
TT=21.329

No dataNo dataSAT
TT=9.273

SAT
TT=11.227

SAT
TT=4.846

No dataSAT
TT=49.832

SAT
TT=49.922

No dataSAT
TT=7.203

SAT
TT=5.978

SAT
TT=4.722

SAT
TT=5.034

SAT
TT=5.034

SAT
TT=7.841

SAT
TT=5.694

No dataSAT
TT=21.57

No dataNo dataSAT
TT=17.038

SAT
TT=62.286

SAT
TT=33.577

No dataNo dataSAT
TT=32.046

SAT
TT=9.794

SAT
TT=6.703

No dataNo dataNo dataNo dataSAT
TT=17.122

No dataSAT
TT=13.475

No dataSAT
TT=23.704

No dataNo dataNo dataNo dataSAT
TT=119.8

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-15.cnf
SAT
TT=2

No dataSAT
TT=46.364

SAT
TT=75.507

No dataNo dataSAT
TT=23.755

No dataNo dataSAT
TT=1.699

SAT
TT=4.502

SAT
TT=41.352

SAT
TT=30.798

SAT
TT=39.048

No dataNo dataSAT
TT=17.141

SAT
TT=2.14

SAT
TT=15.704

No dataSAT
TT=19.868

SAT
TT=19.869

No dataSAT
TT=12.217

SAT
TT=2

SAT
TT=3.434

SAT
TT=10.16

SAT
TT=4.691

SAT
TT=2.904

SAT
TT=3.93

No dataSAT
TT=7.47

No dataNo dataSAT
TT=58.46

SAT
TT=68.709

SAT
TT=30.229

No dataNo dataSAT
TT=13.33

SAT
TT=2.557

SAT
TT=15.235

No dataNo dataNo dataNo dataSAT
TT=2.704

No dataSAT
TT=5.401

No dataSAT
TT=5.195

No dataNo dataNo dataNo dataSAT
TT=61.31

No dataNo dataNo dataNo dataNo data
application/
fuhs/AProVE11/
AProVE11-16.cnf
SAT
TT=0.787

No dataSAT
TT=62.283

SAT
TT=44.302

No dataNo dataSAT
TT=27.04

No dataNo dataSAT
TT=4.349

SAT
TT=4.577

SAT
TT=77.786

SAT
TT=74.044

SAT
TT=8.918

No dataNo dataSAT
TT=1.781

SAT
TT=1.543

SAT
TT=1.027

No dataSAT
TT=12.309

SAT
TT=12.384

No dataSAT
TT=0.953

SAT
TT=0.829

SAT
TT=0.876

SAT
TT=0.822

SAT
TT=0.802

SAT
TT=1.501

SAT
TT=0.787

No dataSAT
TT=9.642

No dataNo dataSAT
TT=16.613

SAT
TT=12.894

SAT
TT=19.167

No dataNo dataSAT
TT=6.751

SAT
TT=1.613

SAT
TT=1.055

No dataNo dataNo dataNo dataSAT
TT=1.813

No dataSAT
TT=3.64

No dataSAT
TT=2.241

No dataNo dataNo dataNo dataSAT
TT=47.31

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom12.cnf
UNSAT
TT=7.187

No dataUNSAT
TT=178.718

UNSAT
TT=167.246

No dataNo dataUNSAT
TT=95.911

No dataNo dataUNSAT
TT=338.239

UNSAT
TT=139.755

UNSAT
TT=47.431

UNSAT
TT=51.82

UNSAT
TT=13.779

No dataNo dataUNSAT
TT=1877.54

UNSAT
TT=564.893

UNSAT
TT=1372.3

No dataUNSAT
TT=129.037

UNSAT
TT=128.511

No dataUNSAT
TT=293.959

UNSAT
TT=1568.76

UNSAT
TT=332.897

UNSAT
TT=121.028

UNSAT
TT=221.391

UNSAT
TT=71.44

UNSAT
TT=218.453

No dataUNSAT
TT=136.607

No dataNo dataUNSAT
TT=314.462

UNSAT
TT=471.76

UNSAT
TT=227.884

No dataNo dataUNSAT
TT=7.187

? (TO)
TT=5000.06

UNSAT
TT=339.89

No dataNo dataNo dataNo dataUNSAT
TT=108.357

No dataUNSAT
TT=357.46

No dataUNSAT
TT=234.082

No dataNo dataNo dataNo dataUNSAT
TT=20.55

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom13.cnf
UNSAT
TT=93.919

No dataUNSAT
TT=1577.42

UNSAT
TT=420.819

No dataNo dataUNSAT
TT=154.829

No dataNo dataUNSAT
TT=1348.77

UNSAT
TT=1959.8

UNSAT
TT=233.766

UNSAT
TT=230.524

UNSAT
TT=94.587

No dataNo data? (TO)
TT=5000.03

UNSAT
TT=349.932

UNSAT
TT=2005.52

No dataUNSAT
TT=722.95

UNSAT
TT=719.795

No dataUNSAT
TT=343.827

UNSAT
TT=637.792

UNSAT
TT=845.26

UNSAT
TT=444.362

UNSAT
TT=2603.46

UNSAT
TT=2094.41

UNSAT
TT=3706.17

No dataUNSAT
TT=641.803

No dataNo dataUNSAT
TT=4225.4

UNSAT
TT=3072.31

UNSAT
TT=714.369

No dataNo dataUNSAT
TT=93.919

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataUNSAT
TT=3630.21

No dataUNSAT
TT=1218.18

No dataUNSAT
TT=130.69

No dataNo dataNo dataNo dataUNSAT
TT=410.3

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom14.cnf
UNSAT
TT=762.1

No dataUNSAT
TT=8927.65

UNSAT
TT=4181.21

No dataNo dataUNSAT
TT=3662.02

No dataNo dataUNSAT
TT=7964.2

? (TO)
TT=40000.8

UNSAT
TT=2666.52

UNSAT
TT=1505.79

UNSAT
TT=762.1

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.07

UNSAT
TT=3414.61

No data? (TO)
TT=5000.11

? (TO)
TT=5000.11

No data? (TO)
TT=5000.1

UNSAT
TT=1934.33

? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=5000.03

? (TO)
TT=5000.13

No data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=12085.3

UNSAT
TT=15256

UNSAT
TT=3936.64

No dataNo dataUNSAT
TT=1466.06

? (TO)
TT=5000.02

? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataUNSAT
TT=11077.2

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom15.cnf
UNSAT
TT=16550.6

No data? (TO)
TT=40000.4

?
TT=39796.9

No dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=40001.2

? (TO)
TT=40001

UNSAT
TT=16550.6

UNSAT
TT=20783.6

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.04

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

? (TO)
TT=5000.12

No data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=4971.07

? (TO)
TT=5000.13

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40001

? (TO)
TT=40000.2

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.03

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=20397.5

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom16.cnf



No data? (TO)
TT=40000.5

?
TT=39827.2

No dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=35861.8

? (TO)
TT=40000.8

? (TO)
TT=40000.4

? (TO)
TT=40000.4

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

? (TO)
TT=5000.11

? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=40000.9

? (TO)
TT=40000.6

? (TO)
TT=40000.8

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.01

? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20397.3

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom17.cnf



No data? (TO)
TT=40000.4

?
TT=39822.5

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=35804.7

? (TO)
TT=40001.2

? (TO)
TT=40001.1

? (TO)
TT=40000.8

? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.03

? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.13

? (TO)
TT=5000.05

? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40001

? (TO)
TT=35512

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=20396.7

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom18.cnf



No data? (TO)
TT=40000.3

?
TT=39794.5

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=30687.2

? (TO)
TT=40001

? (TO)
TT=40000.6

? (TO)
TT=40000.5

? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.01

? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

? (TO)
TT=5000.12

? (TO)
TT=5000.07

? (TO)
TT=5000.11

? (TO)
TT=5000.03

? (TO)
TT=5000.01

? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.5

? (TO)
TT=35672.8

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=20396.6

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom19.cnf



No data? (TO)
TT=40000.4

?
TT=39781.3

No dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=35786

? (TO)
TT=40000.6

? (TO)
TT=40001

? (TO)
TT=40000.6

? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.01

? (TO)
TT=5000.11

No data? (TO)
TT=5000.12

? (TO)
TT=5000.13

No data? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.11

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.3

? (TO)
TT=35672.3

No dataNo data? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=20395.8

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom20.cnf



No data? (TO)
TT=40000.5

?
TT=39781.3

No dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.7

? (TO)
TT=40000.7

? (TO)
TT=40001.1

? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.03

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

? (TO)
TT=5000.1

? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.13

? (TO)
TT=5000.04

? (TO)
TT=5000.13

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40001

? (TO)
TT=40000.5

? (TO)
TT=34702.9

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.04

? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=20395

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom21.cnf



No data? (TO)
TT=40000.6

?
TT=39765.2

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40001.3

? (TO)
TT=40001.4

? (TO)
TT=40000.9

? (TO)
TT=40000.8

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.02

? (TO)
TT=5000.11

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=40000.9

? (TO)
TT=35672.6

No dataNo data? (TO)
TT=5000.14

? (TO)
TT=5000.01

? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=20394.2

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom22.cnf



No data? (TO)
TT=35783.6

?
TT=39771.1

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40001.4

? (TO)
TT=40001

? (TO)
TT=40001.1

? (TO)
TT=40001.1

? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.8

? (TO)
TT=35369.7

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=20394.8

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom23.cnf



No data? (TO)
TT=40000.4

?
TT=39746.5

No dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40001

? (TO)
TT=40001.2

? (TO)
TT=40001.1

? (TO)
TT=40000.7

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

? (TO)
TT=5000.12

No data? (TO)
TT=5000.08

? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.12

? (TO)
TT=5000.02

? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.6

? (TO)
TT=35670.3

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=20393.5

No data? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom24.cnf



No data? (TO)
TT=40000.3

?
TT=39733.5

No dataNo data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=35745.4

? (TO)
TT=40001.5

? (TO)
TT=40000.9

? (TO)
TT=40000.8

? (TO)
TT=5000.15

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

? (TO)
TT=5000.14

No data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.12

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.7

? (TO)
TT=32524.5

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.1

? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=20392.7

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom25.cnf



No data? (TO)
TT=40000.8

?
TT=39198.1

No dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40001.3

? (TO)
TT=40001.2

? (TO)
TT=40001.2

? (TO)
TT=40000.8

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.01

? (TO)
TT=5000.05

No data? (TO)
TT=5000.08

? (TO)
TT=5000.04

No data? (TO)
TT=5000.13

? (TO)
TT=5000.04

? (TO)
TT=5000.12

? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000

? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.9

? (TO)
TT=40000.5

? (TO)
TT=35671.9

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20392.5

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-bottom26.cnf



No data? (TO)
TT=40000.4

?
TT=39020.1

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=35739.9

? (TO)
TT=40001.4

? (TO)
TT=40001

? (TO)
TT=40000.9

? (TO)
TT=5000.2

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

? (TO)
TT=5000.12

No data? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.5

? (TO)
TT=35636.2

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20392.5

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top21.cnf
UNSAT
TT=18199.9

No data? (TO)
TT=40000.3

?
TT=39774.2

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=35716

? (TO)
TT=40000.8

UNSAT
TT=28768.5

UNSAT
TT=23194.7

? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.02

? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

? (TO)
TT=5000.11

? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=34809.9

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.08

? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=18199.9

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top22.cnf



No data? (TO)
TT=40000.3

?
TT=39766.2

No dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=39344.9

? (TO)
TT=40000.7

? (TO)
TT=40000.6

? (TO)
TT=40000.6

? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

? (TO)
TT=5000.14

No data? (TO)
TT=5000.11

? (TO)
TT=5000.12

? (TO)
TT=5000.12

? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=35668

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=20395.1

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top23.cnf
SAT
TT=640.829

No data? (TO)
TT=40000.1

?
TT=39746.6

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=35645

? (TO)
TT=40000.9

SAT
TT=24177.7

SAT
TT=21882.9

? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (TO)
TT=5000.1

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

SAT
TT=640.829

? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.03

SAT
TT=4184.86

? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40001

? (TO)
TT=40000.5

? (TO)
TT=35587.1

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20395

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top24.cnf
SAT
TT=585.525

No dataSAT
TT=10034.3

SAT
TT=2530.05

No dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40001.2

SAT
TT=2977.46

SAT
TT=4481.94

SAT
TT=585.525

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.01

? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

No data? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.13

? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40001.1

? (TO)
TT=35269.3

No dataNo dataSAT
TT=728.731

? (TO)
TT=5000.08

SAT
TT=4768.12

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=20394.8

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top25.cnf
SAT
TT=1033.04

No dataSAT
TT=6197.85

SAT
TT=13022

No dataNo dataSAT
TT=2196.17

No dataNo dataSAT
TT=22500

SAT
TT=16160.6

SAT
TT=1033.04

SAT
TT=2967.81

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.02

? (TO)
TT=5000.03

No data? (TO)
TT=5000.08

? (TO)
TT=5000.07

No dataSAT
TT=4668.07

SAT
TT=2570.3

? (TO)
TT=5000.12

? (TO)
TT=5000.04

? (TO)
TT=5000.04

SAT
TT=2024.52

? (TO)
TT=5000.12

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=3354.27

SAT
TT=24620.3

? (TO)
TT=35629.1

No dataNo dataSAT
TT=1986.46

? (TO)
TT=5000.02

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataSAT
TT=11618.5

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top26.cnf
SAT
TT=847.939

No dataSAT
TT=1187.16

SAT
TT=7862.52

No dataNo data? (TO)
TT=5000.04

No dataNo dataSAT
TT=39985.1

SAT
TT=18272.5

SAT
TT=2473.52

SAT
TT=9625.04

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.05

SAT
TT=2127.38

? (TO)
TT=5000.03

No data? (TO)
TT=5000.13

? (TO)
TT=5000.07

No dataSAT
TT=2588.3

SAT
TT=2905.29

SAT
TT=1311.41

? (TO)
TT=5000.09

SAT
TT=2872.98

SAT
TT=1198.33

SAT
TT=847.939

No dataSAT
TT=3769.99

No dataNo dataSAT
TT=4971.99

SAT
TT=6221.88

SAT
TT=13024.1

No dataNo data? (TO)
TT=5000.05

SAT
TT=3017.71

SAT
TT=1463.52

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataSAT
TT=6261.8

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataSAT
TT=3784.53

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top28.cnf
SAT
TT=247.738

No dataSAT
TT=9943.04

SAT
TT=13066.2

No dataNo dataSAT
TT=247.738

No dataNo dataSAT
TT=6986.16

SAT
TT=8250.25

SAT
TT=1648.1

SAT
TT=1424.84

SAT
TT=1124.53

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000

? (TO)
TT=5000.09

No dataSAT
TT=675.135

SAT
TT=673.354

No dataSAT
TT=3360.77

SAT
TT=583.09

SAT
TT=1352.96

? (TO)
TT=5000.03

SAT
TT=620.599

SAT
TT=824.637

SAT
TT=580.617

No dataSAT
TT=2188.16

No dataNo dataSAT
TT=3324.45

SAT
TT=4606.62

SAT
TT=26100.7

No dataNo data? (TO)
TT=5000.08

SAT
TT=465.106

SAT
TT=408.167

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataSAT
TT=439.25

No dataSAT
TT=3738.36

No dataNo dataNo dataNo dataSAT
TT=4312.91

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top29.cnf
SAT
TT=46.841

No dataSAT
TT=1425.02

SAT
TT=3498.85

No dataNo dataSAT
TT=874.843

No dataNo dataSAT
TT=4912.51

SAT
TT=2422.68

SAT
TT=1330.44

SAT
TT=3108.3

? (TO)
TT=5000.15

No dataNo data? (TO)
TT=5000.03

SAT
TT=3355.37

? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

? (TO)
TT=5000.1

No dataSAT
TT=615.526

SAT
TT=698.69

SAT
TT=3086.85

? (TO)
TT=5000.06

SAT
TT=256.156

SAT
TT=145.214

SAT
TT=261.665

No dataSAT
TT=2791.65

No dataNo dataSAT
TT=4113.01

SAT
TT=4673.98

SAT
TT=3267.79

No dataNo data? (TO)
TT=5000.07

SAT
TT=46.841

SAT
TT=1882.35

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataSAT
TT=2339.59

No dataSAT
TT=978.935

No dataNo dataNo dataNo dataSAT
TT=906.7

No dataNo dataNo dataNo dataNo data
application/fuhs/
slp-synthesis-AES/
slp-synthesis-aes-top30.cnf
SAT
TT=94.336

No dataSAT
TT=2952.61

SAT
TT=3335.22

No dataNo dataSAT
TT=878.933

No dataNo dataSAT
TT=602.001

SAT
TT=7531.42

SAT
TT=1424.16

SAT
TT=1241.29

SAT
TT=1543.15

No dataNo data? (TO)
TT=5000.06

SAT
TT=3794.22

? (TO)
TT=5000.05

No dataSAT
TT=377.201

SAT
TT=376.67

No dataSAT
TT=2101.76

SAT
TT=421.729

SAT
TT=2865.07

? (TO)
TT=5000.1

SAT
TT=987.606

SAT
TT=137.091

SAT
TT=423.065

No dataSAT
TT=1504.48

No dataNo dataSAT
TT=6361.02

SAT
TT=6207.4

SAT
TT=723.56

No dataNo data? (TO)
TT=5000.08

SAT
TT=94.336

SAT
TT=768.544

No dataNo dataNo dataNo dataSAT
TT=4132.91

No dataSAT
TT=95.485

No dataSAT
TT=2302.65

No dataNo dataNo dataNo dataSAT
TT=1903.06

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pathways-13-step17.cnf
UNSAT
TT=179.191

No dataUNSAT
TT=1073.44

UNSAT
TT=1023.15

No dataNo dataUNSAT
TT=252.352

No dataNo dataUNSAT
TT=1424.91

UNSAT
TT=1506.39

UNSAT
TT=858.298

UNSAT
TT=828.13

UNSAT
TT=199.118

No dataNo dataUNSAT
TT=1217.45

UNSAT
TT=678.05

UNSAT
TT=652.279

No dataUNSAT
TT=270.724

UNSAT
TT=270.171

No dataUNSAT
TT=1076.37

UNSAT
TT=927.47

UNSAT
TT=1841.54

UNSAT
TT=2945.38

UNSAT
TT=1762.46

UNSAT
TT=1532.02

UNSAT
TT=1754.4

No dataUNSAT
TT=1184.52

No dataNo dataUNSAT
TT=1375.86

UNSAT
TT=1190.42

UNSAT
TT=1382.01

No dataNo dataUNSAT
TT=179.91

UNSAT
TT=1504.13

UNSAT
TT=874.828

No dataNo dataNo dataNo dataUNSAT
TT=1225.46

No dataUNSAT
TT=934.669

No dataUNSAT
TT=179.191

No dataNo dataNo dataNo dataUNSAT
TT=642.73

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pathways-17-step20.cnf
UNSAT
TT=130.866

No dataUNSAT
TT=1368.11

UNSAT
TT=1465.34

No dataNo dataUNSAT
TT=310.925

No dataNo dataUNSAT
TT=2863.38

UNSAT
TT=1976.04

UNSAT
TT=874.58

UNSAT
TT=878.102

UNSAT
TT=170.985

No dataNo dataUNSAT
TT=589.296

UNSAT
TT=320.24

UNSAT
TT=401.724

No dataUNSAT
TT=188.835

UNSAT
TT=188.633

No dataUNSAT
TT=1340.14

UNSAT
TT=352.81

UNSAT
TT=620.462

UNSAT
TT=1593.51

UNSAT
TT=656.513

UNSAT
TT=369.839

UNSAT
TT=644.436

No dataUNSAT
TT=183.582

No dataNo dataUNSAT
TT=987.694

UNSAT
TT=929.137

UNSAT
TT=1391.19

No dataNo dataUNSAT
TT=215.393

UNSAT
TT=973.849

UNSAT
TT=771.185

No dataNo dataNo dataNo dataUNSAT
TT=988.004

No dataUNSAT
TT=930.143

No dataUNSAT
TT=130.866

No dataNo dataNo dataNo dataUNSAT
TT=629.71

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pathways-17-step21.cnf
SAT
TT=72.002

No dataSAT
TT=1056.84

SAT
TT=1100.37

No dataNo dataSAT
TT=303.595

No dataNo dataSAT
TT=530.154

SAT
TT=1441.68

SAT
TT=874.988

SAT
TT=610.223

SAT
TT=198.003

No dataNo dataSAT
TT=941.679

SAT
TT=2125.29

SAT
TT=2233.65

No dataSAT
TT=589.477

SAT
TT=591.241

No dataSAT
TT=1790.46

SAT
TT=2153.29

? (TO)
TT=5000.11

SAT
TT=2260.26

SAT
TT=2933

SAT
TT=1520.85

SAT
TT=2922.3

No dataSAT
TT=72.002

No dataNo dataSAT
TT=877.436

SAT
TT=576.12

SAT
TT=367.34

No dataNo dataSAT
TT=195.505

? (TO)
TT=5000.03

SAT
TT=1183.1

No dataNo dataNo dataNo dataSAT
TT=452.086

No dataSAT
TT=1131.74

No dataSAT
TT=117.99

No dataNo dataNo dataNo dataSAT
TT=814.6

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-12-step15.cnf
UNSAT
TT=61.399

No dataUNSAT
TT=532.3

UNSAT
TT=459.48

No dataNo dataUNSAT
TT=92.878

No dataNo dataUNSAT
TT=127.661

UNSAT
TT=164.264

UNSAT
TT=504.949

UNSAT
TT=399.139

UNSAT
TT=61.399

No dataNo dataUNSAT
TT=167.518

UNSAT
TT=199.133

UNSAT
TT=196.154

No dataUNSAT
TT=176.032

UNSAT
TT=176.695

No dataUNSAT
TT=460.357

UNSAT
TT=414.497

UNSAT
TT=330.882

UNSAT
TT=315.069

UNSAT
TT=537.096

UNSAT
TT=402.926

UNSAT
TT=540.442

No dataUNSAT
TT=62.446

No dataNo dataUNSAT
TT=357.454

UNSAT
TT=358.701

UNSAT
TT=210.045

No dataNo dataUNSAT
TT=77.163

UNSAT
TT=366.047

UNSAT
TT=307.492

No dataNo dataNo dataNo dataUNSAT
TT=329.698

No dataUNSAT
TT=431.976

No dataUNSAT
TT=73.793

No dataNo dataNo dataNo dataUNSAT
TT=109.25

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-12-step16.cnf
SAT
TT=6.337

No dataSAT
TT=196.558

SAT
TT=180.64

No dataNo dataSAT
TT=94.492

No dataNo dataSAT
TT=140.797

SAT
TT=92.833

SAT
TT=374.099

SAT
TT=113.366

SAT
TT=70.38

No dataNo dataSAT
TT=44.78

SAT
TT=49.042

SAT
TT=55.027

No dataSAT
TT=61.656

SAT
TT=55.684

No dataSAT
TT=45.009

SAT
TT=128.719

SAT
TT=125.338

SAT
TT=23.802

SAT
TT=6.347

SAT
TT=142.134

SAT
TT=6.337

No dataSAT
TT=23.66

No dataNo dataSAT
TT=321.12

SAT
TT=354.63

SAT
TT=111.999

No dataNo dataSAT
TT=30.071

SAT
TT=125.292

SAT
TT=187.999

No dataNo dataNo dataNo dataSAT
TT=77.351

No dataSAT
TT=155.384

No dataSAT
TT=46.625

No dataNo dataNo dataNo dataSAT
TT=110.34

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-18-step15.cnf
UNSAT
TT=7.666

No dataUNSAT
TT=272.014

UNSAT
TT=235.451

No dataNo dataUNSAT
TT=116.423

No dataNo dataUNSAT
TT=218.095

UNSAT
TT=213.174

UNSAT
TT=135.427

UNSAT
TT=125.484

UNSAT
TT=16.942

No dataNo dataUNSAT
TT=7.666

UNSAT
TT=10.465

UNSAT
TT=8.646

No dataUNSAT
TT=27.692

UNSAT
TT=27.802

No dataUNSAT
TT=17.577

UNSAT
TT=14.604

UNSAT
TT=10.522

UNSAT
TT=11.95

UNSAT
TT=13.7

UNSAT
TT=11.856

UNSAT
TT=13.366

No dataUNSAT
TT=25.438

No dataNo dataUNSAT
TT=155.701

UNSAT
TT=139.512

UNSAT
TT=94.107

No dataNo dataUNSAT
TT=23.479

UNSAT
TT=25.758

UNSAT
TT=12.591

No dataNo dataNo dataNo dataUNSAT
TT=11.291

No dataUNSAT
TT=43.854

No dataUNSAT
TT=56.326

No dataNo dataNo dataNo dataUNSAT
TT=141.91

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-18-step16.cnf
SAT
TT=24.89

No dataSAT
TT=412.557

SAT
TT=357.455

No dataNo dataSAT
TT=160.246

No dataNo dataSAT
TT=313.731

SAT
TT=295.482

SAT
TT=267.815

SAT
TT=200.428

SAT
TT=24.89

No dataNo dataSAT
TT=28.524

SAT
TT=62.366

SAT
TT=44.409

No dataSAT
TT=73.064

SAT
TT=80.564

No dataSAT
TT=241.198

SAT
TT=639

SAT
TT=42.529

SAT
TT=82.107

SAT
TT=80.351

SAT
TT=406.618

SAT
TT=81

No dataSAT
TT=104.29

No dataNo dataSAT
TT=313.036

SAT
TT=317.867

SAT
TT=172

No dataNo dataSAT
TT=33.499

SAT
TT=734.014

SAT
TT=79.083

No dataNo dataNo dataNo dataSAT
TT=114.625

No dataSAT
TT=115.106

No dataSAT
TT=117.279

No dataNo dataNo dataNo dataSAT
TT=189.23

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-27-step13.cnf
UNSAT
TT=29.848

No dataUNSAT
TT=562.309

UNSAT
TT=596.094

No dataNo dataUNSAT
TT=275.599

No dataNo dataUNSAT
TT=824.052

UNSAT
TT=814.525

UNSAT
TT=420.607

UNSAT
TT=370.313

UNSAT
TT=40.514

No dataNo dataUNSAT
TT=37.092

UNSAT
TT=29.848

UNSAT
TT=43.203

No dataUNSAT
TT=88.736

UNSAT
TT=91.389

No dataUNSAT
TT=158.985

UNSAT
TT=91.217

UNSAT
TT=60.013

UNSAT
TT=54.887

UNSAT
TT=92.954

UNSAT
TT=93.571

UNSAT
TT=91.817

No dataUNSAT
TT=62.525

No dataNo dataUNSAT
TT=412.952

UNSAT
TT=474.312

UNSAT
TT=274.684

No dataNo dataUNSAT
TT=72.37

UNSAT
TT=64.626

UNSAT
TT=59.35

No dataNo dataNo dataNo dataUNSAT
TT=68.345

No data? (exit code)
TT=163.398

No dataUNSAT
TT=155.502

No dataNo dataNo dataNo dataUNSAT
TT=415.71

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-27-step14.cnf
SAT
TT=10.518

No dataSAT
TT=705.217

SAT
TT=525.822

No dataNo dataSAT
TT=288.126

No dataNo dataSAT
TT=1122.33

SAT
TT=1055.36

SAT
TT=227.08

SAT
TT=212.457

SAT
TT=65.649

No dataNo dataSAT
TT=28.762

SAT
TT=10.518

SAT
TT=27.772

No dataSAT
TT=184.772

SAT
TT=184.184

No dataSAT
TT=30.731

SAT
TT=104.418

SAT
TT=76.595

SAT
TT=36.762

SAT
TT=110.704

SAT
TT=21.534

SAT
TT=109.359

No dataSAT
TT=79.211

No dataNo dataSAT
TT=201.081

SAT
TT=208.539

SAT
TT=665.31

No dataNo dataSAT
TT=82.063

SAT
TT=143.559

SAT
TT=99.536

No dataNo dataNo dataNo dataSAT
TT=127.576

No data? (exit code)
TT=146.411

No dataSAT
TT=198.454

No dataNo dataNo dataNo dataSAT
TT=332.86

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-rovers-18-step11.cnf
UNSAT
TT=3.933

No dataUNSAT
TT=296.585

UNSAT
TT=82.426

No dataNo dataUNSAT
TT=162.431

No dataNo data? (TO)
TT=35790

? (TO)
TT=40001.4

UNSAT
TT=137.549

UNSAT
TT=89.134

UNSAT
TT=64.543

No dataNo dataUNSAT
TT=8.286

UNSAT
TT=5.638

UNSAT
TT=5.451

No data? (TO)
TT=5000.1

? (TO)
TT=5000.12

No dataUNSAT
TT=3.933

UNSAT
TT=5.17

UNSAT
TT=10.427

UNSAT
TT=4.651

UNSAT
TT=7.585

UNSAT
TT=9.092

UNSAT
TT=15.083

No data? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=103.586

UNSAT
TT=138.538

UNSAT
TT=49.112

No dataNo dataUNSAT
TT=136.691

UNSAT
TT=8.013

UNSAT
TT=15.833

No dataNo dataNo dataNo dataUNSAT
TT=7.115

No dataUNSAT
TT=16.427

No dataUNSAT
TT=252.021

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-rovers-18-step12.cnf
SAT
TT=0.394

No dataSAT
TT=13.042

SAT
TT=11.891

No dataNo dataSAT
TT=15.631

No dataNo dataSAT
TT=3.528

Signal
TT=3.861

SAT
TT=53.139

SAT
TT=45.918

SAT
TT=4.971

No dataNo dataSAT
TT=1.021

SAT
TT=1.063

SAT
TT=0.411

No dataSAT
TT=41.579

SAT
TT=42.816

No dataSAT
TT=0.521

SAT
TT=0.501

SAT
TT=0.394

SAT
TT=0.412

SAT
TT=0.469

SAT
TT=0.941

SAT
TT=0.464

No dataSAT
TT=6.751

No dataNo dataSAT
TT=1.425

SAT
TT=1.366

SAT
TT=6.707

No dataNo dataSAT
TT=7.019

SAT
TT=1.096

SAT
TT=0.583

No dataNo dataNo dataNo dataSAT
TT=1.305

No dataSAT
TT=2.379

No dataSAT
TT=2.854

No dataNo dataNo dataNo dataSAT
TT=23.83

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-TPP-21-step11.cnf
UNSAT
TT=218.303

No dataUNSAT
TT=2382.84

UNSAT
TT=2577.63

No dataNo dataUNSAT
TT=635.249

No dataNo dataUNSAT
TT=2255.5

UNSAT
TT=2182.32

UNSAT
TT=2291.47

UNSAT
TT=2108.91

UNSAT
TT=503.901

No dataNo dataUNSAT
TT=1227.02

UNSAT
TT=940.782

UNSAT
TT=1058.44

No dataUNSAT
TT=857.048

UNSAT
TT=849.728

No data? (TO)
TT=5000.16

UNSAT
TT=1722.91

UNSAT
TT=4962.99

? (TO)
TT=5000.1

? (TO)
TT=5000.12

UNSAT
TT=1795.31

? (TO)
TT=5000.16

No dataUNSAT
TT=319.027

No dataNo dataUNSAT
TT=5330.88

UNSAT
TT=5060.5

UNSAT
TT=2978.47

No dataNo dataUNSAT
TT=408.637

UNSAT
TT=2042.83

UNSAT
TT=3229.7

No dataNo dataNo dataNo dataUNSAT
TT=1784.9

No dataUNSAT
TT=4173.63

No dataUNSAT
TT=218.303

No dataNo dataNo dataNo dataUNSAT
TT=3560.66

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
AAAI2010-SATPlanning/
aaai10-planning-ipc5-TPP-30-step11.cnf
SAT
TT=18.405

No dataSAT
TT=347.476

SAT
TT=470.605

No dataNo dataSAT
TT=216.318

No dataNo dataSAT
TT=96.554

SAT
TT=157.146

SAT
TT=233.37

SAT
TT=177.307

SAT
TT=139.116

No dataNo dataSAT
TT=52.264

SAT
TT=30.423

SAT
TT=31.711

No dataSAT
TT=141.871

SAT
TT=142.02

No dataSAT
TT=40.289

SAT
TT=51.202

SAT
TT=41.785

SAT
TT=102.683

SAT
TT=18.68

SAT
TT=56.789

SAT
TT=18.405

No dataSAT
TT=24.653

No dataNo dataSAT
TT=337.898

SAT
TT=447.797

SAT
TT=196.418

No dataNo dataSAT
TT=168.708

SAT
TT=21.088

SAT
TT=96.321

No dataNo dataNo dataNo dataSAT
TT=47.601

No dataSAT
TT=136.849

No dataSAT
TT=93.318

No dataNo dataNo dataNo dataSAT
TT=164.82

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf
UNSAT
TT=0.588

No dataUNSAT
TT=17.012

UNSAT
TT=19.006

No dataNo dataUNSAT
TT=16.085

No dataNo dataUNSAT
TT=1.684

UNSAT
TT=1.478

UNSAT
TT=99.899

UNSAT
TT=93.971

UNSAT
TT=10.142

No dataNo dataUNSAT
TT=1.351

UNSAT
TT=1.302

UNSAT
TT=0.629

No dataUNSAT
TT=5.483

UNSAT
TT=5.711

No dataUNSAT
TT=0.645

UNSAT
TT=0.634

UNSAT
TT=0.613

UNSAT
TT=0.588

UNSAT
TT=0.614

UNSAT
TT=1.221

UNSAT
TT=0.609

No dataUNSAT
TT=4.419

No dataNo dataUNSAT
TT=6.941

UNSAT
TT=5.92

UNSAT
TT=14.591

No dataNo dataUNSAT
TT=2.178

UNSAT
TT=1.283

UNSAT
TT=0.626

No dataNo dataNo dataNo dataUNSAT
TT=1.349

No dataUNSAT
TT=1.862

No dataUNSAT
TT=1.448

No dataNo dataNo dataNo dataUNSAT
TT=37.36

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf
UNSAT
TT=51.87

No dataUNSAT
TT=1233.65

UNSAT
TT=1165.75

No dataNo dataUNSAT
TT=252.403

No dataNo dataUNSAT
TT=523.443

UNSAT
TT=609.12

UNSAT
TT=589.443

UNSAT
TT=566.937

UNSAT
TT=141.95

No dataNo dataUNSAT
TT=97.523

UNSAT
TT=54.526

UNSAT
TT=51.87

No dataUNSAT
TT=112.698

UNSAT
TT=112.275

No dataUNSAT
TT=98.137

UNSAT
TT=80.666

UNSAT
TT=88.046

UNSAT
TT=66.021

UNSAT
TT=96.053

UNSAT
TT=77.08

UNSAT
TT=98.016

No dataUNSAT
TT=103.662

No dataNo dataUNSAT
TT=846.51

UNSAT
TT=786.188

UNSAT
TT=1271.87

No dataNo dataUNSAT
TT=98.445

UNSAT
TT=105.687

UNSAT
TT=83.48

No dataNo dataNo dataNo dataUNSAT
TT=90.456

No dataUNSAT
TT=128.04

No dataUNSAT
TT=175.008

No dataNo dataNo dataNo dataUNSAT
TT=578

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
UNSAT
TT=630.529

No dataUNSAT
TT=8273.21

UNSAT
TT=8871.39

No dataNo dataUNSAT
TT=3786.58

No dataNo data? (TO)
TT=40001.1

? (TO)
TT=35732

UNSAT
TT=2280.83

UNSAT
TT=2416.88

UNSAT
TT=1071.5

No dataNo dataUNSAT
TT=3609.53

UNSAT
TT=1871.4

UNSAT
TT=630.529

No dataUNSAT
TT=3205.13

UNSAT
TT=2915.6

No data? (TO)
TT=5000.12

? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=5000.03

? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.13

No data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=15570.8

UNSAT
TT=13214.1

UNSAT
TT=12752.8

No dataNo dataUNSAT
TT=1255.82

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataUNSAT
TT=2891.73

No data? (TO)
TT=20395.4

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataUNSAT
TT=2588.84

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf
UNSAT
TT=153.665

No dataUNSAT
TT=1673.76

UNSAT
TT=1741.48

No dataNo dataUNSAT
TT=293.258

No dataNo dataUNSAT
TT=8031.77

UNSAT
TT=8041.1

UNSAT
TT=1349.45

UNSAT
TT=1241.99

UNSAT
TT=178.976

No dataNo dataUNSAT
TT=318.1

UNSAT
TT=205.647

UNSAT
TT=153.665

No dataUNSAT
TT=160.692

UNSAT
TT=164.762

No data? (TO)
TT=5000.09

UNSAT
TT=617.931

UNSAT
TT=437.883

UNSAT
TT=1094.14

UNSAT
TT=539.517

UNSAT
TT=605.728

UNSAT
TT=659.325

No dataUNSAT
TT=756.891

No dataNo dataUNSAT
TT=1032.63

UNSAT
TT=1072.46

UNSAT
TT=1592.52

No dataNo dataUNSAT
TT=228.606

UNSAT
TT=579.758

UNSAT
TT=321.822

No dataNo dataNo dataNo dataUNSAT
TT=347.39

No dataUNSAT
TT=1137.71

No dataUNSAT
TT=359.32

No dataNo dataNo dataNo dataUNSAT
TT=810.71

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf
UNSAT
TT=1004.79

No dataUNSAT
TT=21654.4

?
TT=39729.8

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40001.5

? (TO)
TT=40001.1

UNSAT
TT=32219.4

UNSAT
TT=33060.1

? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No dataSignal
TT=3045.16

? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.02

? (TO)
TT=5000.09

No dataUNSAT
TT=4594.2

No dataNo dataUNSAT
TT=14224.8

UNSAT
TT=22252

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.14

? (TO)
TT=5000

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20390.5

No dataUNSAT
TT=1004.79

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf
UNSAT
TT=2.008

No dataUNSAT
TT=84.188

UNSAT
TT=88.285

No dataNo dataUNSAT
TT=50.416

No dataNo dataUNSAT
TT=8.07

UNSAT
TT=7.058

UNSAT
TT=156.411

UNSAT
TT=152.443

UNSAT
TT=13.814

No dataNo dataUNSAT
TT=3.102

UNSAT
TT=3.126

UNSAT
TT=2.492

No dataUNSAT
TT=12.42

UNSAT
TT=12.389

No dataUNSAT
TT=2.703

UNSAT
TT=2.21

UNSAT
TT=2.296

UNSAT
TT=2.008

UNSAT
TT=2.672

UNSAT
TT=3.15

UNSAT
TT=2.765

No dataUNSAT
TT=7.954

No dataNo dataUNSAT
TT=62.418

UNSAT
TT=40.442

UNSAT
TT=41.615

No dataNo dataUNSAT
TT=3.858

UNSAT
TT=2.86

UNSAT
TT=2.246

No dataNo dataNo dataNo dataUNSAT
TT=3.65

No dataUNSAT
TT=4.675

No dataUNSAT
TT=4.216

No dataNo dataNo dataNo dataUNSAT
TT=95.65

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf
UNSAT
TT=4.628

No dataUNSAT
TT=140.795

UNSAT
TT=138.087

No dataNo dataUNSAT
TT=55.133

No dataNo dataUNSAT
TT=31.415

UNSAT
TT=34.925

UNSAT
TT=284.447

UNSAT
TT=259.425

UNSAT
TT=24.488

No dataNo dataUNSAT
TT=7.2

UNSAT
TT=6.943

UNSAT
TT=6.422

No dataUNSAT
TT=18.663

UNSAT
TT=20.448

No dataUNSAT
TT=5.373

UNSAT
TT=5.72

UNSAT
TT=4.628

UNSAT
TT=5.096

UNSAT
TT=5.574

UNSAT
TT=6.941

UNSAT
TT=5.521

No dataUNSAT
TT=10.854

No dataNo dataUNSAT
TT=139.09

UNSAT
TT=140.654

UNSAT
TT=93.478

No dataNo dataUNSAT
TT=8.042

UNSAT
TT=7.544

UNSAT
TT=5.577

No dataNo dataNo dataNo dataUNSAT
TT=9.665

No dataUNSAT
TT=13.444

No dataUNSAT
TT=9.863

No dataNo dataNo dataNo dataUNSAT
TT=117.53

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf
UNSAT
TT=3.622

No dataUNSAT
TT=97.708

UNSAT
TT=97.473

No dataNo dataUNSAT
TT=28.92

No dataNo dataUNSAT
TT=23.442

UNSAT
TT=22.385

UNSAT
TT=230.526

UNSAT
TT=223.219

UNSAT
TT=36.723

No dataNo dataUNSAT
TT=5.781

UNSAT
TT=3.943

UNSAT
TT=3.646

No dataUNSAT
TT=13.239

UNSAT
TT=14.509

No dataUNSAT
TT=4.626

UNSAT
TT=4.098

UNSAT
TT=4.059

UNSAT
TT=4.541

UNSAT
TT=3.681

UNSAT
TT=4.363

UNSAT
TT=3.622

No dataUNSAT
TT=9.285

No dataNo dataUNSAT
TT=93.938

UNSAT
TT=92.539

UNSAT
TT=79.072

No dataNo dataUNSAT
TT=6.632

UNSAT
TT=5.545

UNSAT
TT=4.316

No dataNo dataNo dataNo dataUNSAT
TT=5.466

No dataUNSAT
TT=12.674

No dataUNSAT
TT=7.109

No dataNo dataNo dataNo dataUNSAT
TT=72.94

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf
UNSAT
TT=21.744

No dataUNSAT
TT=297.541

UNSAT
TT=302.193

No dataNo dataUNSAT
TT=98.218

No dataNo dataUNSAT
TT=369.27

UNSAT
TT=320.316

UNSAT
TT=348.22

UNSAT
TT=354.97

UNSAT
TT=35.301

No dataNo dataUNSAT
TT=28.654

UNSAT
TT=21.744

UNSAT
TT=31.072

No dataUNSAT
TT=47.106

UNSAT
TT=46.848

No dataUNSAT
TT=179.484

UNSAT
TT=68.544

UNSAT
TT=41.089

UNSAT
TT=93.125

UNSAT
TT=63.891

UNSAT
TT=55.408

UNSAT
TT=63.793

No data? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=249.559

UNSAT
TT=227.641

UNSAT
TT=318.273

No dataNo dataUNSAT
TT=23.958

UNSAT
TT=45.067

UNSAT
TT=108.792

No dataNo dataNo dataNo dataUNSAT
TT=39.166

No dataUNSAT
TT=59.178

No dataUNSAT
TT=102.169

No dataNo dataNo dataNo dataUNSAT
TT=146.12

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
UNSAT
TT=2133.18

No data? (TO)
TT=40000.4

?
TT=39494.8

No dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40001.4

? (TO)
TT=40001.6

? (TO)
TT=40001

? (TO)
TT=40000.5

? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.11

No dataUNSAT
TT=2133.18

UNSAT
TT=2164.05

No data? (TO)
TT=5000.05

? (TO)
TT=5000.11

? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=7714.59

UNSAT
TT=6270.79

? (TO)
TT=40000.6

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000

? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20388.7

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf
UNSAT
TT=104.513

No dataUNSAT
TT=974.982

UNSAT
TT=1026.09

No dataNo dataUNSAT
TT=596.576

No dataNo dataUNSAT
TT=15451.1

UNSAT
TT=15797.5

UNSAT
TT=845.154

UNSAT
TT=820.305

UNSAT
TT=104.513

No dataNo dataUNSAT
TT=432.572

UNSAT
TT=195.651

UNSAT
TT=198.324

No dataUNSAT
TT=163.28

UNSAT
TT=162.663

No dataUNSAT
TT=4536.21

UNSAT
TT=2417.4

? (TO)
TT=5000.1

UNSAT
TT=673.055

UNSAT
TT=2605.15

UNSAT
TT=1712.18

UNSAT
TT=2621.47

No dataUNSAT
TT=789.011

No dataNo dataUNSAT
TT=1019.66

UNSAT
TT=1022.4

UNSAT
TT=1837.32

No dataNo dataUNSAT
TT=149.619

? (TO)
TT=5000.1

UNSAT
TT=1275.22

No dataNo dataNo dataNo dataUNSAT
TT=380.029

No dataUNSAT
TT=1241.68

No dataUNSAT
TT=551.32

No dataNo dataNo dataNo dataUNSAT
TT=625.13

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf
UNSAT
TT=0.741

No dataUNSAT
TT=35.797

UNSAT
TT=31.05

No dataNo dataUNSAT
TT=17.212

No dataNo dataUNSAT
TT=2.123

UNSAT
TT=1.921

UNSAT
TT=110.482

UNSAT
TT=104.368

UNSAT
TT=11.142

No dataNo dataUNSAT
TT=1.92

UNSAT
TT=2.061

UNSAT
TT=0.741

No dataUNSAT
TT=5.972

UNSAT
TT=5.432

No dataUNSAT
TT=0.836

UNSAT
TT=0.81

UNSAT
TT=0.745

UNSAT
TT=0.763

UNSAT
TT=0.78

UNSAT
TT=1.984

UNSAT
TT=0.77

No dataUNSAT
TT=4.697

No dataNo dataUNSAT
TT=10.884

UNSAT
TT=11.696

UNSAT
TT=10.537

No dataNo dataUNSAT
TT=2.491

UNSAT
TT=1.993

UNSAT
TT=0.759

No dataNo dataNo dataNo dataUNSAT
TT=1.99

No dataUNSAT
TT=2.744

No dataUNSAT
TT=1.847

No dataNo dataNo dataNo dataUNSAT
TT=44.84

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf
UNSAT
TT=0.745

No dataUNSAT
TT=30.625

UNSAT
TT=27.577

No dataNo dataUNSAT
TT=18.609

No dataNo dataUNSAT
TT=1.739

UNSAT
TT=2.066

UNSAT
TT=109.508

UNSAT
TT=102.846

UNSAT
TT=11.121

No dataNo dataUNSAT
TT=1.493

UNSAT
TT=1.519

UNSAT
TT=0.765

No dataUNSAT
TT=6.171

UNSAT
TT=6.752

No dataUNSAT
TT=0.77

UNSAT
TT=0.789

UNSAT
TT=0.755

UNSAT
TT=0.785

UNSAT
TT=0.77

UNSAT
TT=1.395

UNSAT
TT=0.761

No dataUNSAT
TT=4.96

No dataNo dataUNSAT
TT=9.669

UNSAT
TT=8.621

UNSAT
TT=11.081

No dataNo dataUNSAT
TT=2.44

UNSAT
TT=1.463

UNSAT
TT=0.745

No dataNo dataNo dataNo dataUNSAT
TT=1.546

No dataUNSAT
TT=2.486

No dataUNSAT
TT=1.678

No dataNo dataNo dataNo dataUNSAT
TT=41.45

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf
UNSAT
TT=3.537

No dataUNSAT
TT=129.436

UNSAT
TT=134.402

No dataNo dataUNSAT
TT=25.98

No dataNo dataUNSAT
TT=67.616

UNSAT
TT=66.071

UNSAT
TT=311.764

UNSAT
TT=290.784

UNSAT
TT=34.296

No dataNo dataUNSAT
TT=7.899

UNSAT
TT=3.537

UNSAT
TT=5.431

No dataUNSAT
TT=19.365

UNSAT
TT=19.365

No dataUNSAT
TT=6.654

UNSAT
TT=6.252

UNSAT
TT=4.337

UNSAT
TT=6.829

UNSAT
TT=4.394

UNSAT
TT=6.397

UNSAT
TT=4.342

No dataUNSAT
TT=12.358

No dataNo dataUNSAT
TT=117.258

UNSAT
TT=112.721

UNSAT
TT=136.922

No dataNo dataUNSAT
TT=25.872

UNSAT
TT=5.607

UNSAT
TT=8.918

No dataNo dataNo dataNo dataUNSAT
TT=7.161

No dataUNSAT
TT=19.809

No dataUNSAT
TT=14.854

No dataNo dataNo dataNo dataUNSAT
TT=82.63

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
UNSAT
TT=2052.83

No data? (TO)
TT=40000.7

?
TT=39428.7

No dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=35882.9

? (TO)
TT=40002

Signal
TT=283.665

UNSAT
TT=25760.7

? (TO)
TT=5000.14

No dataNo dataUNSAT
TT=2230.26

UNSAT
TT=2052.83

UNSAT
TT=2079.26

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.13

? (TO)
TT=5000.06

? (TO)
TT=5000.15

UNSAT
TT=2299.65

? (TO)
TT=5000.08

? (TO)
TT=5000.02

? (TO)
TT=5000.08

No data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40001

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.13

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataUNSAT
TT=2589.94

No dataUNSAT
TT=7470.5

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf
UNSAT
TT=0.179

No data? (exit code)
TT=10.135

? (exit code)
TT=10.702

No dataNo dataUNSAT
TT=8.952

No dataNo dataUNSAT
TT=0.702

UNSAT
TT=0.704

UNSAT
TT=7.142

UNSAT
TT=6.826

UNSAT
TT=0.447

No dataNo dataUNSAT
TT=1.023

UNSAT
TT=1.084

UNSAT
TT=0.581

No dataUNSAT
TT=0.82

UNSAT
TT=0.901

No dataUNSAT
TT=0.614

UNSAT
TT=0.597

UNSAT
TT=0.575

UNSAT
TT=0.602

UNSAT
TT=0.58

UNSAT
TT=0.99

UNSAT
TT=0.579

No dataUNSAT
TT=0.24

No dataNo dataUNSAT
TT=0.777

UNSAT
TT=0.807

UNSAT
TT=0.921

No dataNo dataUNSAT
TT=0.904

UNSAT
TT=1.031

UNSAT
TT=0.599

No dataNo dataNo dataNo dataUNSAT
TT=1.094

No dataUNSAT
TT=1.478

No dataUNSAT
TT=0.179

No dataNo dataNo dataNo dataUNSAT
TT=14.55

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf
UNSAT
TT=245.654

No dataUNSAT
TT=1936.61

UNSAT
TT=2004.6

No dataNo dataUNSAT
TT=325.524

No dataNo dataUNSAT
TT=12152.4

UNSAT
TT=11245.4

UNSAT
TT=1357.14

UNSAT
TT=1316.04

UNSAT
TT=245.654

No dataNo dataUNSAT
TT=644.051

UNSAT
TT=404.327

UNSAT
TT=382.681

No dataUNSAT
TT=347.53

UNSAT
TT=346.671

No dataUNSAT
TT=3050.01

UNSAT
TT=2168.72

UNSAT
TT=2865.52

UNSAT
TT=3307.65

UNSAT
TT=2661.53

UNSAT
TT=1251.52

UNSAT
TT=2676.85

No dataUNSAT
TT=2716.52

No dataNo dataUNSAT
TT=2157.91

UNSAT
TT=2045.74

UNSAT
TT=3091

No dataNo dataUNSAT
TT=404.268

UNSAT
TT=2304.12

UNSAT
TT=1058.19

No dataNo dataNo dataNo dataUNSAT
TT=706.262

No dataUNSAT
TT=1302.58

No dataUNSAT
TT=1004.3

No dataNo dataNo dataNo dataUNSAT
TT=714.73

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf
UNSAT
TT=2.567

No dataUNSAT
TT=104.099

UNSAT
TT=114.48

No dataNo dataUNSAT
TT=52.023

No dataNo dataUNSAT
TT=13.748

UNSAT
TT=12.47

UNSAT
TT=128.765

UNSAT
TT=120.736

UNSAT
TT=15.31

No dataNo dataUNSAT
TT=4.232

UNSAT
TT=3.591

UNSAT
TT=2.688

No dataUNSAT
TT=16.617

UNSAT
TT=16.618

No dataUNSAT
TT=2.866

UNSAT
TT=2.886

UNSAT
TT=3.063

UNSAT
TT=2.756

UNSAT
TT=2.593

UNSAT
TT=3.677

UNSAT
TT=2.567

No dataUNSAT
TT=9.189

No dataNo dataUNSAT
TT=96.301

UNSAT
TT=106.562

UNSAT
TT=61.139

No dataNo dataUNSAT
TT=5.928

UNSAT
TT=3.841

UNSAT
TT=2.964

No dataNo dataNo dataNo dataUNSAT
TT=4.267

No dataUNSAT
TT=6.682

No dataUNSAT
TT=5.458

No dataNo dataNo dataNo dataUNSAT
TT=96.53

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf
UNSAT
TT=19.938

No dataUNSAT
TT=309.282

UNSAT
TT=335.873

No dataNo dataUNSAT
TT=64.614

No dataNo dataUNSAT
TT=512.621

UNSAT
TT=286.202

UNSAT
TT=352.342

UNSAT
TT=299.272

UNSAT
TT=34.279

No dataNo dataUNSAT
TT=31.107

UNSAT
TT=25.694

UNSAT
TT=29.817

No dataUNSAT
TT=59.334

UNSAT
TT=64.768

No dataUNSAT
TT=40.043

UNSAT
TT=29.273

UNSAT
TT=29.242

UNSAT
TT=119.057

UNSAT
TT=46.8

UNSAT
TT=28.47

UNSAT
TT=32.406

No data? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=268.489

UNSAT
TT=250.475

UNSAT
TT=288.815

No dataNo dataUNSAT
TT=19.938

UNSAT
TT=166.808

UNSAT
TT=163.122

No dataNo dataNo dataNo dataUNSAT
TT=32.637

No dataUNSAT
TT=57.811

No dataUNSAT
TT=84.815

No dataNo dataNo dataNo dataUNSAT
TT=162.73

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf
UNSAT
TT=3.551

No dataUNSAT
TT=238.441

UNSAT
TT=241.84

No dataNo dataUNSAT
TT=51.511

No dataNo dataUNSAT
TT=110.013

UNSAT
TT=94.783

UNSAT
TT=198.53

UNSAT
TT=195.004

UNSAT
TT=30.08

No dataNo dataUNSAT
TT=6.98

UNSAT
TT=3.551

UNSAT
TT=5.722

No dataUNSAT
TT=24.434

UNSAT
TT=26.66

No dataUNSAT
TT=7.728

UNSAT
TT=5.303

UNSAT
TT=5.909

UNSAT
TT=4.499

UNSAT
TT=3.971

UNSAT
TT=7.209

UNSAT
TT=3.921

No dataUNSAT
TT=19.289

No dataNo dataUNSAT
TT=184.801

UNSAT
TT=178.211

UNSAT
TT=236.845

No dataNo dataUNSAT
TT=22.749

UNSAT
TT=3.866

UNSAT
TT=6.582

No dataNo dataNo dataNo dataUNSAT
TT=5.705

No dataUNSAT
TT=17.813

No dataUNSAT
TT=8.907

No dataNo dataNo dataNo dataUNSAT
TT=134.61

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
UNSAT
TT=891.683

No data? (TO)
TT=40000.3

?
TT=39439.9

No dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40001.1

? (TO)
TT=40001.7

? (TO)
TT=40000.6

? (TO)
TT=40001.1

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.03

UNSAT
TT=2122.47

No dataUNSAT
TT=900.357

UNSAT
TT=891.683

No data? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.03

? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=7430.68

UNSAT
TT=6155.13

UNSAT
TT=29121.4

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=20387.6

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf
SAT
TT=1.503

No dataSAT
TT=103.334

SAT
TT=87.508

No dataNo dataSAT
TT=79.643

No dataNo dataSAT
TT=5.648

Signal
TT=5.823

SAT
TT=204.788

SAT
TT=187.484

SAT
TT=15.881

No dataNo dataSAT
TT=3.602

SAT
TT=3.494

SAT
TT=1.525

No dataSAT
TT=15.005

SAT
TT=15.003

No dataSAT
TT=1.709

SAT
TT=1.544

SAT
TT=1.517

SAT
TT=1.601

SAT
TT=1.511

SAT
TT=3.645

SAT
TT=1.503

No dataSAT
TT=10.593

No dataNo dataSAT
TT=48.033

SAT
TT=26.145

SAT
TT=13.504

No dataNo dataSAT
TT=9.917

SAT
TT=4.096

SAT
TT=1.595

No dataNo dataNo dataNo dataSAT
TT=3.701

No dataSAT
TT=4.917

No dataSAT
TT=3.365

No dataNo dataNo dataNo dataSAT
TT=99.49

No dataNo dataNo dataNo dataNo data
application/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf
SAT
TT=1.95

No dataSAT
TT=118.14

SAT
TT=164.834

No dataNo dataSAT
TT=121.065

No dataNo dataSignal
TT=9.804

Signal
TT=9.809

SAT
TT=213.831

SAT
TT=203.952

SAT
TT=24.381

No dataNo dataSAT
TT=5.596

SAT
TT=4.687

SAT
TT=2.013

No dataSAT
TT=18.828

SAT
TT=18.848

No dataSAT
TT=2.204

SAT
TT=2.018

SAT
TT=1.968

SAT
TT=2.077

SAT
TT=1.967

SAT
TT=4.853

SAT
TT=1.95

No dataSAT
TT=12.966

No dataNo dataSAT
TT=57.617

SAT
TT=53.446

SAT
TT=16.856

No dataNo dataSAT
TT=13.453

SAT
TT=4.801

SAT
TT=2.126

No dataNo dataNo dataNo dataSAT
TT=5.343

No dataSAT
TT=6.698

No dataSAT
TT=4.571

No dataNo dataNo dataNo dataSAT
TT=109.62

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf
SAT
TT=1.354

No dataSAT
TT=77.771

SAT
TT=72.66

No dataNo dataSAT
TT=53.037

No dataNo dataSAT
TT=4.749

SAT
TT=4.739

SAT
TT=133.633

SAT
TT=120.187

SAT
TT=11.455

No dataNo dataSAT
TT=3.226

SAT
TT=3.086

SAT
TT=1.476

No dataSAT
TT=9.402

SAT
TT=9.423

No dataSAT
TT=1.594

SAT
TT=1.415

SAT
TT=1.375

SAT
TT=1.383

SAT
TT=1.369

SAT
TT=2.81

SAT
TT=1.354

No dataSAT
TT=12.556

No dataNo dataSAT
TT=19.062

SAT
TT=33.963

SAT
TT=12.385

No dataNo dataSAT
TT=5.139

SAT
TT=2.894

SAT
TT=1.482

No dataNo dataNo dataNo dataSAT
TT=3.026

No dataSAT
TT=3.874

No dataSAT
TT=2.892

No dataNo dataNo dataNo dataSAT
TT=94.72

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-countbits128-tseitin.cnf
UNSAT
TT=2605.99

No data? (TO)
TT=40000.8

?
TT=39684.3

No dataNo data? (TO)
TT=5000.09

No dataNo dataWrong Cert.
TT=9.594

? (TO)
TT=40001.6

? (TO)
TT=40000.9

UNSAT
TT=34112.7

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.04

UNSAT
TT=4229.32

UNSAT
TT=3577.65

No data? (TO)
TT=5000.07

UNSAT
TT=4758.42

No data? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.02

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=33581.9

UNSAT
TT=26603

? (TO)
TT=40000.1

No dataNo dataUNSAT
TT=2605.99

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataUNSAT
TT=18085.4

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=415.86

No dataNo dataNo dataNo dataNo data
application/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf
UNSAT
TT=0.348

No dataUNSAT
TT=8.063

UNSAT
TT=25.101

No dataNo dataUNSAT
TT=7.781

No dataNo dataUNSAT
TT=2.05

UNSAT
TT=2.081

UNSAT
TT=430.233

UNSAT
TT=429.952

UNSAT
TT=41.753

No dataNo dataUNSAT
TT=0.351

UNSAT
TT=0.348

? (TO)
TT=5000.06

No dataUNSAT
TT=3.886

UNSAT
TT=3.946

No dataUNSAT
TT=6.805

? (TO)
TT=5000.1

? (TO)
TT=5000.08

UNSAT
TT=3.915

? (TO)
TT=5000.04

UNSAT
TT=0.355

? (TO)
TT=5000.07

No dataUNSAT
TT=1.328

No dataNo dataUNSAT
TT=31.046

UNSAT
TT=31.34

UNSAT
TT=3.573

No dataNo dataUNSAT
TT=0.681

UNSAT
TT=0.348

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataUNSAT
TT=0.366

No dataUNSAT
TT=0.401

No dataUNSAT
TT=0.369

No dataNo dataNo dataNo dataUNSAT
TT=32.84

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf
UNSAT
TT=3.889

No dataUNSAT
TT=340.971

UNSAT
TT=339.533

No dataNo dataUNSAT
TT=286.009

No dataNo dataUNSAT
TT=12.62

UNSAT
TT=16.956

UNSAT
TT=797.546

UNSAT
TT=851.74

UNSAT
TT=193.126

No dataNo dataUNSAT
TT=1705.08

UNSAT
TT=1567.81

UNSAT
TT=5.132

No dataUNSAT
TT=66.49

UNSAT
TT=66.488

No dataUNSAT
TT=3.956

UNSAT
TT=4.744

UNSAT
TT=3.889

UNSAT
TT=4.405

UNSAT
TT=3.996

UNSAT
TT=1721.96

UNSAT
TT=4.107

No dataUNSAT
TT=21.462

No dataNo dataUNSAT
TT=244.016

UNSAT
TT=233.652

UNSAT
TT=44.748

No dataNo dataUNSAT
TT=27.586

UNSAT
TT=1570.44

UNSAT
TT=5.61

No dataNo dataNo dataNo dataUNSAT
TT=1263.94

No dataUNSAT
TT=1241.8

No dataUNSAT
TT=86.911

No dataNo dataNo dataNo dataUNSAT
TT=120.75

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf
UNSAT
TT=5.593

No dataUNSAT
TT=312.181

UNSAT
TT=455.231

No dataNo dataUNSAT
TT=163.725

No dataNo dataUNSAT
TT=109.532

UNSAT
TT=113.944

UNSAT
TT=606.369

UNSAT
TT=585.889

UNSAT
TT=97.331

No dataNo dataUNSAT
TT=209.592

UNSAT
TT=231.413

UNSAT
TT=10.526

No dataUNSAT
TT=42.128

UNSAT
TT=42.063

No dataUNSAT
TT=14.351

UNSAT
TT=23.589

UNSAT
TT=9.884

UNSAT
TT=5.593

UNSAT
TT=11.984

UNSAT
TT=210.974

UNSAT
TT=12.16

No dataUNSAT
TT=24.439

No dataNo dataUNSAT
TT=203.905

UNSAT
TT=189.163

UNSAT
TT=311.545

No dataNo dataUNSAT
TT=31.021

UNSAT
TT=239.199

UNSAT
TT=15.661

No dataNo dataNo dataNo dataUNSAT
TT=225.507

No dataUNSAT
TT=190.772

No dataUNSAT
TT=108.834

No dataNo dataNo dataNo dataUNSAT
TT=122.42

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf
UNSAT
TT=13.02

No dataUNSAT
TT=656.539

UNSAT
TT=780.321

No dataNo dataUNSAT
TT=521.514

No dataNo dataUNSAT
TT=40.777

UNSAT
TT=36.578

UNSAT
TT=828.199

UNSAT
TT=709.825

UNSAT
TT=168.763

No dataNo dataUNSAT
TT=612.705

UNSAT
TT=452.856

UNSAT
TT=19.988

No dataUNSAT
TT=90.595

UNSAT
TT=90.338

No dataUNSAT
TT=20.658

UNSAT
TT=33.843

UNSAT
TT=19.656

UNSAT
TT=13.02

UNSAT
TT=20.698

UNSAT
TT=487.672

UNSAT
TT=17.147

No dataUNSAT
TT=41.622

No dataNo dataUNSAT
TT=395.487

UNSAT
TT=401.204

UNSAT
TT=194.012

No dataNo dataUNSAT
TT=35.017

UNSAT
TT=520.677

UNSAT
TT=29.04

No dataNo dataNo dataNo dataUNSAT
TT=484.03

No dataUNSAT
TT=440.196

No dataUNSAT
TT=55.387

No dataNo dataNo dataNo dataUNSAT
TT=145.72

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-nlzbe256-tseitin.cnf
UNSAT
TT=9.305

No dataUNSAT
TT=398.411

UNSAT
TT=332.672

No dataNo dataUNSAT
TT=209.15

No dataNo dataUNSAT
TT=17.262

UNSAT
TT=17.729

UNSAT
TT=485.86

UNSAT
TT=465.216

UNSAT
TT=60.923

No dataNo dataUNSAT
TT=21.949

UNSAT
TT=26.565

UNSAT
TT=9.305

No dataUNSAT
TT=38.66

UNSAT
TT=38.681

No dataUNSAT
TT=11.23

UNSAT
TT=10.842

UNSAT
TT=11.526

UNSAT
TT=13.779

UNSAT
TT=12.695

UNSAT
TT=21.574

UNSAT
TT=12.718

No dataUNSAT
TT=23.383

No dataNo dataUNSAT
TT=223.265

UNSAT
TT=186.055

UNSAT
TT=98.928

No dataNo dataUNSAT
TT=12.748

UNSAT
TT=22.747

UNSAT
TT=10.922

No dataNo dataNo dataNo dataUNSAT
TT=25.108

No dataUNSAT
TT=26.381

No dataUNSAT
TT=20.864

No dataNo dataNo dataNo dataUNSAT
TT=124.79

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf
SAT
TT=0.872

No dataSAT
TT=121.66

? (TO)
TT=145

No dataNo dataSAT
TT=108.876

No dataNo dataSAT
TT=1.316

SAT
TT=1.302

SAT
TT=145.831

SAT
TT=108.814

SAT
TT=15.415

No dataNo dataSAT
TT=19.544

SAT
TT=21.442

SAT
TT=0.908

No dataSAT
TT=4.609

SAT
TT=4.607

No dataSAT
TT=0.988

SAT
TT=0.905

SAT
TT=0.891

SAT
TT=0.995

SAT
TT=0.962

SAT
TT=20.502

SAT
TT=0.882

No dataSAT
TT=3.28

No dataNo dataSAT
TT=5.483

SAT
TT=5.504

SAT
TT=4.35

No dataNo dataSignal
TT=2.033

SAT
TT=21.349

SAT
TT=0.872

No dataNo dataNo dataNo dataSAT
TT=19.795

No dataSAT
TT=21.147

No dataSAT
TT=2.596

No dataNo dataNo dataNo dataSAT
TT=106.64

No dataNo dataNo dataNo dataNo data
application/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf
SAT
TT=1.223

No dataSAT
TT=549.007

SAT
TT=234.433

No dataNo dataSAT
TT=255.785

No dataNo dataSAT
TT=1.767

SAT
TT=1.837

? (TO)
TT=40001

? (TO)
TT=40000.7

? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.06

SAT
TT=1051.6

SAT
TT=1.269

No dataSAT
TT=1270.61

SAT
TT=1267.98

No dataSAT
TT=1.389

SAT
TT=1.27

SAT
TT=1.249

SAT
TT=1.399

SAT
TT=1.237

? (TO)
TT=5000.04

SAT
TT=1.231

No dataSAT
TT=1833.47

No dataNo dataSAT
TT=217.74

SAT
TT=218.377

SAT
TT=5.902

No dataNo data? (TO)
TT=5000.15

SAT
TT=2240.91

SAT
TT=1.223

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=20372.4

No dataSAT
TT=5.023

No dataNo dataNo dataNo dataSAT
TT=117.61

No dataNo dataNo dataNo dataNo data
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf
SAT
TT=1.239

No dataSAT
TT=92.322

SAT
TT=65.446

No dataNo dataSAT
TT=72.166

No dataNo dataSAT
TT=7.168

Signal
TT=5.948

SAT
TT=132.788

SAT
TT=122.69

SAT
TT=10.907

No dataNo dataSAT
TT=3.481

SAT
TT=3.245

SAT
TT=1.306

No dataSAT
TT=15.762

SAT
TT=15.725

No dataSAT
TT=1.397

SAT
TT=1.288

SAT
TT=1.239

SAT
TT=1.655

SAT
TT=1.244

SAT
TT=3.16

SAT
TT=1.245

No dataSAT
TT=16.232

No dataNo dataSAT
TT=10.058

SAT
TT=5.695

SAT
TT=9.1

No dataNo dataSAT
TT=10.272

SAT
TT=3.358

SAT
TT=1.298

No dataNo dataNo dataNo dataSAT
TT=3.634

No dataSAT
TT=4.845

No dataSAT
TT=4.43

No dataNo dataNo dataNo dataSAT
TT=93.7

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/jarvisalo/
smtqfbv-aigs/
smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf



No data? (TO)
TT=39908.2

?
TT=39116.1

No dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40001.5

? (TO)
TT=40001.9

? (TO)
TT=40000.3

? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.08

No data? (TO)
TT=5000.03

? (TO)
TT=5000.09

No data? (TO)
TT=5000.14

? (TO)
TT=5000.04

? (TO)
TT=5000.07

? (TO)
TT=5000.12

? (TO)
TT=5000.13

? (TO)
TT=5000.02

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.3

? (TO)
TT=40000.7

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=20387.2

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/kullmann/
AES/Benchmarks/128/
aes_128_10_keyfind_1.cnf



No data? (TO)
TT=40000.4

?
TT=39781.5

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=35674.7

? (TO)
TT=40000.9

? (TO)
TT=40000.7

? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=40001

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=20393

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data
application/kullmann/
AES/Benchmarks/128/
aes_128_1_keyfind_1.cnf



No data? (TO)
TT=40000.2

? (TO)
TT=42150.2

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=35659

? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=40001

? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=5000.04

? (TO)
TT=5000.11

? (TO)
TT=5000.03

? (TO)
TT=5000.07

? (TO)
TT=5000.12

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.9

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=20398.9

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/kullmann/
AES/Benchmarks/128/
aes_128_2_keyfind_1.cnf



No data? (TO)
TT=40000.6

?
TT=39821.2

No dataNo data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.7

? (TO)
TT=40000.5

? (TO)
TT=40000.7

? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.06

No data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=40000.9

? (TO)
TT=40000.9

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.13

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=20397.8

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo data
application/kullmann/
AES/Benchmarks/128/
aes_128_3_keyfind_1.cnf



No data? (TO)
TT=36368.9

?
TT=39814.9

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=30648.1

? (TO)
TT=40000.7

? (TO)
TT=40000.7

? (TO)
TT=40000.9

? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.06

? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.9

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.01

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20396.4

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
32/aes_32_1_keyfind_1.cnf
SAT
TT=0.006

No data? (exit code)
TT=1.048

? (exit code)
TT=0.944

No dataNo dataSAT
TT=0.636

No dataNo dataSAT
TT=0.015

SAT
TT=0.019

SAT
TT=0.229

SAT
TT=0.351

SAT
TT=0.021

No dataNo dataSAT
TT=0.016

SAT
TT=0.025

SAT
TT=0.017

No dataSAT
TT=0.084

SAT
TT=0.083

No dataSAT
TT=0.016

SAT
TT=0.009

SAT
TT=0.016

SAT
TT=0.006

SAT
TT=0.015

SAT
TT=0.021

SAT
TT=0.023

No dataSAT
TT=0.053

No dataNo dataSAT
TT=0.319

SAT
TT=0.285

SAT
TT=0.124

No dataNo dataSAT
TT=0.062

SAT
TT=0.026

SAT
TT=0.008

No dataNo dataNo dataNo dataSAT
TT=0.013

No dataSAT
TT=0.035

No dataSAT
TT=0.039

No dataNo dataNo dataNo dataSAT
TT=2.736

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
32/aes_32_2_keyfind_1.cnf
SAT
TT=0.299

No dataSAT
TT=11.133

SAT
TT=5.277

No dataNo dataSAT
TT=3.221

No dataNo dataSAT
TT=0.694

SAT
TT=7.322

SAT
TT=14.271

SAT
TT=14.239

SAT
TT=13.992

No dataNo dataSAT
TT=11.679

SAT
TT=9.583

SAT
TT=10.793

No dataSAT
TT=0.575

SAT
TT=0.574

No dataSAT
TT=6.66

SAT
TT=2.697

SAT
TT=4.959

SAT
TT=6.132

SAT
TT=1.142

SAT
TT=14.771

SAT
TT=0.299

No dataSAT
TT=715.757

No dataNo dataSAT
TT=19.146

SAT
TT=7.908

SAT
TT=3.803

No dataNo dataSAT
TT=4.747

SAT
TT=14.593

SAT
TT=3.593

No dataNo dataNo dataNo dataSAT
TT=63.32

No dataSAT
TT=4.637

No dataSAT
TT=1.268

No dataNo dataNo dataNo dataSAT
TT=17.44

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
32/aes_32_3_keyfind_1.cnf
SAT
TT=35.269

No data? (TO)
TT=8448.6

SAT
TT=8751.16

No dataNo dataSAT
TT=1780

No dataNo dataSAT
TT=2313.88

SAT
TT=2904.83

SAT
TT=98.499

SAT
TT=2132.05

? (TO)
TT=5000.03

No dataNo dataSAT
TT=2168.68

? (TO)
TT=5000.07

SAT
TT=3204.38

No dataSAT
TT=1734.82

SAT
TT=1707.88

No dataSAT
TT=1309.16

? (TO)
TT=5000.05

SAT
TT=1000.25

SAT
TT=4999.77

SAT
TT=188.931

? (TO)
TT=5000.02

SAT
TT=886.666

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=2339.44

SAT
TT=35.269

SAT
TT=11632.2

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.07

SAT
TT=820.591

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataSAT
TT=3278.73

No dataSAT
TT=2908.57

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
32/aes_32_4_keyfind_1.cnf



No data? (TO)
TT=40000.3

?
TT=39830.5

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=35664.8

? (TO)
TT=40000.6

? (TO)
TT=40000.8

? (TO)
TT=40000.8

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.13

? (TO)
TT=5000.01

? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

? (TO)
TT=5000.12

? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.8

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=20399.4

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
32/aes_32_5_keyfind_1.cnf
SAT
TT=7602.69

No data? (TO)
TT=40000.6

SAT
TT=7602.69

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.8

? (TO)
TT=40000.4

? (TO)
TT=40000.5

? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.01

? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.2

? (MO)
TT=3807.06

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000

? (TO)
TT=5000.03

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20399.9

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/kullmann/AES/Benchmarks/
64/aes_64_1_keyfind_1.cnf
SAT
TT=91.163

No dataSAT
TT=4235.98

SAT
TT=3984.07

No dataNo data? (TO)
TT=5000.06

No dataNo dataSAT
TT=3153.86

SAT
TT=1954.06

SAT
TT=7511.91

SAT
TT=3963.13

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

No dataSAT
TT=1455.08

SAT
TT=372.863

SAT
TT=1202.56

? (TO)
TT=5000.05

SAT
TT=494.354

? (TO)
TT=5000.07

SAT
TT=91.163

No dataSAT
TT=261.145

No dataNo dataSAT
TT=3073.94

SAT
TT=3125.74

SAT
TT=17778.6

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.03

SAT
TT=3033.57

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataSAT
TT=460.972

No dataSAT
TT=337.072

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
64/aes_64_2_keyfind_1.cnf



No data? (TO)
TT=40000.2

?
TT=39831.8

No dataNo data? (TO)
TT=5000

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.4

? (TO)
TT=40000.4

? (TO)
TT=40000.4

? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.03

? (TO)
TT=5000.1

No data? (TO)
TT=5000.02

? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

? (TO)
TT=5000.11

? (TO)
TT=5000.08

? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=5000.01

? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.6

? (TO)
TT=40000.2

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.02

? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=20399.2

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
64/aes_64_3_keyfind_1.cnf



No data? (TO)
TT=40000.3

?
TT=39780.8

No dataNo data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.9

? (TO)
TT=40000.5

? (TO)
TT=40000.4

? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.1

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.9

? (TO)
TT=40000.8

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=20398.7

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
application/kullmann/AES/Benchmarks/
64/aes_64_4_keyfind_1.cnf



No data? (TO)
TT=40000.8

?
TT=39934.5

No dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=30687.7

? (TO)
TT=40000.2

? (TO)
TT=40000.7

? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.01

No data? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.11

? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=40000.9

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.09

? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=20399

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E00N23.cnf
UNSAT
TT=3122.96

No data? (MO)
TT=26398.7

? (MO)
TT=25524.7

No dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=39769.3

? (TO)
TT=39761.2

? (TO)
TT=40001.2

? (TO)
TT=40001.3

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.06

UNSAT
TT=3798.1

UNSAT
TT=3122.96

No data? (TO)
TT=5000.1

? (TO)
TT=5000.09

No data? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.15

? (TO)
TT=5000.09

? (TO)
TT=5000.11

UNSAT
TT=4930.12

? (TO)
TT=5000.15

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.8

? (TO)
TT=40000.4

No dataNo dataUNSAT
TT=4487.98

? (TO)
TT=5000.01

? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20235.6

No data? (TO)
TT=5000.16

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E00X23.cnf
UNSAT
TT=2417.94

No data? (MO)
TT=28939.1

? (MO)
TT=26724.9

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=39790.2

? (TO)
TT=39751.3

? (TO)
TT=40001.1

? (TO)
TT=40000.4

? (TO)
TT=5000.15

No dataNo data? (TO)
TT=5000.03

UNSAT
TT=3186.31

? (TO)
TT=5000.1

No dataUNSAT
TT=4526.79

UNSAT
TT=4491.35

No data? (TO)
TT=5000.18

? (TO)
TT=5000.1

? (TO)
TT=5000.17

? (TO)
TT=5000.09

? (TO)
TT=5000.13

? (TO)
TT=5000.11

? (TO)
TT=5000.19

No data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=34683.4

UNSAT
TT=36576.4

? (MO)
TT=38436.2

No dataNo dataUNSAT
TT=2417.94

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=20303.7

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E02F17.cnf
UNSAT
TT=11.845

No dataUNSAT
TT=123.277

UNSAT
TT=151.303

No dataNo dataUNSAT
TT=45.667

No dataNo dataUNSAT
TT=76.23

UNSAT
TT=63.432

UNSAT
TT=77.208

UNSAT
TT=75.183

UNSAT
TT=18.354

No dataNo dataUNSAT
TT=42.219

UNSAT
TT=22.911

UNSAT
TT=20.015

No dataUNSAT
TT=39.49

UNSAT
TT=39.476

No dataUNSAT
TT=69.573

UNSAT
TT=35.796

UNSAT
TT=47.749

UNSAT
TT=28.4

UNSAT
TT=60.952

UNSAT
TT=29.619

UNSAT
TT=60.958

No dataUNSAT
TT=65.521

No dataNo dataUNSAT
TT=141.481

UNSAT
TT=159.995

UNSAT
TT=252.258

No dataNo dataUNSAT
TT=11.845

UNSAT
TT=70.556

UNSAT
TT=31.593

No dataNo dataNo dataNo dataUNSAT
TT=41.22

No dataUNSAT
TT=41.212

No dataUNSAT
TT=41.483

No dataNo dataNo dataNo dataUNSAT
TT=31.45

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E02F20.cnf
SAT
TT=27.197

No dataSAT
TT=420.025

SAT
TT=571.272

No dataNo dataSAT
TT=368.932

No dataNo dataSAT
TT=268.785

SAT
TT=696.761

SAT
TT=1709.28

SAT
TT=1293.34

SAT
TT=258.505

No dataNo dataSAT
TT=238.166

SAT
TT=27.197

SAT
TT=253.881

No dataSAT
TT=48.598

SAT
TT=48.783

No dataSAT
TT=213.684

SAT
TT=443.685

SAT
TT=354.409

SAT
TT=518.456

SAT
TT=99.751

SAT
TT=134.044

SAT
TT=99.578

No dataSAT
TT=81.448

No dataNo dataSAT
TT=178.503

SAT
TT=191.279

SAT
TT=211.101

No dataNo dataSAT
TT=97.643

SAT
TT=70.041

SAT
TT=1080.75

No dataNo dataNo dataNo dataSAT
TT=44.906

No dataSAT
TT=318.306

No dataSAT
TT=406.315

No dataNo dataNo dataNo dataSAT
TT=454.04

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E02F22.cnf
SAT
TT=44.584

No dataSAT
TT=1412.8

SAT
TT=1734.67

No dataNo dataSAT
TT=870.486

No dataNo dataSAT
TT=1061.42

SAT
TT=477.098

SAT
TT=19887.9

SAT
TT=18819.5

SAT
TT=2218.47

No dataNo dataSAT
TT=508.799

SAT
TT=120.929

SAT
TT=640.637

No dataSAT
TT=506.564

SAT
TT=508.444

No dataSAT
TT=507.593

SAT
TT=445.115

SAT
TT=332.911

SAT
TT=2865.36

SAT
TT=335.591

SAT
TT=44.584

SAT
TT=369.602

No dataSAT
TT=533.84

No dataNo dataSAT
TT=1055.35

SAT
TT=306.142

SAT
TT=3105.5

No dataNo dataSAT
TT=235.336

SAT
TT=291.611

SAT
TT=1065.89

No dataNo dataNo dataNo dataSAT
TT=175.2

No dataSAT
TT=569.947

No dataSAT
TT=388.051

No dataNo dataNo dataNo dataSAT
TT=1087.14

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E03N17.cnf
UNSAT
TT=1.043

No dataUNSAT
TT=16.31

UNSAT
TT=19.754

No dataNo dataUNSAT
TT=10.947

No dataNo dataUNSAT
TT=10.991

UNSAT
TT=3.413

UNSAT
TT=10.17

UNSAT
TT=10.15

UNSAT
TT=1.288

No dataNo dataUNSAT
TT=2.54

UNSAT
TT=2.511

UNSAT
TT=1.359

No dataUNSAT
TT=2.88

UNSAT
TT=3.176

No dataUNSAT
TT=1.846

UNSAT
TT=1.636

UNSAT
TT=1.602

UNSAT
TT=1.408

UNSAT
TT=1.048

UNSAT
TT=1.165

UNSAT
TT=1.043

No dataUNSAT
TT=2.443

No dataNo dataUNSAT
TT=6.497

UNSAT
TT=6.399

UNSAT
TT=8.175

No dataNo dataUNSAT
TT=2.426

UNSAT
TT=2.437

UNSAT
TT=1.25

No dataNo dataNo dataNo dataUNSAT
TT=2.085

No dataUNSAT
TT=7.677

No dataUNSAT
TT=3.313

No dataNo dataNo dataNo dataUNSAT
TT=17.32

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/leberre/
2dimensionalstrippacking/
E04F19.cnf
SAT
TT=9.636

No dataSAT
TT=464.789

SAT
TT=299.305

No dataNo dataSAT
TT=59.549

No dataNo dataSAT
TT=186.775

SAT
TT=268.994

SAT
TT=752.061

SAT
TT=764.674

SAT
TT=96.687

No dataNo dataSAT
TT=50.268

SAT
TT=9.636

SAT
TT=159.299

No dataSAT
TT=95.663

SAT
TT=105.399

No dataSAT
TT=97.782

SAT
TT=44.458

SAT
TT=83.792

SAT
TT=1749.99

SAT
TT=79.698

SAT
TT=38.495

SAT
TT=79.41

No dataSAT
TT=461.586

No dataNo dataSAT
TT=162.859

SAT
TT=39.318

SAT
TT=439.29

No dataNo dataSAT
TT=76.846

SAT
TT=21.142

SAT
TT=105.011

No dataNo dataNo dataNo dataSAT
TT=40.636

No dataSAT
TT=194.403

No dataSAT
TT=39.371

No dataNo dataNo dataNo dataSAT
TT=456.58

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E04F20.cnf
SAT
TT=18.904

No dataSAT
TT=139.522

SAT
TT=474.042

No dataNo dataSAT
TT=78.079

No dataNo dataSAT
TT=143.118

SAT
TT=323.14

SAT
TT=2627.95

SAT
TT=2172.3

SAT
TT=521.071

No dataNo dataSAT
TT=91.732

SAT
TT=29.145

SAT
TT=200.92

No dataSAT
TT=59.815

SAT
TT=59.919

No dataSAT
TT=71.936

SAT
TT=156.631

SAT
TT=85.048

SAT
TT=303.383

SAT
TT=80.243

SAT
TT=38.864

SAT
TT=79.652

No dataSAT
TT=137.792

No dataNo dataSAT
TT=70.328

SAT
TT=255.562

SAT
TT=198.972

No dataNo dataSAT
TT=103.955

SAT
TT=18.904

SAT
TT=111.776

No dataNo dataNo dataNo dataSAT
TT=26.578

No dataSAT
TT=238.116

No dataSAT
TT=51.519

No dataNo dataNo dataNo dataSAT
TT=155.12

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E04N18.cnf
UNSAT
TT=0.546

No dataUNSAT
TT=8.951

UNSAT
TT=24.162

No dataNo dataUNSAT
TT=11.183

No dataNo dataUNSAT
TT=1.664

UNSAT
TT=1.201

UNSAT
TT=10.011

UNSAT
TT=9.933

UNSAT
TT=1.124

No dataNo dataUNSAT
TT=2.665

UNSAT
TT=0.546

UNSAT
TT=1.001

No dataUNSAT
TT=2.499

UNSAT
TT=2.498

No dataUNSAT
TT=1.168

UNSAT
TT=0.99

UNSAT
TT=0.965

UNSAT
TT=1.015

UNSAT
TT=0.954

UNSAT
TT=0.59

UNSAT
TT=0.954

No dataUNSAT
TT=3.065

No dataNo dataUNSAT
TT=1.411

UNSAT
TT=1.39

UNSAT
TT=7.67

No dataNo dataUNSAT
TT=3.408

UNSAT
TT=0.69

UNSAT
TT=1.006

No dataNo dataNo dataNo dataUNSAT
TT=2.401

No dataUNSAT
TT=0.991

No dataUNSAT
TT=4.09

No dataNo dataNo dataNo dataUNSAT
TT=15.94

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E05F18.cnf
SAT
TT=1.123

No dataSAT
TT=53.93

SAT
TT=32.386

No dataNo dataSAT
TT=32.737

No dataNo dataSAT
TT=45.399

SAT
TT=58.086

SAT
TT=70.879

SAT
TT=81.889

SAT
TT=21.255

No dataNo dataSAT
TT=1.941

SAT
TT=1.123

SAT
TT=31.335

No dataSAT
TT=38.196

SAT
TT=38.101

No dataSAT
TT=7.839

SAT
TT=9.99

SAT
TT=17.012

SAT
TT=59.385

SAT
TT=18.654

SAT
TT=6.714

SAT
TT=18.523

No dataSAT
TT=22.532

No dataNo dataSAT
TT=156.4

SAT
TT=112.341

SAT
TT=44.393

No dataNo dataSAT
TT=16.381

SAT
TT=10.536

SAT
TT=11.299

No dataNo dataNo dataNo dataSAT
TT=4.924

No dataSAT
TT=10.708

No dataSAT
TT=14.812

No dataNo dataNo dataNo dataSAT
TT=34.06

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E05F20.cnf
SAT
TT=13.743

No dataSAT
TT=258.321

SAT
TT=483.526

No dataNo dataSAT
TT=68.489

No dataNo dataSAT
TT=176.622

SAT
TT=310.243

SAT
TT=2070.08

SAT
TT=2305.13

SAT
TT=396.927

No dataNo dataSAT
TT=59.441

SAT
TT=23.115

SAT
TT=92.803

No dataSAT
TT=142.102

SAT
TT=131.021

No dataSAT
TT=62.399

SAT
TT=98.81

SAT
TT=65.017

SAT
TT=450.703

SAT
TT=80.558

SAT
TT=13.743

SAT
TT=80.4

No dataSAT
TT=114.499

No dataNo dataSAT
TT=66.422

SAT
TT=24.277

SAT
TT=493.502

No dataNo dataSAT
TT=117.368

SAT
TT=30.267

SAT
TT=131.98

No dataNo dataNo dataNo dataSAT
TT=24.679

No dataSAT
TT=54.343

No dataSAT
TT=140.529

No dataNo dataNo dataNo dataSAT
TT=121.33

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E05X15.cnf
UNSAT
TT=4.669

No dataUNSAT
TT=65.336

UNSAT
TT=72.311

No dataNo dataUNSAT
TT=43.64

No dataNo dataUNSAT
TT=66.089

UNSAT
TT=63.691

UNSAT
TT=42.803

UNSAT
TT=45.114

UNSAT
TT=9.077

No dataNo dataUNSAT
TT=56.441

UNSAT
TT=7.301

UNSAT
TT=6.059

No dataUNSAT
TT=10.046

UNSAT
TT=10.642

No dataUNSAT
TT=6.87

UNSAT
TT=5.576

UNSAT
TT=6.533

UNSAT
TT=9.657

UNSAT
TT=5.638

UNSAT
TT=7.372

UNSAT
TT=6.225

No dataUNSAT
TT=27.346

No dataNo dataUNSAT
TT=47.148

UNSAT
TT=34.661

UNSAT
TT=58.917

No dataNo dataUNSAT
TT=7.508

UNSAT
TT=10.218

UNSAT
TT=4.669

No dataNo dataNo dataNo dataUNSAT
TT=39.969

No dataUNSAT
TT=82.239

No dataUNSAT
TT=56.858

No dataNo dataNo dataNo dataUNSAT
TT=25.24

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E07N15.cnf
UNSAT
TT=0.009

No data? (exit code)
TT=2.896

? (exit code)
TT=2.75

No dataNo dataUNSAT
TT=2.435

No dataNo dataUNSAT
TT=0.021

UNSAT
TT=0.022

UNSAT
TT=0.24

UNSAT
TT=0.335

UNSAT
TT=0.011

No dataNo dataUNSAT
TT=0.033

UNSAT
TT=0.031

UNSAT
TT=0.01

No dataUNSAT
TT=0.025

UNSAT
TT=0.024

No dataUNSAT
TT=0.012

? (exit code)
TT=0.01

UNSAT
TT=0.011

UNSAT
TT=0.016

UNSAT
TT=0.009

UNSAT
TT=0.031

UNSAT
TT=0.011

No dataUNSAT
TT=0.034

No dataNo dataUNSAT
TT=0.121

UNSAT
TT=0.119

UNSAT
TT=0.051

No dataNo dataUNSAT
TT=0.194

UNSAT
TT=0.034

UNSAT
TT=0.01

No dataNo dataNo dataNo dataUNSAT
TT=0.032

No dataUNSAT
TT=0.033

No dataUNSAT
TT=0.026

No dataNo dataNo dataNo dataUNSAT
TT=14.318

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
E15N15.cnf
UNSAT
TT=0.01

No data? (exit code)
TT=2.95

? (exit code)
TT=2.89

No dataNo dataUNSAT
TT=2.522

No dataNo dataUNSAT
TT=0.023

UNSAT
TT=0.022

UNSAT
TT=0.294

UNSAT
TT=1.042

UNSAT
TT=0.012

No dataNo dataUNSAT
TT=0.085

UNSAT
TT=0.083

UNSAT
TT=0.01

No dataUNSAT
TT=0.025

UNSAT
TT=0.026

No dataUNSAT
TT=0.012

? (exit code)
TT=0.011

UNSAT
TT=0.01

UNSAT
TT=0.017

UNSAT
TT=0.012

UNSAT
TT=0.082

UNSAT
TT=0.011

No dataUNSAT
TT=0.039

No dataNo dataUNSAT
TT=0.127

UNSAT
TT=0.124

UNSAT
TT=0.068

No dataNo dataUNSAT
TT=0.204

UNSAT
TT=0.09

UNSAT
TT=0.011

No dataNo dataNo dataNo dataUNSAT
TT=0.076

No dataUNSAT
TT=0.075

No dataUNSAT
TT=0.026

No dataNo dataNo dataNo dataUNSAT
TT=15.17

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
korf-15.cnf
UNSAT
TT=1.819

No dataUNSAT
TT=47.182

UNSAT
TT=40.61

No dataNo dataUNSAT
TT=49.34

No dataNo dataUNSAT
TT=110.306

UNSAT
TT=36.441

UNSAT
TT=26.16

UNSAT
TT=19.597

UNSAT
TT=5.818

No dataNo dataUNSAT
TT=62.181

UNSAT
TT=31.863

UNSAT
TT=28.577

No dataUNSAT
TT=42.886

UNSAT
TT=42.795

No dataUNSAT
TT=38.563

UNSAT
TT=25.826

UNSAT
TT=19.011

UNSAT
TT=264.21

UNSAT
TT=23.981

UNSAT
TT=32.77

UNSAT
TT=23.89

No dataUNSAT
TT=16.774

No dataNo dataUNSAT
TT=97.212

UNSAT
TT=68.126

UNSAT
TT=20.875

No dataNo dataUNSAT
TT=1.819

UNSAT
TT=31.432

UNSAT
TT=18.9

No dataNo dataNo dataNo dataUNSAT
TT=77.056

No dataUNSAT
TT=56.218

No dataUNSAT
TT=13.546

No dataNo dataNo dataNo dataUNSAT
TT=23.94

No dataNo dataNo dataNo dataNo data
application/leberre/
2dimensionalstrippacking/
korf-17.cnf
UNSAT
TT=440.727

No dataUNSAT
TT=8229.55

UNSAT
TT=8868.38

No dataNo dataUNSAT
TT=865.531

No dataNo dataUNSAT
TT=1728.67

UNSAT
TT=1585.25

UNSAT
TT=3566.16

UNSAT
TT=3118.66

UNSAT
TT=712.342

No dataNo dataUNSAT
TT=3288.58

UNSAT
TT=991.48

UNSAT
TT=498.042

No dataUNSAT
TT=962.197

UNSAT
TT=883.436

No dataUNSAT
TT=854.727

UNSAT
TT=444.459

UNSAT
TT=649.768

? (TO)
TT=5000.09

UNSAT
TT=444.522

UNSAT
TT=618.406

UNSAT
TT=440.727

No dataUNSAT
TT=953.288

No dataNo dataUNSAT
TT=5338.44

UNSAT
TT=4599.51

UNSAT
TT=3430.58

No dataNo dataUNSAT
TT=1126.59

? (TO)
TT=5000.06

UNSAT
TT=606.14

No dataNo dataNo dataNo dataUNSAT
TT=1124.4

No dataUNSAT
TT=2725.98

No dataUNSAT
TT=675.087

No dataNo dataNo dataNo dataUNSAT
TT=1972

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/leberre/
2dimensionalstrippacking/
korf-18.cnf
UNSAT
TT=588.006

No dataUNSAT
TT=8547.75

UNSAT
TT=6757.08

No dataNo dataUNSAT
TT=3104.04

No dataNo dataUNSAT
TT=5929.51

UNSAT
TT=9266.26

UNSAT
TT=3437.29

UNSAT
TT=3801.61

UNSAT
TT=870.143

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No dataUNSAT
TT=2667.89

UNSAT
TT=2351.41

No data? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.09

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=12333.4

UNSAT
TT=17634.8

UNSAT
TT=6485.1

No dataNo dataUNSAT
TT=910.333

? (TO)
TT=5000.1

UNSAT
TT=588.006

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20395.8

No dataUNSAT
TT=2917.88

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_3b_unknown.cnf
UNSAT
TT=114.081

No dataUNSAT
TT=3528.26

UNSAT
TT=3594.45

No dataNo dataUNSAT
TT=487.621

No dataNo dataUNSAT
TT=1225.97

UNSAT
TT=1264.99

UNSAT
TT=3808.78

UNSAT
TT=3770.3

UNSAT
TT=384.319

No dataNo dataUNSAT
TT=239.93

UNSAT
TT=114.081

UNSAT
TT=271.71

No dataUNSAT
TT=329.991

UNSAT
TT=327.56

No dataUNSAT
TT=584.362

UNSAT
TT=209.479

UNSAT
TT=289.017

UNSAT
TT=936.673

UNSAT
TT=280.537

UNSAT
TT=221.881

UNSAT
TT=323.714

No dataUNSAT
TT=489.728

No dataNo dataUNSAT
TT=1518.03

UNSAT
TT=1593.09

UNSAT
TT=3038.69

No dataNo dataUNSAT
TT=368.904

UNSAT
TT=637.171

UNSAT
TT=496.247

No dataNo dataNo dataNo dataUNSAT
TT=223.685

No dataUNSAT
TT=568.09

No dataUNSAT
TT=396.845

No dataNo dataNo dataNo dataUNSAT
TT=3624.38

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_3_uc_sat.cnf
SAT
TT=22.616

No dataSAT
TT=780.225

SAT
TT=763.54

No dataNo dataSAT
TT=842.858

No dataNo dataSignal
TT=742.43

SAT
TT=1329.52

SAT
TT=1354.99

SAT
TT=343.321

SAT
TT=1493.6

No dataNo dataSAT
TT=801.074

SAT
TT=274.059

SAT
TT=587.608

No dataSAT
TT=217.083

SAT
TT=213.712

No dataSAT
TT=138.53

SAT
TT=25.628

SAT
TT=540.3

SAT
TT=2571.16

SAT
TT=106.225

SAT
TT=335.815

SAT
TT=118.542

No dataSAT
TT=22.616

No dataNo dataSAT
TT=696.139

SAT
TT=1927.8

SAT
TT=1057.88

No dataNo dataSAT
TT=2369.4

SAT
TT=287.44

SAT
TT=972.184

No dataNo dataNo dataNo dataSAT
TT=78.937

No dataSAT
TT=1302.64

No dataSAT
TT=173.457

No dataNo dataNo dataNo dataSAT
TT=3400.42

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_b_unsat.cnf
UNSAT
TT=107.463

No dataUNSAT
TT=2760.07

UNSAT
TT=2919.32

No dataNo dataUNSAT
TT=420.068

No dataNo dataUNSAT
TT=1061.18

UNSAT
TT=1031.74

UNSAT
TT=3284.3

UNSAT
TT=3148.45

UNSAT
TT=336.951

No dataNo dataUNSAT
TT=226.225

UNSAT
TT=107.463

UNSAT
TT=210.747

No dataUNSAT
TT=287

UNSAT
TT=286.199

No dataUNSAT
TT=420.069

UNSAT
TT=163.814

UNSAT
TT=254.564

UNSAT
TT=755.041

UNSAT
TT=270.225

UNSAT
TT=233.531

UNSAT
TT=309.692

No dataUNSAT
TT=539.634

No dataNo dataUNSAT
TT=1306.15

UNSAT
TT=1216.53

UNSAT
TT=2791.9

No dataNo dataUNSAT
TT=306.06

UNSAT
TT=482.575

UNSAT
TT=393.559

No dataNo dataNo dataNo dataUNSAT
TT=214.973

No dataUNSAT
TT=466.659

No dataUNSAT
TT=293.426

No dataNo dataNo dataNo dataUNSAT
TT=3538.88

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_fb_unknown.cnf
UNSAT
TT=99.537

No dataUNSAT
TT=2819.23

UNSAT
TT=2985.79

No dataNo dataUNSAT
TT=421.019

No dataNo dataUNSAT
TT=1001.21

UNSAT
TT=924.844

UNSAT
TT=3136.88

UNSAT
TT=3218.76

UNSAT
TT=360.173

No dataNo dataUNSAT
TT=215.742

UNSAT
TT=99.537

UNSAT
TT=212.306

No dataUNSAT
TT=306.158

UNSAT
TT=304.633

No dataUNSAT
TT=470.868

UNSAT
TT=186.028

UNSAT
TT=249.414

UNSAT
TT=617.701

UNSAT
TT=244.404

UNSAT
TT=201.15

UNSAT
TT=272.69

No dataUNSAT
TT=535.956

No dataNo dataUNSAT
TT=1309.74

UNSAT
TT=1228.39

UNSAT
TT=2993.17

No dataNo dataUNSAT
TT=307.923

UNSAT
TT=478.591

UNSAT
TT=366.775

No dataNo dataNo dataNo dataUNSAT
TT=195.101

No dataUNSAT
TT=480.11

No dataUNSAT
TT=310.203

No dataNo dataNo dataNo dataUNSAT
TT=3602.28

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_f_unknown.cnf
UNSAT
TT=108.831

No dataUNSAT
TT=2980.2

UNSAT
TT=2881.89

No dataNo dataUNSAT
TT=436.99

No dataNo dataUNSAT
TT=969.755

UNSAT
TT=1252.91

UNSAT
TT=3051.47

UNSAT
TT=3103.34

UNSAT
TT=312.95

No dataNo dataUNSAT
TT=277.239

UNSAT
TT=108.831

UNSAT
TT=205.385

No dataUNSAT
TT=314.138

UNSAT
TT=315.287

No dataUNSAT
TT=429.23

UNSAT
TT=171.075

UNSAT
TT=295.904

UNSAT
TT=608.776

UNSAT
TT=272.111

UNSAT
TT=199.702

UNSAT
TT=288.018

No dataUNSAT
TT=523.077

No dataNo dataUNSAT
TT=1215.78

UNSAT
TT=1195.3

UNSAT
TT=2695.71

No dataNo dataUNSAT
TT=316.861

UNSAT
TT=514.936

UNSAT
TT=418.752

No dataNo dataNo dataNo dataUNSAT
TT=195.507

No dataUNSAT
TT=447.042

No dataUNSAT
TT=338.347

No dataNo dataNo dataNo dataUNSAT
TT=3581.29

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_kkb_unknown.cnf
UNSAT
TT=105.068

No dataUNSAT
TT=2841.59

UNSAT
TT=2943.22

No dataNo dataUNSAT
TT=438.91

No dataNo dataUNSAT
TT=871.749

UNSAT
TT=979.411

UNSAT
TT=3349.97

UNSAT
TT=3257.8

UNSAT
TT=326.804

No dataNo dataUNSAT
TT=207.501

UNSAT
TT=105.068

UNSAT
TT=222.592

No dataUNSAT
TT=295.749

UNSAT
TT=296.77

No dataUNSAT
TT=444.25

UNSAT
TT=179.857

UNSAT
TT=311.29

UNSAT
TT=656.292

UNSAT
TT=290.612

UNSAT
TT=204.404

UNSAT
TT=314.931

No dataUNSAT
TT=570.279

No dataNo dataUNSAT
TT=1265.11

UNSAT
TT=1254.33

UNSAT
TT=2758.74

No dataNo dataUNSAT
TT=314.455

UNSAT
TT=455.981

UNSAT
TT=444.715

No dataNo dataNo dataNo dataUNSAT
TT=216.027

No dataUNSAT
TT=534.659

No dataUNSAT
TT=379.896

No dataNo dataNo dataNo dataUNSAT
TT=3584.53

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_pcb_unknown.cnf
UNSAT
TT=102.934

No dataUNSAT
TT=2771.14

UNSAT
TT=2983.89

No dataNo dataUNSAT
TT=445.55

No dataNo dataUNSAT
TT=1030.37

UNSAT
TT=1093.03

UNSAT
TT=3186.08

UNSAT
TT=3203.15

UNSAT
TT=330.56

No dataNo dataUNSAT
TT=231.689

UNSAT
TT=102.934

UNSAT
TT=238.527

No dataUNSAT
TT=270.903

UNSAT
TT=270.123

No dataUNSAT
TT=465.092

UNSAT
TT=180.667

UNSAT
TT=214.199

UNSAT
TT=685.733

UNSAT
TT=287.449

UNSAT
TT=182.872

UNSAT
TT=359.905

No dataUNSAT
TT=516.581

No dataNo dataUNSAT
TT=1204.15

UNSAT
TT=1188.25

UNSAT
TT=2689.06

No dataNo dataUNSAT
TT=314.953

UNSAT
TT=524.175

UNSAT
TT=438.232

No dataNo dataNo dataNo dataUNSAT
TT=191.812

No dataUNSAT
TT=526.978

No dataUNSAT
TT=331.765

No dataNo dataNo dataNo dataUNSAT
TT=3600.13

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_r_sat.cnf
SAT
TT=5.916

No dataSAT
TT=167.311

SAT
TT=164.98

No dataNo dataSAT
TT=150.604

No dataNo dataSAT
TT=41.547

Signal
TT=179.538

SAT
TT=95.86

SAT
TT=109.676

SAT
TT=84.921

No dataNo dataSAT
TT=8.775

SAT
TT=6.787

SAT
TT=11.46

No dataSAT
TT=40.655

SAT
TT=40.621

No dataSAT
TT=10.547

SAT
TT=10.341

SAT
TT=9.421

SAT
TT=1503.69

SAT
TT=9.884

SAT
TT=5.916

SAT
TT=9.357

No dataSAT
TT=15.656

No dataNo dataSAT
TT=28.553

SAT
TT=26.362

SAT
TT=95.788

No dataNo dataSAT
TT=115.818

SAT
TT=12.014

SAT
TT=17.871

No dataNo dataNo dataNo dataSAT
TT=6.583

No dataSAT
TT=21.897

No dataSAT
TT=48.996

No dataNo dataNo dataNo dataSAT
TT=117.85

No dataNo dataNo dataNo dataNo data
application/manthey/
traffic/
traffic_r_uc_sat.cnf
SAT
TT=42.589

No dataSAT
TT=1828.17

SAT
TT=2021.84

No dataNo dataSAT
TT=1227.92

No dataNo dataSignal
TT=4386.72

SAT
TT=1438.3

SAT
TT=3724.65

SAT
TT=4972.86

? (TO)
TT=5000.23

No dataNo dataSAT
TT=3948.05

SAT
TT=42.589

SAT
TT=2969.74

No dataSAT
TT=798.506

SAT
TT=797.082

No dataSAT
TT=65.762

SAT
TT=151.562

SAT
TT=1402.42

? (TO)
TT=5000.15

SAT
TT=193.431

SAT
TT=63.545

SAT
TT=106.687

No dataSAT
TT=590.21

No dataNo dataSAT
TT=1657.34

SAT
TT=1400.99

SAT
TT=2090.17

No dataNo data? (TO)
TT=5000.24

SAT
TT=138.167

SAT
TT=279.471

No dataNo dataNo dataNo dataSAT
TT=232.249

No dataSAT
TT=10591.8

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataSAT
TT=1977.87

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/rintanen/
SATPlanning/
blocks-blocks-36-0.120-NOTKNOWN.cnf
UNSAT
TT=549.042

No data? (MO)
TT=5943.2

? (MO)
TT=4733.03

No dataNo dataUNSAT
TT=2042.14

No dataNo dataUNSAT
TT=6255.99

UNSAT
TT=6455.37

UNSAT
TT=5954.34

UNSAT
TT=6950.46

UNSAT
TT=647.665

No dataNo dataUNSAT
TT=1848.03

UNSAT
TT=1314.48

UNSAT
TT=1342.2

No dataUNSAT
TT=1337.31

UNSAT
TT=1325.55

No dataUNSAT
TT=3716.31

UNSAT
TT=2290.81

UNSAT
TT=1992.98

UNSAT
TT=2398.69

UNSAT
TT=2783.26

UNSAT
TT=2059.01

UNSAT
TT=2778

No dataUNSAT
TT=1054.81

No dataNo dataUNSAT
TT=14167.6

UNSAT
TT=13594.5

UNSAT
TT=6640.98

No dataNo dataUNSAT
TT=549.042

UNSAT
TT=2253.95

UNSAT
TT=2144.4

No dataNo dataNo dataNo dataUNSAT
TT=3209.39

No data? (exit code)
TT=4055.73

No dataUNSAT
TT=583.66

No dataNo dataNo dataNo dataUNSAT
TT=3562.93

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
blocks-blocks-36-0.160-NOTKNOWN.cnf
SAT
TT=16.614

No dataSAT
TT=1544.3

SAT
TT=1174.52

No dataNo dataSAT
TT=1044.95

No dataNo dataSAT
TT=891.629

SAT
TT=751.325

SAT
TT=522.823

SAT
TT=473.619

SAT
TT=78.98

No dataNo dataSAT
TT=36.236

SAT
TT=92.735

SAT
TT=35.815

No dataSAT
TT=50.229

SAT
TT=53.877

No dataSAT
TT=47.445

SAT
TT=74.854

SAT
TT=37.625

SAT
TT=52.28

SAT
TT=29.309

SAT
TT=16.614

SAT
TT=29.439

No dataSAT
TT=122.395

No dataNo dataSAT
TT=291.718

SAT
TT=210.179

SAT
TT=135.984

No dataNo dataSAT
TT=54.06

SAT
TT=120.559

SAT
TT=85.645

No dataNo dataNo dataNo dataSAT
TT=42.835

No data? (exit code)
TT=245.188

No dataSAT
TT=212.063

No dataNo dataNo dataNo dataSAT
TT=219.55

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
blocks-blocks-36-0.170-NOTKNOWN.cnf
SAT
TT=28.737

No dataSAT
TT=1671.72

SAT
TT=1469.63

No dataNo dataSAT
TT=1180.07

No dataNo dataSAT
TT=906.449

SAT
TT=916.845

SAT
TT=421.278

SAT
TT=438.856

SAT
TT=37.913

No dataNo dataSAT
TT=38.105

SAT
TT=70.418

SAT
TT=86.88

No dataSAT
TT=61.14

SAT
TT=60.901

No dataSAT
TT=30.647

SAT
TT=34.908

SAT
TT=28.737

SAT
TT=39.603

SAT
TT=140.104

SAT
TT=120.922

SAT
TT=142.266

No dataSAT
TT=132.182

No dataNo dataSAT
TT=312.115

SAT
TT=196.641

SAT
TT=216.947

No dataNo dataSAT
TT=84.995

SAT
TT=47.887

SAT
TT=112.002

No dataNo dataNo dataNo dataSAT
TT=47.232

No data? (exit code)
TT=112.15

No dataSAT
TT=239.895

No dataNo dataNo dataNo dataSAT
TT=238.02

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
blocks-blocks-36-0.180-SAT.cnf
SAT
TT=25.751

No dataSAT
TT=1585.26

SAT
TT=1459.7

No dataNo dataSAT
TT=1326.37

No dataNo dataSAT
TT=929.89

SAT
TT=1136.46

SAT
TT=382.801

SAT
TT=401.7

SAT
TT=43.948

No dataNo dataSAT
TT=38.07

SAT
TT=28.618

SAT
TT=34.732

No dataSAT
TT=67.458

SAT
TT=74.111

No dataSAT
TT=203.375

SAT
TT=67.715

SAT
TT=69.011

SAT
TT=25.751

SAT
TT=48.381

SAT
TT=209.497

SAT
TT=48.104

No dataSAT
TT=241.347

No dataNo dataSAT
TT=304.564

SAT
TT=193.678

SAT
TT=259.589

No dataNo dataSAT
TT=70.13

SAT
TT=59.254

SAT
TT=34.88

No dataNo dataNo dataNo dataSAT
TT=43.8

No data? (exit code)
TT=88.781

No dataSAT
TT=221.177

No dataNo dataNo dataNo dataSAT
TT=436.61

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
blocks-blocks-37-1.120-NOTKNOWN.cnf
UNSAT
TT=61.391

No dataUNSAT
TT=1199.86

UNSAT
TT=1126.06

No dataNo dataUNSAT
TT=762.117

No dataNo dataUNSAT
TT=690.21

UNSAT
TT=643.599

UNSAT
TT=598.157

UNSAT
TT=671.721

UNSAT
TT=74.764

No dataNo dataUNSAT
TT=86.328

UNSAT
TT=61.391

UNSAT
TT=67.161

No dataUNSAT
TT=76.339

UNSAT
TT=75.887

No dataUNSAT
TT=182.635

UNSAT
TT=116.01

UNSAT
TT=144.373

UNSAT
TT=81.996

UNSAT
TT=96.041

UNSAT
TT=98.127

UNSAT
TT=92.067

No dataUNSAT
TT=256.144

No dataNo dataUNSAT
TT=755.632

UNSAT
TT=651.621

UNSAT
TT=440.973

No dataNo dataUNSAT
TT=81.83

UNSAT
TT=93.436

UNSAT
TT=107.832

No dataNo dataNo dataNo dataUNSAT
TT=112.376

No data? (exit code)
TT=305.376

No dataUNSAT
TT=175.032

No dataNo dataNo dataNo dataUNSAT
TT=206.65

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
blocks-blocks-37-1.130-NOTKNOWN.cnf
UNSAT
TT=381.959

No dataUNSAT
TT=4580.05

UNSAT
TT=4372.49

No dataNo data? (MO)
TT=2235.22

No dataNo dataUNSAT
TT=3050.9

UNSAT
TT=3109.36

UNSAT
TT=4088.11

UNSAT
TT=3443.17

UNSAT
TT=486.271

No dataNo dataUNSAT
TT=951.914

UNSAT
TT=923.488

UNSAT
TT=1089.52

No dataUNSAT
TT=744.758

UNSAT
TT=675.016

No dataUNSAT
TT=2165.61

UNSAT
TT=1291.75

UNSAT
TT=1877.94

UNSAT
TT=1356.74

UNSAT
TT=1930.25

UNSAT
TT=1758.94

UNSAT
TT=1981.37

No dataUNSAT
TT=1118.7

No dataNo dataUNSAT
TT=5369.67

UNSAT
TT=5238.96

UNSAT
TT=5076.58

No dataNo dataUNSAT
TT=381.959

UNSAT
TT=1058.74

UNSAT
TT=1071.83

No dataNo dataNo dataNo dataUNSAT
TT=1172.05

No data? (exit code)
TT=3137.44

No dataUNSAT
TT=418.987

No dataNo dataNo dataNo dataUNSAT
TT=2754.96

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
blocks-blocks-37-1.150-SAT.cnf
SAT
TT=19.69

No dataSAT
TT=1168.59

SAT
TT=1089.8

No dataNo dataSAT
TT=984.214

No dataNo dataSAT
TT=830.77

SAT
TT=929.839

SAT
TT=298.769

SAT
TT=289.074

SAT
TT=37.49

No dataNo dataSAT
TT=42.16

SAT
TT=25.523

SAT
TT=23.7

No dataSAT
TT=69.459

SAT
TT=69.525

No dataSAT
TT=27.117

SAT
TT=27.731

SAT
TT=24.189

SAT
TT=19.69

SAT
TT=21.001

SAT
TT=65.526

SAT
TT=20.89

No dataSAT
TT=189.496

No dataNo dataSAT
TT=166.913

SAT
TT=294.644

SAT
TT=202.335

No dataNo dataSAT
TT=78.979

SAT
TT=90.852

SAT
TT=40.541

No dataNo dataNo dataNo dataSAT
TT=249.801

No data? (exit code)
TT=99.3

No dataSAT
TT=171.927

No dataNo dataNo dataNo dataSAT
TT=392.95

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
grid-strips-grid-y-3.035-NOTKNOWN.cnf
UNSAT
TT=198.951

No dataUNSAT
TT=1993.23

UNSAT
TT=2283.29

No dataNo dataUNSAT
TT=637.165

No dataNo dataUNSAT
TT=3162.27

UNSAT
TT=2892.49

UNSAT
TT=2397.91

UNSAT
TT=1911.38

UNSAT
TT=271.055

No dataNo dataUNSAT
TT=265.96

UNSAT
TT=311.076

UNSAT
TT=198.951

No dataUNSAT
TT=537.91

UNSAT
TT=491.896

No dataUNSAT
TT=472.227

UNSAT
TT=537.245

UNSAT
TT=438.324

UNSAT
TT=362.032

UNSAT
TT=577.439

UNSAT
TT=781.154

UNSAT
TT=534.001

No dataUNSAT
TT=395.938

No dataNo dataUNSAT
TT=3292.3

UNSAT
TT=2815.92

UNSAT
TT=2134.56

No dataNo dataUNSAT
TT=352.436

UNSAT
TT=382.081

UNSAT
TT=288.675

No dataNo dataNo dataNo dataUNSAT
TT=600.22

No dataUNSAT
TT=1356.4

No dataUNSAT
TT=229.485

No dataNo dataNo dataNo dataUNSAT
TT=627.8

No dataNo dataNo dataNo dataNo data
application/rintanen/
SATPlanning/
grid-strips-grid-y-4.025-NOTKNOWN.cnf
UNSAT
TT=7.417

No dataUNSAT
TT=392.829

UNSAT
TT=437.493

No dataNo dataUNSAT
TT=309.57

No dataNo dataUNSAT
TT=1552.86

UNSAT
TT=1623.97

UNSAT
TT=174.253

UNSAT
TT=155.942

UNSAT
TT=27.063

No dataNo dataUNSAT
TT=7.417

UNSAT
TT=12.871

UNSAT
TT=14.478

No dataUNSAT
TT=24.686

UNSAT
TT=24.763

No dataUNSAT
TT=26.049

UNSAT
TT=18.03

UNSAT
TT=16.604

UNSAT
TT=19.007

UNSAT
TT=21.19

UNSAT
TT=17.515

UNSAT
TT=21.283

No dataUNSAT
TT=55.128

No dataNo dataUNSAT
TT=125.604

UNSAT
TT=130.53

UNSAT
TT=112.344

No dataNo dataUNSAT
TT=42.725

UNSAT
TT=20.215

UNSAT
TT=13.982

No dataNo dataNo dataNo dataUNSAT
TT=12.706

No dataUNSAT
TT=33.092

No dataUNSAT
TT=33.992

No dataNo dataNo dataNo dataUNSAT
TT=149.91

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf
UNSAT
TT=2632.81

No data? (MO)
TT=20277.7

? (MO)
TT=13660.9

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=35527.9

? (TO)
TT=40001.7

? (MO)
TT=8488.84

UNSAT
TT=9699.84

UNSAT
TT=2632.81

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.09

No data? (TO)
TT=5000.14

? (TO)
TT=5000.12

No data? (TO)
TT=5000.18

? (TO)
TT=5000.04

? (TO)
TT=5000.1

? (TO)
TT=5000.08

? (TO)
TT=5000.25

? (TO)
TT=5000.01

? (TO)
TT=5000.05

No data? (TO)
TT=5000.12

No dataNo dataSignal
TT=31687.9

? (TO)
TT=40001.8

? (TO)
TT=40000.7

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.18

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20387.2

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf



No data? (MO)
TT=3123.76

? (MO)
TT=2891.73

No dataNo data? (MO)
TT=4293.91

No dataNo data? (TO)
TT=39727.6

? (TO)
TT=39713

? (MO)
TT=1605.83

? (MO)
TT=1534.22

? (TO)
TT=5000.39

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

? (TO)
TT=5000.15

No data? (TO)
TT=5000.25

? (TO)
TT=5000.09

? (TO)
TT=5000.21

? (TO)
TT=5000.31

? (TO)
TT=5000.35

? (TO)
TT=5000.01

? (TO)
TT=5000.27

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.8

? (problem)
TT=36849.3

? (TO)
TT=40000.8

No dataNo data? (TO)
TT=5000.25

? (TO)
TT=5000

? (TO)
TT=5000.26

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (exit code)
TT=12472.9

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf



No data? (MO)
TT=2360.68

? (MO)
TT=2187.6

No dataNo data? (MO)
TT=3094.01

No dataNo data? (TO)
TT=38948.6

? (TO)
TT=38989.5

? (MO)
TT=1414.36

? (MO)
TT=1261.55

? (TO)
TT=5000.56

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.02

? (TO)
TT=5000.05

No data? (TO)
TT=5000.15

? (TO)
TT=5000.11

No data? (TO)
TT=5000.21

? (TO)
TT=5000.15

? (TO)
TT=5000.24

? (TO)
TT=5000.28

? (TO)
TT=5000.32

? (TO)
TT=5000.04

? (TO)
TT=5000.21

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=40001

? (TO)
TT=40000.6

No dataNo data? (TO)
TT=5000.38

? (TO)
TT=5000.11

? (TO)
TT=5000.27

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (exit code)
TT=7280.56

No data? (TO)
TT=5000.16

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf



No data? (MO)
TT=21017

? (MO)
TT=17497.3

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40001.5

? (TO)
TT=40001.7

? (MO)
TT=10990.4

? (MO)
TT=10149.9

? (TO)
TT=5000.25

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.01

? (TO)
TT=5000.1

No data? (TO)
TT=5000.2

? (TO)
TT=5000.16

No data? (TO)
TT=5000.17

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.13

? (TO)
TT=5000.1

? (TO)
TT=5000.11

? (TO)
TT=5000.12

No data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=40001.5

? (TO)
TT=40000.8

? (TO)
TT=40000.1

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20386.1

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf



No data? (MO)
TT=2794.41

? (MO)
TT=2870.74

No dataNo data? (MO)
TT=3700.98

No dataNo data? (TO)
TT=39750.9

? (TO)
TT=39719.5

? (MO)
TT=1523.91

? (MO)
TT=1388.34

? (TO)
TT=5000.37

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.03

No data? (TO)
TT=5000.15

? (TO)
TT=5000.11

No data? (TO)
TT=5000.28

? (TO)
TT=5000.11

? (TO)
TT=5000.32

? (TO)
TT=5000.07

? (TO)
TT=5000.28

? (TO)
TT=5000.1

? (TO)
TT=5000.24

No data? (TO)
TT=5000.05

No dataNo dataSignal
TT=26981

? (TO)
TT=40001.4

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.24

? (TO)
TT=5000.01

? (TO)
TT=5000.29

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (exit code)
TT=14528.7

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf



No data? (MO)
TT=1847.14

? (MO)
TT=2085.52

No dataNo data? (MO)
TT=3768.58

No dataNo data? (TO)
TT=39010.3

? (TO)
TT=38980.6

? (MO)
TT=1506.23

? (MO)
TT=1388.24

? (TO)
TT=5000.44

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.02

? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

? (TO)
TT=5000.05

No data? (TO)
TT=5000.21

? (TO)
TT=5000.12

? (TO)
TT=5000.21

? (TO)
TT=5000.33

? (TO)
TT=5000.38

? (TO)
TT=5000.01

? (TO)
TT=5000.24

No data? (TO)
TT=5000.05

No dataNo dataSignal
TT=35233.8

? (TO)
TT=40001.4

? (TO)
TT=40000.8

No dataNo data? (TO)
TT=5000.34

? (TO)
TT=5000.04

? (TO)
TT=5000.29

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (exit code)
TT=12663.1

No data? (TO)
TT=5000.17

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf
SAT
TT=4.953

No dataSAT
TT=254.165

SAT
TT=418.352

No dataNo dataSAT
TT=768.376

No dataNo dataSAT
TT=1253.48

SAT
TT=1238.75

SAT
TT=479.692

SAT
TT=407.93

SAT
TT=678.166

No dataNo dataSAT
TT=20.328

SAT
TT=293.975

SAT
TT=44.44

No dataSAT
TT=14.394

SAT
TT=14.226

No dataSAT
TT=4.953

SAT
TT=19.1

SAT
TT=29.352

SAT
TT=24.468

SAT
TT=10.395

SAT
TT=13.118

SAT
TT=10.45

No dataSAT
TT=43.894

No dataNo dataSAT
TT=31.602

SAT
TT=50.206

SAT
TT=165.898

No dataNo dataSAT
TT=300.76

SAT
TT=102.054

SAT
TT=10.996

No dataNo dataNo dataNo dataSAT
TT=63.539

No dataSAT
TT=94.302

No dataSAT
TT=326.407

No dataNo dataNo dataNo dataSAT
TT=991.92

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf
UNSAT
TT=28.465

No dataUNSAT
TT=289.811

UNSAT
TT=275.8

No dataNo dataUNSAT
TT=58.375

No dataNo dataUNSAT
TT=238.299

UNSAT
TT=269.53

UNSAT
TT=352.351

UNSAT
TT=335.252

UNSAT
TT=52.793

No dataNo dataUNSAT
TT=94.999

UNSAT
TT=91.831

UNSAT
TT=83.16

No dataUNSAT
TT=127.771

UNSAT
TT=128.164

No dataUNSAT
TT=259.741

UNSAT
TT=176.394

UNSAT
TT=204.072

UNSAT
TT=144.811

UNSAT
TT=195.929

UNSAT
TT=163.303

UNSAT
TT=194.622

No dataUNSAT
TT=28.465

No dataNo dataUNSAT
TT=512.82

UNSAT
TT=534.449

UNSAT
TT=219.766

No dataNo dataUNSAT
TT=79.656

UNSAT
TT=133.019

UNSAT
TT=89.057

No dataNo dataNo dataNo dataUNSAT
TT=128.679

No dataUNSAT
TT=410.206

No dataUNSAT
TT=31.632

No dataNo dataNo dataNo dataUNSAT
TT=70.221

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf
UNSAT
TT=477.605

No dataUNSAT
TT=4495.53

UNSAT
TT=3536.04

No dataNo dataUNSAT
TT=945.819

No dataNo dataUNSAT
TT=26703.2

UNSAT
TT=26069.3

UNSAT
TT=2912.27

UNSAT
TT=2872.91

UNSAT
TT=502.235

No dataNo dataUNSAT
TT=3554.62

UNSAT
TT=2270.49

UNSAT
TT=2271.05

No dataUNSAT
TT=1976.6

UNSAT
TT=1966.71

No data? (TO)
TT=5000.23

? (TO)
TT=5000.05

? (TO)
TT=5000.25

? (TO)
TT=5000.19

? (TO)
TT=5000.27

? (TO)
TT=5000.07

? (TO)
TT=5000.3

No dataUNSAT
TT=689.057

No dataNo dataUNSAT
TT=17771.3

UNSAT
TT=16844.3

UNSAT
TT=3377.37

No dataNo dataUNSAT
TT=493.145

? (TO)
TT=5000.01

UNSAT
TT=3519.65

No dataNo dataNo dataNo dataUNSAT
TT=4628.12

No data? (exit code)
TT=8228.16

No dataUNSAT
TT=477.605

No dataNo dataNo dataNo dataUNSAT
TT=993.2

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf
SAT
TT=1309.74

No data? (MO)
TT=13688.8

SAT
TT=10852.3

No dataNo dataSAT
TT=2353.43

No dataNo data? (TO)
TT=39999.7

? (TO)
TT=39930.4

SAT
TT=24379.4

SAT
TT=11648.8

? (TO)
TT=5000.15

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.05

? (TO)
TT=5000.12

No data? (TO)
TT=5000.17

? (TO)
TT=5000.15

No data? (TO)
TT=5000.33

? (TO)
TT=5000.09

? (TO)
TT=5000.28

? (TO)
TT=5000.24

? (TO)
TT=5000.3

? (TO)
TT=5000

? (TO)
TT=5000.32

No dataSAT
TT=2697.36

No dataNo dataSAT
TT=19127

SAT
TT=10614.2

SAT
TT=19802.7

No dataNo dataSAT
TT=2995.61

? (TO)
TT=5000.09

? (TO)
TT=5000.3

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataSAT
TT=5896.75

No dataSAT
TT=1309.74

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf
SAT
TT=1095.17

No dataSAT
TT=10914.8

? (MO)
TT=18105.5

No dataNo data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=34928.8

? (TO)
TT=39713.6

? (TO)
TT=40001.2

SAT
TT=21943.6

? (TO)
TT=5000.2

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No data? (TO)
TT=5000.13

? (TO)
TT=5000.1

No data? (TO)
TT=5000.29

? (TO)
TT=5000.06

SAT
TT=2082.64

? (TO)
TT=5000.21

? (TO)
TT=5000.35

? (TO)
TT=5000.06

? (TO)
TT=5000.41

No dataSAT
TT=4689.93

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.6

SAT
TT=22549.4

No dataNo data? (TO)
TT=5000.26

? (TO)
TT=5000.07

? (TO)
TT=5000.27

No dataNo dataNo dataNo dataSAT
TT=1419.22

No data? (exit code)
TT=6480.68

No dataSAT
TT=1095.17

No dataNo dataNo dataNo dataSAT
TT=4271.9

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
application/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf
SAT
TT=1007.46

No dataSAT
TT=10532.9

SAT
TT=9546.74

No dataNo dataSAT
TT=1007.46

No dataNo data? (TO)
TT=39476.6

? (TO)
TT=39269.7

? (TO)
TT=40001.3

? (TO)
TT=40001.1

? (TO)
TT=5000.18

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.04

? (TO)
TT=5000.13

No data? (TO)
TT=5000.04

? (TO)
TT=5000.05

No data? (TO)
TT=5000.33

? (TO)
TT=5000.14

? (TO)
TT=5000.42

? (TO)
TT=5000.27

? (TO)
TT=5000.4

? (TO)
TT=5000.01

? (TO)
TT=5000.4

No dataSAT
TT=4067.62

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.9

SAT
TT=14144.8

No dataNo data? (TO)
TT=5000.21

? (TO)
TT=5000.04

? (TO)
TT=5000.32

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (exit code)
TT=5827.39

No dataSignal
TT=2530.46

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.080-SAT.cnf
SAT
TT=1503.62

No data? (MO)
TT=13264

? (MO)
TT=15733.8

No dataNo dataSAT
TT=1503.62

No dataNo dataSAT
TT=9467.52

? (TO)
TT=39085.3

? (TO)
TT=40001

? (TO)
TT=40000.9

? (TO)
TT=5000.24

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

? (TO)
TT=5000.07

No data? (TO)
TT=5000.4

? (TO)
TT=5000.05

? (TO)
TT=5000.41

? (TO)
TT=5000.29

? (TO)
TT=5000.54

? (TO)
TT=5000.05

? (TO)
TT=5000.39

No dataSAT
TT=3884.71

No dataNo data? (TO)
TT=40001

? (TO)
TT=40000.7

SAT
TT=18758.4

No dataNo data? (TO)
TT=5000.28

? (TO)
TT=5000.05

? (TO)
TT=5000.35

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (exit code)
TT=5942.54

No dataSignal
TT=2236.4

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf
SAT
TT=129.665

No data? (MO)
TT=2114.9

? (MO)
TT=2502.98

No dataNo data? (MO)
TT=1105.37

No dataNo dataSAT
TT=1143.04

SAT
TT=1859.21

? (MO)
TT=1270.77

? (MO)
TT=1210.97

? (MO)
TT=338.924

No dataNo dataSAT
TT=645.912

SAT
TT=245.982

? (TO)
TT=5000.13

No dataSAT
TT=1495.77

SAT
TT=1490.97

No dataSAT
TT=149.098

SAT
TT=210.552

SAT
TT=1720.85

? (TO)
TT=5000.49

SAT
TT=833.832

SAT
TT=862.433

SAT
TT=933.23

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=1933.89

SAT
TT=811.13

SAT
TT=506.658

No dataNo data? (TO)
TT=5000.37

SAT
TT=129.665

SAT
TT=1373.96

No dataNo dataNo dataNo dataSAT
TT=781.076

No dataSAT
TT=238.049

No dataSAT
TT=142.353

No dataNo dataNo dataNo dataSAT
TT=3228.52

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
SAT
TT=510.889

No data? (MO)
TT=3387.05

? (MO)
TT=3284.24

No dataNo data? (MO)
TT=1553

No dataNo dataSAT
TT=9990.6

SAT
TT=5057.51

? (MO)
TT=1698.19

? (MO)
TT=1567.33

? (MO)
TT=401.26

No dataNo dataSAT
TT=1228.2

SAT
TT=510.889

SAT
TT=4820.18

No data? (TO)
TT=5000.1

? (TO)
TT=5000.17

No dataSAT
TT=2366.22

SAT
TT=2760.13

SAT
TT=4017.5

? (TO)
TT=5000.34

SAT
TT=3885.32

SAT
TT=2486.84

SAT
TT=3973.74

No data? (TO)
TT=5000.14

No dataNo dataSAT
TT=13304.3

SAT
TT=24023.2

SAT
TT=12933.9

No dataNo dataSAT
TT=2605.02

SAT
TT=2561.97

SAT
TT=2695.5

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (exit code)
TT=4097.26

No dataSAT
TT=1762.2

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
SAT
TT=363.759

No data? (MO)
TT=4169.33

? (MO)
TT=3938.1

No dataNo data? (MO)
TT=2470.17

No dataNo dataSAT
TT=6860.5

SAT
TT=6940.12

Signal
TT=1864.54

? (MO)
TT=1690.18

? (MO)
TT=404.241

No dataNo dataSAT
TT=3573.66

SAT
TT=660.154

SAT
TT=2359.95

No data? (TO)
TT=5000.1

? (TO)
TT=5000.16

No dataSAT
TT=2045.85

? (TO)
TT=5000.14

? (problem)
TT=4228.21

SAT
TT=3046.58

SAT
TT=1260.85

? (TO)
TT=5000.03

SAT
TT=1296.5

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=18551.4

SAT
TT=25255.2

SAT
TT=12682

No dataNo data? (TO)
TT=5000.57

SAT
TT=363.759

? (TO)
TT=5000.41

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (exit code)
TT=2075.59

No dataSAT
TT=1744.1

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
SAT
TT=745.077

No data? (MO)
TT=5219.74

? (MO)
TT=5170.63

No dataNo data? (MO)
TT=3871.84

No dataNo data? (TO)
TT=5103.5

? (TO)
TT=5102.88

? (MO)
TT=1992.23

? (MO)
TT=1868.12

? (MO)
TT=435.513

No dataNo dataSAT
TT=1901.51

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (problem)
TT=4939.82

SAT
TT=4596.78

? (problem)
TT=4031.31

? (TO)
TT=5000.51

SAT
TT=1356.27

? (TO)
TT=5000.1

SAT
TT=1474.65

No dataSAT
TT=745.077

No dataNo data? (TO)
TT=40001.2

? (TO)
TT=40000.9

SAT
TT=4489.84

No dataNo data? (TO)
TT=5000.56

SAT
TT=1508.67

? (TO)
TT=5000.4

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (exit code)
TT=1811.89

No dataSAT
TT=1721.71

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
SAT
TT=2556.24

No data? (MO)
TT=2518.89

? (MO)
TT=2562.59

No dataNo data? (MO)
TT=1248.86

No dataNo dataSAT
TT=14442.2

SAT
TT=7681.85

? (MO)
TT=1662.93

? (MO)
TT=1494.63

? (MO)
TT=358.842

No dataNo dataSAT
TT=2556.24

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

? (TO)
TT=5000.08

No data? (problem)
TT=4676.88

? (TO)
TT=5000.08

SAT
TT=3543.66

? (TO)
TT=5000.48

? (problem)
TT=4670.93

? (TO)
TT=5000.01

? (problem)
TT=4822.75

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=14111.3

SAT
TT=6510.16

SAT
TT=12979.4

No dataNo data? (TO)
TT=5000.32

? (TO)
TT=5000.04

? (TO)
TT=5000.28

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (exit code)
TT=4616.89

No dataSAT
TT=3083.06

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
SAT
TT=3527.13

No data? (MO)
TT=3804.24

? (MO)
TT=3647.56

No dataNo data? (MO)
TT=2127.2

No dataNo data? (TO)
TT=11790

? (TO)
TT=9269.4

Signal
TT=1969.74

Signal
TT=1943.2

? (MO)
TT=424.861

No dataNo dataSAT
TT=4339.42

? (TO)
TT=5000.02

? (TO)
TT=5000.1

No data? (TO)
TT=5000.18

? (TO)
TT=5000.19

No data? (problem)
TT=4838.76

? (TO)
TT=5000.13

? (problem)
TT=3662.42

? (TO)
TT=5000.47

? (problem)
TT=4403.95

? (TO)
TT=5000.06

? (problem)
TT=4541.56

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=33375.2

SAT
TT=30177.5

? (TO)
TT=30447.2

No dataNo dataSAT
TT=3527.13

? (TO)
TT=5000.09

? (TO)
TT=5000.43

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (exit code)
TT=2618.55

No data? (TO)
TT=5000.15

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf



No data? (MO)
TT=5151.68

? (MO)
TT=5062.51

No dataNo data? (MO)
TT=3359.32

No dataNo data? (TO)
TT=5102.97

? (TO)
TT=5103.12

? (MO)
TT=2124.68

? (MO)
TT=1859.05

? (MO)
TT=360.68

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000

? (TO)
TT=5000.16

No data? (TO)
TT=5000.16

? (TO)
TT=5000.17

No data? (problem)
TT=4227.45

? (TO)
TT=5000.11

? (problem)
TT=3950.96

? (TO)
TT=5000.52

? (problem)
TT=3993.77

? (TO)
TT=5000.05

? (problem)
TT=4092.18

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40001.6

? (TO)
TT=30559.7

No dataNo data? (TO)
TT=5000.57

? (TO)
TT=5000.03

? (TO)
TT=5000.41

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (exit code)
TT=2273.3

No data? (TO)
TT=5000.21

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo data
application/rintanen/SATPlanning/
transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf
SAT
TT=124.843

No data? (MO)
TT=2132.65

? (MO)
TT=2400.93

No dataNo data? (MO)
TT=925.07

No dataNo dataSAT
TT=1225.01

SAT
TT=1819.32

SAT
TT=279.677

SAT
TT=241.039

? (MO)
TT=352.698

No dataNo dataSAT
TT=207.387

SAT
TT=385.528

SAT
TT=382.096

No dataSAT
TT=3337.62

SAT
TT=3673.2

No dataSAT
TT=2447.8

SAT
TT=677.607

SAT
TT=580.658

SAT
TT=1153.49

SAT
TT=3186.38

SAT
TT=1868.91

SAT
TT=3238.33

No dataSAT
TT=143.334

No dataNo dataSAT
TT=3461.81

SAT
TT=4146.88

SAT
TT=593.795

No dataNo dataSAT
TT=1640.63

SAT
TT=124.843

SAT
TT=2181.83

No dataNo dataNo dataNo dataSAT
TT=392.621

No dataSAT
TT=757.173

No dataSAT
TT=538.231

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
APPLICATIONS/bioinfo/
q_query_3_L150_coli.sat.cnf
UNSAT
TT=44.759

No dataUNSAT
TT=2380.18

UNSAT
TT=2257

No dataNo dataUNSAT
TT=1088.16

No dataNo dataUNSAT
TT=1734.77

UNSAT
TT=1897.82

UNSAT
TT=2639.7

UNSAT
TT=2512.84

UNSAT
TT=1050.63

No dataNo dataUNSAT
TT=121.995

UNSAT
TT=85.482

UNSAT
TT=48.205

No dataUNSAT
TT=262.666

UNSAT
TT=262.589

No dataUNSAT
TT=83.354

UNSAT
TT=88.58

UNSAT
TT=151.305

UNSAT
TT=86.734

UNSAT
TT=44.759

UNSAT
TT=97.609

UNSAT
TT=100.864

No dataUNSAT
TT=569.535

No dataNo dataUNSAT
TT=1334.91

UNSAT
TT=1767.18

UNSAT
TT=2175.88

No dataNo dataUNSAT
TT=836.146

UNSAT
TT=168.555

UNSAT
TT=96.327

No dataNo dataNo dataNo dataUNSAT
TT=265.055

No dataUNSAT
TT=451.325

No dataUNSAT
TT=360.656

No dataNo dataNo dataNo dataUNSAT
TT=1816.9

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bioinfo/
q_query_3_l46_lambda.cnf
UNSAT
TT=79.111

No dataUNSAT
TT=1314.64

UNSAT
TT=1573.75

No dataNo dataUNSAT
TT=571.674

No dataNo dataUNSAT
TT=608.072

UNSAT
TT=658.352

UNSAT
TT=1846.06

UNSAT
TT=1967.26

UNSAT
TT=416.566

No dataNo dataUNSAT
TT=307.347

UNSAT
TT=79.111

UNSAT
TT=124.577

No dataUNSAT
TT=134.767

UNSAT
TT=133.931

No dataUNSAT
TT=127.239

UNSAT
TT=106.913

UNSAT
TT=96.489

UNSAT
TT=1282.35

UNSAT
TT=79.243

UNSAT
TT=128.813

UNSAT
TT=79.38

No dataUNSAT
TT=280.617

No dataNo dataUNSAT
TT=958.4

UNSAT
TT=936.969

UNSAT
TT=1603.47

No dataNo dataUNSAT
TT=416.132

UNSAT
TT=124.806

UNSAT
TT=105.367

No dataNo dataNo dataNo dataUNSAT
TT=195.188

No dataUNSAT
TT=234.24

No dataUNSAT
TT=137.864

No dataNo dataNo dataNo dataUNSAT
TT=576.13

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bioinfo/
q_query_3_L70_coli.sat.cnf
SAT
TT=23.738

No dataSAT
TT=738.997

SAT
TT=1041.57

No dataNo dataSAT
TT=326.105

No dataNo dataSAT
TT=302.772

SAT
TT=305.042

SAT
TT=1402.01

SAT
TT=1433.95

SAT
TT=273.948

No dataNo dataSAT
TT=71.533

SAT
TT=44.024

SAT
TT=36.6

No dataSAT
TT=68.609

SAT
TT=68.404

No dataSAT
TT=43.269

SAT
TT=39.728

SAT
TT=23.738

SAT
TT=56.341

SAT
TT=33.935

SAT
TT=43.864

SAT
TT=29.124

No dataSAT
TT=170.412

No dataNo dataSAT
TT=452.317

SAT
TT=460.12

SAT
TT=593.517

No dataNo dataSAT
TT=123.835

SAT
TT=36.117

SAT
TT=26.354

No dataNo dataNo dataNo dataSAT
TT=79.093

No dataSAT
TT=114.942

No dataSAT
TT=109.579

No dataNo dataNo dataNo dataSAT
TT=824.18

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
countbitsarray/
countbitsarray04_32.cnf



No data? (TO)
TT=40000.5

?
TT=39833

No dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.3

? (TO)
TT=40000.3

? (TO)
TT=40001

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.04

? (TO)
TT=5000.12

No data? (TO)
TT=5000.09

? (TO)
TT=5000.13

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.02

? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=5000.13

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40001.1

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.03

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20397.8

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
countbitsrotate/
countbitsrotate032.cnf



No data? (TO)
TT=40000.1

?
TT=39833.4

No dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.5

? (TO)
TT=40000.2

? (TO)
TT=40000.8

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.03

? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.5

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.1

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=20399.4

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
countbitssrl/
countbitssrl064.cnf



No data? (TO)
TT=40000.7

?
TT=39748.6

No dataNo data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=40001.2

? (TO)
TT=40001.5

? (TO)
TT=40000.9

? (TO)
TT=40000.5

? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=5000.11

? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.3

? (TO)
TT=40000.5

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20393.9

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
countbitswegner/
countbitswegner128.cnf
UNSAT
TT=3303.24

No data? (TO)
TT=40000.1

?
TT=39664.5

No dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=40001.9

? (TO)
TT=40003

? (TO)
TT=40001.1

UNSAT
TT=36691.9

? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.03

UNSAT
TT=3823.31

No data? (TO)
TT=5000.09

? (TO)
TT=5000.12

No data? (TO)
TT=5000.11

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.05

? (TO)
TT=5000.14

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40001

? (TO)
TT=40000.7

No dataNo dataUNSAT
TT=3303.24

? (TO)
TT=5000.1

? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=20385.4

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=552.77

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bitverif/maxor/
maxor128.cnf
UNSAT
TT=2123.23

No data? (MO)
TT=27588.8

? (MO)
TT=28846.3

No dataNo data? (TO)
TT=5000.01

No dataNo dataWrong Cert.
TT=5601.71

? (TO)
TT=40001.6

UNSAT
TT=12487.7

UNSAT
TT=13641

UNSAT
TT=3281.6

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.04

UNSAT
TT=4928.99

No dataUNSAT
TT=2128.96

UNSAT
TT=2123.23

No data? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=5000.07

UNSAT
TT=3967.26

? (TO)
TT=5000.07

? (TO)
TT=5000.11

? (TO)
TT=5000.1

No dataUNSAT
TT=3478.73

No dataNo dataUNSAT
TT=8485.26

UNSAT
TT=8818.12

UNSAT
TT=22308.3

No dataNo dataUNSAT
TT=2293.16

? (TO)
TT=5000.1

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=20381.7

No dataUNSAT
TT=2169.13

No dataNo dataNo dataNo dataUNSAT
TT=4975.17

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bitverif/maxxor/
maxxor032.cnf
UNSAT
TT=53.285

No dataUNSAT
TT=466.363

UNSAT
TT=528.143

No dataNo dataUNSAT
TT=673.832

No dataNo dataWrong Cert.
TT=20915.6

UNSAT
TT=16904.7

UNSAT
TT=258.086

UNSAT
TT=230.02

UNSAT
TT=62.505

No dataNo dataUNSAT
TT=133.385

UNSAT
TT=446.771

UNSAT
TT=53.285

No dataUNSAT
TT=149.679

UNSAT
TT=149.531

No dataUNSAT
TT=336.31

UNSAT
TT=2910.59

UNSAT
TT=1720.49

UNSAT
TT=293.645

UNSAT
TT=1834.8

UNSAT
TT=1509.56

UNSAT
TT=1234.72

No dataUNSAT
TT=4915.63

No dataNo dataUNSAT
TT=784.878

UNSAT
TT=745.413

UNSAT
TT=969.383

No dataNo dataUNSAT
TT=87.988

UNSAT
TT=4281.09

UNSAT
TT=610.896

No dataNo dataNo dataNo dataUNSAT
TT=486.392

No dataUNSAT
TT=1200.63

No dataUNSAT
TT=87.633

No dataNo dataNo dataNo dataUNSAT
TT=129.29

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bitverif/maxxor/
maxxor064.cnf
UNSAT
TT=809.913

No dataUNSAT
TT=8547.03

UNSAT
TT=9111.76

No dataNo dataUNSAT
TT=4073.56

No dataNo data? (TO)
TT=40002.3

? (TO)
TT=40001

UNSAT
TT=2591.04

UNSAT
TT=2510.1

UNSAT
TT=1122.82

No dataNo dataUNSAT
TT=4039.51

? (TO)
TT=5000.01

UNSAT
TT=859.254

No dataUNSAT
TT=1764.76

UNSAT
TT=1759.66

No data? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=5000.04

? (TO)
TT=5000.04

? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=11237.3

UNSAT
TT=11930.6

? (TO)
TT=35973.4

No dataNo dataUNSAT
TT=809.913

? (TO)
TT=5000.01

? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=20393

No dataUNSAT
TT=1664.58

No dataNo dataNo dataNo dataUNSAT
TT=1479.9

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
APPLICATIONS/
bitverif/maxxor/
maxxor128.cnf
UNSAT
TT=37756.2

No data? (MO)
TT=32879

? (MO)
TT=36710.8

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40002

? (TO)
TT=40002.4

? (TO)
TT=40000.6

UNSAT
TT=37756.2

? (TO)
TT=5000.17

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.02

? (TO)
TT=5000.04

No data? (TO)
TT=5000.11

? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.16

? (TO)
TT=5000.03

? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.7

? (TO)
TT=40000.5

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20381.1

No data? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
maxxororand/
maxxororand064.cnf
UNSAT
TT=4672.05

No data? (TO)
TT=40000.7

?
TT=39708

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40001.5

? (TO)
TT=40001.8

UNSAT
TT=30713.3

UNSAT
TT=32680.4

? (TO)
TT=5000.16

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.01

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=5000.14

No data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=40001.1

? (TO)
TT=40001

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.05

UNSAT
TT=4672.05

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=19905.5

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
minandmaxor/
minandmaxor016.cnf
UNSAT
TT=0.16

No dataUNSAT
TT=4.386

UNSAT
TT=3.883

No dataNo dataUNSAT
TT=1.956

No dataNo dataUNSAT
TT=0.629

UNSAT
TT=0.647

UNSAT
TT=4.191

UNSAT
TT=4.234

UNSAT
TT=0.436

No dataNo dataUNSAT
TT=0.378

UNSAT
TT=0.283

UNSAT
TT=0.208

No dataUNSAT
TT=1.227

UNSAT
TT=1.255

No dataUNSAT
TT=0.22

UNSAT
TT=0.175

UNSAT
TT=0.167

UNSAT
TT=0.308

UNSAT
TT=0.163

UNSAT
TT=0.254

UNSAT
TT=0.16

No dataUNSAT
TT=1.032

No dataNo dataUNSAT
TT=4.73

UNSAT
TT=4.405

UNSAT
TT=1.021

No dataNo dataUNSAT
TT=0.358

UNSAT
TT=0.342

UNSAT
TT=0.207

No dataNo dataNo dataNo dataUNSAT
TT=0.423

No dataUNSAT
TT=0.92

No dataUNSAT
TT=0.331

No dataNo dataNo dataNo dataUNSAT
TT=3.219

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
minandmaxor/
minandmaxor128.cnf
UNSAT
TT=1971.87

No dataUNSAT
TT=21251.4

UNSAT
TT=25430.4

No dataNo data? (TO)
TT=5000.1

No dataNo dataWrong Cert.
TT=3028.98

UNSAT
TT=6794.24

UNSAT
TT=10711.9

UNSAT
TT=11651.7

UNSAT
TT=1971.87

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=2757.35

UNSAT
TT=3284.39

No dataUNSAT
TT=4787.03

? (TO)
TT=5000.04

No data? (TO)
TT=5000.11

? (TO)
TT=5000.06

? (TO)
TT=5000.07

UNSAT
TT=2248.95

? (TO)
TT=5000.1

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No data? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=13979.2

UNSAT
TT=14600.1

UNSAT
TT=23519

No dataNo dataUNSAT
TT=2061.35

? (TO)
TT=5000.09

UNSAT
TT=3533.26

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=4859.13

No dataUNSAT
TT=2254.91

No dataNo dataNo dataNo dataUNSAT
TT=2879.84

No dataNo dataNo dataNo dataNo data
APPLICATIONS/bitverif/
minxorminand/
minxorminand128.cnf
UNSAT
TT=808.69

No dataUNSAT
TT=19025.2

UNSAT
TT=24646.3

No dataNo data? (TO)
TT=5000.05

No dataNo dataWrong Cert.
TT=204.922

UNSAT
TT=808.69

UNSAT
TT=10135.9

UNSAT
TT=9573.03

UNSAT
TT=2234.6

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.07

UNSAT
TT=2886.62

No dataUNSAT
TT=4059.89

UNSAT
TT=3795.16

No data? (TO)
TT=5000.1

? (TO)
TT=5000.09

UNSAT
TT=1691.84

UNSAT
TT=1058.67

UNSAT
TT=1966.85

? (TO)
TT=5000.02

UNSAT
TT=1943.93

No data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=21554.8

UNSAT
TT=18632.2

UNSAT
TT=20926.6

No dataNo data? (TO)
TT=5000.19

? (TO)
TT=5000.1

UNSAT
TT=1103.2

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=1269.89

No dataUNSAT
TT=2240.44

No dataNo dataNo dataNo dataUNSAT
TT=4994.82

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bitverif/mulhs/
mulhs016.cnf



No data? (TO)
TT=40000.3

? (TO)
TT=42043.4

No dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.3

? (TO)
TT=40000.6

? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.01

? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

? (TO)
TT=5000.12

No data? (TO)
TT=5000.1

? (TO)
TT=5000.1

? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.11

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.3

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.01

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20398.4

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
bitverif/smulo/
smulo064.cnf



No data? (TO)
TT=40000.6

?
TT=39057.2

No dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=40001.4

? (TO)
TT=40000.9

? (TO)
TT=40000.9

? (TO)
TT=40000.6

? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.12

? (TO)
TT=5000.09

? (TO)
TT=5000.04

? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.2

? (TO)
TT=35673.9

No dataNo data? (TO)
TT=5000.15

? (TO)
TT=5000.06

? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=20394.8

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
c32sat/
post-c32s-gcdm16-23.cnf
UNSAT
TT=27.699

No dataUNSAT
TT=320.639

UNSAT
TT=350.932

No dataNo dataUNSAT
TT=208.97

No dataNo dataUNSAT
TT=27.846

UNSAT
TT=72.043

UNSAT
TT=371.584

UNSAT
TT=336.526

UNSAT
TT=33.4

No dataNo dataUNSAT
TT=70.005

UNSAT
TT=69.712

UNSAT
TT=27.699

No dataUNSAT
TT=61.564

UNSAT
TT=61.37

No dataUNSAT
TT=124.433

UNSAT
TT=79.051

UNSAT
TT=77.992

UNSAT
TT=216.632

UNSAT
TT=91.569

UNSAT
TT=77.684

UNSAT
TT=78.572

No dataUNSAT
TT=152.263

No dataNo dataUNSAT
TT=309.269

UNSAT
TT=347.183

UNSAT
TT=462.387

No dataNo dataUNSAT
TT=35.215

UNSAT
TT=128.001

UNSAT
TT=43.657

No dataNo dataNo dataNo dataUNSAT
TT=97.465

No dataUNSAT
TT=159.172

No dataUNSAT
TT=40.109

No dataNo dataNo dataNo dataUNSAT
TT=126.35

No dataNo dataNo dataNo dataNo data
APPLICATIONS/c32sat/
post-cbmc-zfcp-2.8-u2-noholes.cnf
SAT
TT=29.31

No data? (TO)
TT=5099.3

? (TO)
TT=5098.91

No dataNo data? (TO)
TT=5000.33

No dataNo data? (TO)
TT=5118.7

? (TO)
TT=5113.72

? (MO)
TT=166.467

? (MO)
TT=155.529

SAT
TT=501.796

No dataNo dataSAT
TT=39.726

SAT
TT=29.31

SAT
TT=56.275

No dataSAT
TT=136.984

SAT
TT=137.384

No dataSAT
TT=58.507

SAT
TT=61.954

SAT
TT=59.586

SAT
TT=63.908

SAT
TT=54.921

SAT
TT=31.487

SAT
TT=54.711

No dataSAT
TT=168.919

No dataNo dataSAT
TT=1128.62

SAT
TT=943.308

SAT
TT=70.121

No dataNo dataSAT
TT=110.562

SAT
TT=44.136

SAT
TT=54.505

No dataNo dataNo dataNo dataSAT
TT=36.343

No data? (exit code)
TT=18.828

No dataSignal
TT=101.581

No dataNo dataNo dataNo dataSAT
TT=361.23

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/desgen/
gss-14-s100.cnf
SAT
TT=4.008

No dataSAT
TT=54.321

SAT
TT=22.864

No dataNo dataSAT
TT=8.055

No dataNo dataSAT
TT=5.528

SAT
TT=22.456

SAT
TT=41.766

SAT
TT=38.686

SAT
TT=28.034

No dataNo dataSAT
TT=21.201

SAT
TT=8.305

SAT
TT=17.431

No dataSAT
TT=18.206

SAT
TT=18.212

No dataSAT
TT=4.008

SAT
TT=8.782

SAT
TT=15.964

SAT
TT=19.095

SAT
TT=14.007

SAT
TT=13.747

SAT
TT=13.715

No dataSAT
TT=16.186

No dataNo dataSAT
TT=121.231

SAT
TT=23.265

SAT
TT=50.959

No dataNo dataSAT
TT=5.807

SAT
TT=17.559

SAT
TT=13.757

No dataNo dataNo dataNo dataSAT
TT=31.769

No dataSAT
TT=39.681

No dataSAT
TT=34.815

No dataNo dataNo dataNo dataSAT
TT=33.94

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
APPLICATIONS/
crypto/desgen/
gss-16-s100.cnf
SAT
TT=6.824

No dataSAT
TT=199.188

SAT
TT=192.734

No dataNo dataSAT
TT=84.973

No dataNo dataSAT
TT=371.011

SAT
TT=179.834

SAT
TT=278.318

SAT
TT=339.544

SAT
TT=102.228

No dataNo dataSAT
TT=117.169

SAT
TT=10.887

SAT
TT=38.799

No dataSAT
TT=51.436

SAT
TT=51.259

No dataSAT
TT=12.884

SAT
TT=22.989

SAT
TT=59.696

SAT
TT=54.126

SAT
TT=6.97

SAT
TT=42.286

SAT
TT=6.824

No dataSAT
TT=415.537

No dataNo dataSAT
TT=144.965

SAT
TT=34.677

SAT
TT=421.553

No dataNo dataSAT
TT=69.74

SAT
TT=44.764

SAT
TT=47.512

No dataNo dataNo dataNo dataSAT
TT=31.405

No dataSAT
TT=118.47

No dataSAT
TT=31.936

No dataNo dataNo dataNo dataSAT
TT=79.71

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/desgen/
gss-19-s100.cnf
SAT
TT=51.463

No dataSAT
TT=288.762

SAT
TT=241.184

No dataNo dataSAT
TT=199.564

No dataNo dataSAT
TT=1271.32

SAT
TT=261.442

SAT
TT=1007.94

SAT
TT=1485.06

SAT
TT=311.662

No dataNo dataSAT
TT=103.525

SAT
TT=170.881

SAT
TT=399.978

No dataSAT
TT=614.037

SAT
TT=611.057

No dataSAT
TT=545.694

SAT
TT=85.168

SAT
TT=227.34

SAT
TT=1631.76

SAT
TT=314.103

SAT
TT=483.164

SAT
TT=306.656

No dataSAT
TT=51.463

No dataNo dataSAT
TT=1131.87

SAT
TT=215.004

SAT
TT=190.42

No dataNo dataSAT
TT=242.705

SAT
TT=286.268

SAT
TT=1181.21

No dataNo dataNo dataNo dataSAT
TT=196.885

No dataSAT
TT=2399.96

No dataSAT
TT=815.873

No dataNo dataNo dataNo dataSAT
TT=53.6

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/desgen/
gss-21-s100.cnf
SAT
TT=38.046

No dataSAT
TT=3373.76

SAT
TT=75.746

No dataNo dataSAT
TT=4002.53

No dataNo dataSAT
TT=9570.66

SAT
TT=20529.8

SAT
TT=6869.73

SAT
TT=2872.59

SAT
TT=1614.32

No dataNo data? (TO)
TT=5000.04

SAT
TT=2109.72

SAT
TT=3599.58

No dataSAT
TT=4885.98

SAT
TT=4860.35

No dataSAT
TT=38.046

SAT
TT=670.114

? (TO)
TT=5000.08

? (TO)
TT=5000.12

? (TO)
TT=5000.06

SAT
TT=1048.6

? (TO)
TT=5000.04

No dataSAT
TT=42.509

No dataNo dataSAT
TT=1883.03

SAT
TT=2263.38

SAT
TT=397.519

No dataNo dataSAT
TT=1843.29

? (TO)
TT=5000.09

SAT
TT=391.067

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataSAT
TT=5406.59

No dataSAT
TT=151.026

No dataNo dataNo dataNo dataSAT
TT=2450.92

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/desgen/
gss-22-s100.cnf
SAT
TT=56.498

No data? (TO)
TT=40000.4

SAT
TT=2356.48

No dataNo data? (TO)
TT=5000.1

No dataNo dataSAT
TT=25933.2

SAT
TT=11515.6

SAT
TT=5369.9

SAT
TT=23162

SAT
TT=2264.22

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.02

SAT
TT=2764.42

No dataSAT
TT=1430.75

SAT
TT=1418.51

No data? (TO)
TT=5000.09

SAT
TT=2728.66

SAT
TT=1310.08

SAT
TT=4173.83

? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.03

No dataSAT
TT=56.498

No dataNo dataSAT
TT=9509.03

SAT
TT=1381.09

SAT
TT=35968.2

No dataNo dataSAT
TT=2557.55

SAT
TT=198.842

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.14

No data? (TO)
TT=20397.6

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/desgen/
gss-27-s100.cnf
SAT
TT=3141.43

No dataSAT
TT=3141.43

?
TT=39801.9

No dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.7

? (TO)
TT=40000.3

? (TO)
TT=40000.9

? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=5000.12

? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.11

? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=40000.6

? (TO)
TT=40000.1

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.13

No data? (TO)
TT=20397.7

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/md5gen/
gus-md5-11.cnf
UNSAT
TT=1376.76

No dataUNSAT
TT=34046

UNSAT
TT=24673

No dataNo data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=40001.3

UNSAT
TT=33945.1

UNSAT
TT=17581.3

UNSAT
TT=19172.9

UNSAT
TT=2693.59

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.02

? (TO)
TT=5000.11

No data? (TO)
TT=5000.09

? (TO)
TT=5000.11

No dataUNSAT
TT=1750.95

UNSAT
TT=2189.35

UNSAT
TT=1543.91

? (TO)
TT=5000.05

UNSAT
TT=1376.76

UNSAT
TT=1536.8

UNSAT
TT=1495.54

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.2

UNSAT
TT=19304.9

No dataNo data? (TO)
TT=5000.08

UNSAT
TT=2114.5

UNSAT
TT=1871.05

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=9351.99

No dataUNSAT
TT=2059.14

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
crypto/md5gen/
gus-md5-12.cnf



No data? (TO)
TT=40000.2

? (TO)
TT=40313.9

No dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.9

? (TO)
TT=40000.9

? (TO)
TT=40001

? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.1

? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

? (TO)
TT=5000.12

? (TO)
TT=5000.11

? (TO)
TT=5000.08

? (TO)
TT=5000.11

? (TO)
TT=5000.02

? (TO)
TT=5000.11

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.9

? (TO)
TT=40000.5

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000

? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20397.2

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
ACG-10-10p0.cnf
UNSAT
TT=31.616

No dataUNSAT
TT=474.246

UNSAT
TT=464.771

No dataNo dataUNSAT
TT=99.506

No dataNo dataUNSAT
TT=267.996

UNSAT
TT=252.202

UNSAT
TT=577.162

UNSAT
TT=587.593

UNSAT
TT=112.734

No dataNo dataUNSAT
TT=31.616

UNSAT
TT=34.628

UNSAT
TT=37.539

No dataUNSAT
TT=38.397

UNSAT
TT=38.058

No dataUNSAT
TT=47.068

UNSAT
TT=43.489

UNSAT
TT=41.814

UNSAT
TT=37.23

UNSAT
TT=32.651

UNSAT
TT=64.47

UNSAT
TT=32.334

No dataUNSAT
TT=58.3

No dataNo dataUNSAT
TT=173.11

UNSAT
TT=199.481

UNSAT
TT=309.07

No dataNo dataUNSAT
TT=61.575

UNSAT
TT=41.264

UNSAT
TT=62.646

No dataNo dataNo dataNo dataUNSAT
TT=35.923

No dataUNSAT
TT=111.398

No dataUNSAT
TT=58.594

No dataNo dataNo dataNo dataUNSAT
TT=136.63

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
ACG-15-5p1.cnf
SAT
TT=55.554

No dataSAT
TT=743.279

SAT
TT=675.78

No dataNo dataSAT
TT=253.844

No dataNo dataSAT
TT=446.592

SAT
TT=346.401

SAT
TT=657.389

SAT
TT=345.813

SAT
TT=100.871

No dataNo dataSAT
TT=82.872

SAT
TT=55.554

SAT
TT=66.458

No dataSAT
TT=71.652

SAT
TT=63.004

No dataSAT
TT=116.061

SAT
TT=78.794

SAT
TT=83.651

SAT
TT=88.58

SAT
TT=79.697

SAT
TT=75.017

SAT
TT=80.899

No dataSAT
TT=64.813

No dataNo dataSAT
TT=198.387

SAT
TT=186.877

SAT
TT=388.624

No dataNo dataSAT
TT=73.645

SAT
TT=120.252

SAT
TT=77.218

No dataNo dataNo dataNo dataSAT
TT=57.11

No dataSAT
TT=163.069

No dataSAT
TT=64.974

No dataNo dataNo dataNo dataSAT
TT=180.77

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UCG-15-10p0.cnf
UNSAT
TT=173.435

No dataUNSAT
TT=2097.17

UNSAT
TT=2202.34

No dataNo dataUNSAT
TT=612.922

No dataNo dataUNSAT
TT=1441.36

UNSAT
TT=1315.71

UNSAT
TT=2071.46

UNSAT
TT=2256.89

UNSAT
TT=374.307

No dataNo dataUNSAT
TT=257.519

UNSAT
TT=403.269

UNSAT
TT=312.699

No dataUNSAT
TT=173.583

UNSAT
TT=173.435

No dataUNSAT
TT=439.287

UNSAT
TT=311.448

UNSAT
TT=293.909

UNSAT
TT=504.753

UNSAT
TT=403.722

UNSAT
TT=309.123

UNSAT
TT=402.269

No dataUNSAT
TT=361.994

No dataNo dataUNSAT
TT=936.926

UNSAT
TT=988.027

UNSAT
TT=1977.49

No dataNo dataUNSAT
TT=389.203

UNSAT
TT=413.926

UNSAT
TT=351.195

No dataNo dataNo dataNo dataUNSAT
TT=471.245

No dataUNSAT
TT=491.287

No dataUNSAT
TT=240.704

No dataNo dataNo dataNo dataUNSAT
TT=1127.74

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
APPLICATIONS/diagnosis/
UCG-15-10p1.cnf
SAT
TT=245.772

No dataSAT
TT=2491.39

SAT
TT=2695.47

No dataNo dataSAT
TT=799.004

No dataNo dataSAT
TT=1677.5

SAT
TT=2207.24

SAT
TT=2493.94

SAT
TT=2408.87

SAT
TT=414.992

No dataNo dataSAT
TT=1009.9

SAT
TT=351.51

SAT
TT=510.005

No dataSAT
TT=246.651

SAT
TT=245.772

No dataSAT
TT=714.409

SAT
TT=280.967

SAT
TT=410.919

SAT
TT=488.525

SAT
TT=377.53

SAT
TT=474.105

SAT
TT=365.103

No dataSAT
TT=330.152

No dataNo dataSAT
TT=1252.81

SAT
TT=1320

SAT
TT=1404.37

No dataNo dataSAT
TT=411.806

SAT
TT=687.37

SAT
TT=560.161

No dataNo dataNo dataNo dataSAT
TT=646.046

No dataSAT
TT=547.454

No dataSAT
TT=345.038

No dataNo dataNo dataNo dataSAT
TT=1637.54

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UCG-15-5p0.cnf
UNSAT
TT=38.165

No dataUNSAT
TT=505.3

UNSAT
TT=506.424

No dataNo dataUNSAT
TT=109.694

No dataNo dataUNSAT
TT=271.593

UNSAT
TT=239.227

UNSAT
TT=413.22

UNSAT
TT=377.103

UNSAT
TT=86.095

No dataNo dataUNSAT
TT=67.605

UNSAT
TT=46.914

UNSAT
TT=89.726

No dataUNSAT
TT=38.262

UNSAT
TT=38.165

No dataUNSAT
TT=48.017

UNSAT
TT=39.273

UNSAT
TT=45.45

UNSAT
TT=55.811

UNSAT
TT=41.977

UNSAT
TT=41.543

UNSAT
TT=40.979

No dataUNSAT
TT=56.69

No dataNo dataUNSAT
TT=163.292

UNSAT
TT=178.236

UNSAT
TT=229.237

No dataNo dataUNSAT
TT=73.358

UNSAT
TT=58.494

UNSAT
TT=39.392

No dataNo dataNo dataNo dataUNSAT
TT=55.846

No dataUNSAT
TT=74.809

No dataUNSAT
TT=39.615

No dataNo dataNo dataNo dataUNSAT
TT=137.42

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UCG-20-5p1.cnf
SAT
TT=109.921

No dataSAT
TT=793.872

SAT
TT=883.19

No dataNo dataSAT
TT=335.116

No dataNo dataSAT
TT=821.735

SAT
TT=956.759

SAT
TT=802.946

SAT
TT=1272.84

SAT
TT=209.846

No dataNo dataSAT
TT=500.423

SAT
TT=373.118

SAT
TT=602.449

No dataSAT
TT=216.36

SAT
TT=215.296

No dataSAT
TT=532.858

SAT
TT=224.914

SAT
TT=228.247

SAT
TT=448.455

SAT
TT=345.317

SAT
TT=406.138

SAT
TT=340.583

No dataSAT
TT=228.788

No dataNo dataSAT
TT=780.682

SAT
TT=852.747

SAT
TT=914.645

No dataNo dataSAT
TT=109.921

SAT
TT=223.779

SAT
TT=356.17

No dataNo dataNo dataNo dataSAT
TT=377.45

No dataSAT
TT=312.244

No dataSAT
TT=147.851

No dataNo dataNo dataNo dataSAT
TT=1184.79

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UR-10-10p1.cnf
SAT
TT=14.27

No dataSAT
TT=529.142

SAT
TT=581.376

No dataNo dataSAT
TT=215.375

No dataNo dataSAT
TT=366.748

SAT
TT=178.495

SAT
TT=361.208

SAT
TT=511.511

SAT
TT=63.34

No dataNo dataSAT
TT=35.11

SAT
TT=63.989

SAT
TT=51.829

No dataSAT
TT=56.896

SAT
TT=50.221

No dataSAT
TT=85.273

SAT
TT=52.255

SAT
TT=14.27

SAT
TT=75.485

SAT
TT=78.733

SAT
TT=54.845

SAT
TT=79.703

No dataSAT
TT=127.202

No dataNo dataSAT
TT=197.651

SAT
TT=179.973

SAT
TT=363.16

No dataNo dataSAT
TT=61.873

SAT
TT=33.18

SAT
TT=67.038

No dataNo dataNo dataNo dataSAT
TT=42.085

No dataSAT
TT=199.704

No dataSAT
TT=83.172

No dataNo dataNo dataNo dataSAT
TT=108.53

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UR-20-10p0.cnf
UNSAT
TT=1428.89

No dataUNSAT
TT=33541.8

UNSAT
TT=22886.6

No dataNo dataUNSAT
TT=2445.05

No dataNo dataUNSAT
TT=17150.5

UNSAT
TT=15989.5

UNSAT
TT=12995

UNSAT
TT=12273

UNSAT
TT=1910.73

No dataNo data? (TO)
TT=5000.08

UNSAT
TT=2565.14

UNSAT
TT=2343.35

No dataUNSAT
TT=1827.79

UNSAT
TT=1803.04

No data? (TO)
TT=5000.15

UNSAT
TT=4734.67

? (TO)
TT=5000.17

UNSAT
TT=4260.33

? (TO)
TT=5000.2

? (TO)
TT=5000.05

? (TO)
TT=5000.15

No dataUNSAT
TT=3856.36

No dataNo dataUNSAT
TT=12637.4

UNSAT
TT=16068.4

UNSAT
TT=24453.7

No dataNo dataUNSAT
TT=1428.89

? (TO)
TT=5000.01

UNSAT
TT=3228.41

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataUNSAT
TT=6235.05

No dataUNSAT
TT=2663.29

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UR-20-10p1.cnf
SAT
TT=2102.85

No dataSAT
TT=7340.75

?
TT=38314.3

No dataNo data? (TO)
TT=5000.02

No dataNo dataSAT
TT=15883

SAT
TT=22276.5

SAT
TT=10364.9

SAT
TT=9798.46

SAT
TT=2266.38

No dataNo data? (TO)
TT=5000.02

SAT
TT=3308.7

? (TO)
TT=5000.07

No dataSAT
TT=2464.5

SAT
TT=2432.96

No dataSAT
TT=2549.89

? (TO)
TT=5000.05

SAT
TT=3254.49

? (TO)
TT=5000.18

? (TO)
TT=5000.14

SAT
TT=2601.04

? (TO)
TT=5000.16

No dataSAT
TT=2102.85

No dataNo dataSAT
TT=16009.4

SAT
TT=11713.1

SAT
TT=15216.7

No dataNo dataSAT
TT=2464.24

SAT
TT=4071.63

SAT
TT=2609.76

No dataNo dataNo dataNo dataSAT
TT=2893.27

No dataSAT
TT=9881.65

No dataSAT
TT=3076.78

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UTI-10-5t1.cnf
SAT
TT=0.958

No dataSAT
TT=41.764

SAT
TT=36.585

No dataNo dataSAT
TT=30.073

No dataNo dataSAT
TT=6.859

SAT
TT=6.756

SAT
TT=116.106

SAT
TT=108.283

SAT
TT=9.508

No dataNo dataSAT
TT=1.633

SAT
TT=1.591

SAT
TT=1.242

No dataSAT
TT=3.778

SAT
TT=3.769

No dataSAT
TT=1.655

SAT
TT=1.006

SAT
TT=1.076

SAT
TT=1.124

SAT
TT=0.958

SAT
TT=2.041

SAT
TT=0.961

No dataSAT
TT=5.028

No dataNo dataSAT
TT=6.283

SAT
TT=6.779

SAT
TT=7.854

No dataNo dataSAT
TT=10.543

SAT
TT=1.803

SAT
TT=1.157

No dataNo dataNo dataNo dataSAT
TT=2.033

No dataSAT
TT=2.447

No dataSAT
TT=5.502

No dataNo dataNo dataNo dataSAT
TT=36.93

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UTI-20-10p0.cnf
UNSAT
TT=335.143

No dataUNSAT
TT=3734.58

UNSAT
TT=3870.99

No dataNo dataUNSAT
TT=538.938

No dataNo dataUNSAT
TT=5712.55

UNSAT
TT=7280.84

UNSAT
TT=2554.63

UNSAT
TT=2649.71

UNSAT
TT=399.381

No dataNo dataUNSAT
TT=851.657

UNSAT
TT=486.148

UNSAT
TT=471.026

No dataUNSAT
TT=615.548

UNSAT
TT=616.058

No dataUNSAT
TT=3300.58

UNSAT
TT=1293.32

UNSAT
TT=1408.17

UNSAT
TT=1415.69

UNSAT
TT=2072.22

UNSAT
TT=914.607

UNSAT
TT=2064.84

No dataUNSAT
TT=1042.67

No dataNo dataUNSAT
TT=2780.49

UNSAT
TT=2631.98

UNSAT
TT=4718.35

No dataNo dataUNSAT
TT=335.143

UNSAT
TT=2492.59

UNSAT
TT=781.016

No dataNo dataNo dataNo dataUNSAT
TT=1152.85

No dataUNSAT
TT=2141.12

No dataUNSAT
TT=1830.76

No dataNo dataNo dataNo dataUNSAT
TT=3294.53

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UTI-20-10p1.cnf
SAT
TT=608.162

No dataSAT
TT=5394.67

SAT
TT=6256.06

No dataNo dataSAT
TT=1401.91

No dataNo dataSAT
TT=9661.89

SAT
TT=5294.56

SAT
TT=4457.56

SAT
TT=4175.03

SAT
TT=627.861

No dataNo dataSAT
TT=2447.44

SAT
TT=803.443

SAT
TT=1465.14

No dataSAT
TT=1397.37

SAT
TT=1401.06

No dataSAT
TT=682.661

SAT
TT=2299.54

SAT
TT=4010.27

? (TO)
TT=5000.17

SAT
TT=3130.92

SAT
TT=987.324

SAT
TT=2742.59

No dataSAT
TT=2072.9

No dataNo dataSAT
TT=8049.73

SAT
TT=4228.81

SAT
TT=9536.75

No dataNo dataSAT
TT=608.162

SAT
TT=4178.19

SAT
TT=2638.07

No dataNo dataNo dataNo dataSAT
TT=2133.72

No dataSAT
TT=5289.16

No dataSAT
TT=3155.97

No dataNo dataNo dataNo dataSAT
TT=4033.26

No dataNo dataNo dataNo dataNo data
APPLICATIONS/diagnosis/
UTI-20-10t0.cnf
UNSAT
TT=3.914

No dataUNSAT
TT=146.56

UNSAT
TT=189.267

No dataNo dataUNSAT
TT=120.909

No dataNo dataUNSAT
TT=29.236

UNSAT
TT=26.525

UNSAT
TT=203.255

UNSAT
TT=200.867

UNSAT
TT=18.773

No dataNo dataUNSAT
TT=5.942

UNSAT
TT=5.591

UNSAT
TT=4.708

No dataUNSAT
TT=8.601

UNSAT
TT=8.583

No dataUNSAT
TT=6.372

UNSAT
TT=5.981

UNSAT
TT=4.288

UNSAT
TT=6.023

UNSAT
TT=5.543

UNSAT
TT=3.914

UNSAT
TT=5.409

No dataUNSAT
TT=9.684

No dataNo dataUNSAT
TT=31.951

UNSAT
TT=30.333

UNSAT
TT=64.131

No dataNo dataUNSAT
TT=22.162

UNSAT
TT=9.116

UNSAT
TT=4.063

No dataNo dataNo dataNo dataUNSAT
TT=9.054

No dataUNSAT
TT=13.048

No dataUNSAT
TT=17.238

No dataNo dataNo dataNo dataUNSAT
TT=116.32

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
APPLICATIONS/diagnosis/
UTI-20-10t1.cnf
SAT
TT=3.105

No dataSAT
TT=170.037

SAT
TT=187.901

No dataNo dataSAT
TT=120.138

No dataNo dataSAT
TT=25.404

SAT
TT=25.19

SAT
TT=200.361

SAT
TT=195.776

SAT
TT=18.085

No dataNo dataSAT
TT=4.927

SAT
TT=3.74

SAT
TT=3.105

No dataSAT
TT=7.909

SAT
TT=7.871

No dataSAT
TT=3.109

SAT
TT=3.903

SAT
TT=3.986

SAT
TT=3.264

SAT
TT=4.812

SAT
TT=6.215

SAT
TT=4.837

No dataSAT
TT=8.65

No dataNo dataSAT
TT=20.623

SAT
TT=20.225

SAT
TT=42.06

No dataNo dataSAT
TT=21.744

SAT
TT=6.329

SAT
TT=3.841

No dataNo dataNo dataNo dataSAT
TT=7.721

No dataSAT
TT=6.693

No dataSAT
TT=17.367

No dataNo dataNo dataNo dataSAT
TT=114.35

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
satComp09_BioInstances/
ndhf_xits_19_UNKNOWN.cnf
SAT
TT=13.486

No dataSAT
TT=873.737

SAT
TT=1321.32

No dataNo dataSAT
TT=266.533

No dataNo data? (TO)
TT=40002.1

? (TO)
TT=40001.4

SAT
TT=47.339

SAT
TT=48.546

SAT
TT=482.62

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.1

SAT
TT=529.905

No dataSAT
TT=44.524

SAT
TT=44.292

No dataSAT
TT=182.236

SAT
TT=13.486

SAT
TT=1149.58

SAT
TT=40.426

SAT
TT=2009.81

? (TO)
TT=5000.05

SAT
TT=2232.08

No dataSAT
TT=21.679

No dataNo dataSAT
TT=38.779

SAT
TT=38.266

SAT
TT=786.682

No dataNo dataSAT
TT=453.558

? (TO)
TT=5000.01

SAT
TT=653.494

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=20385.4

No dataSAT
TT=1394.79

No dataNo dataNo dataNo dataSAT
TT=59.1

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
satComp09_BioInstances/rbcl_xits_08_UNSAT.cnf
UNSAT
TT=977.211

No data? (TO)
TT=40000.3

?
TT=39086.4

No dataNo data? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=10001.5

UNSAT
TT=8492.66

? (TO)
TT=40000.8

? (TO)
TT=40000.8

? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.02

UNSAT
TT=3353.51

UNSAT
TT=4976.85

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.12

UNSAT
TT=1510.87

UNSAT
TT=1433.54

UNSAT
TT=4243.34

UNSAT
TT=1290.69

UNSAT
TT=2852.52

UNSAT
TT=1291.73

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.5

UNSAT
TT=32554.8

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.1

UNSAT
TT=977.211

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=14307.2

No dataUNSAT
TT=1350.8

No dataNo dataNo dataNo dataUNSAT
TT=2019.47

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
satComp09_BioInstances/
rbcl_xits_09_UNKNOWN.cnf



No data? (TO)
TT=40000.8

?
TT=39798

No dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=35703.1

? (TO)
TT=40000.8

? (TO)
TT=40000.6

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No data? (TO)
TT=5000.08

? (TO)
TT=5000.11

No data? (TO)
TT=5000.07

? (TO)
TT=5000.14

? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.8

? (TO)
TT=40000.7

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20398.4

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
satComp09_BioInstances/
rbcl_xits_15_SAT.cnf
SAT
TT=0.742

No dataSAT
TT=8.784

SAT
TT=7.001

No dataNo dataSAT
TT=7.845

No dataNo dataSignal
TT=3.414

SAT
TT=2.727

SAT
TT=12.74

SAT
TT=12.727

SAT
TT=1.347

No dataNo dataSAT
TT=1.389

SAT
TT=5.154

SAT
TT=0.837

No dataSAT
TT=1.117

SAT
TT=1.117

No dataSAT
TT=0.979

SAT
TT=0.824

SAT
TT=0.778

SAT
TT=0.946

SAT
TT=0.774

SAT
TT=0.759

SAT
TT=0.773

No dataSAT
TT=1.544

No dataNo dataSAT
TT=7.074

SAT
TT=7.377

SAT
TT=5.229

No dataNo dataSAT
TT=8.756

SAT
TT=644.776

SAT
TT=0.742

No dataNo dataNo dataNo dataSAT
TT=241.108

No dataSAT
TT=1.096

No dataSAT
TT=1.637

No dataNo dataNo dataNo dataSAT
TT=19.5

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
satComp09_BioInstances/
rbcl_xits_18_SAT.cnf
SAT
TT=1.043

No dataSAT
TT=9.719

SAT
TT=9.405

No dataNo dataSAT
TT=10.148

No dataNo dataSAT
TT=3.39

SAT
TT=3.354

SAT
TT=14.571

SAT
TT=14.076

SAT
TT=1.2

No dataNo dataSAT
TT=4.996

SAT
TT=70.8

SAT
TT=1.099

No dataSAT
TT=1.285

SAT
TT=1.283

No dataSAT
TT=1.326

SAT
TT=1.152

SAT
TT=1.097

SAT
TT=1.125

SAT
TT=1.092

SAT
TT=1.043

SAT
TT=1.093

No dataSAT
TT=2.208

No dataNo dataSAT
TT=9.761

SAT
TT=9.563

SAT
TT=3.987

No dataNo dataSAT
TT=8.782

SAT
TT=1.245

SAT
TT=1.094

No dataNo dataNo dataNo dataSAT
TT=192.209

No dataSAT
TT=1.446

No dataSAT
TT=1.214

No dataNo dataNo dataNo dataSAT
TT=17.37

No dataNo dataNo dataNo dataNo data
APPLICATIONS/
satComp09_BioInstances/rpoc_xits_09_UNSAT.cnf



No data? (TO)
TT=40000.4

?
TT=39828.9

No dataNo data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=40001.3

? (TO)
TT=40001.3

? (TO)
TT=40000.3

? (TO)
TT=40001

? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.02

? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

? (TO)
TT=5000.11

No data? (TO)
TT=5000.11

? (TO)
TT=5000.11

? (TO)
TT=5000.03

? (TO)
TT=5000.11

? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.6

? (TO)
TT=40000.8

No dataNo data? (TO)
TT=5000.14

? (TO)
TT=5000.08

? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=20398.4

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
crafted/anton/SRHD-SGI/
srhd-sgi-m27-q225-n25-p15-s58217873.cnf
SAT
TT=0.072

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.727

SAT
TT=36.602

SAT
TT=28.488

No dataSAT
TT=112.219

SAT
TT=23.681

No dataNo dataNo dataSAT
TT=20.525

No dataSAT
TT=27.673

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=107.31

No dataNo dataSAT
TT=11.777

No dataSAT
TT=3.856

SAT
TT=0.773

SAT
TT=0.386

SAT
TT=21.465

SAT
TT=19.678

No dataSAT
TT=12.682

SAT
TT=3.723

SAT
TT=0.072

SAT
TT=89.61

SAT
TT=6.143

No dataNo dataNo dataNo dataNo dataSAT
TT=1487.87

No dataNo dataSAT
TT=309.579

SAT
TT=27.897

SAT
TT=0.324

SAT
TT=0.198

No dataSAT
TT=0.229

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m27-q225-n25-p30-s70617701.cnf
SAT
TT=0.053

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=42.567

SAT
TT=72.458

SAT
TT=61.044

No dataSAT
TT=130.575

SAT
TT=5.128

No dataNo dataNo dataSAT
TT=26.8

No dataSAT
TT=875.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=102.686

No dataNo dataSAT
TT=41.619

No dataSAT
TT=16.967

SAT
TT=2.919

SAT
TT=3.07

SAT
TT=367.786

SAT
TT=92.786

No dataSAT
TT=370.601

SAT
TT=1559.55

SAT
TT=0.053

SAT
TT=528.412

SAT
TT=177.933

No dataNo dataNo dataNo dataNo dataSAT
TT=2184.3

No dataNo dataSAT
TT=82.707

SAT
TT=31.918

SAT
TT=0.572

SAT
TT=0.727

No dataSAT
TT=27.615

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m27-q255-n25-p15-s2076598.cnf
SAT
TT=0.651

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=578.031

SAT
TT=1289.35

SAT
TT=782.343

No dataSAT
TT=473.569

SAT
TT=323.285

No dataNo dataNo dataSAT
TT=2248.58

No dataSAT
TT=1082.39

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=589.535

No dataNo dataSAT
TT=201.764

No data? (TO)
TT=40000.5

SAT
TT=14.943

SAT
TT=3.169

SAT
TT=489.639

SAT
TT=25.53

No dataSAT
TT=2220.49

SAT
TT=150.164

SAT
TT=19862

SAT
TT=1098.89

SAT
TT=732.878

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.28

No dataNo data? (TO)
TT=5000.07

SAT
TT=27.14

SAT
TT=0.651

SAT
TT=3.22

No dataSAT
TT=415.169

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/anton/SRHD-SGI/
srhd-sgi-m27-q255-n25-p30-s39712998.cnf
SAT
TT=0.055

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=478.135

SAT
TT=478.852

SAT
TT=199.195

No dataSAT
TT=1509.97

SAT
TT=753.968

No dataNo dataNo dataSAT
TT=156.264

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=38.58

No dataNo data? (TO)
TT=5000.09

No dataSAT
TT=112.924

SAT
TT=139.692

SAT
TT=72.536

? (TO)
TT=20400

SAT
TT=1143.09

No data? (TO)
TT=5000.05

SAT
TT=2773.09

SAT
TT=0.055

? (TO)
TT=5000.05

SAT
TT=30.019

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.39

No dataNo dataSAT
TT=1482.68

SAT
TT=315.14

SAT
TT=12.224

SAT
TT=67.466

No dataSAT
TT=0.278

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m32-q326.25-n30-p15-s44266159.cnf
SAT
TT=0.167

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=202.869

SAT
TT=507.54

SAT
TT=101.933

No dataSAT
TT=371.049

SAT
TT=299.766

No dataNo dataNo dataSAT
TT=592.971

No dataSAT
TT=2960.57

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.801

No dataNo dataSAT
TT=3071.78

No dataSAT
TT=34.295

SAT
TT=10.98

SAT
TT=4.887

SAT
TT=1317.05

SAT
TT=444.486

No data? (TO)
TT=5000.06

? (TO)
TT=5000.03

SAT
TT=0.167

? (TO)
TT=5000.04

SAT
TT=151.68

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.98

No dataNo dataSAT
TT=518.942

SAT
TT=36.04

SAT
TT=2.89

SAT
TT=0.989

No dataSAT
TT=0.386

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m32-q326.25-n30-p30-s48700942.cnf
SAT
TT=0.341

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=545.606

SAT
TT=1270.66

SAT
TT=279.486

No dataSAT
TT=189.719

SAT
TT=25.709

No dataNo dataNo dataSAT
TT=1243.89

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=386.112

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=0.756

SAT
TT=18.14

SAT
TT=13.583

SAT
TT=1097.12

SAT
TT=75.681

No data? (TO)
TT=5000.12

? (TO)
TT=5000.04

SAT
TT=0.341

? (TO)
TT=5000.03

SAT
TT=300.028

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.97

No dataNo dataSAT
TT=630.369

SAT
TT=45.23

SAT
TT=16.861

SAT
TT=185.163

No dataSAT
TT=50.051

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m32-q369.75-n30-p15-s59317012.cnf
SAT
TT=0.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3237.35

SAT
TT=12421.3

SAT
TT=2512.2

No dataSAT
TT=4548.88

? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=4524.79

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=941.136

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=1911.91

SAT
TT=40.54

SAT
TT=6.876

SAT
TT=1320.46

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

SAT
TT=594.119

SAT
TT=0.09

? (TO)
TT=5000.04

SAT
TT=2493.84

No dataNo dataNo dataNo dataNo dataSAT
TT=65.55

No dataNo dataSAT
TT=1575.18

SAT
TT=386.33

SAT
TT=18.511

SAT
TT=17.997

No dataSAT
TT=0.456

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
SAT
TT=0.154

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40000.5

? (TO)
TT=40000.7

No dataSAT
TT=426.729

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40001

SAT
TT=1538.33

SAT
TT=1543.31

? (TO)
TT=20399.8

? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

? (TO)
TT=5000.09

SAT
TT=0.154

? (TO)
TT=5000.11

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.81

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.08

SAT
TT=9.164

SAT
TT=931.155

No dataSAT
TT=0.467

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf
SAT
TT=0.082

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=47.599

SAT
TT=272.995

SAT
TT=569.878

No dataSAT
TT=134.505

SAT
TT=97.597

No dataNo dataNo dataSAT
TT=1241.76

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=118.243

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=40000.5

SAT
TT=190.683

SAT
TT=213.17

SAT
TT=162.857

SAT
TT=68.131

No data? (TO)
TT=5000.03

SAT
TT=1486.59

SAT
TT=0.082

SAT
TT=1618.55

SAT
TT=49.648

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.34

No dataNo dataSAT
TT=2226.98

SAT
TT=35.54

SAT
TT=17.619

SAT
TT=5.439

No dataSAT
TT=0.729

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf
SAT
TT=0.178

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3342.14

SAT
TT=8720.5

SAT
TT=17591.2

No dataSAT
TT=16080

SAT
TT=73.235

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=184.975

No dataNo data? (TO)
TT=5000.12

No dataSAT
TT=19844.8

SAT
TT=15.817

SAT
TT=628.447

? (TO)
TT=20399.7

? (TO)
TT=5000.08

No data? (TO)
TT=5000.08

? (TO)
TT=5000.12

SAT
TT=0.178

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.7

No dataNo data? (TO)
TT=5000.11

SAT
TT=391.79

SAT
TT=794.087

SAT
TT=710.583

No dataSAT
TT=0.946

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf
SAT
TT=0.09

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=28451.4

? (TO)
TT=40000.9

No data? (TO)
TT=40000.8

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40001.2

SAT
TT=1676.73

SAT
TT=397.266

? (TO)
TT=20399.3

? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

? (TO)
TT=5000.06

SAT
TT=0.09

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.54

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.06

SAT
TT=454.226

SAT
TT=30.047

No dataSAT
TT=0.833

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
SAT
TT=0.157

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=31166.6

? (TO)
TT=40001

No data? (TO)
TT=40000.4

? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40001.2

? (TO)
TT=40000.1

? (TO)
TT=5000.08

? (TO)
TT=20400.1

? (TO)
TT=5000.12

No data? (TO)
TT=5000.07

? (TO)
TT=5000.06

SAT
TT=0.157

? (TO)
TT=5000.08

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.41

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataSAT
TT=0.849

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m42-q585-n40-p15-s54275047.cnf
SAT
TT=30.056

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

SAT
TT=124.58

SAT
TT=15170.7

No dataSAT
TT=2935.3

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=173.567

No dataNo data? (TO)
TT=5000.03

No dataSAT
TT=6031.67

SAT
TT=1033.59

SAT
TT=1033.66

SAT
TT=3189.69

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=40001.2

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.61

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000

SAT
TT=220.526

SAT
TT=30.056

No dataSAT
TT=3800.01

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/anton/SRHD-SGI/
srhd-sgi-m42-q585-n40-p30-s19690873.cnf
SAT
TT=0.156

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40001.3

SAT
TT=979.902

No dataSAT
TT=428.502

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.08

No dataSAT
TT=580.796

SAT
TT=1778.78

SAT
TT=626.267

? (TO)
TT=20399.2

? (TO)
TT=5000.07

No data? (TO)
TT=5000.1

? (TO)
TT=5000.13

SAT
TT=0.156

? (TO)
TT=5000.13

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.76

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No dataSAT
TT=1.331

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m42-q663-n40-p15-s72490337.cnf
SAT
TT=0.166

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.7

? (TO)
TT=40001.6

No data? (TO)
TT=40000.9

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40001

SAT
TT=2746.37

SAT
TT=685.449

? (TO)
TT=20399

? (TO)
TT=5000.15

No data? (TO)
TT=5000.09

? (TO)
TT=5000.14

SAT
TT=0.166

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.33

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.11

SAT
TT=93.18

SAT
TT=209.114

No dataSAT
TT=1.399

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m42-q663-n40-p30-s67876261.cnf
SAT
TT=0.129

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40001.6

? (TO)
TT=40001.7

No dataSAT
TT=15539.5

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.9

? (TO)
TT=40000.2

? (TO)
TT=5000.07

? (TO)
TT=20398.8

SAT
TT=4412.47

No data? (TO)
TT=5000.06

? (TO)
TT=5000.13

SAT
TT=0.129

? (TO)
TT=5000.11

? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.23

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataSAT
TT=1.252

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m47-q742.5-n45-p15-s28972035.cnf
SAT
TT=0.269

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

SAT
TT=16077.1

SAT
TT=32343.9

No data? (TO)
TT=40000.4

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.5

SAT
TT=3214.58

SAT
TT=1491.57

? (TO)
TT=20398.9

? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

? (TO)
TT=5000.08

SAT
TT=0.269

? (TO)
TT=5000.1

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.02

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.08

SAT
TT=99.623

SAT
TT=145.531

No dataSAT
TT=2.243

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m47-q742.5-n45-p30-s17570390.cnf
SAT
TT=0.256

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

? (TO)
TT=35954

? (TO)
TT=40001.9

No data? (TO)
TT=40000.6

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001.1

? (TO)
TT=40000.7

? (TO)
TT=5000.04

? (TO)
TT=20399.2

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

? (TO)
TT=5000.14

SAT
TT=0.256

? (TO)
TT=5000.08

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.65

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.01

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No dataSAT
TT=2.265

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m47-q841.5-n45-p15-s16393788.cnf
SAT
TT=0.197

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=35803.5

? (TO)
TT=40001.4

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40001

SAT
TT=23192.5

SAT
TT=2008.25

? (TO)
TT=20398.9

? (TO)
TT=5000.15

No data? (TO)
TT=5000.13

? (TO)
TT=5000.08

SAT
TT=0.197

? (TO)
TT=5000.12

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.44

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.06

SAT
TT=3529.03

SAT
TT=4487.83

No dataSAT
TT=1.945

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m47-q841.5-n45-p30-s84954709.cnf
SAT
TT=0.135

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=35692.1

? (TO)
TT=40001.7

No data? (TO)
TT=40000.6

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001.3

? (TO)
TT=40000.7

? (TO)
TT=5000.1

? (TO)
TT=20398.3

? (TO)
TT=5000.1

No data? (TO)
TT=5000.11

? (TO)
TT=5000.07

SAT
TT=0.135

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.94

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataSAT
TT=2.003

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m52-q1041.25-n50-p15-s99099953.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.6

? (TO)
TT=40002.5

No data? (TO)
TT=40000.5

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.6

? (TO)
TT=40000.3

? (TO)
TT=5000.06

? (TO)
TT=20398.3

? (TO)
TT=5000.12

No data? (TO)
TT=5000.13

? (TO)
TT=5000.1

? (TO)
TT=40001

? (TO)
TT=5000.09

? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.46

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.17

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf
SAT
TT=0.199

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40001.7

? (TO)
TT=40002

No data? (TO)
TT=40000.7

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.9

? (TO)
TT=40000.1

? (TO)
TT=5000

? (TO)
TT=20398.9

? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

? (TO)
TT=5000.11

SAT
TT=0.199

? (TO)
TT=5000.13

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.11

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No dataSAT
TT=2.743

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m52-q918.75-n50-p15-s98191766.cnf
SAT
TT=0.322

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40001.2

? (TO)
TT=40001.7

No data? (TO)
TT=40000.9

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.7

SAT
TT=13618

SAT
TT=2163.19

? (TO)
TT=20399

? (TO)
TT=5000.14

No data? (TO)
TT=5000.11

? (TO)
TT=5000.15

SAT
TT=0.322

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.02

No dataNo data? (TO)
TT=5000.07

SAT
TT=295.72

? (TO)
TT=5000.06

SAT
TT=2206.65

No dataSAT
TT=3.234

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/anton/SRHD-SGI/
srhd-sgi-m52-q918.75-n50-p30-s52376212.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

? (TO)
TT=40001.9

? (TO)
TT=40001.8

No data? (TO)
TT=40000.5

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.8

? (TO)
TT=40000.8

? (TO)
TT=5000.05

? (TO)
TT=20398

? (TO)
TT=5000.15

No data? (TO)
TT=5000.1

? (TO)
TT=5000.14

? (TO)
TT=40000.7

? (TO)
TT=5000.15

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.97

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.11

No data? (TO)
TT=5000.21

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf
SAT
TT=0.466

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=40001.7

? (TO)
TT=40001.8

No data? (TO)
TT=40001

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.6

? (TO)
TT=40000.7

? (TO)
TT=5000.09

? (TO)
TT=20395.4

? (TO)
TT=5000.09

No data? (TO)
TT=5000.12

? (TO)
TT=5000.09

SAT
TT=0.466

? (TO)
TT=5000.09

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.55

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.04

No dataSAT
TT=6.969

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m62-q1327.5-n60-p30-s52708253.cnf
SAT
TT=0.521

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=35652.9

? (TO)
TT=40002

No data? (TO)
TT=40001

? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40001.1

? (TO)
TT=40000.2

? (TO)
TT=5000.04

? (TO)
TT=20397.1

? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

? (TO)
TT=5000.07

SAT
TT=0.521

? (TO)
TT=5000.1

? (TO)
TT=5000.17

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.06

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.13

? (TO)
TT=5000.08

No dataSAT
TT=7.092

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m62-q1504.5-n60-p15-s80450670.cnf
SAT
TT=0.366

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40001.6

? (TO)
TT=40002.1

No data? (TO)
TT=40000.8

? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001.1

? (TO)
TT=40000.3

? (TO)
TT=5000.03

? (TO)
TT=20397.9

? (TO)
TT=5000.17

No data? (TO)
TT=5000.08

? (TO)
TT=5000.08

SAT
TT=0.366

? (TO)
TT=5000.1

? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.48

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.03

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No dataSAT
TT=5.647

No data
crafted/anton/SRHD-SGI/
srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf
SAT
TT=0.465

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=35776.9

? (TO)
TT=40002.1

No data? (TO)
TT=40000.7

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=40000.8

? (TO)
TT=40000.3

? (TO)
TT=5000.08

? (TO)
TT=20395.6

? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

? (TO)
TT=5000.09

SAT
TT=0.465

? (TO)
TT=5000.1

? (TO)
TT=5000.17

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.9

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.11

No dataSAT
TT=5.564

No data
CRAFTED/
edgematching/
all/em_8_4_5_all.cnf
SAT
TT=1.524

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8.596

SAT
TT=4.921

SAT
TT=6.211

No dataSAT
TT=18.604

SAT
TT=4.873

No dataNo dataNo dataSAT
TT=20.717

No dataSAT
TT=1.772

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.707

No dataNo dataSAT
TT=17.952

No dataSAT
TT=59.821

SAT
TT=17.828

SAT
TT=7.571

SAT
TT=3.927

SAT
TT=5.421

No dataSAT
TT=7.76

SAT
TT=31.209

SAT
TT=14.459

SAT
TT=4.789

SAT
TT=1.524

No dataNo dataNo dataNo dataNo dataSAT
TT=47.099

No dataNo dataSAT
TT=6.61

SAT
TT=27.82

SAT
TT=20.475

SAT
TT=7.382

No dataSAT
TT=21.909

No data
CRAFTED/edgematching/
compact/
em_11_3_4_cmp.cnf
SAT
TT=333.04

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=40000.8

? (TO)
TT=40001.1

No data? (TO)
TT=40000.7

? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=333.04

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.6

? (TO)
TT=35843.4

? (TO)
TT=5000.03

? (TO)
TT=20386.9

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.09

? (TO)
TT=40001.3

? (TO)
TT=5000.06

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.64

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=4999.69

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No data? (TO)
TT=5000.13

No data
CRAFTED/edgematching/
compact/
em_12_2_4_cmp.cnf
SAT
TT=61.284

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=40001.6

? (TO)
TT=40001.8

No data? (TO)
TT=40001.5

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=61.284

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40001.1

? (TO)
TT=40000

? (TO)
TT=5000.06

? (TO)
TT=20370.3

? (TO)
TT=5000.13

No data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=40001.4

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.14

No dataNo data? (TO)
TT=5000

? (TO)
TT=4999.64

? (TO)
TT=5000.03

? (TO)
TT=5000.1

No data? (TO)
TT=5000.13

No data
CRAFTED/edgematching/
compact/
em_7_3_6_cmp.cnf
SAT
TT=9.85

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=213.748

SAT
TT=1720.91

SAT
TT=2487.2

No dataSAT
TT=1943.78

? (TO)
TT=5000.11

No dataNo dataNo dataSAT
TT=190.931

No dataSAT
TT=930.75

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=25.164

No dataNo dataSAT
TT=709.301

No dataSAT
TT=20723.4

SAT
TT=74.491

SAT
TT=358.466

SAT
TT=6374.27

? (TO)
TT=5000.09

No dataSAT
TT=1476.82

SAT
TT=300.397

SAT
TT=867.659

SAT
TT=3243.43

SAT
TT=2946.17

No dataNo dataNo dataNo dataNo dataSAT
TT=1450.3

No dataNo dataSAT
TT=160.949

SAT
TT=4549.69

SAT
TT=401.165

SAT
TT=9.85

No data? (TO)
TT=5000.16

No data
CRAFTED/edgematching/
fbcolors/
em_8_4_5_fbc.cnf
SAT
TT=25.431

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1022.96

SAT
TT=10798.4

SAT
TT=6478.97

No data? (TO)
TT=40000.5

? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=5000.02

No dataSAT
TT=3019.53

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=25.431

No dataNo dataSAT
TT=2333.91

No data? (TO)
TT=40000.5

SAT
TT=13591.7

? (TO)
TT=5000.02

? (TO)
TT=20399.7

? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

SAT
TT=1939.05

? (TO)
TT=40001.4

SAT
TT=1791.18

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataSAT
TT=2554.86

No dataNo data? (TO)
TT=5000.06

SAT
TT=886.46

SAT
TT=239.767

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-3-5_527.cnf
SAT
TT=0.16

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.244

SAT
TT=180.323

SAT
TT=222.751

No dataSAT
TT=35.55

SAT
TT=32.816

No dataNo dataNo dataSAT
TT=223.555

No dataSAT
TT=671.631

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=54.01

No dataNo dataSAT
TT=278.253

No dataSAT
TT=96.56

SAT
TT=0.689

SAT
TT=1.089

SAT
TT=174.037

SAT
TT=4.569

No dataSAT
TT=233.99

SAT
TT=41.425

SAT
TT=734.979

SAT
TT=20.348

SAT
TT=137.048

No dataNo dataNo dataNo dataNo dataSAT
TT=48.775

No dataNo dataSAT
TT=1.219

SAT
TT=25.24

SAT
TT=0.16

SAT
TT=0.433

No dataSAT
TT=1277.54

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-3-5_528.cnf
UNSAT
TT=157.252

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=157.252

UNSAT
TT=793.712

UNSAT
TT=648.148

No dataUNSAT
TT=1104.22

UNSAT
TT=303.089

No dataNo dataNo dataUNSAT
TT=517.955

No dataUNSAT
TT=1849.34

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=977.581

No dataUNSAT
TT=15551.9

UNSAT
TT=1594.35

UNSAT
TT=590.99

? (TO)
TT=20400.3

UNSAT
TT=301.784

No dataUNSAT
TT=552.725

UNSAT
TT=369.057

UNSAT
TT=5082.44

UNSAT
TT=204.934

UNSAT
TT=172.925

No dataNo dataNo dataNo dataNo dataUNSAT
TT=228.981

No dataNo data? (TO)
TT=5000.04

UNSAT
TT=4258.81

? (TO)
TT=5000.05

? (TO)
TT=5000.09

No dataUNSAT
TT=1399.59

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-3-6_2071.cnf
SAT
TT=17.01

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=32039.6

? (TO)
TT=40000.6

No data? (TO)
TT=40000.7

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40000.8

SAT
TT=326.11

SAT
TT=249.277

? (TO)
TT=20399

? (TO)
TT=5000.11

No data? (TO)
TT=5000.07

? (TO)
TT=5000.11

? (TO)
TT=40000.6

? (TO)
TT=5000.09

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.2

No dataNo data? (TO)
TT=5000.09

SAT
TT=389.64

SAT
TT=17.01

SAT
TT=253.098

No data? (TO)
TT=5000.13

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-3-6_2072.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40000.6

? (TO)
TT=40001.2

No data? (TO)
TT=40000.6

? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40000.3

? (TO)
TT=40000.5

? (TO)
TT=5000.05

? (TO)
TT=20399.8

? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

? (TO)
TT=5000.11

? (TO)
TT=40000.6

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.26

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-4-4_511.cnf
SAT
TT=1.278

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

SAT
TT=17652.9

? (TO)
TT=40000.9

No data? (TO)
TT=40000.9

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.278

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40000.7

SAT
TT=3.469

SAT
TT=4.155

? (TO)
TT=20400.4

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

? (TO)
TT=5000.17

? (TO)
TT=40001.1

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.9

No dataNo dataSAT
TT=4995.77

SAT
TT=27.54

SAT
TT=2.971

SAT
TT=7.144

No data? (TO)
TT=5000.12

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-4-4_512.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=35663.4

? (TO)
TT=40000.8

No data? (TO)
TT=40000.4

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40001

? (TO)
TT=40000.6

? (TO)
TT=5000

? (TO)
TT=20400.3

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

? (TO)
TT=5000.17

? (TO)
TT=40000.5

? (TO)
TT=5000.06

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.49

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.03

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No data? (TO)
TT=5000.08

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-4-5_4231.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=35768.2

? (TO)
TT=40000.9

No data? (TO)
TT=40000.8

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.14

No data? (TO)
TT=40000.9

? (TO)
TT=40000.2

? (TO)
TT=5000.04

? (TO)
TT=20399.2

? (TO)
TT=5000.17

No data? (TO)
TT=5000.05

? (TO)
TT=5000.17

? (TO)
TT=40000.9

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.35

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.04

No data? (TO)
TT=5000.16

No data
crafted/kullmann/
GreenTao/GreenTaok1k2/
GreenTao_2-4-5_4232.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=40000.6

? (TO)
TT=40001.2

No data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.6

? (TO)
TT=40000.6

? (TO)
TT=5000.04

? (TO)
TT=20398.4

? (TO)
TT=5000.18

No data? (TO)
TT=5000.08

? (TO)
TT=5000.14

? (TO)
TT=40001

? (TO)
TT=5000.04

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.46

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.01

? (TO)
TT=5000.08

? (TO)
TT=5000.1

No data? (TO)
TT=5000.12

No data
crafted/kullmann/GreenTao/
GreenTaok1k2/
GreenTao_2-5-5_34308.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=35648.4

? (TO)
TT=40002.4

No data? (TO)
TT=40000.6

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.23

No data? (TO)
TT=40000.8

? (TO)
TT=40000.5

? (TO)
TT=5000.06

? (TO)
TT=20396.1

? (TO)
TT=5000.19

No data? (TO)
TT=5000.08

? (TO)
TT=5000.13

? (TO)
TT=40000.4

? (TO)
TT=5000.17

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.08

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.02

? (TO)
TT=5000.09

? (TO)
TT=5000.05

No data? (TO)
TT=5000.18

No data
crafted/kullmann/GreenTao/
GreenTaok1k2/
GreenTao_2-5-5_34309.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40002

? (TO)
TT=40002.1

No data? (TO)
TT=40001

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.25

No data? (TO)
TT=40000.6

? (TO)
TT=40000.5

? (TO)
TT=5000.09

? (TO)
TT=20396.5

? (TO)
TT=5000.14

No data? (TO)
TT=5000.09

? (TO)
TT=5000.12

? (TO)
TT=40001.1

? (TO)
TT=5000.14

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.56

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.11

No data? (TO)
TT=5000.19

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-12_135.cnf
UNSAT
TT=39.165

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=39.165

UNSAT
TT=94.895

UNSAT
TT=99.541

No dataUNSAT
TT=2657.34

UNSAT
TT=358.699

No dataNo dataNo dataUNSAT
TT=75.765

No dataUNSAT
TT=328.246

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=184.03

No dataNo dataUNSAT
TT=325.046

No dataUNSAT
TT=2186.03

UNSAT
TT=287.555

UNSAT
TT=147.18

UNSAT
TT=6840.86

UNSAT
TT=323.38

No dataUNSAT
TT=303.686

UNSAT
TT=164.597

UNSAT
TT=1123.68

UNSAT
TT=51.095

UNSAT
TT=43.386

No dataNo dataNo dataNo dataNo dataUNSAT
TT=158.685

No dataNo dataUNSAT
TT=1328.95

UNSAT
TT=202.44

? (TO)
TT=5000.12

? (TO)
TT=5000.03

No dataUNSAT
TT=442.285

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-13_160.cnf
UNSAT
TT=364.876

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=364.876

UNSAT
TT=1046.62

UNSAT
TT=1032.97

No data? (TO)
TT=40000.7

? (TO)
TT=5000.1

No dataNo dataNo dataUNSAT
TT=1112.25

No dataUNSAT
TT=4184.61

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1590.79

No dataNo dataUNSAT
TT=4260

No dataUNSAT
TT=28102

UNSAT
TT=2314.8

UNSAT
TT=1483.8

? (TO)
TT=20399.8

? (TO)
TT=5000.05

No dataUNSAT
TT=1959.06

UNSAT
TT=2755.23

UNSAT
TT=23717.1

UNSAT
TT=521.214

UNSAT
TT=376.407

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1375.09

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.02

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No data? (TO)
TT=5000.14

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-14_186.cnf
UNSAT
TT=3212.64

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3232.69

UNSAT
TT=8805.54

UNSAT
TT=8751.04

No data? (TO)
TT=40000.9

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.2

UNSAT
TT=19362.7

? (TO)
TT=5000.03

? (TO)
TT=20399.7

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=40000.5

? (TO)
TT=5000.07

UNSAT
TT=3212.64

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.67

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.02

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.13

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-15_218.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=40000.6

? (TO)
TT=40000.9

No data? (TO)
TT=40000.6

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40000.3

? (TO)
TT=40000.1

? (TO)
TT=5000.08

? (TO)
TT=20400.5

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

? (TO)
TT=5000.13

? (TO)
TT=40001.1

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.82

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-16_238.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40000.7

? (TO)
TT=40000.9

No data? (TO)
TT=40000.2

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001

? (TO)
TT=40000.4

? (TO)
TT=5000.02

? (TO)
TT=20399.3

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

? (TO)
TT=5000.12

? (TO)
TT=40000.5

? (TO)
TT=5000.03

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.52

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.04

? (TO)
TT=5000.03

? (TO)
TT=5000.02

No data? (TO)
TT=5000.12

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-17_279.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=40000.3

? (TO)
TT=40000.8

No data? (TO)
TT=40001

? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.4

? (TO)
TT=40000.7

? (TO)
TT=5000.01

? (TO)
TT=20399.9

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

? (TO)
TT=5000.11

? (TO)
TT=40000.9

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.32

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.02

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No data? (TO)
TT=5000.12

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-18_312.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

? (TO)
TT=40000.2

? (TO)
TT=40000.4

No data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.8

? (TO)
TT=40000.2

? (TO)
TT=5000.09

? (TO)
TT=20400

? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

? (TO)
TT=5000.14

? (TO)
TT=40000.7

? (TO)
TT=5000.11

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.64

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-19_349.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40000.7

? (TO)
TT=40000.9

No data? (TO)
TT=40000.9

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40000.5

? (TO)
TT=40000.5

? (TO)
TT=5000.01

? (TO)
TT=20400

? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

? (TO)
TT=5000.14

? (TO)
TT=40001

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.18

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.12

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-20_388.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

? (TO)
TT=40001.1

? (TO)
TT=40000.7

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.6

? (TO)
TT=40000.5

? (TO)
TT=5000.09

? (TO)
TT=20399.8

? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

? (TO)
TT=5000.19

? (TO)
TT=40000.8

? (TO)
TT=5000.04

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.87

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden3k/
VanDerWaerden_2-3-20_389.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=35694

? (TO)
TT=40001.1

No data? (TO)
TT=40000.9

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.6

? (TO)
TT=40000.2

? (TO)
TT=5000

? (TO)
TT=20400.1

? (TO)
TT=5000.12

No data? (TO)
TT=5000.07

? (TO)
TT=5000.14

? (TO)
TT=40000.4

? (TO)
TT=5000.1

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.85

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-19_348.cnf
UNSAT
TT=59.791

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=59.791

UNSAT
TT=122.878

UNSAT
TT=137.575

No dataUNSAT
TT=2420.18

UNSAT
TT=471.459

No dataNo dataNo dataUNSAT
TT=60.835

No dataUNSAT
TT=396.468

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=473.019

No dataNo dataUNSAT
TT=228.863

No dataUNSAT
TT=1562.23

UNSAT
TT=565.674

UNSAT
TT=211.669

UNSAT
TT=4087.89

UNSAT
TT=444.893

No dataUNSAT
TT=203.681

UNSAT
TT=210.691

UNSAT
TT=349.853

UNSAT
TT=70.306

UNSAT
TT=69.901

No dataNo dataNo dataNo dataNo dataUNSAT
TT=682.322

No dataNo dataUNSAT
TT=845.077

UNSAT
TT=162.91

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No dataUNSAT
TT=332.453

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-20_381.cnf
UNSAT
TT=61.058

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=63.273

UNSAT
TT=134.039

UNSAT
TT=151.729

No dataUNSAT
TT=2289.96

UNSAT
TT=404.522

No dataNo dataNo dataUNSAT
TT=61.058

No dataUNSAT
TT=342.169

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=542.092

No dataNo dataUNSAT
TT=174.545

No dataUNSAT
TT=859.634

UNSAT
TT=650.605

UNSAT
TT=272.174

UNSAT
TT=3652.18

UNSAT
TT=387.397

No dataUNSAT
TT=165.049

UNSAT
TT=217.192

UNSAT
TT=359.232

UNSAT
TT=78.616

UNSAT
TT=74.792

No dataNo dataNo dataNo dataNo dataUNSAT
TT=935.814

No dataNo dataUNSAT
TT=1384.82

UNSAT
TT=162.38

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataUNSAT
TT=268.574

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-20_390.cnf
UNSAT
TT=178.147

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=178.147

UNSAT
TT=367.034

UNSAT
TT=382.706

No dataUNSAT
TT=13278.1

UNSAT
TT=2147.95

No dataNo dataNo dataUNSAT
TT=203.23

No dataUNSAT
TT=1394.83

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1528

No dataNo dataUNSAT
TT=857.948

No dataUNSAT
TT=4926.14

UNSAT
TT=1745

UNSAT
TT=642.705

UNSAT
TT=18544.3

UNSAT
TT=1873.81

No dataUNSAT
TT=1131.35

UNSAT
TT=1068.25

UNSAT
TT=1297.47

UNSAT
TT=238.199

UNSAT
TT=188.068

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1928.18

No dataNo data? (TO)
TT=5000

UNSAT
TT=4219.04

? (TO)
TT=5000.08

? (TO)
TT=5000.02

No dataUNSAT
TT=1328.26

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-21_399.cnf
SAT
TT=8.191

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=125.082

SAT
TT=261.625

SAT
TT=210.503

No dataSAT
TT=244.047

SAT
TT=370.149

No dataNo dataNo dataSAT
TT=171.741

No dataSAT
TT=1113.29

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=63.022

No dataNo dataSAT
TT=21.855

No dataSAT
TT=330.97

SAT
TT=198.093

SAT
TT=264.324

SAT
TT=999.394

SAT
TT=605.163

No dataSAT
TT=137.426

SAT
TT=461.866

SAT
TT=1018.43

SAT
TT=29.229

SAT
TT=8.191

No dataNo dataNo dataNo dataNo dataSAT
TT=1767.43

No dataNo dataSAT
TT=1208.35

SAT
TT=38.42

SAT
TT=107.621

SAT
TT=53.214

No dataSAT
TT=248.176

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-21_401.cnf
UNSAT
TT=181.446

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=182.7

UNSAT
TT=439.245

UNSAT
TT=433.326

No dataUNSAT
TT=11617.6

UNSAT
TT=1716.81

No dataNo dataNo dataUNSAT
TT=181.446

No dataUNSAT
TT=1267.71

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1545.24

No dataNo dataUNSAT
TT=903.037

No dataUNSAT
TT=2332.46

UNSAT
TT=1734.34

UNSAT
TT=641.361

UNSAT
TT=17671.6

UNSAT
TT=1625.71

No dataUNSAT
TT=564.688

UNSAT
TT=764.229

UNSAT
TT=1095.99

UNSAT
TT=236.451

UNSAT
TT=194.484

No dataNo dataNo dataNo dataNo dataUNSAT
TT=2309.13

No dataNo dataUNSAT
TT=3112.94

UNSAT
TT=3838.44

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No dataUNSAT
TT=1205.01

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-21_404.cnf
SAT
TT=32.864

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=32.864

SAT
TT=50.226

SAT
TT=50.262

No dataSAT
TT=1277.27

SAT
TT=1234.43

No dataNo dataNo dataSAT
TT=363.328

No dataSAT
TT=656.855

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2969.2

No dataNo dataSAT
TT=169.279

No dataSAT
TT=354.079

SAT
TT=306.438

SAT
TT=130.24

SAT
TT=6627.22

SAT
TT=36.79

No dataSAT
TT=315.535

SAT
TT=155.401

SAT
TT=3335.3

SAT
TT=668.302

SAT
TT=618.746

No dataNo dataNo dataNo dataNo dataSAT
TT=4448.42

No dataNo dataSAT
TT=564.568

SAT
TT=50.83

SAT
TT=193.193

SAT
TT=216.357

No dataSAT
TT=1452.71

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-21_406.cnf
UNSAT
TT=698.091

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=718.06

UNSAT
TT=1751.79

UNSAT
TT=1892.75

No data? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=1129.41

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=27990.6

UNSAT
TT=7544.05

UNSAT
TT=2737.97

? (TO)
TT=20400.3

? (TO)
TT=5000.08

No dataUNSAT
TT=4652.24

UNSAT
TT=2553.57

UNSAT
TT=8545.55

UNSAT
TT=944.347

UNSAT
TT=698.091

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.47

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_443.cnf
SAT
TT=0.439

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=388.098

SAT
TT=814.965

SAT
TT=1491.41

No dataSAT
TT=5931.71

SAT
TT=2129.71

No dataNo dataNo dataSAT
TT=899.892

No dataSAT
TT=357.761

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1865.67

No dataNo dataSAT
TT=94.454

No dataSAT
TT=414.891

SAT
TT=599.598

SAT
TT=36.48

SAT
TT=2355.43

? (TO)
TT=5000.07

No dataSAT
TT=241.729

SAT
TT=1002.5

SAT
TT=6379.25

SAT
TT=422.684

SAT
TT=625.726

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.76

No dataNo dataSAT
TT=0.439

SAT
TT=309.64

SAT
TT=250.881

SAT
TT=47.876

No data? (TO)
TT=5000.12

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_445.cnf
UNSAT
TT=893.472

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=937.639

UNSAT
TT=2117.73

UNSAT
TT=2424.63

No data? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo dataNo dataUNSAT
TT=1266.18

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4304.24

No dataNo data? (TO)
TT=5000.1

No dataUNSAT
TT=17364.7

UNSAT
TT=7752.51

UNSAT
TT=3205.55

? (TO)
TT=20399.7

? (TO)
TT=5000.05

No dataUNSAT
TT=3587.3

UNSAT
TT=4096.4

UNSAT
TT=19053.1

UNSAT
TT=1236.99

UNSAT
TT=893.472

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.67

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.01

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_462.cnf
SAT
TT=4.43

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2297.89

SAT
TT=4752.85

SAT
TT=3023.59

No dataSAT
TT=20464.8

? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=973.963

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3357.35

No dataNo dataSAT
TT=1923.99

No dataSAT
TT=738.485

SAT
TT=14.944

SAT
TT=4.43

SAT
TT=5350.57

? (TO)
TT=5000.14

No dataSAT
TT=2028.76

SAT
TT=2804.59

SAT
TT=32863.3

SAT
TT=1235.77

SAT
TT=212.748

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.9

No dataNo data? (TO)
TT=5000.08

SAT
TT=498.05

SAT
TT=1174.59

SAT
TT=793.393

No data? (TO)
TT=5000.1

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_464.cnf
UNSAT
TT=2654.41

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2654.41

UNSAT
TT=6110.18

UNSAT
TT=6745.57

No data? (TO)
TT=40000.7

? (TO)
TT=5000.04

No dataNo dataNo dataUNSAT
TT=4795.29

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.5

UNSAT
TT=24001.6

? (MO)
TT=7.005

? (TO)
TT=20399.9

? (TO)
TT=5000.12

No data? (TO)
TT=5000.1

? (TO)
TT=5000.11

UNSAT
TT=36681

UNSAT
TT=4106.19

UNSAT
TT=2664.72

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.01

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.01

? (TO)
TT=5000.1

? (TO)
TT=5000.04

No data? (TO)
TT=5000.14

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_505.cnf
SAT
TT=39.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1780.78

SAT
TT=83.819

SAT
TT=83.334

No data? (TO)
TT=40000.5

? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=731.741

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3489.18

No dataNo dataSAT
TT=399.364

No dataSAT
TT=16063.8

SAT
TT=3744.29

? (TO)
TT=5000.09

? (TO)
TT=20399.7

? (TO)
TT=5000.11

No dataSAT
TT=1618.98

SAT
TT=96.162

SAT
TT=12605.7

SAT
TT=3443.33

SAT
TT=886.246

No dataNo dataNo dataNo dataNo dataSAT
TT=1168.4

No dataNo data? (TO)
TT=5000.11

SAT
TT=39.02

SAT
TT=956.159

? (TO)
TT=5000.02

No data? (TO)
TT=5000.08

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_506.cnf
SAT
TT=77.506

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1600.36

SAT
TT=3980.97

SAT
TT=12973.1

No dataSAT
TT=7229.44

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataSAT
TT=3613.11

No dataSAT
TT=18018.9

SAT
TT=4928.27

SAT
TT=1208.22

? (TO)
TT=20399.6

? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=40001

SAT
TT=4170.77

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.33

No dataNo dataSAT
TT=446.848

SAT
TT=294.83

SAT
TT=360.386

SAT
TT=77.506

No data? (TO)
TT=5000.11

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_507.cnf
UNSAT
TT=2487.24

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2515.22

UNSAT
TT=6740.51

UNSAT
TT=7047.16

No data? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo dataNo dataUNSAT
TT=3812.57

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=37446.1

UNSAT
TT=26617.7

? (TO)
TT=5000.04

? (TO)
TT=20400

? (TO)
TT=5000.1

No data? (TO)
TT=5000.12

? (TO)
TT=5000.07

? (TO)
TT=40000.6

UNSAT
TT=3286.36

UNSAT
TT=2487.24

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.34

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_508.cnf
UNSAT
TT=29393.6

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

UNSAT
TT=31161.8

UNSAT
TT=29393.6

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.5

? (TO)
TT=40000.8

? (TO)
TT=5000.01

? (TO)
TT=20399.8

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=40000.8

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.33

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.1

? (TO)
TT=5000.02

No data? (TO)
TT=5000.14

No data
crafted/kullmann/VanDerWaerden/
VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-24_567.cnf
SAT
TT=13.808

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

SAT
TT=23287.4

SAT
TT=12167

No dataSAT
TT=19283.7

? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=717.677

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.808

No dataNo data? (TO)
TT=5000.13

No dataSAT
TT=9724.76

SAT
TT=9728.46

? (TO)
TT=5000.02

? (TO)
TT=20400.1

? (TO)
TT=5000.1

No dataSAT
TT=14.03

? (TO)
TT=5000.14

? (TO)
TT=40001

SAT
TT=66.81

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.01

No dataNo data? (TO)
TT=5000.04

SAT
TT=311.54

SAT
TT=2230.9

? (TO)
TT=5000.09

No data? (TO)
TT=5000.14

No data
crafted/manthey/
sudoku-single-hard/
sudoku_81x81_unknown.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=40002

? (TO)
TT=40002.2

No data? (TO)
TT=40000.5

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40001.1

? (TO)
TT=40000.3

? (TO)
TT=5000.07

? (TO)
TT=20397.4

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

? (TO)
TT=5000.12

? (TO)
TT=40000.4

? (TO)
TT=5000.11

? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.77

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.02

? (TO)
TT=5000.11

? (TO)
TT=5000.06

No data? (TO)
TT=5000.19

No data
CRAFTED/modcircuits/
mod3block_2vars_11gates_u2_autoenc.cnf
SAT
TT=1540.75

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40001.4

? (TO)
TT=40000.6

No data? (TO)
TT=40000.8

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.05

No dataSAT
TT=35725.1

? (TO)
TT=35801.6

? (TO)
TT=5000.07

? (TO)
TT=20398.8

? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

? (TO)
TT=5000.11

? (TO)
TT=40001.1

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.87

No dataNo data? (TO)
TT=5000.07

SAT
TT=1540.75

? (TO)
TT=5000.1

? (TO)
TT=5000.09

No data? (TO)
TT=5000.1

No data
CRAFTED/modcircuits/
mod4block_2vars_8gates_u2.cnf
UNSAT
TT=182.547

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2110.7

UNSAT
TT=4724.56

UNSAT
TT=5395.47

No dataUNSAT
TT=1190.33

UNSAT
TT=298.117

No dataNo dataNo dataUNSAT
TT=1046.51

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=4527.99

No dataUNSAT
TT=3953.65

UNSAT
TT=1519.14

UNSAT
TT=531.42

UNSAT
TT=15585.3

UNSAT
TT=182.547

No data? (TO)
TT=5000.06

UNSAT
TT=3132.45

UNSAT
TT=3090.75

? (TO)
TT=5000.06

UNSAT
TT=1783.65

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.98

No dataNo dataUNSAT
TT=473.033

UNSAT
TT=862.72

? (TO)
TT=5000.04

? (TO)
TT=5000.09

No dataUNSAT
TT=2525.72

No data
CRAFTED/modcircuits/
mod4block_3vars_7gates.cnf
UNSAT
TT=2027.29

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2279.44

UNSAT
TT=21960.3

UNSAT
TT=20320.8

No dataUNSAT
TT=28172.6

? (TO)
TT=5000.12

No dataNo dataNo dataUNSAT
TT=3061.89

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.3

UNSAT
TT=37058

? (TO)
TT=5000.07

? (TO)
TT=20400.1

? (TO)
TT=5000.07

No dataUNSAT
TT=4234.42

? (TO)
TT=5000.15

UNSAT
TT=12413.2

UNSAT
TT=4086.97

UNSAT
TT=2027.29

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.69

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.03

? (TO)
TT=5000.1

? (TO)
TT=5000.07

No data? (TO)
TT=5000.14

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/mosoi/
289/
289-sat-11x10.cnf
SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.088

Signal
TT=0.146

SAT
TT=0.113

No dataSAT
TT=0.68

SAT
TT=0.067

No dataNo dataNo dataSAT
TT=23.616

No dataSAT
TT=0.503

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.237

No dataNo dataSAT
TT=0.011

No dataSAT
TT=0.044

SAT
TT=0.252

SAT
TT=0.161

SAT
TT=4.736

SAT
TT=0.111

No dataSAT
TT=0.063

SAT
TT=0.019

SAT
TT=0.179

SAT
TT=0.091

SAT
TT=0.109

No dataNo dataNo dataNo dataNo dataSAT
TT=0.216

No dataNo dataSAT
TT=0.087

SAT
TT=3.269

SAT
TT=0.077

SAT
TT=0.081

No dataSAT
TT=1.399

No data
crafted/mosoi/
289/
289-sat-11x4.cnf
SAT
TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

SAT
TT=0.011

SAT
TT=0.012

No dataSAT
TT=0.38

SAT
TT=0.009

No dataNo dataNo dataSAT
TT=0.01

No dataSAT
TT=0.152

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.025

No dataNo dataSAT
TT=0.001

No dataSAT
TT=0.055

SAT
TT=0.027

SAT
TT=0.011

SAT
TT=9.165

SAT
TT=0.037

No dataSAT
TT=0.009

SAT
TT=0.004

SAT
TT=0.092

SAT
TT=0.008

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataSAT
TT=0.017

No dataNo dataSAT
TT=0.015

SAT
TT=2.772

SAT
TT=0.007

SAT
TT=0.006

No dataSAT
TT=0.191

No data
crafted/mosoi/
289/
289-sat-11x9.cnf
SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.064

Signal
TT=0.105

SAT
TT=0.09

No dataSAT
TT=0.863

SAT
TT=0.05

No dataNo dataNo dataSAT
TT=0.166

No dataSAT
TT=0.506

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.183

No dataNo dataSAT
TT=0.009

No dataSAT
TT=0.045

SAT
TT=0.199

SAT
TT=0.055

SAT
TT=3.528

SAT
TT=0.093

No dataSAT
TT=0.042

SAT
TT=0.016

SAT
TT=0.062

SAT
TT=0.059

SAT
TT=0.078

No dataNo dataNo dataNo dataNo dataSAT
TT=0.181

No dataNo dataSAT
TT=0.071

SAT
TT=3.16

SAT
TT=0.057

SAT
TT=0.055

No dataSAT
TT=1.089

No data
crafted/mosoi/
289/
289-sat-12x14.cnf
SAT
TT=0.027

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.317

SAT
TT=0.489

SAT
TT=0.49

No dataSAT
TT=2.133

SAT
TT=0.208

No dataNo dataNo dataSAT
TT=0.527

No dataSAT
TT=0.568

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.196

No dataNo dataSAT
TT=0.027

No dataSAT
TT=3.376

SAT
TT=1.708

SAT
TT=0.69

SAT
TT=6.241

SAT
TT=0.242

No dataSAT
TT=0.205

SAT
TT=0.054

SAT
TT=0.173

SAT
TT=0.402

SAT
TT=0.401

No dataNo dataNo dataNo dataNo dataSAT
TT=0.638

No dataNo dataSAT
TT=0.242

SAT
TT=4.721

SAT
TT=0.257

SAT
TT=0.252

No dataSAT
TT=4.374

No data
crafted/mosoi/
289/
289-sat-12x15.cnf
SAT
TT=0.074

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.376

Signal
TT=0.673

SAT
TT=0.562

No dataSAT
TT=2.335

SAT
TT=0.241

No dataNo dataNo dataSAT
TT=0.372

No dataSAT
TT=0.579

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.19

No dataNo dataSAT
TT=0.085

No dataSAT
TT=2.833

SAT
TT=0.692

SAT
TT=0.585

SAT
TT=10.494

SAT
TT=0.294

No dataSAT
TT=0.219

SAT
TT=0.074

SAT
TT=0.186

SAT
TT=0.365

SAT
TT=0.505

No dataNo dataNo dataNo dataNo dataSAT
TT=0.788

No dataNo dataSAT
TT=0.28

SAT
TT=5.141

SAT
TT=0.314

SAT
TT=0.314

No dataSAT
TT=7.331

No data
crafted/mosoi/
289/
289-sat-14x8.cnf
SAT
TT=0.013

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.097

SAT
TT=0.132

SAT
TT=0.131

No dataSAT
TT=0.722

SAT
TT=0.065

No dataNo dataNo dataSAT
TT=4684.53

No dataSAT
TT=0.521

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.246

No dataNo dataSAT
TT=0.013

No dataSAT
TT=0.081

SAT
TT=0.275

SAT
TT=0.098

SAT
TT=4.813

SAT
TT=0.103

No dataSAT
TT=0.06

SAT
TT=0.02

SAT
TT=0.131

SAT
TT=0.09

SAT
TT=0.123

No dataNo dataNo dataNo dataNo dataSAT
TT=0.204

No dataNo dataSAT
TT=0.085

SAT
TT=3.295

SAT
TT=0.087

SAT
TT=0.077

No dataSAT
TT=1.463

No data
crafted/mosoi/
289/
289-sat-4x35.cnf
SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.135

SAT
TT=0.173

SAT
TT=0.184

No dataSAT
TT=1.242

SAT
TT=0.097

No dataNo dataNo dataSAT
TT=0.104

No dataSAT
TT=0.274

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.093

No dataNo dataSAT
TT=0.008

No dataSAT
TT=0.069

SAT
TT=0.36

SAT
TT=0.126

SAT
TT=7.173

SAT
TT=0.18

No dataSAT
TT=0.083

SAT
TT=0.026

SAT
TT=0.305

SAT
TT=0.122

SAT
TT=0.172

No dataNo dataNo dataNo dataNo dataSAT
TT=0.173

No dataNo dataSAT
TT=0.125

SAT
TT=3.577

SAT
TT=0.115

SAT
TT=0.11

No dataSAT
TT=3.571

No data
crafted/mosoi/
289/
289-sat-4x8.cnf
SAT
TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.005

SAT
TT=0.009

SAT
TT=0.008

No dataSAT
TT=0.2

SAT
TT=0.005

No dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=0.125

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.012

No dataNo dataSAT
TT=0.001

No dataSAT
TT=0.032

SAT
TT=0.01

SAT
TT=0.007

SAT
TT=6.832

SAT
TT=0.034

No dataSAT
TT=0.004

SAT
TT=0.003

SAT
TT=0.138

SAT
TT=0.004

SAT
TT=0.004

No dataNo dataNo dataNo dataNo dataSAT
TT=0.01

No dataNo dataSAT
TT=0.011

SAT
TT=2.735

SAT
TT=0.003

SAT
TT=0.003

No dataSAT
TT=0.121

No data
crafted/mosoi/
289/
289-sat-5x8.cnf
SAT
TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

SAT
TT=0.01

SAT
TT=0.013

No dataSAT
TT=0.388

SAT
TT=0.008

No dataNo dataNo dataSAT
TT=0.011

No dataSAT
TT=0.203

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.023

No dataNo dataSAT
TT=0.002

No dataSAT
TT=0.066

SAT
TT=0.031

SAT
TT=0.009

SAT
TT=9.864

SAT
TT=0.042

No dataSAT
TT=0.006

SAT
TT=0.004

SAT
TT=0.069

SAT
TT=0.007

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataSAT
TT=0.017

No dataNo dataSAT
TT=0.013

SAT
TT=2.939

SAT
TT=0.005

SAT
TT=0.005

No dataSAT
TT=0.167

No data
crafted/mosoi/
289/
289-sat-6x19.cnf
SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.086

Signal
TT=0.142

Signal
TT=0.154

No dataSAT
TT=0.88

SAT
TT=0.067

No dataNo dataNo dataSAT
TT=0.196

No dataSAT
TT=0.485

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.243

No dataNo dataSAT
TT=0.011

No dataSAT
TT=0.075

SAT
TT=0.191

SAT
TT=0.064

SAT
TT=6.045

SAT
TT=0.179

No dataSAT
TT=0.057

SAT
TT=0.019

SAT
TT=0.053

SAT
TT=0.089

SAT
TT=0.128

No dataNo dataNo dataNo dataNo dataSAT
TT=0.167

No dataNo dataSAT
TT=0.085

SAT
TT=3.296

SAT
TT=0.077

SAT
TT=0.075

No dataSAT
TT=1.783

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/mosoi/
289/
289-sat-6x20.cnf
SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.107

SAT
TT=0.138

SAT
TT=0.165

No dataSAT
TT=0.875

SAT
TT=0.081

No dataNo dataNo dataSAT
TT=0.247

No dataSAT
TT=0.481

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.277

No dataNo dataSAT
TT=0.011

No dataSAT
TT=0.706

SAT
TT=0.248

SAT
TT=0.109

SAT
TT=5.802

SAT
TT=0.2

No dataSAT
TT=0.08

SAT
TT=0.022

SAT
TT=0.053

SAT
TT=0.122

SAT
TT=0.134

No dataNo dataNo dataNo dataNo dataSAT
TT=0.194

No dataNo dataSAT
TT=0.101

SAT
TT=3.385

SAT
TT=0.089

SAT
TT=0.087

No dataSAT
TT=1.995

No data
crafted/mosoi/
289/
289-sat-6x8.cnf
SAT
TT=0.005

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.01

SAT
TT=0.016

SAT
TT=0.017

No dataSAT
TT=0.194

SAT
TT=0.011

No dataNo dataNo dataSAT
TT=0.022

No dataSAT
TT=0.232

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.032

No dataNo dataSAT
TT=0.005

No dataSAT
TT=0.072

SAT
TT=0.046

SAT
TT=0.013

SAT
TT=5.835

SAT
TT=0.048

No dataSAT
TT=0.009

SAT
TT=0.005

SAT
TT=0.058

SAT
TT=0.011

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataSAT
TT=0.026

No dataNo dataSAT
TT=0.019

SAT
TT=3.035

SAT
TT=0.008

SAT
TT=0.008

No dataSAT
TT=0.251

No data
crafted/mosoi/
289/
289-sat-6x9.cnf
SAT
TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.013

SAT
TT=0.018

Signal
TT=0.027

No dataSAT
TT=0.312

SAT
TT=0.013

No dataNo dataNo dataSAT
TT=0.035

No dataSAT
TT=0.269

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.042

No dataNo dataSAT
TT=0.003

No dataSAT
TT=0.056

SAT
TT=0.062

SAT
TT=0.017

SAT
TT=6.63

SAT
TT=0.053

No dataSAT
TT=0.011

SAT
TT=0.005

SAT
TT=0.137

SAT
TT=0.013

SAT
TT=0.015

No dataNo dataNo dataNo dataNo dataSAT
TT=0.035

No dataNo dataSAT
TT=0.022

SAT
TT=2.803

SAT
TT=0.011

SAT
TT=0.01

No dataSAT
TT=0.291

No data
crafted/mosoi/
289/
289-sat-7x6.cnf
SAT
TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.009

SAT
TT=0.011

SAT
TT=0.01

No dataSAT
TT=0.285

SAT
TT=0.008

No dataNo dataNo dataSAT
TT=0.011

No dataSAT
TT=0.157

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.023

No dataNo dataSAT
TT=0.002

No dataSAT
TT=0.075

SAT
TT=0.035

SAT
TT=0.01

SAT
TT=10.818

SAT
TT=0.04

No dataSAT
TT=0.008

SAT
TT=0.004

SAT
TT=0.07

SAT
TT=0.008

SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataSAT
TT=0.021

No dataNo dataSAT
TT=0.017

SAT
TT=2.829

SAT
TT=0.007

SAT
TT=0.005

No dataSAT
TT=0.169

No data
crafted/mosoi/
289/
289-sat-9x13.cnf
SAT
TT=0.013

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.101

SAT
TT=0.146

SAT
TT=0.123

No dataSAT
TT=0.867

SAT
TT=0.074

No dataNo dataNo dataSAT
TT=0.246

No dataSAT
TT=0.418

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.279

No dataNo dataSAT
TT=0.013

No dataSAT
TT=0.662

SAT
TT=0.518

SAT
TT=0.151

SAT
TT=4.157

SAT
TT=0.137

No dataSAT
TT=0.065

SAT
TT=0.021

SAT
TT=0.208

SAT
TT=0.092

SAT
TT=0.127

No dataNo dataNo dataNo dataNo dataSAT
TT=0.238

No dataNo dataSAT
TT=0.095

SAT
TT=3.378

SAT
TT=0.09

SAT
TT=0.087

No dataSAT
TT=2.026

No data
crafted/mosoi/
289/
289-unsat-13x32.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=40001

? (TO)
TT=40001

No data? (TO)
TT=40000.7

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.5

? (TO)
TT=40000.3

? (TO)
TT=5000.08

? (TO)
TT=20397.4

? (TO)
TT=5000.14

No data? (TO)
TT=5000.08

? (TO)
TT=5000.23

? (TO)
TT=40001.3

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.79

No dataNo data? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.11

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

No data
crafted/mosoi/
289/
289-unsat-14x34.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

? (TO)
TT=31115.8

? (TO)
TT=40001.2

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.5

? (TO)
TT=40000.6

? (TO)
TT=5000.1

? (TO)
TT=20395.5

? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

? (TO)
TT=5000.26

? (TO)
TT=40000.7

? (TO)
TT=5000.05

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.06

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=5000.07

No data? (TO)
TT=5000.13

No data
crafted/mosoi/
289/
289-unsat-14x38.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.3

? (TO)
TT=40001.8

No data? (TO)
TT=40000.6

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001

? (TO)
TT=40000.1

? (TO)
TT=5000.08

? (TO)
TT=20395.5

? (TO)
TT=5000.11

No data? (TO)
TT=5000.07

? (TO)
TT=5000.23

? (TO)
TT=40000.8

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.22

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No data? (TO)
TT=5000.14

No data
crafted/mosoi/
289/
289-unsat-17x27.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=35742.2

? (TO)
TT=40001.2

No data? (TO)
TT=40000.4

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.7

? (TO)
TT=40000.4

? (TO)
TT=5000.07

? (TO)
TT=20397.4

? (TO)
TT=5000.16

No data? (TO)
TT=5000.09

? (TO)
TT=5000.21

? (TO)
TT=40001.3

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.15

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No data
crafted/mosoi/
289/
289-unsat-17x30.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=35743.6

? (TO)
TT=40002

No data? (TO)
TT=40001.1

? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.8

? (TO)
TT=40000.4

? (TO)
TT=5000.06

? (TO)
TT=20394.7

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

? (TO)
TT=5000.23

? (TO)
TT=40001.2

? (TO)
TT=5000.12

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.18

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.03

? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/mosoi/
289/
289-unsat-21x14.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=35695.5

? (TO)
TT=40001.3

No data? (TO)
TT=40000.7

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.8

? (TO)
TT=40000.7

? (TO)
TT=5000.04

? (TO)
TT=20397.8

? (TO)
TT=5000.13

No data? (TO)
TT=5000.05

? (TO)
TT=5000.32

? (TO)
TT=40000.7

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.01

? (TO)
TT=5000.08

? (TO)
TT=5000.06

No data? (TO)
TT=5000.14

No data
crafted/mosoi/
289/
289-unsat-21x33.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40001.9

? (TO)
TT=40001.8

No data? (TO)
TT=40000.8

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40001.1

? (TO)
TT=40000.8

? (TO)
TT=4999.96

? (TO)
TT=20388.9

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

? (TO)
TT=5000.15

? (TO)
TT=40001

? (TO)
TT=5000.07

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.62

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

No data
crafted/mosoi/
289/
289-unsat-21x39.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=35563.4

? (TO)
TT=40002.4

No data? (TO)
TT=40001.2

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.18

No data? (TO)
TT=40001.1

? (TO)
TT=40000.6

? (TO)
TT=5000.02

? (TO)
TT=20391.3

? (TO)
TT=5000.15

No data? (TO)
TT=5000.13

? (TO)
TT=5000.19

? (TO)
TT=40000.8

? (TO)
TT=5000.09

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.12

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

No data
crafted/mosoi/
289/
289-unsat-21x40.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=36386.8

? (TO)
TT=40002.3

No data? (TO)
TT=40001.2

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.15

No data? (TO)
TT=40001

? (TO)
TT=40000.5

? (TO)
TT=5000

? (TO)
TT=20391.7

? (TO)
TT=5000.16

No data? (TO)
TT=5000.08

? (TO)
TT=5000.25

? (TO)
TT=40000.6

? (TO)
TT=5000.11

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.7

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No data
crafted/mosoi/
289/
289-unsat-5x41.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40000.7

? (TO)
TT=40001.2

No data? (TO)
TT=40000.9

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40001.3

? (TO)
TT=40000.1

? (TO)
TT=5000.05

? (TO)
TT=20390.8

? (TO)
TT=5000.14

No data? (TO)
TT=5000.13

? (TO)
TT=5000.34

? (TO)
TT=40000.7

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.27

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=5000.11

? (TO)
TT=5000.02

No data? (TO)
TT=5000.14

No data
crafted/mosoi/
289/
289-unsat-6x30.cnf
SAT
TT=0.212

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

SAT
TT=1.324

Signal
TT=1.341

No dataSAT
TT=2.343

SAT
TT=12.234

No dataNo dataNo dataSAT
TT=0.595

No dataSAT
TT=0.886

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataSAT
TT=1130.75

No dataSAT
TT=28.693

SAT
TT=2.31

SAT
TT=0.656

SAT
TT=6.444

SAT
TT=48.376

No dataSAT
TT=14.966

SAT
TT=0.212

SAT
TT=120.932

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.57

No dataNo dataSAT
TT=0.268

SAT
TT=17.77

SAT
TT=0.276

SAT
TT=0.269

No data? (TO)
TT=5000.09

No data
crafted/mosoi/
289/
289-unsat-6x34.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=35689.5

? (TO)
TT=40000.7

No data? (TO)
TT=40000.8

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.9

? (TO)
TT=40000.1

? (TO)
TT=5000.07

? (TO)
TT=20399.4

? (TO)
TT=5000.12

No data? (TO)
TT=5000.12

? (TO)
TT=5000.31

? (TO)
TT=40000.9

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.38

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

No data
crafted/mosoi/
289/
289-unsat-6x40.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=34314.5

? (TO)
TT=40000.6

No data? (TO)
TT=40000.9

? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.13

No data? (TO)
TT=40000.8

? (TO)
TT=40000.7

? (TO)
TT=5000.03

? (TO)
TT=20394.8

? (TO)
TT=5000.13

No data? (TO)
TT=5000.12

? (TO)
TT=5000.29

? (TO)
TT=40000.4

? (TO)
TT=5000.03

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.36

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.02

? (TO)
TT=5000.1

? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No data
crafted/mosoi/
289/
289-unsat-7x39.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=35762.4

? (TO)
TT=40000.5

No data? (TO)
TT=40001

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40001.2

? (TO)
TT=40000.1

? (TO)
TT=5000.04

? (TO)
TT=20399.2

? (TO)
TT=5000.11

No data? (TO)
TT=5000.07

? (TO)
TT=5000.33

? (TO)
TT=40000.4

? (TO)
TT=5000.03

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.71

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.01

? (TO)
TT=5000.04

? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No data
crafted/mosoi/
289/
289-unsat-9x32.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=26792.3

? (TO)
TT=40001.1

No data? (TO)
TT=40000.7

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=40000.7

? (TO)
TT=40000.7

? (TO)
TT=5000.07

? (TO)
TT=20398.9

? (TO)
TT=5000.14

No data? (TO)
TT=5000.1

? (TO)
TT=5000.24

? (TO)
TT=40001

? (TO)
TT=5000.03

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.82

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
CRAFTED/parity-games/
instance_n8_i8_pp_ci_ce.cnf
SAT
TT=40.402

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=40.402

SAT
TT=261.814

SAT
TT=791.926

No dataSAT
TT=286.493

SAT
TT=438.071

No dataNo dataNo dataSAT
TT=199.806

No dataSAT
TT=446.556

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=127.27

No dataNo dataSAT
TT=82.12

No dataSAT
TT=289.993

SAT
TT=100.628

? (MO)
TT=100.08

SAT
TT=4099.55

SAT
TT=81.449

No dataSAT
TT=109.601

SAT
TT=120.751

SAT
TT=160.048

? (TO)
TT=5000.04

SAT
TT=1563

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.74

No dataNo data? (TO)
TT=5000.09

SAT
TT=83.33

? (TO)
TT=5000.06

? (TO)
TT=5000.02

No data? (TO)
TT=5000.13

No data
CRAFTED/parity-games/
instance_n9_i9_pp.cnf
SAT
TT=279.049

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=279.049

SAT
TT=1357.74

SAT
TT=2447.87

No dataSAT
TT=20267.2

? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=1416.94

No dataSAT
TT=1848.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=794.048

No dataNo dataSAT
TT=801.18

No dataSAT
TT=410.728

SAT
TT=440.08

? (TO)
TT=5000.06

SAT
TT=7001.74

? (TO)
TT=5000.08

No dataSAT
TT=382.613

SAT
TT=999.398

SAT
TT=729.747

SAT
TT=624.883

SAT
TT=1291.71

No dataNo dataNo dataNo dataNo dataSAT
TT=1349.58

No dataNo dataSAT
TT=668.836

SAT
TT=858.33

? (TO)
TT=5000.13

? (TO)
TT=5000.05

No data? (TO)
TT=5000.16

No data
CRAFTED/
ramseycube/
Q3inK10.cnf
SAT
TT=0.115

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=12.023

SAT
TT=12.199

SAT
TT=12.217

No dataSAT
TT=204.89

SAT
TT=9.261

No dataNo dataNo dataSAT
TT=0.25

No dataSAT
TT=0.406

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.506

No dataNo dataSAT
TT=0.115

No dataSAT
TT=4.759

SAT
TT=22.84

SAT
TT=27.07

SAT
TT=849.946

SAT
TT=12.752

No dataSAT
TT=9.018

SAT
TT=44.951

SAT
TT=0.183

SAT
TT=33.992

SAT
TT=18.911

No dataNo dataNo dataNo dataNo dataSAT
TT=17.725

No dataNo dataSAT
TT=0.387

SAT
TT=185.02

SAT
TT=634.29

SAT
TT=619.341

No dataSAT
TT=41.414

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v1560c133795gyes1.cnf
SAT
TT=3144.24

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40001

? (TO)
TT=40001.4

No data? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.6

? (TO)
TT=40000.2

SAT
TT=3144.24

? (TO)
TT=20399.4

? (TO)
TT=5000.14

No data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=40000.8

? (TO)
TT=5000.05

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.59

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.04

SAT
TT=4711.28

? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v2100c215164gyes4.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40000.9

? (TO)
TT=40001.3

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.6

? (TO)
TT=40000.1

? (TO)
TT=5000.01

? (TO)
TT=20398.8

? (TO)
TT=5000.11

No data? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=40001.1

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.21

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v2400c266431gyes2.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.7

? (TO)
TT=40001.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.9

? (TO)
TT=40000.2

? (TO)
TT=5000.03

? (TO)
TT=20399.3

? (TO)
TT=5000.13

No data? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=40001.2

? (TO)
TT=5000.13

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.52

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.01

No data? (TO)
TT=5000.11

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v2400c266431gyes3.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.7

? (TO)
TT=40001.2

No data? (TO)
TT=40000.6

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.7

? (TO)
TT=40000.7

? (TO)
TT=5000.03

? (TO)
TT=20397.2

? (TO)
TT=5000.15

No data? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=40000.6

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.82

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v2640c305320gyes10.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=35923

? (TO)
TT=40001.2

No data? (TO)
TT=40001.1

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.5

? (TO)
TT=40000.8

? (TO)
TT=4999.77

? (TO)
TT=20399.1

? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=40001

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.35

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No data? (TO)
TT=5000.18

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v2640c305320gyes3.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40001.7

? (TO)
TT=40002.1

No data? (TO)
TT=40001

? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=40000.4

? (TO)
TT=40000.4

? (TO)
TT=5000.01

? (TO)
TT=20398.2

? (TO)
TT=5000.13

No data? (TO)
TT=5000.13

? (TO)
TT=5000.1

? (TO)
TT=40000.8

? (TO)
TT=5000.1

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.37

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.01

? (TO)
TT=5000.05

? (TO)
TT=5000.03

No data? (TO)
TT=5000.1

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v760c43649gyes5.cnf
SAT
TT=1.58

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

SAT
TT=21599

SAT
TT=3841.46

No data? (TO)
TT=40000.4

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=334.057

No dataNo dataSAT
TT=4949.07

No data? (TO)
TT=40001.1

SAT
TT=1.58

SAT
TT=8.818

? (TO)
TT=20399.6

? (TO)
TT=5000.14

No data? (TO)
TT=5000.04

SAT
TT=461.74

? (TO)
TT=40000.5

? (TO)
TT=5000.02

SAT
TT=2024.3

No dataNo dataNo dataNo dataNo dataSAT
TT=2449.67

No dataNo data? (TO)
TT=5000.08

SAT
TT=30.03

SAT
TT=14.75

SAT
TT=24.543

No data? (TO)
TT=5000.11

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
CRAFTED/rbsat/crafted/
forced/
rbsat-v760c43649gyes6.cnf
SAT
TT=0.875

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=431.243

SAT
TT=12465.3

SAT
TT=10341.7

No data? (TO)
TT=40000.4

? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=1228.44

No dataSAT
TT=434.103

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataSAT
TT=1830.62

No dataSAT
TT=7715.12

SAT
TT=11.56

SAT
TT=33.249

? (TO)
TT=20400

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

? (TO)
TT=5000.09

SAT
TT=5204.04

? (TO)
TT=5000.03

SAT
TT=1930.72

No dataNo dataNo dataNo dataNo dataSAT
TT=2409.78

No dataNo dataSAT
TT=324.063

SAT
TT=27.695

SAT
TT=0.875

SAT
TT=5.013

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v760c43649gyes8.cnf
SAT
TT=30.53

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3317.91

SAT
TT=31422.9

SAT
TT=18693.2

No data? (TO)
TT=40000.7

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=831.581

No dataNo dataSAT
TT=1711.48

No data? (TO)
TT=40000.9

SAT
TT=333.975

SAT
TT=105.27

? (TO)
TT=20400

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.07

SAT
TT=23542.7

? (TO)
TT=5000.03

SAT
TT=2670.77

No dataNo dataNo dataNo dataNo dataSAT
TT=2870.92

No dataNo data? (TO)
TT=5000.1

SAT
TT=30.53

SAT
TT=100.348

SAT
TT=153.943

No dataSAT
TT=44.762

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v945c61409gyes10.cnf
SAT
TT=2.386

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=40000.7

? (TO)
TT=40001.3

No data? (TO)
TT=40000.3

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40000.9

SAT
TT=3.406

SAT
TT=23.91

? (TO)
TT=20399.8

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

SAT
TT=4397.19

? (TO)
TT=40000.6

SAT
TT=3564.04

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.68

No dataNo data? (TO)
TT=5000.09

SAT
TT=33.63

SAT
TT=2.386

SAT
TT=7.514

No data? (TO)
TT=5000.14

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v945c61409gyes1.cnf
SAT
TT=10.76

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40000.5

SAT
TT=8851.35

No data? (TO)
TT=40000.6

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataSAT
TT=701.921

No data? (TO)
TT=40000.7

SAT
TT=82.94

SAT
TT=10.76

? (TO)
TT=20399.6

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=40000.3

? (TO)
TT=5000.05

SAT
TT=2214.5

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.62

No dataNo data? (TO)
TT=5000.09

SAT
TT=360.63

SAT
TT=20.346

SAT
TT=171.305

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/crafted/
forced/
rbsat-v945c61409gyes7.cnf
SAT
TT=21.61

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.1

SAT
TT=24965.5

No data? (TO)
TT=40000.7

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.8

SAT
TT=74.105

SAT
TT=21.61

? (TO)
TT=20400

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=40000.9

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.65

No dataNo data? (TO)
TT=5000.01

SAT
TT=300.93

SAT
TT=85.831

SAT
TT=85.75

No data? (TO)
TT=5000.16

No data
CRAFTED/rbsat/crafted/
unforced/
rbsat-v1820c171155g5.cnf
SAT
TT=1716.97

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40001.3

? (TO)
TT=40001.1

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40000.7

SAT
TT=3700.85

? (TO)
TT=5000.04

? (TO)
TT=20399.2

? (TO)
TT=5000.13

No data? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=40000.8

? (TO)
TT=5000.08

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.74

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.06

? (TO)
TT=5000.1

SAT
TT=1716.97

No data? (TO)
TT=5000.13

No data
CRAFTED/rbsat/crafted/
unforced/
rbsat-v2400c266431g6.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40001.1

? (TO)
TT=40001.2

No data? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40001

? (TO)
TT=40000.5

? (TO)
TT=5000

? (TO)
TT=20398.3

? (TO)
TT=5000.14

No data? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=40001.2

? (TO)
TT=5000.13

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.5

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/crafted/
unforced/
rbsat-v2400c266431g9.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=40001.7

? (TO)
TT=40001.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40000.6

? (TO)
TT=40000.4

? (TO)
TT=5000.06

? (TO)
TT=20398.1

? (TO)
TT=5000.07

No data? (TO)
TT=5000.11

? (TO)
TT=5000.07

? (TO)
TT=40000.8

? (TO)
TT=5000.1

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.45

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.07

No data? (TO)
TT=5000.14

No data
CRAFTED/rbsat/crafted/
unforced/
rbsat-v760c43649g2.cnf
UNSAT
TT=4697.32

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

UNSAT
TT=14256

UNSAT
TT=14108

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.3

UNSAT
TT=10029.6

? (TO)
TT=5000.07

? (TO)
TT=20399.8

? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=40000.8

? (TO)
TT=5000.1

UNSAT
TT=4697.32

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.07

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.03

? (TO)
TT=5000.02

No data? (TO)
TT=5000.08

No data
CRAFTED/rbsat/crafted/
unforced/
rbsat-v760c43649g7.cnf
SAT
TT=11.693

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

SAT
TT=29084.9

SAT
TT=37188.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=2605.9

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataSAT
TT=364.822

No data? (TO)
TT=40001

SAT
TT=13.17

SAT
TT=56.451

? (TO)
TT=20400

? (TO)
TT=5000.08

No dataSAT
TT=1432.31

? (TO)
TT=5000.09

? (TO)
TT=40000.8

? (TO)
TT=5000.02

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.07

No dataNo data? (TO)
TT=5000.06

SAT
TT=368.91

SAT
TT=11.693

SAT
TT=602.64

No data? (TO)
TT=5000.12

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
CRAFTED/rbsat/crafted/
unforced/
rbsat-v760c43649g9.cnf
SAT
TT=1.116

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4657.27

SAT
TT=3257.82

SAT
TT=6239.37

No dataSAT
TT=33213.1

SAT
TT=916.186

No dataNo dataNo dataSAT
TT=1027.94

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2776.25

No dataNo dataSAT
TT=2491.05

No data? (TO)
TT=40000.9

SAT
TT=1.671

SAT
TT=9.47

? (TO)
TT=20399.7

? (TO)
TT=5000.07

No data? (TO)
TT=5000.11

? (TO)
TT=5000.05

? (TO)
TT=40000.4

? (TO)
TT=5000.06

SAT
TT=2901.41

No dataNo dataNo dataNo dataNo dataSAT
TT=4670.06

No dataNo data? (TO)
TT=5000.06

SAT
TT=29.25

SAT
TT=1.318

SAT
TT=1.116

No data? (TO)
TT=5000.09

No data
CRAFTED/rbsat/crafted/
unforced/
rbsat-v945c61409g3.cnf
SAT
TT=0.62

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

SAT
TT=19301.6

SAT
TT=20708.2

No data? (TO)
TT=40000.9

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.5

SAT
TT=26.18

SAT
TT=68.16

? (TO)
TT=20399.5

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

? (TO)
TT=5000.12

SAT
TT=14202.9

? (TO)
TT=5000.11

SAT
TT=1099.2

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.67

No dataNo data? (TO)
TT=5000.01

SAT
TT=34.42

SAT
TT=0.62

SAT
TT=29.445

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/random/
forced/
rbsat-v1150c84314gyes1.cnf
SAT
TT=114.827

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2534.88

? (TO)
TT=35835.9

? (TO)
TT=40001

No data? (TO)
TT=40000.4

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.9

SAT
TT=400.073

SAT
TT=424.518

? (TO)
TT=20399.5

? (TO)
TT=5000.06

No data? (TO)
TT=5000.13

? (TO)
TT=5000.07

SAT
TT=12295.8

? (TO)
TT=5000.03

SAT
TT=4021.13

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.98

No dataNo data? (TO)
TT=5000.03

SAT
TT=394.33

SAT
TT=114.827

SAT
TT=661.231

No data? (TO)
TT=5000.11

No data
CRAFTED/rbsat/random/
forced/
rbsat-v1375c111739gyes10.cnf
SAT
TT=8.505

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

SAT
TT=26828.1

? (TO)
TT=40000.5

No data? (TO)
TT=40000.3

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.5

SAT
TT=524.598

SAT
TT=423.623

? (TO)
TT=20398.7

? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

? (TO)
TT=5000.12

? (TO)
TT=40001.1

? (TO)
TT=5000.04

SAT
TT=4276.94

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.06

SAT
TT=8.505

SAT
TT=172.438

No data? (TO)
TT=5000.11

No data
CRAFTED/rbsat/random/
forced/
rbsat-v1820c171155gyes3.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40002.4

? (TO)
TT=40001.1

No data? (TO)
TT=40001

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.6

? (TO)
TT=40000.1

? (TO)
TT=5002.23

? (TO)
TT=20399.5

? (TO)
TT=5000.07

No data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=40000.8

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.14

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No data? (TO)
TT=5000.13

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2100c215164gyes2.cnf
SAT
TT=775.246

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=35842

? (TO)
TT=40001.2

No data? (TO)
TT=40000.3

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=5000.07

? (TO)
TT=20398.6

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=40000.4

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.09

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.04

SAT
TT=775.246

? (TO)
TT=5000.06

No data? (TO)
TT=5000.15

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2100c215164gyes7.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=40001

? (TO)
TT=40001.5

No data? (TO)
TT=40000.8

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.9

? (TO)
TT=40000.3

? (TO)
TT=5000.06

? (TO)
TT=20399

? (TO)
TT=5000.11

No data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=40001

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No data? (TO)
TT=5000.14

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2400c266431gyes1.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=40001.7

? (TO)
TT=40001.3

No data? (TO)
TT=40001.1

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.7

? (TO)
TT=40000.2

? (TO)
TT=5000.04

? (TO)
TT=20398.8

? (TO)
TT=5000.1

No data? (TO)
TT=5000.12

? (TO)
TT=5000.14

? (TO)
TT=40000.8

? (TO)
TT=5000.12

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.54

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=4999.98

? (TO)
TT=5000.11

? (TO)
TT=5000.02

No data? (TO)
TT=5000.16

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2400c266431gyes6.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=40001.5

? (TO)
TT=40001.2

No data? (TO)
TT=40000.8

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001.1

? (TO)
TT=40000.5

? (TO)
TT=5000.07

? (TO)
TT=20398.3

? (TO)
TT=5000.12

No data? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=40000.9

? (TO)
TT=5000.09

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.27

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=4999.37

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No data? (TO)
TT=5000.14

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2400c266431gyes7.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

? (TO)
TT=40001.3

? (TO)
TT=40001.8

No data? (TO)
TT=40000.5

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40001

? (TO)
TT=40000.4

? (TO)
TT=5000.02

? (TO)
TT=20398.7

? (TO)
TT=5000.1

No data? (TO)
TT=5000.14

? (TO)
TT=5000.12

? (TO)
TT=40000.6

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.3

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
CRAFTED/rbsat/random/
forced/
rbsat-v2640c305320gyes10.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40001.7

? (TO)
TT=40001.4

No data? (TO)
TT=40001

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=40000.6

? (TO)
TT=40000.5

? (TO)
TT=4999.99

? (TO)
TT=20397.8

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

? (TO)
TT=5000.15

? (TO)
TT=40000.6

? (TO)
TT=5000.08

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.19

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.11

? (TO)
TT=5000.06

No data? (TO)
TT=5000.21

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2640c305320gyes2.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=35841.3

? (TO)
TT=40001.1

No data? (TO)
TT=40000.8

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.8

? (TO)
TT=40000.5

? (TO)
TT=5000.04

? (TO)
TT=20399.2

? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=40000.7

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.19

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No data? (TO)
TT=5000.11

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2640c305320gyes3.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40001.2

? (TO)
TT=40001.2

No data? (TO)
TT=40001.1

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001.1

? (TO)
TT=40000.7

? (TO)
TT=5000.08

? (TO)
TT=20398.2

? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=40000.9

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.24

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No data
CRAFTED/rbsat/random/
forced/
rbsat-v2640c305320gyes5.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=40001.4

? (TO)
TT=40001.6

No data? (TO)
TT=40000.3

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40001.1

? (TO)
TT=40000.4

? (TO)
TT=4999.96

? (TO)
TT=20399.2

? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

? (TO)
TT=5000.12

? (TO)
TT=40000.8

? (TO)
TT=5000.1

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.23

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=4999.9

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.14

No data
CRAFTED/rbsat/random/
forced/
rbsat-v945c61409gyes5.cnf
SAT
TT=4.19

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=940.841

SAT
TT=2853.92

SAT
TT=2474.02

No dataSAT
TT=11122.4

SAT
TT=3480.36

No dataNo dataNo dataSAT
TT=1651.44

No dataSAT
TT=244.941

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1186.47

No dataNo dataSAT
TT=1891.72

No dataSAT
TT=1451.61

SAT
TT=4.19

SAT
TT=67.172

SAT
TT=16190.7

SAT
TT=2541.68

No data? (TO)
TT=5000.08

SAT
TT=3330.18

SAT
TT=22954.6

? (TO)
TT=5000.03

SAT
TT=1424.66

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.58

No dataNo dataSAT
TT=1008.32

SAT
TT=374.12

SAT
TT=4.915

SAT
TT=132.408

No data? (TO)
TT=5000.09

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v1150c84314g1.cnf
SAT
TT=5.17

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

SAT
TT=15860.9

SAT
TT=6929.1

No dataSAT
TT=10556.3

? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=4229.08

No dataSAT
TT=3061.67

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4041

No dataNo dataSAT
TT=4302.87

No dataSAT
TT=20624.7

SAT
TT=1031.68

SAT
TT=5.17

SAT
TT=11990.9

? (TO)
TT=5000.11

No dataSAT
TT=3215.09

? (TO)
TT=5000.04

? (TO)
TT=40000.8

SAT
TT=2226.39

SAT
TT=2944.06

No dataNo dataNo dataNo dataNo dataSAT
TT=1493.47

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.06

SAT
TT=18.489

SAT
TT=135.935

No data? (TO)
TT=5000.09

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v1150c84314g7.cnf
SAT
TT=318.765

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1554.62

? (TO)
TT=40000.6

? (TO)
TT=40000.9

No data? (TO)
TT=40001.1

? (TO)
TT=5000.11

No dataNo dataNo dataSAT
TT=1591.84

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.9

SAT
TT=16555.8

SAT
TT=765.115

? (TO)
TT=20399.7

? (TO)
TT=5000.13

No data? (TO)
TT=5000.06

? (TO)
TT=5000.05

? (TO)
TT=40000.9

? (TO)
TT=5000.04

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.08

No dataNo data? (TO)
TT=5000.01

SAT
TT=379.83

SAT
TT=318.765

? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v1375c111739g4.cnf
SAT
TT=76.685

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40000.8

? (TO)
TT=40000.8

No data? (TO)
TT=40000.4

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.9

SAT
TT=4169.9

? (TO)
TT=5000.1

? (TO)
TT=20399.8

? (TO)
TT=5000.12

No data? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=40001

? (TO)
TT=5000.05

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.37

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.05

SAT
TT=76.685

SAT
TT=408.404

No data? (TO)
TT=5000.17

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v1375c111739g6.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

? (TO)
TT=40000.7

? (TO)
TT=40000.8

No data? (TO)
TT=40001

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.6

? (TO)
TT=40000.3

? (TO)
TT=5000.02

? (TO)
TT=20399.4

? (TO)
TT=5000.13

No data? (TO)
TT=5000.1

? (TO)
TT=5000.12

? (TO)
TT=40000.9

? (TO)
TT=5000.04

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.12

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=4999.96

? (TO)
TT=5000.1

? (TO)
TT=5000.09

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v2100c215164g4.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40001.6

? (TO)
TT=40002

No data? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.9

? (TO)
TT=40000.6

? (TO)
TT=5000.05

? (TO)
TT=20399.1

? (TO)
TT=5000.12

No data? (TO)
TT=5000.13

? (TO)
TT=5000.11

? (TO)
TT=40000.7

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.13

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.08

? (TO)
TT=5000.11

? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
CRAFTED/rbsat/random/
unforced/
rbsat-v2100c215164g9.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40001.3

? (TO)
TT=40001.7

No data? (TO)
TT=40001.1

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.9

? (TO)
TT=40000.1

? (TO)
TT=5000.05

? (TO)
TT=20399.4

? (TO)
TT=5000.13

No data? (TO)
TT=5000.13

? (TO)
TT=5000.05

? (TO)
TT=40001.1

? (TO)
TT=5000.12

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.11

No data? (TO)
TT=5000.14

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v2400c266431g10.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40001.5

? (TO)
TT=40001.4

No data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40001.2

? (TO)
TT=40000.3

? (TO)
TT=5000.05

? (TO)
TT=20398.8

? (TO)
TT=5000.13

No data? (TO)
TT=5000.09

? (TO)
TT=5000.14

? (TO)
TT=40000.6

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.44

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.01

? (TO)
TT=5000.12

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v2400c266431g3.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40001.4

? (TO)
TT=40001.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.5

? (TO)
TT=40000.4

? (TO)
TT=5000.08

? (TO)
TT=20398.5

? (TO)
TT=5000.13

No data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=40000.9

? (TO)
TT=5000.13

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.26

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.02

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v760c43649g5.cnf
SAT
TT=1.137

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=42.45

SAT
TT=48.336

SAT
TT=124.782

No dataSAT
TT=15.659

SAT
TT=126.343

No dataNo dataNo dataSAT
TT=121.292

No dataSAT
TT=1267.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=70.031

No dataNo dataSAT
TT=372.515

No dataSAT
TT=32.038

SAT
TT=12.6

SAT
TT=1.137

SAT
TT=508.856

SAT
TT=88.729

No dataSAT
TT=39.628

SAT
TT=109.505

SAT
TT=530.355

SAT
TT=357.787

SAT
TT=80.474

No dataNo dataNo dataNo dataNo dataSAT
TT=1013.53

No dataNo dataSAT
TT=35.972

SAT
TT=28.71

SAT
TT=16.738

SAT
TT=24.49

No dataSAT
TT=18.681

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v760c43649g7.cnf
SAT
TT=0.326

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.449

SAT
TT=9.164

SAT
TT=172.5

No dataSAT
TT=120.548

SAT
TT=267.77

No dataNo dataNo dataSAT
TT=43.329

No dataSAT
TT=244.947

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=80.055

No dataNo dataSAT
TT=681.442

No dataSAT
TT=522.467

SAT
TT=37.94

SAT
TT=5.76

SAT
TT=559.497

SAT
TT=146.888

No dataSAT
TT=66.665

SAT
TT=622.438

SAT
TT=131.124

SAT
TT=483.06

SAT
TT=70.409

No dataNo dataNo dataNo dataNo dataSAT
TT=119.794

No dataNo dataSAT
TT=958.564

SAT
TT=28.542

SAT
TT=0.326

SAT
TT=157.58

No dataSAT
TT=644.94

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v945c61409g3.cnf
SAT
TT=105.289

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1663.89

? (TO)
TT=40000.7

SAT
TT=33498.7

No data? (TO)
TT=40000.4

? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=2273.21

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.6

SAT
TT=1523.09

SAT
TT=112.591

SAT
TT=17495.4

? (TO)
TT=5000.12

No data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=40000.7

? (TO)
TT=5000.03

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.77

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.04

SAT
TT=105.289

SAT
TT=810.011

No data? (TO)
TT=5000.11

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v945c61409g4.cnf
SAT
TT=13.382

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=687.246

SAT
TT=481.427

SAT
TT=5940.68

No dataSAT
TT=858.453

SAT
TT=2327.73

No dataNo dataNo dataSAT
TT=1017.34

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1726.86

No dataNo dataSAT
TT=3783.16

No dataSAT
TT=10323

SAT
TT=1035.36

SAT
TT=40.285

SAT
TT=7475.27

SAT
TT=2102.66

No data? (TO)
TT=5000.1

SAT
TT=3326.33

SAT
TT=424.393

? (TO)
TT=5000.1

SAT
TT=1598.65

No dataNo dataNo dataNo dataNo dataSAT
TT=3669.15

No dataNo dataSAT
TT=681.019

? (TO)
TT=5000.04

SAT
TT=13.382

SAT
TT=52.952

No dataSAT
TT=4695.88

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v945c61409g6.cnf
UNSAT
TT=3439.73

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3559.79

UNSAT
TT=11014.7

UNSAT
TT=11882.6

No data? (TO)
TT=40001

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3439.73

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40001.1

UNSAT
TT=18702.8

? (TO)
TT=5000.09

? (TO)
TT=20399.9

? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=40000.9

? (TO)
TT=5000.03

UNSAT
TT=4508

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.61

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.03

? (TO)
TT=5000.08

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

No data
CRAFTED/rbsat/random/
unforced/
rbsat-v945c61409g7.cnf
SAT
TT=4.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1447.02

SAT
TT=2370.71

SAT
TT=853.215

No dataSAT
TT=22439.3

SAT
TT=3517.37

No dataNo dataNo dataSAT
TT=1275.86

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1739.82

No dataNo dataSAT
TT=3750.88

No dataSAT
TT=2651.81

SAT
TT=13.491

SAT
TT=4.011

? (TO)
TT=20399.8

SAT
TT=3557.27

No data? (TO)
TT=5000.05

? (TO)
TT=5000.03

SAT
TT=7246.73

? (TO)
TT=5000.07

SAT
TT=1447.21

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.54

No dataNo data? (TO)
TT=5000.07

SAT
TT=34.93

SAT
TT=5.545

SAT
TT=25.708

No dataSAT
TT=803.379

No data
CRAFTED/sgi/
new-difficult-23-189-21-75.cnf
SAT
TT=0.141

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1115.16

SAT
TT=156.686

SAT
TT=411.207

No dataSAT
TT=8274.01

SAT
TT=2953.37

No dataNo dataNo dataSAT
TT=3465.43

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.908

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001.2

SAT
TT=44.118

SAT
TT=3.058

SAT
TT=7061.16

SAT
TT=3189.45

No dataSAT
TT=2741.57

? (TO)
TT=5000.06

SAT
TT=0.141

? (TO)
TT=5000.07

SAT
TT=1170.95

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo data? (TO)
TT=5000.11

SAT
TT=296.84

SAT
TT=1.627

SAT
TT=14.288

No dataSAT
TT=0.183

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
CRAFTED/sgi/
satsgi-n26himBHm28-p0-q293.cnf
SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.034

SAT
TT=0.051

SAT
TT=0.047

No dataSAT
TT=1.207

SAT
TT=0.022

No dataNo dataNo dataSAT
TT=0.04

No dataSAT
TT=0.269

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.083

No dataNo dataSAT
TT=0.007

No dataSAT
TT=0.045

SAT
TT=0.06

SAT
TT=0.03

SAT
TT=2.76

SAT
TT=0.089

No dataSAT
TT=0.016

SAT
TT=0.02

SAT
TT=0.068

SAT
TT=0.142

SAT
TT=0.047

No dataNo dataNo dataNo dataNo dataSAT
TT=5.083

No dataNo dataSAT
TT=0.051

SAT
TT=3.643

SAT
TT=0.035

SAT
TT=0.034

No dataSAT
TT=5.401

No data
crafted/skvortsov/
automata-synchronization/
crn_11_100_s.cnf
SAT
TT=1.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=143.32

SAT
TT=6.663

SAT
TT=5.546

No dataSAT
TT=6.017

SAT
TT=1.011

No dataNo dataNo dataSAT
TT=2.484

No dataSAT
TT=17.524

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=354.082

No dataNo dataSAT
TT=151.767

No dataSAT
TT=7.255

SAT
TT=12.436

SAT
TT=3.505

SAT
TT=7.249

SAT
TT=1.323

No dataSAT
TT=243.815

SAT
TT=888.221

SAT
TT=11.617

? (TO)
TT=5000.03

SAT
TT=1716.33

No dataNo dataNo dataNo dataNo dataSAT
TT=408.404

No dataNo dataSAT
TT=12.019

SAT
TT=3.77

? (TO)
TT=5000.05

? (TO)
TT=5000.02

No dataSAT
TT=13.298

No data
crafted/skvortsov/
automata-synchronization/
crn_11_99_u.cnf
UNSAT
TT=1.246

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1087.73

UNSAT
TT=6.673

UNSAT
TT=6.653

No dataUNSAT
TT=6.305

UNSAT
TT=1.246

No dataNo dataNo dataUNSAT
TT=1.804

No dataUNSAT
TT=17.094

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=347.599

No dataNo dataUNSAT
TT=196.057

No dataUNSAT
TT=6.259

UNSAT
TT=9.46

UNSAT
TT=3.869

UNSAT
TT=9.319

UNSAT
TT=1.296

No dataUNSAT
TT=576.374

? (TO)
TT=5000.03

UNSAT
TT=3.224

? (TO)
TT=5000.05

UNSAT
TT=2346.87

No dataNo dataNo dataNo dataNo dataUNSAT
TT=65.577

No dataNo dataUNSAT
TT=17.812

UNSAT
TT=4.17

? (TO)
TT=5000.03

? (TO)
TT=5000.02

No dataUNSAT
TT=17.698

No data
crafted/skvortsov/
automata-synchronization/
crn_20_360_u.cnf
UNSAT
TT=173.685

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

? (TO)
TT=35655.2

? (TO)
TT=40000.4

No dataUNSAT
TT=875.639

UNSAT
TT=194.536

No dataNo dataNo dataUNSAT
TT=572.824

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=10723.2

UNSAT
TT=2306.64

? (TO)
TT=5000.04

? (exit code)
TT=13.489

UNSAT
TT=173.685

No data? (TO)
TT=5000.06

? (TO)
TT=5000.06

UNSAT
TT=9350.27

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.89

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No data? (TO)
TT=5000.16

No data
crafted/skvortsov/
automata-synchronization/
crn_20_361_s.cnf
SAT
TT=163.024

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40000.8

? (TO)
TT=40001.1

No dataSAT
TT=933.744

SAT
TT=181.579

No dataNo dataNo dataSAT
TT=720.309

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=7079.5

SAT
TT=2791.03

? (TO)
TT=5000.05

? (exit code)
TT=13.846

SAT
TT=163.024

No data? (TO)
TT=5000.12

? (TO)
TT=5000.05

SAT
TT=4579.54

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.87

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.05

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataSAT
TT=3533.64

No data
crafted/skvortsov/
automata-synchronization/
crn_40_1520_u.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=35707.3

? (TO)
TT=40001.3

No data? (TO)
TT=40001.1

? (TO)
TT=5000.15

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001.1

? (TO)
TT=40000.6

? (TO)
TT=5000.03

? (TO)
TT=20382.1

? (TO)
TT=5000.1

No data? (TO)
TT=5000.14

? (TO)
TT=5000.17

? (TO)
TT=40000.8

? (TO)
TT=5000.02

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.91

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.08

? (TO)
TT=5000.11

? (TO)
TT=5000.02

No data? (TO)
TT=5000.15

No data
crafted/skvortsov/
automata-synchronization/
crn_40_1521_s.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

? (TO)
TT=34711.1

? (TO)
TT=40001.6

No data? (TO)
TT=40001.2

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.8

? (TO)
TT=40000.5

? (TO)
TT=5000.06

? (TO)
TT=20382.9

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (TO)
TT=40000.8

? (TO)
TT=5000.03

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.89

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.11

? (TO)
TT=5000.03

No data? (TO)
TT=5000.19

No data
crafted/skvortsov/
automata-synchronization/
rnd_100_27_s.cnf
SAT
TT=2.089

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=15.927

SAT
TT=21.013

SAT
TT=46.081

No dataSAT
TT=19.98

SAT
TT=59.744

No dataNo dataNo dataSAT
TT=41.01

No dataSAT
TT=44.717

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.089

No dataNo dataSAT
TT=38.516

No dataSAT
TT=26.483

SAT
TT=66.771

SAT
TT=26

SAT
TT=117.119

SAT
TT=5.865

No dataSAT
TT=22.206

SAT
TT=22.556

SAT
TT=52.763

SAT
TT=39.002

SAT
TT=74.425

No dataNo dataNo dataNo dataNo dataSAT
TT=237.956

No dataNo dataSAT
TT=214.967

SAT
TT=39.84

? (TO)
TT=5000.11

? (TO)
TT=5000.08

No dataSAT
TT=27.635

No data
crafted/skvortsov/
automata-synchronization/
rnd_100_28_s.cnf
SAT
TT=5.46

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=34.523

SAT
TT=4.915

SAT
TT=21.749

No dataSAT
TT=19.709

SAT
TT=24.314

No dataNo dataNo dataSAT
TT=6.957

No dataSAT
TT=20.694

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=47.031

No dataNo dataSAT
TT=12.394

No dataSAT
TT=26.366

SAT
TT=31.052

SAT
TT=37.127

SAT
TT=205.975

SAT
TT=13.084

No dataSAT
TT=5.46

SAT
TT=8.216

SAT
TT=15.784

SAT
TT=12.808

SAT
TT=15.727

No dataNo dataNo dataNo dataNo dataSAT
TT=339.847

No dataNo dataSAT
TT=41.552

SAT
TT=5.85

? (TO)
TT=5000.08

? (TO)
TT=5000.04

No dataSAT
TT=50.463

No data
crafted/skvortsov/
automata-synchronization/
rnd_100_28_u.cnf
UNSAT
TT=120.858

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=150.824

UNSAT
TT=311.758

UNSAT
TT=240.155

No dataUNSAT
TT=297.753

UNSAT
TT=192.615

No dataNo dataNo dataUNSAT
TT=120.858

No dataUNSAT
TT=541.946

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=269.767

No dataNo dataUNSAT
TT=333.221

No dataUNSAT
TT=387.419

UNSAT
TT=1705.05

UNSAT
TT=561.393

UNSAT
TT=6060.27

UNSAT
TT=138.361

No dataUNSAT
TT=258.518

UNSAT
TT=268.664

UNSAT
TT=174.031

UNSAT
TT=208.137

UNSAT
TT=231.847

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo dataUNSAT
TT=486.489

? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.03

No dataUNSAT
TT=266.803

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/skvortsov/
automata-synchronization/
rnd_100_32_s.cnf
SAT
TT=13.821

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=17.499

SAT
TT=61.613

SAT
TT=216.597

No dataSAT
TT=76.683

SAT
TT=92.809

No dataNo dataNo dataSAT
TT=235.934

No dataSAT
TT=163.051

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=117.629

No dataNo dataSAT
TT=41.513

No dataSAT
TT=49.497

SAT
TT=265.353

SAT
TT=114.528

SAT
TT=4306.41

SAT
TT=13.821

No dataSAT
TT=77.508

SAT
TT=22.107

SAT
TT=79.955

SAT
TT=346.99

SAT
TT=28.051

No dataNo dataNo dataNo dataNo dataSAT
TT=816.441

No dataNo dataSAT
TT=54.475

SAT
TT=39.95

? (TO)
TT=5000.11

? (TO)
TT=5000.02

No dataSAT
TT=87.94

No data
crafted/skvortsov/
automata-synchronization/
rnd_150_29_u.cnf
UNSAT
TT=197.81

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=244.278

UNSAT
TT=673.802

UNSAT
TT=518.061

No dataUNSAT
TT=424.095

UNSAT
TT=276.83

No dataNo dataNo dataUNSAT
TT=197.81

No dataUNSAT
TT=1674.87

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=923.599

No dataNo dataUNSAT
TT=668.608

No dataUNSAT
TT=464.243

UNSAT
TT=3321.03

UNSAT
TT=1034.5

UNSAT
TT=11012

UNSAT
TT=222.643

No dataUNSAT
TT=503.674

UNSAT
TT=358.833

UNSAT
TT=270.154

UNSAT
TT=374.284

UNSAT
TT=319.88

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.56

No dataNo dataUNSAT
TT=359.937

? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataUNSAT
TT=602.377

No data
crafted/skvortsov/
automata-synchronization/
rnd_150_42_s.cnf
SAT
TT=8.274

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=118.801

SAT
TT=35.182

SAT
TT=43.511

No dataSAT
TT=91.421

SAT
TT=18.018

No dataNo dataNo dataSAT
TT=22.444

No dataSAT
TT=58.684

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=57.598

No dataNo dataSAT
TT=24.234

No dataSAT
TT=31.672

SAT
TT=52.026

SAT
TT=199.453

SAT
TT=131.077

SAT
TT=89.288

No dataSAT
TT=37.145

SAT
TT=69.075

SAT
TT=50.367

SAT
TT=8.274

SAT
TT=92.117

No dataNo dataNo dataNo dataNo dataSAT
TT=1845.37

No dataNo dataSAT
TT=41.325

SAT
TT=54.03

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No dataSAT
TT=81.691

No data
crafted/skvortsov/
battleship/
battleship-10-10-unsat.cnf
UNSAT
TT=0.923

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2.203

UNSAT
TT=2.726

UNSAT
TT=2.622

No dataUNSAT
TT=43.538

UNSAT
TT=13.829

No dataNo dataNo dataUNSAT
TT=3.197

No dataUNSAT
TT=3.749

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=5.255

No dataNo dataUNSAT
TT=1.213

No dataUNSAT
TT=50.181

UNSAT
TT=1

UNSAT
TT=8.423

UNSAT
TT=8.354

UNSAT
TT=7.747

No dataUNSAT
TT=1.216

UNSAT
TT=5.053

UNSAT
TT=8.718

UNSAT
TT=0.923

UNSAT
TT=1.904

No dataNo dataNo dataNo dataNo dataUNSAT
TT=8.02

No dataNo dataUNSAT
TT=173.423

UNSAT
TT=16.94

? (TO)
TT=5000.1

? (TO)
TT=5000.03

No dataUNSAT
TT=1.042

No data
crafted/skvortsov/battleship/
battleship-10-17-sat.cnf
SAT
TT=0.004

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=154.252

SAT
TT=42.761

SAT
TT=42.575

No dataSAT
TT=21.369

? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=4115.11

No dataSAT
TT=6.773

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=172.194

No dataNo dataSAT
TT=4.077

No dataSAT
TT=8.286

SAT
TT=4.348

SAT
TT=0.034

SAT
TT=111.82

SAT
TT=898.556

No dataSAT
TT=1.113

SAT
TT=0.007

SAT
TT=20.072

SAT
TT=1.979

SAT
TT=36.449

No dataNo dataNo dataNo dataNo dataSAT
TT=5.375

No dataNo dataSAT
TT=0.627

SAT
TT=29.32

SAT
TT=0.004

SAT
TT=0.017

No dataSAT
TT=1259

No data
crafted/skvortsov/battleship/
battleship-10-18-sat.cnf
SAT
TT=0.004

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.603

Signal
TT=0.043

SAT
TT=0.042

No dataSAT
TT=0.167

SAT
TT=280.155

No dataNo dataNo data? (TO)
TT=5000.02

No dataSAT
TT=0.29

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.013

No dataNo dataSAT
TT=0.005

No dataSAT
TT=0.347

SAT
TT=0.022

SAT
TT=0.008

SAT
TT=3.537

SAT
TT=43.292

No dataSAT
TT=0.163

SAT
TT=0.018

SAT
TT=1.021

SAT
TT=0.013

SAT
TT=77.089

No dataNo dataNo dataNo dataNo dataSAT
TT=5.057

No dataNo dataSAT
TT=0.013

SAT
TT=28.094

SAT
TT=0.005

SAT
TT=0.004

No dataSAT
TT=11.482

No data
crafted/skvortsov/battleship/
battleship-10-19-sat.cnf
SAT
TT=0.005

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=28.897

SAT
TT=0.006

SAT
TT=0.013

No dataSAT
TT=0.271

SAT
TT=8.644

No dataNo dataNo data? (TO)
TT=5000.06

No dataSAT
TT=0.308

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.014

No dataNo dataSAT
TT=0.011

No dataSAT
TT=0.3

SAT
TT=0.025

SAT
TT=0.008

SAT
TT=3.178

SAT
TT=10.806

No dataSAT
TT=0.006

SAT
TT=0.009

SAT
TT=0.115

SAT
TT=0.007

SAT
TT=39.468

No dataNo dataNo dataNo dataNo dataSAT
TT=0.039

No dataNo dataSAT
TT=0.01

SAT
TT=11.54

SAT
TT=0.005

SAT
TT=0.005

No dataSAT
TT=12.992

No data
crafted/skvortsov/
battleship/
battleship-11-11-unsat.cnf
UNSAT
TT=24.27

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=24.27

UNSAT
TT=51.076

UNSAT
TT=50.76

No dataUNSAT
TT=1002.77

UNSAT
TT=348.998

No dataNo dataNo dataUNSAT
TT=268.446

No dataUNSAT
TT=267.008

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=175.523

No dataNo dataUNSAT
TT=215.324

No dataUNSAT
TT=11526.6

UNSAT
TT=39.89

UNSAT
TT=71.286

? (TO)
TT=20400.1

UNSAT
TT=339.623

No dataUNSAT
TT=277.529

UNSAT
TT=143.564

UNSAT
TT=2080.57

UNSAT
TT=48.89

UNSAT
TT=32.129

No dataNo dataNo dataNo dataNo dataUNSAT
TT=162.785

No dataNo data? (TO)
TT=5000.03

UNSAT
TT=161.54

? (TO)
TT=5000.1

? (TO)
TT=5000.07

No dataUNSAT
TT=3442.97

No data
crafted/skvortsov/battleship/
battleship-11-21-sat.cnf
SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=156.533

SAT
TT=1.744

SAT
TT=1.755

No dataSAT
TT=11.976

SAT
TT=330.534

No dataNo dataNo data? (TO)
TT=5000.04

No dataSAT
TT=47.753

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=246.762

No dataNo dataSAT
TT=5.567

No dataSAT
TT=0.501

SAT
TT=0.026

SAT
TT=67.391

SAT
TT=3.094

SAT
TT=519.697

No dataSAT
TT=21.594

SAT
TT=0.031

SAT
TT=0.068

SAT
TT=5.986

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataSAT
TT=35.321

No dataNo dataSAT
TT=0.018

SAT
TT=23.933

SAT
TT=0.008

SAT
TT=0.009

No data? (TO)
TT=5000.04

No data
crafted/skvortsov/
battleship/
battleship-12-12-unsat.cnf
UNSAT
TT=33.025

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=64.792

UNSAT
TT=173.388

UNSAT
TT=146.197

No dataUNSAT
TT=1623.57

UNSAT
TT=247.608

No dataNo dataNo dataUNSAT
TT=131.186

No dataUNSAT
TT=909.484

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=747.86

No dataNo dataUNSAT
TT=437.947

No dataUNSAT
TT=826.035

UNSAT
TT=109.036

UNSAT
TT=333.458

UNSAT
TT=74.643

UNSAT
TT=714.054

No dataUNSAT
TT=854.252

UNSAT
TT=350.17

UNSAT
TT=3558.41

UNSAT
TT=120.622

UNSAT
TT=88.232

No dataNo dataNo dataNo dataNo dataUNSAT
TT=147.684

No dataNo data? (TO)
TT=5000.07

UNSAT
TT=126.23

? (TO)
TT=5000.1

? (TO)
TT=5000.06

No dataUNSAT
TT=33.025

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/skvortsov/battleship/
battleship-12-23-sat.cnf
SAT
TT=0.006

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=148.238

SAT
TT=0.015

SAT
TT=0.029

No dataSAT
TT=0.41

SAT
TT=602.944

No dataNo dataNo dataSAT
TT=150.414

No dataSAT
TT=0.413

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.023

No dataNo dataSAT
TT=0.035

No dataSAT
TT=0.359

SAT
TT=0.068

SAT
TT=0.013

SAT
TT=5.797

SAT
TT=770.013

No dataSAT
TT=0.062

SAT
TT=0.007

SAT
TT=0.035

SAT
TT=0.006

SAT
TT=358.815

No dataNo dataNo dataNo dataNo dataSAT
TT=5.012

No dataNo dataSAT
TT=0.017

SAT
TT=24.065

SAT
TT=0.008

SAT
TT=0.008

No data? (TO)
TT=5000.12

No data
crafted/skvortsov/
battleship/
battleship-13-13-unsat.cnf
UNSAT
TT=1579.25

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1579.25

UNSAT
TT=4795.45

UNSAT
TT=4334.48

No data? (TO)
TT=40000.3

? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.4

UNSAT
TT=3142.22

? (TO)
TT=5000.11

? (TO)
TT=20400.4

? (TO)
TT=5000.12

No data? (TO)
TT=5000.06

? (TO)
TT=5000.03

? (TO)
TT=40000.4

? (TO)
TT=5000.11

UNSAT
TT=2519.64

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.21

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No data
crafted/skvortsov/
battleship/
battleship-14-14-unsat.cnf
UNSAT
TT=13888.3

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

UNSAT
TT=14606.5

UNSAT
TT=15608

No data? (TO)
TT=40001.1

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40001

UNSAT
TT=13888.3

? (TO)
TT=5000.1

? (TO)
TT=20400.4

? (TO)
TT=5000.12

No data? (TO)
TT=5000.11

? (TO)
TT=5000.01

? (TO)
TT=40000.4

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.46

No dataNo data? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No data
crafted/skvortsov/battleship/
battleship-14-26-sat.cnf
SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

SAT
TT=8622.11

SAT
TT=8420.42

No data? (TO)
TT=40000.8

? (TO)
TT=5000.14

No dataNo dataNo dataSAT
TT=1.364

No dataSAT
TT=1747.75

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataSAT
TT=621.974

No dataSAT
TT=154.814

SAT
TT=0.062

SAT
TT=0.022

? (TO)
TT=20400.1

? (TO)
TT=5000.13

No dataSAT
TT=1429.02

SAT
TT=569.489

SAT
TT=24727.4

SAT
TT=8

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.26

No dataNo dataSAT
TT=0.481

SAT
TT=277.482

SAT
TT=0.3

SAT
TT=0.023

No dataSignal
TT=2935.6

No data
crafted/skvortsov/battleship/
battleship-14-27-sat.cnf
SAT
TT=0.016

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

SAT
TT=303.224

SAT
TT=282.033

No data? (TO)
TT=40000.8

? (TO)
TT=5000.13

No dataNo dataNo dataSAT
TT=0.054

No dataSAT
TT=31.368

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataSAT
TT=14.097

No dataSAT
TT=10.409

SAT
TT=0.15

SAT
TT=0.022

SAT
TT=10428

? (TO)
TT=5000.09

No dataSAT
TT=84.279

SAT
TT=1.943

SAT
TT=37.54

SAT
TT=12.862

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.87

No dataNo dataSAT
TT=0.124

SAT
TT=42.93

SAT
TT=0.016

SAT
TT=0.016

No dataSAT
TT=44.564

No data
crafted/skvortsov/
battleship/
battleship-15-15-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

? (TO)
TT=40000.8

? (TO)
TT=40000.7

No data? (TO)
TT=40001.1

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.4

? (TO)
TT=36504.6

? (TO)
TT=5000.06

? (TO)
TT=20400.5

? (TO)
TT=5000.12

No data? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=40001.2

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.93

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.08

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No data
crafted/skvortsov/battleship/
battleship-15-29-sat.cnf
SAT
TT=0.023

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

SAT
TT=950.084

SAT
TT=970.625

No data? (TO)
TT=40000.6

? (TO)
TT=5000.1

No dataNo dataNo dataSAT
TT=62.587

No dataSAT
TT=875.248

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataSAT
TT=1493.6

No dataSAT
TT=54.331

SAT
TT=0.082

SAT
TT=4954.89

? (TO)
TT=20398.2

? (TO)
TT=5000.1

No dataSAT
TT=1532.22

SAT
TT=54.56

? (TO)
TT=40001

SAT
TT=2053.66

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.66

No dataNo dataSAT
TT=0.156

SAT
TT=277.986

SAT
TT=0.027

SAT
TT=0.023

No dataSignal
TT=2114.07

No data
crafted/skvortsov/
battleship/
battleship-16-16-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40000.4

? (TO)
TT=40000.5

No data? (TO)
TT=40000.8

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.5

? (TO)
TT=40000.3

? (TO)
TT=5000.09

? (TO)
TT=20400.2

? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

? (TO)
TT=5000.11

? (TO)
TT=40001.1

? (TO)
TT=5000.06

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

No data
crafted/skvortsov/battleship/
battleship-16-31-sat.cnf
SAT
TT=0.031

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

SAT
TT=871.855

SAT
TT=875.585

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.05

No dataSAT
TT=817.954

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataSAT
TT=748.27

No dataSAT
TT=22.213

SAT
TT=0.244

SAT
TT=0.066

SAT
TT=322.557

? (TO)
TT=5000.13

No data? (TO)
TT=5000.03

SAT
TT=30.636

SAT
TT=0.979

SAT
TT=1137.36

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.95

No dataNo dataSAT
TT=0.09

SAT
TT=218.63

SAT
TT=0.031

SAT
TT=0.057

No dataSignal
TT=3283.61

No data
crafted/skvortsov/battleship/
battleship-17-33-sat.cnf
SAT
TT=0.039

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

? (TO)
TT=35624.1

? (TO)
TT=40000.7

No data? (TO)
TT=40000.9

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.045

No dataNo data? (TO)
TT=5000.07

No dataSAT
TT=0.716

SAT
TT=0.297

SAT
TT=0.052

? (TO)
TT=20399.5

? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

SAT
TT=382.769

SAT
TT=0.486

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataSAT
TT=24.067

No dataNo dataSAT
TT=0.218

SAT
TT=30.506

SAT
TT=0.039

SAT
TT=0.054

No data? (TO)
TT=5000.05

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/skvortsov/battleship/
battleship-24-57-sat.cnf
SAT
TT=0.04

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

SAT
TT=348.318

SAT
TT=346.613

No dataSAT
TT=3.024

? (TO)
TT=5000.14

No dataNo dataNo dataSAT
TT=0.128

No dataSAT
TT=43.885

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataSAT
TT=51.315

No dataSAT
TT=32.694

SAT
TT=2.421

SAT
TT=0.55

SAT
TT=1199.93

? (TO)
TT=5000.2

No dataSAT
TT=171.928

SAT
TT=0.168

SAT
TT=1.625

SAT
TT=249.438

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataSAT
TT=7.546

No dataNo dataSAT
TT=0.04

SAT
TT=34.631

SAT
TT=0.242

SAT
TT=0.246

No dataSAT
TT=441.362

No data
crafted/skvortsov/battleship/
battleship-5-8-unsat.cnf
UNSAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.039

UNSAT
TT=0.054

UNSAT
TT=0.072

No dataUNSAT
TT=0.518

UNSAT
TT=0.047

No dataNo dataNo dataUNSAT
TT=0.047

No dataUNSAT
TT=0.709

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.079

No dataNo dataUNSAT
TT=0.022

No dataUNSAT
TT=0.515

UNSAT
TT=0.085

UNSAT
TT=0.205

UNSAT
TT=3.668

UNSAT
TT=0.089

No dataUNSAT
TT=0.05

UNSAT
TT=0.054

UNSAT
TT=0.25

UNSAT
TT=0.032

UNSAT
TT=0.034

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.07

No dataNo dataUNSAT
TT=0.09

UNSAT
TT=2.729

? (TO)
TT=5000.04

? (TO)
TT=5000.09

No dataUNSAT
TT=0.066

No data
crafted/skvortsov/battleship/
battleship-6-9-unsat.cnf
UNSAT
TT=0.096

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.234

UNSAT
TT=0.413

UNSAT
TT=0.493

No dataUNSAT
TT=2.468

UNSAT
TT=0.595

No dataNo dataNo dataUNSAT
TT=0.427

No dataUNSAT
TT=1.071

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.437

No dataNo dataUNSAT
TT=0.119

No dataUNSAT
TT=3.273

UNSAT
TT=0.166

UNSAT
TT=1.007

UNSAT
TT=3.821

UNSAT
TT=0.658

No dataUNSAT
TT=0.175

UNSAT
TT=0.638

UNSAT
TT=1.143

UNSAT
TT=0.175

UNSAT
TT=0.23

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.134

No dataNo dataUNSAT
TT=2.414

UNSAT
TT=3.32

? (TO)
TT=5000.04

? (TO)
TT=5000.06

No dataUNSAT
TT=0.096

No data
crafted/skvortsov/
battleship/
battleship-7-12-unsat.cnf
UNSAT
TT=37.912

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=107.087

UNSAT
TT=257.36

UNSAT
TT=235.719

No dataUNSAT
TT=3591.4

UNSAT
TT=989.547

No dataNo dataNo dataUNSAT
TT=1349.9

No dataUNSAT
TT=1048.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=352.907

No dataNo dataUNSAT
TT=45.678

No dataUNSAT
TT=10916

UNSAT
TT=91.06

UNSAT
TT=369.485

UNSAT
TT=1759.95

UNSAT
TT=1177.65

No dataUNSAT
TT=735.272

UNSAT
TT=486.604

UNSAT
TT=11004.7

UNSAT
TT=131.559

UNSAT
TT=115.86

No dataNo dataNo dataNo dataNo dataUNSAT
TT=588.774

No dataNo data? (TO)
TT=5000.08

UNSAT
TT=168.03

? (TO)
TT=5000.1

? (TO)
TT=5000.09

No dataUNSAT
TT=37.912

No data
crafted/skvortsov/battleship/
battleship-7-13-sat.cnf
SAT
TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.003

SAT
TT=0.01

SAT
TT=0.01

No dataSAT
TT=0.127

SAT
TT=0.002

No dataNo dataNo dataSAT
TT=45.273

No dataSAT
TT=0.277

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.006

No dataNo dataSAT
TT=0.004

No dataSAT
TT=0.317

SAT
TT=0.009

SAT
TT=0.006

SAT
TT=2.027

SAT
TT=1.186

No dataSAT
TT=0.003

SAT
TT=0.003

SAT
TT=0.117

SAT
TT=0.003

SAT
TT=0.118

No dataNo dataNo dataNo dataNo dataSAT
TT=0.031

No dataNo dataSAT
TT=0.009

SAT
TT=2.751

SAT
TT=0.002

SAT
TT=0.001

No dataSAT
TT=0.94

No data
crafted/skvortsov/battleship/
battleship-8-15-sat.cnf
SAT
TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.035

SAT
TT=0.013

SAT
TT=0.01

No dataSAT
TT=0.391

SAT
TT=0.022

No dataNo dataNo dataSAT
TT=163.855

No dataSAT
TT=0.217

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.012

No dataNo dataSAT
TT=0.003

No dataSAT
TT=0.537

SAT
TT=0.018

SAT
TT=0.005

SAT
TT=4

SAT
TT=0.625

No dataSAT
TT=0.002

SAT
TT=0.002

SAT
TT=0.086

SAT
TT=0.003

SAT
TT=7.749

No dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataNo dataSAT
TT=0.012

SAT
TT=2.759

SAT
TT=0.002

SAT
TT=0.002

No dataSAT
TT=0.139

No data
crafted/skvortsov/battleship/
battleship-9-17-sat.cnf
SAT
TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.011

SAT
TT=0.011

SAT
TT=0.007

No dataSAT
TT=0.248

SAT
TT=234.801

No dataNo dataNo dataSAT
TT=1939.5

No dataSAT
TT=0.377

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.091

No dataNo dataSAT
TT=0.203

No dataSAT
TT=0.339

SAT
TT=0.014

SAT
TT=0.157

SAT
TT=6.234

SAT
TT=1.219

No dataSAT
TT=0.024

SAT
TT=0.027

SAT
TT=0.174

SAT
TT=0.017

SAT
TT=1.204

No dataNo dataNo dataNo dataNo dataSAT
TT=5.329

No dataNo dataSAT
TT=0.018

SAT
TT=27.804

SAT
TT=0.003

SAT
TT=0.003

No dataSAT
TT=8.194

No data
crafted/
spence/hard/
s113-100.cnf
UNSAT
TT=1113.71

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40000.9

? (TO)
TT=40000.6

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.4

? (TO)
TT=40000.7

? (TO)
TT=5000.11

? (TO)
TT=20400.3

? (TO)
TT=5000.08

No data? (TO)
TT=5000.09

? (TO)
TT=5000.23

? (TO)
TT=40000.4

? (TO)
TT=5000.04

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1113.71

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.03

? (TO)
TT=5000.08

? (TO)
TT=5000.09

No data? (TO)
TT=5000.13

No data
crafted/spence/
sgen/
sgen3-n120-s12930489-sat.cnf
SAT
TT=0.006

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.451

SAT
TT=2.771

SAT
TT=4.291

No dataSAT
TT=13.298

SAT
TT=16.179

No dataNo dataNo dataSAT
TT=5.127

No dataSAT
TT=1.359

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.803

No dataNo dataSAT
TT=1.604

No dataSAT
TT=15.222

SAT
TT=0.595

SAT
TT=1.322

SAT
TT=5.962

SAT
TT=3.815

No dataSAT
TT=1.821

SAT
TT=0.941

SAT
TT=4.693

SAT
TT=6.237

SAT
TT=12.973

No dataNo dataNo dataNo dataNo dataSAT
TT=0.248

No dataNo dataSAT
TT=5.46

SAT
TT=19.35

SAT
TT=0.136

SAT
TT=0.006

No dataSAT
TT=167.524

No data
crafted/spence/
sgen/
sgen3-n120-s55656844-unsat.cnf
UNSAT
TT=716.736

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=40000.5

? (TO)
TT=40000.8

No data? (TO)
TT=40000.9

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.6

? (TO)
TT=40000.4

? (TO)
TT=5000.01

? (TO)
TT=20400.4

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

? (TO)
TT=5000.18

? (TO)
TT=40000.7

? (TO)
TT=5000.09

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataUNSAT
TT=716.736

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No data? (TO)
TT=5000.14

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/spence/
sgen/
sgen3-n130-s30940966-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

? (TO)
TT=40000.5

? (TO)
TT=40000.3

No data? (TO)
TT=40000.4

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.6

? (TO)
TT=40000.6

? (TO)
TT=5000.03

? (TO)
TT=20399.1

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

? (TO)
TT=5000.19

? (TO)
TT=40000.4

? (TO)
TT=5000.1

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.83

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000

? (TO)
TT=5000.1

? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No data
crafted/spence/
sgen/
sgen3-n140-s18527668-sat.cnf
SAT
TT=0.235

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=90.528

SAT
TT=152.919

SAT
TT=39.591

No dataSAT
TT=228.855

SAT
TT=39.417

No dataNo dataNo dataSAT
TT=217.897

No dataSAT
TT=1.221

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.841

No dataNo dataSAT
TT=8.247

No dataSAT
TT=159.717

SAT
TT=5.329

SAT
TT=1.174

SAT
TT=5914.74

SAT
TT=32.886

No dataSAT
TT=18.176

SAT
TT=16.613

SAT
TT=525.685

SAT
TT=1.2

SAT
TT=105.002

No dataNo dataNo dataNo dataNo dataSAT
TT=4.801

No dataNo dataSAT
TT=178.111

SAT
TT=24.02

SAT
TT=0.235

SAT
TT=0.26

No dataSAT
TT=475.073

No data
crafted/spence/
sgen/
sgen3-n140-s20078956-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=40000.8

? (TO)
TT=40000.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001

? (TO)
TT=37121.7

? (TO)
TT=5000.01

? (TO)
TT=20400.3

? (TO)
TT=5000.14

No data? (TO)
TT=5000.02

? (TO)
TT=5000.16

? (TO)
TT=40000.4

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=4999.97

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No data
crafted/spence/
sgen/
sgen3-n150-s89334302-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=37986.7

? (TO)
TT=40000.2

No data? (TO)
TT=40001

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=40000.6

? (TO)
TT=40000.5

? (TO)
TT=5000.05

? (TO)
TT=20400.1

? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

? (TO)
TT=5000.24

? (TO)
TT=40000.5

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.01

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No data
crafted/spence/
sgen/
sgen3-n160-s40283905-sat.cnf
SAT
TT=0.187

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=443.15

SAT
TT=191.878

SAT
TT=879.543

No dataSAT
TT=19368.4

? (TO)
TT=5000.08

No dataNo dataNo dataSAT
TT=4660.36

No dataSAT
TT=118.975

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.226

No dataNo dataSAT
TT=1.98

No dataSAT
TT=1001

SAT
TT=23.525

SAT
TT=21.739

SAT
TT=2688.46

? (TO)
TT=5000.1

No dataSAT
TT=14.633

SAT
TT=188.444

SAT
TT=6351.99

SAT
TT=353.802

SAT
TT=221.585

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.93

No dataNo data? (TO)
TT=5000.04

SAT
TT=143.54

SAT
TT=1.774

SAT
TT=0.187

No data? (TO)
TT=5000.13

No data
crafted/spence/
sgen/
sgen3-n160-s73223945-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=30595.1

? (TO)
TT=40000.8

No data? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.4

? (TO)
TT=40000.6

? (TO)
TT=4998.31

? (TO)
TT=20399.9

? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

? (TO)
TT=5000.16

? (TO)
TT=40001.2

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.17

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.01

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No data
crafted/spence/
sgen/
sgen3-n170-s56409011-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

? (TO)
TT=35560

? (TO)
TT=40000.6

No data? (TO)
TT=40001

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.5

? (TO)
TT=40000.8

? (TO)
TT=5000.06

? (TO)
TT=20400.1

? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

? (TO)
TT=5000.17

? (TO)
TT=40000.8

? (TO)
TT=5000.05

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.43

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (TO)
TT=5000.08

No data? (TO)
TT=5000.15

No data
crafted/spence/
sgen/
sgen3-n180-s33098896-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40000.9

? (TO)
TT=40000.5

No data? (TO)
TT=40000.8

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.7

? (TO)
TT=40000.7

? (TO)
TT=5000.07

? (TO)
TT=20400.2

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

? (TO)
TT=5000.25

? (TO)
TT=40000.4

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.56

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=5000.08

No data? (TO)
TT=5000.13

No data
crafted/spence/
sgen/
sgen3-n180-s34713902-sat.cnf
SAT
TT=0.224

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1377.48

SAT
TT=367.491

SAT
TT=1267.79

No dataSAT
TT=3036.07

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000

No dataSAT
TT=753.945

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.67

No dataNo dataSAT
TT=731.778

No dataSAT
TT=16135.5

SAT
TT=2.691

SAT
TT=13.18

? (TO)
TT=20400.2

? (TO)
TT=5000.07

No dataSAT
TT=525.289

SAT
TT=10.498

SAT
TT=33574.9

SAT
TT=1066.89

SAT
TT=1028.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.38

No dataNo data? (TO)
TT=5000.01

SAT
TT=156.42

SAT
TT=0.979

SAT
TT=0.224

No data? (TO)
TT=5000.15

No data
crafted/spence/
sgen/
sgen3-n190-s29985700-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=40000.7

? (TO)
TT=40000.7

No data? (TO)
TT=40000.8

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.3

? (TO)
TT=40000.6

? (TO)
TT=5000

? (TO)
TT=20400

? (TO)
TT=5000.14

No data? (TO)
TT=5000.11

? (TO)
TT=5000.22

? (TO)
TT=40000.8

? (TO)
TT=5000.03

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.73

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No data? (TO)
TT=5000.14

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
crafted/spence/
sgen/
sgen3-n200-s00813792-unsat.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

? (TO)
TT=35555.7

? (TO)
TT=40000.3

No data? (TO)
TT=40000.9

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40000.4

? (TO)
TT=40000.6

? (TO)
TT=5000.12

? (TO)
TT=20400

? (TO)
TT=5000.13

No data? (TO)
TT=5000.11

? (TO)
TT=5000.26

? (TO)
TT=40000.8

? (TO)
TT=5000.09

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.86

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (TO)
TT=5000.05

No data? (TO)
TT=5000.13

No data
crafted/spence/
sgen/
sgen3-n200-s39840374-sat.cnf
SAT
TT=1.843

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4713.39

SAT
TT=3136.41

SAT
TT=299.106

No data? (TO)
TT=40000.9

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.07

No dataSAT
TT=967.822

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.563

No dataNo dataSAT
TT=1164.27

No data? (TO)
TT=40000.4

SAT
TT=109.61

SAT
TT=36.732

? (TO)
TT=20399.9

? (TO)
TT=5000.11

No dataSAT
TT=319.283

SAT
TT=2184.01

? (TO)
TT=40000.6

? (TO)
TT=5000.03

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.73

No dataNo data? (TO)
TT=5000.07

SAT
TT=318.62

SAT
TT=3.356

SAT
TT=1.843

No data? (TO)
TT=5000.14

No data
crafted/spence/
sgen/
sgen3-n220-s24359701-sat.cnf
SAT
TT=6.71

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

SAT
TT=16048.4

? (TO)
TT=40000.6

No data? (TO)
TT=40000.6

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=29.441

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.3

SAT
TT=867.483

SAT
TT=569.724

? (TO)
TT=20400.4

? (TO)
TT=5000.07

No data? (TO)
TT=5000.1

? (TO)
TT=5000.12

? (TO)
TT=40000.5

? (TO)
TT=5000.05

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo data? (TO)
TT=5000.05

SAT
TT=334.92

SAT
TT=36.789

SAT
TT=6.71

No data? (TO)
TT=5000.12

No data
crafted/spence/
sgen/
sgen3-n240-s78945233-sat.cnf
SAT
TT=13.119

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=38896.4

? (TO)
TT=40000.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=73.867

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.8

SAT
TT=2220.35

SAT
TT=272.947

? (TO)
TT=20400.7

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

? (TO)
TT=5000.02

? (TO)
TT=40000.8

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.62

No dataNo data? (TO)
TT=5000.06

SAT
TT=342.62

SAT
TT=15.862

SAT
TT=13.119

No data? (TO)
TT=5000.12

No data
crafted/spence/
sgen/
sgen3-n260-s62321009-sat.cnf
SAT
TT=17.054

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=30634.3

? (TO)
TT=40001

No data? (TO)
TT=40000.7

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=216.266

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.7

SAT
TT=1083.27

SAT
TT=1465.93

? (TO)
TT=20400.5

? (TO)
TT=5000.13

No data? (TO)
TT=5000.04

? (TO)
TT=5000.1

? (TO)
TT=40000.7

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.66

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.07

SAT
TT=17.054

SAT
TT=125.005

No data? (TO)
TT=5000.13

No data
crafted/spence/
sgen/
sgen3-n280-s93756482-sat.cnf
SAT
TT=68.675

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

? (TO)
TT=40000.4

? (TO)
TT=40000.4

No data? (TO)
TT=40000.4

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=348.867

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.6

SAT
TT=1993.49

SAT
TT=4879.36

? (TO)
TT=20400.5

? (TO)
TT=5000.1

No data? (TO)
TT=5000.11

? (TO)
TT=5000.1

? (TO)
TT=40001

? (TO)
TT=5000.02

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.13

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.05

SAT
TT=1280.56

SAT
TT=68.675

No data? (TO)
TT=5000.05

No data
crafted/spence/
sgen/
sgen3-n300-s12830984-sat.cnf
SAT
TT=5.637

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40000.9

? (TO)
TT=40000.6

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40000.8

? (TO)
TT=40000.6

? (TO)
TT=5000.06

? (TO)
TT=20400.3

? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

? (TO)
TT=5000.05

? (TO)
TT=40001.1

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.05

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.03

SAT
TT=5.637

SAT
TT=205.908

No data? (TO)
TT=5000.12

No data
ibm-2002-21r-k95.cnf SAT
TT=8.02

No dataSAT
TT=293.228

SAT
TT=249.721

No dataNo dataSAT
TT=120.465

No dataNo dataSAT
TT=9.332

SAT
TT=24.986

SAT
TT=500.959

SAT
TT=449.36

SAT
TT=59.822

No dataNo dataSAT
TT=20.24

SAT
TT=11.952

SAT
TT=29.72

No dataSAT
TT=59.641

SAT
TT=59.707

No dataSAT
TT=11.186

SAT
TT=12.257

SAT
TT=13.719

SAT
TT=17.797

SAT
TT=10.321

SAT
TT=15.965

SAT
TT=10.194

No dataSAT
TT=39.579

No dataNo dataSAT
TT=219.61

SAT
TT=110.456

SAT
TT=30.617

No dataNo dataSAT
TT=92.363

SAT
TT=17.72

SAT
TT=8.02

No dataNo dataNo dataNo dataSAT
TT=19.515

No dataSAT
TT=61.267

No dataSAT
TT=9.943

No dataNo dataNo dataNo dataSAT
TT=129.73

No dataNo dataNo dataNo dataNo data
ibm-2002-30r-k85.cnf SAT
TT=39.886

No dataSAT
TT=13710.9

SAT
TT=10713.7

No dataNo data? (TO)
TT=5000.03

No dataNo dataSAT
TT=36326.2

SAT
TT=16581

SAT
TT=19334.2

SAT
TT=6307.08

SAT
TT=1813.51

No dataNo dataSAT
TT=2109.75

SAT
TT=413.066

? (TO)
TT=5000.09

No dataSAT
TT=486.729

SAT
TT=483.83

No dataSAT
TT=1368.35

SAT
TT=340.508

SAT
TT=838.475

? (TO)
TT=5000.05

SAT
TT=40.057

SAT
TT=334.717

SAT
TT=39.886

No dataSAT
TT=980.929

No dataNo dataSAT
TT=8087.25

SAT
TT=4461.1

SAT
TT=8625.02

No dataNo data? (TO)
TT=5000.11

SAT
TT=936.542

SAT
TT=360.312

No dataNo dataNo dataNo dataSAT
TT=317.744

No dataSAT
TT=1639.11

No dataSAT
TT=197.843

No dataNo dataNo dataNo dataSAT
TT=913.48

No dataNo dataNo dataNo dataNo data
ibm-2004-01-k90.cnf SAT
TT=9.799

No dataSAT
TT=162.584

SAT
TT=100.878

No dataNo dataSAT
TT=39.866

No dataNo dataSAT
TT=134.039

SAT
TT=75.746

SAT
TT=231.166

SAT
TT=464.443

SAT
TT=28.934

No dataNo dataSAT
TT=63.23

SAT
TT=17.773

SAT
TT=31.643

No dataSAT
TT=47.797

SAT
TT=47.789

No dataSAT
TT=15.179

SAT
TT=11.192

SAT
TT=17.305

SAT
TT=43.522

SAT
TT=18.922

SAT
TT=9.799

SAT
TT=18.475

No dataSAT
TT=23.365

No dataNo dataSAT
TT=72.665

SAT
TT=32.109

SAT
TT=142.831

No dataNo dataSAT
TT=231.654

SAT
TT=25.994

SAT
TT=48.238

No dataNo dataNo dataNo dataSAT
TT=20.481

No dataSAT
TT=48.254

No dataSAT
TT=12.492

No dataNo dataNo dataNo dataSAT
TT=55.47

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
ibm-2004-23-k100.cnf SAT
TT=60.186

No dataSAT
TT=2031.66

SAT
TT=1914.92

No dataNo dataSAT
TT=612.845

No dataNo dataSAT
TT=1480.76

SAT
TT=899.057

SAT
TT=2136.38

SAT
TT=1279.58

SAT
TT=426.019

No dataNo dataSAT
TT=300.016

SAT
TT=145.014

SAT
TT=451.883

No dataSAT
TT=360.507

SAT
TT=360.761

No dataSAT
TT=85.296

SAT
TT=60.186

SAT
TT=107.78

SAT
TT=446.709

SAT
TT=83.68

SAT
TT=153.903

SAT
TT=82.886

No dataSAT
TT=320.105

No dataNo dataSAT
TT=1115.89

SAT
TT=2327.69

SAT
TT=2612.63

No dataNo dataSAT
TT=596.949

SAT
TT=257.21

SAT
TT=133.353

No dataNo dataNo dataNo dataSAT
TT=206.152

No dataSAT
TT=647.122

No dataSAT
TT=157.792

No dataNo dataNo dataNo dataSAT
TT=736.29

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-sat/
partial-10-13-s.cnf
SAT
TT=170.723

No dataSAT
TT=1168.67

SAT
TT=1927.48

No dataNo dataSAT
TT=308.212

No dataNo dataSAT
TT=3298.95

SAT
TT=3899.97

SAT
TT=1879.05

SAT
TT=1633.34

SAT
TT=201.285

No dataNo data? (TO)
TT=5000.04

SAT
TT=170.723

SAT
TT=948.776

No data? (TO)
TT=5000.09

? (TO)
TT=5000.07

No dataSAT
TT=650.512

SAT
TT=2191.57

SAT
TT=415.992

SAT
TT=2140.27

? (TO)
TT=5000.31

SAT
TT=4706.04

? (TO)
TT=5000.23

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=1152.84

SAT
TT=4731.13

SAT
TT=8090.5

No dataNo dataSAT
TT=271.441

SAT
TT=3289.9

? (TO)
TT=5000.17

No dataNo dataNo dataNo dataSAT
TT=1706.94

No dataSAT
TT=1409.95

No dataSAT
TT=1816.74

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-sat/
partial-10-15-s.cnf
SAT
TT=73.125

No dataSAT
TT=1215.29

SAT
TT=1706.12

No dataNo dataSAT
TT=357.64

No dataNo dataSAT
TT=19179.1

SAT
TT=599.559

SAT
TT=1183.14

SAT
TT=1133.67

SAT
TT=149.933

No dataNo dataSAT
TT=73.125

SAT
TT=1773.46

SAT
TT=150.13

No dataSAT
TT=281.493

SAT
TT=280.449

No dataSAT
TT=823.729

SAT
TT=574.976

SAT
TT=260.195

SAT
TT=1243.55

SAT
TT=503.217

SAT
TT=2573.58

SAT
TT=544.075

No dataSAT
TT=308.873

No dataNo dataSAT
TT=1368.45

SAT
TT=1572.56

SAT
TT=7294.32

No dataNo dataSAT
TT=178.002

SAT
TT=1092.68

SAT
TT=859.276

No dataNo dataNo dataNo dataSAT
TT=1000.85

No dataSAT
TT=834.967

No dataSAT
TT=540.168

No dataNo dataNo dataNo dataSAT
TT=1537.17

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-sat/
partial-10-17-s.cnf
SAT
TT=79.238

No dataSAT
TT=858.592

SAT
TT=824.805

No dataNo dataSAT
TT=211.242

No dataNo dataSAT
TT=32899.8

SAT
TT=20612.8

SAT
TT=1804.28

SAT
TT=1659.98

SAT
TT=79.238

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.07

? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

? (TO)
TT=5000.13

No data? (TO)
TT=5000.23

SAT
TT=3373.73

? (TO)
TT=5000.27

? (TO)
TT=5000.22

? (TO)
TT=5000.29

SAT
TT=2719.8

? (TO)
TT=5000.29

No dataSAT
TT=4642.44

No dataNo dataSAT
TT=17807.6

SAT
TT=6931.19

SAT
TT=33864.2

No dataNo dataSAT
TT=93.662

? (TO)
TT=5000.05

? (TO)
TT=5000.17

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (exit code)
TT=8129.01

No data? (TO)
TT=5000.14

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-unsat/
dated-10-17-u.cnf
UNSAT
TT=1912.22

No dataUNSAT
TT=14646

UNSAT
TT=20983.5

No dataNo dataUNSAT
TT=2310.3

No dataNo dataUNSAT
TT=9152.42

UNSAT
TT=12115.8

Signal
TT=432.592

UNSAT
TT=12558.7

UNSAT
TT=4496.9

No dataNo dataUNSAT
TT=2658.12

UNSAT
TT=1912.22

UNSAT
TT=3109.26

No dataUNSAT
TT=2533.06

UNSAT
TT=2536.87

No data? (TO)
TT=5000.04

UNSAT
TT=2990.49

? (TO)
TT=5000.12

? (TO)
TT=5000.05

? (TO)
TT=5000.04

UNSAT
TT=3680.88

? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=14052.3

UNSAT
TT=13427.3

UNSAT
TT=12851

No dataNo dataUNSAT
TT=2108.85

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataUNSAT
TT=3082.6

No dataUNSAT
TT=6232.73

No dataUNSAT
TT=2968.46

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-unsat/
dated-5-13-u.cnf
UNSAT
TT=1218.25

No dataUNSAT
TT=16405.3

UNSAT
TT=21951.5

No dataNo data? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=9394.33

UNSAT
TT=10588.4

UNSAT
TT=7247.9

UNSAT
TT=10975.4

UNSAT
TT=4215.78

No dataNo dataUNSAT
TT=4465.05

UNSAT
TT=2753.5

UNSAT
TT=4782.82

No dataUNSAT
TT=4300.53

UNSAT
TT=4240.7

No data? (TO)
TT=5000.04

? (TO)
TT=5000.11

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.05

UNSAT
TT=4582.14

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=33450.1

UNSAT
TT=31631

UNSAT
TT=20847.2

No dataNo dataUNSAT
TT=1218.25

? (TO)
TT=5000.1

? (TO)
TT=5000.13

No dataNo dataNo dataNo dataUNSAT
TT=3284.96

No dataUNSAT
TT=11498.6

No dataUNSAT
TT=4493.76

No dataNo dataNo dataNo dataUNSAT
TT=3293.99

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-unsat/
partial-5-11-u.cnf



No data? (TO)
TT=40000.2

?
TT=39469.9

No dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40002.1

? (TO)
TT=40002.4

? (TO)
TT=40001.1

? (TO)
TT=40001.1

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.04

? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

? (TO)
TT=5000.05

No data? (TO)
TT=5000.13

? (TO)
TT=5000.08

? (TO)
TT=5000.14

? (TO)
TT=5000.1

? (TO)
TT=5000.18

? (TO)
TT=5000.02

? (TO)
TT=5000.19

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=40000.5

? (TO)
TT=40000.4

? (TO)
TT=40000.6

No dataNo data? (TO)
TT=5000.17

? (TO)
TT=5000.01

? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=20383.8

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
hard-unsat/
total-10-17-u.cnf
UNSAT
TT=2843.87

No dataUNSAT
TT=31811.5

? (MO)
TT=37559.3

No dataNo data? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=16870.8

UNSAT
TT=19172.7

UNSAT
TT=20775.6

UNSAT
TT=17329.7

UNSAT
TT=2908.39

No dataNo dataUNSAT
TT=4833.65

UNSAT
TT=2843.87

UNSAT
TT=4497.08

No dataUNSAT
TT=4599.27

UNSAT
TT=4149.84

No data? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.02

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=20454.6

UNSAT
TT=24062.1

UNSAT
TT=23848.1

No dataNo data? (TO)
TT=5000.11

? (TO)
TT=5000

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataUNSAT
TT=3916.94

No dataUNSAT
TT=12985.4

No dataUNSAT
TT=4225.39

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
industrial/anbulagan/
medium-unsat/
dated-5-11-u.cnf
UNSAT
TT=16.054

No dataUNSAT
TT=174.615

UNSAT
TT=167.598

No dataNo dataUNSAT
TT=115.051

No dataNo dataUNSAT
TT=80.816

UNSAT
TT=67.753

UNSAT
TT=152.977

UNSAT
TT=147.73

UNSAT
TT=20.615

No dataNo dataUNSAT
TT=32.643

UNSAT
TT=26.915

UNSAT
TT=30.138

No dataUNSAT
TT=16.079

UNSAT
TT=16.054

No dataUNSAT
TT=77.18

UNSAT
TT=40.268

UNSAT
TT=51.206

UNSAT
TT=60.942

UNSAT
TT=41.591

UNSAT
TT=42.555

UNSAT
TT=41.122

No dataUNSAT
TT=27.726

No dataNo dataUNSAT
TT=96.902

UNSAT
TT=108.205

UNSAT
TT=98.504

No dataNo dataUNSAT
TT=19.808

UNSAT
TT=38.533

UNSAT
TT=54.747

No dataNo dataNo dataNo dataUNSAT
TT=35.916

No dataUNSAT
TT=65.012

No dataUNSAT
TT=28.191

No dataNo dataNo dataNo dataUNSAT
TT=78.6

No dataNo dataNo dataNo dataNo data
industrial/babic/
dspam/
dspam_dump_vc949.cnf
UNSAT
TT=0.448

No dataUNSAT
TT=41.453

UNSAT
TT=49.42

No dataNo dataUNSAT
TT=28.599

No dataNo dataUNSAT
TT=0.608

UNSAT
TT=0.611

UNSAT
TT=7.767

UNSAT
TT=7.96

UNSAT
TT=0.601

No dataNo dataUNSAT
TT=1.132

UNSAT
TT=1.12

UNSAT
TT=0.454

No dataUNSAT
TT=2.59

UNSAT
TT=2.6

No dataUNSAT
TT=0.529

? (exit code)
TT=0.497

UNSAT
TT=0.449

UNSAT
TT=0.499

UNSAT
TT=0.45

UNSAT
TT=1.127

UNSAT
TT=0.448

No dataUNSAT
TT=5.327

No dataNo dataUNSAT
TT=2.323

UNSAT
TT=2.351

UNSAT
TT=3.251

No dataNo dataUNSAT
TT=16.34

UNSAT
TT=1.13

UNSAT
TT=0.449

No dataNo dataNo dataNo dataUNSAT
TT=1.172

No dataUNSAT
TT=1.268

No dataUNSAT
TT=1.003

No dataNo dataNo dataNo dataUNSAT
TT=51.603

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
industrial/babic/
hsatv17/
hsat_vc12062.cnf
UNSAT
TT=0.508

No dataUNSAT
TT=81.022

UNSAT
TT=70.701

No dataNo dataUNSAT
TT=66.483

No dataNo dataUNSAT
TT=0.89

UNSAT
TT=0.888

UNSAT
TT=23.535

UNSAT
TT=21.48

UNSAT
TT=2.101

No dataNo dataUNSAT
TT=3.338

UNSAT
TT=3.329

UNSAT
TT=0.52

No dataUNSAT
TT=1.271

UNSAT
TT=1.275

No dataUNSAT
TT=0.605

? (exit code)
TT=0.526

UNSAT
TT=0.509

UNSAT
TT=0.591

UNSAT
TT=0.508

UNSAT
TT=3.326

UNSAT
TT=0.511

No dataUNSAT
TT=1.934

No dataNo dataUNSAT
TT=11.236

UNSAT
TT=8.705

UNSAT
TT=5.003

No dataNo dataUNSAT
TT=6.84

UNSAT
TT=3.322

UNSAT
TT=0.53

No dataNo dataNo dataNo dataUNSAT
TT=3.238

No dataUNSAT
TT=3.17

No dataUNSAT
TT=1.299

No dataNo dataNo dataNo dataUNSAT
TT=82.01

No dataNo dataNo dataNo dataNo data
industrial/
crypto/
mizh-sha0-36-2.cnf
SAT
TT=54.129

No dataSAT
TT=936.799

SAT
TT=681.328

No dataNo dataSAT
TT=982.107

No dataNo dataSAT
TT=2081.52

SAT
TT=378.004

SAT
TT=242.157

SAT
TT=294.294

SAT
TT=1012.35

No dataNo data? (TO)
TT=5000.07

SAT
TT=2317.73

SAT
TT=2564.44

No dataSAT
TT=486.293

SAT
TT=482.679

No dataSAT
TT=4023.5

SAT
TT=967.43

SAT
TT=99.089

? (TO)
TT=5000.1

SAT
TT=1235.07

SAT
TT=1217.59

SAT
TT=1213.83

No dataSAT
TT=388.116

No dataNo dataSAT
TT=237.824

SAT
TT=541.876

SAT
TT=1326.98

No dataNo dataSAT
TT=220.708

SAT
TT=1347.33

SAT
TT=54.129

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataSAT
TT=728.806

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataSAT
TT=585.21

No dataNo dataNo dataNo dataNo data
industrial/
fuhs/hard/
AProVE07-01.cnf
UNSAT
TT=2476.89

No data? (TO)
TT=40000.8

?
TT=39796.6

No dataNo data? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=19897.7

UNSAT
TT=28754.5

UNSAT
TT=17823.9

UNSAT
TT=19154.6

? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.03

UNSAT
TT=4946.03

No data? (TO)
TT=5000.13

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.07

? (TO)
TT=5000.04

? (TO)
TT=5000.06

? (TO)
TT=5000.09

No dataUNSAT
TT=2476.89

No dataNo dataUNSAT
TT=39398.7

UNSAT
TT=35303.5

? (TO)
TT=40000.1

No dataNo dataUNSAT
TT=4143.79

? (TO)
TT=5000.1

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=13610.5

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data
industrial/
fuhs/hard/
AProVE07-03.cnf
UNSAT
TT=136.848

No dataUNSAT
TT=6563.81

UNSAT
TT=6512.53

No dataNo dataUNSAT
TT=3754.77

No dataNo dataUNSAT
TT=1868.1

UNSAT
TT=1870.17

UNSAT
TT=1677.93

UNSAT
TT=1840.62

UNSAT
TT=715.298

No dataNo dataUNSAT
TT=1474.44

UNSAT
TT=347.462

UNSAT
TT=136.848

No dataUNSAT
TT=518.263

UNSAT
TT=517.759

No dataUNSAT
TT=1459.1

UNSAT
TT=823.094

? (TO)
TT=5000.08

UNSAT
TT=1553.8

UNSAT
TT=920.17

UNSAT
TT=842.47

UNSAT
TT=1572.89

No dataUNSAT
TT=847.78

No dataNo dataUNSAT
TT=3633.92

UNSAT
TT=3278.87

UNSAT
TT=3568.05

No dataNo dataUNSAT
TT=539.995

UNSAT
TT=1313.19

UNSAT
TT=1709.79

No dataNo dataNo dataNo dataUNSAT
TT=527.927

No dataUNSAT
TT=1680.08

No dataUNSAT
TT=1893.12

No dataNo dataNo dataNo dataUNSAT
TT=1132.66

No dataNo dataNo dataNo dataNo data
industrial/
fuhs/medium/
AProVE07-21.cnf
UNSAT
TT=34.34

No dataUNSAT
TT=713.699

UNSAT
TT=713.33

No dataNo dataUNSAT
TT=187.771

No dataNo dataUNSAT
TT=624.821

UNSAT
TT=572.905

UNSAT
TT=409.358

UNSAT
TT=403.234

UNSAT
TT=101.031

No dataNo dataUNSAT
TT=232.29

UNSAT
TT=79.589

UNSAT
TT=34.34

No dataUNSAT
TT=148.325

UNSAT
TT=162.15

No dataUNSAT
TT=306.315

UNSAT
TT=108.507

UNSAT
TT=274.566

UNSAT
TT=100.847

UNSAT
TT=231.616

UNSAT
TT=43.811

UNSAT
TT=120.82

No dataUNSAT
TT=216.215

No dataNo dataUNSAT
TT=576.601

UNSAT
TT=476.137

UNSAT
TT=468.699

No dataNo dataUNSAT
TT=100.639

UNSAT
TT=115.928

UNSAT
TT=144.245

No dataNo dataNo dataNo dataUNSAT
TT=159.779

No dataUNSAT
TT=89.432

No dataUNSAT
TT=381.297

No dataNo dataNo dataNo dataUNSAT
TT=531.24

No dataNo dataNo dataNo dataNo data
industrial/
IBM_FV_2002_13_rule_1/
SAT_dat.k100.cnf
UNSAT
TT=164.562

No data? (TO)
TT=40000.3

?
TT=39790.1

No dataNo data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=40001.2

? (TO)
TT=40001

UNSAT
TT=2809.53

UNSAT
TT=2324.67

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=399.507

UNSAT
TT=278.161

UNSAT
TT=164.562

No data? (TO)
TT=5000.11

? (TO)
TT=5000.08

No dataUNSAT
TT=3715.06

UNSAT
TT=4916.96

UNSAT
TT=3537.2

UNSAT
TT=174.445

? (TO)
TT=5000.1

UNSAT
TT=2996.74

UNSAT
TT=3454.79

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.9

? (TO)
TT=40000.5

? (TO)
TT=40000.5

No dataNo data? (TO)
TT=5000.13

UNSAT
TT=3253.32

UNSAT
TT=337.267

No dataNo dataNo dataNo dataUNSAT
TT=456.041

No dataUNSAT
TT=3040.25

No data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataUNSAT
TT=3969.54

No dataNo dataNo dataNo dataNo data
industrial/
IBM_FV_2002_13_rule_1/
SAT_dat.k20.cnf
UNSAT
TT=162.983

No data? (TO)
TT=40000.1

?
TT=39808.1

No dataNo data? (TO)
TT=5000.1

No dataNo dataWrong Cert.
TT=206.61

? (TO)
TT=40000.9

UNSAT
TT=3828.28

UNSAT
TT=3188.27

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=427.057

UNSAT
TT=309.206

UNSAT
TT=162.983

No data? (TO)
TT=5000.12

? (TO)
TT=5000.08

No dataUNSAT
TT=3387.73

UNSAT
TT=2904.5

UNSAT
TT=2471.29

UNSAT
TT=321.527

? (TO)
TT=5000.1

UNSAT
TT=2838.25

UNSAT
TT=2599.16

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.4

? (TO)
TT=40000.6

No dataNo data? (TO)
TT=5000.11

UNSAT
TT=4394.07

UNSAT
TT=368.123

No dataNo dataNo dataNo dataUNSAT
TT=1111.1

No dataUNSAT
TT=2358.87

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataUNSAT
TT=3801.99

No dataNo dataNo dataNo dataNo data
industrial/
IBM_FV_2002_13_rule_1/
SAT_dat.k45.cnf
UNSAT
TT=168.225

No data? (TO)
TT=40000.8

?
TT=39788.8

No dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.8

? (TO)
TT=40000.8

UNSAT
TT=2219.57

UNSAT
TT=2418.5

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=306.454

UNSAT
TT=263.83

UNSAT
TT=168.225

No data? (TO)
TT=5000.07

? (TO)
TT=5000.02

No dataUNSAT
TT=3732.83

UNSAT
TT=4923.53

UNSAT
TT=2961.09

UNSAT
TT=192.898

? (TO)
TT=5000.07

UNSAT
TT=4393.68

UNSAT
TT=1787

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.8

? (TO)
TT=40000.8

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=3700.08

UNSAT
TT=382.601

No dataNo dataNo dataNo dataUNSAT
TT=350.772

No dataUNSAT
TT=2440.35

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data
industrial/
IBM_FV_2002_13_rule_1/
SAT_dat.k80.cnf
UNSAT
TT=201.281

No data? (TO)
TT=40000.6

UNSAT
TT=39457.5

No dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=40001.3

? (TO)
TT=40001.4

UNSAT
TT=3034.81

UNSAT
TT=3075.25

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=272.241

UNSAT
TT=258.792

UNSAT
TT=201.281

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

No dataUNSAT
TT=4971.39

UNSAT
TT=4057.21

UNSAT
TT=3643.85

UNSAT
TT=319.058

? (TO)
TT=5000.1

? (TO)
TT=5000.1

UNSAT
TT=3061.29

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=40000.9

? (TO)
TT=40000.3

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=3445.72

UNSAT
TT=532.454

No dataNo dataNo dataNo dataUNSAT
TT=573.467

No dataUNSAT
TT=3451.62

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data
industrial/IBM_FV_2004_30/
IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf
SAT
TT=84.588

No dataSAT
TT=5604.37

SAT
TT=1373.62

No dataNo dataSAT
TT=2831.64

No dataNo dataSAT
TT=2085.42

SAT
TT=1652.82

SAT
TT=10248.8

SAT
TT=12934.3

SAT
TT=2387.24

No dataNo dataSAT
TT=537.852

SAT
TT=298.583

SAT
TT=2354.91

No dataSAT
TT=1548.59

SAT
TT=1360.07

No dataSAT
TT=778.47

SAT
TT=276.936

SAT
TT=84.588

SAT
TT=420.179

SAT
TT=237.892

SAT
TT=125.375

SAT
TT=826.061

No dataSAT
TT=1098.87

No dataNo dataSAT
TT=983.473

SAT
TT=6265.32

SAT
TT=4057.04

No dataNo data? (TO)
TT=5000.12

SAT
TT=316.831

SAT
TT=314.229

No dataNo dataNo dataNo dataSAT
TT=464.834

No dataSAT
TT=5792.71

No dataSAT
TT=457.46

No dataNo dataNo dataNo dataSAT
TT=860.44

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
industrial/IBM_FV_2004_30/
IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf
SAT
TT=49.135

No dataSAT
TT=8556.15

SAT
TT=3572.86

No dataNo data? (TO)
TT=5000.05

No dataNo dataSAT
TT=4415.38

SAT
TT=7551.55

SAT
TT=14978.6

SAT
TT=6291.82

? (TO)
TT=5000.09

No dataNo dataSAT
TT=378.736

SAT
TT=468.012

? (TO)
TT=5000.04

No dataSAT
TT=2384.27

SAT
TT=2617.69

No dataSAT
TT=70.407

SAT
TT=177.602

SAT
TT=507.077

SAT
TT=3734.07

SAT
TT=49.631

SAT
TT=183.408

SAT
TT=49.135

No dataSAT
TT=689.316

No dataNo dataSAT
TT=2414.53

SAT
TT=1615.14

SAT
TT=3172.5

No dataNo data? (TO)
TT=5000.15

SAT
TT=880.169

SAT
TT=1733.5

No dataNo dataNo dataNo dataSAT
TT=170.761

No dataSAT
TT=986.86

No dataSAT
TT=655.503

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
industrial/jarvisalo/
eq.atree.braun.11.unsat.cnf
UNSAT
TT=642.926

No dataUNSAT
TT=21933.3

UNSAT
TT=18497.7

No dataNo data? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=4458.08

UNSAT
TT=6306.54

UNSAT
TT=5685.18

UNSAT
TT=6027.25

UNSAT
TT=1940.1

No dataNo dataUNSAT
TT=4343.27

UNSAT
TT=1167.1

UNSAT
TT=2501.69

No dataUNSAT
TT=1501.01

UNSAT
TT=1641.24

No data? (TO)
TT=5000.04

UNSAT
TT=2510.62

? (TO)
TT=5000.1

? (TO)
TT=5000.08

UNSAT
TT=1699.03

UNSAT
TT=2358.62

? (TO)
TT=5000.09

No dataUNSAT
TT=642.926

No dataNo dataUNSAT
TT=9919.97

UNSAT
TT=8769.34

UNSAT
TT=7576.64

No dataNo dataUNSAT
TT=2065.66

? (TO)
TT=5000.09

UNSAT
TT=3910.84

No dataNo dataNo dataNo dataUNSAT
TT=3628.52

No dataUNSAT
TT=5453.06

No dataUNSAT
TT=1799.3

No dataNo dataNo dataNo dataUNSAT
TT=2228.59

No dataNo dataNo dataNo dataNo data
industrial/jarvisalo/
eq.atree.braun.12.unsat.cnf
UNSAT
TT=2847.01

No data? (TO)
TT=40000.6

?
TT=39839.4

No dataNo data? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=33037.2

UNSAT
TT=28740.1

? (TO)
TT=40000.4

? (TO)
TT=40000.5

? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No data? (TO)
TT=5000.03

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

? (TO)
TT=5000.04

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.11

? (TO)
TT=5000.09

? (TO)
TT=5000.12

No dataUNSAT
TT=2847.01

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.4

UNSAT
TT=33601

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.13

No data? (TO)
TT=20398.9

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo data
industrial/
manolios/
manol-pipe-f7idw.cnf
UNSAT
TT=19.094

No dataUNSAT
TT=438.083

UNSAT
TT=346.726

No dataNo dataUNSAT
TT=142.739

No dataNo dataUNSAT
TT=109.27

UNSAT
TT=283.651

UNSAT
TT=924.406

UNSAT
TT=959.966

UNSAT
TT=92.826

No dataNo dataUNSAT
TT=21.146

UNSAT
TT=22.887

UNSAT
TT=19.602

No dataUNSAT
TT=39.571

UNSAT
TT=39.515

No dataUNSAT
TT=83.4

UNSAT
TT=209.85

UNSAT
TT=185.219

UNSAT
TT=19.094

UNSAT
TT=705.807

UNSAT
TT=320.254

UNSAT
TT=1910.03

No dataUNSAT
TT=110.235

No dataNo dataUNSAT
TT=280.537

UNSAT
TT=285.601

UNSAT
TT=290.997

No dataNo dataUNSAT
TT=52.701

UNSAT
TT=1559

UNSAT
TT=39.838

No dataNo dataNo dataNo dataUNSAT
TT=44.292

No dataUNSAT
TT=51.544

No dataUNSAT
TT=24.846

No dataNo dataNo dataNo dataUNSAT
TT=133.78

No dataNo dataNo dataNo dataNo data
industrial/palacios/
hard/
sortnet-7-ipc5-h15-unsat.cnf



No data? (MO)
TT=4017.89

? (MO)
TT=4023.44

No dataNo data? (MO)
TT=2529.5

No dataNo data? (TO)
TT=40001.3

? (TO)
TT=40001.7

? (TO)
TT=40000.4

? (TO)
TT=40000.3

? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.11

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40000.6

? (TO)
TT=40000.9

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.03

? (TO)
TT=5000.11

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20389.9

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
industrial/palacios/
hard/
sortnet-8-ipc5-h19-sat.cnf
SAT
TT=1057.43

No data? (MO)
TT=2592.9

? (MO)
TT=2590.09

No dataNo data? (MO)
TT=1689.25

No dataNo dataSAT
TT=13072.3

? (TO)
TT=40001.6

? (TO)
TT=40000.5

? (TO)
TT=40000.7

? (TO)
TT=5000.17

No dataNo dataSAT
TT=4933.57

? (TO)
TT=5000

? (TO)
TT=5000.04

No dataSAT
TT=4038.87

SAT
TT=3990.07

No data? (TO)
TT=5000.08

? (TO)
TT=5000.03

? (TO)
TT=5000.15

? (TO)
TT=5000.07

? (TO)
TT=5000.08

SAT
TT=1057.43

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.2

SAT
TT=11450.2

No dataNo data? (TO)
TT=5000.12

? (TO)
TT=5000.03

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataSAT
TT=18306.7

No dataSAT
TT=3361.15

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data
industrial/palacios/
medium/
blocks-4-ipc5-h21-unknown.cnf
UNSAT
TT=10.166

No dataUNSAT
TT=208.372

UNSAT
TT=195.504

No dataNo dataUNSAT
TT=64.762

No dataNo dataUNSAT
TT=106.119

UNSAT
TT=120.675

UNSAT
TT=522.573

UNSAT
TT=532.839

UNSAT
TT=73.189

No dataNo dataUNSAT
TT=12.773

UNSAT
TT=10.166

UNSAT
TT=13.482

No dataUNSAT
TT=33.065

UNSAT
TT=33.127

No dataUNSAT
TT=19.42

UNSAT
TT=22.377

UNSAT
TT=12.104

UNSAT
TT=15.595

UNSAT
TT=13.151

UNSAT
TT=12.062

UNSAT
TT=12.957

No dataUNSAT
TT=15.53

No dataNo dataUNSAT
TT=204.191

UNSAT
TT=209.563

UNSAT
TT=135.762

No dataNo dataUNSAT
TT=21.244

UNSAT
TT=14.069

UNSAT
TT=18.565

No dataNo dataNo dataNo dataUNSAT
TT=13.536

No dataUNSAT
TT=17.002

No dataUNSAT
TT=48.889

No dataNo dataNo dataNo dataUNSAT
TT=106.74

No dataNo dataNo dataNo dataNo data
industrial/palacios/
medium/
cube-11-h14-sat.cnf
SAT
TT=336.92

No data? (MO)
TT=2278.61

? (MO)
TT=2359.89

No dataNo data? (MO)
TT=1579.3

No dataNo dataSAT
TT=923.89

SAT
TT=863.017

SAT
TT=2797.25

SAT
TT=9046.87

SAT
TT=374.039

No dataNo dataSAT
TT=336.92

SAT
TT=433.678

SAT
TT=357.507

No data? (TO)
TT=5000.06

? (TO)
TT=5000.06

No dataSAT
TT=1595.55

SAT
TT=1218.21

SAT
TT=938.798

SAT
TT=1013.7

SAT
TT=1334.03

SAT
TT=874.971

SAT
TT=983.942

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=17151.8

SAT
TT=14311.3

SAT
TT=7701.56

No dataNo data? (TO)
TT=5000.17

SAT
TT=1416.27

SAT
TT=1089.88

No dataNo dataNo dataNo dataSAT
TT=1147.48

No dataSAT
TT=669.564

No dataSignal
TT=446.266

No dataNo dataNo dataNo dataSAT
TT=922.12

No dataNo dataNo dataNo dataNo data
industrial/vliw_sat_4.0/
9vliw_m_9stages_iq3_C1_bug5.cnf
SAT
TT=6.523

No dataSAT
TT=884.982

SAT
TT=876.37

No dataNo dataSAT
TT=910.866

No dataNo data? (TO)
TT=5103.62

? (TO)
TT=5103.48

SAT
TT=2592.66

SAT
TT=4203.36

SAT
TT=747.766

No dataNo dataSAT
TT=14.807

SAT
TT=6.523

SAT
TT=58.294

No dataSAT
TT=58.625

SAT
TT=61.845

No dataSAT
TT=70.436

SAT
TT=74.101

SAT
TT=64.378

SAT
TT=240.811

SAT
TT=65.47

SAT
TT=11.185

SAT
TT=65.95

No dataSAT
TT=150.435

No dataNo dataSAT
TT=403.168

SAT
TT=300.348

SAT
TT=65.267

No dataNo dataSAT
TT=1508.62

SAT
TT=23.675

SAT
TT=76.11

No dataNo dataNo dataNo dataSAT
TT=15.996

No data? (exit code)
TT=32.489

No dataSAT
TT=324.691

No dataNo dataNo dataNo dataSAT
TT=866.18

No dataNo dataNo dataNo dataNo data
industrial/vliw_sat_4.0/
9vliw_m_9stages_iq3_C1_bug6.cnf
SAT
TT=6.879

No dataSAT
TT=826.876

? (TO)
TT=916.71

No dataNo dataSAT
TT=847.16

No dataNo dataSAT
TT=4485.32

SAT
TT=4509.59

SAT
TT=1630.51

SAT
TT=1138.03

SAT
TT=554.251

No dataNo dataSAT
TT=58.595

SAT
TT=6.879

SAT
TT=67.469

No dataSAT
TT=89.034

SAT
TT=88.758

No dataSAT
TT=96.496

SAT
TT=56.541

SAT
TT=73.536

SAT
TT=170.467

SAT
TT=59.87

SAT
TT=14.521

SAT
TT=55.213

No dataSAT
TT=208.896

No dataNo dataSAT
TT=413.606

SAT
TT=282.097

SAT
TT=27.453

No dataNo dataSAT
TT=844.537

SAT
TT=25.743

SAT
TT=75.875

No dataNo dataNo dataNo dataSAT
TT=7.305

No data? (exit code)
TT=80.077

No dataSAT
TT=197.246

No dataNo dataNo dataNo dataSAT
TT=767.82

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
industrial/
vliw_unsat_2.0/
9dlx_vliw_at_b_iq7.cnf
UNSAT
TT=441.7

No data? (MO)
TT=6554.82

? (MO)
TT=7150.19

No dataNo data? (MO)
TT=2773.79

No dataNo dataUNSAT
TT=9545.15

UNSAT
TT=8871.91

UNSAT
TT=7228.53

UNSAT
TT=7137.91

UNSAT
TT=1063.16

No dataNo dataUNSAT
TT=4539.33

UNSAT
TT=1839.82

UNSAT
TT=1116.97

No dataUNSAT
TT=1104.34

UNSAT
TT=1105.32

No dataUNSAT
TT=2348.3

? (TO)
TT=5000.06

? (TO)
TT=5000.19

UNSAT
TT=441.7

? (TO)
TT=5000.23

? (TO)
TT=5000.06

? (TO)
TT=5000.26

No data? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=10250.2

UNSAT
TT=10054.7

UNSAT
TT=7984.58

No dataNo dataUNSAT
TT=1310.6

? (TO)
TT=5000.05

? (TO)
TT=5000.18

No dataNo dataNo dataNo dataUNSAT
TT=2279.48

No data? (exit code)
TT=2453.03

No dataUNSAT
TT=4162.9

No dataNo dataNo dataNo dataUNSAT
TT=1617.69

No dataNo dataNo dataNo dataNo data
manol-pipe-c10nidw.cnf UNSAT
TT=132.277

No dataUNSAT
TT=2813.47

UNSAT
TT=2838.05

No dataNo dataUNSAT
TT=638.142

No dataNo dataUNSAT
TT=4324.2

UNSAT
TT=5110.18

UNSAT
TT=10750.7

UNSAT
TT=10571.3

UNSAT
TT=2119.36

No dataNo dataUNSAT
TT=324.507

UNSAT
TT=132.277

UNSAT
TT=224.663

No dataUNSAT
TT=389.748

UNSAT
TT=390.882

No dataUNSAT
TT=592.917

UNSAT
TT=258.996

UNSAT
TT=271.414

UNSAT
TT=431.788

UNSAT
TT=295.863

UNSAT
TT=150.328

UNSAT
TT=289.427

No dataUNSAT
TT=253.468

No dataNo dataUNSAT
TT=3224.24

UNSAT
TT=3384.41

UNSAT
TT=2241.99

No dataNo dataUNSAT
TT=1240.66

UNSAT
TT=271.36

UNSAT
TT=321.902

No dataNo dataNo dataNo dataUNSAT
TT=295.732

No dataUNSAT
TT=723.068

No dataUNSAT
TT=366.489

No dataNo dataNo dataNo dataUNSAT
TT=3085.86

No dataNo dataNo dataNo dataNo data
manol-pipe-c6bidw_i.cnf UNSAT
TT=12.665

No dataUNSAT
TT=294.219

UNSAT
TT=301.401

No dataNo dataUNSAT
TT=54.253

No dataNo dataUNSAT
TT=243.49

UNSAT
TT=203.792

UNSAT
TT=562.372

UNSAT
TT=559.465

UNSAT
TT=66.663

No dataNo dataUNSAT
TT=19.468

UNSAT
TT=12.665

UNSAT
TT=19.824

No dataUNSAT
TT=36.533

UNSAT
TT=36.485

No dataUNSAT
TT=27.77

UNSAT
TT=20.026

UNSAT
TT=18.675

UNSAT
TT=29.638

UNSAT
TT=20.54

UNSAT
TT=14.943

UNSAT
TT=19.711

No dataUNSAT
TT=50.744

No dataNo dataUNSAT
TT=273.988

UNSAT
TT=283.274

UNSAT
TT=276.08

No dataNo dataUNSAT
TT=37.153

UNSAT
TT=15.686

UNSAT
TT=26.935

No dataNo dataNo dataNo dataUNSAT
TT=19.844

No dataUNSAT
TT=41.861

No dataUNSAT
TT=28.011

No dataNo dataNo dataNo dataUNSAT
TT=100.86

No dataNo dataNo dataNo dataNo data
manol-pipe-f7nidw.cnf UNSAT
TT=23.708

No dataUNSAT
TT=553.085

UNSAT
TT=458.5

No dataNo dataUNSAT
TT=201.865

No dataNo dataUNSAT
TT=312.512

UNSAT
TT=323.688

UNSAT
TT=1587.42

UNSAT
TT=1691.5

UNSAT
TT=168.701

No dataNo dataUNSAT
TT=37.366

UNSAT
TT=45.824

UNSAT
TT=26.297

No dataUNSAT
TT=46.552

UNSAT
TT=50.874

No dataUNSAT
TT=66.834

UNSAT
TT=401.03

UNSAT
TT=71.415

UNSAT
TT=23.708

? (TO)
TT=5000.1

UNSAT
TT=274.242

UNSAT
TT=2139.04

No dataUNSAT
TT=67.352

No dataNo dataUNSAT
TT=347.964

UNSAT
TT=337.027

UNSAT
TT=351.341

No dataNo dataUNSAT
TT=105.975

UNSAT
TT=158.28

UNSAT
TT=39.012

No dataNo dataNo dataNo dataUNSAT
TT=47.615

No dataUNSAT
TT=79.42

No dataUNSAT
TT=31.31

No dataNo dataNo dataNo dataUNSAT
TT=141.31

No dataNo dataNo dataNo dataNo data
mizh-sha0-36-4.cnf SAT
TT=28.074

No dataSAT
TT=282.666

SAT
TT=508.837

No dataNo dataSAT
TT=361.736

No dataNo dataSAT
TT=272.87

SAT
TT=169.805

SAT
TT=155.156

SAT
TT=619.605

SAT
TT=130.362

No dataNo data? (TO)
TT=5000.1

SAT
TT=968.724

? (TO)
TT=5000.09

No dataSAT
TT=96.466

SAT
TT=96.243

No dataSAT
TT=45.305

SAT
TT=413.456

SAT
TT=76.088

? (TO)
TT=5000.11

SAT
TT=657.633

SAT
TT=443.536

SAT
TT=636.643

No dataSAT
TT=422.151

No dataNo dataSAT
TT=313.293

SAT
TT=127.064

SAT
TT=772.233

No dataNo dataSAT
TT=28.074

SAT
TT=261.231

SAT
TT=776.475

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataSAT
TT=831.996

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataSAT
TT=681

No dataNo dataNo dataNo dataNo data
random/large/
unif-k3-r4.2-v10000-c42000-S1091905403-047-UNKNOWN.cnf
SAT
TT=11.403

SAT
TT=496.796

No dataNo dataSAT
TT=4190.44

Wrong Cert.
TT=2375.3

No dataSAT
TT=471.205

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3246.44

SAT
TT=11.403

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=6149.17

SAT
TT=1617.63

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4999

SAT
TT=174.22

No dataSAT
TT=3805.9

No dataNo dataSAT
TT=671.303

No dataSAT
TT=200.179

random/large/
unif-k3-r4.2-v10000-c42000-S1256256213-053-UNKNOWN.cnf
SAT
TT=11.86

SAT
TT=379.85

No dataNo dataSAT
TT=258.845

SAT
TT=40.99

No dataSAT
TT=46.552

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=189.609

SAT
TT=12.312

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=84.84

No dataNo dataNo dataSAT
TT=415.714

SAT
TT=148.968

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=243.202

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=515.727

SAT
TT=11.86

No dataSAT
TT=598.91

No dataNo dataSAT
TT=367.899

No dataSAT
TT=13.332

random/large/
unif-k3-r4.2-v10000-c42000-S1778317451-042-UNKNOWN.cnf
SAT
TT=5.944

SAT
TT=262.701

No dataNo dataSAT
TT=35.714

SAT
TT=58.365

No dataSAT
TT=10.473

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=70.025

SAT
TT=5.944

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=148.562

No dataNo dataNo dataSAT
TT=1256.31

SAT
TT=194.136

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=656.348

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=240.536

SAT
TT=19.575

No dataSAT
TT=298.52

No dataNo dataSAT
TT=158.08

No dataSAT
TT=8.343

random/large/
unif-k3-r4.2-v10000-c42000-S338979727-056-UNKNOWN.cnf
SAT
TT=6.602

SAT
TT=391.99

No dataNo dataSAT
TT=185.556

SAT
TT=128.709

No dataSAT
TT=77.16

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=191.523

SAT
TT=6.602

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=286.772

No dataNo dataNo dataSAT
TT=574.331

SAT
TT=110.943

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=404.308

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=577.433

SAT
TT=33.563

No dataSAT
TT=304.24

No dataNo dataSAT
TT=366.778

No dataSAT
TT=22.065

random/large/
unif-k3-r4.2-v10000-c42000-S360796849-068-UNKNOWN.cnf
SAT
TT=12.007

SAT
TT=362.229

No dataNo dataSAT
TT=61.06

SAT
TT=55.844

No dataSAT
TT=70.546

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=156.685

SAT
TT=13.543

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=422.353

SAT
TT=149.502

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=427.179

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=397.928

SAT
TT=22.042

No dataSAT
TT=406.82

No dataNo dataSAT
TT=329.8

No dataSAT
TT=12.007

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v10000-c42000-S677627694-051-UNKNOWN.cnf
SAT
TT=2.53

SAT
TT=62.701

No dataNo dataSAT
TT=28.756

SAT
TT=14.936

No dataSAT
TT=5.695

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=32.385

SAT
TT=5.879

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=43.222

SAT
TT=103.238

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.659

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=93.904

SAT
TT=7.849

No dataSAT
TT=283.85

No dataNo dataSAT
TT=60.628

No dataSAT
TT=2.53

random/large/
unif-k3-r4.2-v10000-c42000-S709804505-031-UNKNOWN.cnf
SAT
TT=17.989

SAT
TT=349.749

No dataNo dataSAT
TT=320.006

SAT
TT=693.975

No dataSAT
TT=155.18

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=222.357

SAT
TT=33.599

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1545.64

No dataNo dataNo dataSAT
TT=4033.91

SAT
TT=2762.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=627.758

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=456.556

SAT
TT=165.853

No dataSAT
TT=413.21

No dataNo dataSAT
TT=469.727

No dataSAT
TT=17.989

random/large/
unif-k3-r4.2-v10000-c42000-S903594090-011-UNKNOWN.cnf
SAT
TT=4.163

SAT
TT=254.742

No dataNo dataSAT
TT=33.647

SAT
TT=30.16

No dataSAT
TT=14.291

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=63.305

SAT
TT=4.163

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=29.402

No dataNo dataNo dataSAT
TT=55.347

SAT
TT=149.064

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=238.838

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=441.784

SAT
TT=21.451

No dataSAT
TT=291.23

No dataNo dataSAT
TT=294.969

No dataSAT
TT=13.885

random/large/
unif-k3-r4.2-v10000-c42000-S963265686-085-UNKNOWN.cnf
SAT
TT=2.623

SAT
TT=99.937

No dataNo dataSAT
TT=42.229

SAT
TT=50.581

No dataSAT
TT=6.641

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=137.395

SAT
TT=2.623

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=734.204

SAT
TT=200.918

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=718.471

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=132.287

SAT
TT=21.166

No dataSAT
TT=280.82

No dataNo dataSAT
TT=315.933

No dataSAT
TT=11.597

random/large/
unif-k3-r4.2-v10000-c42000-S977705304-066-UNKNOWN.cnf
SAT
TT=9.93

SAT
TT=449.414

No dataNo dataSAT
TT=328.193

SAT
TT=1803.14

No dataSAT
TT=256.339

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=619.981

SAT
TT=120.008

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=766.307

SAT
TT=372.083

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=719.796

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=654.556

SAT
TT=83.569

No dataSAT
TT=4482.65

No dataNo dataSAT
TT=553.207

No dataSAT
TT=9.93

random/large/
unif-k3-r4.2-v15000-c63000-S1201608256-021-UNKNOWN.cnf
SAT
TT=18.29

SAT
TT=307.113

No dataNo dataSAT
TT=200.092

SAT
TT=215.599

No dataSAT
TT=43.529

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=219.598

SAT
TT=27.749

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=1513.99

SAT
TT=581.313

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4728.84

No data? (TO)
TT=5000.01

No dataNo dataSAT
TT=405.976

SAT
TT=74.795

No dataSAT
TT=1056.04

No dataNo dataSAT
TT=368.922

No dataSAT
TT=18.29

random/large/
unif-k3-r4.2-v15000-c63000-S1386494586-003-UNKNOWN.cnf
SAT
TT=33.138

SAT
TT=425.03

No dataNo dataSAT
TT=716.194

SAT
TT=380.08

No dataSAT
TT=295.333

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=346.697

SAT
TT=33.138

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=771.714

No dataNo dataNo dataSAT
TT=9228.74

SAT
TT=406.192

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2667.66

No data? (TO)
TT=4999.83

No dataNo dataSAT
TT=3367.6

SAT
TT=565.864

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=387.847

No dataSAT
TT=49.126

random/large/
unif-k3-r4.2-v15000-c63000-S1868678442-026-UNKNOWN.cnf
SAT
TT=22.545

SAT
TT=282.111

No dataNo dataSAT
TT=154.179

SAT
TT=164.669

No dataSAT
TT=30.239

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=114.599

SAT
TT=37.128

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=1950.71

SAT
TT=778.234

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=398.518

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=1437.88

SAT
TT=302.563

No dataSAT
TT=390.93

No dataNo dataSAT
TT=269.322

No dataSAT
TT=22.545

random/large/
unif-k3-r4.2-v15000-c63000-S38529837-091-UNKNOWN.cnf
SAT
TT=14.928

SAT
TT=163.23

No dataNo dataSAT
TT=121.386

SAT
TT=170.105

No dataSAT
TT=40.732

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=148.763

SAT
TT=14.928

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=163.831

No dataNo dataNo dataSAT
TT=2208.84

SAT
TT=94.72

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=428.887

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=158.878

SAT
TT=135.59

No dataSAT
TT=364.93

No dataNo dataSAT
TT=271.033

No dataSAT
TT=16.189

random/large/
unif-k3-r4.2-v15000-c63000-S43885340-006-UNKNOWN.cnf
SAT
TT=12.635

SAT
TT=407.855

No dataNo dataSAT
TT=78.199

SAT
TT=75.168

No dataSAT
TT=35.207

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=184.504

SAT
TT=13.285

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=2346.22

SAT
TT=329.736

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=740.719

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=421.914

SAT
TT=90.874

No dataSAT
TT=296.75

No dataNo dataSAT
TT=315.478

No dataSAT
TT=12.635

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v15000-c63000-S594553190-015-UNKNOWN.cnf
SAT
TT=451.768

SAT
TT=595.813

No dataNo dataSAT
TT=6209.52

SAT
TT=6279.69

No dataSAT
TT=2740.93

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2347.91

SAT
TT=605.156

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2342.89

No dataNo dataNo data? (TO)
TT=39965.3

SAT
TT=960.89

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.76

SAT
TT=653.991

No dataSAT
TT=998.44

No dataNo dataSAT
TT=548.123

No dataSAT
TT=451.768

random/large/
unif-k3-r4.2-v15000-c63000-S619136916-059-UNKNOWN.cnf
SAT
TT=39.185

SAT
TT=530.183

No dataNo dataSAT
TT=578.971

SAT
TT=464.418

No dataSAT
TT=61.502

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=300.178

SAT
TT=39.185

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=1214.9

SAT
TT=320.75

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4274.78

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=861.698

SAT
TT=478.056

No dataSAT
TT=627.62

No dataNo dataSAT
TT=420.472

No dataSAT
TT=53.368

random/large/
unif-k3-r4.2-v15000-c63000-S89201333-019-UNKNOWN.cnf
SAT
TT=46.633

SAT
TT=429.401

No dataNo dataSAT
TT=1242.82

SAT
TT=448.107

No dataSAT
TT=1004.63

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=508.884

SAT
TT=98.748

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=1257.91

SAT
TT=2980.61

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1194

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=2270.63

SAT
TT=350.061

No dataSAT
TT=1450.56

No dataNo dataSAT
TT=703.72

No dataSAT
TT=46.633

random/large/
unif-k3-r4.2-v15000-c63000-S976131144-051-UNKNOWN.cnf
SAT
TT=12.027

SAT
TT=316.203

No dataNo dataSAT
TT=143.928

SAT
TT=73.292

No dataSAT
TT=49.108

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=324.352

SAT
TT=12.027

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=532.654

No dataNo dataNo dataSAT
TT=2701.37

SAT
TT=169.131

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=609.099

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=587.421

SAT
TT=522.434

No dataSAT
TT=292.95

No dataNo dataSAT
TT=332.007

No dataSAT
TT=16.458

random/large/
unif-k3-r4.2-v15000-c63000-S980027332-029-UNKNOWN.cnf
SAT
TT=4.892

SAT
TT=366.108

No dataNo dataSAT
TT=677.723

SAT
TT=544.068

No dataSAT
TT=431.632

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=296.453

SAT
TT=4.892

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1722.55

No dataNo dataNo dataSAT
TT=13781.2

SAT
TT=1048.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=875.359

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=1028.53

SAT
TT=116.957

No dataSAT
TT=965.42

No dataNo dataSAT
TT=679.531

No dataSAT
TT=31.484

random/large/
unif-k3-r4.2-v20000-c84000-S1204913987-029-UNKNOWN.cnf
SAT
TT=8.624

SAT
TT=220.385

No dataNo dataSAT
TT=154.406

SAT
TT=153.784

No dataSAT
TT=38.927

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=120.365

SAT
TT=9.951

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1042.69

No dataNo dataNo dataSAT
TT=2138.79

SAT
TT=299.492

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=798.556

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=209.358

SAT
TT=269.212

No dataSAT
TT=415.67

No dataNo dataSAT
TT=131.042

No dataSAT
TT=8.624

random/large/
unif-k3-r4.2-v20000-c84000-S1298436766-097-UNKNOWN.cnf
SAT
TT=85.363

SAT
TT=780.41

No dataNo data? (MO)
TT=11781.6

SAT
TT=5867.91

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3079.6

SAT
TT=85.363

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=5698.19

SAT
TT=699.817

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4044.01

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.67

? (TO)
TT=5000.09

No data? (TO)
TT=4992.23

No dataNo dataSAT
TT=812.432

No dataSAT
TT=191.246

random/large/
unif-k3-r4.2-v20000-c84000-S1778371838-017-UNKNOWN.cnf
SAT
TT=21.853

SAT
TT=567.962

No dataNo dataSAT
TT=413.244

SAT
TT=478.815

No dataSAT
TT=381.972

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=237.986

SAT
TT=46.797

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=1774.85

SAT
TT=1012.43

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=1979.96

SAT
TT=150.955

No data? (TO)
TT=4999.97

No dataNo dataSAT
TT=306.605

No dataSAT
TT=21.853

random/large/
unif-k3-r4.2-v20000-c84000-S313385224-076-UNKNOWN.cnf
SAT
TT=35.015

SAT
TT=274.742

No dataNo dataSAT
TT=238.149

SAT
TT=142.239

No dataSAT
TT=32.446

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=352.862

SAT
TT=79.545

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=346.083

No dataNo dataNo dataSAT
TT=8484.73

SAT
TT=373.457

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3792.62

No data? (TO)
TT=5000.02

No dataNo dataSAT
TT=1715.33

SAT
TT=1065.64

No dataSAT
TT=634.24

No dataNo dataSAT
TT=273.38

No dataSAT
TT=35.015

random/large/
unif-k3-r4.2-v20000-c84000-S357264423-067-UNKNOWN.cnf
SAT
TT=186.403

SAT
TT=1232.63

No dataNo dataSAT
TT=2062.79

SAT
TT=2291.1

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8603.77

SAT
TT=570.609

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=1354.98

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.94

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.79

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=1012.77

No dataSAT
TT=186.403

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v20000-c84000-S493397373-056-UNKNOWN.cnf
SAT
TT=21.061

SAT
TT=790.488

No dataNo dataSAT
TT=571.631

SAT
TT=545.833

No dataSAT
TT=323.528

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=502.106

SAT
TT=21.061

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1226.58

No dataNo dataNo dataSAT
TT=7690.15

SAT
TT=1976.74

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.98

SAT
TT=1087.56

No dataSAT
TT=1183.81

No dataNo dataSAT
TT=363.275

No dataSAT
TT=69.617

random/large/
unif-k3-r4.2-v20000-c84000-S525505471-054-UNKNOWN.cnf
SAT
TT=9.222

SAT
TT=219.39

No dataNo dataSAT
TT=410.106

SAT
TT=243.851

No dataSAT
TT=62.896

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=544.736

SAT
TT=9.222

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=505.292

No dataNo dataNo dataSAT
TT=1492.66

SAT
TT=228.049

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1767.49

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=825.782

SAT
TT=399.308

No dataSAT
TT=299.52

No dataNo dataSAT
TT=234.777

No dataSAT
TT=13.793

random/large/
unif-k3-r4.2-v20000-c84000-S840292785-048-UNKNOWN.cnf
SAT
TT=23.472

SAT
TT=392.742

No dataNo dataSAT
TT=300.514

SAT
TT=545.809

No dataSAT
TT=23.928

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=219.828

SAT
TT=39.518

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=1891.36

SAT
TT=341.318

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1551.13

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=294.583

SAT
TT=1759.93

No dataSAT
TT=1589.6

No dataNo dataSAT
TT=315.348

No dataSAT
TT=23.472

random/large/
unif-k3-r4.2-v20000-c84000-S878494004-057-UNKNOWN.cnf
SAT
TT=76.793

SAT
TT=282.641

No dataNo dataSAT
TT=421.911

SAT
TT=212.562

No dataSAT
TT=46.916

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=326.507

SAT
TT=76.793

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=234.547

No dataNo dataNo dataSAT
TT=1772.87

SAT
TT=3075.78

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2450.7

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=1184.11

SAT
TT=131.953

No data? (TO)
TT=5000

No dataNo dataSAT
TT=329.597

No dataSAT
TT=79.053

random/large/
unif-k3-r4.2-v20000-c84000-S921718479-079-UNKNOWN.cnf
SAT
TT=76.446

SAT
TT=1654.13

No dataNo dataSAT
TT=734.118

SAT
TT=1877.31

No dataSAT
TT=295.966

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6797.75

SAT
TT=334.106

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2461.22

No dataNo dataNo dataSAT
TT=7360.1

SAT
TT=4067.85

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=4999.93

No dataNo dataSAT
TT=4723.07

SAT
TT=605.132

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=1549.21

No dataSAT
TT=76.446

random/large/
unif-k3-r4.2-v25000-c105000-S109959541-056-UNKNOWN.cnf
SAT
TT=143.357

SAT
TT=1383.19

No dataNo dataSAT
TT=722.779

SAT
TT=1164.82

No dataSAT
TT=4901.43

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=673.72

SAT
TT=1202.83

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=39970.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.47

SAT
TT=573.599

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=2879.51

No dataSAT
TT=143.357

random/large/
unif-k3-r4.2-v25000-c105000-S1233052734-067-UNKNOWN.cnf
SAT
TT=21.352

SAT
TT=256.614

No dataNo dataSAT
TT=354.416

SAT
TT=324.884

No dataSAT
TT=58.812

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=237.544

SAT
TT=21.352

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.84

No dataNo dataNo dataSAT
TT=4739.84

SAT
TT=1342.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1221.92

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.57

SAT
TT=533.43

No dataSAT
TT=1385.56

No dataNo dataSAT
TT=112.269

No dataSAT
TT=52.75

random/large/
unif-k3-r4.2-v25000-c105000-S1838224332-006-UNKNOWN.cnf
SAT
TT=96.167

SAT
TT=591.71

No dataNo dataSAT
TT=14130.6

SAT
TT=6217.45

No dataSAT
TT=2712.22

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4675.71

SAT
TT=479.701

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=19306

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.5

SAT
TT=3752.29

No dataSAT
TT=1593.44

No dataNo dataSAT
TT=2791.62

No dataSAT
TT=96.167

random/large/
unif-k3-r4.2-v25000-c105000-S269939581-066-UNKNOWN.cnf
SAT
TT=28.882

SAT
TT=738.554

No dataNo dataSAT
TT=462.932

SAT
TT=762.33

No dataSAT
TT=280.9

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=288.958

SAT
TT=28.882

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=860.968

No dataNo dataNo dataSAT
TT=2576.34

SAT
TT=948.181

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4577.74

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=2546.78

SAT
TT=533.204

No dataSAT
TT=980.09

No dataNo dataSAT
TT=460.381

No dataSAT
TT=47.596

random/large/
unif-k3-r4.2-v25000-c105000-S30704505-092-UNKNOWN.cnf
SAT
TT=197.603

SAT
TT=3214.08

No dataNo dataSAT
TT=12538.1

SAT
TT=10379.9

No dataSAT
TT=3351.86

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=36354.5

SAT
TT=285.128

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39970.3

SAT
TT=3109.93

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.64

? (TO)
TT=5000.04

No data? (TO)
TT=4999.92

No dataNo dataSAT
TT=3329.85

No dataSAT
TT=197.603

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v25000-c105000-S5267991-057-UNKNOWN.cnf
SAT
TT=55.633

SAT
TT=463.989

No dataNo dataSAT
TT=1523.92

SAT
TT=8748.37

No dataSAT
TT=1262.63

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6005.44

SAT
TT=279.938

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=10313.4

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.68

SAT
TT=1672.46

No dataSAT
TT=2961.88

No dataNo dataSAT
TT=2735.89

No dataSAT
TT=55.633

random/large/
unif-k3-r4.2-v25000-c105000-S533496308-018-UNKNOWN.cnf
SAT
TT=303.975

SAT
TT=4064.88

No dataNo dataSAT
TT=4492.26

SAT
TT=2983.34

No dataSAT
TT=2378.5

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9576.56

SAT
TT=303.975

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=17359.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.79

SAT
TT=3010.18

No dataSAT
TT=1550.64

No dataNo dataSAT
TT=1155.47

No dataSAT
TT=435.148

random/large/
unif-k3-r4.2-v25000-c105000-S808762165-030-UNKNOWN.cnf
SAT
TT=15.577

SAT
TT=260.199

No dataNo dataSAT
TT=176.851

SAT
TT=374.147

No dataSAT
TT=60.997

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=297.415

SAT
TT=15.577

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=2433.78

SAT
TT=1283.57

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1779.18

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.77

SAT
TT=112.487

No dataSAT
TT=305.72

No dataNo dataSAT
TT=271.468

No dataSAT
TT=47.068

random/large/
unif-k3-r4.2-v25000-c105000-S919014656-003-UNKNOWN.cnf
SAT
TT=30.614

SAT
TT=1242.73

No dataNo dataSAT
TT=848.419

SAT
TT=275.447

No dataSAT
TT=71.847

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=465.623

SAT
TT=55.711

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=7692.7

SAT
TT=570.229

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4336.9

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.85

SAT
TT=358.718

No dataSAT
TT=986.66

No dataNo dataSAT
TT=404.34

No dataSAT
TT=30.614

random/large/
unif-k3-r4.2-v25000-c105000-S92008434-079-UNKNOWN.cnf
SAT
TT=28.479

SAT
TT=370.233

No dataNo dataSAT
TT=1046.5

SAT
TT=467.686

No dataSAT
TT=197.702

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1354.56

SAT
TT=39.875

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=4473.39

? (TO)
TT=4999.9

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3959.4

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4998.71

SAT
TT=2193.07

No dataSAT
TT=1178.06

No dataNo dataSAT
TT=793.259

No dataSAT
TT=28.479

random/large/
unif-k3-r4.2-v2500-c10500-S1201761407-024-UNKNOWN.cnf
SAT
TT=0.37

SAT
TT=23.726

No dataNo dataSAT
TT=12.678

SAT
TT=15.477

No dataSAT
TT=4.486

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.069

SAT
TT=0.37

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=19.245

No dataNo dataNo dataSAT
TT=19.629

SAT
TT=10.289

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.871

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=70.789

SAT
TT=4.425

No dataSAT
TT=23.957

No dataNo dataSAT
TT=2.484

No dataSAT
TT=3.437

random/large/
unif-k3-r4.2-v2500-c10500-S1300417189-038-UNKNOWN.cnf
SAT
TT=0.157

SAT
TT=1.619

No dataNo dataSAT
TT=3.226

SAT
TT=2.758

No dataSAT
TT=1.493

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.492

SAT
TT=0.654

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=7.76

SAT
TT=2.468

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.488

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=2.585

SAT
TT=0.157

No dataSAT
TT=24.235

No dataNo dataSAT
TT=8.19

No dataSAT
TT=0.707

random/large/
unif-k3-r4.2-v2500-c10500-S1907658523-004-UNKNOWN.cnf
SAT
TT=0.287

SAT
TT=5.615

No dataNo dataSAT
TT=6.763

SAT
TT=5.454

No dataSAT
TT=1.889

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.076

SAT
TT=1.056

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=15.97

SAT
TT=13.316

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.631

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=69.369

SAT
TT=0.341

No dataSAT
TT=26.03

No dataNo dataSAT
TT=2.814

No dataSAT
TT=0.287

random/large/
unif-k3-r4.2-v2500-c10500-S374960214-041-UNKNOWN.cnf
SAT
TT=2.284

SAT
TT=13.512

No dataNo dataSAT
TT=53.189

SAT
TT=3.041

No dataSAT
TT=19.2

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.989

SAT
TT=2.284

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=19.741

No dataNo dataNo dataSAT
TT=356.42

SAT
TT=39.27

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.035

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=9.39

SAT
TT=8.876

No dataSAT
TT=289.23

No dataNo dataSAT
TT=43.95

No dataSAT
TT=6.803

random/large/
unif-k3-r4.2-v2500-c10500-S49783605-066-UNKNOWN.cnf
SAT
TT=0.659

SAT
TT=2.989

No dataNo dataSAT
TT=9.718

SAT
TT=4.855

No dataSAT
TT=2.543

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.912

SAT
TT=0.747

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=18.936

No dataNo dataNo dataSAT
TT=17.592

SAT
TT=8.851

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.188

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=18.668

SAT
TT=2.629

No dataSAT
TT=26.53

No dataNo dataSAT
TT=1.922

No dataSAT
TT=0.659

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v2500-c10500-S705365444-036-UNKNOWN.cnf
SAT
TT=2.496

SAT
TT=105.478

No dataNo dataSAT
TT=648.473

SAT
TT=434.922

No dataWrong Cert.
TT=1124.25

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2477.72

SAT
TT=2.496

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=118.676

No dataNo dataNo dataSAT
TT=2296.02

SAT
TT=216.864

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=302.128

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=613.169

SAT
TT=522.814

No dataSAT
TT=388.21

No dataNo dataSAT
TT=786.077

No dataSAT
TT=50.435

random/large/
unif-k3-r4.2-v2500-c10500-S722024572-014-UNKNOWN.cnf
SAT
TT=0.204

SAT
TT=4.06

No dataNo dataSAT
TT=4.047

SAT
TT=3.326

No dataSAT
TT=1.113

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.229

SAT
TT=0.204

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=17.345

No dataNo dataNo dataSAT
TT=6.745

SAT
TT=0.985

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.039

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=6.536

SAT
TT=0.748

No dataSAT
TT=25.34

No dataNo dataSAT
TT=2.403

No dataSAT
TT=0.275

random/large/
unif-k3-r4.2-v2500-c10500-S882087907-088-UNKNOWN.cnf
SAT
TT=0.338

SAT
TT=15.555

No dataNo dataSAT
TT=14.638

SAT
TT=16.235

No dataSAT
TT=103.129

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=25.006

SAT
TT=0.338

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=25.624

No dataNo dataNo dataSAT
TT=95.407

SAT
TT=9.424

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=31.701

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=73.972

SAT
TT=6.184

No dataSAT
TT=297.53

No dataNo dataSAT
TT=41.423

No dataSAT
TT=1.706

random/large/
unif-k3-r4.2-v2500-c10500-S89508070-083-UNKNOWN.cnf
SAT
TT=0.073

SAT
TT=0.39

No dataNo dataSAT
TT=2.012

? (exit code)
TT=2.075

No dataSAT
TT=1.231

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.418

SAT
TT=0.073

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=17.243

No dataNo dataNo dataSAT
TT=1.057

SAT
TT=1.289

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.156

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=0.806

SAT
TT=0.515

No dataSAT
TT=23.958

No dataNo dataSAT
TT=0.923

No dataSAT
TT=0.25

random/large/
unif-k3-r4.2-v2500-c10500-S924370159-018-UNKNOWN.cnf
SAT
TT=1.913

SAT
TT=111.601

No dataNo dataSAT
TT=38.666

SAT
TT=36.875

No dataSAT
TT=2.661

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.393

SAT
TT=3.773

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=18.335

No dataNo dataNo dataSAT
TT=5.376

SAT
TT=88.659

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.591

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=69.847

SAT
TT=23.341

No dataSAT
TT=292.34

No dataNo dataSAT
TT=316.434

No dataSAT
TT=1.913

random/large/
unif-k3-r4.2-v30000-c126000-S1196935200-064-UNKNOWN.cnf
SAT
TT=56.489

SAT
TT=2031.21

No dataNo dataSAT
TT=6780.27

? (MO)
TT=10997.3

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=18591.2

SAT
TT=591.4

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=8207.56

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.73

? (TO)
TT=5000.09

No data? (TO)
TT=4999.96

No dataNo data? (TO)
TT=5000.12

No dataSAT
TT=56.489

random/large/
unif-k3-r4.2-v30000-c126000-S1354319962-100-UNKNOWN.cnf
SAT
TT=129.4

SAT
TT=347.434

No dataNo dataSAT
TT=487.457

SAT
TT=732.167

No dataSAT
TT=247.988

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=284.288

SAT
TT=129.4

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=27364.2

SAT
TT=1425.33

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.81

SAT
TT=1818.88

No dataSAT
TT=1803.76

No dataNo dataSAT
TT=778.293

No dataSAT
TT=148.484

random/large/
unif-k3-r4.2-v30000-c126000-S1854039067-041-UNKNOWN.cnf
SAT
TT=205.402

? (TO)
TT=5000.09

No dataNo dataSAT
TT=891.587

SAT
TT=1890.57

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=37754.6

SAT
TT=316.53

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=39971.8

SAT
TT=3539.89

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.69

SAT
TT=937.266

No data? (TO)
TT=4999.95

No dataNo dataSAT
TT=4932

No dataSAT
TT=205.402

random/large/
unif-k3-r4.2-v30000-c126000-S285324961-078-UNKNOWN.cnf
SAT
TT=32.904

SAT
TT=486.886

No dataNo dataSAT
TT=287.402

SAT
TT=493.384

No dataSAT
TT=83.864

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=198.391

SAT
TT=32.904

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.98

No dataNo dataNo dataSAT
TT=4514.84

SAT
TT=2098.7

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.79

SAT
TT=390.364

No dataSAT
TT=1311.43

No dataNo dataSAT
TT=332.984

No dataSAT
TT=39.821

random/large/
unif-k3-r4.2-v30000-c126000-S379804333-028-UNKNOWN.cnf
SAT
TT=144.181

SAT
TT=498.188

No dataNo dataSAT
TT=1047.16

SAT
TT=826.611

No dataSAT
TT=103.526

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=681.087

SAT
TT=144.181

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=12809.3

SAT
TT=3162.79

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.63

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.7

SAT
TT=1916.55

No dataSAT
TT=803.1

No dataNo dataSAT
TT=404.745

No dataSAT
TT=268.1

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v30000-c126000-S629207485-001-UNKNOWN.cnf
SAT
TT=30.546

SAT
TT=363.954

No dataNo dataSAT
TT=792.919

SAT
TT=635.776

No dataSAT
TT=330.101

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=544.99

SAT
TT=73.665

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataSAT
TT=5125.8

SAT
TT=2091.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.5

SAT
TT=948.226

No dataSAT
TT=3956.78

No dataNo dataSAT
TT=286.209

No dataSAT
TT=30.546

random/large/
unif-k3-r4.2-v30000-c126000-S643238994-057-UNKNOWN.cnf
SAT
TT=91.304

SAT
TT=974.65

No dataNo dataSAT
TT=2599.88

SAT
TT=2338.44

No dataSAT
TT=3523.89

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2464.27

SAT
TT=658.941

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=37172

SAT
TT=3927.33

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.48

SAT
TT=3464.44

No dataSAT
TT=1577.24

No dataNo dataSAT
TT=2124.25

No dataSAT
TT=91.304

random/large/
unif-k3-r4.2-v30000-c126000-S858279511-076-UNKNOWN.cnf
SAT
TT=92.445

SAT
TT=643.458

No dataNo dataSAT
TT=2905.45

SAT
TT=6415.33

No dataSAT
TT=334.5

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5186.71

SAT
TT=362.732

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.58

? (TO)
TT=5000.09

No dataSAT
TT=2328.55

No dataNo dataSAT
TT=1772.28

No dataSAT
TT=92.445

random/large/
unif-k3-r4.2-v30000-c126000-S913491256-073-UNKNOWN.cnf
SAT
TT=222.412

? (TO)
TT=5000.09

No dataNo dataSAT
TT=3526.7

? (MO)
TT=10911.4

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=15323.3

SAT
TT=222.412

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39970.1

SAT
TT=4315.55

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.73

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=624.387

random/large/
unif-k3-r4.2-v30000-c126000-S926207202-053-UNKNOWN.cnf
SAT
TT=45.392

SAT
TT=1826.95

No dataNo dataSAT
TT=515.687

SAT
TT=843.105

No dataSAT
TT=182.964

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=752.781

SAT
TT=118.539

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=15350

SAT
TT=2708.4

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.69

SAT
TT=1513.14

No dataSAT
TT=727.22

No dataNo dataSAT
TT=395.06

No dataSAT
TT=45.392

random/large/
unif-k3-r4.2-v35000-c147000-S1098107876-060-UNKNOWN.cnf
SAT
TT=108.77

SAT
TT=177.324

No dataNo dataSAT
TT=1103.04

SAT
TT=1188.58

No dataSAT
TT=1426.32

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=426.998

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=1747.88

SAT
TT=2703.91

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.44

SAT
TT=852.7

No dataSAT
TT=1814.28

No dataNo dataSAT
TT=563.265

No dataSAT
TT=108.77

random/large/
unif-k3-r4.2-v35000-c147000-S1268831169-016-UNKNOWN.cnf
SAT
TT=96.977

SAT
TT=612.257

No dataNo dataSAT
TT=2401.95

SAT
TT=859.069

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3629.32

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataSAT
TT=11205.6

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4998.72

SAT
TT=716.72

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=2287.15

No dataSAT
TT=96.977

random/large/
unif-k3-r4.2-v35000-c147000-S1886449473-022-UNKNOWN.cnf
SAT
TT=596.17

SAT
TT=692.433

No dataNo data? (MO)
TT=8489.99

SAT
TT=6424.99

No data? (MO)
TT=2869.05

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=652.121

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=18905.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.83

SAT
TT=2752.86

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=2307.06

No dataSAT
TT=596.17

random/large/
unif-k3-r4.2-v35000-c147000-S419010076-063-UNKNOWN.cnf
SAT
TT=235.041

SAT
TT=1310.79

No dataNo data? (MO)
TT=17181.8

? (MO)
TT=7803.3

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38316.8

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39971

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.77

? (TO)
TT=5000.09

No data? (TO)
TT=4999.66

No dataNo dataSAT
TT=3048.64

No dataSAT
TT=235.041

random/large/
unif-k3-r4.2-v35000-c147000-S448503257-098-UNKNOWN.cnf
SAT
TT=292.147

SAT
TT=910.021

No dataNo dataSAT
TT=1330.77

SAT
TT=14569.6

No data? (MO)
TT=2967.71

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=37899.7

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=18060.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.12

No dataNo data? (exit code)
TT=4998.92

SAT
TT=1797.9

No dataSAT
TT=2627.76

No dataNo dataSAT
TT=1099.08

No dataSAT
TT=292.147

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v35000-c147000-S625465881-078-UNKNOWN.cnf
SAT
TT=363.637

SAT
TT=2297.88

No dataNo dataSAT
TT=11713.3

? (MO)
TT=7886.4

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6053.7

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39969.5

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.82

? (TO)
TT=5000.11

No data? (TO)
TT=4999.99

No dataNo dataSAT
TT=382.735

No dataSAT
TT=363.637

random/large/
unif-k3-r4.2-v35000-c147000-S648642831-094-UNKNOWN.cnf
SAT
TT=144.491

? (TO)
TT=5000.07

No dataNo data? (MO)
TT=7086.74

? (MO)
TT=11741

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38143.1

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=39963

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.81

? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=144.491

random/large/
unif-k3-r4.2-v35000-c147000-S883457431-033-UNKNOWN.cnf
SAT
TT=132.892

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=7870.86

? (MO)
TT=18933.6

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38096.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.96

No dataNo dataNo data? (TO)
TT=39970.9

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.86

? (TO)
TT=5000.05

No data? (TO)
TT=5000

No dataNo dataSAT
TT=2030.73

No dataSAT
TT=132.892

random/large/
unif-k3-r4.2-v35000-c147000-S950666065-093-UNKNOWN.cnf
SAT
TT=262.183

? (TO)
TT=5000.08

No dataNo data? (MO)
TT=11763.7

? (MO)
TT=17938.1

No data? (TO)
TT=4749.41

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38019

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39970.1

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.69

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=262.183

random/large/
unif-k3-r4.2-v35000-c147000-S970100151-015-UNKNOWN.cnf
SAT
TT=152.918

SAT
TT=597.567

No dataNo data? (MO)
TT=25497.4

? (MO)
TT=18619.2

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=23594.1

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.99

No dataNo dataNo dataSAT
TT=18800.7

? (TO)
TT=4999.75

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.7

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.09

No dataSAT
TT=152.918

random/large/
unif-k3-r4.2-v40000-c168000-S1184456903-078-UNKNOWN.cnf
SAT
TT=108.505

SAT
TT=1049.46

No dataNo data? (MO)
TT=7175.13

? (MO)
TT=7734.48

No dataSAT
TT=1640.17

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1509.17

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39970.4

SAT
TT=3422.92

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4999.04

? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

No dataNo dataSAT
TT=3802.59

No dataSAT
TT=108.505

random/large/
unif-k3-r4.2-v40000-c168000-S1368340883-085-UNKNOWN.cnf
SAT
TT=58.157

SAT
TT=827.008

No dataNo dataSAT
TT=5010.65

SAT
TT=1410.82

No dataSAT
TT=464.996

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=584.292

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataSAT
TT=9554.17

SAT
TT=3366.65

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

No dataNo data? (exit code)
TT=4999.26

SAT
TT=249.501

No dataSAT
TT=2913.37

No dataNo dataSAT
TT=295.825

No dataSAT
TT=58.157

random/large/
unif-k3-r4.2-v40000-c168000-S1920335371-069-UNKNOWN.cnf
SAT
TT=146.816

SAT
TT=293.975

No dataNo dataSAT
TT=2483.61

SAT
TT=1360.28

No dataSAT
TT=337.078

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=631.046

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39970.1

SAT
TT=3645.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4999.23

SAT
TT=4239.93

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=776.183

No dataSAT
TT=146.816

random/large/
unif-k3-r4.2-v40000-c168000-S386300535-065-UNKNOWN.cnf
SAT
TT=1217.09

? (TO)
TT=5000.07

No dataNo data? (MO)
TT=9423.43

? (MO)
TT=7215.06

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38350.5

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39969.9

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.58

SAT
TT=3986.84

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=4815.98

No dataSAT
TT=1217.09

random/large/
unif-k3-r4.2-v40000-c168000-S471691933-060-UNKNOWN.cnf
SAT
TT=593.197

? (TO)
TT=5000.09

No dataNo data? (MO)
TT=9517.73

? (MO)
TT=11581.3

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38361.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39969.6

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4999.11

? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.09

No dataSAT
TT=593.197

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v40000-c168000-S64788608-008-UNKNOWN.cnf
SAT
TT=52.105

SAT
TT=653.217

No dataNo data? (MO)
TT=8593.24

SAT
TT=7523.65

No dataSAT
TT=391.801

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=919.095

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=18585.4

SAT
TT=4374.76

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4999.13

SAT
TT=1424.47

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=404.812

No dataSAT
TT=52.105

random/large/
unif-k3-r4.2-v40000-c168000-S709305826-098-UNKNOWN.cnf
SAT
TT=58.574

SAT
TT=596.634

No dataNo data? (MO)
TT=7747.18

SAT
TT=3122.84

No dataSAT
TT=368.499

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=939.157

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataSAT
TT=11149.9

SAT
TT=1449.26

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4999.2

SAT
TT=1051.87

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=331.609

No dataSAT
TT=58.574

random/large/
unif-k3-r4.2-v40000-c168000-S845438593-067-UNKNOWN.cnf
SAT
TT=92.719

SAT
TT=3027.97

No dataNo data? (MO)
TT=13347.4

? (MO)
TT=7200.16

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3675.95

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39970.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4999.01

SAT
TT=1821.13

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.05

No dataSAT
TT=92.719

random/large/
unif-k3-r4.2-v40000-c168000-S895938734-057-UNKNOWN.cnf
SAT
TT=168.805

SAT
TT=2334.79

No dataNo dataSAT
TT=5508.23

? (MO)
TT=7217.98

No dataSAT
TT=1882.06

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=553.052

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=7453.07

SAT
TT=1918.92

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.69

SAT
TT=3551.85

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=298.334

No dataSAT
TT=168.805

random/large/
unif-k3-r4.2-v40000-c168000-S907804052-003-UNKNOWN.cnf
SAT
TT=200.801

SAT
TT=3414.57

No dataNo dataSAT
TT=6391.71

? (MO)
TT=7540.54

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2027.36

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=17076.8

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4998.53

SAT
TT=975.969

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=1344.59

No dataSAT
TT=200.801

random/large/
unif-k3-r4.2-v50000-c210000-S1170024351-015-UNKNOWN.cnf
SAT
TT=121.479

SAT
TT=680.518

No dataNo dataSAT
TT=6982.31

SAT
TT=4500.55

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2101.27

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39969.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4999.27

? (TO)
TT=5000.08

No data? (TO)
TT=4985.27

No dataNo dataSAT
TT=2506.03

No dataSAT
TT=121.479

random/large/
unif-k3-r4.2-v50000-c210000-S1401248878-094-UNKNOWN.cnf
SAT
TT=346.339

SAT
TT=1832.23

No dataNo data? (MO)
TT=7135.34

? (MO)
TT=7616.9

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4963.51

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=14133

SAT
TT=4735.65

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.38

SAT
TT=2222.28

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=841.798

No dataSAT
TT=346.339

random/large/
unif-k3-r4.2-v50000-c210000-S1969540674-065-UNKNOWN.cnf
SAT
TT=1079.13

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=7138.64

? (MO)
TT=7883.1

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38417.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39969.1

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.16

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=1079.13

random/large/
unif-k3-r4.2-v50000-c210000-S517749870-003-UNKNOWN.cnf
SAT
TT=1493.62

SAT
TT=2604.24

No dataNo data? (MO)
TT=7849.7

? (MO)
TT=8377.95

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38481.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39970.2

? (TO)
TT=4999.91

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4999.27

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=1493.62

random/large/
unif-k3-r4.2-v50000-c210000-S537193780-078-UNKNOWN.cnf
SAT
TT=158.969

SAT
TT=4244.35

No dataNo data? (MO)
TT=7206.33

SAT
TT=4713.72

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2330.93

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39969

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.97

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.02

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=1045.01

No dataSAT
TT=158.969

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v50000-c210000-S746725327-020-UNKNOWN.cnf
SAT
TT=1056.42

? (TO)
TT=5000.07

No dataNo data? (MO)
TT=7159.52

? (MO)
TT=7957

No data? (MO)
TT=2972.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38441.3

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39969.3

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=1056.42

random/large/
unif-k3-r4.2-v50000-c210000-S758437099-099-UNKNOWN.cnf
SAT
TT=838.323

SAT
TT=1862.77

No dataNo data? (MO)
TT=10948.2

? (MO)
TT=7807.86

No data? (MO)
TT=2970.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=38509.4

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39970.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4998.39

? (TO)
TT=5000.04

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=838.323

random/large/
unif-k3-r4.2-v50000-c210000-S874492400-019-UNKNOWN.cnf
SAT
TT=441.68

SAT
TT=1210.28

No dataNo data? (MO)
TT=11790.6

? (MO)
TT=8949.48

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1168.32

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39970.2

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.2

? (TO)
TT=5000.07

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=1430.36

No dataSAT
TT=441.68

random/large/
unif-k3-r4.2-v50000-c210000-S957916968-041-UNKNOWN.cnf
SAT
TT=208.214

? (TO)
TT=5000.1

No dataNo dataSAT
TT=1429.74

? (MO)
TT=8452.82

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1215.74

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataSAT
TT=9750.22

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4999.13

SAT
TT=2262.48

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=361.076

No dataSAT
TT=208.214

random/large/
unif-k3-r4.2-v50000-c210000-S964643921-035-UNKNOWN.cnf
SAT
TT=801.476

SAT
TT=801.476

No dataNo data? (MO)
TT=12528.2

? (MO)
TT=7924.96

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7500.51

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39970.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

No dataNo data? (exit code)
TT=4998.96

SAT
TT=2061.8

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=2210.07

random/large/
unif-k3-r4.2-v5000-c21000-S1157767653-025-UNKNOWN.cnf
SAT
TT=3.588

SAT
TT=328.836

No dataNo dataSAT
TT=67.193

SAT
TT=34.781

No dataSAT
TT=182.073

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=20.745

SAT
TT=3.588

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=23.146

No dataNo dataNo dataSAT
TT=89.881

SAT
TT=60.848

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=38.557

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=92.066

SAT
TT=8.559

No dataSAT
TT=307.61

No dataNo dataSAT
TT=108.464

No dataSAT
TT=33.57

random/large/
unif-k3-r4.2-v5000-c21000-S1259410977-065-UNKNOWN.cnf
SAT
TT=30.381

SAT
TT=687.417

No dataNo dataSAT
TT=34.594

SAT
TT=28.65

No dataSAT
TT=120.854

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=95.409

SAT
TT=73.44

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=46.746

No dataNo dataNo dataSAT
TT=204.47

SAT
TT=72.851

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=107.511

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=414.828

SAT
TT=30.381

No dataSAT
TT=499.13

No dataNo dataSAT
TT=514.127

No dataSAT
TT=65.675

random/large/
unif-k3-r4.2-v5000-c21000-S1781430408-009-UNKNOWN.cnf
SAT
TT=1.326

SAT
TT=89.739

No dataNo dataSAT
TT=14.555

SAT
TT=11.931

No dataSAT
TT=5.537

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=30.836

SAT
TT=1.48

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=22.787

No dataNo dataNo dataSAT
TT=6.748

SAT
TT=7.159

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=30.232

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=77.376

SAT
TT=7.159

No dataSAT
TT=286.22

No dataNo dataSAT
TT=5.014

No dataSAT
TT=1.326

random/large/
unif-k3-r4.2-v5000-c21000-S425619685-036-UNKNOWN.cnf
SAT
TT=1.27

SAT
TT=54.202

No dataNo dataSAT
TT=30.219

SAT
TT=124.017

No dataSAT
TT=2.602

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=25.302

SAT
TT=1.27

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=58.323

No dataNo dataNo dataSAT
TT=180.052

SAT
TT=42.545

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.834

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=90.256

SAT
TT=39.79

No dataSAT
TT=290.26

No dataNo dataSAT
TT=315.205

No dataSAT
TT=8.088

random/large/
unif-k3-r4.2-v5000-c21000-S434028979-077-UNKNOWN.cnf
SAT
TT=2.598

SAT
TT=39.992

No dataNo dataSAT
TT=8.06

SAT
TT=8.103

No dataSAT
TT=3.052

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=19.804

SAT
TT=3.001

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=31.905

No dataNo dataNo dataSAT
TT=76.881

SAT
TT=27.27

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.551

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=72.746

SAT
TT=6.509

No dataSAT
TT=279.83

No dataNo dataSAT
TT=21.603

No dataSAT
TT=2.598

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k3-r4.2-v5000-c21000-S720914503-051-UNKNOWN.cnf
SAT
TT=1.39

SAT
TT=16.113

No dataNo dataSAT
TT=16.71

SAT
TT=11.226

No dataSAT
TT=5

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=38.083

SAT
TT=3.605

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=24.16

No dataNo dataNo dataSAT
TT=59.775

SAT
TT=11.124

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=68.384

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=79.641

SAT
TT=8.353

No dataSAT
TT=25.8

No dataNo dataSAT
TT=27.768

No dataSAT
TT=1.39

random/large/
unif-k3-r4.2-v5000-c21000-S72547786-008-UNKNOWN.cnf
SAT
TT=17.516

SAT
TT=484.403

No dataNo dataSAT
TT=809.252

SAT
TT=284.801

No dataSAT
TT=123.166

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=40.461

SAT
TT=20.657

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=538.18

No dataNo dataNo dataSAT
TT=329.242

SAT
TT=81.796

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=428.154

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=941.236

SAT
TT=183.157

No dataSAT
TT=384.44

No dataNo dataSAT
TT=701.671

No dataSAT
TT=17.516

random/large/
unif-k3-r4.2-v5000-c21000-S901912629-090-UNKNOWN.cnf
SAT
TT=11.262

SAT
TT=61.731

No dataNo dataSAT
TT=232.02

SAT
TT=53.275

No dataSAT
TT=68.991

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=62.558

SAT
TT=11.262

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=30.862

No dataNo dataNo dataSAT
TT=170.89

SAT
TT=231.355

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=88.502

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=159.695

SAT
TT=71.908

No dataSAT
TT=367.35

No dataNo dataSAT
TT=457.038

No dataSAT
TT=15.575

random/large/
unif-k3-r4.2-v5000-c21000-S912026804-034-UNKNOWN.cnf
SAT
TT=3

SAT
TT=337.078

No dataNo dataSAT
TT=49.518

SAT
TT=32.089

No dataSAT
TT=91.944

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=28.147

SAT
TT=3

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=24.749

No dataNo dataNo dataSAT
TT=16.63

SAT
TT=36.937

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=48.633

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=117.235

SAT
TT=19.017

No dataSAT
TT=296.48

No dataNo dataSAT
TT=22.509

No dataSAT
TT=20.284

random/large/
unif-k3-r4.2-v5000-c21000-S936020932-012-UNKNOWN.cnf
SAT
TT=1.223

SAT
TT=47.299

No dataNo dataSAT
TT=38.795

SAT
TT=37.501

No dataSAT
TT=21.963

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=47.542

SAT
TT=4.383

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=105.054

No dataNo dataNo dataSAT
TT=115.034

SAT
TT=28.359

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=104.791

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=73.712

SAT
TT=3.049

No dataSAT
TT=282.44

No dataNo dataSAT
TT=324.441

No dataSAT
TT=1.223

random/large/
unif-k5-r20-v1000-c20000-S107009952-009-UNKNOWN.cnf
SAT
TT=19.882

SAT
TT=117.741

No dataNo dataSAT
TT=1049.27

SAT
TT=104.361

No data? (MO)
TT=3649.92

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=25023.8

SAT
TT=749.554

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=37270.9

SAT
TT=4995.63

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=173.047

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=2638.94

SAT
TT=4720.09

No dataSAT
TT=1771.04

No dataNo dataSAT
TT=1272.54

No dataSAT
TT=19.882

random/large/
unif-k5-r20-v1000-c20000-S1351005860-011-UNKNOWN.cnf
SAT
TT=13.984

SAT
TT=13.984

No dataNo dataSAT
TT=394.822

SAT
TT=1604.09

No dataSAT
TT=96.036

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=858.25

SAT
TT=85.065

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3569.47

No dataNo dataNo dataSAT
TT=4564.32

SAT
TT=503.515

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=677.505

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=1390.66

SAT
TT=168.373

No dataSAT
TT=362.24

No dataNo dataSAT
TT=436.702

No dataSAT
TT=105.242

random/large/
unif-k5-r20-v1000-c20000-S1950850246-038-UNKNOWN.cnf
SAT
TT=20.139

SAT
TT=85.646

No dataNo dataSAT
TT=180.767

SAT
TT=138.491

No dataSAT
TT=145.513

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3522.2

SAT
TT=20.139

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=1359.59

SAT
TT=928.906

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=107.114

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=87.034

SAT
TT=379.865

No dataSAT
TT=656.65

No dataNo dataSAT
TT=280.646

No dataSAT
TT=107.641

random/large/
unif-k5-r20-v1000-c20000-S519298227-080-UNKNOWN.cnf
SAT
TT=30.394

? (TO)
TT=5000.06

No dataNo dataSAT
TT=107.933

SAT
TT=6225.68

No data? (MO)
TT=3641.13

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=30674.1

SAT
TT=177.008

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=30.394

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=829.852

SAT
TT=1175.45

No dataSAT
TT=531.74

No dataNo dataSAT
TT=2289.79

No dataSAT
TT=617.197

random/large/
unif-k5-r20-v1000-c20000-S541740666-063-UNKNOWN.cnf
SAT
TT=34.639

SAT
TT=2766.22

No dataNo dataSAT
TT=746.996

SAT
TT=235.063

No dataSAT
TT=191.703

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11735.4

SAT
TT=34.639

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=1468.25

SAT
TT=446.591

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=64.228

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=423.343

SAT
TT=446.671

No dataSAT
TT=444.71

No dataNo dataSAT
TT=338.083

No dataSAT
TT=75.054

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k5-r20-v1000-c20000-S698025027-034-UNKNOWN.cnf
SAT
TT=298.326

SAT
TT=1613.81

No dataNo dataSAT
TT=1290.59

SAT
TT=4036.99

No dataSAT
TT=184.748

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6740.17

SAT
TT=303.036

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=1801.03

SAT
TT=889.621

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=637.751

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=1655.12

SAT
TT=1537.62

No dataSAT
TT=741.75

No dataNo dataSAT
TT=901.973

No dataSAT
TT=298.326

random/large/
unif-k5-r20-v1000-c20000-S72635791-098-UNKNOWN.cnf
SAT
TT=20.252

? (TO)
TT=5000.08

No dataNo dataSAT
TT=1401.65

SAT
TT=455.262

No dataWrong Cert.
TT=1555.07

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3186.06

SAT
TT=57.772

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=22195.8

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=531.009

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=3119.85

SAT
TT=1288.13

No dataSAT
TT=728.03

No dataNo data? (TO)
TT=5000.07

No dataSAT
TT=20.252

random/large/
unif-k5-r20-v1000-c20000-S883282443-030-UNKNOWN.cnf
SAT
TT=19.323

SAT
TT=233.113

No dataNo dataWrong Cert.
TT=124.337

SAT
TT=203.284

No dataSAT
TT=205.075

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=747.234

SAT
TT=134.55

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.89

No dataNo dataNo dataSAT
TT=434.654

SAT
TT=1315.61

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=76.755

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=139.502

SAT
TT=192.906

No dataSAT
TT=499.63

No dataNo dataSAT
TT=19.323

No dataSAT
TT=188.381

random/large/
unif-k5-r20-v1000-c20000-S941604910-059-UNKNOWN.cnf
SAT
TT=24.193

SAT
TT=1186.88

No dataNo dataSAT
TT=291.606

SAT
TT=425.975

No dataSAT
TT=15.158

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1842.44

SAT
TT=25.797

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataSAT
TT=1498.04

SAT
TT=1087.76

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=195.772

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=755.929

SAT
TT=104.089

No dataSAT
TT=351.95

No dataNo dataSAT
TT=352.254

No dataSAT
TT=24.193

random/large/
unif-k5-r20-v1000-c20000-S945664020-055-UNKNOWN.cnf
SAT
TT=12.423

SAT
TT=156.59

No dataNo dataSAT
TT=63.436

SAT
TT=626.964

No dataSAT
TT=53.949

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1203.89

SAT
TT=63.151

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataSAT
TT=1504.34

SAT
TT=1110.84

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=361.02

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=1145.73

SAT
TT=607.281

No dataSAT
TT=535.15

No dataNo dataSAT
TT=106.178

No dataSAT
TT=12.423

random/large/
unif-k5-r20-v1250-c25000-S1103412232-098-UNKNOWN.cnf
SAT
TT=126.529

SAT
TT=283.854

No dataNo dataSAT
TT=658.757

SAT
TT=2860.9

No dataSAT
TT=229.121

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14974.2

SAT
TT=309.271

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataSAT
TT=19709.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=126.529

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=322

SAT
TT=997.281

No dataSAT
TT=966.86

No dataNo dataSAT
TT=1561.99

No dataSAT
TT=240.866

random/large/
unif-k5-r20-v1250-c25000-S1245360321-088-UNKNOWN.cnf
SAT
TT=10.873

SAT
TT=116.687

No dataNo dataSAT
TT=6545.89

SAT
TT=458.043

No dataSAT
TT=1072.72

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7502.27

SAT
TT=10.873

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataSAT
TT=10025

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=326.838

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=122.68

? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

No dataNo dataSAT
TT=4803.47

No dataSAT
TT=785.104

random/large/
unif-k5-r20-v1250-c25000-S1688530456-019-UNKNOWN.cnf
SAT
TT=37.637

? (TO)
TT=5000.04

No dataNo dataWrong Cert.
TT=6305.08

SAT
TT=2639.88

No data? (MO)
TT=3648.22

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3403.94

SAT
TT=37.637

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=10754.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1455.29

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=4838.87

SAT
TT=423.375

No dataSAT
TT=653.74

No dataNo dataSAT
TT=512.273

No dataSAT
TT=249.569

random/large/
unif-k5-r20-v1250-c25000-S269694958-008-UNKNOWN.cnf
SAT
TT=33.21

SAT
TT=422.611

No dataNo dataSAT
TT=372.087

SAT
TT=1828.79

No dataSAT
TT=231.694

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11643.9

SAT
TT=51.869

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=8526.94

SAT
TT=592.748

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=33.631

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=2964.14

SAT
TT=4633.33

No dataSAT
TT=832.1

No dataNo dataSAT
TT=1191

No dataSAT
TT=33.21

random/large/
unif-k5-r20-v1250-c25000-S313445894-099-UNKNOWN.cnf
SAT
TT=29.254

? (TO)
TT=5000.1

No dataNo dataSAT
TT=184.701

SAT
TT=4101.34

No dataSAT
TT=293.781

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2206.84

SAT
TT=29.254

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=21680.2

SAT
TT=2900.91

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=218.56

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=956.318

SAT
TT=612.611

No dataSAT
TT=511.85

No dataNo dataSAT
TT=89.378

No dataSAT
TT=174.105

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k5-r20-v1250-c25000-S540595895-046-UNKNOWN.cnf
SAT
TT=19.461

SAT
TT=469.088

No dataNo dataSAT
TT=692.319

SAT
TT=786.115

No dataSAT
TT=1456.09

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1532.32

SAT
TT=66.92

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataSAT
TT=2221.02

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=273.301

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=726.365

SAT
TT=19.461

No dataSAT
TT=760.54

No dataNo dataSAT
TT=207.494

No dataSAT
TT=126.152

random/large/
unif-k5-r20-v1250-c25000-S573815729-001-UNKNOWN.cnf
SAT
TT=161.39

SAT
TT=461.384

No dataNo dataSAT
TT=897.468

SAT
TT=355.717

No dataWrong Cert.
TT=2696.26

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=21064

SAT
TT=161.39

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39971

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=247.907

No data? (TO)
TT=5000.15

No dataNo data? (exit code)
TT=4998.84

? (TO)
TT=5000.05

No dataSAT
TT=3399.23

No dataNo data? (TO)
TT=5000.08

No dataSAT
TT=218.473

random/large/
unif-k5-r20-v1250-c25000-S871131876-087-UNKNOWN.cnf
SAT
TT=61.391

? (TO)
TT=5000.1

No dataNo dataSAT
TT=6980.23

SAT
TT=297.523

No data? (MO)
TT=3444.78

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=33495.8

SAT
TT=446.406

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=31681.5

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=61.391

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.97

? (TO)
TT=5000.07

No dataSAT
TT=1168.15

No dataNo dataSAT
TT=1648.64

No dataSAT
TT=433.533

random/large/
unif-k5-r20-v1250-c25000-S935783783-069-UNKNOWN.cnf
SAT
TT=178.941

? (TO)
TT=5000.12

No dataNo data? (MO)
TT=10156.7

SAT
TT=7686.38

No dataSAT
TT=69.663

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

SAT
TT=565.972

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=33691.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1256.69

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4999

SAT
TT=4645.62

No dataSAT
TT=1176.07

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=178.941

random/large/
unif-k5-r20-v1250-c25000-S936047914-093-UNKNOWN.cnf
SAT
TT=4.904

SAT
TT=93.734

No dataNo dataSAT
TT=64.085

Wrong Cert.
TT=76.48

No dataSAT
TT=240.333

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=371.773

SAT
TT=217.262

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3141.04

No dataNo dataNo dataSAT
TT=975.25

SAT
TT=219.87

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=115.71

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=4.904

SAT
TT=138.567

No dataSAT
TT=492.79

No dataNo dataSAT
TT=555.472

No dataSAT
TT=61.505

random/large/
unif-k5-r20-v1500-c30000-S1180959030-088-UNKNOWN.cnf
SAT
TT=101.054

? (TO)
TT=5000.03

No dataNo dataSAT
TT=2386.9

SAT
TT=5424.38

No data? (MO)
TT=3454.83

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

SAT
TT=478.118

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataSAT
TT=12477.8

SAT
TT=1490.36

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4903.52

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=4813.79

? (TO)
TT=5000.03

No dataSAT
TT=810.83

No dataNo dataSAT
TT=357.112

No dataSAT
TT=101.054

random/large/
unif-k5-r20-v1500-c30000-S1305346115-067-UNKNOWN.cnf
SAT
TT=1107.92

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9590.3

? (MO)
TT=7735.6

No data? (MO)
TT=3366.14

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

SAT
TT=3044.78

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=39972

SAT
TT=1390.75

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2516.13

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.96

SAT
TT=3759.56

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=1107.92

random/large/
unif-k5-r20-v1500-c30000-S1793954886-065-UNKNOWN.cnf
SAT
TT=192.951

? (TO)
TT=5000.04

No dataNo dataSAT
TT=1277.88

SAT
TT=450.666

No dataWrong Cert.
TT=801.365

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=12193.9

SAT
TT=598.007

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39971.2

SAT
TT=1906.67

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2470.61

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.97

? (TO)
TT=5000.06

No dataSAT
TT=1039.01

No dataNo dataSAT
TT=329.17

No dataSAT
TT=192.951

random/large/
unif-k5-r20-v1500-c30000-S303265982-092-UNKNOWN.cnf
SAT
TT=186.925

? (TO)
TT=5000.04

No dataNo dataSAT
TT=1320.31

? (MO)
TT=8683.99

No data? (MO)
TT=3457.24

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

SAT
TT=876.397

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=39972.6

? (TO)
TT=4999.62

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=3623.4

? (TO)
TT=5000.03

No dataSAT
TT=1274.63

No dataNo data? (TO)
TT=5000.08

No dataSAT
TT=186.925

random/large/
unif-k5-r20-v1500-c30000-S377999798-061-UNKNOWN.cnf
SAT
TT=214.322

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9876.24

? (MO)
TT=8755.14

No data? (MO)
TT=3449.72

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=39029.1

SAT
TT=3625.71

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=6564.35

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2100.93

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4999

SAT
TT=3535.45

No data? (TO)
TT=4999.96

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=214.322

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k5-r20-v1500-c30000-S64154096-097-UNKNOWN.cnf
SAT
TT=61.365

SAT
TT=204.733

No dataNo data? (MO)
TT=10031.3

SAT
TT=191.161

No data? (MO)
TT=3449.79

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

SAT
TT=286.978

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=3987.97

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=365.606

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=164.623

SAT
TT=61.365

No dataSAT
TT=1466.37

No dataNo dataSAT
TT=2565.86

No dataSAT
TT=229.672

random/large/
unif-k5-r20-v1500-c30000-S715182559-083-UNKNOWN.cnf
SAT
TT=54.129

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9990.41

? (MO)
TT=10203.8

No data? (MO)
TT=3451.67

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

SAT
TT=1398.4

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=32451.5

SAT
TT=1674.38

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1062.86

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=213.071

SAT
TT=3191.25

No dataSAT
TT=1734.73

No dataNo dataSAT
TT=1883.3

No dataSAT
TT=54.129

random/large/
unif-k5-r20-v1500-c30000-S877088425-001-UNKNOWN.cnf
SAT
TT=610.499

? (TO)
TT=5000.08

No dataNo data? (MO)
TT=9456.14

? (MO)
TT=7123.16

No data? (MO)
TT=3454.81

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

SAT
TT=1351.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39970.9

SAT
TT=4619.85

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.95

? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.11

No dataSAT
TT=610.499

random/large/
unif-k5-r20-v1500-c30000-S969405384-096-UNKNOWN.cnf
SAT
TT=1088.25

? (TO)
TT=5000.12

No dataNo data? (MO)
TT=8602.94

? (MO)
TT=9490.97

No data? (MO)
TT=3458.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

SAT
TT=1600.13

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4999.1

? (TO)
TT=5000.04

No dataSAT
TT=1088.25

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=1561.41

random/large/
unif-k5-r20-v1500-c30000-S976428817-077-UNKNOWN.cnf
SAT
TT=566.818

? (TO)
TT=5000.06

No dataNo dataSAT
TT=8161.42

? (MO)
TT=7932.97

No data? (MO)
TT=3454.55

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=566.818

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=4903.05

? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=569.666

random/large/
unif-k5-r20-v2000-c40000-S1143439968-082-UNKNOWN.cnf
SAT
TT=2363.84

? (TO)
TT=5000.07

No dataNo dataSAT
TT=3556.32

? (MO)
TT=8622.68

No data? (MO)
TT=3550.33

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

SAT
TT=3727.61

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.19

? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.12

No dataSAT
TT=2363.84

random/large/
unif-k5-r20-v2000-c40000-S1264065752-051-UNKNOWN.cnf
SAT
TT=110.327

? (TO)
TT=5000.1

No dataNo dataSAT
TT=4785.49

? (MO)
TT=9333.57

No data? (MO)
TT=3546.23

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

SAT
TT=3625.44

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=16065.6

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.07

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.07

No dataSAT
TT=110.327

random/large/
unif-k5-r20-v2000-c40000-S1993071608-084-UNKNOWN.cnf
SAT
TT=559.28

? (TO)
TT=5000.05

No dataNo data? (MO)
TT=8720.45

? (MO)
TT=8313.35

No data? (MO)
TT=3551.19

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

SAT
TT=3650.44

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.4

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.01

No dataNo data? (exit code)
TT=4999.18

? (TO)
TT=5000.07

No data? (TO)
TT=4998.97

No dataNo data? (TO)
TT=5000.05

No dataSAT
TT=559.28

random/large/
unif-k5-r20-v2000-c40000-S319509287-085-UNKNOWN.cnf
SAT
TT=3906.44

? (TO)
TT=5000.08

No dataNo data? (MO)
TT=10310.7

? (MO)
TT=10206.3

No data? (MO)
TT=1989.68

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.35

? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.05

No dataSAT
TT=3906.44

random/large/
unif-k5-r20-v2000-c40000-S394483079-002-UNKNOWN.cnf
SAT
TT=611.74

? (TO)
TT=5000.07

No dataNo data? (MO)
TT=10312.9

? (MO)
TT=9470.04

No data? (MO)
TT=3546

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4999.27

? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.12

No dataSAT
TT=611.74

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k5-r20-v2000-c40000-S61914820-087-UNKNOWN.cnf
SAT
TT=2120.06

? (TO)
TT=5000.11

No dataNo data? (MO)
TT=9527.11

? (MO)
TT=10709.7

No data? (MO)
TT=3550.97

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.02

No data? (TO)
TT=4998.88

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=2120.06

random/large/
unif-k5-r20-v2000-c40000-S656892101-075-UNKNOWN.cnf
SAT
TT=379.26

? (TO)
TT=5000.12

No dataNo data? (MO)
TT=8735.33

? (MO)
TT=9446.77

No data? (MO)
TT=3552.74

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39971.1

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4999.18

? (TO)
TT=5000.07

No data? (TO)
TT=4999.99

No dataNo data? (TO)
TT=5000.1

No dataSAT
TT=379.26

random/large/
unif-k5-r20-v2000-c40000-S837431592-027-UNKNOWN.cnf
SAT
TT=2223.79

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9368.65

? (MO)
TT=9433.37

No data? (MO)
TT=3553.61

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=39971.9

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.08

No dataSAT
TT=2223.79

random/large/
unif-k5-r20-v2000-c40000-S922811046-076-UNKNOWN.cnf
SAT
TT=625.84

? (TO)
TT=5000.06

No dataNo data? (MO)
TT=9512

? (MO)
TT=9861.1

No data? (MO)
TT=3558.21

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=20744.7

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=28196

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4999.18

? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=625.84

random/large/
unif-k5-r20-v2000-c40000-S971556279-001-UNKNOWN.cnf
SAT
TT=640.831

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9490.66

? (MO)
TT=10051.9

No data? (MO)
TT=3548.43

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

SAT
TT=2266.23

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.02

No data? (TO)
TT=4999.35

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=640.831

random/large/
unif-k5-r20-v750-c15000-S1207160791-083-UNKNOWN.cnf
SAT
TT=39.91

SAT
TT=146.986

No dataNo dataSAT
TT=82.65

SAT
TT=15.66

No dataSAT
TT=42.361

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=451.485

SAT
TT=89.944

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=187.6

SAT
TT=414.349

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=54.424

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=130.494

SAT
TT=424.902

No dataSAT
TT=367.91

No dataNo dataSAT
TT=39.91

No dataSAT
TT=84.978

random/large/
unif-k5-r20-v750-c15000-S131912631-041-UNKNOWN.cnf
SAT
TT=14.941

SAT
TT=280.761

No dataNo dataSAT
TT=23.789

SAT
TT=6.795

No dataSAT
TT=33.923

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=333.788

SAT
TT=17.748

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=446.067

No dataNo dataNo dataSAT
TT=217.763

SAT
TT=1105.51

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=21.94

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=14.941

SAT
TT=95.533

No dataSAT
TT=332.75

No dataNo dataSAT
TT=64.493

No dataSAT
TT=44.162

random/large/
unif-k5-r20-v750-c15000-S1787347746-067-UNKNOWN.cnf
SAT
TT=13.857

SAT
TT=615.385

No dataNo dataSAT
TT=71.92

SAT
TT=245.072

No dataSAT
TT=234.677

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.857

SAT
TT=177.386

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataSAT
TT=2412.41

SAT
TT=417.824

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=70.628

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=1427.02

SAT
TT=416.519

No dataSAT
TT=518.82

No dataNo dataSAT
TT=264.975

No dataSAT
TT=75.031

random/large/
unif-k5-r20-v750-c15000-S3662714-068-UNKNOWN.cnf
SAT
TT=335.462

? (TO)
TT=5000.06

No dataNo dataSAT
TT=124.143

SAT
TT=532.627

No dataSAT
TT=452.824

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=335.462

SAT
TT=480.426

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (MO)
TT=6462.08

SAT
TT=3393.73

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=414.901

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=1528.92

SAT
TT=2895.25

No dataSAT
TT=516.43

No dataNo dataSAT
TT=4571.43

No dataSAT
TT=381.561

random/large/
unif-k5-r20-v750-c15000-S440979335-036-UNKNOWN.cnf
SAT
TT=7.172

SAT
TT=14.39

No dataNo dataSAT
TT=13.335

SAT
TT=61.544

No dataSAT
TT=23.907

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=182.713

SAT
TT=7.172

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1939.77

No dataNo dataNo dataSAT
TT=772.979

SAT
TT=25.215

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=54.689

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=91.347

SAT
TT=72.883

No dataSAT
TT=343.68

No dataNo dataSAT
TT=105.144

No dataSAT
TT=15.402

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k5-r20-v750-c15000-S64285713-004-UNKNOWN.cnf
SAT
TT=7.107

SAT
TT=70.084

No dataNo dataSAT
TT=30.282

SAT
TT=44.372

No dataSAT
TT=51.098

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=779.65

SAT
TT=7.107

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=351.007

No dataNo dataNo dataSAT
TT=1532.24

SAT
TT=333.379

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=94.544

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=186.554

SAT
TT=14.375

No dataSAT
TT=425.35

No dataNo dataSAT
TT=214.571

No dataSAT
TT=58.515

random/large/
unif-k5-r20-v750-c15000-S656533785-100-UNKNOWN.cnf
SAT
TT=3.242

SAT
TT=17.215

No dataNo dataSAT
TT=23.75

SAT
TT=18.5

No dataSAT
TT=17.52

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=76.791

SAT
TT=6.003

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=649.151

No dataNo dataNo dataSAT
TT=70.503

SAT
TT=35.466

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=12.594

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=93.828

SAT
TT=80.707

No dataSAT
TT=363.33

No dataNo dataSAT
TT=64.224

No dataSAT
TT=3.242

random/large/
unif-k5-r20-v750-c15000-S888530894-020-UNKNOWN.cnf
SAT
TT=52.605

SAT
TT=312.86

No dataNo dataSAT
TT=26.62

SAT
TT=146.363

No dataSAT
TT=191.517

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3416.13

SAT
TT=52.605

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataSAT
TT=60.968

SAT
TT=498.85

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=191.008

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=603.48

SAT
TT=619.981

No dataSAT
TT=547.94

No dataNo dataSAT
TT=531.299

No dataSAT
TT=241.762

random/large/
unif-k5-r20-v750-c15000-S957625236-045-UNKNOWN.cnf
SAT
TT=1.1

SAT
TT=13.534

No dataNo dataSAT
TT=35.251

SAT
TT=31.385

No dataSAT
TT=8.817

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=441.901

SAT
TT=1.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=219.62

No dataNo dataNo dataSAT
TT=68.407

SAT
TT=90.705

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=29.216

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=71.008

SAT
TT=50.365

No dataSAT
TT=352.44

No dataNo dataSAT
TT=164.464

No dataSAT
TT=17.397

random/large/
unif-k5-r20-v750-c15000-S976181807-056-UNKNOWN.cnf
SAT
TT=16.91

SAT
TT=97.561

No dataNo dataSAT
TT=96.702

SAT
TT=35.608

No dataSAT
TT=40.283

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=63.126

SAT
TT=16.91

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4112.01

No dataNo dataNo dataSAT
TT=301.673

SAT
TT=417.531

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=35.58

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=178.444

SAT
TT=118.02

No dataSAT
TT=457.53

No dataNo dataSAT
TT=181.013

No dataSAT
TT=83.549

random/large/
unif-k7-r85-v150-c12750-S1101422472-003-UNKNOWN.cnf
SAT
TT=79.084

SAT
TT=480.352

No dataNo dataSAT
TT=982.83

SAT
TT=617.541

No dataSAT
TT=29.24

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3270.82

SAT
TT=1966.31

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1069.57

No dataNo dataNo dataSAT
TT=209.31

SAT
TT=1666.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=284.719

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=837.486

SAT
TT=2533.06

No dataSAT
TT=1838.85

No dataNo dataSAT
TT=79.084

No dataSAT
TT=1142.11

random/large/
unif-k7-r85-v150-c12750-S1290198737-013-UNKNOWN.cnf
SAT
TT=64.605

SAT
TT=1119.54

No dataNo dataSAT
TT=50.349

SAT
TT=187.254

No dataSAT
TT=3231.53

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=907.585

SAT
TT=64.605

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1178.2

No dataNo dataNo dataSAT
TT=8725.7

SAT
TT=1099.18

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=86.004

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=501.298

SAT
TT=88.827

No dataSAT
TT=788.36

No dataNo dataSAT
TT=231.838

No dataSAT
TT=259.924

random/large/
unif-k7-r85-v150-c12750-S1737989193-079-UNKNOWN.cnf
SAT
TT=3.545

SAT
TT=98.267

No dataNo dataSAT
TT=758.58

SAT
TT=590.894

No dataSAT
TT=8.098

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=81.07

SAT
TT=154.146

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=693.943

No dataNo dataNo dataSAT
TT=2512.44

SAT
TT=767.355

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.545

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=85.111

SAT
TT=55.094

No dataSAT
TT=926.64

No dataNo dataSAT
TT=30.069

No dataSAT
TT=115.667

random/large/
unif-k7-r85-v150-c12750-S313239685-087-UNKNOWN.cnf
SAT
TT=4.662

SAT
TT=399.913

No dataNo dataSAT
TT=179.08

SAT
TT=2473.44

No dataSAT
TT=1258.61

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=395.104

SAT
TT=155.374

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2534.51

No dataNo dataNo dataSAT
TT=2606.43

? (TO)
TT=4999.93

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4089.16

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=1612.52

SAT
TT=86.398

No dataSAT
TT=947.43

No dataNo dataSAT
TT=1131.48

No dataSAT
TT=4.662

random/large/
unif-k7-r85-v150-c12750-S367425675-085-UNKNOWN.cnf
SAT
TT=21.617

SAT
TT=22.563

No dataNo dataSAT
TT=53.31

SAT
TT=11.248

No dataSAT
TT=131.422

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=292.167

SAT
TT=175.151

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=616.564

No dataNo dataNo dataSAT
TT=2111.98

SAT
TT=42.947

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=31.173

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=157.362

SAT
TT=485.609

No dataSAT
TT=850.01

No dataNo dataSAT
TT=21.617

No dataSAT
TT=78.25

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k7-r85-v150-c12750-S511186849-048-UNKNOWN.cnf
SAT
TT=4.511

SAT
TT=274.52

No dataNo dataSAT
TT=33.765

SAT
TT=233.424

No dataSAT
TT=937.109

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=922.003

SAT
TT=136.707

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=878.882

No dataNo dataNo dataSAT
TT=101.427

SAT
TT=219.888

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=193.527

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=78.653

SAT
TT=254.306

No dataSAT
TT=330.02

No dataNo dataSAT
TT=307.39

No dataSAT
TT=4.511

random/large/
unif-k7-r85-v150-c12750-S541704841-072-UNKNOWN.cnf
SAT
TT=86.339

SAT
TT=472.667

No dataNo dataSAT
TT=884.514

SAT
TT=91.243

No dataSAT
TT=412.039

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2004.37

SAT
TT=157.895

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=86.339

No dataNo dataNo dataSAT
TT=612.852

SAT
TT=1360.19

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=180.988

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=715.556

SAT
TT=455.989

No dataSAT
TT=349.03

No dataNo dataSAT
TT=547.274

No dataSAT
TT=268.46

random/large/
unif-k7-r85-v150-c12750-S789865458-092-UNKNOWN.cnf
SAT
TT=13.094

SAT
TT=418.257

No dataNo dataSAT
TT=322.672

SAT
TT=322.239

No dataSAT
TT=210.08

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=564.475

SAT
TT=65.418

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=601.647

No dataNo dataNo dataSAT
TT=5273.39

SAT
TT=528.35

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=126.341

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=214.949

SAT
TT=53.366

No dataSAT
TT=382.02

No dataNo dataSAT
TT=13.094

No dataSAT
TT=39.496

random/large/
unif-k7-r85-v150-c12750-S896023516-057-UNKNOWN.cnf
SAT
TT=240.774

SAT
TT=1671.97

No dataNo dataSAT
TT=3267.95

SAT
TT=5480.77

No data? (MO)
TT=3644.75

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=375.934

SAT
TT=694.546

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=240.774

No dataNo dataNo dataSAT
TT=3122.07

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4728.54

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4999.16

SAT
TT=2018.96

No dataSAT
TT=1347.23

No dataNo dataSAT
TT=3176.47

No dataSAT
TT=947.48

random/large/
unif-k7-r85-v150-c12750-S93401285-051-UNKNOWN.cnf
SAT
TT=37.216

SAT
TT=51.131

No dataNo dataSAT
TT=121.846

SAT
TT=718.503

No dataSAT
TT=210.16

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2069.43

SAT
TT=788.039

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1128.55

No dataNo dataNo dataSAT
TT=3141.62

SAT
TT=1842.83

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=785.38

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=229.056

SAT
TT=37.216

No dataSAT
TT=1141.47

No dataNo dataSAT
TT=93.514

No dataSAT
TT=908.221

random/large/
unif-k7-r85-v200-c17000-S1227169170-092-UNKNOWN.cnf
SAT
TT=2870.73

? (TO)
TT=5000.06

No dataNo dataSAT
TT=77.269

SAT
TT=4047.31

No data? (MO)
TT=3459.8

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5735.74

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.2

SAT
TT=2870.73

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.43

? (TO)
TT=5000.02

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=3390.81

random/large/
unif-k7-r85-v200-c17000-S1348818483-020-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo dataSAT
TT=3258.95

? (MO)
TT=7991.24

No data? (MO)
TT=3450.98

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39965.2

? (TO)
TT=4999.9

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.51

? (TO)
TT=5000.05

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

random/large/
unif-k7-r85-v200-c17000-S181603592-089-UNKNOWN.cnf
SAT
TT=2380.61

SAT
TT=2848.88

No dataNo dataSAT
TT=8543.22

? (MO)
TT=8638.42

No data? (MO)
TT=3452.81

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.58

SAT
TT=2380.61

No data? (TO)
TT=5000

No dataNo dataSAT
TT=4184.19

No data? (TO)
TT=5000.02

random/large/
unif-k7-r85-v200-c17000-S283489555-036-UNKNOWN.cnf
SAT
TT=405.607

? (TO)
TT=5000.04

No dataNo dataSAT
TT=1968.54

? (MO)
TT=8700.55

No data? (MO)
TT=3455.36

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=17686.1

SAT
TT=405.607

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39971.3

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.45

? (TO)
TT=5000.04

No dataSAT
TT=1960.55

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

random/large/
unif-k7-r85-v200-c17000-S335550727-070-UNKNOWN.cnf
SAT
TT=427.269

? (TO)
TT=5000.06

No dataNo dataSAT
TT=6158.21

? (MO)
TT=8781.04

No data? (MO)
TT=3351.18

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

SAT
TT=1512.96

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1694.49

No dataNo dataNo data? (TO)
TT=39971.7

SAT
TT=427.269

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.45

? (TO)
TT=5000.09

No dataSAT
TT=518.59

No dataNo dataSAT
TT=2600.13

No data? (TO)
TT=5000.09

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k7-r85-v200-c17000-S72668411-025-UNKNOWN.cnf
SAT
TT=197.261

? (TO)
TT=5000.11

No dataNo dataSAT
TT=6290.08

SAT
TT=5286.61

No data? (MO)
TT=3453.92

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13627.7

SAT
TT=197.261

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataSAT
TT=28560.4

SAT
TT=1855.21

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1098.5

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=2068.75

SAT
TT=254.891

No dataSAT
TT=1559.14

No dataNo dataSAT
TT=1688.03

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v200-c17000-S771170845-016-UNKNOWN.cnf
SAT
TT=2600.06

SAT
TT=2600.06

No dataNo data? (MO)
TT=10199.5

? (MO)
TT=9418.34

No data? (MO)
TT=3458.74

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataSAT
TT=22992.7

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.45

? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

random/large/
unif-k7-r85-v200-c17000-S862393334-098-UNKNOWN.cnf
SAT
TT=32.384

SAT
TT=32.384

No dataNo data? (MO)
TT=9504.33

SAT
TT=5925.01

No data? (MO)
TT=3368.73

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4573.05

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1913.15

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.46

? (TO)
TT=5000.06

No data? (TO)
TT=4999.87

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.08

random/large/
unif-k7-r85-v200-c17000-S949556727-080-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=10220.2

? (MO)
TT=9470.19

No data? (MO)
TT=3452.93

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.48

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v200-c17000-S970203146-047-UNKNOWN.cnf
SAT
TT=580.671

? (TO)
TT=5000.12

No dataNo dataSAT
TT=369.742

? (MO)
TT=11419.5

No data? (MO)
TT=3455.23

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

SAT
TT=580.671

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2020.87

No dataNo dataNo data? (TO)
TT=34992.1

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=4999.88

No dataNo data? (exit code)
TT=4998.48

SAT
TT=2573.07

No dataSAT
TT=613.23

No dataNo dataSAT
TT=4010.85

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v250-c21250-S1116436500-050-UNKNOWN.cnf



? (TO)
TT=5000.09

No dataNo data? (MO)
TT=10209.1

? (MO)
TT=10179.4

No data? (MO)
TT=3464.29

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39971.6

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.12

No dataNo data? (exit code)
TT=4998.94

? (TO)
TT=5000.01

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v250-c21250-S1274193329-021-UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data? (MO)
TT=11323.8

? (MO)
TT=8653.5

No data? (MO)
TT=3456.3

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.14

No dataNo data? (exit code)
TT=4998.95

? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v250-c21250-S1682211323-009-UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=8746.55

? (MO)
TT=10134.3

No data? (MO)
TT=3451.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.6

? (TO)
TT=4999.9

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4998.91

? (TO)
TT=5000.02

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

random/large/
unif-k7-r85-v250-c21250-S317257086-003-UNKNOWN.cnf



? (TO)
TT=5000.11

No dataNo data? (MO)
TT=8725.45

? (MO)
TT=9517.54

No data? (MO)
TT=3458.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.93

? (TO)
TT=5000.05

No data? (TO)
TT=4999.99

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

random/large/
unif-k7-r85-v250-c21250-S381985918-018-UNKNOWN.cnf



? (TO)
TT=5000.11

No dataNo data? (MO)
TT=9475.76

? (MO)
TT=8703.62

No data? (MO)
TT=3456.67

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.94

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.08

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k7-r85-v250-c21250-S58287803-001-UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data? (MO)
TT=10487.3

? (MO)
TT=10972.5

No data? (MO)
TT=3459.48

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.85

? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v250-c21250-S655589261-059-UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=9405.86

? (MO)
TT=9477.54

No data? (MO)
TT=3451.63

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=39971.8

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.85

? (TO)
TT=5000.04

No data? (TO)
TT=4999.99

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/large/
unif-k7-r85-v250-c21250-S894356234-063-UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data? (MO)
TT=9393.62

? (MO)
TT=7865.58

No data? (MO)
TT=3453.57

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.85

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v250-c21250-S977260632-016-UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data? (MO)
TT=9421.53

? (MO)
TT=9467.27

No data? (MO)
TT=3455.32

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=4999.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.92

? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/large/
unif-k7-r85-v250-c21250-S981492757-074-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=11671.2

? (MO)
TT=8650.35

No data? (MO)
TT=3461.82

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (MO)
TT=23792

? (TO)
TT=4999.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.03

? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v300-c25500-S1158419275-045-UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=8649.24

? (MO)
TT=10720.9

No data? (MO)
TT=3548.84

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.3

? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v300-c25500-S1286362348-008-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9331.46

? (MO)
TT=8547.9

No data? (MO)
TT=1994.16

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.26

? (TO)
TT=5000.09

No data? (TO)
TT=4999.97

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

random/large/
unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=10566.1

? (MO)
TT=11049.7

No data? (MO)
TT=3545.83

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.36

? (TO)
TT=5000.03

No data? (TO)
TT=4999.85

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

random/large/
unif-k7-r85-v300-c25500-S376724493-075-UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data? (MO)
TT=10914

? (MO)
TT=9432.53

No data? (MO)
TT=3569.16

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.34

? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

random/large/
unif-k7-r85-v300-c25500-S415002759-031-UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data? (MO)
TT=9229.96

? (MO)
TT=10231.8

No data? (MO)
TT=3548.28

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4998.41

? (TO)
TT=5000.02

No data? (TO)
TT=4984.96

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k7-r85-v300-c25500-S680524168-083-UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data? (MO)
TT=10933.4

? (MO)
TT=9432.67

No data? (MO)
TT=3548.33

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.98

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.39

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v300-c25500-S69399346-065-UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data? (MO)
TT=10400.9

? (MO)
TT=9624.96

No data? (MO)
TT=3552.61

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=35327.8

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.12

No dataNo data? (exit code)
TT=4998.27

? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v300-c25500-S926861876-013-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=8620.52

? (MO)
TT=9457.74

No data? (MO)
TT=3551.22

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.27

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

random/large/
unif-k7-r85-v300-c25500-S942666749-061-UNKNOWN.cnf



? (TO)
TT=5000.12

No dataNo data? (MO)
TT=9488.9

? (MO)
TT=9991.3

No data? (MO)
TT=3561.93

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.96

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

No dataNo data? (exit code)
TT=4998.28

? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.03

random/large/
unif-k7-r85-v300-c25500-S966156467-066-UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=10093.6

? (MO)
TT=10165.5

No data? (MO)
TT=1989.63

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39972.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.27

? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

random/large/
unif-k7-r85-v400-c34000-S1163171897-095-UNKNOWN.cnf



? (TO)
TT=5000.09

No dataNo data? (MO)
TT=10257.8

? (MO)
TT=9678.5

No data? (MO)
TT=3557.63

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.4

? (TO)
TT=5000.03

No data? (TO)
TT=4999.91

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data? (MO)
TT=9533.78

? (MO)
TT=9421.83

No data? (MO)
TT=3567.88

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39971.9

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.52

? (TO)
TT=5000.1

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

random/large/
unif-k7-r85-v400-c34000-S1897807474-073-UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=10216.2

? (MO)
TT=9425.36

No data? (MO)
TT=3561.58

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39963.8

? (TO)
TT=4999.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.32

? (TO)
TT=5000.09

No data? (TO)
TT=4999.98

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

random/large/
unif-k7-r85-v400-c34000-S536077088-015-UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=11056.7

? (MO)
TT=7911

No data? (MO)
TT=3550.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.2

? (TO)
TT=4999.99

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4999.25

? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

random/large/
unif-k7-r85-v400-c34000-S586055573-067-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9381.69

? (MO)
TT=9477.26

No data? (MO)
TT=3554.92

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=4999.87

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4999.26

? (TO)
TT=5000.06

No data? (TO)
TT=4999.99

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/large/
unif-k7-r85-v400-c34000-S817927155-033-UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=10150.2

? (MO)
TT=9496.38

No data? (MO)
TT=3554

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo data? (TO)
TT=39972.9

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4999.26

? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v400-c34000-S832901479-042-UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data? (MO)
TT=10270.8

? (MO)
TT=9576.21

No data? (MO)
TT=3554.65

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No dataNo data? (exit code)
TT=4999.27

? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

random/large/
unif-k7-r85-v400-c34000-S927774663-037-UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=8791.59

? (MO)
TT=10473

No data? (MO)
TT=3548.2

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4999.26

? (TO)
TT=5000.09

No data? (TO)
TT=4999.94

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v400-c34000-S943787219-031-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=9353.4

? (MO)
TT=8747.32

No data? (MO)
TT=3547.91

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=4999.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.4

? (TO)
TT=5000.08

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.09

random/large/
unif-k7-r85-v400-c34000-S94779963-093-UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=7895.65

? (MO)
TT=9548.77

No data? (MO)
TT=3556.4

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.39

? (TO)
TT=5000.1

No data? (TO)
TT=4999.97

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v250-c1065-S1295196126-061.UNKNOWN.cnf
UNSAT
TT=0.444

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=4.68

UNSAT
TT=4.415

No dataUNSAT
TT=100.665

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19898.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.444

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=26.307

No dataNo dataNo dataUNSAT
TT=1.308

UNSAT
TT=12.722

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=0.47

No dataNo dataUNSAT
TT=33.811

? (TO)
TT=5000.09

No dataUNSAT
TT=12.65

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v250-c1065-S1397126856-076.UNKNOWN.cnf
UNSAT
TT=0.244

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=3.233

UNSAT
TT=1.894

No dataUNSAT
TT=99.527

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20229.1

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.244

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=26.425

No dataNo dataNo dataUNSAT
TT=0.754

UNSAT
TT=8.508

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=0.267

No dataNo dataUNSAT
TT=33.511

? (TO)
TT=5000.07

No dataUNSAT
TT=10.35

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v250-c1065-S1822479556-014.UNKNOWN.cnf
UNSAT
TT=0.136

? (TO)
TT=5000.08

No dataNo data? (TO)
TT=201.95

? (TO)
TT=101.94

No dataUNSAT
TT=101.377

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20427.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.136

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=15.179

No dataNo dataNo dataUNSAT
TT=0.45

UNSAT
TT=2.834

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=0.15

No dataNo dataUNSAT
TT=30.936

? (TO)
TT=5000.09

No dataUNSAT
TT=5.05

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v250-c1065-S266251785-083.UNKNOWN.cnf
UNSAT
TT=0.244

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=2.486

UNSAT
TT=1.951

No dataUNSAT
TT=101.568

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20193.5

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.244

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=26.579

No dataNo dataNo dataUNSAT
TT=0.787

UNSAT
TT=6.348

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=0.269

No dataNo dataUNSAT
TT=32.651

? (TO)
TT=5000.06

No dataUNSAT
TT=8.54

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v250-c1065-S427778075-026.UNKNOWN.cnf
UNSAT
TT=0.494

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=4.766

UNSAT
TT=4.979

No dataUNSAT
TT=100.707

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19723.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.494

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=25.656

No dataNo dataNo dataUNSAT
TT=1.515

UNSAT
TT=15.244

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=0.541

No dataNo dataUNSAT
TT=36.521

? (TO)
TT=5000.06

No dataUNSAT
TT=18.33

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v250-c1065-S534787376-095.UNKNOWN.cnf
UNSAT
TT=0.254

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=2.873

UNSAT
TT=2.245

No dataUNSAT
TT=100.651

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19687.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.254

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=8.246

No dataNo dataNo dataUNSAT
TT=0.768

UNSAT
TT=4.134

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=0.277

No dataNo dataUNSAT
TT=32.793

? (TO)
TT=5000.1

No dataUNSAT
TT=10.05

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v250-c1065-S671776549-007.UNKNOWN.cnf
UNSAT
TT=0.265

? (TO)
TT=5000.02

No dataNo dataUNSAT
TT=2.796

UNSAT
TT=2.986

No dataUNSAT
TT=101.668

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19923

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.265

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=27.055

No dataNo dataNo dataUNSAT
TT=0.815

UNSAT
TT=6.744

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataUNSAT
TT=0.291

No dataNo dataUNSAT
TT=33.425

? (TO)
TT=5000.06

No dataUNSAT
TT=7.94

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v250-c1065-S860541986-078.UNKNOWN.cnf
UNSAT
TT=0.256

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=2.76

UNSAT
TT=3.156

No dataUNSAT
TT=101.448

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20434.1

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.256

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=53.218

No dataNo dataNo dataUNSAT
TT=0.789

UNSAT
TT=6.867

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=0.28

No dataNo dataUNSAT
TT=32.873

? (TO)
TT=5000.1

No dataUNSAT
TT=7.83

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.1

random/medium/
unif-k3-r4.26-v250-c1065-S931339469-052.UNKNOWN.cnf
UNSAT
TT=0.202

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=2.008

UNSAT
TT=1.824

No dataUNSAT
TT=101.387

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19926.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.202

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=26.091

No dataNo dataNo dataUNSAT
TT=1.669

UNSAT
TT=5.269

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=0.223

No dataNo dataUNSAT
TT=31.589

? (TO)
TT=5000.08

No dataUNSAT
TT=7.67

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v250-c1065-S984689729-080.UNKNOWN.cnf
UNSAT
TT=0.255

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=2.232

UNSAT
TT=3.475

No dataUNSAT
TT=101.536

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19942.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.255

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=27.259

No dataNo dataNo dataUNSAT
TT=0.771

UNSAT
TT=5.785

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=0.313

No dataNo dataUNSAT
TT=32.107

? (TO)
TT=5000.01

No dataUNSAT
TT=7.75

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v300-c1278-S1194590195-083.UNKNOWN.cnf
UNSAT
TT=1.275

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=15.045

UNSAT
TT=18.796

No dataUNSAT
TT=102.736

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20149.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.275

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=28.673

No dataNo dataNo dataUNSAT
TT=10.302

UNSAT
TT=52.062

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=1.407

No dataNo dataUNSAT
TT=55.276

? (TO)
TT=5000.08

No dataUNSAT
TT=91.373

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v300-c1278-S1223020224-097.UNKNOWN.cnf
UNSAT
TT=1.548

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=10.478

UNSAT
TT=21.698

No dataUNSAT
TT=102.832

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20528.7

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.548

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=29.726

No dataNo dataNo dataUNSAT
TT=11.1

UNSAT
TT=53.418

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=1.58

No dataNo dataUNSAT
TT=51.005

? (TO)
TT=5000.06

No dataUNSAT
TT=85.87

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v300-c1278-S1452052526-056.UNKNOWN.cnf
UNSAT
TT=0.678

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=5.013

UNSAT
TT=5.54

No dataUNSAT
TT=100.873

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20448.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.678

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=27.631

No dataNo dataNo dataUNSAT
TT=5.499

UNSAT
TT=25.039

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=0.748

No dataNo dataUNSAT
TT=38.832

? (TO)
TT=5000.09

No dataUNSAT
TT=46.24

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v300-c1278-S1469984978-038.UNKNOWN.cnf
UNSAT
TT=1.129

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=8.242

UNSAT
TT=8.402

No dataUNSAT
TT=101.265

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20066.2

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.129

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=28.715

No dataNo dataNo dataUNSAT
TT=9.071

UNSAT
TT=46.23

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=1.25

No dataNo dataUNSAT
TT=53.418

? (TO)
TT=5000.09

No dataUNSAT
TT=84.01

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v300-c1278-S1569819208-064.UNKNOWN.cnf
UNSAT
TT=1.205

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=8.789

UNSAT
TT=18.213

No dataUNSAT
TT=102.14

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20533.9

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.205

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=28.117

No dataNo dataNo dataUNSAT
TT=9.661

UNSAT
TT=45.685

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=1.327

No dataNo dataUNSAT
TT=48.939

? (TO)
TT=5000.08

No dataUNSAT
TT=95.34

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v300-c1278-S1869766438-024.UNKNOWN.cnf
UNSAT
TT=2.385

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=19.293

UNSAT
TT=16.122

No dataUNSAT
TT=102.574

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20078.7

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2.385

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=31.301

No dataNo dataNo dataUNSAT
TT=19.172

UNSAT
TT=153.624

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=2.628

No dataNo dataUNSAT
TT=69.331

? (TO)
TT=4999.92

No dataUNSAT
TT=158.44

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v300-c1278-S1990987164-054.UNKNOWN.cnf
UNSAT
TT=1.589

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=12.202

UNSAT
TT=14.93

No dataUNSAT
TT=102.798

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=19563.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.589

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=31.726

No dataNo dataNo dataUNSAT
TT=12.65

UNSAT
TT=99.372

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=1.752

No dataNo dataUNSAT
TT=96.254

? (TO)
TT=5000.04

No dataUNSAT
TT=157.43

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v300-c1278-S566093033-041.UNKNOWN.cnf
UNSAT
TT=0.56

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=4.174

UNSAT
TT=4.592

No dataUNSAT
TT=98.857

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21020.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.56

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=51.87

No dataNo dataNo dataUNSAT
TT=4.507

UNSAT
TT=17.18

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=0.619

No dataNo dataUNSAT
TT=36.748

? (TO)
TT=5000.02

No dataUNSAT
TT=16.83

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v300-c1278-S768688898-014.UNKNOWN.cnf
UNSAT
TT=0.807

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=7.619

UNSAT
TT=7.111

No dataUNSAT
TT=99.205

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20754.9

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.807

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=28.169

No dataNo dataNo dataUNSAT
TT=6.47

UNSAT
TT=34.823

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=0.887

No dataNo dataUNSAT
TT=42.091

? (TO)
TT=5000.02

No dataUNSAT
TT=61.16

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v300-c1278-S862932513-073.UNKNOWN.cnf
UNSAT
TT=0.814

? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=13.857

UNSAT
TT=6.288

No dataUNSAT
TT=100.208

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20415.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.814

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=28.403

No dataNo dataNo dataUNSAT
TT=2.472

UNSAT
TT=30.074

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=0.895

No dataNo dataUNSAT
TT=40.636

? (TO)
TT=5000.03

No dataUNSAT
TT=50.23

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v350-c1491-S1060672754-058.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.022

No dataNo data? (exit code)
TT=1.427

? (exit code)
TT=7.542

No dataSAT
TT=0.536

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.811

SAT
TT=0.18

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=110.657

No dataNo dataNo dataSAT
TT=0.115

SAT
TT=0.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.006

No dataSAT
TT=2.259

No dataNo dataSAT
TT=0.012

SAT
TT=0.007

No dataSAT
TT=23.756

No dataNo dataSAT
TT=0.102

No dataSAT
TT=0.024

random/medium/
unif-k3-r4.26-v350-c1491-S1077220429-098.SATISFIABLE.cnf
SAT
TT=0.003

SAT
TT=0.01

No dataNo data? (exit code)
TT=0.861

? (exit code)
TT=0.993

No dataSAT
TT=0.495

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.203

SAT
TT=0.006

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.015

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.753

No dataNo dataNo dataSAT
TT=0.033

SAT
TT=0.013

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.003

No dataSAT
TT=0.017

No dataNo dataSAT
TT=0.004

SAT
TT=0.006

No dataSAT
TT=23.763

No dataNo dataSAT
TT=0.005

No dataSAT
TT=0.003

random/medium/
unif-k3-r4.26-v350-c1491-S1090604743-089.UNKNOWN.cnf
UNSAT
TT=5.199

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=40.606

UNSAT
TT=42.555

No dataUNSAT
TT=107.025

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20620.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=5.199

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=43.733

No dataNo dataNo dataUNSAT
TT=42.003

UNSAT
TT=313.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=5.731

No dataNo dataUNSAT
TT=214.33

? (TO)
TT=5000.06

No dataUNSAT
TT=161.42

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v350-c1491-S1404138730-025.UNKNOWN.cnf
UNSAT
TT=6.427

? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=53.104

UNSAT
TT=61.445

No dataUNSAT
TT=107.173

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20642.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.548

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=41.225

No dataNo dataNo dataUNSAT
TT=47.16

UNSAT
TT=614.865

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=6.427

No dataNo dataUNSAT
TT=74.685

? (TO)
TT=5000.03

No dataUNSAT
TT=162.13

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v350-c1491-S146789605-022.SATISFIABLE.cnf
SAT
TT=0.01

SAT
TT=0.118

No dataNo data? (exit code)
TT=1.395

? (exit code)
TT=1.956

No dataSAT
TT=0.502

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.311

SAT
TT=0.035

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.185

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.803

No dataNo dataNo dataSAT
TT=0.1

SAT
TT=0.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.14

No dataSAT
TT=0.183

No dataNo dataSAT
TT=0.024

SAT
TT=0.012

No dataSAT
TT=6.14

No dataNo dataSAT
TT=0.038

No dataSAT
TT=0.075

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v350-c1491-S1507171828-044.SATISFIABLE.cnf
SAT
TT=0.012

SAT
TT=0.203

No dataNo dataSAT
TT=1.587

SAT
TT=1.863

No dataSAT
TT=0.776

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.187

SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.992

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1

No dataNo dataNo dataSAT
TT=1.443

SAT
TT=0.694

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.122

No dataSAT
TT=5.502

No dataNo dataSAT
TT=0.898

SAT
TT=1.164

No dataSAT
TT=23.763

No dataNo dataSAT
TT=0.778

No dataSAT
TT=0.012

random/medium/
unif-k3-r4.26-v350-c1491-S1705279286-077.UNKNOWN.cnf
UNSAT
TT=7.586

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=72.372

UNSAT
TT=58.924

No dataUNSAT
TT=108.631

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20074.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=7.586

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=49.701

No dataNo dataNo dataUNSAT
TT=61.501

UNSAT
TT=553.393

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=9.127

No dataNo dataUNSAT
TT=75.841

? (TO)
TT=5000.09

No dataUNSAT
TT=164.05

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v350-c1491-S1733949620-064.UNKNOWN.cnf
UNSAT
TT=7.27

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=67.361

UNSAT
TT=58.905

No dataUNSAT
TT=108.24

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20986.1

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=7.27

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=49.73

No dataNo dataNo dataUNSAT
TT=58.26

UNSAT
TT=529.218

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataUNSAT
TT=8.035

No dataNo dataUNSAT
TT=77.002

? (TO)
TT=5000.06

No dataUNSAT
TT=164.51

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v350-c1491-S173446080-001.UNKNOWN.cnf
UNSAT
TT=5.012

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=52.942

UNSAT
TT=42.369

No dataUNSAT
TT=106.298

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20091.9

? (TO)
TT=4999.95

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=5.012

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=40.594

No dataNo dataNo dataUNSAT
TT=40.594

UNSAT
TT=336.808

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=5.54

No dataNo dataUNSAT
TT=74.096

? (TO)
TT=5000.03

No dataUNSAT
TT=161.54

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v350-c1491-S1794283924-053.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.009

No dataNo data? (exit code)
TT=1.695

? (exit code)
TT=2.227

No dataSAT
TT=0.509

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.473

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.225

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.751

No dataNo dataNo dataSAT
TT=0.066

SAT
TT=0.027

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=0.248

No dataNo dataSAT
TT=0.097

SAT
TT=0.011

No dataSAT
TT=23.768

No dataNo dataSAT
TT=0.052

No dataSAT
TT=0.032

random/medium/
unif-k3-r4.26-v350-c1491-S1914191877-004.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.01

No dataNo data? (exit code)
TT=2.354

? (exit code)
TT=1.86

No dataSAT
TT=0.501

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.308

SAT
TT=0.006

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.34

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.742

No dataNo dataNo dataSAT
TT=0.128

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.006

No dataSAT
TT=0.376

No dataNo dataSAT
TT=0.037

SAT
TT=0.006

No dataSAT
TT=24.042

No dataNo dataSAT
TT=0.008

No dataSAT
TT=0.009

random/medium/
unif-k3-r4.26-v350-c1491-S1946851065-023.SATISFIABLE.cnf
SAT
TT=0.004

SAT
TT=0.007

No dataNo data? (exit code)
TT=3.344

? (exit code)
TT=1.823

No dataSAT
TT=0.541

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.329

SAT
TT=0.021

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.468

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.755

No dataNo dataNo dataSAT
TT=0.008

SAT
TT=2.501

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.004

No dataSAT
TT=0.518

No dataNo dataSAT
TT=0.008

SAT
TT=0.007

No dataSAT
TT=23.991

No dataNo dataSAT
TT=0.015

No dataSAT
TT=0.007

random/medium/
unif-k3-r4.26-v350-c1491-S648064606-012.UNKNOWN.cnf
UNSAT
TT=10.246

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=94.092

UNSAT
TT=77.411

No dataUNSAT
TT=109.672

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20662.1

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=10.246

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=52.462

No dataNo dataNo dataUNSAT
TT=83.385

UNSAT
TT=839.49

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=11.268

No dataNo dataUNSAT
TT=337.273

? (TO)
TT=5000.02

No dataUNSAT
TT=166.94

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v350-c1491-S659703274-054.UNKNOWN.cnf
UNSAT
TT=9.235

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=75.213

UNSAT
TT=78.147

No dataUNSAT
TT=109.752

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20807.5

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=9.235

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=49.97

No dataNo dataNo dataUNSAT
TT=74.82

UNSAT
TT=659.402

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=10.152

No dataNo dataUNSAT
TT=77.018

? (TO)
TT=5000.02

No dataUNSAT
TT=166.72

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v350-c1491-S761041117-050.UNKNOWN.cnf
UNSAT
TT=7.311

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=59.033

UNSAT
TT=58.017

No dataUNSAT
TT=108.092

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20832.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=7.311

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=47.312

No dataNo dataNo dataUNSAT
TT=58.26

UNSAT
TT=693.226

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=8.069

No dataNo dataUNSAT
TT=76.013

? (TO)
TT=4999.97

No dataUNSAT
TT=163.73

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v350-c1491-S773607012-011.SATISFIABLE.cnf
SAT
TT=0.003

SAT
TT=0.005

No dataNo data? (exit code)
TT=0.98

? (exit code)
TT=1.079

No dataSAT
TT=0.552

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.112

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.762

No dataNo dataNo dataSAT
TT=0.029

SAT
TT=0.014

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.009

No dataSAT
TT=0.044

No dataNo dataSAT
TT=0.016

SAT
TT=0.005

No dataSAT
TT=23.753

No dataNo dataSAT
TT=0.006

No dataSAT
TT=0.003

random/medium/
unif-k3-r4.26-v350-c1491-S797651048-056.UNKNOWN.cnf
UNSAT
TT=10.869

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=73.427

UNSAT
TT=69.009

No dataUNSAT
TT=112.421

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20773.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=10.869

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=52.887

No dataNo dataNo dataUNSAT
TT=87.936

UNSAT
TT=935.561

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=11.997

No dataNo dataUNSAT
TT=81.671

? (TO)
TT=5000.04

No dataUNSAT
TT=168.83

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v350-c1491-S804294807-063.UNKNOWN.cnf
UNSAT
TT=4.323

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=39.875

UNSAT
TT=35.532

No dataUNSAT
TT=106.817

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21403.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4.323

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=64.665

No dataNo dataNo dataUNSAT
TT=34.921

UNSAT
TT=371.196

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=4.767

No dataNo dataUNSAT
TT=72.256

? (TO)
TT=5000.02

No dataUNSAT
TT=160.82

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v350-c1491-S87195105-042.SATISFIABLE.cnf
SAT
TT=0.003

SAT
TT=0.009

No dataNo data? (exit code)
TT=1.921

? (exit code)
TT=1.693

No dataSAT
TT=0.536

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.22

SAT
TT=0.01

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.19

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.763

No dataNo dataNo dataSAT
TT=0.055

SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.003

No dataSAT
TT=0.21

No dataNo dataSAT
TT=0.01

SAT
TT=0.018

No dataSAT
TT=6.15

No dataNo dataSAT
TT=0.006

No dataSAT
TT=0.008

random/medium/
unif-k3-r4.26-v350-c1491-S946474812-075.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.016

No dataNo data? (exit code)
TT=4.315

? (exit code)
TT=4.397

No dataSAT
TT=0.551

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.147

SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.773

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.757

No dataNo dataNo dataSAT
TT=0.029

SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.007

No dataSAT
TT=0.856

No dataNo dataSAT
TT=0.008

SAT
TT=0.013

No dataSAT
TT=23.765

No dataNo dataSAT
TT=0.005

No dataSAT
TT=0.01

random/medium/
unif-k3-r4.26-v400-c1704-S1023920765-089.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.024

No dataNo data? (exit code)
TT=1.64

? (exit code)
TT=5.285

No dataSAT
TT=0.536

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.175

SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.871

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.823

No dataNo dataNo dataSAT
TT=0.606

SAT
TT=0.836

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=0.96

No dataNo dataSAT
TT=0.014

SAT
TT=0.064

No dataSAT
TT=23.954

No dataNo dataSAT
TT=0.085

No dataSAT
TT=0.02

random/medium/
unif-k3-r4.26-v400-c1704-S1050579435-065.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.014

No dataNo data? (exit code)
TT=288.766

? (exit code)
TT=288.829

No dataSAT
TT=0.606

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.199

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=47.464

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.815

No dataNo dataNo dataSAT
TT=0.666

SAT
TT=0.843

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.025

No dataSAT
TT=52.018

No dataNo dataSAT
TT=0.02

SAT
TT=0.008

No dataSAT
TT=23.753

No dataNo dataSAT
TT=0.014

No dataSAT
TT=0.088

random/medium/
unif-k3-r4.26-v400-c1704-S1081907273-083.UNKNOWN.cnf
UNSAT
TT=38.9

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=279.446

UNSAT
TT=319.47

No dataUNSAT
TT=141.096

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20394.7

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=38.9

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=140.045

No dataNo dataNo dataUNSAT
TT=313.157

UNSAT
TT=4068.62

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=42.782

No dataNo dataUNSAT
TT=120.672

? (TO)
TT=5000.02

No dataUNSAT
TT=202.33

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v400-c1704-S1409021001-079.UNKNOWN.cnf
UNSAT
TT=30.425

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=253.956

UNSAT
TT=262.618

No dataUNSAT
TT=133.388

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21005.5

? (TO)
TT=4999.98

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=30.425

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=176.667

No dataNo dataNo dataUNSAT
TT=246.444

UNSAT
TT=3476.6

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataUNSAT
TT=33.984

No dataNo dataUNSAT
TT=120.201

? (TO)
TT=5000.05

No dataUNSAT
TT=189.24

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v400-c1704-S1440346932-010.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.008

No dataNo data? (exit code)
TT=0.878

? (exit code)
TT=0.925

No dataSAT
TT=0.521

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.264

SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.014

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.788

No dataNo dataNo dataSAT
TT=0.03

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.005

No dataSAT
TT=0.016

No dataNo dataSAT
TT=0.011

SAT
TT=0.005

No dataSAT
TT=23.754

No dataNo dataSAT
TT=0.005

No dataSAT
TT=0.01

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v400-c1704-S1462223811-042.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.01

No dataNo data? (exit code)
TT=1.178

? (exit code)
TT=1.248

No dataSAT
TT=0.505

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.198

SAT
TT=0.014

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.082

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.797

No dataNo dataNo dataSAT
TT=0.089

SAT
TT=0.012

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=0.091

No dataNo dataSAT
TT=0.013

SAT
TT=0.006

No dataSAT
TT=24.063

No dataNo dataSAT
TT=0.008

No dataSAT
TT=0.015

random/medium/
unif-k3-r4.26-v400-c1704-S1511266249-002.UNKNOWN.cnf
UNSAT
TT=46.97

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=343.079

UNSAT
TT=390.391

No dataUNSAT
TT=145.358

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20986.6

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=46.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=284.629

No dataNo dataNo dataUNSAT
TT=373.338

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=50.936

No dataNo dataUNSAT
TT=139.372

? (TO)
TT=5000.04

No dataUNSAT
TT=206.75

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v400-c1704-S1536900137-053.UNKNOWN.cnf
UNSAT
TT=25.67

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=184.129

UNSAT
TT=181.675

No dataUNSAT
TT=126.262

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20468

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=25.67

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=121.946

No dataNo dataNo dataUNSAT
TT=207.739

UNSAT
TT=3981.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=28.056

No dataNo dataUNSAT
TT=109.48

? (TO)
TT=5000.08

No dataUNSAT
TT=184.05

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v400-c1704-S1635333981-027.UNKNOWN.cnf
UNSAT
TT=31.23

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=268.79

UNSAT
TT=229.547

No dataUNSAT
TT=130.65

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21141

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=31.23

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=140.06

No dataNo dataNo dataUNSAT
TT=252

UNSAT
TT=3849.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=34.352

No dataNo dataUNSAT
TT=110.966

? (TO)
TT=5000.07

No dataUNSAT
TT=190.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v400-c1704-S183128297-005.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.063

No dataNo data? (exit code)
TT=11.997

? (exit code)
TT=3.838

No dataSAT
TT=0.533

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.293

SAT
TT=0.02

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.419

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.838

No dataNo dataNo dataSAT
TT=0.202

SAT
TT=0.062

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.018

No dataSAT
TT=2.383

No dataNo dataSAT
TT=0.008

SAT
TT=0.046

No dataSAT
TT=23.758

No dataNo dataSAT
TT=0.021

No dataSAT
TT=0.039

random/medium/
unif-k3-r4.26-v400-c1704-S1864619158-076.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=1.046

No dataNo dataSAT
TT=14.363

SAT
TT=2.553

No dataSAT
TT=1.802

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.399

SAT
TT=1.875

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=12.516

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.232

No dataNo dataNo dataSAT
TT=4.778

SAT
TT=7.284

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.654

No dataSAT
TT=12.645

No dataNo dataSAT
TT=0.006

SAT
TT=2.082

No dataSAT
TT=24.72

No dataNo dataSAT
TT=0.356

No dataSAT
TT=1.24

random/medium/
unif-k3-r4.26-v400-c1704-S1960786523-069.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.02

No dataNo data? (exit code)
TT=9.122

? (exit code)
TT=11.378

No dataSAT
TT=0.518

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.878

SAT
TT=0.029

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.54

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.781

No dataNo dataNo dataSAT
TT=0.736

SAT
TT=0.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.012

No dataSAT
TT=2.813

No dataNo dataSAT
TT=0.039

SAT
TT=0.012

No dataSAT
TT=23.77

No dataNo dataSAT
TT=0.017

No dataSAT
TT=0.005

random/medium/
unif-k3-r4.26-v400-c1704-S496650424-021.UNKNOWN.cnf
UNSAT
TT=23.901

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=150.729

UNSAT
TT=157.588

No dataUNSAT
TT=125.306

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21513.5

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=23.901

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=91.139

No dataNo dataNo dataUNSAT
TT=191.898

UNSAT
TT=2060.25

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.88

No dataUNSAT
TT=26.333

No dataNo dataUNSAT
TT=103.337

? (TO)
TT=5000.03

No dataUNSAT
TT=182.34

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v400-c1704-S549184435-037.UNKNOWN.cnf
UNSAT
TT=37.131

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=304.226

UNSAT
TT=298.238

No dataUNSAT
TT=143.149

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21703.5

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=37.131

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=176.528

No dataNo dataNo dataUNSAT
TT=297.864

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=40.731

No dataNo dataUNSAT
TT=122.732

? (TO)
TT=5000.02

No dataUNSAT
TT=200.83

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v400-c1704-S690749326-001.UNKNOWN.cnf
UNSAT
TT=37.587

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=227.616

UNSAT
TT=296.71

No dataUNSAT
TT=138.375

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21211.7

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=37.587

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=165.9

No dataNo dataNo dataUNSAT
TT=295.02

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataUNSAT
TT=40.278

No dataNo dataUNSAT
TT=128.702

? (TO)
TT=5000.04

No dataUNSAT
TT=196.35

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v400-c1704-S785747282-100.UNKNOWN.cnf
UNSAT
TT=22.385

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=186.943

UNSAT
TT=174.864

No dataUNSAT
TT=124.049

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21493.7

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=22.385

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=149.481

No dataNo dataNo dataUNSAT
TT=180.539

UNSAT
TT=2912.22

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=24.708

No dataNo dataUNSAT
TT=109.406

? (TO)
TT=5000.05

No dataUNSAT
TT=180.75

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v400-c1704-S823305148-084.SATISFIABLE.cnf
SAT
TT=0.009

SAT
TT=0.053

No dataNo data? (exit code)
TT=9.8

? (exit code)
TT=5.91

No dataSAT
TT=0.525

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.329

SAT
TT=0.013

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.177

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.811

No dataNo dataNo dataSAT
TT=0.046

SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.156

No dataSAT
TT=2.394

No dataNo dataSAT
TT=0.045

SAT
TT=0.023

No dataSAT
TT=23.765

No dataNo dataSAT
TT=0.072

No dataSAT
TT=0.015

random/medium/
unif-k3-r4.26-v400-c1704-S895193371-061.UNKNOWN.cnf
UNSAT
TT=27.212

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=197.805

UNSAT
TT=229.156

No dataUNSAT
TT=127.76

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20847.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=27.212

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=111.675

No dataNo dataNo dataUNSAT
TT=218.2

UNSAT
TT=3435.34

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=29.924

No dataNo dataUNSAT
TT=106.639

? (TO)
TT=5000.03

No dataUNSAT
TT=187.84

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v400-c1704-S913455068-085.SATISFIABLE.cnf
SAT
TT=0.003

SAT
TT=0.007

No dataNo data? (exit code)
TT=2.251

? (exit code)
TT=2.278

No dataSAT
TT=0.517

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.407

SAT
TT=0.014

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.24

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.788

No dataNo dataNo dataSAT
TT=0.059

SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.006

No dataSAT
TT=0.265

No dataNo dataSAT
TT=0.006

SAT
TT=0.014

No dataSAT
TT=23.765

No dataNo dataSAT
TT=0.009

No dataSAT
TT=0.003

random/medium/
unif-k3-r4.26-v400-c1704-S930506247-025.SATISFIABLE.cnf
SAT
TT=0.02

SAT
TT=0.089

No dataNo dataSAT
TT=2.07

SAT
TT=3.288

No dataSAT
TT=0.625

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.233

SAT
TT=0.02

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.454

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.824

No dataNo dataNo dataSAT
TT=0.611

SAT
TT=0.98

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.189

No dataSAT
TT=7.116

No dataNo dataSAT
TT=0.027

SAT
TT=0.155

No dataSAT
TT=24.036

No dataNo dataSAT
TT=0.056

No dataSAT
TT=0.388

random/medium/
unif-k3-r4.26-v450-c1917-S1008065350-031.UNKNOWN.cnf
UNSAT
TT=152.069

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=1225.69

UNSAT
TT=1131.43

No dataUNSAT
TT=254.082

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21353.9

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=152.069

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=542.41

No dataNo dataNo dataUNSAT
TT=1229.6

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=167.002

No dataNo dataUNSAT
TT=332.37

? (TO)
TT=5000.09

No data? (TO)
TT=4999.98

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v450-c1917-S1097024859-001.SATISFIABLE.cnf
SAT
TT=0.004

SAT
TT=0.008

No dataNo data? (exit code)
TT=0.975

? (exit code)
TT=1.008

No dataSAT
TT=0.526

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.241

SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.026

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.83

No dataNo dataNo dataSAT
TT=0.042

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.004

No dataSAT
TT=0.029

No dataNo dataSAT
TT=0.008

SAT
TT=0.005

No dataSAT
TT=23.772

No dataNo dataSAT
TT=0.007

No dataSAT
TT=0.004

random/medium/
unif-k3-r4.26-v450-c1917-S116041094-082.UNKNOWN.cnf
UNSAT
TT=145.128

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=1182.43

UNSAT
TT=1171.03

No dataUNSAT
TT=259.673

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21446.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=145.128

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=483.779

No dataNo dataNo dataUNSAT
TT=1176.22

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=158.957

No dataNo dataUNSAT
TT=280.768

? (TO)
TT=5000.05

No dataUNSAT
TT=586.24

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v450-c1917-S1406921020-013.UNKNOWN.cnf
UNSAT
TT=153.377

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=917.633

UNSAT
TT=1125.28

No dataUNSAT
TT=256.039

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21934

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=153.377

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=664.741

No dataNo dataNo dataUNSAT
TT=1251.96

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=169.471

No dataNo dataUNSAT
TT=299.857

? (TO)
TT=5000.01

No dataUNSAT
TT=613.54

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v450-c1917-S1573194644-097.UNKNOWN.cnf
UNSAT
TT=134.386

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=866.362

UNSAT
TT=884.894

No dataUNSAT
TT=236.43

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20279.8

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=136.041

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=385.619

No dataNo dataNo dataUNSAT
TT=983.269

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=134.386

No dataNo dataUNSAT
TT=229.744

? (TO)
TT=5000.09

No data? (TO)
TT=4999.88

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v450-c1917-S1617626827-069.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.021

No dataNo data? (exit code)
TT=131.124

? (exit code)
TT=109.785

No dataSAT
TT=0.522

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.358

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=23.372

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.854

No dataNo dataNo dataSAT
TT=0.071

SAT
TT=0.822

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.051

No dataSAT
TT=24.495

No dataNo dataSAT
TT=0.043

SAT
TT=0.011

No dataSAT
TT=23.774

No dataNo dataSAT
TT=0.009

No dataSAT
TT=0.142

random/medium/
unif-k3-r4.26-v450-c1917-S16302531-099.UNKNOWN.cnf
UNSAT
TT=154.979

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=1147.03

UNSAT
TT=976.564

No dataUNSAT
TT=257.28

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21134

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=154.979

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=500.372

No dataNo dataNo dataUNSAT
TT=1250.09

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=170.823

No dataNo dataUNSAT
TT=278.846

? (TO)
TT=5000.02

No dataUNSAT
TT=612.52

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v450-c1917-S1879031150-062.UNKNOWN.cnf
UNSAT
TT=300.017

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=2151.56

UNSAT
TT=2164.56

No dataUNSAT
TT=414.585

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21670.1

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=300.017

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1259.61

No dataNo dataNo dataUNSAT
TT=2441.37

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=329.203

No dataNo dataUNSAT
TT=513.655

? (TO)
TT=5000.05

No dataUNSAT
TT=799.33

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.1

random/medium/
unif-k3-r4.26-v450-c1917-S1910317962-059.UNKNOWN.cnf
UNSAT
TT=129.859

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=946.156

UNSAT
TT=934.396

No dataUNSAT
TT=236.576

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20723.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=129.859

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=441.905

No dataNo dataNo dataUNSAT
TT=1048.15

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=143.047

No dataNo dataUNSAT
TT=254.639

? (TO)
TT=5000.09

No dataUNSAT
TT=569.33

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v450-c1917-S1915396418-078.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.006

No dataNo data? (exit code)
TT=1.328

? (exit code)
TT=25.188

No dataSAT
TT=0.503

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.176

SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.948

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=165.434

No dataNo dataNo dataSAT
TT=0.04

SAT
TT=0.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.007

No dataSAT
TT=6.597

No dataNo dataSAT
TT=0.014

SAT
TT=0.01

No dataSAT
TT=23.754

No dataNo dataSAT
TT=0.011

No dataSAT
TT=0.006

random/medium/
unif-k3-r4.26-v450-c1917-S1959079526-027.UNKNOWN.cnf
UNSAT
TT=142.579

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=1046

UNSAT
TT=1166.09

No dataUNSAT
TT=259.266

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21164.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=142.579

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=597.245

No dataNo dataNo dataUNSAT
TT=1145.93

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.92

No dataUNSAT
TT=156.967

No dataNo dataUNSAT
TT=278.699

? (TO)
TT=5000.04

No data? (TO)
TT=4999.94

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v450-c1917-S2065964480-034.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.211

No dataNo data? (exit code)
TT=187.734

? (exit code)
TT=156.942

No dataSAT
TT=0.872

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.724

SAT
TT=0.11

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=33.981

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.847

No dataNo dataNo dataSAT
TT=0.115

SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.088

No dataSAT
TT=33.291

No dataNo dataSAT
TT=0.053

SAT
TT=0.053

No dataSAT
TT=23.758

No dataNo dataSAT
TT=0.008

No dataSAT
TT=0.2

random/medium/
unif-k3-r4.26-v450-c1917-S2083898043-071.SATISFIABLE.cnf
SAT
TT=0.012

SAT
TT=0.07

No dataNo dataSAT
TT=1.768

? (exit code)
TT=245.328

No dataSAT
TT=0.578

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.166

SAT
TT=0.166

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=66.246

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.952

No dataNo dataNo dataSAT
TT=2.341

SAT
TT=0.101

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.012

No dataSAT
TT=65.703

No dataNo dataSAT
TT=0.164

SAT
TT=0.021

No dataSAT
TT=23.903

No dataNo dataSAT
TT=0.134

No dataSAT
TT=0.395

random/medium/
unif-k3-r4.26-v450-c1917-S2088689288-085.SATISFIABLE.cnf
SAT
TT=0.007

SAT
TT=0.034

No dataNo dataSAT
TT=1.666

SAT
TT=1.682

No dataSAT
TT=0.602

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.253

SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=28.343

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.836

No dataNo dataNo dataSAT
TT=0.361

SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.031

No dataSAT
TT=31.292

No dataNo dataSAT
TT=0.173

SAT
TT=0.014

No dataSAT
TT=23.766

No dataNo dataSAT
TT=0.022

No dataSAT
TT=0.017

random/medium/
unif-k3-r4.26-v450-c1917-S222128792-011.SATISFIABLE.cnf
SAT
TT=0.004

SAT
TT=0.094

No dataNo data? (exit code)
TT=10.65

? (exit code)
TT=20.273

No dataSAT
TT=0.569

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.175

SAT
TT=0.058

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.257

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.846

No dataNo dataNo dataSAT
TT=0.194

SAT
TT=0.122

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.012

No dataSAT
TT=10.18

No dataNo dataSAT
TT=0.012

SAT
TT=0.02

No dataSAT
TT=23.765

No dataNo dataSAT
TT=0.016

No dataSAT
TT=0.004

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v450-c1917-S367251957-028.UNKNOWN.cnf
UNSAT
TT=207.124

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=1675.69

UNSAT
TT=1669.49

No dataUNSAT
TT=330.844

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21110.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=207.124

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1051.01

No dataNo dataNo dataUNSAT
TT=1687.63

? (MO)
TT=4355.64

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataUNSAT
TT=227.61

No dataNo dataUNSAT
TT=381.203

? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v450-c1917-S380157195-014.SATISFIABLE.cnf
SAT
TT=0.046

SAT
TT=0.099

No dataNo data? (exit code)
TT=18.224

SAT
TT=1.694

No dataSAT
TT=0.543

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.319

SAT
TT=0.088

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.677

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.019

No dataNo dataNo dataSAT
TT=0.075

SAT
TT=0.061

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.083

No dataSAT
TT=20.127

No dataNo dataSAT
TT=0.336

SAT
TT=0.074

No dataSAT
TT=24.07

No dataNo dataSAT
TT=0.046

No dataSAT
TT=0.108

random/medium/
unif-k3-r4.26-v450-c1917-S386464511-018.SATISFIABLE.cnf
SAT
TT=0.029

SAT
TT=0.474

No dataNo dataSAT
TT=2.24

? (exit code)
TT=538.106

No dataSAT
TT=0.672

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.265

SAT
TT=0.225

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=129.84

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.007

No dataNo dataNo dataSAT
TT=4.065

SAT
TT=0.633

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.029

No dataSAT
TT=188.971

No dataNo dataSAT
TT=0.14

SAT
TT=0.103

No dataSAT
TT=23.765

No dataNo dataSAT
TT=0.297

No dataSAT
TT=0.185

random/medium/
unif-k3-r4.26-v450-c1917-S528475885-007.SATISFIABLE.cnf
SAT
TT=0.054

SAT
TT=0.209

No dataNo dataSAT
TT=1.463

SAT
TT=1.907

No dataSAT
TT=0.593

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.839

SAT
TT=0.296

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=133.062

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.141

No dataNo dataNo dataSAT
TT=0.212

SAT
TT=0.054

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.26

No dataSAT
TT=141.504

No dataNo dataSAT
TT=0.214

SAT
TT=0.417

No dataSAT
TT=24.03

No dataNo dataSAT
TT=0.162

No dataSAT
TT=0.396

random/medium/
unif-k3-r4.26-v450-c1917-S794554332-033.UNKNOWN.cnf
UNSAT
TT=111.609

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=685.34

UNSAT
TT=795.986

No dataUNSAT
TT=227.189

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21468.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=111.609

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=399.015

No dataNo dataNo dataUNSAT
TT=902.182

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=122.735

No dataNo dataUNSAT
TT=245.746

? (TO)
TT=5000.03

No dataUNSAT
TT=562.14

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v500-c2130-S1085677759-100.UNKNOWN.cnf
UNSAT
TT=823.532

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=5619.32

UNSAT
TT=5866.43

No dataUNSAT
TT=3687.42

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22272.7

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=823.532

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataUNSAT
TT=6721.55

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=905.031

No dataNo dataUNSAT
TT=1339.77

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v500-c2130-S1094982880-055.UNKNOWN.cnf
UNSAT
TT=626.623

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=4207.66

UNSAT
TT=4389.94

No dataUNSAT
TT=792.303

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21922.1

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=626.623

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3358.64

No dataNo dataNo dataUNSAT
TT=4624.31

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=631.507

No dataNo dataUNSAT
TT=944.995

? (TO)
TT=5000.04

No data? (TO)
TT=4999.81

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v500-c2130-S1205196501-095.UNKNOWN.cnf
UNSAT
TT=757.265

? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=4793.13

UNSAT
TT=4560.91

No dataUNSAT
TT=3542.45

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21827.9

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=762.965

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2485.64

No dataNo dataNo dataUNSAT
TT=5594.89

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=757.265

No dataNo dataUNSAT
TT=1059.34

? (TO)
TT=5000.11

No data? (TO)
TT=4999.99

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

random/medium/
unif-k3-r4.26-v500-c2130-S1263625223-038.SATISFIABLE.cnf
SAT
TT=0.011

SAT
TT=0.011

No dataNo data? (exit code)
TT=36.902

SAT
TT=1.754

No dataSAT
TT=0.585

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.321

SAT
TT=0.036

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8.839

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.884

No dataNo dataNo dataSAT
TT=0.265

SAT
TT=0.82

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.418

No dataSAT
TT=10.849

No dataNo dataSAT
TT=0.05

SAT
TT=0.043

No dataSAT
TT=23.777

No dataNo dataSAT
TT=0.019

No dataSAT
TT=0.222

random/medium/
unif-k3-r4.26-v500-c2130-S1280860344-022.SATISFIABLE.cnf
SAT
TT=0.014

SAT
TT=0.03

No dataNo dataSAT
TT=1.881

? (exit code)
TT=74.457

No dataSAT
TT=0.529

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.293

SAT
TT=0.021

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.289

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.892

No dataNo dataNo dataSAT
TT=0.112

SAT
TT=0.023

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.031

No dataSAT
TT=15.984

No dataNo dataSAT
TT=0.108

SAT
TT=0.014

No dataSAT
TT=23.763

No dataNo dataSAT
TT=0.07

No dataSAT
TT=0.06

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v500-c2130-S1383368897-031.UNKNOWN.cnf
UNSAT
TT=1709.82

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=13316

UNSAT
TT=13103.2

No dataUNSAT
TT=4757.86

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21317.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1709.82

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataUNSAT
TT=13876.2

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=1889.91

No dataNo dataUNSAT
TT=3021.92

? (TO)
TT=5000.03

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v500-c2130-S1514125851-037.UNKNOWN.cnf
UNSAT
TT=954.825

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=6710.82

UNSAT
TT=6572.44

No dataUNSAT
TT=3783.23

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20899.1

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=954.825

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=7598.92

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=1030.29

No dataNo dataUNSAT
TT=1403.85

? (TO)
TT=5000.07

No data? (TO)
TT=4999.94

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v500-c2130-S1563258922-027.SATISFIABLE.cnf
SAT
TT=0.015

SAT
TT=0.03

No dataNo data? (exit code)
TT=417.752

? (exit code)
TT=207.267

No dataSAT
TT=0.562

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.799

SAT
TT=0.029

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=101.948

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.872

No dataNo dataNo dataSAT
TT=0.096

SAT
TT=0.946

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.029

No dataSAT
TT=113.686

No dataNo dataSAT
TT=0.015

SAT
TT=0.017

No dataSAT
TT=23.778

No dataNo dataSAT
TT=0.02

No dataSAT
TT=0.02

random/medium/
unif-k3-r4.26-v500-c2130-S1762880211-075.UNKNOWN.cnf
UNSAT
TT=1657.58

? (TO)
TT=5000.02

No dataNo dataUNSAT
TT=13331.4

UNSAT
TT=13371.1

No dataUNSAT
TT=4637.41

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21656.6

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1657.58

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataUNSAT
TT=13376

? (TO)
TT=4999.95

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=1986.55

No dataNo dataUNSAT
TT=2549.49

? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v500-c2130-S204737200-067.SATISFIABLE.cnf
SAT
TT=0.026

SAT
TT=0.063

No dataNo dataSAT
TT=1.583

SAT
TT=1.723

No dataSAT
TT=0.781

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.303

SAT
TT=0.026

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=120.727

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.043

No dataNo dataNo dataSAT
TT=0.072

SAT
TT=0.992

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.034

No dataSAT
TT=7.257

No dataNo dataSAT
TT=0.227

SAT
TT=0.454

No dataSAT
TT=23.816

No dataNo dataSAT
TT=0.175

No dataSAT
TT=0.111

random/medium/
unif-k3-r4.26-v500-c2130-S2061684506-048.UNKNOWN.cnf
UNSAT
TT=1184.07

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=10170.7

UNSAT
TT=10306.7

No dataUNSAT
TT=4045.48

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21215.5

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1184.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataUNSAT
TT=9600.01

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=1308.23

No dataNo dataUNSAT
TT=1704.38

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v500-c2130-S247862791-097.UNKNOWN.cnf
UNSAT
TT=444.867

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=2775.9

UNSAT
TT=3597.57

No dataUNSAT
TT=654.375

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21348.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=444.867

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2176.21

No dataNo dataNo dataUNSAT
TT=3609.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=492.912

No dataNo dataUNSAT
TT=756.655

? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v500-c2130-S261841674-082.SATISFIABLE.cnf
SAT
TT=0.936

SAT
TT=20.861

No dataNo dataSAT
TT=93.357

SAT
TT=32.383

No dataWrong Cert.
TT=3431

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.603

SAT
TT=16.54

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=841.395

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.936

No dataNo dataNo dataSAT
TT=117.967

SAT
TT=29.757

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.885

No dataSAT
TT=1439.63

No dataNo dataSAT
TT=213.769

SAT
TT=2.266

No dataSAT
TT=293.77

No dataNo dataSAT
TT=4.068

No dataSAT
TT=4.764

random/medium/
unif-k3-r4.26-v500-c2130-S31329941-054.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.025

No dataNo data? (exit code)
TT=5.361

? (exit code)
TT=16.903

No dataSAT
TT=0.587

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.373

SAT
TT=0.012

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.904

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.882

No dataNo dataNo dataSAT
TT=0.073

SAT
TT=0.025

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=4.38

No dataNo dataSAT
TT=0.019

SAT
TT=0.011

No dataSAT
TT=23.772

No dataNo dataSAT
TT=0.027

No dataSAT
TT=0.005

random/medium/
unif-k3-r4.26-v500-c2130-S481747904-003.SATISFIABLE.cnf
SAT
TT=0.025

SAT
TT=0.032

No dataNo dataSAT
TT=2.196

SAT
TT=1.838

No dataSAT
TT=0.697

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.344

SAT
TT=0.251

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=615.196

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=84.882

No dataNo dataNo dataSAT
TT=1.08

SAT
TT=0.962

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.493

No dataSAT
TT=745.841

No dataNo dataSAT
TT=0.274

SAT
TT=0.025

No dataSAT
TT=23.772

No dataNo dataSAT
TT=0.125

No dataSAT
TT=0.08

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v500-c2130-S670753028-051.UNKNOWN.cnf
UNSAT
TT=917.804

? (TO)
TT=5000.02

No dataNo dataUNSAT
TT=6241.27

UNSAT
TT=7373.82

No dataUNSAT
TT=3820.85

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21480.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=917.804

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4457.83

No dataNo dataNo dataUNSAT
TT=7420.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=1005.59

No dataNo dataUNSAT
TT=1374.55

? (TO)
TT=5000.04

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v500-c2130-S769368248-036.UNKNOWN.cnf
UNSAT
TT=1227.32

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=9028.75

UNSAT
TT=10742.9

No dataUNSAT
TT=4082.58

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21573.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1227.32

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataUNSAT
TT=9921.13

? (TO)
TT=4999.98

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=1344.22

No dataNo dataUNSAT
TT=1770.54

? (TO)
TT=5000.05

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v500-c2130-S831119356-083.SATISFIABLE.cnf
SAT
TT=0.015

SAT
TT=0.054

No dataNo dataSAT
TT=1.786

SAT
TT=1.672

No dataSAT
TT=0.614

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.191

SAT
TT=0.015

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=258.866

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.147

No dataNo dataNo dataSAT
TT=4.358

SAT
TT=0.815

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.02

No dataSAT
TT=285.988

No dataNo dataSAT
TT=0.546

SAT
TT=0.394

No dataSAT
TT=23.997

No dataNo dataSAT
TT=0.052

No dataSAT
TT=0.173

random/medium/
unif-k3-r4.26-v500-c2130-S840902310-084.SATISFIABLE.cnf
SAT
TT=0.014

SAT
TT=0.014

No dataNo dataSAT
TT=1.548

? (exit code)
TT=1.613

No dataSAT
TT=0.628

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.408

SAT
TT=0.15

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=22.195

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.023

No dataNo dataNo dataSAT
TT=0.924

SAT
TT=0.014

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.063

No dataSAT
TT=22.582

No dataNo dataSAT
TT=0.027

SAT
TT=0.117

No dataSAT
TT=23.78

No dataNo dataSAT
TT=0.095

No dataSAT
TT=0.177

random/medium/
unif-k3-r4.26-v500-c2130-S9113894-047.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.01

No dataNo data? (exit code)
TT=2.152

? (exit code)
TT=2.278

No dataSAT
TT=0.551

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.35

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.739

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=122.01

No dataNo dataNo dataSAT
TT=0.029

SAT
TT=0.014

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.005

No dataSAT
TT=0.821

No dataNo dataSAT
TT=0.022

SAT
TT=0.01

No dataSAT
TT=23.77

No dataNo dataSAT
TT=0.021

No dataSAT
TT=0.005

random/medium/
unif-k3-r4.26-v550-c2343-S107514131-038.SATISFIABLE.cnf
SAT
TT=0.009

SAT
TT=0.019

No dataNo data? (exit code)
TT=77.413

? (exit code)
TT=77.202

No dataSAT
TT=0.537

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.324

SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=37.606

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.913

No dataNo dataNo dataSAT
TT=0.042

SAT
TT=0.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.027

No dataSAT
TT=41.75

No dataNo dataSAT
TT=0.017

SAT
TT=0.048

No dataSAT
TT=23.771

No dataNo dataSAT
TT=0.009

No dataSAT
TT=0.027

random/medium/
unif-k3-r4.26-v550-c2343-S1114532273-035.SATISFIABLE.cnf
SAT
TT=0.016

SAT
TT=0.022

No dataNo dataSAT
TT=1.601

? (TO)
TT=2930.64

No dataSAT
TT=0.564

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.122

SAT
TT=0.025

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.933

No dataNo dataNo dataSAT
TT=0.321

SAT
TT=0.048

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.056

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=0.077

SAT
TT=0.09

No dataSAT
TT=23.774

No dataNo dataSAT
TT=0.036

No dataSAT
TT=0.016

random/medium/
unif-k3-r4.26-v550-c2343-S1163259790-073.UNKNOWN.cnf
UNSAT
TT=2978.05

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=26364.1

UNSAT
TT=25555.1

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21062.4

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2978.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataUNSAT
TT=24189

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataUNSAT
TT=3260.41

No dataNo dataUNSAT
TT=4581.92

? (TO)
TT=5000.1

No data? (TO)
TT=4999.8

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v550-c2343-S1552308135-080.SATISFIABLE.cnf
SAT
TT=0.027

SAT
TT=0.081

No dataNo data? (TO)
TT=878.85

? (TO)
TT=1850.28

No dataSAT
TT=0.554

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.306

SAT
TT=0.049

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=942.324

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.021

No dataNo dataNo dataSAT
TT=0.234

SAT
TT=0.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.034

No dataSAT
TT=1038.18

No dataNo dataSAT
TT=0.039

SAT
TT=0.041

No dataSAT
TT=23.765

No dataNo dataSAT
TT=0.084

No dataSAT
TT=0.027

random/medium/
unif-k3-r4.26-v550-c2343-S1554089933-067.UNKNOWN.cnf



? (TO)
TT=5000.09

No dataNo data?
TT=34773.8

? (TO)
TT=40000.8

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22119.6

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4999.01

? (TO)
TT=5000.06

No data? (TO)
TT=4999.96

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v550-c2343-S1610857498-043.SATISFIABLE.cnf
SAT
TT=0.007

SAT
TT=0.028

No dataNo data? (exit code)
TT=110.371

? (exit code)
TT=112.683

No dataSAT
TT=0.538

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.291

SAT
TT=0.036

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=35.916

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.91

No dataNo dataNo dataSAT
TT=0.045

SAT
TT=0.058

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.011

No dataSAT
TT=44.019

No dataNo dataSAT
TT=0.007

SAT
TT=0.011

No dataSAT
TT=23.879

No dataNo dataSAT
TT=0.011

No dataSAT
TT=0.012

random/medium/
unif-k3-r4.26-v550-c2343-S1663503036-045.UNKNOWN.cnf
UNSAT
TT=3292.86

? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=27371

UNSAT
TT=24489.7

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22444.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3292.86

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataUNSAT
TT=26678.5

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=3605.51

No dataNo data? (exit code)
TT=4998.85

? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v550-c2343-S1693168158-005.UNKNOWN.cnf
UNSAT
TT=2349.78

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=18959

UNSAT
TT=19809.5

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22176.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2349.78

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=19057.6

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=2585.31

No dataNo dataUNSAT
TT=3219.97

? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

random/medium/
unif-k3-r4.26-v550-c2343-S1694067460-072.UNKNOWN.cnf
UNSAT
TT=1906.91

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=11102.2

UNSAT
TT=13895.3

No dataUNSAT
TT=4584.03

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21660.4

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1917.7

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataUNSAT
TT=13975.8

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=1906.91

No dataNo dataUNSAT
TT=2777.62

? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v550-c2343-S1940049314-069.SATISFIABLE.cnf
SAT
TT=0.007

SAT
TT=0.018

No dataNo data? (exit code)
TT=194.725

? (exit code)
TT=386.416

No dataSAT
TT=0.581

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.123

SAT
TT=0.007

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=76.73

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataSAT
TT=0.879

SAT
TT=0.061

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=85.194

No dataNo dataSAT
TT=0.038

SAT
TT=0.008

No dataSAT
TT=23.78

No dataNo dataSAT
TT=0.013

No dataSAT
TT=0.03

random/medium/
unif-k3-r4.26-v550-c2343-S2058622508-076.SATISFIABLE.cnf
SAT
TT=0.024

SAT
TT=0.279

No dataNo dataSAT
TT=1.833

SAT
TT=1.957

No dataSAT
TT=0.669

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.299

SAT
TT=0.461

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1328.68

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.926

No dataNo dataNo dataSAT
TT=0.606

SAT
TT=0.532

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.055

No dataSAT
TT=1338.44

No dataNo dataSAT
TT=0.358

SAT
TT=0.024

No dataSAT
TT=23.78

No dataNo dataSAT
TT=0.13

No dataSAT
TT=0.411

random/medium/
unif-k3-r4.26-v550-c2343-S311101868-094.SATISFIABLE.cnf
SAT
TT=0.046

SAT
TT=3.344

No dataNo dataSAT
TT=2.223

SAT
TT=1.877

No dataSAT
TT=3.24

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.527

SAT
TT=2.123

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1244.2

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.46

No dataNo dataNo dataSAT
TT=37.404

SAT
TT=0.153

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.046

No dataSAT
TT=1368.1

No dataNo dataSAT
TT=6.607

SAT
TT=1.968

No dataSAT
TT=25.71

No dataNo dataSAT
TT=0.213

No dataSAT
TT=0.822

random/medium/
unif-k3-r4.26-v550-c2343-S591042619-090.UNKNOWN.cnf
UNSAT
TT=3358.18

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=27093.1

UNSAT
TT=34707.4

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22073.9

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3358.18

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=27133.9

? (TO)
TT=4999.98

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=3675.27

No dataNo dataUNSAT
TT=4680.92

? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v550-c2343-S720541313-052.UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data?
TT=30790.5

? (TO)
TT=40000.4

No data? (TO)
TT=4816.26

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22368.6

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.97

? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v550-c2343-S816372663-049.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data?
TT=39839.4

? (TO)
TT=36015.1

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21850

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4999.03

? (TO)
TT=4999.71

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v550-c2343-S874954918-011.SATISFIABLE.cnf
SAT
TT=0.022

SAT
TT=0.775

No dataNo data? (exit code)
TT=1.738

SAT
TT=1.754

No dataSAT
TT=1.06

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.153

SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=267.691

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.097

No dataNo dataNo dataSAT
TT=0.246

SAT
TT=0.045

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.071

No dataSAT
TT=295.934

No dataNo dataSAT
TT=0.313

SAT
TT=0.053

No dataSAT
TT=23.772

No dataNo dataSAT
TT=0.373

No dataSAT
TT=0.133

random/medium/
unif-k3-r4.26-v550-c2343-S912111154-025.UNKNOWN.cnf
UNSAT
TT=2260.91

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=16017.4

UNSAT
TT=18249.9

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21794.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2260.91

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataUNSAT
TT=18414.5

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=2501.49

No dataNo dataUNSAT
TT=3139.78

? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v550-c2343-S927210717-059.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.041

No dataNo data? (exit code)
TT=1.457

? (exit code)
TT=74.187

No dataSAT
TT=0.542

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.131

SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=72.361

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.937

No dataNo dataNo dataSAT
TT=0.082

SAT
TT=0.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.037

No dataSAT
TT=79.683

No dataNo dataSAT
TT=0.17

SAT
TT=0.018

No dataSAT
TT=23.767

No dataNo dataSAT
TT=0.026

No dataSAT
TT=0.005

random/medium/
unif-k3-r4.26-v550-c2343-S943066845-088.UNKNOWN.cnf
UNSAT
TT=2695.29

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=21643.6

UNSAT
TT=20426.2

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22467.1

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2695.29

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataUNSAT
TT=21805.3

? (TO)
TT=4999.95

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=2979.41

No dataNo dataUNSAT
TT=4697

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v550-c2343-S960198064-030.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.008

No dataNo dataSAT
TT=2.142

? (exit code)
TT=356.61

No dataSAT
TT=0.547

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.334

SAT
TT=0.015

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=56.958

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.927

No dataNo dataNo dataSAT
TT=0.088

SAT
TT=0.026

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.024

No dataSAT
TT=63.544

No dataNo dataSAT
TT=0.088

SAT
TT=0.033

No dataSAT
TT=24.032

No dataNo dataSAT
TT=0.014

No dataSAT
TT=0.055

random/medium/
unif-k3-r4.26-v600-c2556-S1245124682-071.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data?
TT=30765

? (TO)
TT=35916.1

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21899.1

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.4

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.55

? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v600-c2556-S1339958817-007.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=39105.4

? (TO)
TT=40000.5

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22648.4

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.95

? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v600-c2556-S1383380994-043.SATISFIABLE.cnf
SAT
TT=0.141

SAT
TT=2.783

No dataNo dataSAT
TT=9.973

SAT
TT=2.163

No dataSAT
TT=4.894

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8.011

SAT
TT=0.263

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=104.626

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.493

No dataNo dataNo dataSAT
TT=17.54

SAT
TT=7.572

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.141

No dataSAT
TT=115.868

No dataNo dataSAT
TT=1.19

SAT
TT=0.492

No dataSAT
TT=23.77

No dataNo dataSAT
TT=0.673

No dataSAT
TT=0.32

random/medium/
unif-k3-r4.26-v600-c2556-S1468528501-076.SATISFIABLE.cnf
SAT
TT=0.725

SAT
TT=3.59

No dataNo dataSAT
TT=10.919

SAT
TT=49.338

No dataSAT
TT=0.994

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=15.579

SAT
TT=0.725

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4029.45

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.014

No dataNo dataNo dataSAT
TT=18.963

SAT
TT=8.278

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.101

No dataSAT
TT=4450.26

No dataNo dataSAT
TT=9.097

SAT
TT=1.285

No dataSAT
TT=25.23

No dataNo dataSAT
TT=1.575

No dataSAT
TT=5.951

random/medium/
unif-k3-r4.26-v600-c2556-S1677156340-036.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=29950.6

? (TO)
TT=40000.4

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22538.5

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.96

? (TO)
TT=5000.04

No data? (TO)
TT=4999.76

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v600-c2556-S1720013904-060.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data?
TT=39819.8

? (TO)
TT=31876

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22447.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.55

? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

random/medium/
unif-k3-r4.26-v600-c2556-S1734827769-099.UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data?
TT=28529.2

? (TO)
TT=40000.7

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21646.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v600-c2556-S1885965779-049.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=39458.2

? (TO)
TT=40000.4

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22233.4

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.54

? (TO)
TT=5000.03

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v600-c2556-S2019147653-030.SATISFIABLE.cnf
SAT
TT=0.089

SAT
TT=0.597

No dataNo dataSAT
TT=1.535

SAT
TT=6.156

No dataSAT
TT=1.959

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.491

SAT
TT=1.748

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1684.78

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.999

No dataNo dataNo dataSAT
TT=0.14

SAT
TT=0.089

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.839

No dataSAT
TT=1863.49

No dataNo dataSAT
TT=0.144

SAT
TT=0.719

No dataSAT
TT=24.15

No dataNo dataSAT
TT=0.176

No dataSAT
TT=0.754

random/medium/
unif-k3-r4.26-v600-c2556-S2050053883-062.SATISFIABLE.cnf
SAT
TT=0.824

SAT
TT=4.94

No dataNo dataSAT
TT=30.294

SAT
TT=9.379

No dataSAT
TT=13.373

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.203

SAT
TT=1.186

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4953.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.535

No dataNo dataNo dataSAT
TT=3.318

SAT
TT=0.824

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.087

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=8.039

SAT
TT=2.463

No dataSAT
TT=27.03

No dataNo dataSAT
TT=1.051

No dataSAT
TT=25.775

random/medium/
unif-k3-r4.26-v600-c2556-S224791863-033.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=35056.9

? (TO)
TT=40000.6

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=20799.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.14

No dataNo data? (exit code)
TT=4998.57

? (TO)
TT=5000.06

No data? (TO)
TT=4999.85

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v600-c2556-S248192082-054.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=39838.1

? (TO)
TT=40000.7

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22041.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.03

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v600-c2556-S252359291-002.SATISFIABLE.cnf
SAT
TT=0.023

SAT
TT=0.271

No dataNo data? (exit code)
TT=1099.62

? (TO)
TT=1135.06

No dataSAT
TT=0.596

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.544

SAT
TT=0.023

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=181.109

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.008

No dataNo dataNo dataSAT
TT=1.358

SAT
TT=0.043

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.092

No dataSAT
TT=201.167

No dataNo dataSAT
TT=0.165

SAT
TT=0.029

No dataSAT
TT=23.773

No dataNo dataSAT
TT=0.065

No dataSAT
TT=0.096

random/medium/
unif-k3-r4.26-v600-c2556-S373048162-052.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.012

No dataNo data? (TO)
TT=195.99

? (exit code)
TT=438.37

No dataSAT
TT=0.605

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.236

SAT
TT=0.037

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=494.625

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.967

No dataNo dataNo dataSAT
TT=0.213

SAT
TT=0.015

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.084

No dataSAT
TT=480.833

No dataNo dataSAT
TT=0.251

SAT
TT=0.026

No dataSAT
TT=23.794

No dataNo dataSAT
TT=0.026

No dataSAT
TT=0.005

random/medium/
unif-k3-r4.26-v600-c2556-S379672572-039.SATISFIABLE.cnf
SAT
TT=0.014

SAT
TT=0.054

No dataNo dataSAT
TT=4.245

SAT
TT=3.239

No dataSAT
TT=2.621

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.647

SAT
TT=0.477

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.361

No dataNo dataNo dataSAT
TT=0.969

SAT
TT=1.378

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.029

No dataSAT
TT=3461.39

No dataNo dataSAT
TT=1.609

SAT
TT=0.014

No dataSAT
TT=23.789

No dataNo dataSAT
TT=1.894

No dataSAT
TT=0.997

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v600-c2556-S506401817-075.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data?
TT=23661.4

? (TO)
TT=40000.9

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22900.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.92

? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v600-c2556-S610796494-086.SATISFIABLE.cnf
SAT
TT=0.023

SAT
TT=0.794

No dataNo data? (TO)
TT=1080.69

? (TO)
TT=685.88

No dataSAT
TT=0.765

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.24

SAT
TT=0.023

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.059

No dataNo dataNo dataSAT
TT=0.384

SAT
TT=0.111

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.174

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=0.417

SAT
TT=0.176

No dataSAT
TT=23.784

No dataNo dataSAT
TT=0.408

No dataSAT
TT=0.358

random/medium/
unif-k3-r4.26-v600-c2556-S727005963-093.SATISFIABLE.cnf
SAT
TT=0.029

SAT
TT=0.046

No dataNo data? (TO)
TT=690.63

? (TO)
TT=1572.05

No dataSAT
TT=0.753

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.672

SAT
TT=0.048

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=585.061

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.988

No dataNo dataNo dataSAT
TT=0.052

SAT
TT=0.029

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.07

No dataSAT
TT=646.801

No dataNo dataSAT
TT=0.055

SAT
TT=0.055

No dataSAT
TT=23.799

No dataNo dataSAT
TT=0.039

No dataSAT
TT=0.073

random/medium/
unif-k3-r4.26-v600-c2556-S735137557-045.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.013

No dataNo data? (exit code)
TT=9.14

? (exit code)
TT=3.439

No dataSAT
TT=0.53

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.163

SAT
TT=0.01

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.057

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.977

No dataNo dataNo dataSAT
TT=0.099

SAT
TT=0.019

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.006

No dataSAT
TT=2.296

No dataNo dataSAT
TT=0.016

SAT
TT=0.029

No dataSAT
TT=23.78

No dataNo dataSAT
TT=0.027

No dataSAT
TT=0.007

random/medium/
unif-k3-r4.26-v600-c2556-S869604189-077.UNKNOWN.cnf



? (TO)
TT=5000.11

No dataNo data?
TT=34906.5

? (TO)
TT=40000.6

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22610

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4999.15

? (TO)
TT=5000.02

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v650-c2769-S1069233620-009.SATISFIABLE.cnf
SAT
TT=3.729

SAT
TT=22.615

No dataNo dataSAT
TT=90.831

SAT
TT=32.779

No dataSAT
TT=80.505

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.532

SAT
TT=4.292

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.729

No dataNo dataNo dataSAT
TT=75.796

SAT
TT=3.729

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.859

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4999.02

SAT
TT=8.298

No dataSAT
TT=280.73

No dataNo dataSAT
TT=32.474

No dataSAT
TT=5.186

random/medium/
unif-k3-r4.26-v650-c2769-S1235135694-059.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=39823.2

? (TO)
TT=36029.5

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21814.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=39972.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.96

? (TO)
TT=5000.02

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v650-c2769-S1261029273-036.SATISFIABLE.cnf
SAT
TT=0.037

SAT
TT=0.838

No dataNo dataSAT
TT=1.54

SAT
TT=6.285

No dataSAT
TT=2.393

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.165

SAT
TT=0.772

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.082

No dataNo dataNo dataSAT
TT=0.286

SAT
TT=0.885

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.048

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=0.434

SAT
TT=0.046

No dataSAT
TT=24.33

No dataNo dataSAT
TT=0.059

No dataSAT
TT=0.037

random/medium/
unif-k3-r4.26-v650-c2769-S1298256564-085.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40354.3

? (TO)
TT=35783.7

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22528.3

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.35

? (TO)
TT=4999.9

No data? (TO)
TT=4999.78

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v650-c2769-S1402967451-034.SATISFIABLE.cnf
SAT
TT=1.256

SAT
TT=18.077

No dataNo dataSAT
TT=1.979

SAT
TT=176.558

No dataSAT
TT=698.28

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.67

SAT
TT=2.625

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.256

No dataNo dataNo dataSAT
TT=126.751

SAT
TT=64.768

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.995

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=3.688

SAT
TT=21.471

No dataSAT
TT=326.78

No dataNo dataSAT
TT=1.956

No dataSAT
TT=24.458

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v650-c2769-S1495462442-016.SATISFIABLE.cnf
SAT
TT=0.012

SAT
TT=1.622

No dataNo dataSAT
TT=1.728

SAT
TT=1.805

No dataSAT
TT=0.752

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.776

SAT
TT=0.625

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.423

No dataNo dataNo dataSAT
TT=0.15

SAT
TT=2.056

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.454

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=2.018

SAT
TT=0.127

No dataSAT
TT=24.23

No dataNo dataSAT
TT=0.012

No dataSAT
TT=2.13

random/medium/
unif-k3-r4.26-v650-c2769-S1631976568-086.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=21383

? (TO)
TT=31316.7

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22813.8

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4999

? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v650-c2769-S1894319588-015.SATISFIABLE.cnf
SAT
TT=0.012

SAT
TT=0.019

No dataNo dataSAT
TT=1.644

? (TO)
TT=3239.81

No dataSAT
TT=0.614

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.23

SAT
TT=0.06

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=564.032

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.012

No dataNo dataNo dataSAT
TT=0.289

SAT
TT=1.685

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.053

No dataSAT
TT=559.608

No dataNo dataSAT
TT=0.025

SAT
TT=0.012

No dataSAT
TT=23.786

No dataNo dataSAT
TT=0.08

No dataSAT
TT=0.03

random/medium/
unif-k3-r4.26-v650-c2769-S1920526651-049.SATISFIABLE.cnf
SAT
TT=0.007

SAT
TT=0.077

No dataNo dataSAT
TT=2.249

SAT
TT=2.189

No dataSAT
TT=0.984

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.382

SAT
TT=0.292

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1790.48

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.995

No dataNo dataNo dataSAT
TT=0.615

SAT
TT=1.285

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.122

No dataSAT
TT=2027.21

No dataNo dataSAT
TT=0.676

SAT
TT=0.082

No dataSAT
TT=24.051

No dataNo dataSAT
TT=0.652

No dataSAT
TT=0.007

random/medium/
unif-k3-r4.26-v650-c2769-S2065143904-035.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=39077.2

? (TO)
TT=35888.6

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=21981.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.94

? (TO)
TT=5000.03

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v650-c2769-S216164582-083.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=29817.3

? (TO)
TT=34057.9

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22015.5

? (TO)
TT=4999.96

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39972.4

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=4999.88

No dataNo data? (exit code)
TT=4998.57

? (TO)
TT=5000.05

No data? (TO)
TT=4999.95

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v650-c2769-S29470018-050.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=35440.3

? (TO)
TT=40000.3

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22194.5

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.94

? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.08

random/medium/
unif-k3-r4.26-v650-c2769-S30721646-064.SATISFIABLE.cnf
SAT
TT=0.01

SAT
TT=0.028

No dataNo data? (TO)
TT=2346.96

? (TO)
TT=1371.38

No dataSAT
TT=0.527

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.239

SAT
TT=0.03

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1511.86

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.999

No dataNo dataNo dataSAT
TT=0.267

SAT
TT=0.84

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.044

No dataSAT
TT=1660.41

No dataNo dataSAT
TT=0.059

SAT
TT=0.097

No dataSAT
TT=23.788

No dataNo dataSAT
TT=0.058

No dataSAT
TT=0.01

random/medium/
unif-k3-r4.26-v650-c2769-S4140122-004.SATISFIABLE.cnf
SAT
TT=0.021

SAT
TT=0.043

No dataNo dataSAT
TT=1.594

SAT
TT=1.819

No dataSAT
TT=0.767

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.537

SAT
TT=0.054

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1578.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.336

No dataNo dataNo dataSAT
TT=0.123

SAT
TT=1.096

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.179

No dataSAT
TT=1747.9

No dataNo dataSAT
TT=0.115

SAT
TT=0.102

No dataSAT
TT=23.785

No dataNo dataSAT
TT=0.1

No dataSAT
TT=0.021

random/medium/
unif-k3-r4.26-v650-c2769-S466707249-079.SATISFIABLE.cnf
SAT
TT=0.03

SAT
TT=0.069

No dataNo dataSAT
TT=1.876

SAT
TT=3.844

No dataSAT
TT=1.095

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.552

SAT
TT=0.03

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3076.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.145

No dataNo dataNo dataSAT
TT=0.671

SAT
TT=0.121

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.057

No dataSAT
TT=3799.5

No dataNo dataSAT
TT=0.104

SAT
TT=0.257

No dataSAT
TT=24.051

No dataNo dataSAT
TT=0.059

No dataSAT
TT=0.084

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v650-c2769-S510739670-068.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=39129.9

? (TO)
TT=36857.4

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22342.2

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

random/medium/
unif-k3-r4.26-v650-c2769-S525571208-063.SATISFIABLE.cnf
SAT
TT=0.012

SAT
TT=0.138

No dataNo dataSAT
TT=1.535

? (TO)
TT=685.92

No dataSAT
TT=1.097

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.416

SAT
TT=0.039

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1292.47

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.001

No dataNo dataNo dataSAT
TT=2.099

SAT
TT=0.461

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.128

No dataSAT
TT=1426.34

No dataNo dataSAT
TT=0.188

SAT
TT=0.012

No dataSAT
TT=23.785

No dataNo dataSAT
TT=0.398

No dataSAT
TT=0.035

random/medium/
unif-k3-r4.26-v650-c2769-S910125393-002.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=30916.1

? (TO)
TT=32095.5

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22511

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=36926.6

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4999.04

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k3-r4.26-v650-c2769-S944656226-046.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data?
TT=39109.6

? (TO)
TT=35829.1

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22488.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=39972.7

? (TO)
TT=4999.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.57

? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v650-c2769-S960948361-055.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=39823.9

? (TO)
TT=40000.3

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22961.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.4

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.58

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

random/medium/
unif-k3-r4.26-v700-c2982-S1124205008-074.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=28413.5

? (TO)
TT=35548

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22338.3

? (TO)
TT=4999.98

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=39971.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=4999.98

No dataNo data? (exit code)
TT=4998.63

? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

random/medium/
unif-k3-r4.26-v700-c2982-S115072124-051.SATISFIABLE.cnf
SAT
TT=0.052

SAT
TT=0.781

No dataNo dataSAT
TT=2.111

SAT
TT=2.193

No dataSAT
TT=0.618

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.837

SAT
TT=1.147

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.317

No dataNo dataNo dataSAT
TT=0.897

SAT
TT=0.052

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.119

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=0.438

SAT
TT=0.495

No dataSAT
TT=25.55

No dataNo dataSAT
TT=0.134

No dataSAT
TT=0.521

random/medium/
unif-k3-r4.26-v700-c2982-S1230934123-063.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=39827.1

? (TO)
TT=40000.4

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22365.9

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39971.9

? (TO)
TT=4999.79

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.17

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.47

? (TO)
TT=5000.05

No data? (TO)
TT=4999.99

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v700-c2982-S1565617179-002.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data?
TT=39864

? (TO)
TT=40000.4

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22658.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=39971.3

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.62

? (TO)
TT=5000.03

No data? (TO)
TT=4999.71

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v700-c2982-S157016908-041.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=29030.1

? (TO)
TT=31805.5

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22955.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.4

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.97

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v700-c2982-S1617172756-030.SATISFIABLE.cnf
SAT
TT=0.009

SAT
TT=0.018

No dataNo data? (exit code)
TT=87.251

? (exit code)
TT=344.707

No dataSAT
TT=0.573

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.459

SAT
TT=0.018

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=93.729

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.098

No dataNo dataNo dataSAT
TT=0.05

SAT
TT=0.928

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.046

No dataSAT
TT=94.882

No dataNo dataSAT
TT=0.012

SAT
TT=0.01

No dataSAT
TT=23.788

No dataNo dataSAT
TT=0.013

No dataSAT
TT=0.009

random/medium/
unif-k3-r4.26-v700-c2982-S171669125-021.SATISFIABLE.cnf
SAT
TT=0.008

SAT
TT=0.023

No dataNo data? (TO)
TT=878.38

? (exit code)
TT=583.222

No dataSAT
TT=0.583

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.215

SAT
TT=0.025

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=571.168

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.041

No dataNo dataNo dataSAT
TT=0.083

SAT
TT=0.019

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=634.628

No dataNo dataSAT
TT=0.02

SAT
TT=0.019

No dataSAT
TT=24.023

No dataNo dataSAT
TT=0.034

No dataSAT
TT=0.008

random/medium/
unif-k3-r4.26-v700-c2982-S1744841484-003.SATISFIABLE.cnf
SAT
TT=0.024

SAT
TT=0.443

No dataNo dataSAT
TT=1.595

? (TO)
TT=2731.21

No dataSAT
TT=1.001

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.654

SAT
TT=0.024

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1398.98

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.058

No dataNo dataNo dataSAT
TT=0.672

SAT
TT=0.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.042

No dataSAT
TT=1400.81

No dataNo dataSAT
TT=0.305

SAT
TT=0.277

No dataSAT
TT=23.787

No dataNo dataSAT
TT=0.123

No dataSAT
TT=0.064

random/medium/
unif-k3-r4.26-v700-c2982-S1800377425-032.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=30514.7

? (TO)
TT=35968.1

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=22363.8

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39972.5

? (TO)
TT=4999.93

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4999.01

? (TO)
TT=5000.03

No data? (TO)
TT=4999.98

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.09

random/medium/
unif-k3-r4.26-v700-c2982-S1863077195-052.SATISFIABLE.cnf
SAT
TT=0.061

SAT
TT=0.137

No dataNo data? (exit code)
TT=1.585

SAT
TT=1.767

No dataSAT
TT=0.674

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.398

SAT
TT=0.217

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.224

No dataNo dataNo dataSAT
TT=1.094

SAT
TT=0.885

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.061

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=0.291

SAT
TT=0.371

No dataSAT
TT=23.791

No dataNo dataSAT
TT=0.947

No dataSAT
TT=0.177

random/medium/
unif-k3-r4.26-v700-c2982-S1971541934-090.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data?
TT=34806.1

? (TO)
TT=40000.7

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=23384

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39966.7

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.94

? (TO)
TT=4999.83

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v700-c2982-S2036658259-036.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (TO)
TT=42361.6

? (TO)
TT=32168

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=23244.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4999.2

? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v700-c2982-S608588601-044.SATISFIABLE.cnf
SAT
TT=0.109

SAT
TT=0.109

No dataNo dataSAT
TT=4.477

SAT
TT=31.159

No dataSAT
TT=35.016

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.152

SAT
TT=1.395

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.675

No dataNo dataNo dataSAT
TT=15.022

SAT
TT=3.367

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.197

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=1.043

SAT
TT=1.074

No dataSAT
TT=24.54

No dataNo dataSAT
TT=5.047

No dataSAT
TT=0.84

random/medium/
unif-k3-r4.26-v700-c2982-S628307658-028.SATISFIABLE.cnf
SAT
TT=0.021

SAT
TT=0.894

No dataNo data? (exit code)
TT=1.457

SAT
TT=1.796

No dataSAT
TT=0.64

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.042

SAT
TT=0.238

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.985

No dataNo dataNo dataSAT
TT=1.548

SAT
TT=0.021

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.144

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=0.446

SAT
TT=0.223

No dataSAT
TT=23.783

No dataNo dataSAT
TT=0.309

No dataSAT
TT=1.527

random/medium/
unif-k3-r4.26-v700-c2982-S812011128-009.SATISFIABLE.cnf
SAT
TT=0.258

SAT
TT=2.247

No dataNo dataSAT
TT=7.42

SAT
TT=4.527

No dataSAT
TT=1.022

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.706

SAT
TT=0.258

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.019

No dataNo dataNo dataSAT
TT=1.65

SAT
TT=0.311

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.679

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=2.689

SAT
TT=3.254

No dataSAT
TT=23.786

No dataNo dataSAT
TT=1.187

No dataSAT
TT=0.961

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v700-c2982-S826445785-043.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=39060.2

? (TO)
TT=33398.9

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=23224.2

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.52

? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.02

random/medium/
unif-k3-r4.26-v700-c2982-S893015585-015.SATISFIABLE.cnf
SAT
TT=0.055

SAT
TT=1.241

No dataNo dataSAT
TT=1.516

SAT
TT=44.271

No dataSAT
TT=4.53

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.363

SAT
TT=0.055

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.06

No dataNo dataNo dataSAT
TT=0.34

SAT
TT=13.043

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=20.149

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=1.297

SAT
TT=8.78

No dataSAT
TT=24.15

No dataNo dataSAT
TT=2.54

No dataSAT
TT=0.232

random/medium/
unif-k3-r4.26-v700-c2982-S899463426-096.UNKNOWN.cnf



? (TO)
TT=5000.02

No dataNo data?
TT=39865.8

? (TO)
TT=35666.8

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=23548.8

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.27

? (TO)
TT=5000.02

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k3-r4.26-v700-c2982-S900569154-026.SATISFIABLE.cnf
SAT
TT=0.025

SAT
TT=0.028

No dataNo data? (TO)
TT=2448.21

? (TO)
TT=681.53

No dataSAT
TT=0.576

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.197

SAT
TT=0.054

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1637.8

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.19

No dataNo dataNo dataSAT
TT=0.325

SAT
TT=0.045

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.071

No dataSAT
TT=1829.56

No dataNo dataSAT
TT=0.065

SAT
TT=0.025

No dataSAT
TT=23.816

No dataNo dataSAT
TT=0.033

No dataSAT
TT=0.099

random/medium/
unif-k3-r4.26-v700-c2982-S942849-099.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=32524.9

? (TO)
TT=36151.1

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (problem)
TT=23365.9

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.62

? (TO)
TT=5000.08

No data? (TO)
TT=4999.39

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

random/medium/
unif-k3-r4.26-v750-c3195-S1115406553-014.SATISFIABLE.cnf
SAT
TT=0.026

SAT
TT=0.115

No dataNo dataSAT
TT=2.004

? (exit code)
TT=1.725

No dataSAT
TT=1.041

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.014

SAT
TT=0.163

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.364

No dataNo dataNo dataSAT
TT=2.37

SAT
TT=3.436

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.076

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=0.026

SAT
TT=0.254

No dataSAT
TT=24.04

No dataNo dataSAT
TT=0.055

No dataSAT
TT=0.469

random/medium/
unif-k3-r4.26-v750-c3195-S1378008329-078.SATISFIABLE.cnf
SAT
TT=0.033

SAT
TT=0.208

No dataNo dataSAT
TT=2.903

SAT
TT=2.487

No dataSAT
TT=0.598

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.28

SAT
TT=0.207

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.083

No dataNo dataNo dataSAT
TT=1.073

SAT
TT=0.841

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.272

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=2.756

SAT
TT=0.033

No dataSAT
TT=23.791

No dataNo dataSAT
TT=0.758

No dataSAT
TT=0.036

random/medium/
unif-k3-r4.26-v750-c3195-S158767647-027.SATISFIABLE.cnf
SAT
TT=1.205

SAT
TT=1.552

No dataNo dataSAT
TT=42.506

SAT
TT=56.085

No dataSAT
TT=50.206

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.205

SAT
TT=3.712

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.398

No dataNo dataNo dataSAT
TT=16.039

SAT
TT=2.537

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8.952

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=5.603

SAT
TT=5.106

No dataSAT
TT=23.79

No dataNo dataSAT
TT=2.86

No dataSAT
TT=10.275

random/medium/
unif-k3-r4.26-v750-c3195-S1985868475-070.SATISFIABLE.cnf
SAT
TT=0.043

SAT
TT=0.068

No dataNo data? (exit code)
TT=1.48

? (exit code)
TT=1.587

No dataSAT
TT=0.689

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.483

SAT
TT=0.122

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.074

No dataNo dataNo dataSAT
TT=0.097

SAT
TT=0.629

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.078

No data? (TO)
TT=5000.14

No dataNo dataSAT
TT=0.381

SAT
TT=0.043

No dataSAT
TT=23.817

No dataNo dataSAT
TT=0.304

No dataSAT
TT=0.182

random/medium/
unif-k3-r4.26-v750-c3195-S2050161601-088.SATISFIABLE.cnf
SAT
TT=0.602

SAT
TT=4.018

No dataNo dataSAT
TT=1.785

SAT
TT=49.691

No dataSAT
TT=2.191

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.982

SAT
TT=1.295

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.621

No dataNo dataNo dataSAT
TT=15.88

SAT
TT=9.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.602

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=1.811

SAT
TT=2.082

No dataSAT
TT=24.34

No dataNo dataSAT
TT=3.698

No dataSAT
TT=4.041

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v750-c3195-S397702672-080.SATISFIABLE.cnf
SAT
TT=0.323

SAT
TT=1.569

No dataNo dataSAT
TT=22.636

SAT
TT=4.43

No dataSAT
TT=0.75

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.236

SAT
TT=0.323

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.342

No dataNo dataNo dataSAT
TT=1.295

SAT
TT=7.175

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.237

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=7.624

SAT
TT=7.285

No dataSAT
TT=24.52

No dataNo dataSAT
TT=3.592

No dataSAT
TT=2.117

random/medium/
unif-k3-r4.26-v750-c3195-S576842028-023.SATISFIABLE.cnf
SAT
TT=0.055

SAT
TT=0.055

No dataNo dataSAT
TT=16.549

SAT
TT=1.895

No dataSAT
TT=2.208

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.679

SAT
TT=0.164

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.393

No dataNo dataNo dataSAT
TT=9.5

SAT
TT=0.69

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.346

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=0.072

SAT
TT=1.101

No dataSAT
TT=276.76

No dataNo dataSAT
TT=0.09

No dataSAT
TT=0.138

random/medium/
unif-k3-r4.26-v750-c3195-S664770261-061.SATISFIABLE.cnf
SAT
TT=0.128

SAT
TT=0.233

No dataNo dataSAT
TT=1.741

SAT
TT=2.463

No dataSAT
TT=0.702

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.565

SAT
TT=0.266

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.415

No dataNo dataNo dataSAT
TT=0.473

SAT
TT=2.389

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.199

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=0.128

SAT
TT=2.515

No dataSAT
TT=23.951

No dataNo dataSAT
TT=0.235

No dataSAT
TT=0.232

random/medium/
unif-k3-r4.26-v750-c3195-S8215859-049.SATISFIABLE.cnf
SAT
TT=0.541

SAT
TT=24.738

No dataNo dataSAT
TT=87.15

SAT
TT=168.233

No dataSAT
TT=4.76

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.224

SAT
TT=7.077

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2

No dataNo dataNo dataSAT
TT=9.54

SAT
TT=72.046

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.352

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=0.541

SAT
TT=10.226

No dataSAT
TT=298.04

No dataNo dataSAT
TT=2.666

No dataSAT
TT=5.175

random/medium/
unif-k3-r4.26-v750-c3195-S973075635-083.SATISFIABLE.cnf
SAT
TT=0.053

SAT
TT=0.132

No dataNo dataSAT
TT=1.642

SAT
TT=1.786

No dataSAT
TT=0.933

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.27

SAT
TT=0.134

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.171

No dataNo dataNo dataSAT
TT=0.114

SAT
TT=1.157

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.057

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=0.262

SAT
TT=0.055

No dataSAT
TT=23.787

No dataNo dataSAT
TT=0.18

No dataSAT
TT=0.053

random/medium/
unif-k3-r4.26-v800-c3408-S1534711423-054.SATISFIABLE.cnf
SAT
TT=0.244

SAT
TT=1.518

No dataNo dataSAT
TT=4.883

SAT
TT=7.455

No dataSAT
TT=12.099

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.182

SAT
TT=2.826

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.654

No dataNo dataNo dataSAT
TT=43.498

SAT
TT=6.604

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.328

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=4.518

SAT
TT=0.244

No dataSAT
TT=24.059

No dataNo dataSAT
TT=7.398

No dataSAT
TT=16.595

random/medium/
unif-k3-r4.26-v800-c3408-S1536861174-069.SATISFIABLE.cnf
SAT
TT=0.032

SAT
TT=0.04

No dataNo data? (TO)
TT=1861.95

? (TO)
TT=2250.76

No dataSAT
TT=0.692

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.695

SAT
TT=0.152

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=802.149

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.131

No dataNo dataNo dataSAT
TT=0.246

SAT
TT=0.973

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.038

No dataSAT
TT=891.178

No dataNo dataSAT
TT=0.034

SAT
TT=0.053

No dataSAT
TT=24.028

No dataNo dataSAT
TT=0.09

No dataSAT
TT=0.032

random/medium/
unif-k3-r4.26-v800-c3408-S1631205309-024.SATISFIABLE.cnf
SAT
TT=0.033

SAT
TT=0.247

No dataNo dataSAT
TT=4.423

SAT
TT=1.843

No dataSAT
TT=0.613

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.361

SAT
TT=0.072

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.359

No dataNo dataNo dataSAT
TT=0.172

SAT
TT=0.033

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.078

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=0.281

SAT
TT=0.035

No dataSAT
TT=23.999

No dataNo dataSAT
TT=0.309

No dataSAT
TT=0.082

random/medium/
unif-k3-r4.26-v800-c3408-S1831593686-090.SATISFIABLE.cnf
SAT
TT=0.033

SAT
TT=0.13

No dataNo data? (TO)
TT=2343.5

? (TO)
TT=681.68

No dataSAT
TT=0.663

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.201

SAT
TT=0.046

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.125

No dataNo dataNo dataSAT
TT=0.102

SAT
TT=0.033

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.171

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=1.161

SAT
TT=0.038

No dataSAT
TT=23.792

No dataNo dataSAT
TT=0.061

No dataSAT
TT=0.048

random/medium/
unif-k3-r4.26-v800-c3408-S456969343-019.SATISFIABLE.cnf
SAT
TT=0.039

SAT
TT=0.051

No dataNo data? (TO)
TT=1462.62

? (TO)
TT=1268.8

No dataSAT
TT=0.741

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.394

SAT
TT=0.216

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.126

No dataNo dataNo dataSAT
TT=0.064

SAT
TT=0.104

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.039

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=0.111

SAT
TT=0.042

No dataSAT
TT=23.82

No dataNo dataSAT
TT=0.114

No dataSAT
TT=0.107

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k3-r4.26-v800-c3408-S846876765-035.SATISFIABLE.cnf
SAT
TT=0.031

SAT
TT=0.037

No dataNo dataSAT
TT=1.481

SAT
TT=1.928

No dataSAT
TT=0.584

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.503

SAT
TT=0.156

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.138

No dataNo dataNo dataSAT
TT=0.416

SAT
TT=0.772

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.114

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=1.618

SAT
TT=0.031

No dataSAT
TT=23.796

No dataNo dataSAT
TT=0.11

No dataSAT
TT=0.039

random/medium/
unif-k3-r4.26-v800-c3408-S852188518-088.SATISFIABLE.cnf
SAT
TT=2.763

SAT
TT=4.596

No dataNo dataSAT
TT=5.107

SAT
TT=18.669

No dataSAT
TT=1.175

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=29.934

SAT
TT=4.88

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.781

No dataNo dataNo dataSAT
TT=50.025

SAT
TT=30.314

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.867

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=2.763

SAT
TT=7.696

No dataSAT
TT=301.24

No dataNo dataSAT
TT=3.713

No dataSAT
TT=14.942

random/medium/
unif-k3-r4.26-v800-c3408-S890760919-021.SATISFIABLE.cnf
SAT
TT=0.052

SAT
TT=0.282

No dataNo dataSAT
TT=1.606

SAT
TT=6.227

No dataSAT
TT=0.688

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.467

SAT
TT=0.193

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1299.57

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.547

No dataNo dataNo dataSAT
TT=0.217

SAT
TT=1.169

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.314

No dataSAT
TT=1579.95

No dataNo dataSAT
TT=0.19

SAT
TT=0.329

No dataSAT
TT=23.789

No dataNo dataSAT
TT=1.045

No dataSAT
TT=0.052

random/medium/
unif-k3-r4.26-v800-c3408-S902286199-017.SATISFIABLE.cnf
SAT
TT=0.025

SAT
TT=0.978

No dataNo dataSAT
TT=1.642

SAT
TT=1.891

No dataSAT
TT=1.289

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.328

SAT
TT=0.084

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataSAT
TT=0.306

SAT
TT=0.025

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.065

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=0.596

SAT
TT=1.464

No dataSAT
TT=24.095

No dataNo dataSAT
TT=0.45

No dataSAT
TT=0.147

random/medium/
unif-k3-r4.26-v800-c3408-S91768321-029.SATISFIABLE.cnf
SAT
TT=0.022

SAT
TT=0.061

No dataNo data? (TO)
TT=2735.09

? (TO)
TT=489.62

No dataSAT
TT=0.572

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.712

SAT
TT=0.033

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=92.653

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.112

No dataNo dataNo dataSAT
TT=0.195

SAT
TT=0.941

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.022

No dataSAT
TT=1038.06

No dataNo dataSAT
TT=0.044

SAT
TT=0.027

No dataSAT
TT=24.016

No dataNo dataSAT
TT=0.104

No dataSAT
TT=0.027

random/medium/
unif-k5-r21.3-v100-c2130-S1059781282-048.UNKNOWN.cnf
UNSAT
TT=344.772

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=2559.57

UNSAT
TT=2477.6

No dataUNSAT
TT=454.178

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=344.772

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=369.957

No dataNo dataNo dataUNSAT
TT=2774.01

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=355.725

No dataNo data? (exit code)
TT=4998.54

? (TO)
TT=5000.03

No dataUNSAT
TT=785.51

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v100-c2130-S1189700536-035.SATISFIABLE.cnf
SAT
TT=0.029

SAT
TT=0.045

No dataNo data? (TO)
TT=395.8

? (exit code)
TT=1.545

No dataSAT
TT=0.659

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.171

SAT
TT=0.039

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=196.403

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.825

No dataNo dataNo dataSAT
TT=0.25

SAT
TT=0.958

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.055

No dataSAT
TT=201.678

No dataNo dataSAT
TT=0.106

SAT
TT=0.049

No dataSAT
TT=31.548

No dataNo dataSAT
TT=0.029

No dataSAT
TT=0.067

random/medium/
unif-k5-r21.3-v100-c2130-S1336161514-068.UNKNOWN.cnf
UNSAT
TT=390.66

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=2620.21

UNSAT
TT=2769.71

No dataUNSAT
TT=534.99

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=390.66

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=446.463

No dataNo dataNo dataUNSAT
TT=3157.3

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=405.797

No dataNo data? (exit code)
TT=4998.37

? (TO)
TT=5000.1

No dataUNSAT
TT=833.38

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=4999.68

random/medium/
unif-k5-r21.3-v100-c2130-S1465579926-097.UNKNOWN.cnf
UNSAT
TT=321.466

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=2189.73

UNSAT
TT=2600.02

No dataUNSAT
TT=468.805

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=321.466

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=332.349

No dataNo dataNo dataUNSAT
TT=2589.1

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=332.26

No dataNo dataUNSAT
TT=4896.51

? (TO)
TT=5000.06

No dataUNSAT
TT=794.55

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v100-c2130-S1574817612-041.SATISFIABLE.cnf
SAT
TT=0.023

SAT
TT=0.028

No dataNo data? (exit code)
TT=1.32

? (exit code)
TT=22.432

No dataSAT
TT=0.591

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.233

SAT
TT=0.056

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.972

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.782

No dataNo dataNo dataSAT
TT=0.159

SAT
TT=0.053

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.023

No dataSAT
TT=7.221

No dataNo dataSAT
TT=0.068

SAT
TT=0.036

No dataSAT
TT=31.615

No dataNo dataSAT
TT=0.042

No dataSAT
TT=0.076

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v100-c2130-S1741857700-014.UNKNOWN.cnf
UNSAT
TT=348.401

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=2264.57

UNSAT
TT=2312.57

No dataUNSAT
TT=488.633

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=348.401

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=432.959

No dataNo dataNo dataUNSAT
TT=2804.35

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=393.463

No dataNo data? (exit code)
TT=4998.37

? (TO)
TT=5000.05

No dataUNSAT
TT=790.43

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v100-c2130-S1760258375-046.UNKNOWN.cnf
UNSAT
TT=320.093

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=2044.76

UNSAT
TT=2578.67

No dataUNSAT
TT=430.669

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=320.093

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=372.137

No dataNo dataNo dataUNSAT
TT=2255.93

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=331.28

No dataNo data? (exit code)
TT=4998.53

? (TO)
TT=5000.1

No dataUNSAT
TT=760.03

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

random/medium/
unif-k5-r21.3-v100-c2130-S1880411078-058.SATISFIABLE.cnf
SAT
TT=0.038

SAT
TT=0.038

No dataNo dataSAT
TT=1.665

SAT
TT=1.812

No dataSAT
TT=0.777

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.441

SAT
TT=0.279

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.59

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.873

No dataNo dataNo dataSAT
TT=4.406

SAT
TT=1.804

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.186

No dataSAT
TT=1.656

No dataNo dataSAT
TT=0.65

SAT
TT=0.134

No dataSAT
TT=31.528

No dataNo dataSAT
TT=0.29

No dataSAT
TT=0.215

random/medium/
unif-k5-r21.3-v100-c2130-S1926673460-089.SATISFIABLE.cnf
SAT
TT=0.028

SAT
TT=0.128

No dataNo data? (exit code)
TT=24.942

? (exit code)
TT=12.881

No dataSAT
TT=0.742

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.158

SAT
TT=0.071

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11.319

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.799

No dataNo dataNo dataSAT
TT=1.193

SAT
TT=0.111

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.028

No dataSAT
TT=11.765

No dataNo dataSAT
TT=0.038

SAT
TT=0.048

No dataSAT
TT=31.615

No dataNo dataSAT
TT=0.032

No dataSAT
TT=0.044

random/medium/
unif-k5-r21.3-v100-c2130-S196779284-038.SATISFIABLE.cnf
SAT
TT=0.011

SAT
TT=0.037

No dataNo data? (exit code)
TT=270.308

? (exit code)
TT=1.559

No dataSAT
TT=0.529

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.262

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=42.503

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.74

No dataNo dataNo dataSAT
TT=0.148

SAT
TT=0.047

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.015

No dataSAT
TT=44.153

No dataNo dataSAT
TT=0.066

SAT
TT=0.114

No dataSAT
TT=31.48

No dataNo dataSAT
TT=0.052

No dataSAT
TT=0.011

random/medium/
unif-k5-r21.3-v100-c2130-S1980330668-030.SATISFIABLE.cnf
SAT
TT=0.009

SAT
TT=0.049

No dataNo data? (exit code)
TT=41.119

? (exit code)
TT=1.518

No dataSAT
TT=0.593

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.273

SAT
TT=0.009

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=19.465

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.744

No dataNo dataNo dataSAT
TT=0.129

SAT
TT=0.052

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.013

No dataSAT
TT=20.365

No dataNo dataSAT
TT=0.018

SAT
TT=0.039

No dataSAT
TT=31.501

No dataNo dataSAT
TT=0.063

No dataSAT
TT=0.012

random/medium/
unif-k5-r21.3-v100-c2130-S20037494-023.SATISFIABLE.cnf
SAT
TT=0.015

SAT
TT=0.042

No dataNo data? (exit code)
TT=1.465

? (exit code)
TT=101.629

No dataSAT
TT=0.642

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.12

SAT
TT=0.029

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=99.253

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.849

No dataNo dataNo dataSAT
TT=0.296

SAT
TT=0.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.044

No dataSAT
TT=102.131

No dataNo dataSAT
TT=0.015

SAT
TT=0.037

No dataSAT
TT=32.656

No dataNo dataSAT
TT=0.041

No dataSAT
TT=0.091

random/medium/
unif-k5-r21.3-v100-c2130-S2051088205-036.UNKNOWN.cnf
UNSAT
TT=299.271

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=2068.37

UNSAT
TT=2140.91

No dataUNSAT
TT=404.316

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=299.271

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=350.417

No dataNo dataNo dataUNSAT
TT=2411.38

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=311.934

No dataNo data? (exit code)
TT=4998.37

? (TO)
TT=5000.05

No dataUNSAT
TT=771.5

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v100-c2130-S206772908-015.UNKNOWN.cnf
UNSAT
TT=328.159

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=2279

UNSAT
TT=2334.34

No dataUNSAT
TT=433.175

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=328.159

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=374.922

No dataNo dataNo dataUNSAT
TT=2628.91

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=339.061

No dataNo data? (exit code)
TT=4998.44

? (TO)
TT=5000.05

No dataUNSAT
TT=780.8

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

random/medium/
unif-k5-r21.3-v100-c2130-S2098066936-001.UNKNOWN.cnf
UNSAT
TT=347.316

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=2474.04

UNSAT
TT=2309.89

No dataUNSAT
TT=452.644

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=347.316

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=403.519

No dataNo dataNo data? (MO)
TT=97.553

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=390.8

No dataNo data? (exit code)
TT=4998.38

? (TO)
TT=5000.02

No dataUNSAT
TT=789.95

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v100-c2130-S328068950-002.SATISFIABLE.cnf
SAT
TT=0.029

SAT
TT=0.237

No dataNo data? (exit code)
TT=16.924

SAT
TT=1.742

No dataSAT
TT=0.66

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.148

SAT
TT=0.029

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.131

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.81

No dataNo dataNo dataSAT
TT=0.484

SAT
TT=0.691

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.137

No dataSAT
TT=3.245

No dataNo dataSAT
TT=0.036

SAT
TT=0.116

No dataSAT
TT=28.66

No dataNo dataSAT
TT=0.067

No dataSAT
TT=0.465

random/medium/
unif-k5-r21.3-v100-c2130-S332580795-055.SATISFIABLE.cnf
SAT
TT=0.092

SAT
TT=0.256

No dataNo dataSAT
TT=1.557

SAT
TT=2.024

No dataSAT
TT=0.728

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.465

SAT
TT=0.541

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=358.454

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.246

No dataNo dataNo dataSAT
TT=1.229

SAT
TT=1.59

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.761

No dataSAT
TT=374.559

No dataNo dataSAT
TT=0.142

SAT
TT=0.092

No dataSAT
TT=31.73

No dataNo dataSAT
TT=0.236

No dataSAT
TT=0.653

random/medium/
unif-k5-r21.3-v100-c2130-S360859187-040.UNKNOWN.cnf
UNSAT
TT=358.158

? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=2401.98

UNSAT
TT=2891.06

No dataUNSAT
TT=460.516

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=358.158

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=411.178

No dataNo dataNo dataUNSAT
TT=2887.91

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=402.659

No dataNo data? (exit code)
TT=4998.35

? (TO)
TT=5000.1

No dataUNSAT
TT=800.05

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v100-c2130-S707565158-096.SATISFIABLE.cnf
SAT
TT=0.058

SAT
TT=0.395

No dataNo dataSAT
TT=2.015

SAT
TT=1.792

No dataSAT
TT=0.783

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.443

SAT
TT=0.124

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=45.858

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.773

No dataNo dataNo dataSAT
TT=0.569

SAT
TT=0.087

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.058

No dataSAT
TT=47.598

No dataNo dataSAT
TT=0.154

SAT
TT=0.26

No dataSAT
TT=32.499

No dataNo dataSAT
TT=0.233

No dataSAT
TT=0.121

random/medium/
unif-k5-r21.3-v100-c2130-S815408325-054.UNKNOWN.cnf
UNSAT
TT=313.313

? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=2546.85

UNSAT
TT=2300.23

No dataUNSAT
TT=419.344

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=313.313

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=344.091

No dataNo dataNo dataUNSAT
TT=2524.16

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=324.476

No dataNo data? (exit code)
TT=4998.35

? (TO)
TT=5000.06

No dataUNSAT
TT=754.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

random/medium/
unif-k5-r21.3-v125-c2662-S1061710238-001.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=39826.8

? (TO)
TT=40000.3

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.38

? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v125-c2662-S118521533-021.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data?
TT=34991.2

? (TO)
TT=36083.4

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.47

? (TO)
TT=5000.02

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.02

random/medium/
unif-k5-r21.3-v125-c2662-S1194239878-049.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data?
TT=39815.1

? (TO)
TT=40000.6

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.47

? (TO)
TT=5000.02

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

random/medium/
unif-k5-r21.3-v125-c2662-S121099030-067.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data?
TT=28450.2

? (TO)
TT=36058.6

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39972.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.38

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

random/medium/
unif-k5-r21.3-v125-c2662-S1224290751-070.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=39076.6

? (TO)
TT=40000.8

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=34969.7

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.45

? (TO)
TT=5000.09

No data? (TO)
TT=4999.38

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v125-c2662-S1258495116-025.SATISFIABLE.cnf
SAT
TT=0.025

SAT
TT=0.437

No dataNo dataSAT
TT=6.596

SAT
TT=14.859

No dataSAT
TT=0.652

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.246

SAT
TT=0.094

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.926

No dataNo dataNo dataSAT
TT=2.797

SAT
TT=1.167

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.402

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=2.155

SAT
TT=0.067

No dataSAT
TT=34.796

No dataNo dataSAT
TT=0.258

No dataSAT
TT=0.025

random/medium/
unif-k5-r21.3-v125-c2662-S1300400916-048.SATISFIABLE.cnf
SAT
TT=0.024

SAT
TT=0.045

No dataNo data? (TO)
TT=2378.97

? (exit code)
TT=1197.54

No dataSAT
TT=0.575

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.266

SAT
TT=0.032

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=433.095

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.844

No dataNo dataNo dataSAT
TT=0.194

SAT
TT=0.062

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.08

No dataSAT
TT=411.708

No dataNo dataSAT
TT=0.024

SAT
TT=0.061

No dataSAT
TT=33.706

No dataNo dataSAT
TT=0.054

No dataSAT
TT=0.024

random/medium/
unif-k5-r21.3-v125-c2662-S1396350646-062.SATISFIABLE.cnf
SAT
TT=0.007

SAT
TT=0.1

No dataNo data? (exit code)
TT=626.19

? (exit code)
TT=1246.56

No dataSAT
TT=0.646

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.371

SAT
TT=0.165

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=204.342

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.841

No dataNo dataNo dataSAT
TT=0.294

SAT
TT=1.126

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.007

No dataSAT
TT=213.873

No dataNo dataSAT
TT=0.012

SAT
TT=0.253

No dataSAT
TT=33.717

No dataNo dataSAT
TT=0.098

No dataSAT
TT=0.04

random/medium/
unif-k5-r21.3-v125-c2662-S1397972185-007.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data?
TT=31733.5

? (TO)
TT=35940

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=4999.86

No dataNo data? (exit code)
TT=4998.38

? (TO)
TT=5000.08

No data? (TO)
TT=4999.73

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

random/medium/
unif-k5-r21.3-v125-c2662-S1647930270-030.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=35402.4

? (TO)
TT=34063.8

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.4

? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v125-c2662-S2092454698-027.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=30213

? (TO)
TT=36152.7

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39964.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.45

? (TO)
TT=5000.06

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

random/medium/
unif-k5-r21.3-v125-c2662-S218235649-089.SATISFIABLE.cnf
SAT
TT=0.049

SAT
TT=0.049

No dataNo dataSAT
TT=4.412

SAT
TT=2.499

No dataSAT
TT=0.67

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.734

SAT
TT=0.699

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3646.64

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.767

No dataNo dataNo dataSAT
TT=1.484

SAT
TT=0.593

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.451

No dataSAT
TT=3770.36

No dataNo dataSAT
TT=0.085

SAT
TT=0.582

No dataSAT
TT=33.95

No dataNo dataSAT
TT=0.96

No dataSAT
TT=2.326

random/medium/
unif-k5-r21.3-v125-c2662-S236776564-037.SATISFIABLE.cnf
SAT
TT=0.258

SAT
TT=0.275

No dataNo dataSAT
TT=3.444

SAT
TT=9.887

No dataSAT
TT=0.698

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.624

SAT
TT=2.104

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.137

No dataNo dataNo dataSAT
TT=21.5

SAT
TT=2.778

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.45

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=0.797

SAT
TT=0.258

No dataSAT
TT=33.94

No dataNo dataSAT
TT=2.418

No dataSAT
TT=6.215

random/medium/
unif-k5-r21.3-v125-c2662-S34055288-072.SATISFIABLE.cnf
SAT
TT=0.034

SAT
TT=0.128

No dataNo data? (exit code)
TT=2.191

? (TO)
TT=491.94

No dataSAT
TT=0.726

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.235

SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1324.65

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.858

No dataNo dataNo dataSAT
TT=1.416

SAT
TT=0.405

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.197

No dataSAT
TT=1374.04

No dataNo dataSAT
TT=0.049

SAT
TT=0.07

No dataSAT
TT=33.704

No dataNo dataSAT
TT=0.047

No dataSAT
TT=0.039

random/medium/
unif-k5-r21.3-v125-c2662-S396831120-092.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data?
TT=34598.5

? (TO)
TT=40000.2

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.55

? (TO)
TT=5000.1

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v125-c2662-S436871389-051.SATISFIABLE.cnf
SAT
TT=0.011

SAT
TT=0.114

No dataNo data? (exit code)
TT=1528.24

? (TO)
TT=1791.11

No dataSAT
TT=0.679

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.167

SAT
TT=0.044

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=298.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.856

No dataNo dataNo dataSAT
TT=0.335

SAT
TT=0.205

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.02

No dataSAT
TT=309.347

No dataNo dataSAT
TT=0.11

SAT
TT=0.083

No dataSAT
TT=34.868

No dataNo dataSAT
TT=0.234

No dataSAT
TT=0.011

random/medium/
unif-k5-r21.3-v125-c2662-S446351158-079.SATISFIABLE.cnf
SAT
TT=0.401

SAT
TT=13.009

No dataNo dataSAT
TT=14.698

SAT
TT=11.593

No dataSAT
TT=2.525

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.401

SAT
TT=8.259

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.777

No dataNo dataNo dataSAT
TT=0.978

SAT
TT=21.761

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.935

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=2.147

SAT
TT=4.342

No dataSAT
TT=287.04

No dataNo dataSAT
TT=0.893

No dataSAT
TT=3.852

random/medium/
unif-k5-r21.3-v125-c2662-S464722883-083.SATISFIABLE.cnf
SAT
TT=0.022

SAT
TT=0.411

No dataNo dataSAT
TT=1.583

SAT
TT=1.852

No dataSAT
TT=0.626

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.297

SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=424.78

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.929

No dataNo dataNo dataSAT
TT=2.659

SAT
TT=0.112

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.042

No dataSAT
TT=440.075

No dataNo dataSAT
TT=0.322

SAT
TT=0.157

No dataSAT
TT=33.784

No dataNo dataSAT
TT=0.059

No dataSAT
TT=0.1

random/medium/
unif-k5-r21.3-v125-c2662-S675870149-098.SATISFIABLE.cnf
SAT
TT=0.034

SAT
TT=0.309

No dataNo dataSAT
TT=1.949

SAT
TT=1.836

No dataSAT
TT=0.875

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.263

SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=912.104

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.171

No dataNo dataNo dataSAT
TT=0.806

SAT
TT=1.844

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.554

No dataSAT
TT=1070.83

No dataNo dataSAT
TT=0.118

SAT
TT=0.084

No dataSAT
TT=33.722

No dataNo dataSAT
TT=0.056

No dataSAT
TT=0.502

random/medium/
unif-k5-r21.3-v125-c2662-S689381858-022.UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data?
TT=31392

? (TO)
TT=35917.3

No data? (TO)
TT=5000

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39972.2

? (MO)
TT=3188.38

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.37

? (TO)
TT=5000.09

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

random/medium/
unif-k5-r21.3-v150-c3195-S1116496771-020.SATISFIABLE.cnf
SAT
TT=0.142

SAT
TT=0.91

No dataNo dataSAT
TT=2.965

SAT
TT=17.228

No dataSAT
TT=2.765

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.507

SAT
TT=15.58

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11.46

No dataNo dataNo dataSAT
TT=1.41

SAT
TT=1.953

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.486

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=0.142

SAT
TT=7.283

No dataSAT
TT=296.85

No dataNo dataSAT
TT=4.646

No dataSAT
TT=4.737

random/medium/
unif-k5-r21.3-v150-c3195-S1216095115-028.SATISFIABLE.cnf
SAT
TT=0.05

SAT
TT=0.05

No dataNo dataSAT
TT=1.758

SAT
TT=1.993

No dataSAT
TT=1.005

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.614

SAT
TT=0.492

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.08

No dataNo dataNo dataSAT
TT=1.511

SAT
TT=1.958

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.308

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=0.687

SAT
TT=0.516

No dataSAT
TT=34.612

No dataNo dataSAT
TT=0.404

No dataSAT
TT=1.463

random/medium/
unif-k5-r21.3-v150-c3195-S1428216398-076.SATISFIABLE.cnf
SAT
TT=0.372

SAT
TT=0.436

No dataNo dataSAT
TT=1.628

SAT
TT=2.087

No dataSAT
TT=2.838

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.791

SAT
TT=1.899

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.476

No dataNo dataNo dataSAT
TT=23.13

SAT
TT=2.663

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.911

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=1.884

SAT
TT=0.444

No dataSAT
TT=34.584

No dataNo dataSAT
TT=0.708

No dataSAT
TT=0.372

random/medium/
unif-k5-r21.3-v150-c3195-S1499315720-089.SATISFIABLE.cnf
SAT
TT=0.221

SAT
TT=19.671

No dataNo dataSAT
TT=43.258

SAT
TT=45.03

No dataSAT
TT=18.225

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.221

SAT
TT=2.971

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.676

No dataNo dataNo dataSAT
TT=59.85

SAT
TT=35.982

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.833

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=7.66

SAT
TT=5.316

No dataSAT
TT=34.593

No dataNo dataSAT
TT=8.812

No dataSAT
TT=7.925

random/medium/
unif-k5-r21.3-v150-c3195-S1502652578-043.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data?
TT=31133

? (TO)
TT=29292.3

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=39972.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.41

? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=4999.94

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v150-c3195-S1579607106-017.SATISFIABLE.cnf
SAT
TT=0.288

SAT
TT=1.722

No dataNo dataSAT
TT=10.527

SAT
TT=1.756

No dataSAT
TT=0.64

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.361

SAT
TT=1.346

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.348

No dataNo dataNo dataSAT
TT=12.69

SAT
TT=4.245

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.591

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=0.288

SAT
TT=1.221

No dataSAT
TT=35.498

No dataNo dataSAT
TT=0.339

No dataSAT
TT=2.281

random/medium/
unif-k5-r21.3-v150-c3195-S1632870961-099.SATISFIABLE.cnf
SAT
TT=9.897

SAT
TT=26.33

No dataNo dataSAT
TT=486.809

SAT
TT=18.841

No dataSAT
TT=87.435

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=35.788

SAT
TT=58.773

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.897

No dataNo dataNo dataSAT
TT=29.48

SAT
TT=77.395

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=181.181

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.41

SAT
TT=54.443

No dataSAT
TT=400.53

No dataNo dataSAT
TT=138.47

No dataSAT
TT=528.237

random/medium/
unif-k5-r21.3-v150-c3195-S1650617512-037.SATISFIABLE.cnf
SAT
TT=0.046

SAT
TT=0.502

No dataNo dataSAT
TT=2.485

SAT
TT=2.609

No dataSAT
TT=0.775

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.31

SAT
TT=0.987

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.905

No dataNo dataNo dataSAT
TT=4.873

SAT
TT=0.281

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.859

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=0.571

SAT
TT=0.241

No dataSAT
TT=34.589

No dataNo dataSAT
TT=0.052

No dataSAT
TT=0.046

random/medium/
unif-k5-r21.3-v150-c3195-S1653142431-025.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data?
TT=34816.3

? (TO)
TT=35959.3

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.41

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v150-c3195-S1787844685-006.SATISFIABLE.cnf
SAT
TT=0.064

SAT
TT=0.192

No dataNo dataSAT
TT=1.635

? (exit code)
TT=1.704

No dataSAT
TT=0.621

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.435

SAT
TT=0.342

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.181

No dataNo dataNo dataSAT
TT=2.535

SAT
TT=1.383

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.064

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=0.119

SAT
TT=0.112

No dataSAT
TT=36.237

No dataNo dataSAT
TT=0.212

No dataSAT
TT=0.185

random/medium/
unif-k5-r21.3-v150-c3195-S1836400953-011.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data?
TT=39844.4

? (TO)
TT=40000.7

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4998.52

? (TO)
TT=5000.05

No data? (TO)
TT=4999.88

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v150-c3195-S1847541883-049.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data?
TT=28260.3

? (TO)
TT=36035.8

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39973.2

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.47

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.04

random/medium/
unif-k5-r21.3-v150-c3195-S207562876-057.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data?
TT=36026.2

? (TO)
TT=35826.4

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.54

? (TO)
TT=5000.06

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v150-c3195-S2124915970-046.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=35229.6

? (TO)
TT=40000.4

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39971.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.39

? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v150-c3195-S259896945-079.SATISFIABLE.cnf
SAT
TT=0.083

SAT
TT=6.196

No dataNo dataSAT
TT=48.301

SAT
TT=11.401

No dataSAT
TT=3.771

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11.686

SAT
TT=4.398

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.207

No dataNo dataNo dataSAT
TT=57.45

SAT
TT=18.414

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.586

No data? (TO)
TT=5000.14

No dataNo dataSAT
TT=0.083

SAT
TT=5.539

No dataSAT
TT=38.64

No dataNo dataSAT
TT=0.127

No dataSAT
TT=3.031

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v150-c3195-S31505198-038.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data?
TT=39817.2

? (TO)
TT=40000.5

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.41

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v150-c3195-S334650851-022.SATISFIABLE.cnf
SAT
TT=0.06

SAT
TT=0.06

No dataNo dataSAT
TT=2.248

SAT
TT=3.702

No dataSAT
TT=0.737

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.595

SAT
TT=0.087

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.01

No dataNo dataNo dataSAT
TT=2.864

SAT
TT=4.819

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.18

No data? (TO)
TT=5000.11

No dataNo dataSAT
TT=0.504

SAT
TT=0.249

No dataSAT
TT=34.607

No dataNo dataSAT
TT=0.544

No dataSAT
TT=0.074

random/medium/
unif-k5-r21.3-v150-c3195-S375894551-007.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data?
TT=39821.6

? (TO)
TT=40000.1

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.6

? (TO)
TT=4999.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.53

? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.02

random/medium/
unif-k5-r21.3-v150-c3195-S788239782-034.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data?
TT=35250.4

? (TO)
TT=35909.3

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.41

? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v150-c3195-S873866006-055.UNKNOWN.cnf



? (TO)
TT=5000.11

No dataNo data?
TT=34727.9

? (TO)
TT=40000.9

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.4

? (TO)
TT=5000.04

No data? (TO)
TT=4999.73

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v175-c3727-S100095490-071.SATISFIABLE.cnf
SAT
TT=0.145

SAT
TT=2.491

No dataNo dataSAT
TT=4.228

SAT
TT=56.258

No dataSAT
TT=6.663

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.53

SAT
TT=6.084

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.56

No dataNo dataNo dataSAT
TT=7.95

SAT
TT=21.541

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.937

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=2.491

SAT
TT=7.559

No dataSAT
TT=35.42

No dataNo dataSAT
TT=0.145

No dataSAT
TT=6.062

random/medium/
unif-k5-r21.3-v175-c3727-S110935064-075.SATISFIABLE.cnf
SAT
TT=0.242

SAT
TT=0.847

No dataNo dataSAT
TT=5.307

SAT
TT=4.649

No dataSAT
TT=1.261

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.004

SAT
TT=0.288

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.25

No dataNo dataNo dataSAT
TT=0.317

SAT
TT=0.804

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.49

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=0.242

SAT
TT=0.346

No dataSAT
TT=34.585

No dataNo dataSAT
TT=2.697

No dataSAT
TT=1.113

random/medium/
unif-k5-r21.3-v175-c3727-S1110880865-004.SATISFIABLE.cnf
SAT
TT=0.022

SAT
TT=0.18

No dataNo dataSAT
TT=1.818

? (exit code)
TT=1.805

No dataSAT
TT=0.917

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.133

SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.171

No dataNo dataNo dataSAT
TT=0.573

SAT
TT=1.568

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.031

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=0.085

SAT
TT=0.097

No dataSAT
TT=34.519

No dataNo dataSAT
TT=0.101

No dataSAT
TT=0.172

random/medium/
unif-k5-r21.3-v175-c3727-S1126657927-015.SATISFIABLE.cnf
SAT
TT=0.933

SAT
TT=79.103

No dataNo dataSAT
TT=183.069

SAT
TT=115.429

No dataSAT
TT=199.133

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=65.001

SAT
TT=0.933

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=17.883

No dataNo dataNo dataSAT
TT=235.75

SAT
TT=5.917

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=36.155

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=17.676

SAT
TT=57.535

No dataSAT
TT=354.95

No dataNo dataSAT
TT=21.551

No dataSAT
TT=26.304

random/medium/
unif-k5-r21.3-v175-c3727-S1592669696-022.SATISFIABLE.cnf
SAT
TT=0.171

SAT
TT=0.415

No dataNo dataSAT
TT=1.543

SAT
TT=3.8

No dataSAT
TT=1.544

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.762

SAT
TT=0.171

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.208

No dataNo dataNo dataSAT
TT=27.09

SAT
TT=0.65

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.21

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=0.798

SAT
TT=0.702

No dataSAT
TT=34.585

No dataNo dataSAT
TT=1.419

No dataSAT
TT=0.88

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v175-c3727-S185833400-026.SATISFIABLE.cnf
SAT
TT=2.456

SAT
TT=2.456

No dataNo dataSAT
TT=75.657

SAT
TT=23.696

No dataSAT
TT=34.336

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=19.372

SAT
TT=12.016

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.93

No dataNo dataNo dataSAT
TT=377.777

SAT
TT=57.48

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=29.421

No data? (TO)
TT=5000.14

No dataNo dataSAT
TT=14.026

SAT
TT=76.979

No dataSAT
TT=37.63

No dataNo dataSAT
TT=33.572

No dataSAT
TT=43.829

random/medium/
unif-k5-r21.3-v175-c3727-S520872997-084.SATISFIABLE.cnf
SAT
TT=0.569

SAT
TT=1.112

No dataNo dataSAT
TT=8.99

SAT
TT=2.779

No dataSAT
TT=1.601

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.344

SAT
TT=0.83

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.19

No dataNo dataNo dataSAT
TT=3.49

SAT
TT=1.831

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.569

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=2.784

SAT
TT=1.231

No dataSAT
TT=35.22

No dataNo dataSAT
TT=1.23

No dataSAT
TT=0.686

random/medium/
unif-k5-r21.3-v175-c3727-S539832832-088.SATISFIABLE.cnf
SAT
TT=1.366

SAT
TT=73.046

No dataNo dataSAT
TT=19.582

SAT
TT=20.131

No dataSAT
TT=12.996

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.107

SAT
TT=17.585

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.518

No dataNo dataNo dataSAT
TT=7.01

SAT
TT=33.017

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=27.163

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=91.889

SAT
TT=1.366

No dataSAT
TT=288.53

No dataNo dataSAT
TT=2.967

No dataSAT
TT=116.833

random/medium/
unif-k5-r21.3-v175-c3727-S752966552-099.SATISFIABLE.cnf
SAT
TT=0.04

SAT
TT=0.063

No dataNo data? (exit code)
TT=1.694

SAT
TT=2.141

No dataSAT
TT=1.265

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.323

SAT
TT=0.069

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.24

No dataNo dataNo dataSAT
TT=0.951

SAT
TT=0.097

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.04

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=0.079

SAT
TT=0.346

No dataSAT
TT=34.603

No dataNo dataSAT
TT=0.389

No dataSAT
TT=0.574

random/medium/
unif-k5-r21.3-v175-c3727-S82160031-050.SATISFIABLE.cnf
SAT
TT=4.631

SAT
TT=32.416

No dataNo dataSAT
TT=45.722

SAT
TT=95.562

No dataSAT
TT=5.98

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=32.858

SAT
TT=4.631

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.669

No dataNo dataNo dataSAT
TT=44.61

SAT
TT=72.769

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=58.791

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=11.955

SAT
TT=29.905

No dataSAT
TT=364.13

No dataNo dataSAT
TT=7.817

No dataSAT
TT=54.659

random/medium/
unif-k5-r21.3-v50-c1065-S1007919187-045.UNKNOWN.cnf
UNSAT
TT=0.145

? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=1.687

? (exit code)
TT=2.09

No dataUNSAT
TT=101.255

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.145

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=24.363

No dataNo dataNo dataUNSAT
TT=0.445

UNSAT
TT=3.953

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=0.165

No dataNo dataUNSAT
TT=31.321

? (TO)
TT=5000.08

No dataUNSAT
TT=8.63

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.04

random/medium/
unif-k5-r21.3-v50-c1065-S1054153452-040.UNKNOWN.cnf
UNSAT
TT=0.165

? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=2.139

? (exit code)
TT=1.806

No dataUNSAT
TT=101.453

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.165

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=49.498

No dataNo dataNo dataUNSAT
TT=1.695

UNSAT
TT=3.999

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=0.173

No dataNo dataUNSAT
TT=31.347

? (TO)
TT=5000.04

No dataUNSAT
TT=9.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v50-c1065-S1139883571-082.UNKNOWN.cnf
UNSAT
TT=0.136

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=2.251

? (exit code)
TT=1.712

No dataUNSAT
TT=100.369

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.136

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=18.768

No dataNo dataNo dataUNSAT
TT=0.454

UNSAT
TT=2.241

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=0.14

No dataNo dataUNSAT
TT=30.755

? (TO)
TT=5000.08

No dataUNSAT
TT=7.94

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v50-c1065-S1449708927-022.UNKNOWN.cnf
UNSAT
TT=0.126

? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=1.584

UNSAT
TT=1.803

No dataUNSAT
TT=101.244

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.126

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=19.432

No dataNo dataNo dataUNSAT
TT=1.201

UNSAT
TT=2.403

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=0.13

No dataNo dataUNSAT
TT=30.78

? (TO)
TT=5000.02

No dataUNSAT
TT=8.16

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

random/medium/
unif-k5-r21.3-v50-c1065-S1491756361-004.UNKNOWN.cnf
UNSAT
TT=0.162

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=1.426

? (exit code)
TT=1.82

No dataUNSAT
TT=101.362

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.162

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=42.03

No dataNo dataNo dataUNSAT
TT=0.54

UNSAT
TT=2.949

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=0.169

No dataNo dataUNSAT
TT=31.11

? (TO)
TT=5000.08

No dataUNSAT
TT=9.48

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v50-c1065-S1990278523-047.UNKNOWN.cnf
UNSAT
TT=0.148

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=2.468

? (TO)
TT=202.07

No dataUNSAT
TT=99.522

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.1

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.148

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=24.141

No dataNo dataNo dataUNSAT
TT=0.772

UNSAT
TT=2.918

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=0.152

No dataNo dataUNSAT
TT=31.068

? (TO)
TT=5000.02

No dataUNSAT
TT=8.23

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

random/medium/
unif-k5-r21.3-v50-c1065-S370067727-038.UNKNOWN.cnf
UNSAT
TT=0.133

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=2.705

? (TO)
TT=101.83

No dataUNSAT
TT=101.365

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.133

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=18.791

No dataNo dataNo dataUNSAT
TT=0.347

UNSAT
TT=2.352

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=0.14

No dataNo dataUNSAT
TT=30.821

? (TO)
TT=5000.03

No dataUNSAT
TT=7.65

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v50-c1065-S433637520-048.UNKNOWN.cnf
UNSAT
TT=0.148

? (TO)
TT=5000.08

No dataNo dataUNSAT
TT=2.412

? (TO)
TT=202.06

No dataUNSAT
TT=100.316

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.148

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=18.837

No dataNo dataNo dataUNSAT
TT=0.499

UNSAT
TT=3.523

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=0.153

No dataNo dataUNSAT
TT=31.011

? (TO)
TT=5000.06

No dataUNSAT
TT=8.34

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

random/medium/
unif-k5-r21.3-v50-c1065-S505037856-056.UNKNOWN.cnf
UNSAT
TT=0.143

? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=1.522

? (exit code)
TT=2.027

No dataUNSAT
TT=100.382

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.143

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=18.85

No dataNo dataNo dataUNSAT
TT=1.228

UNSAT
TT=2.637

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=0.151

No dataNo dataUNSAT
TT=30.92

? (TO)
TT=5000.08

No dataUNSAT
TT=8.04

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v50-c1065-S827703138-064.UNKNOWN.cnf
UNSAT
TT=0.151

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=1.542

? (exit code)
TT=1.856

No dataUNSAT
TT=100.916

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.151

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=24.174

No dataNo dataNo dataUNSAT
TT=0.313

UNSAT
TT=4.513

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=0.157

No dataNo dataUNSAT
TT=31.109

? (TO)
TT=5000.07

No dataUNSAT
TT=8.35

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v75-c1597-S1009664450-096.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.023

No dataNo dataSAT
TT=1.357

? (exit code)
TT=9.048

No dataSAT
TT=0.577

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.203

SAT
TT=0.012

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.581

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.675

No dataNo dataNo dataSAT
TT=0.138

SAT
TT=0.038

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=2.692

No dataNo dataSAT
TT=0.015

SAT
TT=0.053

No dataSAT
TT=50.275

No dataNo dataSAT
TT=0.051

No dataSAT
TT=0.006

random/medium/
unif-k5-r21.3-v75-c1597-S1129651135-081.SATISFIABLE.cnf
SAT
TT=0.006

SAT
TT=0.031

No dataNo data? (exit code)
TT=1.539

? (exit code)
TT=1.617

No dataSAT
TT=0.514

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.128

SAT
TT=0.008

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.121

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.644

No dataNo dataNo dataSAT
TT=0.126

SAT
TT=0.837

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.009

No dataSAT
TT=0.126

No dataNo dataSAT
TT=0.006

SAT
TT=0.042

No dataSAT
TT=29.379

No dataNo dataSAT
TT=0.026

No dataSAT
TT=0.022

random/medium/
unif-k5-r21.3-v75-c1597-S1214523131-078.SATISFIABLE.cnf
SAT
TT=0.017

SAT
TT=0.025

No dataNo data? (exit code)
TT=1.366

? (exit code)
TT=26.795

No dataSAT
TT=0.53

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.154

SAT
TT=0.017

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.559

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.644

No dataNo dataNo dataSAT
TT=0.111

SAT
TT=0.839

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.018

No dataSAT
TT=5.9

No dataNo dataSAT
TT=0.022

SAT
TT=0.027

No dataSAT
TT=29.432

No dataNo dataSAT
TT=0.028

No dataSAT
TT=0.017

random/medium/
unif-k5-r21.3-v75-c1597-S1227489160-001.UNKNOWN.cnf
UNSAT
TT=6.081

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=58.676

UNSAT
TT=58.418

No dataUNSAT
TT=106.381

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.081

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=49.25

No dataNo dataNo dataUNSAT
TT=48.63

UNSAT
TT=235.036

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=6.374

No dataNo dataUNSAT
TT=116.419

? (TO)
TT=5000.01

No dataUNSAT
TT=167.54

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v75-c1597-S1366648725-024.SATISFIABLE.cnf
SAT
TT=0.005

SAT
TT=0.028

No dataNo data? (exit code)
TT=2.123

? (exit code)
TT=1.517

No dataSAT
TT=0.627

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.291

SAT
TT=0.01

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.111

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.634

No dataNo dataNo dataSAT
TT=0.34

SAT
TT=0.048

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.005

No dataSAT
TT=0.116

No dataNo dataSAT
TT=0.015

SAT
TT=0.045

No dataSAT
TT=29.421

No dataNo dataSAT
TT=0.032

No dataSAT
TT=0.019

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v75-c1597-S1431779634-058.UNKNOWN.cnf
UNSAT
TT=6.929

? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=72.586

UNSAT
TT=55.409

No dataUNSAT
TT=108.152

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.929

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=50.426

No dataNo dataNo dataUNSAT
TT=55.493

UNSAT
TT=262.571

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=7.335

No dataNo dataUNSAT
TT=120.4

? (TO)
TT=5000.06

No dataUNSAT
TT=168.43

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v75-c1597-S1508981094-051.UNKNOWN.cnf
UNSAT
TT=8.506

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=61.752

UNSAT
TT=60.452

No dataUNSAT
TT=109.822

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=8.506

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=51.607

No dataNo dataNo dataUNSAT
TT=67.86

UNSAT
TT=313.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=8.851

No dataNo dataUNSAT
TT=151.251

? (TO)
TT=4999.18

No dataUNSAT
TT=171.53

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

random/medium/
unif-k5-r21.3-v75-c1597-S1636883934-028.SATISFIABLE.cnf
SAT
TT=0.027

SAT
TT=0.027

No dataNo data? (exit code)
TT=4.087

? (exit code)
TT=6.603

No dataSAT
TT=0.583

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.11

SAT
TT=0.031

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.662

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.624

No dataNo dataNo dataSAT
TT=1.004

SAT
TT=0.997

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.171

No dataSAT
TT=2.777

No dataNo dataSAT
TT=0.071

SAT
TT=0.161

No dataSAT
TT=29.436

No dataNo dataSAT
TT=0.187

No dataSAT
TT=0.104

random/medium/
unif-k5-r21.3-v75-c1597-S1713710439-035.UNKNOWN.cnf
UNSAT
TT=7.903

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=56.27

UNSAT
TT=71.373

No dataUNSAT
TT=108.286

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=7.903

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=51.17

No dataNo dataNo dataUNSAT
TT=63.531

UNSAT
TT=319.261

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=8.298

No dataNo dataUNSAT
TT=143.945

? (TO)
TT=5000.1

No dataUNSAT
TT=169.33

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v75-c1597-S1750722942-074.UNKNOWN.cnf
UNSAT
TT=6.992

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=85.022

UNSAT
TT=51.701

No dataUNSAT
TT=107.196

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.992

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=50.176

No dataNo dataNo dataUNSAT
TT=56.142

UNSAT
TT=197.481

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=8.003

No dataNo dataUNSAT
TT=137.785

? (TO)
TT=5000.06

No dataUNSAT
TT=168.42

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

random/medium/
unif-k5-r21.3-v75-c1597-S1825761395-059.UNKNOWN.cnf
UNSAT
TT=6.888

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=55.218

UNSAT
TT=47.379

No dataUNSAT
TT=107.595

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.888

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=50.309

No dataNo dataNo dataUNSAT
TT=55.39

UNSAT
TT=290.168

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=7.163

No dataNo dataUNSAT
TT=120.665

? (TO)
TT=5000.1

No dataUNSAT
TT=169.15

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

random/medium/
unif-k5-r21.3-v75-c1597-S2038462183-033.SATISFIABLE.cnf
SAT
TT=0.019

SAT
TT=0.062

No dataNo data? (exit code)
TT=3.104

? (exit code)
TT=6.589

No dataSAT
TT=0.635

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.161

SAT
TT=0.08

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.911

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.634

No dataNo dataNo dataSAT
TT=0.168

SAT
TT=0.063

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.087

No dataSAT
TT=1.076

No dataNo dataSAT
TT=0.088

SAT
TT=0.037

No dataSAT
TT=29.419

No dataNo dataSAT
TT=0.019

No dataSAT
TT=0.036

random/medium/
unif-k5-r21.3-v75-c1597-S241605246-015.SATISFIABLE.cnf
SAT
TT=0.018

SAT
TT=0.032

No dataNo dataSAT
TT=1.427

? (exit code)
TT=1.604

No dataSAT
TT=0.595

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.228

SAT
TT=0.112

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.257

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.714

No dataNo dataNo dataSAT
TT=0.744

SAT
TT=0.046

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.039

No dataSAT
TT=0.27

No dataNo dataSAT
TT=0.018

SAT
TT=0.126

No dataSAT
TT=29.928

No dataNo dataSAT
TT=0.059

No dataSAT
TT=0.102

random/medium/
unif-k5-r21.3-v75-c1597-S25975519-056.SATISFIABLE.cnf
SAT
TT=0.003

SAT
TT=0.031

No dataNo data? (exit code)
TT=1.452

? (exit code)
TT=1.739

No dataSAT
TT=0.563

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.121

SAT
TT=0.011

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.65

No dataNo dataNo dataSAT
TT=0.122

SAT
TT=0.032

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.003

No dataSAT
TT=0.147

No dataNo dataSAT
TT=0.009

SAT
TT=0.027

No dataSAT
TT=29.427

No dataNo dataSAT
TT=0.03

No dataSAT
TT=0.006

random/medium/
unif-k5-r21.3-v75-c1597-S295912653-089.UNKNOWN.cnf
UNSAT
TT=6.419

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=53.224

UNSAT
TT=60.698

No dataUNSAT
TT=108.224

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.419

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=49.751

No dataNo dataNo dataUNSAT
TT=49.706

UNSAT
TT=177.161

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=6.727

No dataNo dataUNSAT
TT=128.935

? (TO)
TT=5000.09

No dataUNSAT
TT=167.93

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k5-r21.3-v75-c1597-S428924146-076.UNKNOWN.cnf
UNSAT
TT=7.407

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=73.433

UNSAT
TT=60.349

No dataUNSAT
TT=107.665

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=7.407

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=54.211

No dataNo dataNo dataUNSAT
TT=59.08

UNSAT
TT=185.858

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=7.706

No dataNo dataUNSAT
TT=134.957

? (TO)
TT=5000.05

No dataUNSAT
TT=168.83

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v75-c1597-S445191369-092.SATISFIABLE.cnf
SAT
TT=0.009

SAT
TT=0.02

No dataNo data? (exit code)
TT=1.4

? (exit code)
TT=1.632

No dataSAT
TT=0.545

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.159

SAT
TT=0.026

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.629

No dataNo dataNo dataSAT
TT=0.14

SAT
TT=0.032

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.009

No dataSAT
TT=0.115

No dataNo dataSAT
TT=0.024

SAT
TT=0.025

No dataSAT
TT=29.384

No dataNo dataSAT
TT=0.029

No dataSAT
TT=0.018

random/medium/
unif-k5-r21.3-v75-c1597-S602837755-005.UNKNOWN.cnf
UNSAT
TT=6.42

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=57.52

UNSAT
TT=51.837

No dataUNSAT
TT=107.733

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=6.42

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=50.125

No dataNo dataNo dataUNSAT
TT=51.688

UNSAT
TT=226.081

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=7.471

No dataNo dataUNSAT
TT=120.703

? (TO)
TT=5000.02

No dataUNSAT
TT=168.03

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

random/medium/
unif-k5-r21.3-v75-c1597-S60874767-043.UNKNOWN.cnf
UNSAT
TT=7.231

? (TO)
TT=5000.02

No dataNo dataUNSAT
TT=56.595

UNSAT
TT=77.172

No dataUNSAT
TT=110.38

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=7.231

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=51.69

No dataNo dataNo dataUNSAT
TT=58.272

UNSAT
TT=258.971

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=7.579

No dataNo dataUNSAT
TT=135.251

? (TO)
TT=5000.07

No dataUNSAT
TT=169.43

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

random/medium/
unif-k5-r21.3-v75-c1597-S906725726-060.SATISFIABLE.cnf
SAT
TT=0.004

SAT
TT=0.025

No dataNo dataSAT
TT=1.346

? (exit code)
TT=3.939

No dataSAT
TT=0.561

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.179

SAT
TT=0.016

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.338

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.624

No dataNo dataNo dataSAT
TT=0.286

SAT
TT=0.037

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.004

No dataSAT
TT=2.699

No dataNo dataSAT
TT=0.023

SAT
TT=0.035

No dataSAT
TT=30.409

No dataNo dataSAT
TT=0.029

No dataSAT
TT=0.006

random/medium/
unif-k7-r89-v50-c4450-S1027567260-047.UNKNOWN.cnf
UNSAT
TT=32.42

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=270.13

UNSAT
TT=317.653

No dataUNSAT
TT=636.953

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=36.102

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=157.617

No dataNo dataNo dataUNSAT
TT=263.241

UNSAT
TT=634.277

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=32.42

No dataNo dataUNSAT
TT=299.554

? (TO)
TT=5000.07

No dataUNSAT
TT=204.23

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v50-c4450-S1034575833-022.UNKNOWN.cnf
UNSAT
TT=32.607

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=378.271

UNSAT
TT=270.142

No dataUNSAT
TT=636.7

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=32.607

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=169.628

No dataNo dataNo dataUNSAT
TT=264.857

UNSAT
TT=978.622

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=35.388

No dataNo dataUNSAT
TT=297.538

? (TO)
TT=5000.1

No dataUNSAT
TT=204.42

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

random/medium/
unif-k7-r89-v50-c4450-S1082084494-034.UNKNOWN.cnf
UNSAT
TT=32.418

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=258.924

UNSAT
TT=270.135

No dataUNSAT
TT=636.312

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=4999.98

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=32.615

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=157.633

No dataNo dataNo dataUNSAT
TT=262.566

UNSAT
TT=888.938

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=32.418

No dataNo dataUNSAT
TT=300.867

? (TO)
TT=5000.02

No dataUNSAT
TT=202.35

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

random/medium/
unif-k7-r89-v50-c4450-S1087312438-073.SATISFIABLE.cnf
SAT
TT=0.019

SAT
TT=0.432

No dataNo data? (exit code)
TT=22.98

? (exit code)
TT=23.482

No dataSAT
TT=0.738

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.292

SAT
TT=0.35

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.565

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.941

No dataNo dataNo dataSAT
TT=2.775

SAT
TT=2.74

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.229

No dataSAT
TT=9.728

No dataNo dataSAT
TT=0.049

SAT
TT=0.685

No dataSAT
TT=35.54

No dataNo dataSAT
TT=0.457

No dataSAT
TT=0.019

random/medium/
unif-k7-r89-v50-c4450-S1273410420-036.UNKNOWN.cnf
UNSAT
TT=34.4

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=220.266

UNSAT
TT=299.264

No dataUNSAT
TT=633.692

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=34.948

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=159.658

No dataNo dataNo dataUNSAT
TT=279.265

UNSAT
TT=1068.48

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=34.4

No dataNo dataUNSAT
TT=314.796

? (TO)
TT=5000.07

No dataUNSAT
TT=205.73

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v50-c4450-S1374457799-001.UNKNOWN.cnf
UNSAT
TT=33.05

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=222.181

UNSAT
TT=311.861

No dataUNSAT
TT=636.756

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=33.531

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=157.993

No dataNo dataNo dataUNSAT
TT=269.3

UNSAT
TT=904.269

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=33.05

No dataNo dataUNSAT
TT=297.67

? (TO)
TT=5000.08

No dataUNSAT
TT=200.15

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v50-c4450-S1430772875-039.SATISFIABLE.cnf
SAT
TT=0.036

SAT
TT=0.479

No dataNo dataSAT
TT=1.922

? (exit code)
TT=11.054

No dataSAT
TT=0.733

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.776

SAT
TT=0.111

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.331

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.837

No dataNo dataNo dataSAT
TT=5.61

SAT
TT=2.859

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.203

No dataSAT
TT=7.348

No dataNo dataSAT
TT=0.036

SAT
TT=0.604

No dataSAT
TT=36.84

No dataNo dataSAT
TT=0.696

No dataSAT
TT=0.689

random/medium/
unif-k7-r89-v50-c4450-S1496316430-079.SATISFIABLE.cnf
SAT
TT=0.045

SAT
TT=0.726

No dataNo data? (exit code)
TT=4.293

SAT
TT=1.914

No dataSAT
TT=1.131

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.488

SAT
TT=0.813

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.523

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.531

No dataNo dataNo dataSAT
TT=2.105

SAT
TT=3.521

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.045

No dataSAT
TT=0.524

No dataNo dataSAT
TT=0.18

SAT
TT=1.099

No dataSAT
TT=35.7

No dataNo dataSAT
TT=0.948

No dataSAT
TT=0.098

random/medium/
unif-k7-r89-v50-c4450-S1786071619-083.SATISFIABLE.cnf
SAT
TT=0.033

SAT
TT=0.443

No dataNo data? (exit code)
TT=5.436

? (exit code)
TT=10.572

No dataSAT
TT=1.038

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.141

SAT
TT=0.062

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.585

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.843

No dataNo dataNo dataSAT
TT=2.973

SAT
TT=2.962

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.033

No dataSAT
TT=3.557

No dataNo dataSAT
TT=0.257

SAT
TT=0.634

No dataSAT
TT=36.83

No dataNo dataSAT
TT=0.468

No dataSAT
TT=0.213

random/medium/
unif-k7-r89-v50-c4450-S1788358104-029.SATISFIABLE.cnf
SAT
TT=0.052

SAT
TT=0.493

No dataNo data? (exit code)
TT=12.605

SAT
TT=1.937

No dataSAT
TT=0.726

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.15

SAT
TT=0.073

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11.017

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.942

No dataNo dataNo dataSAT
TT=2.789

SAT
TT=2.652

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.061

No dataSAT
TT=10.932

No dataNo dataSAT
TT=0.052

SAT
TT=0.614

No dataSAT
TT=25.54

No dataNo dataSAT
TT=0.649

No dataSAT
TT=0.07

random/medium/
unif-k7-r89-v50-c4450-S1880985555-004.UNKNOWN.cnf
UNSAT
TT=34.104

? (TO)
TT=5000.03

No dataNo dataUNSAT
TT=377.352

UNSAT
TT=260.125

No dataUNSAT
TT=628.062

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=34.354

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=158.288

No dataNo dataNo dataUNSAT
TT=275.332

UNSAT
TT=1109.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataUNSAT
TT=34.104

No dataNo dataUNSAT
TT=305.287

? (TO)
TT=5000.02

No dataUNSAT
TT=201.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v50-c4450-S2039518547-066.UNKNOWN.cnf
UNSAT
TT=32.994

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=277.961

UNSAT
TT=254.65

No dataUNSAT
TT=633.256

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=33.473

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=158.052

No dataNo dataNo dataUNSAT
TT=268.017

UNSAT
TT=777.941

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=32.994

No dataNo dataUNSAT
TT=318.993

? (TO)
TT=5000.02

No dataUNSAT
TT=200.14

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k7-r89-v50-c4450-S321945897-005.UNKNOWN.cnf
UNSAT
TT=32.804

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=257.182

UNSAT
TT=260.549

No dataUNSAT
TT=634.577

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=33.269

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=165.832

No dataNo dataNo dataUNSAT
TT=266.683

UNSAT
TT=1047.59

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=32.804

No dataNo dataUNSAT
TT=317.01

? (TO)
TT=5000.06

No dataUNSAT
TT=199.94

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

random/medium/
unif-k7-r89-v50-c4450-S324945930-048.UNKNOWN.cnf
UNSAT
TT=32.602

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=282.049

UNSAT
TT=197.265

No dataUNSAT
TT=545.263

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=32.602

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=156.412

No dataNo dataNo dataUNSAT
TT=258.471

UNSAT
TT=1002.28

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataUNSAT
TT=35.433

No dataNo dataUNSAT
TT=317.733

? (TO)
TT=5000.1

No dataUNSAT
TT=199.05

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

random/medium/
unif-k7-r89-v50-c4450-S422404201-035.SATISFIABLE.cnf
SAT
TT=0.064

SAT
TT=0.464

No dataNo data? (exit code)
TT=4.916

? (exit code)
TT=5.007

No dataSAT
TT=0.73

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.385

SAT
TT=0.204

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.198

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.976

No dataNo dataNo dataSAT
TT=6.055

SAT
TT=3.113

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.094

No dataSAT
TT=1.198

No dataNo dataSAT
TT=0.064

SAT
TT=0.669

No dataSAT
TT=35.23

No dataNo dataSAT
TT=0.618

No dataSAT
TT=0.4

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v50-c4450-S675112162-053.SATISFIABLE.cnf
SAT
TT=0.047

SAT
TT=0.461

No dataNo dataSAT
TT=1.703

? (exit code)
TT=39.446

No dataSAT
TT=0.735

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.304

SAT
TT=0.195

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=17.676

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.791

No dataNo dataNo dataSAT
TT=2.51

SAT
TT=3.083

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.047

No dataSAT
TT=17.434

No dataNo dataSAT
TT=0.097

SAT
TT=0.635

No dataSAT
TT=35.23

No dataNo dataSAT
TT=0.572

No dataSAT
TT=0.106

random/medium/
unif-k7-r89-v50-c4450-S708803296-021.UNKNOWN.cnf
UNSAT
TT=32.959

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=273.936

UNSAT
TT=252.426

No dataUNSAT
TT=632.62

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=33.548

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=171.592

No dataNo dataNo dataUNSAT
TT=268.49

UNSAT
TT=936.759

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=32.959

No dataNo dataUNSAT
TT=283.518

? (TO)
TT=5000.03

No dataUNSAT
TT=200.03

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

random/medium/
unif-k7-r89-v50-c4450-S768928417-025.SATISFIABLE.cnf
SAT
TT=0.041

SAT
TT=0.687

No dataNo data? (exit code)
TT=1.595

? (exit code)
TT=1.666

No dataSAT
TT=0.717

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.307

SAT
TT=0.067

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.187

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.708

No dataNo dataNo dataSAT
TT=2.285

SAT
TT=2.64

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.107

No dataSAT
TT=12.976

No dataNo dataSAT
TT=0.055

SAT
TT=0.67

No dataSAT
TT=35.24

No dataNo dataSAT
TT=0.521

No dataSAT
TT=0.041

random/medium/
unif-k7-r89-v50-c4450-S864690872-081.SATISFIABLE.cnf
SAT
TT=0.021

SAT
TT=0.541

No dataNo data? (exit code)
TT=1.492

? (exit code)
TT=19.514

No dataSAT
TT=0.807

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.182

SAT
TT=0.041

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.301

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.699

No dataNo dataNo dataSAT
TT=5.455

SAT
TT=3.352

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.033

No dataSAT
TT=16.125

No dataNo dataSAT
TT=0.03

SAT
TT=0.659

No dataSAT
TT=36.63

No dataNo dataSAT
TT=0.575

No dataSAT
TT=0.021

random/medium/
unif-k7-r89-v50-c4450-S879384975-017.SATISFIABLE.cnf
SAT
TT=0.017

SAT
TT=0.457

No dataNo data? (exit code)
TT=22.356

? (exit code)
TT=13.422

No dataSAT
TT=1.77

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.318

SAT
TT=0.017

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=11.179

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.964

No dataNo dataNo dataSAT
TT=2.178

SAT
TT=1.921

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.045

No dataSAT
TT=9.899

No dataNo dataSAT
TT=0.419

SAT
TT=0.817

No dataSAT
TT=35.45

No dataNo dataSAT
TT=0.527

No dataSAT
TT=0.039

random/medium/
unif-k7-r89-v60-c5340-S113771637-026.UNKNOWN.cnf
UNSAT
TT=368.443

? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=3068.88

UNSAT
TT=3316.87

No dataUNSAT
TT=1172.71

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=371.347

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=456.024

No dataNo dataNo dataUNSAT
TT=3009.28

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=368.443

No dataNo data? (exit code)
TT=4998.53

? (TO)
TT=5000.48

No dataUNSAT
TT=810.01

No dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

random/medium/
unif-k7-r89-v60-c5340-S1141565617-016.SATISFIABLE.cnf
SAT
TT=0.741

SAT
TT=14.388

No dataNo dataSAT
TT=6.003

SAT
TT=7.861

No dataSAT
TT=2.51

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.794

SAT
TT=6.711

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=166.926

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.017

No dataNo dataNo dataSAT
TT=29.102

SAT
TT=3.458

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.778

No dataSAT
TT=152.527

No dataNo dataSAT
TT=0.741

SAT
TT=6.519

No dataSAT
TT=290.02

No dataNo dataSAT
TT=5.041

No dataSAT
TT=1.447

random/medium/
unif-k7-r89-v60-c5340-S1445862528-059.UNKNOWN.cnf
UNSAT
TT=368.302

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=3751.85

UNSAT
TT=3434.37

No dataUNSAT
TT=1171.2

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=369.359

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=455.061

No dataNo dataNo dataUNSAT
TT=3001.87

? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataUNSAT
TT=368.302

No dataNo data? (exit code)
TT=4998.52

? (TO)
TT=5000.1

No dataUNSAT
TT=844.83

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

random/medium/
unif-k7-r89-v60-c5340-S1458986015-022.SATISFIABLE.cnf
SAT
TT=1.866

SAT
TT=5.203

No dataNo dataSAT
TT=25.975

SAT
TT=9.526

No dataSAT
TT=14.014

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8.697

SAT
TT=5.614

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=67.083

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=29.458

No dataNo dataNo dataSAT
TT=63.03

SAT
TT=12.239

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.866

No dataSAT
TT=66.905

No dataNo dataSAT
TT=17.564

SAT
TT=5.52

No dataSAT
TT=242.33

No dataNo dataSAT
TT=33.428

No dataSAT
TT=9.859

random/medium/
unif-k7-r89-v60-c5340-S1510638717-051.SATISFIABLE.cnf
SAT
TT=0.344

SAT
TT=0.574

No dataNo dataSAT
TT=1.808

SAT
TT=6.166

No dataSAT
TT=5.728

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.344

SAT
TT=2.283

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=92.316

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.184

No dataNo dataNo dataSAT
TT=19.01

SAT
TT=3.626

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.075

No dataSAT
TT=81.084

No dataNo dataSAT
TT=1.326

SAT
TT=1.072

No dataSAT
TT=248.85

No dataNo dataSAT
TT=3.42

No dataSAT
TT=0.553

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v60-c5340-S1556216475-025.UNKNOWN.cnf
UNSAT
TT=367.009

? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=3769.95

UNSAT
TT=3362.75

No dataUNSAT
TT=1211.47

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=369.941

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=455.77

No dataNo dataNo dataUNSAT
TT=3001.78

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataUNSAT
TT=367.009

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.02

No dataUNSAT
TT=811.14

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v60-c5340-S1583005701-053.SATISFIABLE.cnf
SAT
TT=0.224

SAT
TT=1.821

No dataNo dataSAT
TT=4.905

SAT
TT=7.671

No dataSAT
TT=1.544

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.583

SAT
TT=0.865

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=14.067

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.324

No dataNo dataNo dataSAT
TT=20.689

SAT
TT=4.882

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.471

No dataSAT
TT=14.002

No dataNo dataSAT
TT=1.106

SAT
TT=1.174

No dataSAT
TT=35.84

No dataNo dataSAT
TT=1.312

No dataSAT
TT=0.224

random/medium/
unif-k7-r89-v60-c5340-S1675230100-032.UNKNOWN.cnf
UNSAT
TT=352.104

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=2926.64

UNSAT
TT=3621.49

No dataUNSAT
TT=1157.94

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=352.104

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=441.368

No dataNo dataNo dataUNSAT
TT=2853.66

? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=379.459

No dataNo data? (exit code)
TT=4998.54

? (TO)
TT=5000.03

No dataUNSAT
TT=826.25

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v60-c5340-S1720200795-004.UNKNOWN.cnf
UNSAT
TT=370.187

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=3440.96

UNSAT
TT=3423.21

No dataUNSAT
TT=1173.75

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=371.017

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=458.816

No dataNo dataNo dataUNSAT
TT=2991.46

? (TO)
TT=4999.79

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=370.187

No dataNo data? (exit code)
TT=4998.55

? (TO)
TT=5000.07

No dataUNSAT
TT=812.63

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.04

random/medium/
unif-k7-r89-v60-c5340-S1831136826-075.UNKNOWN.cnf
UNSAT
TT=364.595

? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=2542.31

UNSAT
TT=3148.95

No dataUNSAT
TT=867.994

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=364.948

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=452.807

No dataNo dataNo dataUNSAT
TT=2941.53

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=364.595

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.02

No dataUNSAT
TT=805.22

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

random/medium/
unif-k7-r89-v60-c5340-S1982873755-080.SATISFIABLE.cnf
SAT
TT=0.262

SAT
TT=2.38

No dataNo dataSAT
TT=1.845

SAT
TT=4.635

No dataSAT
TT=2.685

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.754

SAT
TT=1.814

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=142.51

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.743

No dataNo dataNo dataSAT
TT=13.178

SAT
TT=3.566

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.627

No dataSAT
TT=141.435

No dataNo dataSAT
TT=1.317

SAT
TT=1.406

No dataSAT
TT=35.84

No dataNo dataSAT
TT=3.145

No dataSAT
TT=0.262

random/medium/
unif-k7-r89-v60-c5340-S2117313371-002.UNKNOWN.cnf
UNSAT
TT=373.874

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=3801.88

UNSAT
TT=3219.9

No dataUNSAT
TT=1180.53

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=374.987

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=460.576

No dataNo dataNo dataUNSAT
TT=3036.24

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=373.874

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.02

No dataUNSAT
TT=813.73

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.05

random/medium/
unif-k7-r89-v60-c5340-S239039906-021.SATISFIABLE.cnf
SAT
TT=0.081

SAT
TT=0.635

No dataNo data? (exit code)
TT=114.731

? (exit code)
TT=4.995

No dataSAT
TT=0.785

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.527

SAT
TT=0.081

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=107.878

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.873

No dataNo dataNo dataSAT
TT=7.91

SAT
TT=5.529

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.164

No dataSAT
TT=106.994

No dataNo dataSAT
TT=0.317

SAT
TT=1.617

No dataSAT
TT=35.83

No dataNo dataSAT
TT=0.566

No dataSAT
TT=0.394

random/medium/
unif-k7-r89-v60-c5340-S384085843-009.UNKNOWN.cnf
UNSAT
TT=362.918

? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=2979.89

UNSAT
TT=2792.89

No dataUNSAT
TT=869.862

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=368.614

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=452.999

No dataNo dataNo dataUNSAT
TT=2987.7

? (TO)
TT=4999.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataUNSAT
TT=362.918

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.08

No dataUNSAT
TT=805.64

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v60-c5340-S385597856-055.SATISFIABLE.cnf
SAT
TT=0.07

SAT
TT=1.061

No dataNo dataSAT
TT=1.734

SAT
TT=1.992

No dataSAT
TT=0.837

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.444

SAT
TT=0.07

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=40.731

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.802

No dataNo dataNo dataSAT
TT=10.22

SAT
TT=3.231

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.226

No dataSAT
TT=45.214

No dataNo dataSAT
TT=0.691

SAT
TT=0.78

No dataSAT
TT=37.35

No dataNo dataSAT
TT=1.642

No dataSAT
TT=0.082

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v60-c5340-S388186442-035.SATISFIABLE.cnf
SAT
TT=0.579

SAT
TT=1.034

No dataNo dataSAT
TT=1.829

SAT
TT=11.402

No dataSAT
TT=4.696

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.793

SAT
TT=0.579

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=196.107

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.17

No dataNo dataNo dataSAT
TT=7.357

SAT
TT=6.93

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.326

No dataSAT
TT=189.114

No dataNo dataSAT
TT=0.635

SAT
TT=0.972

No dataSAT
TT=35.96

No dataNo dataSAT
TT=5.649

No dataSAT
TT=1.356

random/medium/
unif-k7-r89-v60-c5340-S614849838-039.UNKNOWN.cnf
UNSAT
TT=367.053

? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=3625.38

UNSAT
TT=3371.32

No dataUNSAT
TT=1170.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.9

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=368.71

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=453.336

No dataNo dataNo dataUNSAT
TT=2958.99

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=367.053

No dataNo data? (exit code)
TT=4998.51

? (TO)
TT=5000.03

No dataUNSAT
TT=846.43

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v60-c5340-S630613738-050.SATISFIABLE.cnf
SAT
TT=0.072

SAT
TT=1.047

No dataNo data? (exit code)
TT=4.306

SAT
TT=2.95

No dataSAT
TT=1.379

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.355

SAT
TT=0.624

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=117.363

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.017

No dataNo dataNo dataSAT
TT=2.594

SAT
TT=3.839

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.072

No dataSAT
TT=126.245

No dataNo dataSAT
TT=0.099

SAT
TT=1.165

No dataSAT
TT=37.26

No dataNo dataSAT
TT=2.819

No dataSAT
TT=0.738

random/medium/
unif-k7-r89-v60-c5340-S642174893-006.UNKNOWN.cnf
UNSAT
TT=377.49

? (TO)
TT=5000.05

No dataNo dataUNSAT
TT=2690.17

UNSAT
TT=2901.56

No dataUNSAT
TT=1080.16

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=382.245

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=494.403

No dataNo dataNo dataUNSAT
TT=3099.55

? (TO)
TT=4999.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=377.49

No dataNo data? (exit code)
TT=4998.56

? (TO)
TT=5000.03

No dataUNSAT
TT=820.92

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v60-c5340-S969033069-088.SATISFIABLE.cnf
SAT
TT=0.127

SAT
TT=0.746

No dataNo dataSAT
TT=2.877

SAT
TT=2.174

No dataSAT
TT=0.965

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.182

SAT
TT=0.657

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=34.49

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.128

No dataNo dataNo dataSAT
TT=12.497

SAT
TT=3.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.639

No dataSAT
TT=35.462

No dataNo dataSAT
TT=0.307

SAT
TT=0.879

No dataSAT
TT=35.44

No dataNo dataSAT
TT=1.048

No dataSAT
TT=0.127

random/medium/
unif-k7-r89-v70-c6230-S1018943457-089.SATISFIABLE.cnf
SAT
TT=0.171

SAT
TT=2.028

No dataNo dataSAT
TT=3.207

SAT
TT=9.354

No dataSAT
TT=1.622

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.363

SAT
TT=0.171

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=379.164

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.066

No dataNo dataNo dataSAT
TT=23.02

SAT
TT=5.122

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.083

No dataSAT
TT=347.141

No dataNo dataSAT
TT=0.415

SAT
TT=2.422

No dataSAT
TT=35.94

No dataNo dataSAT
TT=2.746

No dataSAT
TT=2.305

random/medium/
unif-k7-r89-v70-c6230-S1254276596-021.UNKNOWN.cnf
UNSAT
TT=4367.31

? (TO)
TT=5000.04

No dataNo data? (MO)
TT=30577.3

UNSAT
TT=38308.6

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4823.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataUNSAT
TT=35753.3

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=4367.31

No dataNo data? (exit code)
TT=4998.6

? (TO)
TT=5000.01

No data? (TO)
TT=4999.84

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v70-c6230-S1321356000-046.SATISFIABLE.cnf
SAT
TT=0.186

SAT
TT=1.338

No dataNo dataSAT
TT=5.802

SAT
TT=1.913

No dataSAT
TT=0.865

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.753

SAT
TT=0.186

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=164.222

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.441

No dataNo dataNo dataSAT
TT=4.255

SAT
TT=6.26

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.417

No dataSAT
TT=164.623

No dataNo dataSAT
TT=0.425

SAT
TT=1.207

No dataSAT
TT=36.14

No dataNo dataSAT
TT=0.782

No dataSAT
TT=0.932

random/medium/
unif-k7-r89-v70-c6230-S1335110382-066.SATISFIABLE.cnf
SAT
TT=0.03

SAT
TT=4.971

No dataNo dataSAT
TT=9.947

SAT
TT=19.099

No dataSAT
TT=4.061

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.137

SAT
TT=12.792

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=760.311

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=35.665

No dataNo dataNo dataSAT
TT=86.193

SAT
TT=31.682

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.03

No dataSAT
TT=762.662

No dataNo dataSAT
TT=1.964

SAT
TT=8.977

No dataSAT
TT=287.673

No dataNo dataSAT
TT=8.71

No dataSAT
TT=22.909

random/medium/
unif-k7-r89-v70-c6230-S1351138814-007.SATISFIABLE.cnf
SAT
TT=0.931

SAT
TT=4.57

No dataNo dataSAT
TT=6.354

SAT
TT=5.239

No dataSAT
TT=9.204

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.064

SAT
TT=4.794

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2129.29

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.957

No dataNo dataNo dataSAT
TT=48.126

SAT
TT=13.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.515

No dataSAT
TT=2109.75

No dataNo dataSAT
TT=0.931

SAT
TT=1.962

No dataSAT
TT=294.03

No dataNo dataSAT
TT=1.803

No dataSAT
TT=4.128

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v70-c6230-S1475900283-041.UNKNOWN.cnf
UNSAT
TT=4321.31

? (TO)
TT=5000.03

No dataNo data? (MO)
TT=27660.4

UNSAT
TT=35910

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.8

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4823.67

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo dataUNSAT
TT=35261

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=4321.31

No dataNo data? (exit code)
TT=4998.61

? (TO)
TT=5000.05

No data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v70-c6230-S1516725086-012.UNKNOWN.cnf
UNSAT
TT=4368.87

? (TO)
TT=5000.05

No dataNo data?
TT=32087.5

? (TO)
TT=32918.8

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4388.47

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=35842.2

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataUNSAT
TT=4368.87

No dataNo data? (exit code)
TT=4998.61

? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v70-c6230-S1555786344-071.SATISFIABLE.cnf
SAT
TT=0.27

SAT
TT=1.097

No dataNo dataSAT
TT=1.882

SAT
TT=2.165

No dataSAT
TT=0.952

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.765

SAT
TT=0.769

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1541.86

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.232

No dataNo dataNo dataSAT
TT=10.78

SAT
TT=3.776

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.27

No dataSAT
TT=1532.65

No dataNo dataSAT
TT=0.726

SAT
TT=1.006

No dataSAT
TT=36.055

No dataNo dataSAT
TT=0.755

No dataSAT
TT=0.372

random/medium/
unif-k7-r89-v70-c6230-S1780733482-097.UNKNOWN.cnf
UNSAT
TT=4616.98

? (TO)
TT=5000.03

No dataNo data?
TT=31125.2

UNSAT
TT=35009

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4616.98

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=34287.1

? (TO)
TT=4999.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataUNSAT
TT=4641.9

No dataNo data? (exit code)
TT=4998.58

? (TO)
TT=5000.02

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v70-c6230-S1805176884-064.UNKNOWN.cnf
UNSAT
TT=4422.37

? (TO)
TT=5000.06

No dataNo data? (MO)
TT=36558.3

? (TO)
TT=35789

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4436.53

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataUNSAT
TT=35987.8

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=4422.37

No dataNo data? (exit code)
TT=4998.61

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.09

random/medium/
unif-k7-r89-v70-c6230-S1846644927-079.SATISFIABLE.cnf
SAT
TT=0.334

SAT
TT=1.169

No dataNo dataSAT
TT=3.891

SAT
TT=7.687

No dataSAT
TT=4.11

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.717

SAT
TT=0.945

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=470.706

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.757

No dataNo dataNo dataSAT
TT=37.824

SAT
TT=6.474

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.048

No dataSAT
TT=468.404

No dataNo dataSAT
TT=1.196

SAT
TT=8.07

No dataSAT
TT=36.43

No dataNo dataSAT
TT=1.243

No dataSAT
TT=0.334

random/medium/
unif-k7-r89-v70-c6230-S1960545292-083.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=31895.8

? (MO)
TT=30330.4

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.59

? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

random/medium/
unif-k7-r89-v70-c6230-S2045410966-069.SATISFIABLE.cnf
SAT
TT=0.079

SAT
TT=2.44

No dataNo dataSAT
TT=1.848

SAT
TT=2.14

No dataSAT
TT=1.864

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.666

SAT
TT=0.551

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3097.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.9

No dataNo dataNo dataSAT
TT=10.566

SAT
TT=3.79

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.076

No dataSAT
TT=3111.11

No dataNo dataSAT
TT=0.079

SAT
TT=1.945

No dataSAT
TT=35.73

No dataNo dataSAT
TT=0.698

No dataSAT
TT=5.055

random/medium/
unif-k7-r89-v70-c6230-S2143190124-085.SATISFIABLE.cnf
SAT
TT=2.048

SAT
TT=6.578

No dataNo dataSAT
TT=27.567

SAT
TT=14.258

No dataSAT
TT=1.251

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.204

SAT
TT=2.048

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4443.83

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.431

No dataNo dataNo dataSAT
TT=11.87

SAT
TT=23.448

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.878

No dataSAT
TT=4257.66

No dataNo dataSAT
TT=2.849

SAT
TT=5.638

No dataSAT
TT=287.91

No dataNo dataSAT
TT=2.512

No dataSAT
TT=7.535

random/medium/
unif-k7-r89-v70-c6230-S250627100-039.UNKNOWN.cnf
UNSAT
TT=4398.56

? (TO)
TT=5000.06

No dataNo data? (MO)
TT=35026.8

? (TO)
TT=40000.6

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4414.75

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataUNSAT
TT=35901.6

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataUNSAT
TT=4398.56

No dataNo data? (exit code)
TT=4998.61

? (TO)
TT=5000.03

No data? (TO)
TT=4999.98

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.08

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v70-c6230-S289144908-090.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=34201.2

? (TO)
TT=36412.1

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39971.6

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.6

? (TO)
TT=5000.02

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.04

random/medium/
unif-k7-r89-v70-c6230-S314780693-050.SATISFIABLE.cnf
SAT
TT=0.328

SAT
TT=1.593

No dataNo dataSAT
TT=14.007

SAT
TT=6.445

No dataSAT
TT=2.165

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.263

SAT
TT=3.102

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3045.55

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.074

No dataNo dataNo dataSAT
TT=14.25

SAT
TT=6.94

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.322

No dataSAT
TT=2995.85

No dataNo dataSAT
TT=0.328

SAT
TT=1.263

No dataSAT
TT=305.63

No dataNo dataSAT
TT=1.724

No dataSAT
TT=2.008

random/medium/
unif-k7-r89-v70-c6230-S560963242-048.UNKNOWN.cnf



? (TO)
TT=5000.09

No dataNo data?
TT=31264.5

? (MO)
TT=33410.1

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001.1

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.62

? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v70-c6230-S635440951-015.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data? (MO)
TT=27287.3

? (MO)
TT=37390

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39971.8

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.6

? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.08

random/medium/
unif-k7-r89-v70-c6230-S944754256-018.SATISFIABLE.cnf
SAT
TT=0.646

SAT
TT=0.805

No dataNo dataSAT
TT=4.442

SAT
TT=5.958

No dataSAT
TT=2.207

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.686

SAT
TT=1.44

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3289.68

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.351

No dataNo dataNo dataSAT
TT=12.67

SAT
TT=4.245

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.322

No dataSAT
TT=3215.47

No dataNo dataSAT
TT=1.157

SAT
TT=3.663

No dataSAT
TT=37.42

No dataNo dataSAT
TT=0.765

No dataSAT
TT=0.646

random/medium/
unif-k7-r89-v80-c7120-S1147977026-087.SATISFIABLE.cnf
SAT
TT=0.18

SAT
TT=1.451

No dataNo dataSAT
TT=8.089

SAT
TT=12.56

No dataSAT
TT=3.537

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.753

SAT
TT=1.855

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.204

No dataNo dataNo dataSAT
TT=27.588

SAT
TT=17.379

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.18

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=0.489

SAT
TT=9.586

No dataSAT
TT=36.05

No dataNo dataSAT
TT=3.916

No dataSAT
TT=7.179

random/medium/
unif-k7-r89-v80-c7120-S1254315629-032.SATISFIABLE.cnf
SAT
TT=1.766

SAT
TT=11.442

No dataNo dataSAT
TT=16.426

SAT
TT=9.089

No dataSAT
TT=2.746

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=22.888

SAT
TT=2.497

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.766

No dataNo dataNo dataSAT
TT=24.66

SAT
TT=4.87

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=8.271

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=2.075

SAT
TT=2.357

No dataSAT
TT=292.39

No dataNo dataSAT
TT=9.93

No dataSAT
TT=7.853

random/medium/
unif-k7-r89-v80-c7120-S1494985128-003.UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data? (MO)
TT=20694.7

? (MO)
TT=21111.9

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39972.8

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No dataNo data? (exit code)
TT=4998.67

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v80-c7120-S153059456-076.SATISFIABLE.cnf
SAT
TT=0.072

SAT
TT=2.365

No dataNo dataSAT
TT=11.408

SAT
TT=11.79

No dataSAT
TT=1.965

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.709

SAT
TT=0.364

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.924

No dataNo dataNo dataSAT
TT=45.345

SAT
TT=15.175

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.143

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=2.634

SAT
TT=1.375

No dataSAT
TT=37.33

No dataNo dataSAT
TT=2.489

No dataSAT
TT=0.072

random/medium/
unif-k7-r89-v80-c7120-S1623694027-006.SATISFIABLE.cnf
SAT
TT=1.093

SAT
TT=1.58

No dataNo dataSAT
TT=1.744

SAT
TT=3.534

No dataSAT
TT=4.189

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.424

SAT
TT=1.093

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1254.26

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=15.171

No dataNo dataNo dataSAT
TT=37.647

SAT
TT=13.939

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.573

No dataSAT
TT=1355.31

No dataNo dataSAT
TT=1.207

SAT
TT=12.174

No dataSAT
TT=36.14

No dataNo dataSAT
TT=4.412

No dataSAT
TT=3.974

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v80-c7120-S1637697223-097.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data? (MO)
TT=20585.7

? (MO)
TT=21790.1

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.2

? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.1

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.67

? (TO)
TT=5000.07

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v80-c7120-S1639347701-083.SATISFIABLE.cnf
SAT
TT=0.426

SAT
TT=5.876

No dataNo dataSAT
TT=14.844

SAT
TT=2.331

No dataSAT
TT=6.707

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.572

SAT
TT=0.877

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.885

No dataNo dataNo dataSAT
TT=18.26

SAT
TT=10.298

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.683

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=6.958

SAT
TT=1.373

No dataSAT
TT=38.45

No dataNo dataSAT
TT=4.112

No dataSAT
TT=0.426

random/medium/
unif-k7-r89-v80-c7120-S175431861-098.SATISFIABLE.cnf
SAT
TT=0.597

SAT
TT=29.32

No dataNo dataSAT
TT=37.843

SAT
TT=85.455

No dataSAT
TT=7.019

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.597

SAT
TT=51.087

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.89

No dataNo dataNo dataSAT
TT=317.092

SAT
TT=33.712

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.97

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=22.7

SAT
TT=1.162

No dataSAT
TT=406.13

No dataNo dataSAT
TT=15.966

No dataSAT
TT=87.233

random/medium/
unif-k7-r89-v80-c7120-S1801179747-047.SATISFIABLE.cnf
SAT
TT=7.348

SAT
TT=27.051

No dataNo dataSAT
TT=19.099

SAT
TT=25.823

No dataSAT
TT=28.958

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=39.391

SAT
TT=20.028

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=67.156

No dataNo dataNo dataSAT
TT=319.708

SAT
TT=29.478

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=32.562

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=20.666

SAT
TT=7.348

No dataSAT
TT=301.84

No dataNo dataSAT
TT=87.759

No dataSAT
TT=52.009

random/medium/
unif-k7-r89-v80-c7120-S1818856267-075.UNKNOWN.cnf



? (TO)
TT=5000.05

No dataNo data? (MO)
TT=20691.3

? (MO)
TT=25562.9

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40001

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39971.8

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.65

? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

random/medium/
unif-k7-r89-v80-c7120-S1901567697-013.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=23522.8

? (MO)
TT=22222.9

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=4999.99

No dataNo dataNo data? (TO)
TT=39972

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

No dataNo data? (exit code)
TT=4998.63

? (TO)
TT=5000.03

No data? (TO)
TT=4999.97

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.05

random/medium/
unif-k7-r89-v80-c7120-S1957603206-080.SATISFIABLE.cnf
SAT
TT=0.152

SAT
TT=1.245

No dataNo dataSAT
TT=5.392

SAT
TT=9.037

No dataSAT
TT=4.331

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.54

SAT
TT=1.498

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.217

No dataNo dataNo dataSAT
TT=50.25

SAT
TT=15.748

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.152

No data? (TO)
TT=5000.13

No dataNo dataSAT
TT=2.583

SAT
TT=2.596

No dataSAT
TT=288.14

No dataNo dataSAT
TT=6.74

No dataSAT
TT=5.226

random/medium/
unif-k7-r89-v80-c7120-S1968028041-077.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=26542.6

? (MO)
TT=21215.9

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.1

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39971.4

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.64

? (TO)
TT=5000.06

No data? (TO)
TT=5000

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.02

random/medium/
unif-k7-r89-v80-c7120-S1980280938-088.UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data? (MO)
TT=21068.1

? (MO)
TT=27940

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=39971.3

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.65

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

random/medium/
unif-k7-r89-v80-c7120-S199880667-010.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=24304

? (MO)
TT=20234.8

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=39971.6

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No dataNo data? (exit code)
TT=4998.65

? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v80-c7120-S2107193201-069.UNKNOWN.cnf
SAT
TT=6.201

SAT
TT=6.201

No dataNo dataSAT
TT=449.269

SAT
TT=644.014

No dataSAT
TT=73.116

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=93.775

SAT
TT=196.531

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.635

No dataNo dataNo dataSAT
TT=1442.9

SAT
TT=79.129

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=13.619

No data? (TO)
TT=4999.81

No dataNo dataSAT
TT=87.541

SAT
TT=59.561

No dataSAT
TT=333.74

No dataNo dataSAT
TT=368.965

No dataSAT
TT=16.319

random/medium/
unif-k7-r89-v80-c7120-S474185167-033.SATISFIABLE.cnf
SAT
TT=1.02

SAT
TT=4.597

No dataNo dataSAT
TT=3.681

SAT
TT=9.901

No dataSAT
TT=5.443

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.035

SAT
TT=3.177

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.992

No dataNo dataNo dataSAT
TT=22.22

SAT
TT=9.65

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.165

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=1.02

SAT
TT=1.249

No dataSAT
TT=37.25

No dataNo dataSAT
TT=4.081

No dataSAT
TT=3.051

random/medium/
unif-k7-r89-v80-c7120-S513640009-027.SATISFIABLE.cnf
SAT
TT=0.272

SAT
TT=8.661

No dataNo dataSAT
TT=13.876

SAT
TT=4.291

No dataSAT
TT=9.393

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.563

SAT
TT=0.272

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.498

No dataNo dataNo dataSAT
TT=23.246

SAT
TT=17.99

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.887

No data? (TO)
TT=5000.12

No dataNo dataSAT
TT=7.973

SAT
TT=1.553

No dataSAT
TT=302.04

No dataNo dataSAT
TT=3.216

No dataSAT
TT=1.837

random/medium/
unif-k7-r89-v80-c7120-S839353433-100.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=24350

? (MO)
TT=21782.3

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.13

No dataNo data? (exit code)
TT=4998.64

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v80-c7120-S841042385-099.UNKNOWN.cnf



? (TO)
TT=5000.02

No dataNo data? (MO)
TT=29329.1

? (MO)
TT=24660.2

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=39972.2

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.65

? (TO)
TT=5000.07

No data? (TO)
TT=4999.95

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v90-c8010-S1321406709-042.UNKNOWN.cnf



? (TO)
TT=5000.03

No dataNo data? (MO)
TT=23598

? (MO)
TT=17535.1

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=39972.5

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

No dataNo data? (exit code)
TT=4998.69

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v90-c8010-S1458811765-091.UNKNOWN.cnf



? (TO)
TT=5000.04

No dataNo data? (MO)
TT=20783.6

? (MO)
TT=16522.3

No data?
TT=4921.96

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971.9

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.69

? (TO)
TT=5000.09

No data? (TO)
TT=4999.98

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.03

random/medium/
unif-k7-r89-v90-c8010-S1475406203-080.UNKNOWN.cnf



? (TO)
TT=5000.11

No dataNo data? (MO)
TT=18619.4

? (MO)
TT=19514.2

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39971.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No dataNo data? (exit code)
TT=4998.72

? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.02

random/medium/
unif-k7-r89-v90-c8010-S1828831772-021.SATISFIABLE.cnf
SAT
TT=9.358

SAT
TT=50.565

No dataNo dataSAT
TT=187.144

SAT
TT=90.884

No dataSAT
TT=55.419

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=83.084

SAT
TT=89.669

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.358

No dataNo dataNo dataSAT
TT=855.699

SAT
TT=144.897

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=197.825

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=157.744

SAT
TT=162.958

No dataSAT
TT=447.15

No dataNo dataSAT
TT=38.919

No dataSAT
TT=165.737

random/medium/
unif-k7-r89-v90-c8010-S1897189325-062.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=25305.3

? (MO)
TT=25741.3

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.3

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=37931.8

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

No dataNo data? (exit code)
TT=4998.72

? (TO)
TT=5000.06

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v90-c8010-S2014736708-037.SATISFIABLE.cnf
SAT
TT=1.057

SAT
TT=10.588

No dataNo dataSAT
TT=8.141

SAT
TT=4.154

No dataSAT
TT=14.629

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.974

SAT
TT=4.093

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.92

No dataNo dataNo dataSAT
TT=44.8

SAT
TT=9.799

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.213

No data? (TO)
TT=5000.06

No dataNo dataSAT
TT=1.057

SAT
TT=1.177

No dataSAT
TT=301.01

No dataNo dataSAT
TT=10.255

No dataSAT
TT=3.295

random/medium/
unif-k7-r89-v90-c8010-S2039249975-038.SATISFIABLE.cnf
SAT
TT=3.512

SAT
TT=76.588

No dataNo dataSAT
TT=30.311

SAT
TT=52.403

No dataSAT
TT=23.813

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=43.318

SAT
TT=25.435

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=80.784

No dataNo dataNo dataSAT
TT=109.39

SAT
TT=51.048

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=9.447

No data? (TO)
TT=5000.07

No dataNo dataSAT
TT=3.941

SAT
TT=3.512

No dataSAT
TT=308.13

No dataNo dataSAT
TT=40.138

No dataSAT
TT=38.202

random/medium/
unif-k7-r89-v90-c8010-S2127424322-078.UNKNOWN.cnf



? (TO)
TT=5000.07

No dataNo data? (MO)
TT=17934.1

? (MO)
TT=21842

No data? (MO)
TT=4705.81

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.69

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

random/medium/
unif-k7-r89-v90-c8010-S224440242-006.SATISFIABLE.cnf
SAT
TT=0.209

SAT
TT=2.707

No dataNo dataSAT
TT=13.695

SAT
TT=3.115

No dataSAT
TT=9.412

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.382

SAT
TT=0.209

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.688

No dataNo dataNo dataSAT
TT=35.1

SAT
TT=6.461

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.937

No data? (TO)
TT=5000.08

No dataNo dataSAT
TT=5.812

SAT
TT=3.255

No dataSAT
TT=290.94

No dataNo dataSAT
TT=0.936

No dataSAT
TT=3.563

random/medium/
unif-k7-r89-v90-c8010-S231612998-061.SATISFIABLE.cnf
SAT
TT=2.85

SAT
TT=43.586

No dataNo dataSAT
TT=9.594

SAT
TT=20.922

No dataSAT
TT=10.519

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.85

SAT
TT=7.249

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=41.696

No dataNo dataNo dataSAT
TT=187.526

SAT
TT=12.862

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=40.477

No data? (TO)
TT=5000.05

No dataNo dataSAT
TT=16.696

SAT
TT=9.157

No dataSAT
TT=294.12

No dataNo dataSAT
TT=41.03

No dataSAT
TT=28.184

random/medium/
unif-k7-r89-v90-c8010-S271997978-024.SATISFIABLE.cnf
SAT
TT=0.222

SAT
TT=5.348

No dataNo dataSAT
TT=7.481

SAT
TT=8.662

No dataSAT
TT=8.948

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.84

SAT
TT=6.315

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=41.368

No dataNo dataNo dataSAT
TT=123.085

SAT
TT=6.777

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4.834

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=76.563

SAT
TT=1.197

No dataSAT
TT=36.25

No dataNo dataSAT
TT=9.788

No dataSAT
TT=0.222

random/medium/
unif-k7-r89-v90-c8010-S423984545-074.UNKNOWN.cnf



? (TO)
TT=5000.08

No dataNo data? (MO)
TT=24426.6

? (MO)
TT=18712.7

No data? (MO)
TT=4546.61

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.5

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=39971.8

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.73

? (TO)
TT=5000.03

No data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

random/medium/
unif-k7-r89-v90-c8010-S501033814-049.SATISFIABLE.cnf
SAT
TT=0.542

SAT
TT=3.387

No dataNo dataSAT
TT=25.785

SAT
TT=26.679

No dataSAT
TT=4.106

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=5.859

SAT
TT=0.542

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.602

No dataNo dataNo dataSAT
TT=15.06

SAT
TT=17.164

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.54

No data? (TO)
TT=5000.09

No dataNo dataSAT
TT=1.617

SAT
TT=3.586

No dataSAT
TT=36.62

No dataNo dataSAT
TT=4.535

No dataSAT
TT=8.784

random/medium/
unif-k7-r89-v90-c8010-S51928934-076.SATISFIABLE.cnf
SAT
TT=1.325

SAT
TT=21.601

No dataNo data? (exit code)
TT=49.27

SAT
TT=20.221

No dataSAT
TT=1.494

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=12.481

SAT
TT=2.911

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=7.438

No dataNo dataNo dataSAT
TT=38.869

SAT
TT=78.909

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.425

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=1.824

SAT
TT=1.325

No dataSAT
TT=291.14

No dataNo dataSAT
TT=16.43

No dataSAT
TT=8.104

random/medium/
unif-k7-r89-v90-c8010-S64052796-033.SATISFIABLE.cnf
SAT
TT=0.463

SAT
TT=37.737

No dataNo dataSAT
TT=18.482

SAT
TT=5.036

No dataSAT
TT=8.149

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.463

SAT
TT=4.543

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.992

No dataNo dataNo dataSAT
TT=100.66

SAT
TT=25.006

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.426

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=7.157

SAT
TT=3.443

No dataSAT
TT=36.83

No dataNo dataSAT
TT=2.275

No dataSAT
TT=4.45

Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
random/medium/
unif-k7-r89-v90-c8010-S661190852-039.SATISFIABLE.cnf
SAT
TT=0.088

SAT
TT=72.526

No dataNo dataSAT
TT=59.259

SAT
TT=20.256

No dataSAT
TT=8.929

No dataNo dataNo dataNo dataNo dataNo dataSAT
TT=102.833

SAT
TT=0.088

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=15.027

No dataNo dataNo dataSAT
TT=76.854

SAT
TT=54.355

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=51.56

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=133.14

SAT
TT=38.473

No dataSAT
TT=38.45

No dataNo dataSAT
TT=23.426

No dataSAT
TT=106.209

random/medium/
unif-k7-r89-v90-c8010-S741717046-057.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=17958.2

? (MO)
TT=15906.3

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.4

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39965.2

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (exit code)
TT=4998.73

? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

random/medium/
unif-k7-r89-v90-c8010-S764895749-094.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=21055.2

? (MO)
TT=20680.5

No data? (MO)
TT=4811.93

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.7

? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39966

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.67

? (TO)
TT=5000.02

No data? (TO)
TT=4999.98

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

random/medium/
unif-k7-r89-v90-c8010-S775210372-041.UNKNOWN.cnf



? (TO)
TT=5000.1

No dataNo data? (MO)
TT=22478

? (MO)
TT=20579.8

No data? (MO)
TT=4541.38

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=39971.7

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

No dataNo data? (exit code)
TT=4998.7

? (TO)
TT=5000.02

No data? (TO)
TT=4999.89

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.02

random/medium/
unif-k7-r89-v90-c8010-S818753762-096.UNKNOWN.cnf



? (TO)
TT=5000.06

No dataNo data? (MO)
TT=23312.2

? (MO)
TT=18454.3

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=39972.8

? (TO)
TT=4999.97

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo data? (exit code)
TT=4998.69

? (TO)
TT=5000.06

No data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

SAT02/handmade/chu-min-li/
urquhart/
urquhart3_25bis.shuffled.cnf
UNSAT
TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=27.667

UNSAT
TT=102.075

UNSAT
TT=93.631

No dataUNSAT
TT=13.739

UNSAT
TT=1.651

No dataNo dataNo dataUNSAT
TT=11.351

No dataUNSAT
TT=80.034

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo dataUNSAT
TT=8.412

No dataUNSAT
TT=44.639

UNSAT
TT=0.019

UNSAT
TT=0.258

UNSAT
TT=347.996

UNSAT
TT=1.181

No dataUNSAT
TT=112.479

UNSAT
TT=1398.45

UNSAT
TT=291.404

UNSAT
TT=42.656

UNSAT
TT=153.963

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.001

No dataNo dataUNSAT
TT=421.809

UNSAT
TT=4.44

? (TO)
TT=5000.09

? (TO)
TT=5000.07

No dataUNSAT
TT=0.088

No data
SAT02/handmade/pehoushek/
plainoldcnf/
5cnf_3500_3500_30f1.shuffled.cnf
UNSAT
TT=0.004

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.006

UNSAT
TT=0.011

UNSAT
TT=0.009

No dataUNSAT
TT=0.296

UNSAT
TT=0.009

No dataNo dataNo dataUNSAT
TT=0.007

No dataUNSAT
TT=0.337

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.019

No dataNo dataUNSAT
TT=0.004

No dataUNSAT
TT=0.118

UNSAT
TT=0.044

UNSAT
TT=0.122

UNSAT
TT=11.008

UNSAT
TT=0.04

No dataUNSAT
TT=0.005

UNSAT
TT=0.007

UNSAT
TT=0.097

UNSAT
TT=0.006

UNSAT
TT=0.006

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.071

No dataNo dataUNSAT
TT=0.009

UNSAT
TT=3.156

? (TO)
TT=5000.08

? (TO)
TT=5000.11

No dataUNSAT
TT=0.062

No data
SAT02/handmade/pehoushek/
plainoldcnf/
5cnf_3900_3900_060.shuffled.cnf
UNSAT
TT=1.207

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2.272

UNSAT
TT=6.852

UNSAT
TT=5.636

No dataUNSAT
TT=52.929

UNSAT
TT=9.437

No dataNo dataNo dataUNSAT
TT=3.32

No dataUNSAT
TT=14.303

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=43.333

No dataNo dataUNSAT
TT=1.37

No dataUNSAT
TT=31.969

UNSAT
TT=1.207

UNSAT
TT=8.939

UNSAT
TT=530.69

UNSAT
TT=10.117

No dataUNSAT
TT=11.209

UNSAT
TT=8.362

UNSAT
TT=29.513

UNSAT
TT=2.516

UNSAT
TT=2.314

No dataNo dataNo dataNo dataNo dataUNSAT
TT=4.332

No dataNo dataUNSAT
TT=68.616

UNSAT
TT=14.14

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No dataUNSAT
TT=10.7

No data
SAT02/handmade/pehoushek/
plainoldcnf/
5cnf_3900_3900_220.shuffled.cnf
SAT
TT=0.034

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40000.4

? (TO)
TT=40000.5

No data? (TO)
TT=40001.1

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.118

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.8

SAT
TT=0.188

SAT
TT=0.048

? (TO)
TT=20400.2

? (TO)
TT=5000.12

No data? (TO)
TT=5000.03

? (TO)
TT=5000.26

? (TO)
TT=40000.4

SAT
TT=4553.75

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.41

No dataNo dataSAT
TT=0.733

SAT
TT=30.602

SAT
TT=0.035

SAT
TT=0.034

No data? (TO)
TT=5000.13

No data
SAT02/handmade/pehoushek/
plainoldcnf/
5cnf_4300_4300_110.shuffled.cnf
SAT
TT=0.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1494.72

SAT
TT=2058.86

SAT
TT=2431.6

No dataSAT
TT=25101.3

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.01

No dataSAT
TT=4641.37

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.854

No dataNo dataSAT
TT=437.486

No dataSAT
TT=39767.4

SAT
TT=0.249

SAT
TT=0.036

? (TO)
TT=20400.3

? (TO)
TT=5000.04

No dataSAT
TT=3872.57

SAT
TT=46.93

? (TO)
TT=40000.5

SAT
TT=1759.28

SAT
TT=2302.81

No dataNo dataNo dataNo dataNo dataSAT
TT=1971.74

No dataNo dataSAT
TT=0.02

SAT
TT=27.999

SAT
TT=0.026

SAT
TT=0.037

No data? (TO)
TT=5000.13

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT02/handmade/pehoushek/
plainoldcnf/
5cnf_4300_4300_170.shuffled.cnf
SAT
TT=0.096

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40000.3

? (TO)
TT=40000.2

No data? (TO)
TT=40000.5

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.049

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.9

SAT
TT=0.176

SAT
TT=0.104

? (TO)
TT=20400.1

? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

? (TO)
TT=5000.18

? (TO)
TT=40000.9

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.6

No dataNo dataSAT
TT=7.066

SAT
TT=30.708

SAT
TT=0.096

SAT
TT=0.382

No data? (TO)
TT=5000.13

No data
SAT02/handmade/pehoushek/
twentyvars/
7cnf20_90000_90000_7.shuffled.cnf
SAT
TT=0.006

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.013

SAT
TT=0.015

SAT
TT=0.023

No dataSAT
TT=0.388

SAT
TT=0.037

No dataNo dataNo dataSAT
TT=0.01

No dataSAT
TT=0.309

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.023

No dataNo dataSAT
TT=0.006

No dataSAT
TT=0.309

SAT
TT=0.109

SAT
TT=0.15

SAT
TT=66.09

SAT
TT=0.072

No dataSAT
TT=0.011

SAT
TT=0.019

SAT
TT=0.099

SAT
TT=0.023

SAT
TT=0.02

No dataNo dataNo dataNo dataNo dataSAT
TT=4.902

No dataNo dataSAT
TT=0.017

SAT
TT=13.446

SAT
TT=0.109

SAT
TT=0.107

No dataSAT
TT=0.072

No data
SAT02/handmade/simon/
satex-challenges/
c6288.shuffled.cnf
UNSAT
TT=0.775

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40000.8

? (TO)
TT=40000.8

No dataUNSAT
TT=234.317

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.9

UNSAT
TT=10367.9

? (TO)
TT=5000.04

? (TO)
TT=20400.2

? (TO)
TT=5000.13

No data? (TO)
TT=5000.04

? (TO)
TT=5000.07

? (TO)
TT=40001.2

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.775

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=3636.38

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No data? (TO)
TT=5000.11

No data
SAT02/handmade/simon/
satex-challenges/
f600.shuffled.cnf
SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40000.6

? (TO)
TT=40000.8

No data? (TO)
TT=40000.5

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.975

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001.1

SAT
TT=0.056

SAT
TT=0.022

? (TO)
TT=20400.3

? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

? (TO)
TT=5000.2

? (TO)
TT=40000.9

SAT
TT=4074.87

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataSAT
TT=4750.96

No dataNo dataSAT
TT=21.956

SAT
TT=23.772

SAT
TT=0.055

SAT
TT=0.171

No data? (TO)
TT=5000.07

No data
SAT02/handmade/simon/
satex-challenges/
par32-3.shuffled.cnf
SAT
TT=0.639

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40000.5

? (TO)
TT=40000.3

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=137.305

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.7

SAT
TT=11.04

? (TO)
TT=5000.07

? (TO)
TT=20400.2

? (TO)
TT=5000.06

No data? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=40000.6

? (TO)
TT=5000.07

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataSAT
TT=0.639

No dataNo data? (TO)
TT=5000.1

SAT
TT=157.96

? (TO)
TT=5000.04

? (TO)
TT=5000.01

No data? (TO)
TT=5000.06

No data
SAT02/handmade/
zhang-lintao/xor-chain/
x1_40.shuffled.cnf
UNSAT
TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=136.802

UNSAT
TT=475.773

UNSAT
TT=511.602

No dataUNSAT
TT=8.742

UNSAT
TT=1.067

No dataNo dataNo dataUNSAT
TT=238.859

No dataUNSAT
TT=350.308

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo dataUNSAT
TT=43.334

No dataUNSAT
TT=154.381

UNSAT
TT=0.011

UNSAT
TT=0.157

UNSAT
TT=291.861

UNSAT
TT=1.09

No dataUNSAT
TT=452.51

UNSAT
TT=2878.35

UNSAT
TT=748.88

UNSAT
TT=116.587

UNSAT
TT=668.533

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.001

No dataNo dataUNSAT
TT=649.253

UNSAT
TT=3.75

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No dataUNSAT
TT=0.092

No data
SAT02/handmade/
zhang-lintao/xor-chain/
x1_80.shuffled.cnf
UNSAT
TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=40000.7

? (TO)
TT=40000.3

No dataUNSAT
TT=29.805

UNSAT
TT=3.62

No dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.003

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.9

UNSAT
TT=0.02

UNSAT
TT=0.282

? (TO)
TT=20398.7

UNSAT
TT=3.586

No data? (TO)
TT=5000.06

? (TO)
TT=5000.4

? (TO)
TT=40000.6

? (TO)
TT=5000.1

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo data? (TO)
TT=5000.05

UNSAT
TT=6.55

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No dataUNSAT
TT=0.256

No data
SAT02/industrial/
aloul/Bart/
bart17.shuffled.cnf
SAT
TT=0.004

No data? (exit code)
TT=0.906

? (exit code)
TT=0.864

No dataNo dataSAT
TT=0.512

No dataNo dataSAT
TT=0.02

SAT
TT=0.035

SAT
TT=0.222

SAT
TT=0.325

SAT
TT=0.018

No dataNo dataSAT
TT=0.009

SAT
TT=0.009

SAT
TT=0.004

No dataSAT
TT=0.01

SAT
TT=0.01

No dataSAT
TT=0.004

SAT
TT=0.005

SAT
TT=0.005

SAT
TT=0.005

SAT
TT=0.005

SAT
TT=0.01

SAT
TT=0.005

No dataSAT
TT=0.019

No dataNo dataSAT
TT=0.075

SAT
TT=0.086

SAT
TT=0.01

No dataNo dataSAT
TT=11.782

SAT
TT=0.018

SAT
TT=0.004

No dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=0.022

No dataSAT
TT=0.004

No dataNo dataNo dataNo dataSAT
TT=3.048

No dataNo dataNo dataNo dataNo data
SAT02/industrial/aloul/
Homer/homer14.shuffled.cnf
UNSAT
TT=71.343

No dataUNSAT
TT=2038.07

UNSAT
TT=1874.19

No dataNo dataUNSAT
TT=1012.25

No dataNo dataUNSAT
TT=448.33

UNSAT
TT=481.457

UNSAT
TT=2560.73

UNSAT
TT=2558.91

UNSAT
TT=274.602

No dataNo dataUNSAT
TT=407.916

UNSAT
TT=225.814

UNSAT
TT=2543.95

No dataUNSAT
TT=654.999

UNSAT
TT=592.258

No dataUNSAT
TT=888.118

UNSAT
TT=401.176

UNSAT
TT=2561.68

UNSAT
TT=2180.05

UNSAT
TT=2477.29

UNSAT
TT=598.163

UNSAT
TT=2507.51

No dataUNSAT
TT=399.997

No dataNo dataUNSAT
TT=2448.08

UNSAT
TT=2480.32

UNSAT
TT=343.038

No dataNo dataUNSAT
TT=71.343

UNSAT
TT=863.632

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataUNSAT
TT=872.072

No dataUNSAT
TT=664.615

No dataUNSAT
TT=1222.4

No dataNo dataNo dataNo dataUNSAT
TT=206.93

No dataNo dataNo dataNo dataNo data
SAT02/industrial/aloul/
Homer/homer16.shuffled.cnf
UNSAT
TT=738.98

No dataUNSAT
TT=3259.88

UNSAT
TT=4383.11

No dataNo data? (TO)
TT=5000.01

No dataNo dataUNSAT
TT=1107.62

UNSAT
TT=1068.43

UNSAT
TT=8536.45

UNSAT
TT=8535.92

UNSAT
TT=1939.51

No dataNo dataUNSAT
TT=4296.55

UNSAT
TT=2224.83

UNSAT
TT=3016.98

No data? (TO)
TT=5000.07

? (TO)
TT=5000.15

No dataUNSAT
TT=3087.69

UNSAT
TT=2911.72

UNSAT
TT=4288.48

? (TO)
TT=5000.08

UNSAT
TT=3949.8

? (TO)
TT=5000.01

UNSAT
TT=4239.39

No dataUNSAT
TT=4256.35

No dataNo dataUNSAT
TT=1014.8

UNSAT
TT=1010.41

UNSAT
TT=2245.49

No dataNo dataUNSAT
TT=968.957

? (TO)
TT=5000.01

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataUNSAT
TT=4987.71

No dataUNSAT
TT=5589.33

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataUNSAT
TT=738.98

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT02/industrial/aloul/
Homer/homer17.shuffled.cnf
UNSAT
TT=238.87

No dataUNSAT
TT=2095.06

UNSAT
TT=1793.48

No dataNo dataUNSAT
TT=861.096

No dataNo dataUNSAT
TT=2067.53

UNSAT
TT=1987.76

UNSAT
TT=2838.61

UNSAT
TT=2840.09

UNSAT
TT=238.87

No dataNo data? (TO)
TT=5000.11

UNSAT
TT=3130.6

? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

? (TO)
TT=5000.05

No data? (TO)
TT=5000.09

? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.12

? (TO)
TT=5000.12

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=17277.7

UNSAT
TT=22227.1

UNSAT
TT=2886.94

No dataNo dataUNSAT
TT=1083.56

? (TO)
TT=5000.01

? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=10476.5

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataUNSAT
TT=812.76

No dataNo dataNo dataNo dataNo data
SAT02/industrial/
biere/dinphil/
dp04s04.shuffled.cnf
SAT
TT=0.007

No data? (exit code)
TT=1.069

? (exit code)
TT=1.04

No dataNo dataSAT
TT=0.629

No dataNo dataSAT
TT=0.013

SAT
TT=0.012

SAT
TT=0.486

SAT
TT=0.309

SAT
TT=0.027

No dataNo dataSAT
TT=0.018

SAT
TT=0.016

SAT
TT=0.009

No dataSAT
TT=0.164

SAT
TT=0.164

No dataSAT
TT=0.01

SAT
TT=0.008

SAT
TT=0.008

SAT
TT=0.008

SAT
TT=0.009

SAT
TT=0.019

SAT
TT=0.008

No dataSAT
TT=0.072

No dataNo dataSAT
TT=0.075

SAT
TT=0.065

SAT
TT=0.035

No dataNo dataSAT
TT=0.049

SAT
TT=0.02

SAT
TT=0.007

No dataNo dataNo dataNo dataSAT
TT=0.016

No dataSAT
TT=0.031

No dataSAT
TT=0.051

No dataNo dataNo dataNo dataSAT
TT=2.888

No dataNo dataNo dataNo dataNo data
SAT02/industrial/
biere/dinphil/
dp04u03.shuffled.cnf
UNSAT
TT=0.006

No data? (exit code)
TT=0.962

? (exit code)
TT=0.885

No dataNo dataUNSAT
TT=0.536

No dataNo dataUNSAT
TT=0.01

UNSAT
TT=0.01

UNSAT
TT=0.385

UNSAT
TT=0.306

UNSAT
TT=0.02

No dataNo dataUNSAT
TT=0.013

UNSAT
TT=0.013

UNSAT
TT=0.007

No dataUNSAT
TT=0.052

UNSAT
TT=0.052

No dataUNSAT
TT=0.007

UNSAT
TT=0.006

UNSAT
TT=0.007

UNSAT
TT=0.007

UNSAT
TT=0.007

UNSAT
TT=0.013

UNSAT
TT=0.006

No dataUNSAT
TT=0.039

No dataNo dataUNSAT
TT=0.068

UNSAT
TT=0.221

UNSAT
TT=0.038

No dataNo dataUNSAT
TT=0.043

UNSAT
TT=0.012

UNSAT
TT=0.006

No dataNo dataNo dataNo dataUNSAT
TT=0.012

No dataUNSAT
TT=0.021

No dataUNSAT
TT=0.021

No dataNo dataNo dataNo dataUNSAT
TT=2.999

No dataNo dataNo dataNo dataNo data
SAT02/industrial/
biere/dinphil/
dp10s10.shuffled.cnf
SAT
TT=0.072

No dataSAT
TT=4.226

SAT
TT=3.282

No dataNo dataSAT
TT=2.246

No dataNo dataSAT
TT=0.282

Signal
TT=0.717

SAT
TT=3.92

SAT
TT=3.889

SAT
TT=1.6

No dataNo dataSAT
TT=0.331

SAT
TT=0.443

SAT
TT=0.118

No dataSAT
TT=0.857

SAT
TT=0.86

No dataSAT
TT=0.072

SAT
TT=0.095

SAT
TT=0.138

SAT
TT=0.166

SAT
TT=0.092

SAT
TT=0.111

SAT
TT=0.09

No dataSAT
TT=0.577

No dataNo dataSAT
TT=1.863

SAT
TT=2.225

SAT
TT=1.29

No dataNo dataSAT
TT=8.388

SAT
TT=0.169

SAT
TT=0.103

No dataNo dataNo dataNo dataSAT
TT=0.632

No dataSAT
TT=0.421

No dataSAT
TT=0.216

No dataNo dataNo dataNo dataSAT
TT=5.06

No dataNo dataNo dataNo dataNo data
SAT02/industrial/
dellacherie/comb/
comb1.shuffled.cnf
UNSAT
TT=72.738

No dataUNSAT
TT=465.321

UNSAT
TT=411.304

No dataNo dataUNSAT
TT=733.336

No dataNo dataUNSAT
TT=2609.39

UNSAT
TT=2738.56

UNSAT
TT=113.607

UNSAT
TT=100.495

UNSAT
TT=72.738

No dataNo dataUNSAT
TT=1789.44

? (TO)
TT=5000.04

UNSAT
TT=101.9

No data? (TO)
TT=5000.07

? (TO)
TT=5000.08

No dataUNSAT
TT=474.861

UNSAT
TT=4645.48

UNSAT
TT=396.665

UNSAT
TT=91.265

? (TO)
TT=5000.1

UNSAT
TT=4061.33

UNSAT
TT=738.814

No data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.8

UNSAT
TT=376.956

No dataNo dataUNSAT
TT=113.111

UNSAT
TT=4314.29

UNSAT
TT=317.286

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=20398.4

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataUNSAT
TT=552.03

No dataNo dataNo dataNo dataNo data
SAT02/industrial/goldberg/
fpga_routing/
vda_gr_rcs_w9.shuffled.cnf
SAT
TT=0.257

No dataSAT
TT=4.742

SAT
TT=4.669

No dataNo dataSAT
TT=4.657

No dataNo dataSAT
TT=0.883

SAT
TT=0.989

SAT
TT=3.328

SAT
TT=2.765

SAT
TT=0.257

No dataNo dataSAT
TT=0.447

SAT
TT=0.415

SAT
TT=0.353

No dataSAT
TT=1.968

SAT
TT=1.966

No dataSAT
TT=0.397

SAT
TT=0.381

SAT
TT=0.361

SAT
TT=0.373

SAT
TT=0.353

SAT
TT=0.402

SAT
TT=0.355

No dataSAT
TT=1.38

No dataNo dataSAT
TT=8.018

SAT
TT=8.15

SAT
TT=1.659

No dataNo dataSAT
TT=0.543

SAT
TT=0.484

SAT
TT=0.354

No dataNo dataNo dataNo dataSAT
TT=0.472

No dataSAT
TT=0.828

No dataSAT
TT=0.672

No dataNo dataNo dataNo dataSAT
TT=7.205

No dataNo dataNo dataNo dataNo data
SAT02/industrial/goldberg/
rand_net/
rand_net60-25-10.shuffled.cnf
UNSAT
TT=0.012

No dataUNSAT
TT=5.254

UNSAT
TT=4.901

No dataNo dataUNSAT
TT=2.416

No dataNo dataUNSAT
TT=2.227

UNSAT
TT=1.965

UNSAT
TT=7.815

UNSAT
TT=7.641

UNSAT
TT=1.415

No dataNo dataUNSAT
TT=0.612

UNSAT
TT=9.599

UNSAT
TT=1.049

No dataUNSAT
TT=0.824

UNSAT
TT=0.824

No dataUNSAT
TT=3.027

UNSAT
TT=10.114

UNSAT
TT=2.046

UNSAT
TT=1.552

UNSAT
TT=5.591

UNSAT
TT=9.787

UNSAT
TT=2.98

No dataUNSAT
TT=2.272

No dataNo dataUNSAT
TT=4.878

UNSAT
TT=4.965

UNSAT
TT=10.27

No dataNo dataUNSAT
TT=0.012

UNSAT
TT=12.536

UNSAT
TT=0.786

No dataNo dataNo dataNo dataUNSAT
TT=16.42

No dataUNSAT
TT=4.398

No dataUNSAT
TT=0.894

No dataNo dataNo dataNo dataUNSAT
TT=4.25

No dataNo dataNo dataNo dataNo data
SAT02/industrial/goldberg/
rand_net/
rand_net60-30-1.shuffled.cnf
UNSAT
TT=0.015

No dataUNSAT
TT=3.011

UNSAT
TT=2.735

No dataNo dataUNSAT
TT=1.485

No dataNo dataUNSAT
TT=0.301

UNSAT
TT=0.306

UNSAT
TT=11.187

UNSAT
TT=11.068

UNSAT
TT=1.119

No dataNo dataUNSAT
TT=0.202

UNSAT
TT=0.133

UNSAT
TT=0.101

No dataUNSAT
TT=0.737

UNSAT
TT=0.738

No dataUNSAT
TT=0.141

UNSAT
TT=0.11

UNSAT
TT=0.118

UNSAT
TT=0.098

UNSAT
TT=0.114

UNSAT
TT=0.113

UNSAT
TT=0.11

No dataUNSAT
TT=0.678

No dataNo dataUNSAT
TT=2.429

UNSAT
TT=2.76

UNSAT
TT=0.757

No dataNo dataUNSAT
TT=0.015

UNSAT
TT=0.14

UNSAT
TT=0.118

No dataNo dataNo dataNo dataUNSAT
TT=0.16

No dataUNSAT
TT=0.334

No dataUNSAT
TT=0.189

No dataNo dataNo dataNo dataUNSAT
TT=4.34

No dataNo dataNo dataNo dataNo data
SAT02/industrial/goldberg/
rand_net/
rand_net60-40-10.shuffled.cnf
UNSAT
TT=0.018

No dataUNSAT
TT=64.152

UNSAT
TT=55.953

No dataNo dataUNSAT
TT=95.624

No dataNo dataUNSAT
TT=311.48

UNSAT
TT=284.869

UNSAT
TT=47.169

UNSAT
TT=44.714

UNSAT
TT=8.364

No dataNo dataUNSAT
TT=62.671

UNSAT
TT=406.553

UNSAT
TT=64.348

No dataUNSAT
TT=5.777

UNSAT
TT=5.763

No dataUNSAT
TT=104.717

UNSAT
TT=687.703

UNSAT
TT=273.454

UNSAT
TT=17.298

UNSAT
TT=1284.07

UNSAT
TT=480.185

UNSAT
TT=1489.34

No dataUNSAT
TT=318.09

No dataNo dataUNSAT
TT=30.995

UNSAT
TT=31.778

UNSAT
TT=134.799

No dataNo dataUNSAT
TT=0.018

UNSAT
TT=514.315

UNSAT
TT=46.903

No dataNo dataNo dataNo dataUNSAT
TT=943.391

No dataUNSAT
TT=277.677

No dataUNSAT
TT=25.7

No dataNo dataNo dataNo dataUNSAT
TT=14.14

No dataNo dataNo dataNo dataNo data
SAT02/industrial/goldberg/
rand_net/
rand_net70-60-10.shuffled.cnf
UNSAT
TT=0.028

No dataUNSAT
TT=270.266

UNSAT
TT=237.491

No dataNo dataUNSAT
TT=725.804

No dataNo dataUNSAT
TT=781.999

UNSAT
TT=407.595

UNSAT
TT=140.529

UNSAT
TT=133.27

UNSAT
TT=37.697

No dataNo dataUNSAT
TT=248.336

? (TO)
TT=5000.07

UNSAT
TT=149.912

No dataUNSAT
TT=67.243

UNSAT
TT=66.919

No dataUNSAT
TT=349.02

UNSAT
TT=4505.24

UNSAT
TT=1872.04

UNSAT
TT=102.536

UNSAT
TT=4916.24

UNSAT
TT=2187.46

UNSAT
TT=938.594

No dataUNSAT
TT=1156.63

No dataNo dataUNSAT
TT=343.298

UNSAT
TT=316.631

UNSAT
TT=889.042

No dataNo dataUNSAT
TT=0.028

? (TO)
TT=5000.07

UNSAT
TT=102.587

No dataNo dataNo dataNo dataUNSAT
TT=1656.48

No dataUNSAT
TT=1676.57

No dataUNSAT
TT=348.11

No dataNo dataNo dataNo dataUNSAT
TT=437.88

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT02/industrial/nam/fpga-routing/
k2fix_gr_rcs_w8.shuffled.cnf
UNSAT
TT=4.63

No dataUNSAT
TT=43.905

UNSAT
TT=41.809

No dataNo dataUNSAT
TT=11.812

No dataNo dataUNSAT
TT=18986.5

UNSAT
TT=36367.4

? (TO)
TT=40000.6

? (TO)
TT=40000.4

? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.05

UNSAT
TT=2318.75

? (TO)
TT=5000.01

No dataUNSAT
TT=20.917

UNSAT
TT=19.006

No data? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.09

? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (TO)
TT=5000.11

No dataUNSAT
TT=4.63

No dataNo dataUNSAT
TT=31.546

UNSAT
TT=31.538

UNSAT
TT=31.64

No dataNo data? (TO)
TT=5000.11

? (TO)
TT=5000.13

? (TO)
TT=5000.08

No dataNo dataNo dataNo data? (TO)
TT=5000

No dataUNSAT
TT=3012.87

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataUNSAT
TT=444.9

No dataNo dataNo dataNo dataNo data
SAT02/industrial/nam/fpga-routing/
k2fix_gr_rcs_w9.shuffled.cnf
UNSAT
TT=39.874

No dataUNSAT
TT=778.858

UNSAT
TT=538.691

No dataNo dataUNSAT
TT=601.802

No dataNo dataUNSAT
TT=176.738

UNSAT
TT=160.987

UNSAT
TT=3837.25

UNSAT
TT=3927.15

UNSAT
TT=1787.46

No dataNo dataUNSAT
TT=1567.79

UNSAT
TT=410.857

UNSAT
TT=39.874

No dataUNSAT
TT=243.956

UNSAT
TT=267.932

No dataUNSAT
TT=85.797

UNSAT
TT=44.347

UNSAT
TT=238.698

UNSAT
TT=69.014

UNSAT
TT=109.331

UNSAT
TT=44.545

UNSAT
TT=110.579

No dataUNSAT
TT=84.224

No dataNo dataUNSAT
TT=340.672

UNSAT
TT=340.449

UNSAT
TT=354.86

No dataNo dataUNSAT
TT=1022.94

UNSAT
TT=62.657

UNSAT
TT=164.549

No dataNo dataNo dataNo dataUNSAT
TT=1809

No dataUNSAT
TT=125.905

No dataUNSAT
TT=120.071

No dataNo dataNo dataNo dataUNSAT
TT=145.76

No dataNo dataNo dataNo dataNo data
SAT03/handmade/anton/SAT/
SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf
SAT
TT=1.355

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

SAT
TT=3600.42

SAT
TT=11769.7

No data? (TO)
TT=40000.6

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2053.41

No dataNo dataSAT
TT=1164.35

No dataSAT
TT=289.672

SAT
TT=1.572

SAT
TT=1.501

SAT
TT=1450.72

? (TO)
TT=5000.07

No dataSAT
TT=400.485

SAT
TT=604.253

? (TO)
TT=40001

? (TO)
TT=5000.07

SAT
TT=4914.62

No dataNo dataNo dataNo dataNo dataSAT
TT=2169.2

No dataNo dataSAT
TT=38.168

SAT
TT=28.43

SAT
TT=1.355

SAT
TT=5.755

No dataSAT
TT=1066.95

No data
SAT03/handmade/anton/UNSAT/
SGI_30_50_30_20_1-log.shuffled-as.sat03-107.cnf
UNSAT
TT=949.86

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

UNSAT
TT=12960.7

UNSAT
TT=15567.4

No data? (TO)
TT=40000.3

? (TO)
TT=5000.03

No dataNo dataNo dataUNSAT
TT=2133.3

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=1329.43

No dataUNSAT
TT=4802.17

? (TO)
TT=40000.2

? (TO)
TT=5000.04

UNSAT
TT=8430.92

? (TO)
TT=5000.13

No dataUNSAT
TT=4859.18

? (TO)
TT=5000.1

UNSAT
TT=9314.29

UNSAT
TT=1565.15

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.14

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=949.86

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No data? (TO)
TT=5000.1

No data
SAT03/handmade/anton/UNSAT/
SGI_30_50_30_20_3-log.shuffled-as.sat03-109.cnf
UNSAT
TT=1952.87

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2386.85

UNSAT
TT=27309.4

UNSAT
TT=20926.8

No data? (TO)
TT=40000.9

? (TO)
TT=5000.06

No dataNo dataNo dataUNSAT
TT=4121.23

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=3393.79

No dataUNSAT
TT=13176.8

? (TO)
TT=40000.4

? (TO)
TT=5000.1

UNSAT
TT=12662.7

? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

? (TO)
TT=5000.11

UNSAT
TT=27223

UNSAT
TT=4978.11

UNSAT
TT=2302.28

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.2

No dataNo data? (TO)
TT=5000.06

UNSAT
TT=1952.87

? (TO)
TT=5000.05

? (TO)
TT=5000.08

No data? (TO)
TT=5000.09

No data
SAT03/handmade/anton/UNSAT/
SGI_30_50_30_20_5-log.shuffled-as.sat03-111.cnf
UNSAT
TT=1606.57

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2450.6

UNSAT
TT=23825.9

UNSAT
TT=22080.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo dataUNSAT
TT=4293.71

No dataUNSAT
TT=8293.17

? (TO)
TT=40000.1

? (TO)
TT=5000.03

UNSAT
TT=16115.2

? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

? (TO)
TT=5000.08

UNSAT
TT=28031.9

UNSAT
TT=4281.81

UNSAT
TT=2105.99

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.05

No dataNo data? (TO)
TT=5000.08

UNSAT
TT=1606.57

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.11

No data
SAT03/handmade/anton/UNSAT/
SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
UNSAT
TT=1745.74

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1745.74

UNSAT
TT=4078.34

UNSAT
TT=4061.74

No dataUNSAT
TT=36297.7

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.4

UNSAT
TT=32234.5

? (TO)
TT=5000.04

? (TO)
TT=20400

? (TO)
TT=5000.08

No data? (TO)
TT=5000.1

? (TO)
TT=5000.13

? (TO)
TT=40001.2

? (TO)
TT=5000.11

UNSAT
TT=2420.91

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.08

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=4578.95

? (TO)
TT=5000.1

? (TO)
TT=5000.09

No data? (TO)
TT=5000.14

No data
SAT03/handmade/anton/UNSAT/
SGI_30_60_24_40_2-log.shuffled-as.sat03-119.cnf
UNSAT
TT=2742.7

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3403.32

UNSAT
TT=38789.3

UNSAT
TT=36488.7

No data? (TO)
TT=40000.3

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=3803.24

No data? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=5000.09

? (TO)
TT=20399.9

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.15

? (TO)
TT=40000.7

? (TO)
TT=5000.03

UNSAT
TT=3161.18

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.59

No dataNo data? (TO)
TT=5000.01

UNSAT
TT=2742.7

? (TO)
TT=5000.07

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

No data
SAT03/handmade/anton/UNSAT/
SGI_30_60_28_40_7-log.shuffled-as.sat03-127.cnf
UNSAT
TT=2451.79

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=30929.7

? (TO)
TT=40001.3

No data? (TO)
TT=40000.6

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=40000.9

? (TO)
TT=40000.5

? (TO)
TT=5000.07

? (TO)
TT=20399.9

? (TO)
TT=5000.13

No data? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=40000.9

? (TO)
TT=5000.08

UNSAT
TT=4047

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=2451.79

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.07

No data
SAT03/handmade/anton/UNSAT/
SGI_30_60_29_30_6-dir.shuffled-as.sat03-130.cnf
UNSAT
TT=2182.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2182.13

UNSAT
TT=6178.3

UNSAT
TT=6502.24

No data? (TO)
TT=40001

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40001

? (TO)
TT=40000.1

? (TO)
TT=5000.1

? (TO)
TT=20400

? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

? (TO)
TT=5000.09

? (TO)
TT=40001.2

? (TO)
TT=5000.04

UNSAT
TT=2790.3

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.9

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.03

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No data? (TO)
TT=5000.13

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf
UNSAT
TT=870.448

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4841.06

UNSAT
TT=11294.3

UNSAT
TT=11071

No data? (TO)
TT=40000.8

? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.5

UNSAT
TT=23060.2

? (TO)
TT=5000.01

? (TO)
TT=20398.5

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

? (TO)
TT=5000.1

? (exit code)
TT=10723.6

? (TO)
TT=5000.04

UNSAT
TT=4173.5

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.02

No dataNo data? (TO)
TT=5000.04

UNSAT
TT=3643.28

? (TO)
TT=5000.08

? (TO)
TT=5000.05

No dataUNSAT
TT=870.448

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
UNSAT
TT=3885.47

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=35698.9

UNSAT
TT=32837.5

No data? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.7

? (TO)
TT=40000.1

? (TO)
TT=5000

? (TO)
TT=20399.9

? (TO)
TT=5000.12

No data? (TO)
TT=5000.04

? (TO)
TT=5000.13

? (TO)
TT=40000.5

? (TO)
TT=5000.02

UNSAT
TT=3885.47

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.41

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=4105.05

? (TO)
TT=5000.06

? (TO)
TT=5000.07

No data? (TO)
TT=5000.13

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_18_80_10-dir.shuffled-as.sat03-140.cnf
UNSAT
TT=3019.17

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3019.17

UNSAT
TT=6804.14

UNSAT
TT=6661.66

No data? (TO)
TT=40000.8

? (TO)
TT=5000.14

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=5000.1

? (TO)
TT=20400.1

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (exit code)
TT=7582.99

? (TO)
TT=5000.11

UNSAT
TT=3153.33

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.82

No dataNo data? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_19_80_8-log.shuffled-as.sat03-143.cnf
UNSAT
TT=1801.9

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2338.39

UNSAT
TT=19508.7

UNSAT
TT=17913.2

No data? (TO)
TT=40000.5

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=2657.34

No data? (TO)
TT=40000.7

UNSAT
TT=26953.8

? (TO)
TT=5000.09

? (TO)
TT=20400.3

? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

? (TO)
TT=5000.15

UNSAT
TT=33096

UNSAT
TT=4526.03

UNSAT
TT=1801.9

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.96

No dataNo data? (TO)
TT=5000.11

UNSAT
TT=1853.46

? (TO)
TT=5000.09

? (TO)
TT=5000.07

No data? (TO)
TT=5000.11

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_20_60_10-dir.shuffled-as.sat03-144.cnf
UNSAT
TT=917.673

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=917.673

UNSAT
TT=1695.74

UNSAT
TT=1768.45

No dataUNSAT
TT=31302.8

? (TO)
TT=5000.13

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=40000.5

UNSAT
TT=12873.8

? (TO)
TT=5000.02

? (TO)
TT=20399.8

? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (exit code)
TT=39508.7

? (TO)
TT=5000.06

UNSAT
TT=1121.82

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.47

No dataNo data? (TO)
TT=5000.05

UNSAT
TT=2306.21

? (TO)
TT=5000.04

? (TO)
TT=5000.09

No dataUNSAT
TT=3470.12

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_20_70_1-dir.shuffled-as.sat03-146.cnf
UNSAT
TT=2999.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2999.01

UNSAT
TT=6855.65

UNSAT
TT=6845.06

No data? (TO)
TT=40001

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.8

UNSAT
TT=34884.7

? (TO)
TT=5000.09

? (TO)
TT=20400.3

? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (exit code)
TT=39247.8

? (TO)
TT=5000.11

UNSAT
TT=3483.8

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.22

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.01

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No data? (TO)
TT=5000.29

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_21_60_7-log.shuffled-as.sat03-151.cnf
UNSAT
TT=4393.03

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=35710.2

? (TO)
TT=40000.7

No data? (TO)
TT=40000.8

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40001

? (TO)
TT=40000.2

? (TO)
TT=5000.07

? (TO)
TT=20400

? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=40000.7

? (TO)
TT=5000.07

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.13

No dataNo data? (TO)
TT=5000.01

UNSAT
TT=4393.03

? (TO)
TT=5000.1

? (TO)
TT=5000.1

No data? (TO)
TT=5000.11

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
UNSAT
TT=17173

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.13

UNSAT
TT=15450

UNSAT
TT=17173

No data? (TO)
TT=40000.8

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40001

? (TO)
TT=40000.7

? (TO)
TT=5000.01

? (TO)
TT=20399.9

? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

? (TO)
TT=5000.13

? (exit code)
TT=32938.6

? (TO)
TT=5000.09

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.96

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.11

? (TO)
TT=5000.09

? (TO)
TT=5000.04

No data? (TO)
TT=5000.14

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf
UNSAT
TT=3288.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3288.15

UNSAT
TT=9930.4

UNSAT
TT=10260.1

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.6

? (TO)
TT=40000.3

? (TO)
TT=5000.03

? (TO)
TT=20400.2

? (TO)
TT=5000.1

No data? (TO)
TT=5000.12

? (TO)
TT=5000.05

? (TO)
TT=40000.9

? (TO)
TT=5000.1

UNSAT
TT=3761.2

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.69

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No data? (TO)
TT=5000.1

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_26_60_1-dir.shuffled-as.sat03-167.cnf
UNSAT
TT=3495.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3495.12

UNSAT
TT=9061.58

UNSAT
TT=9734.49

No data? (TO)
TT=40000.6

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=40000.7

? (TO)
TT=40000.7

? (TO)
TT=5000.01

? (TO)
TT=20399.9

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

? (TO)
TT=40001.1

? (TO)
TT=5000.03

UNSAT
TT=4286.18

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.12

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No data? (TO)
TT=5000.31

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT03/handmade/anton/UNSAT/
SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf
UNSAT
TT=3709.53

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3709.53

UNSAT
TT=10150.5

UNSAT
TT=10273.7

No data? (TO)
TT=40000.6

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.5

? (TO)
TT=40000.3

? (TO)
TT=5000.07

? (TO)
TT=20399.9

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

? (TO)
TT=5000.1

? (TO)
TT=40001.1

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.63

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.05

? (TO)
TT=5000.07

? (TO)
TT=5000.07

No data? (TO)
TT=5000.11

No data
SAT03/handmade/anton/UNSAT/
SGI_30_70_29_50_3-dir.shuffled-as.sat03-179.cnf
UNSAT
TT=2304

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2304

UNSAT
TT=6628.44

UNSAT
TT=6504.81

No data? (TO)
TT=40000.3

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.8

? (TO)
TT=40000.1

? (TO)
TT=5000.07

? (TO)
TT=20399.5

? (TO)
TT=5000.11

No data? (TO)
TT=5000.07

? (TO)
TT=5000.1

? (TO)
TT=40001.3

? (TO)
TT=5000.08

UNSAT
TT=2995.66

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.26

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.1

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.16

No data
SAT03/handmade/anton/UNSAT/
SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=26307.9

? (TO)
TT=40000.4

No data? (TO)
TT=40000.9

? (TO)
TT=5000.04

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.5

? (TO)
TT=40000.7

? (TO)
TT=5000.02

? (TO)
TT=20400

? (TO)
TT=5000.1

No data? (TO)
TT=5000.09

? (TO)
TT=5000.12

? (TO)
TT=40001.2

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.63

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No data
SAT03/handmade/anton/UNSAT/
SGI_30_80_28_70_8-dir.shuffled-as.sat03-215.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=35681.8

? (TO)
TT=40001

No data? (TO)
TT=40000.5

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=40000.8

? (TO)
TT=40000.3

? (TO)
TT=5000.09

? (TO)
TT=20399.6

? (TO)
TT=5000.12

No data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=40000.5

? (TO)
TT=5000.08

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.86

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.03

? (TO)
TT=5000.1

? (TO)
TT=5000.04

No data? (TO)
TT=5000.15

No data
SAT03/handmade/bevan/
cnf/
marg3x3add8ch.shuffled-as.sat03-1448.cnf
UNSAT
TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.622

UNSAT
TT=6.503

UNSAT
TT=7.005

No dataUNSAT
TT=5.877

UNSAT
TT=0.717

No dataNo dataNo dataUNSAT
TT=1.127

No dataUNSAT
TT=15.127

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4.207

No dataNo dataUNSAT
TT=1.412

No dataUNSAT
TT=3.608

UNSAT
TT=0.013

UNSAT
TT=0.006

UNSAT
TT=15.236

UNSAT
TT=0.972

No dataUNSAT
TT=10.481

UNSAT
TT=13.872

UNSAT
TT=2.744

UNSAT
TT=2.226

UNSAT
TT=3.654

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo dataUNSAT
TT=4.394

UNSAT
TT=3.65

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataUNSAT
TT=0.079

No data
SAT03/handmade/bevan/
cnf/
marg3x3add8.shuffled-as.sat03-1449.cnf
UNSAT
TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.392

UNSAT
TT=2.213

UNSAT
TT=2.588

No dataUNSAT
TT=2.438

UNSAT
TT=0.626

No dataNo dataNo dataUNSAT
TT=0.232

No dataUNSAT
TT=4.255

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.118

No dataNo dataUNSAT
TT=0.433

No dataUNSAT
TT=1.31

UNSAT
TT=0.011

UNSAT
TT=0.207

UNSAT
TT=9.071

UNSAT
TT=0.144

No dataUNSAT
TT=3.545

UNSAT
TT=7.519

UNSAT
TT=0.932

UNSAT
TT=1.171

UNSAT
TT=1.181

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.001

No dataNo dataUNSAT
TT=0.318

UNSAT
TT=3.54

? (TO)
TT=5000.08

? (TO)
TT=5000.01

No dataUNSAT
TT=0.084

No data
SAT03/handmade/gomes/
bqwh/
bqwh.50.825.shuffled-as.sat03-1648.cnf
SAT
TT=2.048

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

? (TO)
TT=40000.7

? (TO)
TT=40001

No data? (TO)
TT=40000.6

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40001.1

? (TO)
TT=40000.4

? (TO)
TT=5000.09

? (TO)
TT=20399.4

? (TO)
TT=5000.12

No data? (TO)
TT=5000.07

? (TO)
TT=5000.05

? (TO)
TT=40000.7

? (TO)
TT=5000.08

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.78

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.05

? (TO)
TT=5000.03

SAT
TT=2.048

No data? (TO)
TT=5000.15

No data
SAT03/handmade/gomes/
bqwh/
bqwh.60.1152.shuffled-as.sat03-1650.cnf
SAT
TT=373.939

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=40001.1

? (TO)
TT=40000.8

No data? (TO)
TT=40000.7

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.12

No data? (TO)
TT=40000.7

? (TO)
TT=40000.1

? (TO)
TT=5000.05

? (TO)
TT=20399.7

? (TO)
TT=5000.07

No data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=40000.5

? (TO)
TT=5000.1

? (TO)
TT=5000.13

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.16

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=5000.08

? (TO)
TT=5000.04

SAT
TT=373.939

No data? (TO)
TT=5000.14

No data
SAT03/handmade/markstrom/
UNSATISFIABLE/
mm-2x2-6-6-s.1.shuffled-as.sat03-1499.cnf
UNSAT
TT=180.703

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=249.728

UNSAT
TT=1092.45

UNSAT
TT=1237.03

No dataUNSAT
TT=1279.39

UNSAT
TT=220.304

No dataNo dataNo dataUNSAT
TT=180.703

No dataUNSAT
TT=811.96

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=779.072

No dataNo dataUNSAT
TT=668.692

No dataUNSAT
TT=3814.46

UNSAT
TT=1536.02

UNSAT
TT=560.517

UNSAT
TT=19453.2

UNSAT
TT=357.729

No dataUNSAT
TT=491.307

UNSAT
TT=913.427

UNSAT
TT=1938.54

UNSAT
TT=247.666

UNSAT
TT=349.052

No dataNo dataNo dataNo dataNo dataUNSAT
TT=198.166

No dataNo data? (TO)
TT=5000.05

UNSAT
TT=567.94

? (TO)
TT=5000.11

? (TO)
TT=5000.07

No dataUNSAT
TT=386.236

No data
SAT03/handmade/stanion/hwb/
hwb-n28-01-S136611085.shuffled-as.sat03-1627.cnf
UNSAT
TT=668.579

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1425.93

UNSAT
TT=6833.87

UNSAT
TT=5682.26

No dataUNSAT
TT=26836.3

UNSAT
TT=3542.45

No dataNo dataNo dataUNSAT
TT=2233.22

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2522.91

No dataNo dataUNSAT
TT=668.579

No data? (TO)
TT=40000.9

UNSAT
TT=15572.9

? (TO)
TT=5000.04

? (TO)
TT=20400.4

UNSAT
TT=2685.32

No data? (TO)
TT=5000.04

? (TO)
TT=5000.21

? (TO)
TT=40000.7

UNSAT
TT=1493.43

UNSAT
TT=1611.88

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1898.7

No dataNo data? (TO)
TT=5000.07

UNSAT
TT=1467.24

? (TO)
TT=5000.08

? (TO)
TT=5000.07

No data? (TO)
TT=5000.09

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT03/handmade/stanion/hwb/
hwb-n28-02-S818962541.shuffled-as.sat03-1628.cnf
UNSAT
TT=1325.32

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2878.73

UNSAT
TT=12472.4

UNSAT
TT=13176.6

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3593.5

No dataNo dataUNSAT
TT=1325.32

No data? (TO)
TT=40001.1

UNSAT
TT=31596.4

? (TO)
TT=5000.01

? (TO)
TT=20400.3

? (TO)
TT=5000.07

No data? (TO)
TT=5000.06

? (TO)
TT=5000.24

? (TO)
TT=40000.6

UNSAT
TT=2569.33

UNSAT
TT=2703.76

No dataNo dataNo dataNo dataNo dataUNSAT
TT=4299.27

No dataNo data? (TO)
TT=5000.02

UNSAT
TT=1711.16

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No data
SAT03/handmade/stanion/hwb/
hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
UNSAT
TT=3326.88

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

UNSAT
TT=38801.5

UNSAT
TT=36727.4

No data? (TO)
TT=40000.8

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=3326.88

No data? (TO)
TT=40000.3

? (TO)
TT=40000.6

? (TO)
TT=5000.02

? (TO)
TT=20400.3

? (TO)
TT=5000.1

No data? (TO)
TT=5000.07

? (TO)
TT=5000.23

? (TO)
TT=40000.7

? (TO)
TT=5000.06

? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.45

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=3978.58

? (TO)
TT=5000.05

? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

No data
SAT03/handmade/stanion/hwb/
hwb-n32-02-S1478512323.shuffled-as.sat03-1638.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40000.2

? (TO)
TT=40000.5

No data? (TO)
TT=40000.3

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40000.4

? (TO)
TT=40000.6

? (TO)
TT=5000.04

? (TO)
TT=20400

? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

? (TO)
TT=5000.21

? (TO)
TT=40000.5

? (TO)
TT=5000.06

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.03

? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

No data
SAT03/industrial/goldberg/
hard_eq_check/
c6288mul.miter.shuffled-as.sat03-346.cnf
UNSAT
TT=195.02

No dataUNSAT
TT=1604.3

UNSAT
TT=2280.92

No dataNo dataUNSAT
TT=2146.85

No dataNo data? (TO)
TT=35694.2

? (TO)
TT=40000.8

UNSAT
TT=426.865

UNSAT
TT=386.561

UNSAT
TT=294.396

No dataNo dataUNSAT
TT=2841.33

UNSAT
TT=3240.88

UNSAT
TT=326.513

No data? (TO)
TT=5000.1

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

? (TO)
TT=5000.06

? (TO)
TT=5000.04

UNSAT
TT=2794.29

? (TO)
TT=5000.07

? (TO)
TT=5000.02

? (TO)
TT=5000.05

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.7

? (TO)
TT=40001.1

UNSAT
TT=1262.38

No dataNo dataUNSAT
TT=195.02

? (TO)
TT=5000.09

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataUNSAT
TT=3288.45

No data? (TO)
TT=20396.7

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=428

No dataNo dataNo dataNo dataNo data
SAT03/industrial/goldberg/hard_eq_check/
k2mul.miter.shuffled-as.sat03-355.cnf
UNSAT
TT=1129.19

No dataUNSAT
TT=27321.7

UNSAT
TT=21373.1

No dataNo data? (TO)
TT=5000.02

No dataNo dataUNSAT
TT=16266.1

UNSAT
TT=11635.7

UNSAT
TT=3318.17

UNSAT
TT=3151.28

UNSAT
TT=2178.73

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=1129.19

UNSAT
TT=1132.9

No dataUNSAT
TT=1838.21

UNSAT
TT=1828.6

No data? (TO)
TT=5000.05

UNSAT
TT=3097.03

? (TO)
TT=5000.06

UNSAT
TT=4636.38

? (TO)
TT=5000.06

UNSAT
TT=2764.68

? (TO)
TT=5000.07

No data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=13603.3

UNSAT
TT=15473.7

UNSAT
TT=19895.8

No dataNo dataUNSAT
TT=1614.2

? (TO)
TT=5000.08

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataUNSAT
TT=2534.82

No dataUNSAT
TT=7166.17

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataUNSAT
TT=3392.6

No dataNo dataNo dataNo dataNo data
SAT03/industrial/goldberg/hard_eq_check/
x1mul.miter.shuffled-as.sat03-359.cnf
UNSAT
TT=622.811

No dataUNSAT
TT=8374.4

UNSAT
TT=8964.94

No dataNo dataUNSAT
TT=3984.74

No dataNo dataUNSAT
TT=25831.5

UNSAT
TT=29357.2

UNSAT
TT=1513.68

UNSAT
TT=1670.02

UNSAT
TT=1407.63

No dataNo data? (TO)
TT=5000.06

UNSAT
TT=1051.47

UNSAT
TT=622.811

No dataUNSAT
TT=1421.05

UNSAT
TT=1553.69

No dataUNSAT
TT=4124.27

UNSAT
TT=2923.67

? (TO)
TT=5000.05

UNSAT
TT=1935.46

? (TO)
TT=5000.06

UNSAT
TT=3094.52

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

No dataNo dataUNSAT
TT=8264.05

UNSAT
TT=8597.09

UNSAT
TT=5548.19

No dataNo dataUNSAT
TT=841.157

? (TO)
TT=5000.05

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataUNSAT
TT=1532.2

No dataUNSAT
TT=9955.02

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataUNSAT
TT=1436.93

No dataNo dataNo dataNo dataNo data
SAT03/industrial/kukula/
addm_bench/
am_7_7.shuffled-as.sat03-363.cnf



No data? (TO)
TT=40000.8

?
TT=39029.4

No dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=35663.4

? (TO)
TT=40000.5

? (TO)
TT=40001

? (TO)
TT=40000.7

? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.01

? (TO)
TT=5000.04

No data? (TO)
TT=5000.08

? (TO)
TT=5000.02

No data? (TO)
TT=5000.1

? (TO)
TT=5000.08

? (TO)
TT=5000.08

? (TO)
TT=5000.08

? (TO)
TT=5000.07

? (TO)
TT=5000.01

? (TO)
TT=5000.09

No data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=40000.3

? (TO)
TT=40000.5

? (TO)
TT=40000.6

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.01

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=20398.5

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data
SAT03/industrial/li/
li-exam/
li-exam-61.shuffled-as.sat03-366.cnf



No data? (TO)
TT=40000.9

?
TT=39816

No dataNo data? (TO)
TT=5000.02

No dataNo data? (TO)
TT=35793.4

? (TO)
TT=40001.5

? (TO)
TT=40001.1

? (TO)
TT=40000.6

? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.04

? (TO)
TT=5000.04

No data? (TO)
TT=5000.12

? (TO)
TT=5000.12

No data? (TO)
TT=5000.05

? (TO)
TT=5000.11

? (TO)
TT=5000.1

? (TO)
TT=5000.09

? (TO)
TT=5000.07

? (TO)
TT=5000.08

? (TO)
TT=5000.07

No data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40001.2

? (TO)
TT=40001.1

? (TO)
TT=40000.3

No dataNo data? (TO)
TT=5000.17

? (TO)
TT=5000.07

? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=20394.6

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo data
SAT03/industrial/li/
li-test4/
li-test4-100.shuffled-as.sat03-370.cnf



No data? (TO)
TT=40000.4

?
TT=39786.6

No dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=40001.9

? (TO)
TT=40001.2

? (TO)
TT=40000.9

? (TO)
TT=40001.6

? (TO)
TT=5000.14

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.01

? (TO)
TT=5000.06

No data? (TO)
TT=5000.11

? (TO)
TT=5000.13

No data? (TO)
TT=5000.11

? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.1

? (TO)
TT=5000.17

? (TO)
TT=5000.05

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

No dataNo dataSignal
TT=29329.1

? (TO)
TT=40000.8

? (TO)
TT=40000.5

No dataNo data? (TO)
TT=5000.17

? (TO)
TT=5000.07

? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000

No data? (TO)
TT=20392.6

No data? (TO)
TT=5000.16

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
SAT03/industrial/maris/
CNF/
gripper13u.shuffled-as.sat03-395.cnf
UNSAT
TT=1519.95

No data? (TO)
TT=40000.8

?
TT=39800.6

No dataNo data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=22211.2

? (TO)
TT=40000.4

? (TO)
TT=40000.9

? (TO)
TT=40001

? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.07

UNSAT
TT=2801.15

? (TO)
TT=5000.12

No dataUNSAT
TT=1524.75

UNSAT
TT=1519.95

No dataUNSAT
TT=4653.3

? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=5000.11

? (TO)
TT=5000.03

? (TO)
TT=5000.02

? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=15587.2

UNSAT
TT=16885.7

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.01

? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No data? (TO)
TT=20397.6

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT03/industrial/schuppan/l2s/
bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf
UNSAT
TT=911.704

No data? (MO)
TT=20458.8

UNSAT
TT=13383.5

No dataNo data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=3992.66

UNSAT
TT=3947.75

UNSAT
TT=10083.4

UNSAT
TT=10859.9

UNSAT
TT=2263.05

No dataNo dataUNSAT
TT=1143.73

UNSAT
TT=971.123

UNSAT
TT=1032.84

No dataUNSAT
TT=920.037

UNSAT
TT=911.704

No dataUNSAT
TT=1484.19

UNSAT
TT=1300.57

UNSAT
TT=1733.93

UNSAT
TT=1203.13

UNSAT
TT=921.39

UNSAT
TT=1412.6

UNSAT
TT=1477.67

No dataUNSAT
TT=1428.65

No dataNo dataUNSAT
TT=4301.45

UNSAT
TT=4420.07

UNSAT
TT=7845.43

No dataNo dataUNSAT
TT=1734.96

UNSAT
TT=1070.6

UNSAT
TT=1006.87

No dataNo dataNo dataNo dataUNSAT
TT=1583.89

No dataUNSAT
TT=2855.8

No dataUNSAT
TT=1126.09

No dataNo dataNo dataNo dataUNSAT
TT=3577.6

No dataNo dataNo dataNo dataNo data
SAT03/industrial/schuppan/l2s/
dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf



No data? (MO)
TT=22802.6

? (MO)
TT=19652.2

No dataNo data? (TO)
TT=5000.01

No dataNo data? (TO)
TT=33264.8

? (TO)
TT=37890.9

? (TO)
TT=40000.6

? (TO)
TT=40000.9

? (TO)
TT=5000.23

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.09

? (TO)
TT=5000.1

No data? (TO)
TT=5000.14

? (TO)
TT=5000.16

No data? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.1

? (TO)
TT=5000.1

? (TO)
TT=5000.02

? (TO)
TT=5000.13

No data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=40001.1

? (TO)
TT=40000.9

? (TO)
TT=40000.2

No dataNo data? (TO)
TT=5000.17

? (TO)
TT=5000.01

? (TO)
TT=5000.13

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (TO)
TT=20376

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
SAT03/industrial/schuppan/l2s/
valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf
UNSAT
TT=1644.38

No data? (MO)
TT=13007

? (MO)
TT=17793.6

No dataNo data? (TO)
TT=5000.1

No dataNo dataUNSAT
TT=18837.5

UNSAT
TT=19347

UNSAT
TT=30129.5

UNSAT
TT=26458

? (TO)
TT=5000.17

No dataNo dataUNSAT
TT=2700.48

UNSAT
TT=1728.61

UNSAT
TT=1923.74

No dataUNSAT
TT=3834.2

UNSAT
TT=3814.38

No dataUNSAT
TT=2113.68

UNSAT
TT=2207.56

UNSAT
TT=1804.09

UNSAT
TT=1644.38

UNSAT
TT=2172.16

UNSAT
TT=1816.85

UNSAT
TT=2119.35

No dataUNSAT
TT=2590.18

No dataNo dataUNSAT
TT=29519.1

UNSAT
TT=29627.2

UNSAT
TT=20335.6

No dataNo data? (TO)
TT=5000.22

UNSAT
TT=2858.29

UNSAT
TT=2049.9

No dataNo dataNo dataNo dataUNSAT
TT=3174.17

No dataUNSAT
TT=5227.39

No dataUNSAT
TT=2483.3

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
SAT03/industrial/simon/sat02/
6pipe_6_ooo.shuffled-as.sat03-413.cnf
UNSAT
TT=19.086

No dataUNSAT
TT=371.431

UNSAT
TT=366.547

No dataNo dataUNSAT
TT=170.101

No dataNo dataWrong Cert.
TT=27.474

UNSAT
TT=80.244

UNSAT
TT=323.276

UNSAT
TT=286.927

UNSAT
TT=49.252

No dataNo dataUNSAT
TT=58.202

UNSAT
TT=80.174

UNSAT
TT=19.738

No dataUNSAT
TT=37.312

UNSAT
TT=37.412

No dataUNSAT
TT=21.201

UNSAT
TT=81.709

UNSAT
TT=45.997

UNSAT
TT=19.086

UNSAT
TT=48.48

UNSAT
TT=59.626

UNSAT
TT=44.796

No dataUNSAT
TT=117.627

No dataNo dataUNSAT
TT=252.116

UNSAT
TT=241.861

UNSAT
TT=283.227

No dataNo dataUNSAT
TT=44.543

UNSAT
TT=377.015

UNSAT
TT=35.536

No dataNo dataNo dataNo dataUNSAT
TT=115.935

No dataUNSAT
TT=126.651

No dataUNSAT
TT=39.608

No dataNo dataNo dataNo dataUNSAT
TT=89.85

No dataNo dataNo dataNo dataNo data
SAT04/handmade/andrew/composite/
Composite-024BitPrimes-1.used-as.sat04-861.cnf
SAT
TT=11.485

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=152.598

SAT
TT=61.876

SAT
TT=151.197

No dataSAT
TT=482.54

SAT
TT=169.966

No dataNo dataNo dataSAT
TT=119.222

No dataSAT
TT=105.651

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=494.407

No dataNo dataSAT
TT=50.12

No dataSAT
TT=72.575

SAT
TT=788.175

SAT
TT=322.281

SAT
TT=921.509

SAT
TT=538.547

No dataSAT
TT=17.389

SAT
TT=317.627

SAT
TT=122.759

SAT
TT=138.543

SAT
TT=352.28

No dataNo dataNo dataNo dataNo dataSAT
TT=45.609

No dataNo dataSAT
TT=11.485

SAT
TT=86.64

? (TO)
TT=5000.12

? (TO)
TT=5000.09

No dataSAT
TT=659.564

No data
SAT04/handmade/anton/l4k4/
lksat-n900-m6174-k4-l4-s819398222.used-as.sat04-929.cnf
SAT
TT=0.108

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.492

SAT
TT=1.084

SAT
TT=2.196

No dataSAT
TT=0.61

SAT
TT=5.13

No dataNo dataNo dataSAT
TT=1.159

No dataSAT
TT=2.339

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.632

No dataNo dataSAT
TT=1.213

No dataSAT
TT=1.726

SAT
TT=0.842

SAT
TT=0.295

SAT
TT=2.066

SAT
TT=0.782

No dataSAT
TT=2.955

SAT
TT=0.31

SAT
TT=0.426

SAT
TT=2.208

SAT
TT=0.887

No dataNo dataNo dataNo dataNo dataSAT
TT=1.182

No dataNo dataSAT
TT=2.048

SAT
TT=6.15

SAT
TT=0.171

SAT
TT=0.108

No dataSAT
TT=2.097

No data
SAT04/handmade/anton/l5k3/
lksat-n1100-m4103-k3-l5-s558351420.used-as.sat04-934.cnf
SAT
TT=0.035

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.41

SAT
TT=9.563

SAT
TT=34.589

No dataSAT
TT=44.047

SAT
TT=434.783

No dataNo dataNo dataSAT
TT=6.665

No dataSAT
TT=74.188

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1.439

No dataNo dataSAT
TT=49.883

No dataSAT
TT=259.808

SAT
TT=0.334

SAT
TT=0.124

SAT
TT=18.376

SAT
TT=357.023

No dataSAT
TT=174.923

SAT
TT=6.675

SAT
TT=5.568

SAT
TT=29.893

SAT
TT=2.977

No dataNo dataNo dataNo dataNo dataSAT
TT=0.474

No dataNo dataSAT
TT=13.172

SAT
TT=24.031

SAT
TT=0.035

SAT
TT=0.078

No dataSAT
TT=4.655

No data
SAT04/handmade/anton/l5k3/
lksat-n900-m3357-k3-l5-s950595579.used-as.sat04-938.cnf
SAT
TT=0.017

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.886

SAT
TT=0.835

SAT
TT=2.121

No dataSAT
TT=3.33

SAT
TT=7.7

No dataNo dataNo dataSAT
TT=13.974

No dataSAT
TT=20.141

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=6.862

No dataNo dataSAT
TT=5.834

No dataSAT
TT=2.155

SAT
TT=0.068

SAT
TT=0.028

SAT
TT=63.856

SAT
TT=2.077

No dataSAT
TT=3.8

SAT
TT=4.198

SAT
TT=0.891

SAT
TT=6.148

SAT
TT=1.406

No dataNo dataNo dataNo dataNo dataSAT
TT=0.296

No dataNo dataSAT
TT=43.038

SAT
TT=17.85

SAT
TT=0.018

SAT
TT=0.017

No dataSAT
TT=0.137

No data
SAT04/handmade/connamacher/connm-d-0.02/
connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf
SAT
TT=1595.59

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

? (TO)
TT=35680.7

? (TO)
TT=40000.9

No data? (TO)
TT=40000.5

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.02

No dataSAT
TT=4401.74

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.11

No dataSAT
TT=8566.9

? (TO)
TT=40000.1

? (MO)
TT=3048.79

? (TO)
TT=20397.6

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=40000.5

SAT
TT=1595.59

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.06

? (TO)
TT=5000.11

? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

No data
SAT04/handmade/connamacher/connm-d0.02/
connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf
UNSAT
TT=2315.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3422.92

UNSAT
TT=11895.4

UNSAT
TT=11205.7

No dataUNSAT
TT=15836.3

UNSAT
TT=4934.29

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2315.09

No dataNo dataUNSAT
TT=3045.55

No dataUNSAT
TT=22807.4

UNSAT
TT=30895.7

? (TO)
TT=5000.04

? (TO)
TT=20400.3

UNSAT
TT=4326.04

No data? (TO)
TT=5000.12

? (TO)
TT=5000.11

? (TO)
TT=40000.9

? (TO)
TT=5000.03

UNSAT
TT=2907.76

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.68

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No data? (TO)
TT=5000.06

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT04/handmade/connamacher/connm-d0.04/
connm-ue-csp-sat-n800-d0.04-s1788334438.used-as.sat04-976.cnf
UNSAT
TT=4759.42

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=4937.59

UNSAT
TT=18234.3

UNSAT
TT=18321.8

No data? (TO)
TT=40000.7

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=40000.7

? (TO)
TT=40000.3

? (TO)
TT=5000.06

? (TO)
TT=20400.4

? (TO)
TT=5000.12

No data? (TO)
TT=5000.04

? (TO)
TT=5000.07

? (TO)
TT=40000.6

? (TO)
TT=5000.03

UNSAT
TT=4759.42

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.81

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No data
SAT04/handmade/hirsch03/
hgen8-n320-01-S1432474240.shuffled-as.sat03-890.used-as.sat04-841.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

? (TO)
TT=40000.8

? (TO)
TT=40000.3

No data? (TO)
TT=40000.3

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.3

? (TO)
TT=40000.6

? (TO)
TT=5000.06

? (TO)
TT=20400

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

? (TO)
TT=5000.03

? (TO)
TT=40000.8

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.91

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000

? (TO)
TT=5000.05

? (TO)
TT=5000.03

No data? (TO)
TT=5000.12

No data
SAT04/handmade/kexu/
frb-0.6/
frb75-13-2.used-as.sat04-878.cnf
SAT
TT=1.072

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2387.11

SAT
TT=7372.27

SAT
TT=11085.5

No data? (TO)
TT=40001.1

? (TO)
TT=5000.11

No dataNo dataNo dataSAT
TT=3146.33

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4810.2

No dataNo dataSAT
TT=1631.34

No dataSAT
TT=28979.9

SAT
TT=7.86

SAT
TT=3.357

? (TO)
TT=20400.4

? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=40000.8

SAT
TT=3519.77

SAT
TT=3824.28

No dataNo dataNo dataNo dataNo dataSAT
TT=3835.62

No dataNo data? (TO)
TT=5000.04

SAT
TT=25.432

SAT
TT=1.072

SAT
TT=2.275

No data? (TO)
TT=5000.11

No data
SAT04/handmade/kexu/
frb-0.6/
frb80-14-2.used-as.sat04-880.cnf
SAT
TT=3.836

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3573.69

SAT
TT=15518.1

SAT
TT=19318.5

No data? (TO)
TT=40000.6

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=434.004

SAT
TT=21.42

SAT
TT=11.474

? (TO)
TT=20400

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

? (TO)
TT=5000.06

? (TO)
TT=40000.8

? (TO)
TT=5000.09

SAT
TT=3382.81

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.11

No dataNo data? (TO)
TT=5000.07

SAT
TT=27.83

SAT
TT=3.836

SAT
TT=156.148

No data? (TO)
TT=5000.11

No data
SAT04/handmade/kexu/
frb-0.8/
frb45-21-1.used-as.sat04-883.cnf
SAT
TT=3.096

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=1025.24

SAT
TT=9817.32

SAT
TT=669.284

No dataSAT
TT=19437.3

SAT
TT=698.776

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataSAT
TT=2777.26

No data? (TO)
TT=40000.7

SAT
TT=35.285

SAT
TT=3.096

? (TO)
TT=20400

SAT
TT=3128.69

No data? (TO)
TT=5000.12

SAT
TT=400.12

SAT
TT=3604.46

? (TO)
TT=5000.04

SAT
TT=1737.43

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.66

No dataNo data? (TO)
TT=5000.05

SAT
TT=370.54

SAT
TT=25.077

SAT
TT=42.523

No dataSAT
TT=234.997

No data
SAT04/handmade/kexu/
frb-0.8/
frb59-26-1.used-as.sat04-891.cnf
SAT
TT=502.369

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=35794.4

? (TO)
TT=40001.4

No data? (TO)
TT=40000.4

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40000.7

SAT
TT=502.369

? (TO)
TT=5000.08

? (TO)
TT=20399.4

? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

? (TO)
TT=5000.07

? (TO)
TT=40001

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.4

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000

SAT
TT=3328.84

? (TO)
TT=5000.02

No data? (TO)
TT=5000.13

No data
SAT04/handmade/kexu/
frb-0.8/
frb59-26-2.used-as.sat04-892.cnf



No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=35745.8

? (TO)
TT=40001.5

No data? (TO)
TT=40001

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40001

? (TO)
TT=40000.5

? (TO)
TT=5000.01

? (TO)
TT=20399.6

? (TO)
TT=5000.11

No data? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=40000.6

? (TO)
TT=5000.07

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.62

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.08

? (TO)
TT=5000.12

? (TO)
TT=5000.02

No data? (TO)
TT=5000.16

No data
SAT04/handmade/marijn/
equilarge-l/
equilarge_l2.used-as.sat04-894.cnf
UNSAT
TT=930.14

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=35729.1

? (TO)
TT=40001

No data? (TO)
TT=40001

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.9

UNSAT
TT=5114.38

? (TO)
TT=5000.01

? (TO)
TT=20400.1

? (TO)
TT=5000.05

No data? (TO)
TT=5000.04

? (TO)
TT=5000.18

? (TO)
TT=40001.1

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1603.22

No dataNo data? (TO)
TT=5000.04

UNSAT
TT=930.14

? (TO)
TT=5000.04

? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

No data
SAT04/handmade/marijn/
equilarge-l/
equilarge_l4.used-as.sat04-896.cnf
UNSAT
TT=821.55

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40001

? (TO)
TT=40000.4

No data? (TO)
TT=40000.5

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.03

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40001

UNSAT
TT=5000.35

? (TO)
TT=5000.09

? (TO)
TT=20400.2

? (TO)
TT=5000.14

No data? (TO)
TT=5000.04

? (TO)
TT=5000.16

? (TO)
TT=40000.5

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1402.88

No dataNo data? (TO)
TT=5000.08

UNSAT
TT=821.55

? (TO)
TT=5000.08

? (TO)
TT=5000.02

No data? (TO)
TT=5000.04

No data
SAT04/industrial/
hoonsang/vis-bmc/
all.used-as.sat04-986.cnf
UNSAT
TT=13.467

No dataUNSAT
TT=165.239

UNSAT
TT=166.696

No dataNo dataUNSAT
TT=34.641

No dataNo dataUNSAT
TT=136.659

UNSAT
TT=133.882

UNSAT
TT=140.8

UNSAT
TT=145.088

UNSAT
TT=22.347

No dataNo dataUNSAT
TT=31.746

UNSAT
TT=20.386

UNSAT
TT=15.239

No dataUNSAT
TT=13.712

UNSAT
TT=13.467

No dataUNSAT
TT=38.264

UNSAT
TT=35.132

UNSAT
TT=48.073

UNSAT
TT=62.602

UNSAT
TT=28.753

UNSAT
TT=24.788

UNSAT
TT=36.574

No dataUNSAT
TT=33.738

No dataNo dataUNSAT
TT=88.307

UNSAT
TT=89.208

UNSAT
TT=166.706

No dataNo dataUNSAT
TT=50.817

UNSAT
TT=49.786

UNSAT
TT=30.303

No dataNo dataNo dataNo dataUNSAT
TT=29.006

No dataUNSAT
TT=51.598

No dataUNSAT
TT=33.535

No dataNo dataNo dataNo dataUNSAT
TT=56.92

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT04/industrial/
hoonsang/vis-bmc/
dekker.used-as.sat04-989.cnf
UNSAT
TT=3.686

No dataUNSAT
TT=54.54

UNSAT
TT=63.174

No dataNo dataUNSAT
TT=10.143

No dataNo dataUNSAT
TT=11.473

UNSAT
TT=23.114

UNSAT
TT=80.911

UNSAT
TT=90.788

UNSAT
TT=15.715

No dataNo dataUNSAT
TT=10.252

UNSAT
TT=8.034

UNSAT
TT=3.686

No dataUNSAT
TT=3.994

UNSAT
TT=3.994

No dataUNSAT
TT=10.251

UNSAT
TT=79.386

UNSAT
TT=8.735

UNSAT
TT=17.438

UNSAT
TT=26.079

UNSAT
TT=10.396

UNSAT
TT=25.57

No dataUNSAT
TT=33.587

No dataNo dataUNSAT
TT=27.236

UNSAT
TT=28.789

UNSAT
TT=59.449

No dataNo dataUNSAT
TT=5.436

UNSAT
TT=10.696

UNSAT
TT=11.565

No dataNo dataNo dataNo dataUNSAT
TT=5.433

No dataUNSAT
TT=22.418

No dataUNSAT
TT=14.597

No dataNo dataNo dataNo dataUNSAT
TT=27.15

No dataNo dataNo dataNo dataNo data
SAT04/industrial/vangelder/
cnf-color/
abb313GPIA-9-c.used-as.sat04-317.cnf
SAT
TT=17.037

No dataSAT
TT=578.703

SAT
TT=952.118

No dataNo data? (TO)
TT=5000.09

No dataNo dataSAT
TT=11015.9

SAT
TT=6949.39

? (TO)
TT=40000.9

? (TO)
TT=40000.8

? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000

? (TO)
TT=5000.07

? (TO)
TT=5000.05

No dataSAT
TT=1506.52

SAT
TT=1363.5

No data? (TO)
TT=5000.06

? (TO)
TT=5000.08

? (TO)
TT=5000.05

? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.03

? (TO)
TT=5000.06

No data? (TO)
TT=5000.04

No dataNo dataSAT
TT=545.705

SAT
TT=5346.67

? (TO)
TT=40000.4

No dataNo data? (TO)
TT=5000.11

? (TO)
TT=5000.04

? (TO)
TT=5000.1

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20390

No dataSAT
TT=17.037

No dataNo dataNo dataNo dataSAT
TT=97.23

No dataNo dataNo dataNo dataNo data
SAT04/industrial/vangelder/
cnf-color/
abb313GPIA-9-tr.used-as.sat04-321.cnf
SAT
TT=1.405

No dataSAT
TT=16.72

SAT
TT=18.985

No dataNo dataSAT
TT=13.843

No dataNo dataSAT
TT=3.548

SAT
TT=2.953

? (TO)
TT=40000.3

? (TO)
TT=40001.1

? (TO)
TT=5000.06

No dataNo dataSAT
TT=1.818

SAT
TT=1122.56

SAT
TT=2.555

No dataSAT
TT=4.898

SAT
TT=4.697

No dataSAT
TT=1.803

SAT
TT=8.512

SAT
TT=1.454

SAT
TT=1.669

SAT
TT=1.406

SAT
TT=1.725

SAT
TT=1.405

No dataSAT
TT=11.277

No dataNo dataSAT
TT=37.876

SAT
TT=38.011

SAT
TT=4.8

No dataNo data? (TO)
TT=5000.08

SAT
TT=154.708

SAT
TT=2.481

No dataNo dataNo dataNo dataSAT
TT=2583.51

No dataSAT
TT=3.856

No dataSAT
TT=1.464

No dataNo dataNo dataNo dataSAT
TT=41.65

No dataNo dataNo dataNo dataNo data
SAT04/industrial/vangelder/
cnf-color/
myciel6-tr.used-as.sat04-320.cnf
UNSAT
TT=518.252

No data? (TO)
TT=40000.6

?
TT=39819.9

No dataNo data? (TO)
TT=5000.03

No dataNo dataWrong Cert.
TT=476.19

UNSAT
TT=518.252

UNSAT
TT=20093.8

UNSAT
TT=20514.2

UNSAT
TT=4573.78

No dataNo data? (TO)
TT=5000.01

UNSAT
TT=4269.69

? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

? (TO)
TT=5000.05

No data? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No dataUNSAT
TT=965.272

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.9

UNSAT
TT=1329.95

No dataNo dataUNSAT
TT=4021.42

? (TO)
TT=5000.03

? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=20399.7

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo data
SAT04/industrial/velev/
pipe-sat-1-1/
12pipe_bug4_q0.used-as.sat04-723.cnf
SAT
TT=15.319

No dataSAT
TT=206.245

SAT
TT=202.67

No dataNo dataSAT
TT=223.102

No dataNo dataSAT
TT=29.188

SAT
TT=45.286

SAT
TT=220.751

SAT
TT=203.783

SAT
TT=71.161

No dataNo dataSAT
TT=44.82

SAT
TT=202.105

SAT
TT=50.343

No dataSAT
TT=43.455

SAT
TT=43.076

No dataSAT
TT=49.662

SAT
TT=44.502

SAT
TT=43.156

SAT
TT=42.283

SAT
TT=52.93

SAT
TT=16.346

SAT
TT=52.789

No dataSAT
TT=15.319

No dataNo dataSAT
TT=24.132

SAT
TT=22.484

SAT
TT=100.784

No dataNo dataSAT
TT=232.207

SAT
TT=65.914

SAT
TT=41.392

No dataNo dataNo dataNo dataSAT
TT=168.253

No dataSAT
TT=23.093

No dataSAT
TT=45.485

No dataNo dataNo dataNo dataSAT
TT=186.24

No dataNo dataNo dataNo dataNo data
SAT04/industrial/velev/
pipe-sat-1-1/
12pipe_bug6_q0.used-as.sat04-725.cnf
SAT
TT=16.588

No dataSAT
TT=194.896

SAT
TT=199.94

No dataNo dataSAT
TT=177.755

No dataNo dataSignal
TT=495.129

SAT
TT=36.433

SAT
TT=221.847

SAT
TT=221.777

SAT
TT=23.754

No dataNo dataSAT
TT=25.514

SAT
TT=76.118

SAT
TT=46.391

No dataSAT
TT=18.362

SAT
TT=18.322

No dataSAT
TT=43.383

SAT
TT=45.722

SAT
TT=44.535

SAT
TT=39.91

SAT
TT=41.512

SAT
TT=17.519

SAT
TT=41.529

No dataSAT
TT=16.588

No dataNo dataSAT
TT=22.263

SAT
TT=23.092

SAT
TT=62.118

No dataNo dataSAT
TT=47.787

SAT
TT=19.469

SAT
TT=39.919

No dataNo dataNo dataNo dataSAT
TT=204.17

No dataSAT
TT=25.761

No dataSAT
TT=34.974

No dataNo dataNo dataNo dataSAT
TT=167.36

No dataNo dataNo dataNo dataNo data
SAT04/industrial/velev/
vliw_unsat_2.0/
9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf
UNSAT
TT=326.479

No dataUNSAT
TT=7341.85

UNSAT
TT=7783.9

No dataNo dataUNSAT
TT=2723.58

No dataNo dataUNSAT
TT=7459.16

UNSAT
TT=8859.66

UNSAT
TT=4514.89

UNSAT
TT=4765.92

UNSAT
TT=598.394

No dataNo dataUNSAT
TT=2686.32

UNSAT
TT=719.008

UNSAT
TT=933.356

No dataUNSAT
TT=811.835

UNSAT
TT=720.348

No dataUNSAT
TT=3062.96

? (TO)
TT=5000.11

? (TO)
TT=5000.22

UNSAT
TT=326.479

? (TO)
TT=5000.24

? (TO)
TT=5000.02

? (TO)
TT=5000.2

No data? (TO)
TT=5000.07

No dataNo dataUNSAT
TT=6802.93

UNSAT
TT=7041.92

UNSAT
TT=8228.9

No dataNo dataUNSAT
TT=724.46

? (TO)
TT=5000.03

? (TO)
TT=5000.14

No dataNo dataNo dataNo dataUNSAT
TT=1570.1

No data? (exit code)
TT=3128.06

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo dataUNSAT
TT=1243.54

No dataNo dataNo dataNo dataNo data
SAT04/industrial/velev/
vliw_unsat_2.0/
9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
UNSAT
TT=935.02

No data? (MO)
TT=5636.46

? (MO)
TT=5143.23

No dataNo data? (MO)
TT=2077.01

No dataNo dataUNSAT
TT=23488.1

UNSAT
TT=18435.3

UNSAT
TT=13822

UNSAT
TT=13957.3

UNSAT
TT=1691.58

No dataNo data? (TO)
TT=5000.02

UNSAT
TT=1774.78

UNSAT
TT=1728.79

No dataUNSAT
TT=1822.45

UNSAT
TT=1816.28

No data? (TO)
TT=5000.27

? (TO)
TT=5000.12

? (TO)
TT=5000.23

UNSAT
TT=935.02

? (TO)
TT=5000.31

? (TO)
TT=5000.05

? (TO)
TT=5000.23

No dataUNSAT
TT=2741.88

No dataNo dataUNSAT
TT=19273

UNSAT
TT=18349.7

UNSAT
TT=17237.1

No dataNo dataUNSAT
TT=1775.87

? (TO)
TT=5000.03

? (TO)
TT=5000.15

No dataNo dataNo dataNo dataUNSAT
TT=4746.19

No data? (exit code)
TT=2530.24

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo data
SAT04/industrial/velev/
vliw_unsat_2.0/
9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf
UNSAT
TT=1144.59

No data? (MO)
TT=4513.4

? (MO)
TT=4549.97

No dataNo data? (MO)
TT=1941.81

No dataNo data? (TO)
TT=28966.4

? (TO)
TT=33276.3

UNSAT
TT=18155.6

UNSAT
TT=17402.9

UNSAT
TT=2432.68

No dataNo data? (TO)
TT=5000.04

UNSAT
TT=2648.1

UNSAT
TT=2176.51

No dataUNSAT
TT=2650.06

UNSAT
TT=2654.56

No data? (TO)
TT=5000.36

? (TO)
TT=5000.14

? (TO)
TT=5000.29

UNSAT
TT=1144.59

? (TO)
TT=5000.35

? (TO)
TT=5000.01

? (TO)
TT=5000.24

No dataUNSAT
TT=3091.14

No dataNo dataUNSAT
TT=25557.9

UNSAT
TT=24123.3

? (MO)
TT=16506.3

No dataNo dataUNSAT
TT=3632.55

? (TO)
TT=5000.01

? (TO)
TT=5000.15

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (exit code)
TT=2461.95

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-220-3.shuffled-as.sat05-2490.cnf
SAT
TT=64.57

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=394.413

SAT
TT=146.194

SAT
TT=685.204

No dataSAT
TT=541.664

SAT
TT=655.927

No dataNo dataNo dataSAT
TT=64.57

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2186.14

No dataNo data? (TO)
TT=5000.04

No dataSAT
TT=1388.72

SAT
TT=3174.58

SAT
TT=1189.06

SAT
TT=3057.75

SAT
TT=188.834

No dataSAT
TT=90.57

? (TO)
TT=5000.18

SAT
TT=7166.1

SAT
TT=278.078

SAT
TT=938.346

No dataNo dataNo dataNo dataNo dataSAT
TT=316.197

No dataNo data? (TO)
TT=5000.09

SAT
TT=1088.56

? (TO)
TT=5000.03

? (TO)
TT=5000.08

No data? (TO)
TT=5000.11

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-230-3.shuffled-as.sat05-2505.cnf
SAT
TT=21.665

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=402.362

SAT
TT=438.319

SAT
TT=380.551

No dataSAT
TT=2489.19

SAT
TT=293.097

No dataNo dataNo dataSAT
TT=514.556

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataNo data? (TO)
TT=5000.11

No dataSAT
TT=924.489

SAT
TT=931.72

? (TO)
TT=5000.01

SAT
TT=21.665

SAT
TT=567.829

No dataSAT
TT=669.988

? (TO)
TT=5000.13

SAT
TT=7863.9

? (TO)
TT=5000.09

SAT
TT=3112.66

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.78

No dataNo data? (TO)
TT=5000.02

SAT
TT=127.92

? (TO)
TT=5000.07

? (TO)
TT=5000.1

No data? (TO)
TT=5000.18

No data
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-240-2.shuffled-as.sat05-2519.cnf
SAT
TT=153.203

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=153.203

SAT
TT=4816.21

SAT
TT=728.202

No dataSAT
TT=23561.3

SAT
TT=3294.03

No dataNo dataNo dataSAT
TT=2395.21

No data? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.05

No dataSAT
TT=252.496

SAT
TT=1617.25

SAT
TT=4984.03

SAT
TT=5977.81

SAT
TT=1943.87

No dataSAT
TT=3357.33

? (TO)
TT=5000.11

SAT
TT=23461.2

SAT
TT=1594.24

SAT
TT=1648.23

No dataNo dataNo dataNo dataNo dataSAT
TT=1760.55

No dataNo data? (TO)
TT=5000.11

SAT
TT=3646.83

? (TO)
TT=5000.11

? (TO)
TT=5000.09

No data? (TO)
TT=5000.09

No data
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520.cnf
SAT
TT=543.832

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3962.38

SAT
TT=293.84

SAT
TT=621.562

No dataSAT
TT=1144.29

SAT
TT=661.551

No dataNo dataNo dataSAT
TT=1923

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=4220.26

No dataNo data? (TO)
TT=5000.03

No dataSAT
TT=2052.34

SAT
TT=2563.07

SAT
TT=1032.94

? (TO)
TT=20400.4

SAT
TT=543.832

No dataSAT
TT=864.317

? (TO)
TT=5000.19

SAT
TT=3470.66

SAT
TT=4060.58

SAT
TT=2673.69

No dataNo dataNo dataNo dataNo dataSAT
TT=4935.21

No dataNo data? (TO)
TT=5000.08

SAT
TT=1091.96

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No data? (TO)
TT=5000.13

No data
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-250-1.shuffled-as.sat05-2533.cnf
SAT
TT=155.124

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3494.53

SAT
TT=1311.35

SAT
TT=7833.37

No dataSAT
TT=1108.59

SAT
TT=155.124

No dataNo dataNo dataSAT
TT=2542.63

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.08

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=2374.2

SAT
TT=5856.7

? (TO)
TT=5000.02

? (TO)
TT=20400.5

SAT
TT=4204.52

No dataSAT
TT=585.98

? (TO)
TT=5000.15

SAT
TT=16712.8

SAT
TT=1406.36

SAT
TT=4047.86

No dataNo dataNo dataNo dataNo dataSAT
TT=1545.61

No dataNo data? (TO)
TT=5000.07

SAT
TT=584.24

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No data? (TO)
TT=5000.07

No data
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-250-2.shuffled-as.sat05-2534.cnf
SAT
TT=173.21

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=173.21

SAT
TT=657.969

SAT
TT=1508.62

No dataSAT
TT=2418.08

SAT
TT=668.36

No dataNo dataNo dataSAT
TT=3569.42

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.11

No dataSAT
TT=7264.49

SAT
TT=4787.55

SAT
TT=4006.29

? (TO)
TT=20400.3

SAT
TT=2001.55

No dataSAT
TT=1009.15

? (TO)
TT=5000.15

SAT
TT=6173.5

SAT
TT=1213.55

SAT
TT=4375.33

No dataNo dataNo dataNo dataNo dataSAT
TT=1452.1

No dataNo data? (TO)
TT=5000.01

SAT
TT=1140.84

? (TO)
TT=5000.05

? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

No data
SAT05/crafted/jarvisalo05/
mod2c-rand3bip-sat/
mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535.cnf
SAT
TT=135.159

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3892

SAT
TT=4053.94

SAT
TT=1353.33

No dataSAT
TT=487.541

SAT
TT=855.848

No dataNo dataNo dataSAT
TT=1868.42

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.06

No dataSAT
TT=2476.94

SAT
TT=15390.8

? (TO)
TT=5000.02

? (TO)
TT=20400.5

SAT
TT=135.159

No dataSAT
TT=264.845

? (TO)
TT=5000.2

? (TO)
TT=40000.7

SAT
TT=2332.63

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo dataSAT
TT=2567.93

No dataNo data? (TO)
TT=5000.01

SAT
TT=1278.89

? (TO)
TT=5000.12

? (TO)
TT=5000.09

No data? (TO)
TT=5000.07

No data
SAT05/crafted/jarvisalo05/
mod2-rand3bip-sat/
mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
SAT
TT=0.006

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

SAT
TT=3220.88

SAT
TT=37733.2

No data? (TO)
TT=40000.4

? (TO)
TT=5000.05

No dataNo dataNo data? (TO)
TT=5000.07

No dataSAT
TT=3471.53

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.006

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.9

SAT
TT=0.085

? (TO)
TT=5000.02

? (TO)
TT=20399.8

? (TO)
TT=5000.12

No dataSAT
TT=505.182

? (TO)
TT=5000.17

? (TO)
TT=40000.4

? (TO)
TT=5000.02

? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataSAT
TT=0.007

No dataNo data? (TO)
TT=5000.05

SAT
TT=155.996

? (TO)
TT=5000.08

? (TO)
TT=5000.11

No data? (TO)
TT=5000.13

No data
SAT05/crafted/lynce05/
social-golfer-problem/
sgp_5-6-8.shuffled-as.sat05-2669.cnf
SAT
TT=3276.36

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

SAT
TT=34059.6

SAT
TT=3276.36

No data? (TO)
TT=40000.9

? (TO)
TT=5000.12

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40001

? (TO)
TT=40000.8

? (TO)
TT=5000.09

? (TO)
TT=20397.7

SAT
TT=3392.63

No data? (TO)
TT=5000.08

? (TO)
TT=5000.15

? (TO)
TT=40000.9

SAT
TT=3687.92

? (TO)
TT=5000.15

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.3

No dataNo data? (TO)
TT=5000.05

SAT
TT=3555.14

? (TO)
TT=5000.09

? (TO)
TT=5000.09

No data? (TO)
TT=5000.11

No data
SAT05/crafted/markstrom05/eulcbip/
eulcbip-7-UNSAT.shuffled-as.sat05-3936.cnf
UNSAT
TT=0.083

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=30578.2

? (TO)
TT=40000.3

No data? (TO)
TT=40000.5

? (TO)
TT=5000.11

No dataNo dataNo data? (TO)
TT=5000.11

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.083

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40001

? (TO)
TT=40000.4

? (TO)
TT=5000.06

? (TO)
TT=20400.1

? (TO)
TT=5000.13

No data? (TO)
TT=5000.1

? (TO)
TT=5000.26

? (TO)
TT=40001

? (TO)
TT=5000.03

? (TO)
TT=5000.1

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4999.03

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.05

? (TO)
TT=5000.11

? (TO)
TT=5000.06

No data? (TO)
TT=5000.12

No data
SAT05/crafted/roussel05/visbmc-PHNF/
phnf-size10-exclusive-philo.used-as.sat04-988.shuffled-as.sat05-4195.cnf
UNSAT
TT=2174.06

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40001.8

? (TO)
TT=40001.3

No dataUNSAT
TT=5212.99

? (TO)
TT=5000.09

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=5000.03

No dataUNSAT
TT=10128.9

? (TO)
TT=40000.5

? (TO)
TT=5000.02

? (TO)
TT=20384.9

? (TO)
TT=5000.15

No data? (TO)
TT=5000.09

? (TO)
TT=5000.1

UNSAT
TT=2174.06

? (TO)
TT=5000.13

? (TO)
TT=5000.12

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.7

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.07

? (TO)
TT=5000.14

? (TO)
TT=5000.1

No data? (TO)
TT=5000.13

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT05/crafted/sabharwal05/counting/
fphp/unsat/harder/
fphp-020-019.shuffled-as.sat05-1232.cnf
UNSAT
TT=2.087

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

? (TO)
TT=40000.5

? (TO)
TT=40000.7

No data? (TO)
TT=40000.8

? (TO)
TT=5000.06

No dataNo dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40000.4

? (TO)
TT=40000.2

? (TO)
TT=5000.05

? (TO)
TT=20399.2

? (TO)
TT=5000.12

No data? (TO)
TT=5000.11

? (TO)
TT=5000.09

? (TO)
TT=40001.2

? (TO)
TT=5000.09

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1019.69

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataUNSAT
TT=2.087

No data
SAT05/crafted/sabharwal05/counting/
fphp/unsat/harder/
fphp-030-029.shuffled-as.sat05-1234.cnf
UNSAT
TT=17.091

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=35669

? (TO)
TT=40001.1

No data? (TO)
TT=40000.8

? (TO)
TT=5000.08

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=40000.8

? (TO)
TT=40000.5

? (TO)
TT=5000.06

? (TO)
TT=20396.6

? (TO)
TT=5000.16

No data? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=40000.5

? (TO)
TT=5000.03

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.66

No dataNo data? (TO)
TT=5000.1

? (TO)
TT=2840.62

? (TO)
TT=5000.12

? (TO)
TT=5000.04

No dataUNSAT
TT=17.091

No data
SAT05/crafted/sabharwal05/counting/
php/unsat/easier/
php-010-008.shuffled-as.sat05-1171.cnf
UNSAT
TT=0.097

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.485

UNSAT
TT=1.187

UNSAT
TT=1.189

No dataUNSAT
TT=5.946

UNSAT
TT=1.314

No dataNo dataNo dataUNSAT
TT=0.863

No dataUNSAT
TT=1.272

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3.244

No dataNo dataUNSAT
TT=0.545

No dataUNSAT
TT=5.888

UNSAT
TT=0.877

UNSAT
TT=1.885

UNSAT
TT=9.027

UNSAT
TT=0.892

No dataUNSAT
TT=0.897

UNSAT
TT=1.894

UNSAT
TT=4.628

UNSAT
TT=0.486

UNSAT
TT=0.396

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.447

No dataNo dataUNSAT
TT=7.721

UNSAT
TT=4.03

? (TO)
TT=5000.03

? (TO)
TT=5000.05

No dataUNSAT
TT=0.097

No data
SAT05/crafted/sabharwal05/counting/
php/unsat/easier/
php-045-035.shuffled-as.sat05-1181.cnf
UNSAT
TT=44.479

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.1

? (TO)
TT=30716.1

? (TO)
TT=40000.9

No data? (TO)
TT=40000.7

? (TO)
TT=5000.17

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.06

No data? (TO)
TT=40001.4

? (TO)
TT=40000.2

? (TO)
TT=5000.09

? (TO)
TT=20397.5

? (TO)
TT=5000.16

No data? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=40000.8

? (TO)
TT=5000.09

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.72

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.1

? (TO)
TT=5000.06

? (TO)
TT=5000.04

No dataUNSAT
TT=44.479

No data
SAT05/crafted/sabharwal05/counting/
php/unsat/harder/
php-020-019.shuffled-as.sat05-1190.cnf
UNSAT
TT=1.584

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

? (TO)
TT=35631

? (TO)
TT=40000.3

No data? (TO)
TT=40000.4

? (TO)
TT=5000.07

No dataNo dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.07

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.9

? (TO)
TT=40000.7

? (TO)
TT=5000.05

? (TO)
TT=20400

? (TO)
TT=5000.11

No data? (TO)
TT=5000.08

? (TO)
TT=5000.04

? (TO)
TT=40000.8

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1476.57

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No dataUNSAT
TT=1.584

No data
SAT05/crafted/sabharwal05/counting/
php/unsat/harder/
php-040-039.shuffled-as.sat05-1194.cnf
UNSAT
TT=45.136

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.06

? (TO)
TT=40000.6

? (TO)
TT=40000.9

No data? (TO)
TT=40001.1

? (TO)
TT=5000.1

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40001.1

? (TO)
TT=40000.1

? (TO)
TT=5000.09

? (TO)
TT=20397.4

? (TO)
TT=5000.16

No data? (TO)
TT=5000.1

? (TO)
TT=5000.15

? (TO)
TT=40001.2

? (TO)
TT=5000.06

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.5

No dataNo data? (TO)
TT=5000.08

? (TO)
TT=5000

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No dataUNSAT
TT=45.136

No data
SAT05/crafted/sabharwal05/
ordering/gt-ordering/sat/
gt-030.shuffled-as.sat05-1295.cnf
UNSAT
TT=0.181

No dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.05

UNSAT
TT=503.656

UNSAT
TT=386.983

No dataUNSAT
TT=39.389

UNSAT
TT=16.843

No dataNo dataNo dataUNSAT
TT=2096.99

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=5000.04

No dataUNSAT
TT=1.599

UNSAT
TT=9.873

UNSAT
TT=885.49

UNSAT
TT=9.868

UNSAT
TT=106.546

No dataUNSAT
TT=521.945

UNSAT
TT=1.666

UNSAT
TT=7.667

? (TO)
TT=5000.03

? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataUNSAT
TT=18.615

No dataNo dataUNSAT
TT=0.181

UNSAT
TT=32.24

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No data? (TO)
TT=5000.16

No data
SAT05/crafted/sabharwal05/pebbling/
grid-pebbling/unsat/
grid-pbl-0250.shuffled-as.sat05-1349.shuffled-as.sat05-1349.cnf
UNSAT
TT=0.373

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.373

UNSAT
TT=0.393

UNSAT
TT=0.376

No dataUNSAT
TT=127.373

UNSAT
TT=9.079

No dataNo dataNo dataUNSAT
TT=1.174

No dataUNSAT
TT=312.498

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.77

No dataNo dataUNSAT
TT=396.935

No dataUNSAT
TT=26.294

UNSAT
TT=2.393

UNSAT
TT=1.319

UNSAT
TT=3.01

UNSAT
TT=30.268

No dataUNSAT
TT=0.433

UNSAT
TT=28.639

UNSAT
TT=93.554

UNSAT
TT=0.433

UNSAT
TT=0.401

No dataNo dataNo dataNo dataNo dataUNSAT
TT=5.404

No dataNo dataUNSAT
TT=1.202

UNSAT
TT=29.05

? (TO)
TT=5000.08

? (TO)
TT=5000.04

No data? (TO)
TT=5000.06

No data
SAT05/crafted/sabharwal05/planning/
logistics/unsat/
logistics-rotate-07t5.shuffled-as.sat05-1137.cnf
UNSAT
TT=0.519

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.951

UNSAT
TT=2.781

UNSAT
TT=3.581

No dataUNSAT
TT=5.716

UNSAT
TT=0.519

No dataNo dataNo dataUNSAT
TT=0.704

No dataUNSAT
TT=2.244

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1.793

No dataNo dataUNSAT
TT=0.618

No dataUNSAT
TT=2.851

UNSAT
TT=5.764

UNSAT
TT=1.878

UNSAT
TT=7.4

UNSAT
TT=1.289

No dataUNSAT
TT=1.028

UNSAT
TT=1.269

UNSAT
TT=23.976

UNSAT
TT=1.064

UNSAT
TT=1.415

No dataNo dataNo dataNo dataNo dataUNSAT
TT=5.57

No dataNo dataUNSAT
TT=3.176

UNSAT
TT=5.444

? (TO)
TT=5000.07

? (TO)
TT=5000.06

No dataUNSAT
TT=4.681

No data
SAT05/crafted/sorge05/QG6/
dead-dnd002.shuffled-as.sat05-2713.cnf
UNSAT
TT=11.702

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=19.57

UNSAT
TT=43.359

UNSAT
TT=43.127

No dataUNSAT
TT=38.383

UNSAT
TT=11.702

No dataNo dataNo dataUNSAT
TT=77.231

No dataUNSAT
TT=270.879

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=59.741

No dataNo dataUNSAT
TT=1327.41

No dataUNSAT
TT=925.561

UNSAT
TT=132.152

UNSAT
TT=45.311

UNSAT
TT=117.353

UNSAT
TT=30.842

No dataUNSAT
TT=38.518

UNSAT
TT=135.506

UNSAT
TT=54.454

UNSAT
TT=36.433

UNSAT
TT=21.228

No dataNo dataNo dataNo dataNo dataUNSAT
TT=59.581

No dataNo dataUNSAT
TT=28.546

UNSAT
TT=24.84

? (TO)
TT=5000.08

? (TO)
TT=5000.06

No dataUNSAT
TT=62.162

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT05/crafted/sorge05/
QG7a/
gensys-brn002.shuffled-as.sat05-3935.cnf
SAT
TT=0.338

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.553

SAT
TT=1.093

SAT
TT=1.234

No dataSAT
TT=4.953

SAT
TT=1.561

No dataNo dataNo dataSAT
TT=0.796

No dataSAT
TT=14.3

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=10.027

No dataNo dataSAT
TT=6.809

No dataSAT
TT=9.166

SAT
TT=13.39

SAT
TT=3.503

SAT
TT=6.202

SAT
TT=4.212

No dataSAT
TT=0.44

SAT
TT=0.662

SAT
TT=4.217

SAT
TT=0.338

SAT
TT=0.428

No dataNo dataNo dataNo dataNo dataSAT
TT=5.78

No dataNo dataSAT
TT=1.02

SAT
TT=15.34

SAT
TT=1.85

SAT
TT=2.244

No dataSAT
TT=8.116

No data
SAT05/crafted/sorge05/
QG7a/
gensys-icl005.shuffled-as.sat05-3826.cnf
UNSAT
TT=452.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=452.04

UNSAT
TT=1535.11

UNSAT
TT=1169.02

No dataUNSAT
TT=2110.78

UNSAT
TT=767.362

No dataNo dataNo dataUNSAT
TT=2057.36

No data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1688.28

No dataNo data? (TO)
TT=5000.04

No data? (TO)
TT=40000.4

UNSAT
TT=6673.46

UNSAT
TT=2300.65

? (TO)
TT=20400.2

UNSAT
TT=527.13

No data? (TO)
TT=5000.04

? (TO)
TT=5000.05

UNSAT
TT=4444.07

UNSAT
TT=1205.46

UNSAT
TT=524.777

No dataNo dataNo dataNo dataNo dataUNSAT
TT=1304.78

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=1090.66

? (TO)
TT=5000.04

? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

No data
SAT05/crafted/sorge05/
QG7a/
gensys-ukn003.shuffled-as.sat05-3843.cnf
UNSAT
TT=1118.21

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1118.21

UNSAT
TT=3203.72

UNSAT
TT=2819.83

No dataUNSAT
TT=4152.01

UNSAT
TT=1429.76

No dataNo dataNo data? (TO)
TT=5000.03

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=2562.08

No dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=40000.3

UNSAT
TT=14948.3

UNSAT
TT=4933.02

? (TO)
TT=20400.6

UNSAT
TT=1397.55

No data? (TO)
TT=5000.03

? (TO)
TT=5000.1

UNSAT
TT=12153.3

UNSAT
TT=3566.48

UNSAT
TT=1240.12

No dataNo dataNo dataNo dataNo dataUNSAT
TT=3817.16

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=2153.97

? (TO)
TT=5000.04

? (TO)
TT=5000.03

No data? (TO)
TT=5000.13

No data
SAT05/crafted/sorge05/
QG7a/
gensys-ukn004.shuffled-as.sat05-3844.cnf
UNSAT
TT=1407.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1648.88

UNSAT
TT=3405.34

UNSAT
TT=3768.25

No dataUNSAT
TT=7400.83

UNSAT
TT=2283.58

No dataNo dataNo data? (TO)
TT=5000.1

No data? (TO)
TT=5000.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3741.08

No dataNo data? (TO)
TT=5000.07

No data? (TO)
TT=40001

UNSAT
TT=23041.6

? (TO)
TT=5000.03

? (TO)
TT=20400.3

UNSAT
TT=1407.09

No data? (TO)
TT=5000.13

? (TO)
TT=5000.07

UNSAT
TT=14476.3

? (TO)
TT=5000.07

UNSAT
TT=2016.97

No dataNo dataNo dataNo dataNo data? (exit code)
TT=4998.47

No dataNo data? (TO)
TT=5000.09

UNSAT
TT=2357.68

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No data? (TO)
TT=5000.07

No data
SAT05/crafted/sorge05/
QG7a/
gensys-ukn006.shuffled-as.sat05-3846.cnf
UNSAT
TT=862.725

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1190.36

UNSAT
TT=2791.42

UNSAT
TT=3193.35

No dataUNSAT
TT=5792.97

UNSAT
TT=1163.68

No dataNo dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=5000.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.12

No dataNo data? (TO)
TT=5000.09

No data? (TO)
TT=40000.6

UNSAT
TT=14861

? (MO)
TT=1084.52

? (TO)
TT=20400.2

UNSAT
TT=862.725

No data? (TO)
TT=5000.05

? (TO)
TT=5000.11

UNSAT
TT=13582.8

UNSAT
TT=3446.56

UNSAT
TT=1341.56

No dataNo dataNo dataNo dataNo dataUNSAT
TT=3674.43

No dataNo data? (TO)
TT=5000.1

UNSAT
TT=1517.55

? (TO)
TT=5000.09

? (TO)
TT=5000.02

No data? (TO)
TT=5000.12

No data
SAT05/crafted/sorge05/
QG7a/
gensys-ukn009.shuffled-as.sat05-3849.cnf
UNSAT
TT=1222.87

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=1240.53

UNSAT
TT=1888.71

UNSAT
TT=2184.14

No dataUNSAT
TT=4199.68

UNSAT
TT=1345.32

No dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=5000.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3339.39

No dataNo data? (TO)
TT=5000.08

No data? (TO)
TT=40000.8

UNSAT
TT=13316.2

UNSAT
TT=4691.99

? (TO)
TT=20400.1

UNSAT
TT=1752.41

No data? (TO)
TT=5000.05

? (TO)
TT=5000.05

UNSAT
TT=14974.5

UNSAT
TT=3956.8

UNSAT
TT=1222.87

No dataNo dataNo dataNo dataNo dataUNSAT
TT=4213.87

No dataNo data? (TO)
TT=5000

UNSAT
TT=1687.76

? (TO)
TT=5000.04

? (TO)
TT=5000.05

No data? (TO)
TT=5000.12

No data
SAT05/crafted/sorge05/QG7/
dead-dnd003.shuffled-as.sat05-3109.cnf
UNSAT
TT=133.148

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=154.832

UNSAT
TT=194.998

UNSAT
TT=169.064

No dataUNSAT
TT=1477.43

UNSAT
TT=1171.98

No dataNo dataNo dataUNSAT
TT=623.777

No data? (TO)
TT=5000.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=3731.86

No dataNo dataUNSAT
TT=4900.91

No dataUNSAT
TT=7268.01

UNSAT
TT=1119.3

UNSAT
TT=459.633

UNSAT
TT=2385.39

UNSAT
TT=515.338

No dataUNSAT
TT=4400.09

UNSAT
TT=418.25

UNSAT
TT=9406.44

UNSAT
TT=170.271

UNSAT
TT=133.148

No dataNo dataNo dataNo dataNo dataUNSAT
TT=249.627

No dataNo data? (TO)
TT=5000.02

UNSAT
TT=597.83

? (TO)
TT=5000.12

? (TO)
TT=5000.02

No dataUNSAT
TT=1187.53

No data
SAT05/crafted/sorge05/
QG7/
gensys-icl007.shuffled-as.sat05-3133.cnf
UNSAT
TT=219.938

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=219.938

UNSAT
TT=904.984

UNSAT
TT=983.989

No dataUNSAT
TT=12539.2

UNSAT
TT=2090.66

No dataNo dataNo dataUNSAT
TT=826.639

No data? (TO)
TT=5000.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=5000.04

No dataNo dataUNSAT
TT=4777.94

No data? (TO)
TT=40000.4

UNSAT
TT=3085.89

UNSAT
TT=1127.06

? (TO)
TT=20400.1

UNSAT
TT=2010.21

No dataUNSAT
TT=3279.2

UNSAT
TT=2920.26

UNSAT
TT=8219.56

UNSAT
TT=586.623

UNSAT
TT=328.756

No dataNo dataNo dataNo dataNo dataUNSAT
TT=644.457

No dataNo data? (TO)
TT=5000.05

UNSAT
TT=867.54

? (TO)
TT=5000.08

? (TO)
TT=5000.03

No dataUNSAT
TT=1703.13

No data
SAT05/crafted/sorge05/QG7/
iso-ukn004.shuffled-as.sat05-3385.cnf
SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.022

SAT
TT=0.041

Signal
TT=0.045

No dataSAT
TT=0.544

SAT
TT=0.04

No dataNo dataNo dataSAT
TT=0.039

No dataSAT
TT=0.688

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.068

No dataNo dataSAT
TT=0.029

No dataSAT
TT=0.131

SAT
TT=0.138

SAT
TT=0.062

SAT
TT=1.305

SAT
TT=0.13

No dataSAT
TT=0.027

SAT
TT=0.052

SAT
TT=0.108

SAT
TT=0.036

SAT
TT=0.028

No dataNo dataNo dataNo dataNo dataSAT
TT=0.182

No dataNo dataSAT
TT=0.053

SAT
TT=5.566

SAT
TT=2.284

SAT
TT=1.898

No dataSAT
TT=0.198

No data
SAT05/crafted/sorge05/
QG8/
gensys-ukn007.shuffled-as.sat05-3586.cnf
UNSAT
TT=0.077

No dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.422

UNSAT
TT=0.581

UNSAT
TT=0.594

No dataUNSAT
TT=7.794

UNSAT
TT=0.831

No dataNo dataNo dataUNSAT
TT=0.175

No dataUNSAT
TT=0.588

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT
TT=0.23

No dataNo dataUNSAT
TT=0.077

No dataUNSAT
TT=0.373

UNSAT
TT=3.255

UNSAT
TT=1.603

UNSAT
TT=6.77

UNSAT
TT=3.418

No dataUNSAT
TT=0.297

UNSAT
TT=0.332

UNSAT
TT=0.654

UNSAT
TT=0.624

UNSAT
TT=0.565

No dataNo dataNo dataNo dataNo dataUNSAT
TT=0.874

No dataNo dataUNSAT
TT=0.231

UNSAT
TT=14.85

? (TO)
TT=5000.1

? (TO)
TT=5000.05

No dataUNSAT
TT=0.585

No data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT05/crafted/sorge05/QG8/
iso-ukn009.shuffled-as.sat05-3632.cnf
SAT
TT=0.021

No dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.021

SAT
TT=0.026

SAT
TT=0.031

No dataSAT
TT=0.658

SAT
TT=0.039

No dataNo dataNo dataSAT
TT=0.059

No dataSAT
TT=0.643

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.056

No dataNo dataSAT
TT=0.022

No dataSAT
TT=0.148

SAT
TT=0.115

SAT
TT=0.155

SAT
TT=1.243

SAT
TT=0.154

No dataSAT
TT=0.033

SAT
TT=0.048

SAT
TT=0.341

SAT
TT=0.037

SAT
TT=0.022

No dataNo dataNo dataNo dataNo dataSAT
TT=0.302

No dataNo dataSAT
TT=0.063

SAT
TT=13.583

SAT
TT=0.414

SAT
TT=0.502

No dataSAT
TT=0.23

No data
SAT05/industrial/grieu05/
vmpc/
vmpc_25.renamed-as.sat05-1913.cnf
SAT
TT=1.551

No dataSAT
TT=24.22

SAT
TT=4.756

No dataNo dataSAT
TT=65.303

No dataNo dataSAT
TT=7.632

SAT
TT=74.384

SAT
TT=7.455

SAT
TT=7.733

SAT
TT=37.786

No dataNo dataSAT
TT=12.499

SAT
TT=4.335

SAT
TT=40.424

No dataSAT
TT=55.272

SAT
TT=54.219

No dataSAT
TT=47.201

SAT
TT=14.356

SAT
TT=1.551

SAT
TT=49.644

SAT
TT=4.559

SAT
TT=6.314

SAT
TT=4.49

No dataSAT
TT=91.011

No dataNo dataSAT
TT=13.735

SAT
TT=13.301

SAT
TT=21.25

No dataNo dataSAT
TT=37.98

SAT
TT=34.824

SAT
TT=1.956

No dataNo dataNo dataNo dataSAT
TT=21.974

No dataSAT
TT=21.061

No dataSAT
TT=54.586

No dataNo dataNo dataNo dataSAT
TT=22.62

No dataNo dataNo dataNo dataNo data
SAT05/industrial/grieu05/
vmpc/
vmpc_29.renamed-as.sat05-1916.cnf
SAT
TT=15.119

No dataSAT
TT=666.574

SAT
TT=294.341

No dataNo dataSAT
TT=283.855

No dataNo dataSAT
TT=429.994

SAT
TT=593.101

SAT
TT=804.43

SAT
TT=234.695

SAT
TT=131.202

No dataNo dataSAT
TT=54.809

SAT
TT=987.965

SAT
TT=159.084

No dataSAT
TT=400.035

SAT
TT=405.098

No dataSAT
TT=595.046

SAT
TT=32.17

SAT
TT=77.441

SAT
TT=346.896

SAT
TT=240.135

SAT
TT=268.183

SAT
TT=239.776

No dataSAT
TT=269.065

No dataNo dataSAT
TT=73.275

SAT
TT=71.789

SAT
TT=164.628

No dataNo dataSAT
TT=504.291

? (TO)
TT=5000.09

SAT
TT=876.401

No dataNo dataNo dataNo dataSAT
TT=420.186

No dataSAT
TT=15.119

No dataSAT
TT=1106.96

No dataNo dataNo dataNo dataSAT
TT=115.31

No dataNo dataNo dataNo dataNo data
SAT05/industrial/grieu05/
vmpc/
vmpc_32.renamed-as.sat05-1919.cnf
SAT
TT=216.737

No dataSAT
TT=1239.6

SAT
TT=388.355

No dataNo dataSAT
TT=216.737

No dataNo dataSAT
TT=3882.99

SAT
TT=9591.73

SAT
TT=1090.85

SAT
TT=824.554

SAT
TT=451.688

No dataNo dataSAT
TT=402.007

SAT
TT=1355.19

SAT
TT=2239.12

No data? (TO)
TT=5000.07

? (TO)
TT=5000.13

No dataSAT
TT=2535.88

SAT
TT=1845.3

SAT
TT=1789.19

SAT
TT=830.804

? (TO)
TT=5000.06

? (TO)
TT=5000.04

? (TO)
TT=5000.08

No dataSAT
TT=1539.72

No dataNo dataSAT
TT=962.193

SAT
TT=953.956

SAT
TT=6651.15

No dataNo dataSAT
TT=330.846

SAT
TT=221.222

? (TO)
TT=5000.05

No dataNo dataNo dataNo dataSAT
TT=1305.34

No dataSAT
TT=1298.56

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataSAT
TT=979.4

No dataNo dataNo dataNo dataNo data
SAT05/industrial/grieu05/
vmpc/
vmpc_34.renamed-as.sat05-1926.cnf
SAT
TT=50.787

No dataSAT
TT=5654.22

SAT
TT=4806.89

No dataNo data? (TO)
TT=5000.07

No dataNo dataSAT
TT=11595.5

SAT
TT=50.787

SAT
TT=14548.9

SAT
TT=4710.17

SAT
TT=549.091

No dataNo dataSAT
TT=1914.58

SAT
TT=3499.24

? (TO)
TT=5000.03

No data? (TO)
TT=5000.11

? (TO)
TT=5000.03

No data? (TO)
TT=5000.09

? (TO)
TT=5000.09

SAT
TT=3617.25

SAT
TT=3857.42

? (TO)
TT=5000.09

? (TO)
TT=5000.09

? (TO)
TT=5000.06

No data? (TO)
TT=5000.1

No dataNo dataSAT
TT=4246.8

SAT
TT=4213.93

SAT
TT=28146.4

No dataNo dataSAT
TT=4458.59

? (TO)
TT=5000.06

SAT
TT=2127.53

No dataNo dataNo dataNo dataSAT
TT=2396.6

No dataSAT
TT=8751.5

No data? (TO)
TT=5000.12

No dataNo dataNo dataNo data? (TO)
TT=524.86

No dataNo dataNo dataNo dataNo data
SAT05/industrial/grieu05/
vmpc/
vmpc_35.renamed-as.sat05-1921.cnf
SAT
TT=1761.96

No data? (TO)
TT=40000.2

SAT
TT=24817.3

No dataNo data? (TO)
TT=5000.04

No dataNo data? (TO)
TT=35659.2

SAT
TT=30644.9

? (TO)
TT=40000.8

? (TO)
TT=40000.6

? (TO)
TT=5000.07

No dataNo dataSAT
TT=2965.45

SAT
TT=4152.96

? (TO)
TT=5000.08

No data? (TO)
TT=5000.06

? (TO)
TT=5000.05

No data? (TO)
TT=5000.06

? (TO)
TT=5000.09

? (TO)
TT=5000.06

? (TO)
TT=5000.11

? (TO)
TT=5000.05

? (TO)
TT=5000.06

? (TO)
TT=5000.06

No dataSAT
TT=3632.3

No dataNo dataSAT
TT=8675.35

SAT
TT=8606.28

? (TO)
TT=40000.7

No dataNo data? (TO)
TT=5000.07

? (TO)
TT=5000.02

? (TO)
TT=5000.07

No dataNo dataNo dataNo dataSAT
TT=1761.96

No data? (TO)
TT=20396.7

No data? (TO)
TT=5000.04

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
SAT05/industrial/grieu05/
vmpc/
vmpc_36.renamed-as.sat05-1922.cnf
SAT
TT=2647.1

No data? (TO)
TT=40000.3

?
TT=39780.2

No dataNo data? (TO)
TT=5000.07

No dataNo dataSAT
TT=7644.43

SAT
TT=37448.4

? (TO)
TT=40000.6

? (TO)
TT=40001

? (TO)
TT=5000.06

No dataNo dataSAT
TT=4673.92

? (TO)
TT=5000.04

? (TO)
TT=5000.08

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

No dataSAT
TT=3648.76

? (TO)
TT=5000.12

? (TO)
TT=5000.06

? (TO)
TT=5000.12

SAT
TT=4986.02

? (TO)
TT=5000.04

SAT
TT=4972.16

No dataSAT
TT=2766.08

No dataNo data? (TO)
TT=40000.2

? (TO)
TT=40000.4

? (TO)
TT=40000.6

No dataNo data? (TO)
TT=5000.05

? (TO)
TT=5000.09

SAT
TT=2647.1

No dataNo dataNo dataNo data? (TO)
TT=5000.02

No data? (TO)
TT=20395.6

No data? (TO)
TT=5000.05

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No dataNo dataNo dataNo dataNo data
SAT05/industrial/maris05/
DriverLog/
driverlog1_ks99i.renamed-as.sat05-3951.cnf
SAT
TT=0.001

No data? (exit code)
TT=0.757

? (exit code)
TT=0.744

No dataNo dataSAT
TT=0.504

No dataNo dataSAT
TT=0.004

SAT
TT=0.005

SAT
TT=0.452

SAT
TT=0.258

SAT
TT=0.004

No dataNo dataSAT
TT=0.007

SAT
TT=0.005

SAT
TT=0.003

No dataSAT
TT=0.01

SAT
TT=0.009

No dataSAT
TT=0.003

SAT
TT=0.002

SAT
TT=0.001

SAT
TT=0.002

SAT
TT=0.003

SAT
TT=0.009

SAT
TT=0.003

No dataSAT
TT=0.006

No dataNo dataSAT
TT=0.027

SAT
TT=0.057

SAT
TT=0.009

No dataNo dataSAT
TT=0.031

SAT
TT=0.009

SAT
TT=0.003

No dataNo dataNo dataNo dataSAT
TT=0.006

No data? (exit code)
TT=0.01

No dataSAT
TT=0.002

No dataNo dataNo dataNo dataSAT
TT=2.747

No dataNo dataNo dataNo dataNo data
SAT05/industrial/maris05/
DriverLog/
driverlog3_v01a.renamed-as.sat05-3963.cnf
SAT
TT=0.003

No data? (exit code)
TT=0.764

? (exit code)
TT=0.732

No dataNo dataSAT
TT=0.479

No dataNo dataSAT
TT=0.005

SAT
TT=0.006

SAT
TT=0.2

SAT
TT=0.167

SAT
TT=0.005

No dataNo dataSAT
TT=0.01

SAT
TT=0.009

SAT
TT=0.004

No dataSAT
TT=0.012

SAT
TT=0.012

No dataSAT
TT=0.003

SAT
TT=0.003

SAT
TT=0.005

SAT
TT=0.005

SAT
TT=0.005

SAT
TT=0.008

SAT
TT=0.003

No dataSAT
TT=0.007

No dataNo dataSAT
TT=0.072

SAT
TT=0.078

SAT
TT=0.023

No dataNo dataSAT
TT=0.032

SAT
TT=0.012

SAT
TT=0.004

No dataNo dataNo dataNo dataSAT
TT=0.008

No dataSAT
TT=0.01

No dataSAT
TT=0.003

No dataNo dataNo dataNo dataSAT
TT=2.751

No dataNo dataNo dataNo dataNo data
SAT05/industrial/maris05/
Ferry/
ferry5_ks99i.renamed-as.sat05-3994.cnf
SAT
TT=0.013

No dataSAT
TT=1.083

? (exit code)
TT=1.136

No dataNo dataSAT
TT=0.685

No dataNo dataSAT
TT=0.048

SAT
TT=0.043

SAT
TT=0.293

SAT
TT=0.528

SAT
TT=0.021

No dataNo dataSAT
TT=0.038

SAT
TT=0.034

SAT
TT=0.013

No dataSAT
TT=0.116

SAT
TT=0.117

No dataSAT
TT=0.018

SAT
TT=0.015

SAT
TT=0.015

SAT
TT=0.015

SAT
TT=0.015

SAT
TT=0.024

SAT
TT=0.014

No dataSAT
TT=0.105

No dataNo dataSAT
TT=0.38

SAT
TT=0.358

SAT
TT=0.154

No dataNo dataSAT
TT=0.062

SAT
TT=0.028

SAT
TT=0.018

No dataNo dataNo dataNo dataSAT
TT=0.051

No dataSAT
TT=0.066

No dataSAT
TT=0.045

No dataNo dataNo dataNo dataSAT
TT=2.902

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT05/industrial/maris05/
Rovers/
rovers1_ks99i.renamed-as.sat05-3971.cnf
SAT
TT=0.007

No data? (exit code)
TT=0.98

? (exit code)
TT=0.91

No dataNo dataSAT
TT=0.597

No dataNo dataSAT
TT=0.014

SAT
TT=0.012

SAT
TT=0.189

SAT
TT=0.164

SAT
TT=0.007

No dataNo dataSAT
TT=0.021

SAT
TT=0.019

SAT
TT=0.008

No dataSAT
TT=0.028

SAT
TT=0.027

No dataSAT
TT=0.008

SAT
TT=0.008

SAT
TT=0.007

SAT
TT=0.007

SAT
TT=0.009

SAT
TT=0.019

SAT
TT=0.008

No dataSAT
TT=0.014

No dataNo dataSAT
TT=0.075

SAT
TT=0.073

SAT
TT=0.037

No dataNo dataSAT
TT=0.041

SAT
TT=0.022

SAT
TT=0.008

No dataNo dataNo dataNo dataSAT
TT=0.019

No dataSAT
TT=0.026

No dataSAT
TT=0.008

No dataNo dataNo dataNo dataSAT
TT=2.85

No dataNo dataNo dataNo dataNo data
SAT05/industrial/narain05/
vpn/
clauses-8.renamed-as.sat05-1964.cnf
SAT
TT=139.314

No dataSAT
TT=6434.95

SAT
TT=6286.73

No dataNo dataSAT
TT=3499.13

No dataNo dataSAT
TT=5917.49

SAT
TT=4359.54

SAT
TT=5038.73

SAT
TT=5381.62

SAT
TT=316.337

No dataNo dataSAT
TT=4090.62

SAT
TT=624.111

SAT
TT=3918.1

No dataSAT
TT=583.454

SAT
TT=584.549

No dataSAT
TT=278.095

SAT
TT=784.318

SAT
TT=170.933

? (TO)
TT=5000.16

SAT
TT=213.098

SAT
TT=988.955

SAT
TT=207.099

No dataSAT
TT=139.314

No dataNo dataSAT
TT=2298.64

SAT
TT=2235.69

SAT
TT=3982.79

No dataNo dataSAT
TT=551.032

SAT
TT=958.708

SAT
TT=276.718

No dataNo dataNo dataNo dataSAT
TT=3161.31

No data? (exit code)
TT=3613.52

No dataSAT
TT=1646.79

No dataNo dataNo dataNo dataSAT
TT=921.67

No dataNo dataNo dataNo dataNo data
SAT_RACE08/Q1/
SAT_dat.k80_04.cnf
SAT
TT=11.069

No dataSAT
TT=166.607

SAT
TT=210.156

No dataNo dataSAT
TT=62.367

No dataNo dataSAT
TT=94.029

SAT
TT=112.046

SAT
TT=256.164

SAT
TT=288.266

SAT
TT=24.359

No dataNo dataSAT
TT=17.526

SAT
TT=14.592

SAT
TT=15.442

No dataSAT
TT=24.586

SAT
TT=24.456

No dataSAT
TT=17.524

SAT
TT=17.023

SAT
TT=13.667

SAT
TT=19.814

SAT
TT=11.108

SAT
TT=25.356

SAT
TT=11.069

No data? (problem)
TT=24.317

No dataNo dataSAT
TT=173.263

SAT
TT=164.357

SAT
TT=208.81

No dataNo dataSAT
TT=16.116

SAT
TT=12.187

SAT
TT=16.44

No dataNo dataNo dataNo dataSAT
TT=16.508

No dataSAT
TT=41.565

No dataSAT
TT=21.913

No dataNo dataNo dataNo dataSAT
TT=77.49

No dataNo dataNo dataNo dataNo data
SAT_RACE08/Q1/
SAT_dat.k85.cnf
SAT
TT=39.777

No dataSAT
TT=1799.14

SAT
TT=7270.12

No dataNo data? (TO)
TT=5000.05

No dataNo dataSAT
TT=3773.29

SAT
TT=6733.45

SAT
TT=6904.14

? (TO)
TT=40001

SAT
TT=1823.49

No dataNo dataSAT
TT=2329.18

SAT
TT=412.799

? (TO)
TT=5000.05

No data? (TO)
TT=5000.03

? (TO)
TT=5000.03

No dataSAT
TT=1335.29

SAT
TT=339.767

SAT
TT=836.943

? (TO)
TT=5000.11

SAT
TT=40.074

SAT
TT=334.938

SAT
TT=39.777

No dataSAT
TT=274.571

No dataNo dataSAT
TT=3934.81

SAT
TT=4670.78

SAT
TT=4576.09

No dataNo data? (TO)
TT=5000.13

SAT
TT=936.624

SAT
TT=363.971

No dataNo dataNo dataNo dataSAT
TT=290.354

No dataSAT
TT=4512.33

No dataSAT
TT=1237.38

No dataNo dataNo dataNo dataSAT
TT=1752.58

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/cryptography/
mizh/md5_48_3.cnf
SAT
TT=45.083

No dataSAT
TT=211.928

SAT
TT=530.303

No dataNo dataSAT
TT=183.609

No dataNo dataSAT
TT=319.143

SAT
TT=434.266

SAT
TT=327.779

SAT
TT=364.662

SAT
TT=45.083

No dataNo dataSAT
TT=1053.04

SAT
TT=511.454

? (TO)
TT=5000.11

No dataSAT
TT=124.934

SAT
TT=124.81

No dataSAT
TT=356.796

SAT
TT=200.157

SAT
TT=184.943

? (TO)
TT=5000.12

SAT
TT=46.544

SAT
TT=99.201

SAT
TT=63.286

No dataSAT
TT=222.509

No dataNo dataSAT
TT=678.04

SAT
TT=542.534

SAT
TT=976.307

No dataNo dataSAT
TT=617.617

SAT
TT=196.089

SAT
TT=105.096

No dataNo dataNo dataNo dataSAT
TT=2386.95

No dataSAT
TT=822.781

No dataSAT
TT=211.899

No dataNo dataNo dataNo dataSAT
TT=160.24

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/cryptography/
mizh/sha0_36_5.cnf
SAT
TT=20.162

No dataSAT
TT=177.183

SAT
TT=380.648

No dataNo dataSAT
TT=415.121

No dataNo dataSAT
TT=95.566

SAT
TT=8228.98

SAT
TT=562.38

SAT
TT=339.214

SAT
TT=68.865

No dataNo data? (TO)
TT=5000.04

? (TO)
TT=5000.01

? (TO)
TT=5000.08

No dataSAT
TT=136.092

SAT
TT=135.472

No dataSAT
TT=20.162

SAT
TT=65.639

SAT
TT=362.99

? (TO)
TT=5000.11

SAT
TT=214.015

SAT
TT=144.691

SAT
TT=506.33

No dataSAT
TT=342.551

No dataNo dataSAT
TT=296.592

SAT
TT=109.853

SAT
TT=549.83

No dataNo dataSAT
TT=729.329

SAT
TT=75.063

SAT
TT=514.427

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No dataSAT
TT=1008.19

No dataSAT
TT=3762.25

No dataNo dataNo dataNo dataSAT
TT=639.43

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
hardware-verification/manolios/c10idw_i.cnf
UNSAT
TT=21.567

No dataUNSAT
TT=351.099

UNSAT
TT=331.507

No dataNo dataUNSAT
TT=99.588

No dataNo dataUNSAT
TT=311.324

UNSAT
TT=234.728

UNSAT
TT=868.532

UNSAT
TT=855.807

UNSAT
TT=108.4

No dataNo dataUNSAT
TT=30.487

UNSAT
TT=21.567

UNSAT
TT=27.591

No dataUNSAT
TT=50.056

UNSAT
TT=49.953

No dataUNSAT
TT=50.178

UNSAT
TT=35.944

UNSAT
TT=35.823

UNSAT
TT=32.319

UNSAT
TT=49.417

UNSAT
TT=28.103

UNSAT
TT=38.118

No dataUNSAT
TT=55.388

No dataNo dataUNSAT
TT=437.157

UNSAT
TT=429.755

UNSAT
TT=287.168

No dataNo dataUNSAT
TT=50.627

UNSAT
TT=42.172

UNSAT
TT=45.776

No dataNo dataNo dataNo dataUNSAT
TT=40.303

No dataUNSAT
TT=62.981

No dataUNSAT
TT=66.2

No dataNo dataNo dataNo dataUNSAT
TT=177.54

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
hardware-verification/
velev/11pipe_11_ooo.cnf
UNSAT
TT=2200.85

No data? (MO)
TT=11823.2

? (MO)
TT=13089.5

No dataNo data? (TO)
TT=5000.1

No dataNo data? (TO)
TT=35293

UNSAT
TT=39473.4

UNSAT
TT=15706.6

UNSAT
TT=15416.4

UNSAT
TT=3486.91

No dataNo data? (TO)
TT=5000.02

? (TO)
TT=5000.01

UNSAT
TT=3056.65

No dataUNSAT
TT=2200.85

UNSAT
TT=2209.49

No data? (TO)
TT=5000.38

? (TO)
TT=5000.12

? (TO)
TT=5000.25

? (TO)
TT=5000.16

? (TO)
TT=5000.27

? (TO)
TT=5000.04

? (TO)
TT=5000.25

No data? (TO)
TT=5000.09

No dataNo dataUNSAT
TT=10012.2

UNSAT
TT=11516.8

UNSAT
TT=37620

No dataNo dataUNSAT
TT=3514.2

? (TO)
TT=5000.03

? (TO)
TT=5000.2

No dataNo dataNo dataNo data? (TO)
TT=5000.05

No data? (exit code)
TT=3081.35

No dataUNSAT
TT=2505.47

No dataNo dataNo dataNo data? (TO)
TT=5000.09

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
hardware-verification/
velev/11pipe_k.cnf
UNSAT
TT=323.644

No dataUNSAT
TT=9280.15

UNSAT
TT=8220.39

No dataNo data? (MO)
TT=3823.52

No dataNo dataUNSAT
TT=3869.42

UNSAT
TT=3665.55

UNSAT
TT=4258.18

UNSAT
TT=4210.62

UNSAT
TT=734.864

No dataNo data? (TO)
TT=5000.09

? (TO)
TT=5000.1

UNSAT
TT=703.934

No dataUNSAT
TT=609.42

UNSAT
TT=604.533

No dataUNSAT
TT=769.674

? (TO)
TT=5000.09

? (TO)
TT=5000.39

UNSAT
TT=323.644

? (TO)
TT=5000.6

? (TO)
TT=5000.07

? (problem)
TT=4682.14

No dataUNSAT
TT=2365.08

No dataNo dataUNSAT
TT=3011.9

UNSAT
TT=2901.42

UNSAT
TT=7055.37

No dataNo dataUNSAT
TT=658.023

? (TO)
TT=5000.05

UNSAT
TT=1771.37

No dataNo dataNo dataNo data? (TO)
TT=5000.04

No data? (exit code)
TT=4403.78

No dataUNSAT
TT=1650.26

No dataNo dataNo dataNo dataUNSAT
TT=4559.75

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
hardware-verification/
velev/1dlx_c_iq57_a.cnf
UNSAT
TT=552.98

No data? (MO)
TT=4601.78

? (MO)
TT=3866.5

No dataNo data? (MO)
TT=2793.05

No dataNo dataUNSAT
TT=7575.47

UNSAT
TT=7189.01

UNSAT
TT=13193.4

UNSAT
TT=12521.7

UNSAT
TT=887.954

No dataNo dataUNSAT
TT=2632.65

UNSAT
TT=980.848

UNSAT
TT=552.98

No dataUNSAT
TT=1060.14

UNSAT
TT=1039.44

No dataUNSAT
TT=593.117

UNSAT
TT=3998.74

UNSAT
TT=885.053

UNSAT
TT=686.442

UNSAT
TT=1210.56

? (TO)
TT=5000

UNSAT
TT=1195.66

No dataUNSAT
TT=1516.51

No dataNo dataUNSAT
TT=8339.53

UNSAT
TT=8635.97

UNSAT
TT=9410.39

No dataNo dataUNSAT
TT=2156.47

? (TO)
TT=5000.09

UNSAT
TT=1683.09

No dataNo dataNo dataNo dataUNSAT
TT=2494.79

No data? (exit code)
TT=6577.36

No dataUNSAT
TT=1938.6

No dataNo dataNo dataNo dataUNSAT
TT=4783.75

No dataNo dataNo dataNo dataNo data
Bench nameBest resultsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
SAT-Race-2010-CNF/
hardware-verification/
velev/1dlx_c_iq60_a.cnf
UNSAT
TT=718.86

No data? (MO)
TT=3423.22

? (MO)
TT=3877.12

No dataNo data? (MO)
TT=2092.65

No dataNo dataUNSAT
TT=9193.94

UNSAT
TT=9081.04

UNSAT
TT=17961.7

UNSAT
TT=17168.5

UNSAT
TT=1478.14

No dataNo dataUNSAT
TT=3664.13

UNSAT
TT=1407.4

UNSAT
TT=858.928

No dataUNSAT
TT=1543.03

UNSAT
TT=1537.44

No dataUNSAT
TT=718.86

UNSAT
TT=4126.3

UNSAT
TT=1259.73

UNSAT
TT=784.154

UNSAT
TT=1110.78

? (TO)
TT=5000.03

UNSAT
TT=1109.74

No dataUNSAT
TT=2081.67

No dataNo dataUNSAT
TT=9480.09

UNSAT
TT=9762.18

UNSAT
TT=7818.19

No dataNo dataUNSAT
TT=3800.54

? (TO)
TT=5000.09

UNSAT
TT=1931.51

No dataNo dataNo dataNo dataUNSAT
TT=3551.98

No data? (exit code)
TT=10482.4

No dataUNSAT
TT=2514.21

No dataNo dataNo dataNo data? (TO)
TT=5000.11

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
hardware-verification/velev/
2dlx_ca_bp_f_liveness.cnf



No data? (MO)
TT=4287.4

? (MO)
TT=7182.94

No dataNo data? (MO)
TT=2652.26

No dataNo data? (TO)
TT=39104.2

? (TO)
TT=38981.6

? (TO)
TT=34610.3

? (TO)
TT=38715.6

? (TO)
TT=5000.36

No dataNo data? (TO)
TT=5000.01

? (TO)
TT=5000.08

? (TO)
TT=5000.1

No data? (TO)
TT=5000.05

? (TO)
TT=5000.08

No data? (TO)
TT=5000.27

? (TO)
TT=5000.07

? (TO)
TT=5000.25

? (TO)
TT=5000.12

? (TO)
TT=5000.31

? (TO)
TT=5000

? (TO)
TT=5000.27

No data? (TO)
TT=5000.05

No dataNo data? (TO)
TT=40000.4

? (TO)
TT=40000.7

? (TO)
TT=40000.1

No dataNo data? (TO)
TT=5000.28

? (TO)
TT=5000.07

? (TO)
TT=5000.15

No dataNo dataNo dataNo data? (TO)
TT=5000.06

No data? (exit code)
TT=5617.39

No data? (TO)
TT=5000.09

No dataNo dataNo dataNo data? (TO)
TT=5000.01

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
software-verification/
nec/hard-18-U-10652.cnf
UNSAT
TT=4.386

No dataUNSAT
TT=4745.69

UNSAT
TT=4771.63

No dataNo dataUNSAT
TT=4707.97

No dataNo dataUNSAT
TT=1927.13

UNSAT
TT=1931.41

UNSAT
TT=478.687

UNSAT
TT=448.15

UNSAT
TT=42.855

No dataNo dataUNSAT
TT=8.211

UNSAT
TT=4.386

UNSAT
TT=19.069

No dataUNSAT
TT=100.871

UNSAT
TT=100.972

No dataUNSAT
TT=19.477

UNSAT
TT=18.864

UNSAT
TT=19.264

UNSAT
TT=18.864

UNSAT
TT=18.32

UNSAT
TT=8.737

UNSAT
TT=18.083

No dataUNSAT
TT=35.844

No dataNo dataUNSAT
TT=140.6

UNSAT
TT=147.227

UNSAT
TT=125.583

No dataNo dataUNSAT
TT=108.624

UNSAT
TT=9.756

UNSAT
TT=19.756

No dataNo dataNo dataNo dataUNSAT
TT=8.529

No data? (exit code)
TT=27.212

No dataUNSAT
TT=184.65

No dataNo dataNo dataNo dataUNSAT
TT=159.535

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
software-verification/
nec/hard-25-U-7061.cnf
UNSAT
TT=1.793

No dataUNSAT
TT=476.701

UNSAT
TT=459.003

No dataNo dataUNSAT
TT=441.068

No dataNo dataUNSAT
TT=3.534

UNSAT
TT=3.521

UNSAT
TT=119.011

UNSAT
TT=120.712

UNSAT
TT=8.411

No dataNo dataUNSAT
TT=11.569

UNSAT
TT=12.26

UNSAT
TT=2.945

No dataUNSAT
TT=1.793

UNSAT
TT=1.95

No dataUNSAT
TT=3.059

? (exit code)
TT=3.004

UNSAT
TT=2.912

UNSAT
TT=3.143

UNSAT
TT=2.921

UNSAT
TT=11.276

UNSAT
TT=2.911

No dataUNSAT
TT=4.679

No dataNo dataUNSAT
TT=14.814

UNSAT
TT=15.867

UNSAT
TT=18.898

No dataNo dataUNSAT
TT=32.568

UNSAT
TT=12.393

UNSAT
TT=2.902

No dataNo dataNo dataNo dataUNSAT
TT=11.722

No dataUNSAT
TT=12.389

No dataUNSAT
TT=5.866

No dataNo dataNo dataNo dataUNSAT
TT=90.06

No dataNo dataNo dataNo dataNo data
SAT-Race-2010-CNF/
software-verification/nec/hard-6-U-7061.cnf
UNSAT
TT=4.003

No dataUNSAT
TT=251.315

UNSAT
TT=312.397

No dataNo dataUNSAT
TT=206.308

No dataNo dataUNSAT
TT=26.568

UNSAT
TT=26.367

UNSAT
TT=225.465

UNSAT
TT=211.575

UNSAT
TT=20.867

No dataNo dataUNSAT
TT=12.666

UNSAT
TT=12.048

UNSAT
TT=4.028

No dataUNSAT
TT=19.124

UNSAT
TT=20.229

No dataUNSAT
TT=4.398

UNSAT
TT=4.148

UNSAT
TT=4.213

UNSAT
TT=4.409

UNSAT
TT=4.022

UNSAT
TT=11.151

UNSAT
TT=4.003

No dataUNSAT
TT=14.527

No dataNo dataUNSAT
TT=57.058

UNSAT
TT=67.383

UNSAT
TT=59.483

No dataNo dataUNSAT
TT=19.627

UNSAT
TT=11.529

UNSAT
TT=4.214

No dataNo dataNo dataNo dataUNSAT
TT=11.652

No dataUNSAT
TT=15.54

No dataUNSAT
TT=20.819

No dataNo dataNo dataNo dataUNSAT
TT=123.61

No dataNo dataNo dataNo dataNo data
velev-npe-1.0-9dlx-b71.cnf SAT
TT=22.131

No data? (MO)
TT=2227.73

? (MO)
TT=2789.01

No dataNo dataSAT
TT=2115.65

No dataNo data? (TO)
TT=5106.44

? (TO)
TT=5106.47

? (TO)
TT=11534.5

? (TO)
TT=10693.5

? (MO)
TT=3230.69

No dataNo dataSAT
TT=36.691

SAT
TT=531.768

SAT
TT=61.755

No dataSAT
TT=64.053

SAT
TT=64.151

No dataSAT
TT=88.029

SAT
TT=382.575

SAT
TT=226.537

SAT
TT=85.124

SAT
TT=66.604

SAT
TT=22.131

SAT
TT=66.67

No dataSAT
TT=253.95

No dataNo dataSAT
TT=460.673

SAT
TT=436.16

SAT
TT=329.808

No dataNo data? (TO)
TT=5000.44

SAT
TT=373.519

SAT
TT=275.508

No dataNo dataNo dataNo dataSAT
TT=1658.59

No data? (exit code)
TT=45.808

No dataSAT
TT=1140.62

No dataNo dataNo dataNo dataSAT
TT=818.02

No dataNo dataNo dataNo dataNo data
velev-pipe-o-uns-1.0-7.cnf UNSAT
TT=75.173

No dataUNSAT
TT=714.322

UNSAT
TT=753.159

No dataNo dataUNSAT
TT=197.884

No dataNo dataUNSAT
TT=454.833

UNSAT
TT=357.834

UNSAT
TT=513.496

UNSAT
TT=478.854

UNSAT
TT=75.173

No dataNo dataUNSAT
TT=398.47

UNSAT
TT=164.276

UNSAT
TT=86.535

No dataUNSAT
TT=87.405

UNSAT
TT=87.354

No dataUNSAT
TT=196.683

UNSAT
TT=174.364

UNSAT
TT=236.376

UNSAT
TT=105.915

UNSAT
TT=497.962

UNSAT
TT=211.757

UNSAT
TT=497.165

No dataUNSAT
TT=228.274

No dataNo dataUNSAT
TT=458.47

UNSAT
TT=485.518

UNSAT
TT=920.485

No dataNo dataUNSAT
TT=110.472

UNSAT
TT=1084.41

UNSAT
TT=111.7

No dataNo dataNo dataNo dataUNSAT
TT=448.131

No dataUNSAT
TT=499.079

No dataUNSAT
TT=99.447

No dataNo dataNo dataNo dataUNSAT
TT=507.53

No dataNo dataNo dataNo dataNo data
velev-pipe-o-uns-1.1-6.cnf UNSAT
TT=11.355

No dataUNSAT
TT=222.433

UNSAT
TT=152.945

No dataNo dataUNSAT
TT=65.506

No dataNo dataUNSAT
TT=116.446

UNSAT
TT=106.964

UNSAT
TT=155.939

UNSAT
TT=149.335

UNSAT
TT=34.07

No dataNo dataUNSAT
TT=1238.7

UNSAT
TT=1240.22

UNSAT
TT=28.802

No dataUNSAT
TT=17.815

UNSAT
TT=17.804

No dataUNSAT
TT=19.855

UNSAT
TT=206.515

UNSAT
TT=675.169

UNSAT
TT=11.355

UNSAT
TT=1069.08

UNSAT
TT=305.494

UNSAT
TT=965.619

No dataUNSAT
TT=57.835

No dataNo dataUNSAT
TT=124.444

UNSAT
TT=131.436

UNSAT
TT=249.314

No dataNo dataUNSAT
TT=31.279

UNSAT
TT=352.92

UNSAT
TT=117.1

No dataNo dataNo dataNo dataUNSAT
TT=1195.23

No dataUNSAT
TT=132.934

No dataUNSAT
TT=32.336

No dataNo dataNo dataNo dataUNSAT
TT=58.23

No dataNo dataNo dataNo dataNo data
velev-pipe-sat-1.0-b9.cnf SAT
TT=2.563

No dataSAT
TT=341.503

SAT
TT=330.794

No dataNo dataSAT
TT=336.971

No dataNo dataSAT
TT=194.175

SAT
TT=131.718

SAT
TT=3016.31

SAT
TT=3043.72

SAT
TT=158.745

No dataNo dataSAT
TT=11.937

SAT
TT=2.563

SAT
TT=76.301

No dataSAT
TT=24.628

SAT
TT=24.653

No dataSAT
TT=88.679

SAT
TT=78.755

SAT
TT=77.278

SAT
TT=82.141

SAT
TT=75.275

SAT
TT=2.575

SAT
TT=75.19

No dataSAT
TT=68.621

No dataNo dataSAT
TT=67.574

SAT
TT=202.295

SAT
TT=87.161

No dataNo dataSAT
TT=99.192

SAT
TT=132.714

SAT
TT=125.019

No dataNo dataNo dataNo dataSAT
TT=5.16

No data? (exit code)
TT=41.505

No dataSAT
TT=39.513

No dataNo dataNo dataNo dataSAT
TT=1416.56

No dataNo dataNo dataNo dataNo data
velev-vliw-uns-4.0-9-i1.cnf UNSAT
TT=380.915

No data? (MO)
TT=10371.9

? (MO)
TT=8888.04

No dataNo dataUNSAT
TT=3668.85

No dataNo dataUNSAT
TT=11309.5

UNSAT
TT=9479.28

UNSAT
TT=9514.57

UNSAT
TT=9415.61

UNSAT
TT=1677.1

No dataNo dataUNSAT
TT=4911.63

UNSAT
TT=730.077

UNSAT
TT=960.832

No dataUNSAT
TT=1113.08

UNSAT
TT=1100.02

No dataUNSAT
TT=2037.75

? (TO)
TT=5000.07

? (TO)
TT=5000.24

UNSAT
TT=380.915

? (TO)
TT=5000.16

? (TO)
TT=5000.05

? (TO)
TT=5000.17

No data? (TO)
TT=5000.12

No dataNo dataUNSAT
TT=10403.6

UNSAT
TT=10551.1

UNSAT
TT=12438.7

No dataNo dataUNSAT
TT=1238.91

? (TO)
TT=5000.08

? (TO)
TT=5000.19

No dataNo dataNo dataNo dataUNSAT
TT=1747.5

No data? (exit code)
TT=6664.6

No dataUNSAT
TT=3636.04

No dataNo dataNo dataNo dataUNSAT
TT=3668.5

No dataNo dataNo dataNo dataNo data



Statisticsadaptg2wsat2011
2011-03-02
(incomplete)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
borg-sat
11.03.02-par-random (fixed)
(complete)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
borg-sat
11.03.02-seq-random (fixed)
(complete)
clasp
2.0-R4092-crafted
(complete)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
claspmt
2.0-R4095-patched (fixed)
(complete)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
csls
pnorm-8cores
(incomplete)
EagleUP
1.565.350
(incomplete)
EBGlucose
1.0
(incomplete)
glucose
2
(complete)
glueminisat
2.2.5
(complete)
jMiniSat
2011
(complete)
Lingeling
587 [DEPRECATED]
(complete)
Lingeling
587f (fixed)
(complete)
march_rw
2011-03-02
(complete)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
minisat hack: contrasat
2011-03-02
(complete)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
minisat hack: minisat_psm
2011-04-01
(complete)
minisat hack reference: minisat
2.2.0
(complete)
MPhaseSAT
2011-02-15
(complete)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
MPhaseSAT_M
2011-02-16
(complete)
PicoSAT
941
(complete)
Plingeling
587 [DEPRECATED]
(complete)
Plingeling
587f (fixed)
(complete)
ppfolio
par
(complete)
ppfolio
seq
(complete)
priss
1.0
(complete)
QuteRSat
2011-05-12 (fixed)
(complete)
rcl
2011-04-01
(complete)
RestartSAT
B95
(complete)
SApperloT2010
2011-05-15 (fixed)
(complete)
SArTagnan
2011-05-15 (fixed)
(complete)
SAT07 reference solver: minisat
SAT 2007
(complete)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
SAT09 reference solver:glucose
1.0
(complete)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
SAT09 reference solver: march_hi
hi
(complete)
SAT09 reference solver:precosat
236
(complete)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
sathys
2011-04-01
(complete)
Satisfiability Solver Selector
2011-03-18
(complete)
sattime
2011-03-02
(incomplete)
sattime+
2011-03-02
(incomplete)
sattime2011
2011-03-02
(incomplete)
Sol
2011-04-04
(complete)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
Number of times the solver is able to give the best known answer32819619500190014903822243613173353281993402119820820825120219919619118919719413220135912123036186052710431618431310914812214919729819425120611638432496771109106334116362
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
17110040280621209876412103997961620592510147230152513261432651314222699272851329241410131