PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial, subsubcategory FPGA ...

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial, subsubcategory FPGA ...

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (dec) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: borg-pb 10.05.30 (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: borg pb-dec-11.04.03 (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
PBPASSolver-CARD.DP 2012-05-28 (complete)
PBPASSolver-CARD.SN 2012-05-28 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench nameBest results
on this
instance
bsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl10_11_pb.cnf.cr.opb
UNSAT
TT=0.002

UNSAT
TT=0.004

UNSAT
TT=138.958

? (problem)
TT=0.003

UNSAT
TT=0.678

? (problem)
TT=0.002

UNSAT
TT=0.021

? (problem)
TT=0.002

UNSAT
TT=0.019

? (problem)
TT=0.004

UNSAT
TT=0.019

UNSAT
TT=136.123

UNSAT
TT=15.857

UNSAT
TT=67.31

UNSAT
TT=0.002

UNSAT
TT=307.66

UNSAT
TT=0.004

UNSAT
TT=63.326

UNSAT
TT=0.015

UNSAT
TT=183.94

UNSAT
TT=0.008

UNSAT
TT=0.304

UNSAT
TT=0.02

UNSAT
TT=0.486

UNSAT
TT=0.304

UNSAT
TT=0.02

UNSAT
TT=9.722

? (problem)
TT=0.003

? (problem)
TT=0.003

UNSAT
TT=80.247

UNSAT
TT=2.212

UNSAT
TT=295.02

UNSAT
TT=298.93

UNSAT
TT=0.284

UNSAT
TT=176.84

UNSAT
TT=33.289

UNSAT
TT=0.018

UNSAT
TT=0.025

UNSAT
TT=0.027

UNSAT
TT=449.037

UNSAT
TT=449.79

UNSAT
TT=299.73

UNSAT
TT=286.23

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl10_20_pb.cnf.cr.opb
UNSAT
TT=0.004

UNSAT
TT=0.007

UNSAT
TT=39.891

? (problem)
TT=0.004

UNSAT
TT=1.327

? (problem)
TT=0.001

UNSAT
TT=1.27

? (problem)
TT=0.003

UNSAT
TT=1.27

? (problem)
TT=0.005

UNSAT
TT=1.27

? (TO)
TT=1800.02

UNSAT
TT=61.708

UNSAT
TT=56.85

UNSAT
TT=0.004

? (TO)
TT=1800.1

UNSAT
TT=0.005

? (TO)
TT=1801.81

UNSAT
TT=0.017

UNSAT
TT=193.37

UNSAT
TT=0.01

UNSAT
TT=0.254

UNSAT
TT=0.019

UNSAT
TT=0.488

UNSAT
TT=0.273

UNSAT
TT=0.024

UNSAT
TT=34.592

? (problem)
TT=0.002

? (problem)
TT=0.005

UNSAT
TT=23.857

UNSAT
TT=20.976

UNSAT
TT=890.61

UNSAT
TT=499.68

UNSAT
TT=0.245

UNSAT
TT=1521.98

? (TO)
TT=1800.02

UNSAT
TT=0.022

UNSAT
TT=0.026

UNSAT
TT=0.034

? (TO)
TT=1800.03

? (TO)
TT=1800.03

UNSAT
TT=477.89

UNSAT
TT=461.196

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl15_20_pb.cnf.cr.opb
UNSAT
TT=0.007

UNSAT
TT=0.016

? (TO)
TT=1800.03

? (problem)
TT=0.005

? (TO)
TT=1800.12

? (problem)
TT=0.003

? (TO)
TT=1800.08

? (problem)
TT=0.005

? (TO)
TT=1800.04

? (problem)
TT=0.003

? (TO)
TT=1800.06

? (TO)
TT=1800.02

? (TO)
TT=1800.02

? (TO)
TT=1800.03

UNSAT
TT=0.007

? (TO)
TT=1800

UNSAT
TT=0.012

? (TO)
TT=1800.04

UNSAT
TT=0.02

UNSAT
TT=590.45

UNSAT
TT=0.013

UNSAT
TT=0.275

UNSAT
TT=0.026

UNSAT
TT=0.523

UNSAT
TT=0.292

UNSAT
TT=0.024

? (TO)
TT=1800.1

? (problem)
TT=0.005

? (problem)
TT=0.005

? (TO)
TT=1800.08

? (TO)
TT=1800.06

?
TT=1799.91

?
TT=1799.66

UNSAT
TT=0.323

? (TO)
TT=1800.91

? (TO)
TT=1800.06

UNSAT
TT=0.033

UNSAT
TT=0.028

UNSAT
TT=0.038

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1799.65

?
TT=1800.03

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr.opb
UNSAT
TT=0.009

UNSAT
TT=0.017

? (TO)
TT=1800.02

? (problem)
TT=0.005

? (TO)
TT=1800.13

? (problem)
TT=0.006

? (TO)
TT=1800.08

? (problem)
TT=0.005

? (TO)
TT=1800.08

? (problem)
TT=0.005

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.04

UNSAT
TT=0.009

? (TO)
TT=1800.02

UNSAT
TT=0.013

? (TO)
TT=1800.03

UNSAT
TT=0.025

UNSAT
TT=589.896

UNSAT
TT=0.015

UNSAT
TT=0.324

UNSAT
TT=0.028

UNSAT
TT=0.509

UNSAT
TT=0.353

UNSAT
TT=0.026

? (TO)
TT=1800.1

? (problem)
TT=0.005

? (problem)
TT=0.006

? (TO)
TT=1800.09

? (TO)
TT=1800.11

?
TT=1799.63

?
TT=1799.6

UNSAT
TT=0.365

? (TO)
TT=1800.08

? (TO)
TT=1800.09

UNSAT
TT=0.032

UNSAT
TT=0.037

UNSAT
TT=0.041

? (TO)
TT=1800.02

? (TO)
TT=1800.11

?
TT=1799.64

?
TT=1799.63

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl30_31_pb.cnf.cr.opb
UNSAT
TT=0.032

UNSAT
TT=0.077

? (TO)
TT=1800.09

? (problem)
TT=0.01

? (TO)
TT=1800.09

? (problem)
TT=0.007

? (TO)
TT=1800.08

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (problem)
TT=0.009

? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.11

? (TO)
TT=1800.03

UNSAT
TT=0.032

? (TO)
TT=1800.07

UNSAT
TT=0.058

? (TO)
TT=1800.63

UNSAT
TT=0.044

UNSAT
TT=591.503

UNSAT
TT=0.038

UNSAT
TT=1.193

UNSAT
TT=0.043

UNSAT
TT=0.53

UNSAT
TT=1.094

UNSAT
TT=0.043

? (TO)
TT=1800.09

? (problem)
TT=0.008

? (problem)
TT=0.01

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1799.64

?
TT=1799.57

UNSAT
TT=1.052

? (TO)
TT=1800.85

? (TO)
TT=1800.01

UNSAT
TT=0.055

UNSAT
TT=0.057

UNSAT
TT=0.071

? (TO)
TT=1800.09

? (TO)
TT=1800.11

?
TT=1799.96

?
TT=1799.62

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl30_35_pb.cnf.cr.opb
UNSAT
TT=0.042

UNSAT
TT=0.082

? (TO)
TT=1800.11

? (problem)
TT=0.009

? (TO)
TT=1800.09

? (problem)
TT=0.009

? (TO)
TT=1800.05

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (problem)
TT=0.01

? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.12

UNSAT
TT=0.051

? (TO)
TT=1800.1

UNSAT
TT=0.063

? (TO)
TT=1800.01

UNSAT
TT=0.052

UNSAT
TT=590.209

UNSAT
TT=0.042

UNSAT
TT=0.623

UNSAT
TT=0.052

UNSAT
TT=0.555

UNSAT
TT=0.615

UNSAT
TT=0.052

? (TO)
TT=1800.08

? (problem)
TT=0.01

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (TO)
TT=1800.13

?
TT=1799.57

?
TT=1799.52

UNSAT
TT=0.594

? (TO)
TT=1800.1

? (TO)
TT=1800.6

UNSAT
TT=0.065

UNSAT
TT=0.069

UNSAT
TT=0.089

? (TO)
TT=1800.09

? (TO)
TT=1800.1

?
TT=1799.87

? (TO)
TT=1800.07

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl35_36_pb.cnf.cr.opb
UNSAT
TT=0.047

UNSAT
TT=0.124

? (TO)
TT=1800.1

? (problem)
TT=0.011

? (TO)
TT=1800.08

? (problem)
TT=0.012

? (TO)
TT=1800.05

? (problem)
TT=0.01

? (TO)
TT=1800

? (problem)
TT=0.009

? (TO)
TT=1800.06

? (TO)
TT=1800.06

? (TO)
TT=1800.08

? (TO)
TT=1800.13

UNSAT
TT=0.055

? (TO)
TT=1800.06

UNSAT
TT=0.095

? (TO)
TT=1800.08

UNSAT
TT=0.054

UNSAT
TT=592.249

UNSAT
TT=0.052

UNSAT
TT=1.475

UNSAT
TT=0.047

UNSAT
TT=0.572

UNSAT
TT=1.515

UNSAT
TT=0.054

? (TO)
TT=1800.03

? (problem)
TT=0.012

? (problem)
TT=0.011

? (TO)
TT=1800.04

? (TO)
TT=1800.15

?
TT=1799.55

?
TT=1799.49

UNSAT
TT=1.545

? (TO)
TT=1800.04

? (TO)
TT=1800.04

UNSAT
TT=0.075

UNSAT
TT=0.076

UNSAT
TT=0.101

? (TO)
TT=1800.09

? (TO)
TT=1800.08

?
TT=1799.88

?
TT=1799.89

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl35_40_pb.cnf.cr.opb
UNSAT
TT=0.054

UNSAT
TT=0.231

? (TO)
TT=1800.07

? (problem)
TT=0.011

? (TO)
TT=1800.08

? (problem)
TT=0.01

? (TO)
TT=1800.05

? (problem)
TT=0.012

? (TO)
TT=1800.04

? (problem)
TT=0.011

? (TO)
TT=1800.06

? (TO)
TT=1800.12

? (TO)
TT=1800.08

? (TO)
TT=1800.13

UNSAT
TT=0.072

? (TO)
TT=1800.06

UNSAT
TT=0.157

? (TO)
TT=1800.01

UNSAT
TT=0.059

UNSAT
TT=591.159

UNSAT
TT=0.057

UNSAT
TT=0.803

UNSAT
TT=0.061

UNSAT
TT=0.58

UNSAT
TT=0.813

UNSAT
TT=0.054

? (TO)
TT=1800.07

? (problem)
TT=0.013

? (problem)
TT=0.01

? (TO)
TT=1800.14

? (TO)
TT=1800.06

?
TT=1799.54

?
TT=1799.79

UNSAT
TT=0.814

? (TO)
TT=1800.79

? (TO)
TT=1800.02

UNSAT
TT=0.083

UNSAT
TT=0.079

UNSAT
TT=0.106

? (TO)
TT=1800.08

? (TO)
TT=1800.08

?
TT=1799.88

?
TT=1799.89

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl40_45_pb.cnf.cr.opb
UNSAT
TT=0.074

UNSAT
TT=0.197

? (TO)
TT=1800.1

? (problem)
TT=0.017

? (TO)
TT=1800.06

? (problem)
TT=0.013

? (TO)
TT=1800.03

? (problem)
TT=0.015

? (TO)
TT=1800.05

? (problem)
TT=0.018

? (TO)
TT=1800

? (TO)
TT=1800.1

? (TO)
TT=1800.07

? (TO)
TT=1800.11

UNSAT
TT=0.114

? (TO)
TT=1800.53

UNSAT
TT=0.153

? (TO)
TT=1800.06

UNSAT
TT=0.077

UNSAT
TT=592.656

UNSAT
TT=0.078

UNSAT
TT=0.845

UNSAT
TT=0.077

UNSAT
TT=0.608

UNSAT
TT=0.842

UNSAT
TT=0.074

? (TO)
TT=1800.09

? (problem)
TT=0.014

? (problem)
TT=0.015

? (TO)
TT=1800.04

? (TO)
TT=1800.04

?
TT=1799.93

?
TT=1799.54

UNSAT
TT=0.864

? (TO)
TT=1800.06

? (TO)
TT=1800.45

UNSAT
TT=0.108

UNSAT
TT=0.119

UNSAT
TT=0.146

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1799.79

?
TT=1799.42

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl50_51_pb.cnf.cr.opb
UNSAT
TT=0.097

UNSAT
TT=0.399

? (TO)
TT=1800.05

? (problem)
TT=0.021

? (TO)
TT=1800.07

? (problem)
TT=0.018

? (TO)
TT=1800.01

? (problem)
TT=0.021

? (TO)
TT=1800.09

? (problem)
TT=0.02

? (TO)
TT=1800.1

? (TO)
TT=1800.11

? (TO)
TT=1800.03

? (TO)
TT=1800.1

UNSAT
TT=0.227

? (TO)
TT=1800.56

UNSAT
TT=0.326

? (TO)
TT=1800.03

UNSAT
TT=0.117

UNSAT
TT=597.799

UNSAT
TT=0.119

UNSAT
TT=2.234

UNSAT
TT=0.097

UNSAT
TT=0.728

UNSAT
TT=2.054

UNSAT
TT=0.097

? (TO)
TT=1800.08

? (problem)
TT=0.022

? (problem)
TT=0.021

? (TO)
TT=1800.04

? (TO)
TT=1800.1

?
TT=1799.71

?
TT=1799.49

UNSAT
TT=2.104

? (TO)
TT=1800.1

? (TO)
TT=1800.04

UNSAT
TT=0.153

UNSAT
TT=0.157

UNSAT
TT=0.191

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.53

?
TT=1799.49

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl50_55_pb.cnf.cr.opb
UNSAT
TT=0.105

UNSAT
TT=0.573

? (TO)
TT=1800.08

? (problem)
TT=0.021

? (TO)
TT=1800.05

? (problem)
TT=0.021

? (TO)
TT=1800.01

? (problem)
TT=0.021

? (TO)
TT=1800.07

? (problem)
TT=0.022

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.11

? (TO)
TT=1800.1

UNSAT
TT=0.294

?
TT=1598.73

UNSAT
TT=0.455

? (TO)
TT=1800.06

UNSAT
TT=0.123

? (TO)
TT=1800.09

UNSAT
TT=0.129

UNSAT
TT=1.253

UNSAT
TT=0.106

UNSAT
TT=0.722

UNSAT
TT=1.154

UNSAT
TT=0.105

? (TO)
TT=1800.08

? (problem)
TT=0.02

? (problem)
TT=0.021

? (TO)
TT=1800.14

? (TO)
TT=1800.12

?
TT=1799.84

?
TT=1799.83

UNSAT
TT=1.114

? (TO)
TT=1801.02

? (TO)
TT=1800.05

UNSAT
TT=0.137

UNSAT
TT=0.128

UNSAT
TT=0.188

? (TO)
TT=1800.03

? (TO)
TT=1800.02

?
TT=1799.88

?
TT=1799.77

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl50_60_pb.cnf.cr.opb
UNSAT
TT=0.106

UNSAT
TT=3.845

? (TO)
TT=1800.12

? (problem)
TT=0.025

? (TO)
TT=1800.05

? (problem)
TT=0.02

? (TO)
TT=1800.05

? (problem)
TT=0.022

? (TO)
TT=1800.08

? (problem)
TT=0.029

? (TO)
TT=1800.01

? (TO)
TT=1800.05

? (TO)
TT=1800.02

? (TO)
TT=1800.11

UNSAT
TT=0.375

? (TO)
TT=1800

UNSAT
TT=2.6

? (TO)
TT=1800.04

UNSAT
TT=0.117

UNSAT
TT=592.051

UNSAT
TT=0.144

UNSAT
TT=1.284

UNSAT
TT=0.109

UNSAT
TT=0.755

UNSAT
TT=1.143

UNSAT
TT=0.106

? (TO)
TT=1800.05

? (problem)
TT=0.023

? (problem)
TT=0.023

? (TO)
TT=1800.06

? (TO)
TT=1800.1

?
TT=1799.53

?
TT=1799.92

UNSAT
TT=1.215

? (TO)
TT=1800.02

? (TO)
TT=1800.03

UNSAT
TT=0.141

UNSAT
TT=0.145

UNSAT
TT=0.186

? (TO)
TT=1800.11

? (TO)
TT=1800.03

?
TT=1799.55

?
TT=1799.93

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga10_10_sat_pb.cnf.cr.opb
SAT
TT=0.002
T1=0
SAT
TT=0.005
T1=0
SAT
TT=0.041
T1=0.04
? (problem)
TT=0.023

SAT
TT=0.063
T1=0.06
? (problem)
TT=0.025

SAT
TT=0.058
T1=0.06
? (problem)
TT=0.023

SAT
TT=0.054
T1=0.05
? (problem)
TT=0.025

SAT
TT=0.056
T1=0.05
SAT
TT=0.006
T1=0.01
SAT
TT=0.008
T1=0
SAT
TT=0.032
T1=0.03
SAT
TT=0.004
T1=0
SAT
TT=5.965
T1=5.72
SAT
TT=0.003
T1=0
SAT
TT=0.553
T1=0.3
SAT
TT=0.027
T1=0.02
SAT
TT=0.607
T1=1.9
SAT
TT=0.017
T1=0.01
SAT
TT=0.504
T1=1.15
SAT
TT=0.13
T1=0.13
SAT
TT=0.832
T1=0.72
SAT
TT=0.534
T1=0.65
SAT
TT=0.136
T1=0.13
SAT
TT=0.005
T1=0
? (problem)
TT=0.023

? (problem)
TT=0.024

SAT
TT=1.37
T1=1.41
SAT
TT=0.415
T1=0.46
SAT
TT=0.003
T1=0
SAT
TT=0.002
T1=0
SAT
TT=0.566
T1=0.66
SAT
TT=0.364
T1=0.21
SAT
TT=1.964
T1=1.6
SAT
TT=0.18
T1=0.17
SAT
TT=0.163
T1=0.15
SAT
TT=0.03
T1=0.02
SAT
TT=0.014
T1=0.01
SAT
TT=0.015
T1=0.01
SAT
TT=0.002
T1=0
SAT
TT=0.002
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga11_10_sat_pb.cnf.cr.opb
SAT
TT=0.002
T1=0
SAT
TT=0.003
T1=0
SAT
TT=0.744
T1=0.74
? (problem)
TT=0.029

SAT
TT=0.073
T1=0.07
? (problem)
TT=0.027

SAT
TT=0.064
T1=0.06
? (problem)
TT=0.025

SAT
TT=0.064
T1=0.06
? (problem)
TT=0.027

SAT
TT=0.064
T1=0.06
SAT
TT=0.004
T1=0
SAT
TT=0.008
T1=0.01
SAT
TT=0.026
T1=0.03
SAT
TT=0.004
T1=0
SAT
TT=25.559
T1=25.28
SAT
TT=0.002
T1=0
SAT
TT=7.243
T1=6.9
SAT
TT=0.03
T1=0.02
SAT
TT=0.708
T1=1.97
SAT
TT=0.019
T1=0.01
SAT
TT=0.605
T1=1.15
SAT
TT=0.042
T1=0.04
SAT
TT=0.821
T1=0.76
SAT
TT=0.615
T1=0.67
SAT
TT=0.178
T1=0.17
SAT
TT=0.003
T1=0
? (problem)
TT=0.028

? (problem)
TT=0.025

SAT
TT=1.574
T1=1.6
SAT
TT=0.455
T1=0.49
SAT
TT=0.002
T1=0
SAT
TT=0.002
T1=0
SAT
TT=0.575
T1=0.68
SAT
TT=0.354
T1=0.21
SAT
TT=2.81
T1=2.4
SAT
TT=0.185
T1=0.18
SAT
TT=0.188
T1=0.18
SAT
TT=0.034
T1=0.02
SAT
TT=0.018
T1=0.01
SAT
TT=0.016
T1=0.01
SAT
TT=0.003
T1=0
SAT
TT=0.002
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga11_9_sat_pb.cnf.cr.opb
SAT
TT=0.001
T1=0
SAT
TT=0.002
T1=0
SAT
TT=1.385
T1=1.38
? (problem)
TT=0.016

SAT
TT=0.147
T1=0.15
? (problem)
TT=0.016

SAT
TT=0.14
T1=0.14
? (problem)
TT=0.014

SAT
TT=0.141
T1=0.13
? (problem)
TT=0.015

SAT
TT=0.15
T1=0.15
SAT
TT=0.004
T1=0
SAT
TT=0.009
T1=0.01
SAT
TT=0.022
T1=0.01
SAT
TT=0.007
T1=0
SAT
TT=87.34
T1=87.12
SAT
TT=0.003
T1=0
SAT
TT=54.61
T1=54.33
SAT
TT=0.031
T1=0.03
SAT
TT=0.681
T1=1.92
SAT
TT=0.017
T1=0.01
SAT
TT=0.624
T1=1.15
SAT
TT=0.041
T1=0.03
SAT
TT=0.488
T1=0.58
SAT
TT=0.625
T1=0.67
SAT
TT=0.23
T1=0.22
SAT
TT=0.005
T1=0
? (problem)
TT=0.014

? (problem)
TT=0.014

SAT
TT=0.778
T1=0.8
SAT
TT=0.471
T1=0.52
SAT
TT=0.002
T1=0
SAT
TT=0.001
T1=0
SAT
TT=0.584
T1=0.65
SAT
TT=0.325
T1=0.18
SAT
TT=183.455
T1=182.19
SAT
TT=0.27
T1=0.26
SAT
TT=0.27
T1=0.26
SAT
TT=0.031
T1=0.02
SAT
TT=0.021
T1=0.02
SAT
TT=0.019
T1=0.01
SAT
TT=0.002
T1=0
SAT
TT=0.002
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga13_12_sat_pb.cnf.cr.opb
SAT
TT=0.003
T1=0
SAT
TT=0.005
T1=0
SAT
TT=30.745
T1=30.75
? (problem)
TT=0.005

SAT
TT=0.107
T1=0.1
? (problem)
TT=0.006

SAT
TT=0.103
T1=0.1
? (problem)
TT=0.006

SAT
TT=0.104
T1=0.1
? (problem)
TT=0.006

SAT
TT=0.097
T1=0.09
SAT
TT=0.009
T1=0.01
SAT
TT=0.013
T1=0.01
SAT
TT=0.034
T1=0.03
SAT
TT=0.019
T1=0.11
SAT
TT=1671.16
T1=1669.9
SAT
TT=0.003
T1=0
SAT
TT=422.948
T1=422.54
SAT
TT=0.086
T1=0.08
SAT
TT=0.769
T1=2.16
SAT
TT=0.025
T1=0.02
SAT
TT=0.724
T1=1.17
SAT
TT=0.55
T1=0.54
SAT
TT=0.844
T1=0.75
SAT
TT=0.664
T1=0.69
SAT
TT=0.247
T1=0.24
SAT
TT=0.006
T1=0
? (problem)
TT=0.007

? (problem)
TT=0.005

SAT
TT=4.593
T1=4.67
SAT
TT=0.912
T1=0.89
SAT
TT=0.003
T1=0
SAT
TT=0.003
T1=0.01
SAT
TT=0.784
T1=0.68
SAT
TT=0.415
T1=0.23
SAT
TT=438.75
T1=436.98
SAT
TT=0.377
T1=0.37
SAT
TT=0.38
T1=0.37
SAT
TT=0.055
T1=0.04
SAT
TT=0.072
T1=0.07
SAT
TT=0.073
T1=0.07
SAT
TT=0.003
T1=0
SAT
TT=0.003
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga14_12_sat_pb.cnf.cr.opb
SAT
TT=0.002
T1=0
SAT
TT=0.182
T1=0.18
SAT
TT=0.302
T1=0.3
? (problem)
TT=0.007

SAT
TT=0.035
T1=0.03
? (problem)
TT=0.007

SAT
TT=0.031
T1=0.03
? (problem)
TT=0.006

SAT
TT=0.031
T1=0.03
? (problem)
TT=0.008

SAT
TT=0.027
T1=0.02
SAT
TT=0.048
T1=0.05
SAT
TT=0.014
T1=0.01
SAT
TT=0.313
T1=0.3
SAT
TT=0.006
T1=0
? (TO)
TT=1800.06

SAT
TT=0.145
T1=0.14
? (TO)
TT=1800.46

SAT
TT=0.053
T1=0.05
SAT
TT=3.681
T1=4.8
SAT
TT=0.028
T1=0.02
SAT
TT=2.974
T1=1.17
SAT
TT=0.758
T1=0.75
SAT
TT=1.414
T1=1.16
SAT
TT=2.974
T1=1.18
SAT
TT=6.253
T1=6.24
SAT
TT=0.01
T1=0
? (problem)
TT=0.006

? (problem)
TT=0.006

SAT
TT=1.321
T1=1.32
SAT
TT=1.047
T1=1.06
SAT
TT=0.002
T1=0
SAT
TT=0.002
T1=0
SAT
TT=0.874
T1=0.68
SAT
TT=0.407
T1=0.23
? (TO)
TT=1800.55

SAT
TT=0.722
T1=0.71
SAT
TT=0.725
T1=0.71
SAT
TT=0.052
T1=0.04
SAT
TT=0.046
T1=0.05
SAT
TT=0.052
T1=0.05
SAT
TT=0.002
T1=0
SAT
TT=0.003
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga14_13_sat_pb.cnf.cr.opb
SAT
TT=0.003
T1=0
SAT
TT=0.005
T1=0
SAT
TT=0.293
T1=0.29
? (problem)
TT=0.006

SAT
TT=0.622
T1=0.62
? (problem)
TT=0.01

SAT
TT=0.631
T1=0.63
? (problem)
TT=0.007

SAT
TT=0.618
T1=0.61
? (problem)
TT=0.008

SAT
TT=0.617
T1=0.61
SAT
TT=0.005
T1=0
SAT
TT=0.018
T1=0.01
SAT
TT=0.07
T1=0.06
SAT
TT=0.012
T1=0.01
? (TO)
TT=1800.85

SAT
TT=0.004
T1=0
? (TO)
TT=1800.08

SAT
TT=0.055
T1=0.05
SAT
TT=5.137
T1=5.08
SAT
TT=0.044
T1=0.04
SAT
TT=1.204
T1=1.2
SAT
TT=0.416
T1=0.41
SAT
TT=1.006
T1=9.76
SAT
TT=1.135
T1=0.69
SAT
TT=0.505
T1=0.49
SAT
TT=0.006
T1=0.01
? (problem)
TT=0.01

? (problem)
TT=0.01

SAT
TT=7.423
T1=7.56
SAT
TT=0.953
T1=0.97
SAT
TT=0.003
T1=0
SAT
TT=0.003
T1=0
SAT
TT=0.864
T1=0.68
SAT
TT=0.404
T1=0.22
? (TO)
TT=1800.02

SAT
TT=1.264
T1=1.25
SAT
TT=1.22
T1=1.21
SAT
TT=0.036
T1=0.03
SAT
TT=0.05
T1=0.05
SAT
TT=0.049
T1=0.05
SAT
TT=0.003
T1=0
SAT
TT=0.003
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga20_18_sat_pb.cnf.cr.opb
SAT
TT=0.004
T1=0.01
SAT
TT=0.016
T1=0.01
SAT
TT=0.435
T1=0.43
? (problem)
TT=0.045

SAT
TT=0.155
T1=0.15
? (problem)
TT=0.051

SAT
TT=0.146
T1=0.14
? (problem)
TT=0.046

SAT
TT=0.146
T1=0.14
? (problem)
TT=0.05

SAT
TT=0.142
T1=0.14
SAT
TT=1.485
T1=1.48
SAT
TT=0.096
T1=0.09
SAT
TT=0.752
T1=0.74
SAT
TT=0.022
T1=0.02
? (TO)
TT=1800.03

SAT
TT=0.014
T1=0.01
? (TO)
TT=1800.09

SAT
TT=0.179
T1=0.17
SAT
TT=64.635
T1=61.88
SAT
TT=0.152
T1=0.15
SAT
TT=1.603
T1=1.23
SAT
TT=232.601
T1=232.62
SAT
TT=0.484
T1=0.56
SAT
TT=1.433
T1=0.72
?
TT=1796.74

SAT
TT=0.045
T1=0.04
? (problem)
TT=0.046

? (problem)
TT=0.052

? (TO)
TT=1800.06

? (TO)
TT=1800.1

SAT
TT=19.905
T1=19.95
SAT
TT=0.005
T1=0.01
SAT
TT=1.314
T1=0.72
SAT
TT=0.574
T1=0.31
? (TO)
TT=1800.04

SAT
TT=84.299
T1=84.3
SAT
TT=84.646
T1=84.65
SAT
TT=0.186
T1=0.17
SAT
TT=0.095
T1=0.09
SAT
TT=0.102
T1=0.1
SAT
TT=0.004
T1=0.01
SAT
TT=0.004
T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga20_19_sat_pb.cnf.cr.opb
SAT
TT=0.004
T1=0
SAT
TT=0.014
T1=0.01
SAT
TT=0.685
T1=0.68
? (problem)
TT=0.045

SAT
TT=0.05
T1=0.04
? (problem)
TT=0.048

SAT
TT=0.036
T1=0.03
? (problem)
TT=0.047

SAT
TT=0.038
T1=0.04
? (problem)
TT=0.051

SAT
TT=0.04
T1=0.04
SAT
TT=0.013
T1=0.01
SAT
TT=0.139
T1=0.13
SAT
TT=0.251
T1=0.24
SAT
TT=0.023
T1=0.02
? (TO)
TT=1800.04

SAT
TT=0.01
T1=0.01
? (TO)
TT=1801

SAT
TT=0.215
T1=0.21
SAT
TT=64.549
T1=62.98
SAT
TT=0.104
T1=0.1
SAT
TT=1.805
T1=1.23
SAT
TT=1.745
T1=1.73
SAT
TT=0.478
T1=0.58
SAT
TT=1.674
T1=0.74
SAT
TT=1.012
T1=1
SAT
TT=0.068
T1=0.07
? (problem)
TT=0.045

? (problem)
TT=0.045

? (TO)
TT=1800.13

? (TO)
TT=1800.11

SAT
TT=0.005
T1=0
SAT
TT=0.004
T1=0
SAT
TT=1.593
T1=0.74
SAT
TT=0.605
T1=0.32
? (TO)
TT=1800.08

SAT
TT=4.747
T1=4.74
SAT
TT=4.648
T1=4.63
SAT
TT=0.153
T1=0.14
SAT
TT=0.087
T1=0.08
SAT
TT=0.087
T1=0.08
SAT
TT=0.004
T1=0
SAT
TT=0.006
T1=0
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga25_23_sat_pb.cnf.cr.opb
SAT
TT=0.032
T1=0.03
SAT
TT=0.627
T1=0.62
SAT
TT=0.261
T1=0.26
? (problem)
TT=0.018

SAT
TT=15.518
T1=15.52
? (problem)
TT=0.02

SAT
TT=15.697
T1=15.69
? (problem)
TT=0.02

SAT
TT=15.447
T1=15.49
? (problem)
TT=0.017

SAT
TT=15.626
T1=15.63
SAT
TT=83.869
T1=83.87
SAT
TT=7.765
T1=7.76
SAT
TT=0.146
T1=0.13
SAT
TT=0.032
T1=0.03
? (TO)
TT=1800.35

SAT
TT=5.598
T1=5.59
? (TO)
TT=1800.08

SAT
TT=15.529
T1=15.52
SAT
TT=67.782
T1=64.83
SAT
TT=0.203
T1=0.2
SAT
TT=1.672
T1=1.26
SAT
TT=7.565
T1=7.55
SAT
TT=1.145
T1=1.22
SAT
TT=5.705
T1=2.3
SAT
TT=4.165
T1=4.15
SAT
TT=268.347
T1=268.4
? (problem)
TT=0.018

? (problem)
TT=0.019

? (TO)
TT=1800.1

SAT
TT=3.177
T1=3.07
SAT
TT=0.307
T1=0.31
SAT
TT=0.346
T1=0.35
SAT
TT=1.885
T1=0.79
SAT
TT=0.694
T1=0.35
? (TO)
TT=1800.6

?
TT=1796.78

?
TT=1796.78

SAT
TT=2.232
T1=2.22
SAT
TT=0.309
T1=0.3
SAT
TT=0.312
T1=0.31
SAT
TT=0.349
T1=0.34
SAT
TT=0.369
T1=0.36
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga25_24_sat_pb.cnf.cr.opb
SAT
TT=0.027
T1=0.02
SAT
TT=0.437
T1=0.43
SAT
TT=0.776
T1=0.77
? (problem)
TT=0.021

SAT
TT=1.454
T1=1.45
? (problem)
TT=0.023

SAT
TT=1.436
T1=1.43
? (problem)
TT=0.018

SAT
TT=1.423
T1=1.42
? (problem)
TT=0.018

SAT
TT=1.431
T1=1.43
SAT
TT=0.043
T1=0.04
SAT
TT=0.194
T1=0.19
SAT
TT=1279.74
T1=1279.92
SAT
TT=0.235
T1=0.23
? (TO)
TT=1800.01

SAT
TT=0.369
T1=0.36
? (TO)
TT=1800.02

SAT
TT=15.329
T1=15.32
SAT
TT=64.092
T1=61.51
SAT
TT=0.267
T1=0.26
SAT
TT=2.485
T1=1.26
SAT
TT=10.275
T1=10.27
SAT
TT=1.281
T1=0.96
SAT
TT=1.824
T1=0.8
SAT
TT=596.03
T1=596.11
SAT
TT=0.087
T1=0.08
? (problem)
TT=0.026

? (problem)
TT=0.021

? (TO)
TT=1800.03

? (TO)
TT=1800.06

SAT
TT=0.049
T1=0.04
SAT
TT=0.028
T1=0.02
SAT
TT=1.904
T1=0.79
SAT
TT=0.744
T1=0.38
? (TO)
TT=1800.71

SAT
TT=59.272
T1=59.28
SAT
TT=55.517
T1=55.52
SAT
TT=2.346
T1=2.33
SAT
TT=0.275
T1=0.27
SAT
TT=0.273
T1=0.27
SAT
TT=0.028
T1=0.02
SAT
TT=0.027
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga25_25_sat_pb.cnf.cr.opb
SAT
TT=0.027
T1=0.02
SAT
TT=0.032
T1=0.03
SAT
TT=1.227
T1=1.22
? (problem)
TT=0.025

SAT
TT=0.286
T1=0.28
? (problem)
TT=0.02

SAT
TT=0.301
T1=0.29
? (problem)
TT=0.021

SAT
TT=0.278
T1=0.28
? (problem)
TT=0.022

SAT
TT=0.278
T1=0.27
SAT
TT=0.973
T1=0.97
SAT
TT=0.145
T1=0.14
SAT
TT=0.173
T1=0.15
SAT
TT=0.05
T1=0.05
? (TO)
TT=1800.05

SAT
TT=0.028
T1=0.02
? (TO)
TT=1800.03

SAT
TT=14.79
T1=14.79
SAT
TT=64.292
T1=62.79
SAT
TT=0.268
T1=0.26
SAT
TT=2.045
T1=1.27
SAT
TT=3.997
T1=3.99
SAT
TT=1.357
T1=1.02
SAT
TT=2.113
T1=0.78
SAT
TT=2.269
T1=2.26
SAT
TT=0.054
T1=0.05
? (problem)
TT=0.022

? (problem)
TT=0.022

? (TO)
TT=1800.04

? (TO)
TT=1800.1

SAT
TT=0.048
T1=0.04
SAT
TT=0.027
T1=0.02
SAT
TT=1.817
T1=0.79
SAT
TT=0.824
T1=0.39
? (TO)
TT=1800.04

SAT
TT=7.452
T1=7.44
SAT
TT=7.365
T1=7.35
SAT
TT=0.412
T1=0.4
SAT
TT=0.234
T1=0.23
SAT
TT=0.236
T1=0.23
SAT
TT=0.028
T1=0.02
SAT
TT=0.028
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga30_29_sat_pb.cnf.cr.opb
SAT
TT=0.03
T1=0.02
SAT
TT=0.161
T1=0.16
SAT
TT=0.69
T1=0.69
? (problem)
TT=0.031

SAT
TT=0.087
T1=0.09
? (problem)
TT=0.032

SAT
TT=0.075
T1=0.07
? (problem)
TT=0.031

SAT
TT=0.077
T1=0.07
? (problem)
TT=0.035

SAT
TT=0.079
T1=0.07
SAT
TT=0.076
T1=0.08
SAT
TT=0.129
T1=0.13
SAT
TT=0.844
T1=0.82
SAT
TT=0.106
T1=0.1
? (TO)
TT=1800.03

SAT
TT=0.131
T1=0.13
? (TO)
TT=1800.64

SAT
TT=26.846
T1=26.84
SAT
TT=64.039
T1=62.46
SAT
TT=0.863
T1=0.86
SAT
TT=2.844
T1=1.52
SAT
TT=15.929
T1=15.92
SAT
TT=1.585
T1=1.16
SAT
TT=2.673
T1=0.85
SAT
TT=11.931
T1=11.92
SAT
TT=0.03
T1=0.03
? (problem)
TT=0.034

? (problem)
TT=0.03

? (TO)
TT=1800.09

? (TO)
TT=1800.09

SAT
TT=0.032
T1=0.03
SAT
TT=0.031
T1=0.02
SAT
TT=2.234
T1=0.81
SAT
TT=0.886
T1=0.43
? (TO)
TT=1800.05

SAT
TT=14.375
T1=14.37
SAT
TT=14.414
T1=14.39
SAT
TT=4.566
T1=4.55
SAT
TT=0.459
T1=0.45
SAT
TT=0.455
T1=0.45
SAT
TT=0.032
T1=0.02
SAT
TT=0.032
T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga35_33_sat_pb.cnf.cr.opb
SAT
TT=0.036
T1=0.03
SAT
TT=0.58
T1=0.58
SAT
TT=1.085
T1=1.08
? (problem)
TT=0.045

SAT
TT=755.413
T1=755.57
? (problem)
TT=0.048

SAT
TT=696.343
T1=696.45
? (problem)
TT=0.047

SAT
TT=695.519
T1=695.65
? (problem)
TT=0.045

SAT
TT=696.009
T1=696.11
SAT
TT=2.041
T1=2.04
SAT
TT=968.6
T1=968.81
SAT
TT=13.184
T1=13.16
SAT
TT=0.164
T1=0.16
? (TO)
TT=1800.32

SAT
TT=0.527
T1=0.52
? (TO)
TT=1800.06

SAT
TT=36.065
T1=36.06
SAT
TT=281.631
T1=270.21
SAT
TT=0.919
T1=0.91
SAT
TT=19.752
T1=9.34
SAT
TT=19.532
T1=19.53
SAT
TT=1.912
T1=1.31
SAT
TT=3.212
T1=1.38
SAT
TT=1775.45
T1=1775.72
SAT
TT=362.954
T1=363.04
? (problem)
TT=0.045

? (problem)
TT=0.05

? (TO)
TT=1800.08

? (TO)
TT=1800.12

SAT
TT=0.036
T1=0.03
SAT
TT=9.257
T1=9.25
SAT
TT=2.284
T1=0.85
SAT
TT=1.015
T1=0.48
? (TO)
TT=1800.03

?
TT=1796.74

?
TT=1796.75

SAT
TT=5.445
T1=5.57
SAT
TT=0.537
T1=0.53
SAT
TT=0.534
T1=0.53
SAT
TT=9.169
T1=9.16
SAT
TT=9.157
T1=9.17
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga35_34_sat_pb.cnf.cr.opb
SAT
TT=0.016
T1=0.02
SAT
TT=0.073
T1=0.07
SAT
TT=1.034
T1=1.03
? (problem)
TT=0.062

SAT
TT=0.108
T1=0.11
? (problem)
TT=0.048

SAT
TT=0.103
T1=0.1
? (problem)
TT=0.05

SAT
TT=0.099
T1=0.09
? (problem)
TT=0.046

SAT
TT=0.102
T1=0.1
SAT
TT=0.071
T1=0.07
SAT
TT=58.123
T1=58.14
SAT
TT=1.071
T1=1.04
SAT
TT=0.217
T1=0.21
? (TO)
TT=1800.3

SAT
TT=0.065
T1=0.06
? (TO)
TT=1800.68

SAT
TT=41.795
T1=41.79
SAT
TT=64.271
T1=61.71
SAT
TT=1.217
T1=1.21
SAT
TT=3.553
T1=1.33
SAT
TT=94.597
T1=94.6
SAT
TT=1.802
T1=6.61
SAT
TT=2.523
T1=0.84
SAT
TT=16.258
T1=16.24
SAT
TT=55.639
T1=55.65
? (problem)
TT=0.049

? (problem)
TT=0.054

? (TO)
TT=1800.08

? (TO)
TT=1800.06

SAT
TT=0.017
T1=0.02
SAT
TT=0.016
T1=0.02
SAT
TT=3.372
T1=1.36
SAT
TT=1.134
T1=0.49
? (TO)
TT=1800.08

?
TT=1796.77

?
TT=1796.76

SAT
TT=6.119
T1=6.09
SAT
TT=2.141
T1=2.13
SAT
TT=2.112
T1=2.11
SAT
TT=0.017
T1=0.02
SAT
TT=0.019
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga35_35_sat_pb.cnf.cr.opb
SAT
TT=0.038
T1=0.02
SAT
TT=0.087
T1=0.08
SAT
TT=1.577
T1=1.57
? (problem)
TT=0.051

SAT
TT=1.359
T1=1.35
? (problem)
TT=0.051

SAT
TT=1.363
T1=1.36
? (problem)
TT=0.054

SAT
TT=1.355
T1=1.35
? (problem)
TT=0.055

SAT
TT=1.353
T1=1.35
SAT
TT=0.097
T1=0.09
SAT
TT=33.013
T1=33.03
SAT
TT=3.541
T1=3.51
SAT
TT=0.209
T1=0.21
? (TO)
TT=1800.01

SAT
TT=0.083
T1=0.08
? (TO)
TT=1800.06

SAT
TT=49.863
T1=49.85
SAT
TT=64.064
T1=62.49
SAT
TT=2.107
T1=2.1
SAT
TT=2.994
T1=1.34
SAT
TT=22.301
T1=22.29
SAT
TT=1.833
T1=1.31
SAT
TT=2.574
T1=0.84
?
TT=1796.76

SAT
TT=25.883
T1=25.88
? (problem)
TT=0.052

? (problem)
TT=0.055

? (TO)
TT=1800.07

? (TO)
TT=1800.11

SAT
TT=0.038
T1=0.03
SAT
TT=0.038
T1=0.02
SAT
TT=2.553
T1=0.85
SAT
TT=1.114
T1=0.51
? (TO)
TT=1800.05

SAT
TT=22.456
T1=22.45
SAT
TT=22.292
T1=22.27
SAT
TT=6.588
T1=6.57
SAT
TT=2.002
T1=2
SAT
TT=2.04
T1=2.03
SAT
TT=0.038
T1=0.02
SAT
TT=0.041
T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga40_38_sat_pb.cnf.cr.opb
SAT
TT=0.023
T1=0.02
SAT
TT=0.113
T1=0.11
SAT
TT=1.091
T1=1.09
? (problem)
TT=0.071

SAT
TT=35.618
T1=35.62
? (problem)
TT=0.067

SAT
TT=36.007
T1=36.01
? (problem)
TT=0.065

SAT
TT=34.788
T1=34.79
? (problem)
TT=0.066

SAT
TT=35.926
T1=35.93
SAT
TT=0.114
T1=0.11
SAT
TT=1291.57
T1=1291.82
? (TO)
TT=1800.04

SAT
TT=1.549
T1=1.55
? (TO)
TT=1800.05

SAT
TT=0.103
T1=0.1
? (TO)
TT=1800.09

SAT
TT=67.117
T1=67.12
SAT
TT=11.941
T1=12.61
SAT
TT=1.789
T1=1.78
SAT
TT=2.763
T1=1.58
SAT
TT=26.519
T1=26.5
SAT
TT=1.739
T1=1.81
SAT
TT=3.563
T1=1.39
SAT
TT=20.589
T1=20.57
SAT
TT=374.256
T1=374.34
? (problem)
TT=0.068

? (problem)
TT=0.075

? (TO)
TT=1800.05

? (TO)
TT=1800.11

SAT
TT=0.023
T1=0.03
SAT
TT=0.023
T1=0.02
SAT
TT=2.344
T1=0.88
SAT
TT=1.126
T1=0.51
? (TO)
TT=1800.05

?
TT=1796.75

?
TT=1796.76

SAT
TT=6.822
T1=6.79
SAT
TT=1.142
T1=1.14
SAT
TT=1.082
T1=1.08
SAT
TT=0.026
T1=0.03
SAT
TT=0.027
T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga40_39_sat_pb.cnf.cr.opb
SAT
TT=0.116
T1=0.11
SAT
TT=0.268
T1=0.26
SAT
TT=1.27
T1=1.26
? (problem)
TT=0.089

SAT
TT=264.787
T1=264.83
? (problem)
TT=0.09

SAT
TT=255.43
T1=255.6
? (problem)
TT=0.073

SAT
TT=266.666
T1=266.7
? (problem)
TT=0.069

SAT
TT=265.771
T1=265.81
SAT
TT=0.127
T1=0.12
SAT
TT=110.825
T1=110.85
SAT
TT=6.148
T1=7.51
SAT
TT=0.427
T1=0.43
? (TO)
TT=1800.55

SAT
TT=0.246
T1=0.24
? (TO)
TT=1800.06

SAT
TT=69.231
T1=69.22
SAT
TT=66.013
T1=63
SAT
TT=2.239
T1=2.23
SAT
TT=2.954
T1=1.35
?
TT=1789.75

SAT
TT=1.146
T1=1.2
SAT
TT=4.013
T1=1.4
?
TT=1796.74

? (TO)
TT=1800.11

? (problem)
TT=0.076

? (problem)
TT=0.089

? (TO)
TT=1800.04

? (TO)
TT=1800

SAT
TT=0.116
T1=0.11
SAT
TT=0.194
T1=0.18
SAT
TT=2.634
T1=0.87
SAT
TT=1.135
T1=0.52
? (TO)
TT=1800.58

?
TT=1796.79

?
TT=1796.79

SAT
TT=10.626
T1=10.6
SAT
TT=3.644
T1=3.64
SAT
TT=3.591
T1=3.59
SAT
TT=0.173
T1=0.17
SAT
TT=0.174
T1=0.17
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga45_45_sat_pb.cnf.cr.opb
SAT
TT=0.074
T1=0.07
SAT
TT=0.384
T1=0.38
SAT
TT=1.335
T1=1.33
? (problem)
TT=0.109

SAT
TT=563.69
T1=563.8
? (problem)
TT=0.098

SAT
TT=566.604
T1=566.71
? (problem)
TT=0.1

SAT
TT=560.03
T1=560.14
? (problem)
TT=0.099

SAT
TT=560.173
T1=560.26
SAT
TT=0.332
T1=0.33
SAT
TT=0.571
T1=0.57
SAT
TT=4.824
T1=4.77
SAT
TT=0.608
T1=0.6
? (TO)
TT=1800.01

SAT
TT=0.327
T1=0.32
? (TO)
TT=1800.08

SAT
TT=122.461
T1=122.46
SAT
TT=64.294
T1=61.48
SAT
TT=4.642
T1=4.63
SAT
TT=3.054
T1=1.4
SAT
TT=34.72
T1=34.7
SAT
TT=1.521
T1=2.3
SAT
TT=3.802
T1=1.4
SAT
TT=26.085
T1=26.09
SAT
TT=0.166
T1=0.16
? (problem)
TT=0.103

? (problem)
TT=0.101

? (TO)
TT=1800.09

? (TO)
TT=1800.04

SAT
TT=0.145
T1=0.13
SAT
TT=0.074
T1=0.07
SAT
TT=2.993
T1=0.99
SAT
TT=1.395
T1=0.73
? (TO)
TT=1800.05

SAT
TT=26.834
T1=26.82
SAT
TT=25.696
T1=25.67
SAT
TT=13.017
T1=12.98
SAT
TT=5.003
T1=5
SAT
TT=4.827
T1=4.82
SAT
TT=0.074
T1=0.07
SAT
TT=0.084
T1=0.07



Statisticsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
Number of times the solver is able to give the best known answer30200200200200201920193050530293030293030271900892020302052525300192020
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
000000000000060000010200510000780000000076