PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade, subsubcategory MPS to OPB

This page displays the results of the different solvers for each benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade, subsubcategory MPS to OPB

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)

Bench nameBest results
on this
instance
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-blend.opb
OPT
f=0
TT=78.661
T1=0.37
? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800

? (TO)

TT=1800.02

? (TO)

TT=1800.06

SAT (TO)
f=0
TT=1800.04
T1=0.15
SAT (TO)
f=2542922221368
TT=1800.08
T1=1779.96
? (exit code)

TT=1203.33

? (TO)

TT=1801.14

OPT
f=0
TT=267.804
T1=1.41
SAT
f=0
TT=1792
T1=0.03
OPT
f=0
TT=1126.5
T1=0.95
SAT (TO)
f=2500775267180
TT=1800.08
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.04

SAT (TO)
f=3231332497982
TT=1800.16
T1=8.5
? (TO)

TT=1800.04

OPT
f=0
TT=78.661
T1=0.37
? (TO)

TT=1800.02

? (TO)

TT=1800.02

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-brandy.opb
UNSAT

TT=0.052

? (TO)

TT=1800.02

UNSAT

TT=135.448

? (TO)

TT=1800.08

UNSAT

TT=136.81

? (TO)

TT=1800.02

UNSAT

TT=136.62

? (TO)

TT=1800.01

UNSAT

TT=135.09

UNSAT

TT=0.068

UNSAT

TT=1.09

UNSAT

TT=1.134

UNSAT

TT=1.054

UNSAT

TT=1.335

UNSAT

TT=0.123

UNSAT

TT=1.595

UNSAT

TT=0.052

? (TO)

TT=1800.09

? (TO)

TT=1800.01

UNSAT

TT=1.474

UNSAT

TT=0.946

UNSAT

TT=0.954

? (TO)

TT=1800.02

UNSAT

TT=0.54

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-degen3.opb




? (MO)

TT=270.66

? (problem)

TT=122.11

? (MO)

TT=281.66

? (problem)

TT=121.724

? (MO)

TT=271.99

? (problem)

TT=124.043

? (MO)

TT=290.36

? (problem)

TT=122.131

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.72

?

TT=1789.98

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (problem)

TT=143.501

? (problem)

TT=149.411

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.09

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-modszk1.opb




? (problem)

TT=182.532

? (TO)

TT=1800.01

? (problem)

TT=178.111

? (TO)

TT=1800.08

? (problem)

TT=201.488

? (TO)

TT=1800.07

? (problem)

TT=197.718

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.74

? (TO)

TT=1801.66

UNSAT

TT=1.38

? (TO)

TT=1800.55

? (TO)

TT=1800.07

? (MO)

TT=171.02

? (MO)

TT=171.04

? (TO)

TT=1800.17

? (TO)

TT=1800.71

? (TO)

TT=1800.36

? (TO)

TT=1800.07

UNSAT

TT=108.833

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-scagr25.opb
UNSAT

TT=0.045

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.09

UNSAT

TT=0.079

UNSAT

TT=0.613

UNSAT

TT=1.443

UNSAT

TT=1.534

UNSAT

TT=2.053

UNSAT

TT=0.164

UNSAT

TT=1.905

UNSAT

TT=0.045

? (TO)

TT=1800.02

? (TO)

TT=1800.02

UNSAT

TT=2.034

UNSAT

TT=1.135

UNSAT

TT=1.104

? (TO)

TT=1800.11

UNSAT

TT=23.079

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-scagr7.opb
UNSAT

TT=0.013

? (TO)

TT=1800.03

UNSAT

TT=15.026

? (TO)

TT=1800.02

UNSAT

TT=14.37

? (TO)

TT=1800.01

UNSAT

TT=14.311

? (TO)

TT=1800.02

UNSAT

TT=13.861

UNSAT

TT=0.025

UNSAT

TT=0.152

UNSAT

TT=1.055

UNSAT

TT=1.035

UNSAT

TT=1.533

UNSAT

TT=0.054

UNSAT

TT=1.605

UNSAT

TT=0.013

? (TO)

TT=1800.02

? (TO)

TT=1800.02

UNSAT

TT=1.633

UNSAT

TT=0.834

UNSAT

TT=0.762

? (TO)

TT=1800.01

UNSAT

TT=1.723

normalized-PB06/OPT-BIGINT/mps-v2-20-10/
ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-scorpion.opb




? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.05

Signal

TT=362.06

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.61

UNSAT

TT=1.552

? (TO)

TT=1800.14

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (exit code)

TT=619.622

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-seba.opb
SAT
f=20367073880
TT=1800.19
T1=46.9
? (problem)

TT=336.761

? (TO)

TT=1800.08

? (problem)

TT=323.521

? (TO)

TT=1800.08

? (problem)

TT=340.111

? (TO)

TT=1800

? (problem)

TT=326.933

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.2

SAT
f=17916854142
TT=1789.84
T1=1790.02
SAT (TO)
f=20367073880
TT=1800.19
T1=46.9
? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.08

SAT (TO)
f=20480665600
TT=1800.03
T1=25.44
SAT (TO)
f=23171349459
TT=1800.04
T1=1118.62
? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-share1b.opb
UNSAT

TT=0.375

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.03

UNSAT

TT=0.043

UNSAT

TT=0.65

UNSAT

TT=1.018

UNSAT

TT=1.034

UNSAT

TT=1.396

UNSAT

TT=0.087

UNSAT

TT=1.6

UNSAT

TT=0.375

? (TO)

TT=1800.02

? (TO)

TT=1800.02

UNSAT

TT=1.523

UNSAT

TT=0.804

UNSAT

TT=0.806

? (TO)

TT=1800.11

UNSAT

TT=0.36

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-ship04s.opb
UNSAT

TT=0.776

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

UNSAT

TT=0.218

UNSAT

TT=2.782

UNSAT

TT=1.068

UNSAT

TT=0.776

UNSAT

TT=0.915

UNSAT

TT=0.478

UNSAT

TT=1.075

UNSAT

TT=1.45

? (TO)

TT=1800.02

? (TO)

TT=1800.02

UNSAT

TT=1.107

UNSAT

TT=0.905

UNSAT

TT=0.924

UNSAT

TT=238.442

UNSAT

TT=231.717

Bench nameBest resultsnpSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-wood1p.opb




? (problem)

TT=0.431

? (problem)

TT=0.454

? (problem)

TT=0.412

? (problem)

TT=0.441

? (problem)

TT=0.405

? (problem)

TT=0.439

? (problem)

TT=0.427

? (problem)

TT=0.453

?

TT=1.572

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.86

? (TO)

TT=1800.1

UNSAT

TT=489.368

? (TO)

TT=1800.62

? (TO)

TT=1800.08

? (problem)

TT=0.389

? (problem)

TT=0.386

? (TO)

TT=1800.59

? (TO)

TT=1800.1

? (TO)

TT=1800

? (TO)

TT=1800.03

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-woodw.opb
UNSAT

TT=2.952

? (TO)

TT=1800.02

? (problem)

TT=197.5

? (TO)

TT=1800.01

? (problem)

TT=196.805

? (TO)

TT=1800.01

? (problem)

TT=195.967

? (TO)

TT=1800.08

? (problem)

TT=198.825

UNSAT

TT=2.315

UNSAT

TT=72.945

UNSAT

TT=9.282

UNSAT

TT=10.392

UNSAT

TT=16.352

UNSAT

TT=3.7

UNSAT

TT=15.341

UNSAT

TT=2.952

? (TO)

TT=1800.02

? (TO)

TT=1800.02

UNSAT

TT=12.911

UNSAT

TT=5.893

UNSAT

TT=5.531

UNSAT

TT=1009.2

UNSAT

TT=634.41

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-a1c1s1.opb




? (MO)

TT=200.14

? (MO)

TT=131.39

? (MO)

TT=217.96

? (MO)

TT=130.74

? (MO)

TT=203.29

? (MO)

TT=129.14

? (MO)

TT=225.8

? (MO)

TT=128.63

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.22

? (TO)

TT=1801.02

UNSAT

TT=39.114

? (TO)

TT=1800.89

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.2

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mkc.opb
SAT
f=-147500
TT=1800.09
T1=1552.77
? (TO)

TT=1800.02

? (TO)

TT=1800

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.03

Signal

TT=774.688

? (TO)

TT=1800.07

No Cert.

TT=838.9

? (exit code)

TT=1126.76

? (TO)

TT=1800.17

SAT
f=0
TT=1789.71
T1=0.06
? (TO)

TT=1800.53

SAT (TO)
f=0
TT=1800
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.08

SAT (TO)
f=-120625
TT=1800.95
T1=0.89
SAT (TO)
f=-128625
TT=1800.83
T1=0.94
SAT (TO)
f=-147500
TT=1800.09
T1=1552.77
? (TO)

TT=1800.07

? (TO)

TT=1800.03

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-nsrand-ipx.opb
SAT
f=1205862294
TT=1800.56
T1=95.44
? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.07

SAT (TO)
f=1207959552
TT=1800.11
T1=5.78
? (TO)

TT=1800.08

SAT (TO)
f=1340014445
TT=1800.51
T1=1681.67
SAT (TO)
f=1205862294
TT=1800.56
T1=95.44
SAT (TO)
f=1207959552
TT=1800.12
T1=155.82
SAT
f=1133706240
TT=1789.85
T1=1017.42
SAT (TO)
f=1207959552
TT=1800.07
T1=31.97
? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.1

SAT (TO)
f=1613627391
TT=1800.29
T1=936.44
SAT (TO)
f=1612709887
TT=1800.04
T1=81.78
SAT (TO)
f=1207959552
TT=1800.07
T1=0.88
? (TO)

TT=1800.1

? (TO)

TT=1800.02

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-rout.opb
SAT
f=1074949888
TT=1800.85
T1=1558.79
? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800

SAT (TO)
f=1075346944
TT=1800.04
T1=516.64
SAT (TO)
f=1075131904
TT=1800.11
T1=579.87
No Cert.

TT=1802.06

SAT (TO)
f=1074949888
TT=1800.85
T1=1558.79
SAT (TO)
f=1075062528
TT=1800.11
T1=450.91
Wrong Cert.

TT=922.547

SAT (TO)
f=1075070720
TT=1800.49
T1=898.22
SAT (TO)
f=1075079936
TT=1800.07
T1=1800.5
? (TO)

TT=1800.01

? (TO)

TT=1800.02

SAT (TO)
f=1075005952
TT=1800.67
T1=555.37
SAT (TO)
f=1075059456
TT=1800.01
T1=1213.7
SAT (TO)
f=1074999808
TT=1800.09
T1=992.85
? (TO)

TT=1800.02

? (TO)

TT=1800.02

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-qnet1.opb
UNSAT

TT=0.09

? (TO)

TT=1800.02

UNSAT

TT=2.053

? (TO)

TT=1800.02

UNSAT

TT=1.825

? (TO)

TT=1800.02

UNSAT

TT=1.81

? (TO)

TT=1800.02

UNSAT

TT=1.862

UNSAT

TT=0.021

UNSAT

TT=0.97

UNSAT

TT=1.617

UNSAT

TT=1.443

UNSAT

TT=2.923

UNSAT

TT=0.088

UNSAT

TT=3.265

UNSAT

TT=0.09

? (TO)

TT=1800.02

? (TO)

TT=1800.01

UNSAT

TT=2.464

UNSAT

TT=1.193

UNSAT

TT=0.663

UNSAT

TT=1.781

UNSAT

TT=1.757

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-misc06.opb




? (TO)

TT=1800.02

? (problem)

TT=0.073

? (TO)

TT=1800.02

? (problem)

TT=0.077

? (TO)

TT=1800.09

? (problem)

TT=0.082

? (TO)

TT=1800.02

? (problem)

TT=0.075

?

TT=0.13

Signal

TT=493.904

? (exit code)

TT=1065.98

? (TO)

TT=1800.23

? (TO)

TT=1800.19

UNSAT

TT=0.835

? (TO)

TT=1800.18

? (MO)

TT=657.29

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.02

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod013.opb
SAT
f=29890560
TT=1800.19
T1=814.89
? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.1

SAT (TO)
f=44219296
TT=1800.08
T1=15.3
SAT (TO)
f=43475091
TT=1800.1
T1=610.76
SAT (TO)
f=33049600
TT=1800.02
T1=0.52
SAT (TO)
f=32737280
TT=1800.37
T1=934.4
SAT (TO)
f=31406080
TT=1801.29
T1=91.38
OPT
f=28769280
TT=25.834
T1=23.69
SAT (TO)
f=29890560
TT=1800.19
T1=814.89
SAT (TO)
f=37876336
TT=1800.08
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.02

SAT (TO)
f=32537600
TT=1800.13
T1=2.81
SAT (TO)
f=31749120
TT=1800.07
T1=1657.24
SAT (TO)
f=32179200
TT=1800.6
T1=1564.79
? (TO)

TT=1800.11

? (TO)

TT=1800.03

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-rgn.opb
SAT
f=893264
TT=1800.06
T1=1723.84
? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.06

SAT (TO)
f=893264
TT=1800.06
T1=1723.84
? (TO)

TT=1800.46

? (TO)

TT=1800.09

? (TO)

TT=1801.09

?

TT=1790.08

? (TO)

TT=1800.18

SAT (TO)
f=1089124
TT=1800.03
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.85

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.07

Bench nameBest resultsnpSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/plato.asu.edu/pub/fctp/
normalized-mps-v2-20-10-n370a.opb
SAT
f=10179070629
TT=1800.32
T1=36.12
? (TO)

TT=1800.02

? (problem)

TT=99.445

? (TO)

TT=1800.02

? (problem)

TT=100.779

? (TO)

TT=1800.01

? (problem)

TT=100.778

? (TO)

TT=1800.01

? (problem)

TT=98.35

Signal

TT=521.333

? (TO)

TT=1800.08

SAT (TO)
f=10588553132
TT=1804.16
T1=31.47
SAT (TO)
f=10179070629
TT=1800.32
T1=36.12
? (TO)

TT=1801.03

Wrong UNSAT

TT=1331.15

SAT (TO)
f=14718324449
TT=1800.51
T1=261.36
? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.02

SAT (TO)
f=30868248806
TT=1800.87
T1=58.35
? (TO)

TT=1800

SAT (TO)
f=21327862917
TT=1800.43
T1=30.78
? (TO)

TT=1800.07

? (TO)

TT=1800.1

normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/fctp/
normalized-mps-v2-20-10-ran12x21.opb
SAT
f=5516295
TT=1800.71
T1=22.28
? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.08

SAT (TO)
f=10333602
TT=1800.09
T1=249.66
SAT (TO)
f=26538369
TT=1800.07
T1=1735.43
SAT (TO)
f=6105088
TT=1800.01
T1=1.51
SAT (TO)
f=7033876
TT=1800.88
T1=1.81
SAT (TO)
f=6473725
TT=1800.16
T1=58.63
Wrong Opt.
f=5789071
TT=1236.73
T1=469.38
SAT (TO)
f=5516295
TT=1800.71
T1=22.28
SAT (TO)
f=23672838
TT=1800.09
T1=1800.5
? (TO)

TT=1800.01

? (TO)

TT=1800.02

SAT (TO)
f=9441250
TT=1800.6
T1=42.86
SAT (TO)
f=14851421
TT=1800.06
T1=0.79
SAT (TO)
f=10481249
TT=1800.59
T1=54.89
? (TO)

TT=1800.11

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos11.opb
OPT
f=9216
TT=192.164
T1=14.93
? (MO)

TT=194.62

? (TO)

TT=1800.06

? (MO)

TT=196.41

? (TO)

TT=1800.08

? (MO)

TT=204.55

? (TO)

TT=1800.14

? (MO)

TT=206.33

? (TO)

TT=1800.11

SAT (TO)
f=9216
TT=1800.05
T1=640.06
OPT
f=9216
TT=489.615
T1=444.75
OPT
f=9216
TT=225.89
T1=46.43
OPT
f=9216
TT=277.852
T1=58.36
OPT
f=9216
TT=387.355
T1=25.67
SAT
f=10240
TT=1789.79
T1=1591.56
OPT
f=9216
TT=194.344
T1=14.93
OPT
f=9216
TT=225.383
T1=225.43
? (TO)

TT=1800.08

? (TO)

TT=1800.05

SAT (TO)
f=11264
TT=1800.09
T1=12.43
OPT
f=9216
TT=218.78
T1=43.81
OPT
f=9216
TT=192.164
T1=27.68
? (TO)

TT=1800.03

? (TO)

TT=1800.02

normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-bg512142.opb
SAT
f=15026065169129
TT=1800.74
T1=2.97
? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1801.72

? (TO)

TT=1800.63

? (TO)

TT=1800.12

Wrong UNSAT

TT=124.741

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.02

SAT (TO)
f=22148925268443
TT=1800.08
T1=2.69
SAT (TO)
f=15026065169129
TT=1800.74
T1=2.97
? (TO)

TT=1800.92

? (TO)

TT=1800.02

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-blp-ic98.opb
SAT
f=1090626176
TT=1800.08
T1=594.5
? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.09

Signal

TT=811.356

Signal

TT=243.661

? (TO)

TT=1800.44

? (TO)

TT=1800.06

? (TO)

TT=1800.9

?

TT=1789.87

? (TO)

TT=1800.15

? (MO)

TT=372.75

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.2

? (TO)

TT=1800.07

SAT (TO)
f=1090626176
TT=1800.08
T1=594.5
? (TO)

TT=1800.09

? (TO)

TT=1800.1

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-sp98ic.opb
SAT
f=3860756214
TT=1800.01
T1=363.4
? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.01

SAT (TO)
f=4618416110
TT=1800.15
T1=914.95
SAT (TO)
f=116514206638
TT=1800.1
T1=232.1
SAT (TO)
f=4026056741
TT=1800.07
T1=2.37
SAT (TO)
f=4026056741
TT=1800.07
T1=2.54
SAT (TO)
f=3860756214
TT=1800.01
T1=363.4
SAT
f=2897121594
TT=1789.89
T1=1790.05
SAT (TO)
f=3897566335
TT=1800.09
T1=3.39
SAT (TO)
f=102092345218
TT=1800.07
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.1

SAT (TO)
f=3897566335
TT=1800.48
T1=52.48
SAT (TO)
f=3897566335
TT=1800.07
T1=60.69
SAT (TO)
f=5639465843
TT=1800.83
T1=1.11
? (TO)

TT=1800.1

? (TO)

TT=1800.11

normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-usAbbrv.8.25_70.opb
SAT
f=123904
TT=1800.02
T1=169.89
? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.04

Signal

TT=1677.12

SAT (TO)
f=125952
TT=1800.03
T1=1538.16
SAT (TO)
f=124928
TT=1800.77
T1=1416.3
SAT (TO)
f=125952
TT=1800.84
T1=576.74
SAT (TO)
f=126976
TT=1800.45
T1=962.53
SAT
f=189440
TT=1789.86
T1=1304.21
SAT (TO)
f=128000
TT=1800.13
T1=793.67
SAT (TO)
f=125952
TT=1800.07
T1=1800.4
? (TO)

TT=1800.01

? (TO)

TT=1800.01

SAT (TO)
f=123904
TT=1800.02
T1=556.84
SAT (TO)
f=123904
TT=1800.03
T1=169.89
SAT (TO)
f=124928
TT=1800
T1=453.19
? (TO)

TT=1800.11

? (TO)

TT=1800.02

normalized-PB06/OPT-MEDINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-gt2.opb
OPT
f=21166
TT=4.313
T1=3.22
? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.01

? (TO)

TT=1800.35

SAT (TO)
f=21166
TT=1800.01
T1=273.84
SAT (TO)
f=64860
TT=1800.12
T1=584.68
? (TO)

TT=1800.06

SAT (TO)
f=107340
TT=1800.04
T1=1060.64
OPT
f=21166
TT=4.393
T1=6.21
OPT
f=21166
TT=0.686
T1=0.67
OPT
f=21166
TT=4.313
T1=3.22
SAT (TO)
f=60195
TT=1800
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.12

OPT
f=21166
TT=6.023
T1=4.21
SAT (TO)
f=25652
TT=1800.01
T1=1393.67
SAT (TO)
f=247501
TT=1800.06
T1=1109.48
? (TO)

TT=1800.02

? (TO)

TT=1800.03

normalized-PB06/OPT-MEDINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-air03.opb
SAT
f=199987
TT=1800.08
T1=1359.36
? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.08

SAT (TO)
f=247744
TT=1800.05
T1=1571.42
SAT (TO)
f=296312
TT=1800.09
T1=1431.73
No Cert.

TT=270.04

SAT (TO)
f=225993
TT=1800.02
T1=891.72
SAT (TO)
f=200105
TT=1800.7
T1=450.27
OPT
f=170080
TT=19.051
T1=18.99
SAT (TO)
f=200394
TT=1800.03
T1=156.86
SAT (TO)
f=307057
TT=1800.03
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.07

SAT (TO)
f=200394
TT=1800.18
T1=36.03
SAT (TO)
f=213885
TT=1800.05
T1=199.98
SAT (TO)
f=199987
TT=1800.08
T1=1359.36
? (TO)

TT=1800.09

? (TO)

TT=1800.1

normalized-PB06/OPT-MEDINT/mps-v2-20-10/
plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-seymour1.opb
SAT
f=471080
TT=1800.2
T1=201.56
? (MO)

TT=311.22

? (TO)

TT=1800

? (MO)

TT=301.41

? (TO)

TT=1800.08

? (MO)

TT=303.92

? (TO)

TT=1800.04

? (MO)

TT=298.82

? (TO)

TT=1800.1

Signal

TT=1607.44

SAT (TO)
f=1008256
TT=1800.06
T1=137.33
SAT (TO)
f=471086
TT=1800.42
T1=1.36
SAT (TO)
f=471086
TT=1800.05
T1=1.33
SAT (TO)
f=471080
TT=1800.75
T1=201.56
SAT
f=444370
TT=1789.87
T1=978.33
SAT (TO)
f=471080
TT=1800.2
T1=203.77
SAT (TO)
f=1008256
TT=1800.04
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.1

SAT (TO)
f=471083
TT=1800.65
T1=56.93
SAT (TO)
f=471086
TT=1800.59
T1=1.03
SAT (TO)
f=495616
TT=1800.08
T1=1.15
? (TO)

TT=1800.07

? (TO)

TT=1800.06




StatisticsnpSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
Number of times the solver is able to give the best known answer0303030309811120148009101230
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
00000000010420560012500