MAX-CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in extension (2-ARY-EXT), subcategory problems with patterns

This page displays the results of the different solvers for each benchmark for category binary constraints in extension (2-ARY-EXT), subcategory problems with patterns

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance
textthe solver was ended by a signal
textthe solver gave an incomplete answer
textthe solver was disqualified in the category
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
AbsconMax 112 pc-d
AbsconMax 112 pc-w
Concrete + CSP4J - MCRW Engine 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Sugar v1.13+minisat
Sugar++ v1.13+minisat-inc
toulbar2 2008-06-27
toulbar2/BTD 2008-06-27

Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/BH-4-13/
normalized-BlackHole-4-13-e-0_ext.xml
MSAT TO
f=2
TT=3600.03

MSAT (TO)
f=9
TT=1619.71
T1=2.99
MSAT (TO)
f=9
TT=1573.87
T1=3.25
MSAT (TO)
f=2
TT=3600.03

MSAT (TO)
f=6
TT=3600.06

MSAT (MO)
f=120
TT=134.53
T1=123.41
? (MO)

TT=58.318

? (TO)

TT=3600.01

? (TO)

TT=3600.06

csp/BH-4-13/
normalized-BlackHole-4-13-e-1_ext.xml
MSAT TO
f=2
TT=3600.05

MSAT (TO)
f=9
TT=1626.71
T1=32.58
MSAT (TO)
f=9
TT=1610.54
T1=36.15
MSAT (TO)
f=2
TT=3600.05

MSAT (TO)
f=6
TT=3600.05

MSAT (MO)
f=209
TT=150.82
T1=138.82
? (MO)

TT=60.898

? (TO)

TT=3600.06

? (TO)

TT=3600.06

csp/BH-4-13/
normalized-BlackHole-4-13-e-2_ext.xml
MSAT TO
f=3
TT=3600.08

MSAT (TO)
f=10
TT=1594.42
T1=17.31
MSAT (TO)
f=10
TT=1626.61
T1=17.21
MSAT (TO)
f=3
TT=3600.08

MSAT (TO)
f=5
TT=3600.05

MSAT (MO)
f=122
TT=138.96
T1=126.91
? (MO)

TT=59.935

? (TO)

TT=3600.03

? (TO)

TT=3600.05

csp/BH-4-13/
normalized-BlackHole-4-13-e-3_ext.xml
MSAT TO
f=2
TT=3600.05

MSAT (TO)
f=7
TT=1620.34
T1=34.15
MSAT (TO)
f=7
TT=1600.47
T1=30.74
MSAT (TO)
f=2
TT=3600.05

MSAT (TO)
f=6
TT=3600.04

MSAT (MO)
f=308
TT=137.304
T1=126.09
? (MO)

TT=60.104

? (TO)

TT=3600.1

? (TO)

TT=3600.07

csp/BH-4-13/
normalized-BlackHole-4-13-m-0_ext.xml
MSAT TO
f=2
TT=3600.1

MSAT (TO)
f=8
TT=1619.33
T1=4.73
MSAT (TO)
f=8
TT=1595.75
T1=4.74
MSAT (TO)
f=2
TT=3600.1

MSAT (TO)
f=4
TT=3600.08

MSAT (MO)
f=128
TT=159.68
T1=146.89
? (MO)

TT=57.817

? (TO)

TT=3600.02

? (TO)

TT=3600.06

csp/BH-4-13/
normalized-BlackHole-4-13-m-1_ext.xml
MSAT TO
f=2
TT=3600.05

MSAT (TO)
f=5
TT=1626.62
T1=39.79
MSAT (TO)
f=5
TT=1594.55
T1=36.85
MSAT (TO)
f=2
TT=3600.05

MSAT (TO)
f=4
TT=3600.08

MSAT (MO)
f=130
TT=134.02
T1=122.64
? (MO)

TT=63.018

? (TO)

TT=3600.08

? (TO)

TT=3600.02

csp/BH-4-13/
normalized-BlackHole-4-13-m-2_ext.xml
MSAT TO
f=2
TT=3600.08

MSAT (TO)
f=7
TT=1600.96
T1=7.24
MSAT (TO)
f=7
TT=1589.81
T1=8.03
MSAT (TO)
f=2
TT=3600.08

MSAT (TO)
f=5
TT=3600.04

MSAT (MO)
f=126
TT=137.34
T1=125.96
? (MO)

TT=64.927

? (TO)

TT=3600.1

? (TO)

TT=3600.04

csp/BH-4-4/
normalized-BlackHole-4-4-e-0_ext.xml
MOPT
f=1
TT=1.617
T1=0
MSAT (TO)
f=1
TT=1581.05
T1=0.76
MSAT (TO)
f=1
TT=1582.65
T1=0.97
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=6.199
T1=5.61
OPTIMUM
f=1
TT=359.681
T1=359.38
OPTIMUM
f=1
TT=1.617
T1=0
OPTIMUM
f=1
TT=6.398
T1=6.33
csp/BH-4-4/
normalized-BlackHole-4-4-e-1_ext.xml
MOPT
f=1
TT=1.492
T1=0
MSAT (TO)
f=1
TT=1571.12
T1=1.37
MSAT (TO)
f=1
TT=1586.45
T1=1.38
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=41.085
T1=40.48
OPTIMUM
f=1
TT=234.917
T1=234.74
OPTIMUM
f=1
TT=1.492
T1=0
OPTIMUM
f=1
TT=6.365
T1=6.32
csp/BH-4-4/
normalized-BlackHole-4-4-e-2_ext.xml
MOPT
f=1
TT=1.601
T1=0
MSAT (TO)
f=1
TT=1685.08
T1=0.68
MSAT (TO)
f=1
TT=1585.39
T1=0.64
MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=430.832
T1=430.32
OPTIMUM
f=1
TT=1120.16
T1=1119.91
OPTIMUM
f=1
TT=1.601
T1=0
OPTIMUM
f=1
TT=6.962
T1=6.87
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/BH-4-4/
normalized-BlackHole-4-4-e-3_ext.xml
MOPT
f=1
TT=1.591
T1=0
MSAT (TO)
f=1
TT=1563.14
T1=0.96
OPTIMUM
f=1
TT=1321.58
T1=1.15
CHECKS=103874000
NODES=35651
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600

OPTIMUM
f=1
TT=29.123
T1=28.6
OPTIMUM
f=1
TT=107.458
T1=105.86
OPTIMUM
f=1
TT=1.591
T1=0
OPTIMUM
f=1
TT=6.36
T1=6.24
csp/BH-4-4/
normalized-BlackHole-4-4-e-4_ext.xml
MOPT
f=1
TT=1.64
T1=0
MSAT (TO)
f=1
TT=2153.75
T1=1.27
MSAT (TO)
f=1
TT=1589.29
T1=1.26
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.04

OPTIMUM
f=1
TT=260.555
T1=260.03
OPTIMUM
f=1
TT=131.038
T1=127.16
OPTIMUM
f=1
TT=1.64
T1=0
OPTIMUM
f=1
TT=6.458
T1=6.42
csp/BH-4-4/
normalized-BlackHole-4-4-e-5_ext.xml
MOPT
f=1
TT=1.495
T1=0
MSAT (TO)
f=1
TT=1580.23
T1=1.05
OPTIMUM
f=1
TT=1217.09
T1=1.07
CHECKS=143927000
NODES=93724
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=76.941
T1=76.46
OPTIMUM
f=1
TT=2.926
T1=2.55
OPTIMUM
f=1
TT=1.495
T1=0
OPTIMUM
f=1
TT=5.921
T1=5.8
csp/BH-4-4/
normalized-BlackHole-4-4-e-6_ext.xml
MOPT
f=1
TT=1.6
T1=0
MSAT (TO)
f=1
TT=1595.31
T1=1.68
MSAT (TO)
f=1
TT=1588.82
T1=1.84
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=90.787
T1=90.24
OPTIMUM
f=1
TT=160.742
T1=158.19
OPTIMUM
f=1
TT=1.6
T1=0
OPTIMUM
f=1
TT=6.373
T1=6.34
csp/BH-4-4/
normalized-BlackHole-4-4-e-7_ext.xml
MOPT
f=1
TT=1.614
T1=0
MSAT (TO)
f=1
TT=1578.34
T1=0.66
OPTIMUM
f=1
TT=1055.33
T1=0.67
CHECKS=102669000
NODES=50575
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=83.487
T1=83.14
OPTIMUM
f=1
TT=923.397
T1=923.02
OPTIMUM
f=1
TT=1.614
T1=0
OPTIMUM
f=1
TT=6.428
T1=6.33
csp/BH-4-4/
normalized-BlackHole-4-4-e-8_ext.xml
MOPT
f=1
TT=1.513
T1=0
MSAT (TO)
f=1
TT=1591.56
T1=0.68
OPTIMUM
f=1
TT=1515.29
T1=0.64
CHECKS=88138700
NODES=48044
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=36.222
T1=35.71
OPTIMUM
f=1
TT=3.341
T1=2.93
OPTIMUM
f=1
TT=1.513
T1=0
OPTIMUM
f=1
TT=5.973
T1=5.87
csp/BH-4-4/
normalized-BlackHole-4-4-e-9_ext.xml
MOPT
f=1
TT=1.623
T1=0
MSAT (TO)
f=1
TT=2558.13
T1=0.82
MSAT (TO)
f=1
TT=1578.05
T1=0.74
MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=72.313
T1=71.81
OPTIMUM
f=1
TT=896.799
T1=896.28
OPTIMUM
f=1
TT=1.623
T1=0
OPTIMUM
f=1
TT=6.342
T1=6.31
csp/BH-4-7/
normalized-BlackHole-4-7-e-0_ext.xml
MSAT TO
f=1
TT=1599.14
T1=9.82
MSAT (TO)
f=1
TT=1606.37
T1=22.79
MSAT (TO)
f=1
TT=1599.14
T1=24.63
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=2
TT=3600
T1=35.67
MSAT (TO)
f=1
TT=3600.16
T1=9.82
? (TO)

TT=3600.06

? (TO)

TT=3600.09

csp/BH-4-7/
normalized-BlackHole-4-7-e-4_ext.xml
MOPT
f=1
TT=3054.09
T1=12.32
MSAT (TO)
f=1
TT=1596.33
T1=18.86
MSAT (TO)
f=1
TT=1588.52
T1=18.22
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=2
TT=3600.08
T1=83.88
OPTIMUM
f=1
TT=3054.09
T1=12.32
? (TO)

TT=3600.03

? (TO)

TT=3600.13

csp/BH-4-7/
normalized-BlackHole-4-7-e-7_ext.xml
MOPT
f=1
TT=980.632
T1=2.28
MSAT (TO)
f=1
TT=1593.12
T1=2.37
MSAT (TO)
f=1
TT=1583.97
T1=2.28
MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=1
TT=3600

OPTIMUM
f=1
TT=980.632
T1=39.89
MSAT (TO)
f=2
TT=3600.21
T1=11.11
? (TO)

TT=3600.05

? (TO)

TT=3600.05

Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/BH-4-7/
normalized-BlackHole-4-7-e-8_ext.xml
MSAT TO
f=1
TT=1601.91
T1=7.37
MSAT (TO)
f=1
TT=1601.91
T1=7.39
MSAT (TO)
f=1
TT=1602.79
T1=7.37
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600

MSAT (TO)
f=1
TT=3600.06
T1=34.09
MSAT (TO)
f=2
TT=3600.14
T1=9.27
? (TO)

TT=3600.04

? (TO)

TT=3600.09

csp/BH-4-7/
normalized-BlackHole-4-7-e-9_ext.xml
MSAT TO
f=1
TT=1585.31
T1=7.36
MSAT (TO)
f=1
TT=1596.8
T1=7.36
MSAT (TO)
f=1
TT=1585.31
T1=7.61
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.02
T1=32.1
MSAT (TO)
f=3
TT=3600.22
T1=11.75
? (TO)

TT=3600.08

? (TO)

TT=3600.08

csp/BH-4-7/
normalized-BlackHole-4-7-h-1_ext.xml
MSAT TO
f=1
TT=1599.14
T1=5.61
MSAT (TO)
f=1
TT=1599.14
T1=5.61
MSAT (TO)
f=1
TT=1601.42
T1=6
MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=2
TT=3600.05
T1=31.56
MSAT (TO)
f=2
TT=3600.21
T1=10.68
? (TO)

TT=3600.04

? (TO)

TT=3600.06

csp/BH-4-7/
normalized-BlackHole-4-7-h-3_ext.xml
MOPT
f=1
TT=927.684
T1=10.3
MSAT (TO)
f=1
TT=1603.7
T1=17.91
MSAT (TO)
f=1
TT=1988.28
T1=16.57
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=927.684
T1=51.69
MSAT (TO)
f=1
TT=3600.24
T1=10.3
? (TO)

TT=3600.03

? (TO)

TT=3600.04

csp/BH-4-7/
normalized-BlackHole-4-7-h-5_ext.xml
MOPT
f=1
TT=1438.56
T1=7.22
MSAT (TO)
f=1
TT=1592.11
T1=7.31
MSAT (TO)
f=1
TT=1607.47
T1=7.22
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=1438.56
T1=263.95
MSAT (TO)
f=1
TT=3600.21
T1=11.51
? (TO)

TT=3600.06

? (TO)

TT=3600.07

csp/BH-4-7/
normalized-BlackHole-4-7-h-8_ext.xml
MSAT TO
f=1
TT=1616.98
T1=9.57
MSAT (TO)
f=1
TT=1616.98
T1=9.57
MSAT (TO)
f=1
TT=1923.43
T1=10.11
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.02
T1=32.22
MSAT (TO)
f=2
TT=3600.19
T1=11.07
? (TO)

TT=3600.1

? (TO)

TT=3600.07

csp/BH-4-7/
normalized-BlackHole-4-7-h-9_ext.xml
MSAT TO
f=1
TT=1590.63
T1=9.56
MSAT (TO)
f=1
TT=1611.19
T1=26.07
MSAT (TO)
f=1
TT=1590.63
T1=28.24
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.09
T1=57.38
MSAT (TO)
f=1
TT=3600.15
T1=9.56
? (TO)

TT=3600.04

? (TO)

TT=3600.11

csp/coloring/
normalized-dsjc-125-1-4-ext.xml
MSAT TO
f=19
TT=3600.04

MSAT (TO)
f=20
TT=1587.46
T1=1.68
MSAT (TO)
f=20
TT=1591.59
T1=1.86
MSAT (TO)
f=19
TT=3600.04

MSAT (TO)
f=20
TT=3600.08

MSAT (TO)
f=58
TT=3600
T1=44.83
MSAT (TO)
f=79
TT=3600.16
T1=3.94
? (TO)

TT=3600.09

? (TO)
f=65
TT=3600.05
T1=2336.42
csp/coloring/
normalized-geom-30a-4-ext.xml
MOPT
f=4
TT=0.323
T1=0
MSAT (TO)
f=4
TT=1626.04
T1=0.47
OPTIMUM
f=4
TT=164.607
T1=0.48
CHECKS=8843890
NODES=66412
MSAT (TO)
f=4
TT=3600.01

MSAT (TO)
f=4
TT=3600.04

OPTIMUM
f=4
TT=1.562
T1=1.04
OPTIMUM
f=4
TT=1.4
T1=1.05
OPTIMUM
f=4
TT=0.323
T1=0
OPTIMUM
f=4
TT=0.101
T1=0.01
csp/coloring/
normalized-geom-40-2-ext.xml
MOPT
f=22
TT=0.03
T1=0
MSAT (TO)
f=22
TT=1637.14
T1=0.48
OPTIMUM
f=22
TT=1387.6
T1=0.57
CHECKS=102778000
NODES=1073070
MSAT (TO)
f=22
TT=3600.04

MSAT (TO)
f=22
TT=3600

OPTIMUM
f=22
TT=396.059
T1=40.14
OPTIMUM
f=22
TT=780.585
T1=231.93
OPTIMUM
f=22
TT=0.03
T1=0
OPTIMUM
f=22
TT=0.031
T1=0
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/coloring/
normalized-geom-40-3-ext.xml
MOPT
f=7
TT=0.141
T1=0
MSAT (TO)
f=7
TT=1622.75
T1=0.57
OPTIMUM
f=7
TT=1462.57
T1=0.66
CHECKS=98633000
NODES=896136
MSAT (TO)
f=7
TT=3600.09

MSAT (TO)
f=7
TT=3600.04

OPTIMUM
f=7
TT=1.861
T1=1.12
OPTIMUM
f=7
TT=1.777
T1=0.98
OPTIMUM
f=7
TT=0.141
T1=0
OPTIMUM
f=7
TT=0.049
T1=0
csp/coloring/
normalized-geom-40-4-ext.xml
MOPT
f=3
TT=0.216
T1=0
MSAT (TO)
f=3
TT=1643.7
T1=0.45
OPTIMUM
f=3
TT=78.315
T1=0.47
CHECKS=3448160
NODES=38800
MSAT (TO)
f=3
TT=3600.09

MSAT (TO)
f=3
TT=3600.06

OPTIMUM
f=3
TT=1.585
T1=1.43
OPTIMUM
f=3
TT=1.32
T1=1.14
OPTIMUM
f=3
TT=0.216
T1=0
OPTIMUM
f=3
TT=0.055
T1=0
csp/coloring/
normalized-le-450-5a-3-ext.xml
MSAT TO
f=900
TT=3600.09

MSAT (TO)
f=952
TT=1671.41
T1=42.18
MSAT (TO)
f=952
TT=1680.67
T1=44.65
MSAT (TO)
f=902
TT=3600.07

MSAT (TO)
f=900
TT=3600.09

? (MO)

TT=98.11

? (MO)

TT=94.794

? (TO)

TT=3600.05

? (TO)
f=2638
TT=3600.12
T1=2936.68
csp/coloring/
normalized-le-450-5a-4-ext.xml
MSAT TO
f=392
TT=3600.03

MSAT (TO)
f=444
TT=1643.36
T1=27.56
MSAT (TO)
f=444
TT=1660.65
T1=26.68
MSAT (TO)
f=392
TT=3600.03

MSAT (TO)
f=394
TT=3600.08

? (MO)

TT=89.986

? (MO)

TT=98.836

? (TO)

TT=3600.09

? (TO)
f=2270
TT=3600.05
T1=3053.43
csp/coloring/
normalized-myciel-5g-4-ext.xml
MOPT
f=4
TT=16.654
T1=0
MSAT (TO)
f=4
TT=1617.37
T1=0.52
MSAT (TO)
f=4
TT=1591.87
T1=0.58
MSAT (TO)
f=4
TT=3600

MSAT (TO)
f=4
TT=3600.02

OPTIMUM
f=4
TT=278.105
T1=277.9
OPTIMUM
f=4
TT=1582.37
T1=1582.18
OPTIMUM
f=4
TT=16.654
T1=0
OPTIMUM
f=4
TT=18.012
T1=0.02
csp/coloring/
normalized-myciel-5g-5-ext.xml
MOPT
f=1
TT=59.362
T1=0
MSAT (TO)
f=1
TT=1625.63
T1=0.57
MSAT (TO)
f=1
TT=1599.61
T1=0.47
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.05

OPTIMUM
f=1
TT=59.362
T1=2.36
OPTIMUM
f=1
TT=302.625
T1=2.03
OPTIMUM
f=1
TT=102.087
T1=0
OPTIMUM
f=1
TT=94.761
T1=0.04
csp/coloring/
normalized-queens-5-5-4-ext.xml
MOPT
f=12
TT=47.571
T1=0.09
MSAT (TO)
f=12
TT=1593.6
T1=0.46
MSAT (TO)
f=12
TT=1597.37
T1=0.58
MSAT (TO)
f=12
TT=3600.04

MSAT (TO)
f=12
TT=3600.02

MSAT (TO)
f=19
TT=3600.13
T1=1.35
MSAT (TO)
f=19
TT=3600.08
T1=1.8
OPTIMUM
f=12
TT=47.571
T1=0.09
OPTIMUM
f=12
TT=59.298
T1=2.24
csp/QCP-10/
normalized-qcp-10-67-10_ext.xml
MOPT
f=2
TT=5.983
T1=0.85
MSAT (TO)
f=2
TT=1637.35
T1=0.85
MSAT (TO)
f=2
TT=1584.69
T1=1.04
MSAT (TO)
f=2
TT=3600.02

MSAT (TO)
f=2
TT=3600.09

OPTIMUM
f=2
TT=15.27
T1=14.88
OPTIMUM
f=2
TT=5.983
T1=5.73
? (TO)

TT=3600.04

? (TO)

TT=3600.06

csp/QCP-10/
normalized-qcp-10-67-11_ext.xml
MOPT
f=2
TT=6.314
T1=0.85
MSAT (TO)
f=2
TT=1600.29
T1=0.87
MSAT (TO)
f=2
TT=1607.22
T1=0.85
MSAT (TO)
f=2
TT=3600.04

MSAT (TO)
f=2
TT=3600.08

OPTIMUM
f=2
TT=16.031
T1=15.77
OPTIMUM
f=2
TT=6.314
T1=6.02
? (TO)

TT=3600.07

? (TO)

TT=3600.06

csp/QCP-10/
normalized-qcp-10-67-12_ext.xml
MOPT
f=2
TT=6.201
T1=0.75
MSAT (TO)
f=2
TT=1629.96
T1=0.75
MSAT (TO)
f=2
TT=1606.46
T1=0.84
MSAT (TO)
f=2
TT=3600.05

MSAT (TO)
f=2
TT=3600.03

OPTIMUM
f=2
TT=14.846
T1=14.44
OPTIMUM
f=2
TT=6.201
T1=5.93
? (TO)

TT=3600.1

? (TO)

TT=3600.04

Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/QCP-10/
normalized-qcp-10-67-13_ext.xml
MOPT
f=2
TT=6.243
T1=0.88
MSAT (TO)
f=2
TT=1642.59
T1=0.88
MSAT (TO)
f=2
TT=1604.98
T1=0.9
MSAT (TO)
f=2
TT=3600

MSAT (TO)
f=2
TT=3600.05

OPTIMUM
f=2
TT=14.499
T1=14.25
OPTIMUM
f=2
TT=6.243
T1=5.97
? (TO)

TT=3600.05

? (TO)

TT=3600.1

csp/QCP-10/
normalized-qcp-10-67-14_ext.xml
MOPT
f=2
TT=6.977
T1=0.83
MSAT (TO)
f=2
TT=1656.55
T1=0.83
MSAT (TO)
f=2
TT=1589.59
T1=1.04
MSAT (TO)
f=2
TT=3600.01

MSAT (TO)
f=2
TT=3600.03

OPTIMUM
f=2
TT=15.29
T1=15.02
OPTIMUM
f=2
TT=6.977
T1=6.88
? (TO)

TT=3600.08

? (TO)

TT=3600.08

csp/QCP-15/
normalized-qcp-15-120-10_ext.xml
MOPT
f=2
TT=66.054
T1=23
MSAT (TO)
f=2
TT=1668.78
T1=23
MSAT (TO)
f=2
TT=1624.34
T1=25.03
MSAT (TO)
f=2
TT=3600.02

MSAT (TO)
f=2
TT=3600.07

OPTIMUM
f=2
TT=212.771
T1=212.58
OPTIMUM
f=2
TT=66.054
T1=65.38
? (TO)

TT=3600.08

? (TO)

TT=3600.11

csp/QCP-15/
normalized-qcp-15-120-11_ext.xml
MOPT
f=2
TT=72.179
T1=21.46
MSAT (TO)
f=2
TT=1625.04
T1=21.46
MSAT (TO)
f=2
TT=1615.91
T1=23.03
MSAT (TO)
f=2
TT=3600.03

MSAT (TO)
f=2
TT=3600.05

OPTIMUM
f=2
TT=225.382
T1=224.93
OPTIMUM
f=2
TT=72.179
T1=71.9
? (TO)

TT=3600.11

? (TO)

TT=3600.07

csp/QCP-15/
normalized-qcp-15-120-12_ext.xml
MOPT
f=2
TT=119.671
T1=8.26
MSAT (TO)
f=2
TT=1669.14
T1=8.26
MSAT (TO)
f=2
TT=1611.46
T1=8.69
MSAT (TO)
f=2
TT=3600.08

MSAT (TO)
f=2
TT=3600.05

OPTIMUM
f=2
TT=826.919
T1=826.49
OPTIMUM
f=2
TT=119.671
T1=119.16
? (TO)

TT=3494.43

? (TO)

TT=3600.08

csp/QCP-15/
normalized-qcp-15-120-13_ext.xml
MOPT
f=2
TT=303.54
T1=3.48
MSAT (TO)
f=2
TT=1637.24
T1=3.48
MSAT (TO)
f=2
TT=1586.01
T1=3.52
MSAT (TO)
f=2
TT=3600.07

MSAT (TO)
f=2
TT=3600.08

OPTIMUM
f=2
TT=596.46
T1=243.53
OPTIMUM
f=2
TT=303.54
T1=64.27
? (TO)

TT=3600.05

? (TO)

TT=3600.12

csp/QCP-15/
normalized-qcp-15-120-14_ext.xml
MOPT
f=2
TT=76.507
T1=15.31
MSAT (TO)
f=2
TT=1629.77
T1=15.31
MSAT (TO)
f=2
TT=1613.55
T1=15.32
MSAT (TO)
f=2
TT=3600.08

MSAT (TO)
f=2
TT=3600

OPTIMUM
f=2
TT=227.56
T1=227.41
OPTIMUM
f=2
TT=76.507
T1=76.01
? (TO)

TT=3600.02

? (TO)

TT=3600.1

csp/QCP-20/
normalized-qcp-20-187-10_ext.xml
MSAT TO
f=2
TT=3600.04

MSAT (TO)
f=6
TT=1612.19
T1=18.49
MSAT (TO)
f=6
TT=1608.41
T1=16.81
MSAT (TO)
f=2
TT=3600.04

MSAT (TO)
f=2
TT=3600.04

? (MO)

TT=93.52

? (MO)

TT=92.737

? (TO)

TT=3600.04

? (TO)

TT=3600.11

csp/QCP-20/
normalized-qcp-20-187-11_ext.xml
MSAT TO
f=2
TT=3600.04

MSAT (TO)
f=6
TT=1623.62
T1=37.1
MSAT (TO)
f=6
TT=3600.14
T1=34.17
MSAT (TO)
f=2
TT=3600.05

MSAT (TO)
f=2
TT=3600.04

? (MO)

TT=97.24

? (MO)

TT=96.522

? (TO)

TT=3600.02

? (TO)

TT=3600.07

csp/QCP-20/
normalized-qcp-20-187-12_ext.xml
MSAT TO
f=2
TT=3600.05

MSAT (TO)
f=8
TT=1606.07
T1=13.77
MSAT (TO)
f=8
TT=1619.7
T1=12.87
MSAT (TO)
f=2
TT=3600.07

MSAT (TO)
f=2
TT=3600.05

? (MO)

TT=90.56

? (MO)

TT=93.741

? (TO)

TT=3600.05

? (TO)

TT=3600.03

Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/QCP-20/
normalized-qcp-20-187-13_ext.xml
MSAT TO
f=2
TT=3600.02

MSAT (TO)
f=6
TT=1687.42
T1=19.26
MSAT (TO)
f=6
TT=1872.54
T1=19.29
MSAT (TO)
f=2
TT=3600.05

MSAT (TO)
f=2
TT=3600.02

? (MO)

TT=91.29

? (MO)

TT=97.408

? (TO)

TT=3600.08

? (TO)

TT=3600.1

csp/QCP-20/
normalized-qcp-20-187-14_ext.xml
MSAT TO
f=2
TT=3600.06

MSAT (TO)
f=6
TT=1776.86
T1=40.09
MSAT (TO)
f=6
TT=1622.28
T1=40.06
MSAT (TO)
f=2
TT=3600.06

MSAT (TO)
f=2
TT=3600.09

? (MO)

TT=92.818

? (MO)

TT=94.125

? (TO)

TT=3600.07

? (TO)

TT=3600.06

csp/QCP-25/
normalized-qcp-25-264-10_ext.xml
MSAT TO
f=4
TT=3600

MSAT (TO)
f=16
TT=1670.95
T1=43.33
MSAT (TO)
f=16
TT=1643.96
T1=47.51
MSAT (TO)
f=4
TT=3600

MSAT (TO)
f=14
TT=3600.01

?

TT=219.636

?

TT=214.737

? (TO)

TT=3600.06

? (TO)

TT=3600.03

csp/QCP-25/
normalized-qcp-25-264-11_ext.xml
MSAT TO
f=5
TT=3600.05

MSAT (TO)
f=21
TT=1654.71
T1=49.54
MSAT (TO)
f=21
TT=1666.87
T1=44.91
MSAT (TO)
f=5
TT=3600.05

MSAT (TO)
f=14
TT=3600.04

?

TT=201.802

? (TO)

TT=126.299

? (TO)

TT=3600.07

? (TO)

TT=3600.07

csp/QCP-25/
normalized-qcp-25-264-12_ext.xml
MSAT TO
f=3
TT=3600.03

MSAT (TO)
f=20
TT=1643.07
T1=46.42
MSAT (TO)
f=20
TT=1643.23
T1=44.84
MSAT (TO)
f=3
TT=3600.03

MSAT (TO)
f=14
TT=3600

?

TT=213.956

?

TT=206.83

? (TO)

TT=3600.08

? (TO)

TT=3600.08

csp/QCP-25/
normalized-qcp-25-264-13_ext.xml
MSAT TO
f=4
TT=3600.08

MSAT (TO)
f=20
TT=1668.47
T1=47.22
MSAT (TO)
f=20
TT=1643.76
T1=49.8
MSAT (TO)
f=4
TT=3600.08

MSAT (TO)
f=14
TT=3600.04

?

TT=214.805

?

TT=219.111

? (TO)

TT=3600.09

? (TO)

TT=3600.06

csp/QCP-25/
normalized-qcp-25-264-14_ext.xml
MSAT TO
f=4
TT=3600.02

MSAT (TO)
f=18
TT=1634.06
T1=42.51
MSAT (TO)
f=18
TT=1668.49
T1=45.34
MSAT (TO)
f=4
TT=3600.02

MSAT (TO)
f=15
TT=3600.09

?

TT=208.037

?

TT=207.196

? (TO)

TT=3600.03

? (TO)

TT=3600.11

maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-10/
normalized-kbtree-5-2-4-5-10-18_ext.xml
MOPT
f=0
TT=0.019
T1=0
OPTIMUM
f=0
TT=3.44
T1=0.6
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.306
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.467

CHECKS=4906
NODES=11
OPTIMUM
f=0
TT=0.45

CHECKS=4701
NODES=6
OPTIMUM
f=0
TT=2.469
T1=2.28
OPTIMUM
f=0
TT=2.23
T1=2.02
OPTIMUM
f=0
TT=0.019
T1=0
OPTIMUM
f=0
TT=0.074
T1=0
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-10/
normalized-kbtree-5-2-4-5-10-23_ext.xml
MOPT
f=0
TT=0.019
T1=0
OPTIMUM
f=0
TT=3.34
T1=0.56
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.332
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.468

CHECKS=4776
NODES=9
OPTIMUM
f=0
TT=0.454

CHECKS=4851
NODES=12
OPTIMUM
f=0
TT=2.563
T1=2.39
OPTIMUM
f=0
TT=2.533
T1=2.34
OPTIMUM
f=0
TT=0.019
T1=0
OPTIMUM
f=0
TT=0.075
T1=0
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-10/
normalized-kbtree-5-2-4-5-10-26_ext.xml
MOPT
f=0
TT=0.02
T1=0
OPTIMUM
f=0
TT=3.377
T1=0.61
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.557
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.461

CHECKS=5131
NODES=16
OPTIMUM
f=0
TT=0.449

CHECKS=4711
NODES=8
OPTIMUM
f=0
TT=2.529
T1=2.36
OPTIMUM
f=0
TT=2.166
T1=1.97
OPTIMUM
f=0
TT=0.02
T1=0
OPTIMUM
f=0
TT=0.074
T1=0.03
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-20/
normalized-kbtree-5-2-4-5-20-08_ext.xml
MOPT
f=0
TT=0.021
T1=0
OPTIMUM
f=0
TT=2.924
T1=0.55
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.083
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.638

CHECKS=5591
NODES=28
OPTIMUM
f=0
TT=0.532

CHECKS=5546
NODES=27
OPTIMUM
f=0
TT=2.55
T1=2.38
OPTIMUM
f=0
TT=2.305
T1=2.13
OPTIMUM
f=0
TT=0.021
T1=0
OPTIMUM
f=0
TT=0.074
T1=0
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-20/
normalized-kbtree-5-2-4-5-20-38_ext.xml
MOPT
f=0
TT=0.022
T1=0
OPTIMUM
f=0
TT=2.919
T1=0.59
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.96
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.517

CHECKS=6081
NODES=42
OPTIMUM
f=0
TT=0.51

CHECKS=5931
NODES=36
OPTIMUM
f=0
TT=2.758
T1=2.58
OPTIMUM
f=0
TT=2.423
T1=2.21
OPTIMUM
f=0
TT=0.022
T1=0
OPTIMUM
f=0
TT=0.076
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-20/
normalized-kbtree-5-2-4-5-20-50_ext.xml
MOPT
f=0
TT=0.024
T1=0
OPTIMUM
f=0
TT=3.185
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.913
T1=0.61
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.537

CHECKS=7866
NODES=83
OPTIMUM
f=0
TT=0.533

CHECKS=5321
NODES=26
OPTIMUM
f=0
TT=2.645
T1=2.47
OPTIMUM
f=0
TT=2.271
T1=2.09
OPTIMUM
f=0
TT=0.024
T1=0
OPTIMUM
f=0
TT=0.076
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-30/
normalized-kbtree-5-2-4-5-30-25_ext.xml
MOPT
f=0
TT=0.025
T1=0
OPTIMUM
f=0
TT=2.88
T1=0.67
CHECKS=5
NODES=0
OPTIMUM
f=0
TT=2.877
T1=0.59
CHECKS=5
NODES=0
OPTIMUM
f=0
TT=0.678

CHECKS=21071
NODES=448
OPTIMUM
f=0
TT=0.568

CHECKS=40686
NODES=903
OPTIMUM
f=0
TT=2.592
T1=2.43
OPTIMUM
f=0
TT=2.465
T1=2.27
OPTIMUM
f=0
TT=0.025
T1=0
OPTIMUM
f=0
TT=0.084
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-30/
normalized-kbtree-5-2-4-5-30-35_ext.xml
MOPT
f=0
TT=0.06
T1=0
OPTIMUM
f=0
TT=2.729
T1=0.58
CHECKS=5
NODES=0
OPTIMUM
f=0
TT=2.937
T1=0.68
CHECKS=5
NODES=0
OPTIMUM
f=0
TT=0.565

CHECKS=19636
NODES=449
OPTIMUM
f=0
TT=0.558

CHECKS=6951
NODES=68
OPTIMUM
f=0
TT=2.588
T1=2.42
OPTIMUM
f=0
TT=2.263
T1=2.08
OPTIMUM
f=0
TT=0.06
T1=0
OPTIMUM
f=0
TT=0.09
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-30/
normalized-kbtree-5-2-4-5-30-47_ext.xml
MOPT
f=0
TT=0.035
T1=0
OPTIMUM
f=0
TT=2.997
T1=0.78
CHECKS=5
NODES=0
OPTIMUM
f=0
TT=2.891
T1=0.67
CHECKS=5
NODES=0
OPTIMUM
f=0
TT=0.791

CHECKS=86076
NODES=2133
OPTIMUM
f=0
TT=0.595

CHECKS=196851
NODES=4836
OPTIMUM
f=0
TT=2.673
T1=2.47
OPTIMUM
f=0
TT=2.372
T1=2.16
OPTIMUM
f=0
TT=0.035
T1=0
OPTIMUM
f=0
TT=0.085
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-40/
normalized-kbtree-5-2-4-5-40-16_ext.xml
MOPT
f=10
TT=0.862
T1=0
MSAT (TO)
f=10
TT=1597.84
T1=0.77
MSAT (TO)
f=10
TT=1840.42
T1=0.78
MSAT (TO)
f=10
TT=3600.03

MSAT (TO)
f=11
TT=3600.05

OPTIMUM
f=10
TT=157.267
T1=26.54
OPTIMUM
f=10
TT=275.432
T1=81.83
OPTIMUM
f=10
TT=0.862
T1=0
OPTIMUM
f=10
TT=0.146
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-40/
normalized-kbtree-5-2-4-5-40-23_ext.xml
MOPT
f=7
TT=2.136
T1=2.08
MSAT (TO)
f=7
TT=1606.69
T1=3.24
MSAT (TO)
f=7
TT=1589.85
T1=3.25
MSAT (TO)
f=7
TT=3600.02

MSAT (TO)
f=7
TT=3600.05

OPTIMUM
f=7
TT=17.249
T1=17.07
OPTIMUM
f=7
TT=16.279
T1=16.19
OPTIMUM
f=7
TT=2.136
T1=2.08
OPTIMUM
f=7
TT=0.157
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-40/
normalized-kbtree-5-2-4-5-40-32_ext.xml
MOPT
f=10
TT=2.205
T1=2.07
MSAT (TO)
f=10
TT=3600.1
T1=7.83
MSAT (TO)
f=10
TT=1592.95
T1=7.94
MSAT (TO)
f=10
TT=3600.06

MSAT (TO)
f=10
TT=3600.09

OPTIMUM
f=10
TT=824.671
T1=636.34
OPTIMUM
f=10
TT=720.322
T1=607.7
OPTIMUM
f=10
TT=2.205
T1=2.07
OPTIMUM
f=10
TT=0.21
T1=0.05
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-50/
normalized-kbtree-5-2-4-5-50-14_ext.xml
MOPT
f=18
TT=7.276
T1=1.53
MSAT (TO)
f=18
TT=1594.4
T1=1.53
MSAT (TO)
f=18
TT=1566.67
T1=1.67
MSAT (TO)
f=18
TT=3600.09

MSAT (TO)
f=18
TT=3600.05

MSAT (TO)
f=42
TT=3600.12
T1=1.38
MSAT (TO)
f=49
TT=3600.04
T1=1.31
OPTIMUM
f=18
TT=7.276
T1=4.74
OPTIMUM
f=18
TT=0.368
T1=0.04
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-50/
normalized-kbtree-5-2-4-5-50-16_ext.xml
MOPT
f=18
TT=7.307
T1=5.54
MSAT (TO)
f=18
TT=1586.88
T1=8.2
MSAT (TO)
f=18
TT=3600.09
T1=7.53
MSAT (TO)
f=18
TT=3600.06

MSAT (TO)
f=18
TT=3600.09

MSAT (TO)
f=36
TT=3600.06
T1=1.51
MSAT (TO)
f=39
TT=3600.08
T1=1.11
OPTIMUM
f=18
TT=7.307
T1=5.54
OPTIMUM
f=18
TT=0.293
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-50/
normalized-kbtree-5-2-4-5-50-22_ext.xml
MOPT
f=19
TT=10.149
T1=2.38
MSAT (TO)
f=19
TT=1605.56
T1=2.63
MSAT (TO)
f=19
TT=1592.41
T1=2.38
MSAT (TO)
f=19
TT=3600.04

MSAT (TO)
f=19
TT=3600.04

MSAT (TO)
f=20
TT=3600.09
T1=1591.94
MSAT (TO)
f=20
TT=3600.08
T1=2062.6
OPTIMUM
f=19
TT=10.149
T1=4.74
OPTIMUM
f=19
TT=0.504
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-60/
normalized-kbtree-5-2-4-5-60-10_ext.xml
MOPT
f=43
TT=46.123
T1=22.95
MSAT (TO)
f=43
TT=1601.68
T1=24.56
MSAT (TO)
f=43
TT=1599.21
T1=22.95
MSAT (TO)
f=43
TT=3600.09

MSAT (TO)
f=43
TT=3600.03

MSAT (TO)
f=76
TT=3600.02
T1=1.47
MSAT (TO)
f=82
TT=3600.07
T1=1.09
OPTIMUM
f=43
TT=46.123
T1=37.93
OPTIMUM
f=43
TT=0.714
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-60/
normalized-kbtree-5-2-4-5-60-34_ext.xml
MOPT
f=39
TT=8.152
T1=1.55
MSAT (TO)
f=39
TT=1588.67
T1=1.58
MSAT (TO)
f=39
TT=1585.99
T1=1.55
MSAT (TO)
f=39
TT=3600.03

MSAT (TO)
f=39
TT=3600.01

MSAT (TO)
f=74
TT=3600.07
T1=1.67
MSAT (TO)
f=51
TT=3600.13
T1=91.44
OPTIMUM
f=39
TT=8.152
T1=7.67
OPTIMUM
f=39
TT=0.507
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-60/
normalized-kbtree-5-2-4-5-60-36_ext.xml
MOPT
f=41
TT=6.564
T1=0
MSAT (TO)
f=41
TT=1589.29
T1=18.57
MSAT (TO)
f=41
TT=1573.47
T1=18.78
MSAT (TO)
f=41
TT=3600.03

MSAT (TO)
f=41
TT=3600.06

MSAT (TO)
f=81
TT=3600.09
T1=1.29
MSAT (TO)
f=74
TT=3600.12
T1=1.12
OPTIMUM
f=41
TT=6.564
T1=0
OPTIMUM
f=41
TT=0.275
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-70/
normalized-kbtree-5-2-4-5-70-12_ext.xml
MOPT
f=57
TT=35.418
T1=13.22
MSAT (TO)
f=58
TT=1596.19
T1=7.88
MSAT (TO)
f=58
TT=1592.08
T1=8.29
MSAT (TO)
f=57
TT=3600.04

MSAT (TO)
f=57
TT=3600.06

MSAT (TO)
f=101
TT=3600.08
T1=1.26
MSAT (TO)
f=98
TT=3600.05
T1=1.28
OPTIMUM
f=57
TT=35.418
T1=13.22
OPTIMUM
f=57
TT=0.427
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-70/
normalized-kbtree-5-2-4-5-70-33_ext.xml
MOPT
f=57
TT=64.621
T1=55.85
MSAT (TO)
f=58
TT=1595.03
T1=9.45
MSAT (TO)
f=58
TT=1606.76
T1=10.08
MSAT (TO)
f=57
TT=3600.01

MSAT (TO)
f=57
TT=3600.08

MSAT (TO)
f=83
TT=3600.07
T1=1.6
MSAT (TO)
f=94
TT=3600.08
T1=1.25
OPTIMUM
f=57
TT=64.621
T1=55.85
OPTIMUM
f=57
TT=0.437
T1=0.05
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-70/
normalized-kbtree-5-2-4-5-70-37_ext.xml
MOPT
f=59
TT=10.84
T1=5.16
MSAT (TO)
f=60
TT=1597.73
T1=21.39
MSAT (TO)
f=60
TT=1583.59
T1=21.36
MSAT (TO)
f=59
TT=3600

MSAT (TO)
f=59
TT=3600.05

MSAT (TO)
f=92
TT=3600.11
T1=1.33
MSAT (TO)
f=99
TT=3600.05
T1=1.27
OPTIMUM
f=59
TT=10.84
T1=5.16
OPTIMUM
f=59
TT=0.303
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-80/
normalized-kbtree-5-2-4-5-80-06_ext.xml
MOPT
f=90
TT=9.901
T1=6.46
MSAT (TO)
f=91
TT=1564.89
T1=0.94
MSAT (TO)
f=91
TT=1584.64
T1=0.83
MSAT (TO)
f=90
TT=3600.07

MSAT (TO)
f=90
TT=3600.08

MSAT (TO)
f=104
TT=3600.1
T1=987.67
? (TO)

TT=3600.06

OPTIMUM
f=90
TT=9.901
T1=6.46
OPTIMUM
f=90
TT=0.395
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-80/
normalized-kbtree-5-2-4-5-80-11_ext.xml
MOPT
f=90
TT=20.623
T1=1.37
MSAT (TO)
f=90
TT=1579.95
T1=1.54
MSAT (TO)
f=90
TT=1568.36
T1=1.37
MSAT (TO)
f=90
TT=3600.02

MSAT (TO)
f=90
TT=3600.07

? (TO)

TT=3600.03

MSAT (TO)
f=104
TT=3600.06
T1=792.97
OPTIMUM
f=90
TT=20.623
T1=8.72
OPTIMUM
f=90
TT=0.233
T1=0.04
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-80/
normalized-kbtree-5-2-4-5-80-41_ext.xml
MOPT
f=86
TT=1.153
T1=0
MSAT (TO)
f=86
TT=1610.69
T1=4.58
MSAT (TO)
f=86
TT=1602.86
T1=4.95
MSAT (TO)
f=86
TT=3600.07

MSAT (TO)
f=86
TT=3600.01

? (TO)

TT=3600.08

MSAT (TO)
f=104
TT=3600.1
T1=2258.46
OPTIMUM
f=86
TT=1.153
T1=0
OPTIMUM
f=86
TT=0.205
T1=0.05
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-90/
normalized-kbtree-5-2-4-5-90-08_ext.xml
MOPT
f=119
TT=5.931
T1=2.07
MSAT (TO)
f=120
TT=1606.07
T1=5.13
MSAT (TO)
f=120
TT=1589.15
T1=4.83
MSAT (TO)
f=119
TT=3600.04

MSAT (TO)
f=119
TT=3600.07

? (TO)

TT=3600.09

? (TO)

TT=3600.07

OPTIMUM
f=119
TT=5.931
T1=2.07
OPTIMUM
f=119
TT=0.206
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-90/
normalized-kbtree-5-2-4-5-90-13_ext.xml
MOPT
f=121
TT=4.075
T1=1.49
MSAT (TO)
f=122
TT=1599.36
T1=3.11
MSAT (TO)
f=122
TT=1579.98
T1=3.13
MSAT (TO)
f=121
TT=3600.06

MSAT (TO)
f=121
TT=3600.06

? (TO)

TT=3600.06

? (TO)

TT=3600.09

OPTIMUM
f=121
TT=4.075
T1=1.49
OPTIMUM
f=121
TT=0.189
T1=0.04
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-90/
normalized-kbtree-5-2-4-5-90-34_ext.xml
MOPT
f=121
TT=3.171
T1=0
MSAT (TO)
f=121
TT=1601.96
T1=5.32
MSAT (TO)
f=121
TT=1590.27
T1=5.31
MSAT (TO)
f=121
TT=3600.08

MSAT (TO)
f=121
TT=3600.05

? (TO)

TT=3600.08

? (TO)

TT=3600.08

OPTIMUM
f=121
TT=3.171
T1=0
OPTIMUM
f=121
TT=0.255
T1=0.04
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-10/
normalized-kbtree-9-2-3-5-10-26_ext.xml
MOPT
f=0
TT=0.022
T1=0
OPTIMUM
f=0
TT=3.815
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.809
T1=0.57
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.505

CHECKS=7324
NODES=15
OPTIMUM
f=0
TT=0.501

CHECKS=7224
NODES=11
OPTIMUM
f=0
TT=3.599
T1=3.38
OPTIMUM
f=0
TT=2.808
T1=2.59
OPTIMUM
f=0
TT=0.022
T1=0
OPTIMUM
f=0
TT=0.09
T1=0
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-10/
normalized-kbtree-9-2-3-5-10-35_ext.xml
MOPT
f=0
TT=0.021
T1=0
OPTIMUM
f=0
TT=3.755
T1=0.61
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.787
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.493

CHECKS=7694
NODES=17
OPTIMUM
f=0
TT=0.494

CHECKS=7109
NODES=12
OPTIMUM
f=0
TT=3.611
T1=3.4
OPTIMUM
f=0
TT=2.749
T1=2.61
OPTIMUM
f=0
TT=0.021
T1=0
OPTIMUM
f=0
TT=0.094
T1=0
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-10/
normalized-kbtree-9-2-3-5-10-38_ext.xml
MOPT
f=0
TT=0.024
T1=0.01
OPTIMUM
f=0
TT=3.833
T1=0.59
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.755
T1=0.62
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.505

CHECKS=7674
NODES=21
OPTIMUM
f=0
TT=0.504

CHECKS=7059
NODES=10
OPTIMUM
f=0
TT=3.587
T1=3.41
OPTIMUM
f=0
TT=2.757
T1=2.54
OPTIMUM
f=0
TT=0.024
T1=0.01
OPTIMUM
f=0
TT=0.093
T1=0
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-20/
normalized-kbtree-9-2-3-5-20-01_ext.xml
MOPT
f=0
TT=0.066
T1=0
OPTIMUM
f=0
TT=3.154
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.217
T1=0.63
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.566

CHECKS=21549
NODES=308
OPTIMUM
f=0
TT=0.563

CHECKS=28019
NODES=386
OPTIMUM
f=0
TT=3.678
T1=3.46
OPTIMUM
f=0
TT=2.842
T1=2.75
OPTIMUM
f=0
TT=0.066
T1=0
OPTIMUM
f=0
TT=0.102
T1=0
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-20/
normalized-kbtree-9-2-3-5-20-02_ext.xml
MOPT
f=0
TT=0.047
T1=0
OPTIMUM
f=0
TT=3.207
T1=0.68
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.16
T1=0.59
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.572

CHECKS=16169
NODES=160
OPTIMUM
f=0
TT=0.569

CHECKS=41169
NODES=600
OPTIMUM
f=0
TT=3.559
T1=3.38
OPTIMUM
f=0
TT=2.892
T1=2.7
OPTIMUM
f=0
TT=0.047
T1=0
OPTIMUM
f=0
TT=0.103
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-20/
normalized-kbtree-9-2-3-5-20-15_ext.xml
MOPT
f=0
TT=0.043
T1=0
OPTIMUM
f=0
TT=3.13
T1=0.68
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.123
T1=0.67
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.564

CHECKS=29439
NODES=422
OPTIMUM
f=0
TT=0.576

CHECKS=22424
NODES=291
OPTIMUM
f=0
TT=3.629
T1=3.42
OPTIMUM
f=0
TT=2.88
T1=2.66
OPTIMUM
f=0
TT=0.043
T1=0
OPTIMUM
f=0
TT=0.102
T1=0
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-30/
normalized-kbtree-9-2-3-5-30-02_ext.xml
MOPT
f=9
TT=61.91
T1=1.78
MSAT (TO)
f=9
TT=1586.63
T1=1.78
MSAT (TO)
f=9
TT=1598.95
T1=1.87
MSAT (TO)
f=9
TT=3600.07

MSAT (TO)
f=9
TT=3600.06

MSAT (TO)
f=9
TT=3600.06
T1=1416.24
MSAT (TO)
f=9
TT=3600.1
T1=958.62
OPTIMUM
f=9
TT=61.91
T1=43.17
OPTIMUM
f=9
TT=1.32
T1=1.09
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-30/
normalized-kbtree-9-2-3-5-30-08_ext.xml
MOPT
f=7
TT=10.242
T1=1.02
MSAT (TO)
f=7
TT=1597.99
T1=1.07
MSAT (TO)
f=7
TT=1577.11
T1=1.02
MSAT (TO)
f=7
TT=3600.08

MSAT (TO)
f=7
TT=3600.02

OPTIMUM
f=7
TT=601.208
T1=601.01
OPTIMUM
f=7
TT=467.651
T1=467.45
OPTIMUM
f=7
TT=10.242
T1=6.33
OPTIMUM
f=7
TT=0.298
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-30/
normalized-kbtree-9-2-3-5-30-34_ext.xml
MOPT
f=6
TT=0.822
T1=0
MSAT (TO)
f=6
TT=1592.98
T1=0.88
MSAT (TO)
f=6
TT=1583.04
T1=0.67
MSAT (TO)
f=6
TT=3600.05

MSAT (TO)
f=6
TT=3600.07

OPTIMUM
f=6
TT=56.993
T1=43.37
OPTIMUM
f=6
TT=40.088
T1=27.33
OPTIMUM
f=6
TT=0.822
T1=0
OPTIMUM
f=6
TT=0.37
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-40/
normalized-kbtree-9-2-3-5-40-16_ext.xml
MOPT
f=27
TT=112.054
T1=7.65
MSAT (TO)
f=27
TT=1607.75
T1=7.85
MSAT (TO)
f=27
TT=1575.09
T1=7.65
MSAT (TO)
f=27
TT=3600.06

MSAT (TO)
f=27
TT=3600.02

MSAT (TO)
f=57
TT=3600.03
T1=1.83
MSAT (TO)
f=66
TT=3600.06
T1=2.28
OPTIMUM
f=27
TT=112.054
T1=31.65
OPTIMUM
f=27
TT=1.074
T1=0.07
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-40/
normalized-kbtree-9-2-3-5-40-38_ext.xml
MOPT
f=27
TT=231.657
T1=217.88
MSAT (TO)
f=28
TT=1603.77
T1=5.25
MSAT (TO)
f=28
TT=1611.25
T1=5.21
MSAT (TO)
f=27
TT=3600.06

MSAT (TO)
f=27
TT=3600.06

MSAT (TO)
f=57
TT=3600.02
T1=1.68
MSAT (TO)
f=57
TT=3600.09
T1=1.72
OPTIMUM
f=27
TT=231.657
T1=217.88
OPTIMUM
f=27
TT=0.773
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-40/
normalized-kbtree-9-2-3-5-40-50_ext.xml
MOPT
f=30
TT=1464.28
T1=916.61
MSAT (TO)
f=31
TT=1605.01
T1=10.59
MSAT (TO)
f=31
TT=1582.17
T1=9.7
MSAT (TO)
f=30
TT=3600.04

MSAT (TO)
f=31
TT=3600.09

MSAT (TO)
f=67
TT=3600.05
T1=2.35
MSAT (TO)
f=73
TT=3600.12
T1=1.39
OPTIMUM
f=30
TT=1464.28
T1=916.61
OPTIMUM
f=30
TT=1.717
T1=1.57
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-50/
normalized-kbtree-9-2-3-5-50-05_ext.xml
MOPT
f=48
TT=815.95
T1=349.25
MSAT (TO)
f=49
TT=1599.18
T1=17.92
MSAT (TO)
f=49
TT=1601.74
T1=16.18
MSAT (TO)
f=48
TT=3600.01

MSAT (TO)
f=48
TT=3600.04

MSAT (TO)
f=98
TT=3600.06
T1=1.57
MSAT (TO)
f=106
TT=3600.09
T1=1.59
OPTIMUM
f=48
TT=815.95
T1=349.25
OPTIMUM
f=48
TT=1.26
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-50/
normalized-kbtree-9-2-3-5-50-24_ext.xml
MOPT
f=48
TT=1505.22
T1=1266.6
MSAT (TO)
f=49
TT=3600.15
T1=0.84
MSAT (TO)
f=49
TT=1596.72
T1=0.8
MSAT (TO)
f=48
TT=3600.1

MSAT (TO)
f=49
TT=3600.04

MSAT (TO)
f=103
TT=3600.04
T1=1.73
MSAT (TO)
f=103
TT=3600.09
T1=1.51
OPTIMUM
f=48
TT=1505.22
T1=1266.6
OPTIMUM
f=48
TT=1.44
T1=1.08
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-50/
normalized-kbtree-9-2-3-5-50-31_ext.xml
MOPT
f=45
TT=364.264
T1=3.16
MSAT (TO)
f=45
TT=1600.79
T1=3.25
MSAT (TO)
f=45
TT=1594.33
T1=3.16
MSAT (TO)
f=45
TT=3600.09

MSAT (TO)
f=45
TT=3600.06

MSAT (TO)
f=74
TT=3600.06
T1=3329.67
MSAT (TO)
f=97
TT=3600.07
T1=1.39
OPTIMUM
f=45
TT=364.264
T1=295.35
OPTIMUM
f=45
TT=0.897
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-60/
normalized-kbtree-9-2-3-5-60-02_ext.xml
MOPT
f=86
TT=2611.56
T1=10.22
MSAT (TO)
f=86
TT=1641.7
T1=10.25
MSAT (TO)
f=86
TT=1590.93
T1=10.22
MSAT (TO)
f=86
TT=3600.05

MSAT (TO)
f=86
TT=3600.08

MSAT (TO)
f=143
TT=3600.08
T1=1.63
MSAT (TO)
f=136
TT=3600.1
T1=1.37
OPTIMUM
f=86
TT=2611.56
T1=574.44
OPTIMUM
f=86
TT=5.054
T1=4.34
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-60/
normalized-kbtree-9-2-3-5-60-21_ext.xml
MSAT TO
f=85
TT=1592.3
T1=33.37
MSAT (TO)
f=86
TT=1612.83
T1=6.42
MSAT (TO)
f=85
TT=1592.3
T1=33.37
MSAT (TO)
f=85
TT=3600.06

MSAT (TO)
f=85
TT=3600.07

MSAT (TO)
f=138
TT=3600
T1=17.36
MSAT (TO)
f=142
TT=3600.14
T1=2.15
? (TO)

TT=3600.1

OPTIMUM
f=85
TT=2.345
T1=1.46
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-60/
normalized-kbtree-9-2-3-5-60-41_ext.xml
MOPT
f=87
TT=2148.25
T1=0.88
MSAT (TO)
f=87
TT=1568.61
T1=0.88
MSAT (TO)
f=87
TT=1597.07
T1=0.88
MSAT (TO)
f=87
TT=3600.07

MSAT (TO)
f=87
TT=3600.09

MSAT (TO)
f=127
TT=3600.07
T1=2.02
MSAT (TO)
f=149
TT=3600.15
T1=1.9
OPTIMUM
f=87
TT=2148.25
T1=69.17
OPTIMUM
f=87
TT=3.624
T1=2.75
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-70/
normalized-kbtree-9-2-3-5-70-04_ext.xml
MSAT TO
f=112
TT=1598.71
T1=21.39
MSAT (TO)
f=112
TT=1601.55
T1=23.15
MSAT (TO)
f=112
TT=1598.71
T1=21.39
MSAT (TO)
f=112
TT=3600

MSAT (TO)
f=112
TT=3600.09

MSAT (TO)
f=150
TT=3600.06
T1=24.42
MSAT (TO)
f=143
TT=3600.13
T1=44.49
? (TO)

TT=3600.09

OPTIMUM
f=112
TT=2.879
T1=1.58
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-70/
normalized-kbtree-9-2-3-5-70-39_ext.xml
MOPT
f=108
TT=897.07
T1=10.74
MSAT (TO)
f=109
TT=3600.12
T1=0.84
MSAT (TO)
f=109
TT=1613.23
T1=0.88
MSAT (TO)
f=108
TT=3600

MSAT (TO)
f=108
TT=3600.01

MSAT (TO)
f=143
TT=3600.02
T1=2.06
MSAT (TO)
f=143
TT=3600.13
T1=9.3
OPTIMUM
f=108
TT=897.07
T1=10.74
OPTIMUM
f=108
TT=1.785
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-70/
normalized-kbtree-9-2-3-5-70-50_ext.xml
MSAT TO
f=112
TT=3600

MSAT (TO)
f=113
TT=1597.33
T1=16.22
MSAT (TO)
f=113
TT=1589.18
T1=17.41
MSAT (TO)
f=112
TT=3600.09

MSAT (TO)
f=112
TT=3600

MSAT (TO)
f=148
TT=3600.03
T1=41.42
MSAT (TO)
f=137
TT=3600.14
T1=85.97
? (TO)

TT=3600.11

OPTIMUM
f=112
TT=3.624
T1=3.04
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-80/
normalized-kbtree-9-2-3-5-80-36_ext.xml
MOPT
f=157
TT=340.681
T1=11.44
MSAT (TO)
f=157
TT=1596.48
T1=12.38
MSAT (TO)
f=157
TT=1599.45
T1=11.44
MSAT (TO)
f=157
TT=3600.03

MSAT (TO)
f=157
TT=3600.07

? (TO)

TT=3600.07

? (TO)

TT=3600.12

OPTIMUM
f=157
TT=340.681
T1=56.45
OPTIMUM
f=157
TT=3.366
T1=2.75
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-80/
normalized-kbtree-9-2-3-5-80-38_ext.xml
MSAT TO
f=158
TT=3600

MSAT (TO)
f=159
TT=1596.08
T1=5.78
MSAT (TO)
f=159
TT=1598.82
T1=6.32
MSAT (TO)
f=158
TT=3600.03

MSAT (TO)
f=158
TT=3600

? (TO)

TT=3600.1

? (TO)

TT=3600.12

? (TO)

TT=3600.05

OPTIMUM
f=158
TT=2.861
T1=2.75
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-80/
normalized-kbtree-9-2-3-5-80-50_ext.xml
MOPT
f=153
TT=3228.99
T1=37.01
MSAT (TO)
f=153
TT=1611.03
T1=39.65
MSAT (TO)
f=153
TT=1609.87
T1=37.01
MSAT (TO)
f=153
TT=3600.05

MSAT (TO)
f=153
TT=3600.01

? (TO)

TT=3600.06

? (TO)

TT=3600.13

OPTIMUM
f=153
TT=3228.99
T1=2842.72
OPTIMUM
f=153
TT=2.107
T1=1.67
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-90/
normalized-kbtree-9-2-3-5-90-06_ext.xml
MOPT
f=193
TT=979.48
T1=368.72
MSAT (TO)
f=194
TT=1603.64
T1=12.68
MSAT (TO)
f=194
TT=1607.41
T1=12.46
MSAT (TO)
f=193
TT=3600.09

MSAT (TO)
f=193
TT=3600.09

? (TO)

TT=3600.06

? (TO)

TT=3600.11

OPTIMUM
f=193
TT=979.48
T1=368.72
OPTIMUM
f=193
TT=1.866
T1=0.06
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-90/
normalized-kbtree-9-2-3-5-90-29_ext.xml
MOPT
f=196
TT=766.222
T1=29.41
MSAT (TO)
f=196
TT=1627.83
T1=29.41
MSAT (TO)
f=196
TT=1605.26
T1=29.5
MSAT (TO)
f=196
TT=3600.01

MSAT (TO)
f=196
TT=3600.09

? (TO)

TT=3600.02

? (TO)

TT=3600.13

OPTIMUM
f=196
TT=766.222
T1=167.33
OPTIMUM
f=196
TT=1.355
T1=0.05
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-90/
normalized-kbtree-9-2-3-5-90-48_ext.xml
MOPT
f=197
TT=1098.63
T1=27.13
MSAT (TO)
f=197
TT=1619.64
T1=27.13
MSAT (TO)
f=197
TT=1612.17
T1=27.21
MSAT (TO)
f=197
TT=3600.01

MSAT (TO)
f=197
TT=3600.08

? (TO)

TT=3600.03

? (TO)

TT=3600.11

OPTIMUM
f=197
TT=1098.63
T1=804.69
OPTIMUM
f=197
TT=1.205
T1=0.05
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-10/
normalized-kbtree-9-5-3-5-10-18_ext.xml
MOPT
f=0
TT=0.02
T1=0
OPTIMUM
f=0
TT=3.475
T1=0.68
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.188
T1=0.61
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.507

CHECKS=6620
NODES=17
OPTIMUM
f=0
TT=0.621

CHECKS=6125
NODES=11
OPTIMUM
f=0
TT=1.605
T1=1.44
OPTIMUM
f=0
TT=1.617
T1=1.38
OPTIMUM
f=0
TT=0.02
T1=0
OPTIMUM
f=0
TT=0.085
T1=0.04
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-10/
normalized-kbtree-9-5-3-5-10-31_ext.xml
MOPT
f=0
TT=0.021
T1=0
OPTIMUM
f=0
TT=3.206
T1=0.59
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.39
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.504

CHECKS=6555
NODES=15
OPTIMUM
f=0
TT=0.502

CHECKS=5945
NODES=7
OPTIMUM
f=0
TT=1.682
T1=1.51
OPTIMUM
f=0
TT=1.665
T1=1.39
OPTIMUM
f=0
TT=0.021
T1=0
OPTIMUM
f=0
TT=0.084
T1=0.05
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-10/
normalized-kbtree-9-5-3-5-10-36_ext.xml
MOPT
f=0
TT=0.02
T1=0
OPTIMUM
f=0
TT=3.127
T1=0.6
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=3.162
T1=0.57
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.502

CHECKS=6000
NODES=11
OPTIMUM
f=0
TT=0.477

CHECKS=6110
NODES=9
OPTIMUM
f=0
TT=1.649
T1=1.59
OPTIMUM
f=0
TT=1.63
T1=1.35
OPTIMUM
f=0
TT=0.02
T1=0
OPTIMUM
f=0
TT=0.081
T1=0
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-20/
normalized-kbtree-9-5-3-5-20-04_ext.xml
MOPT
f=0
TT=0.134
T1=0
OPTIMUM
f=0
TT=2.726
T1=0.68
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.879
T1=0.68
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.574

CHECKS=34075
NODES=446
OPTIMUM
f=0
TT=0.539

CHECKS=46715
NODES=633
OPTIMUM
f=0
TT=1.615
T1=1.45
OPTIMUM
f=0
TT=1.623
T1=1.39
OPTIMUM
f=0
TT=0.134
T1=0
OPTIMUM
f=0
TT=0.159
T1=0.04
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-20/
normalized-kbtree-9-5-3-5-20-13_ext.xml
MOPT
f=1
TT=0.034
T1=0
OPTIMUM
f=1
TT=33.278
T1=0.59
CHECKS=122908
NODES=280
OPTIMUM
f=1
TT=73.433
T1=0.68
CHECKS=2319270
NODES=2612
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=1.682
T1=1.44
OPTIMUM
f=1
TT=1.797
T1=1.52
OPTIMUM
f=1
TT=0.034
T1=0
OPTIMUM
f=1
TT=0.112
T1=0.05
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-20/
normalized-kbtree-9-5-3-5-20-21_ext.xml
MOPT
f=1
TT=0.04
T1=0
OPTIMUM
f=1
TT=33.049
T1=0.63
CHECKS=106173
NODES=198
OPTIMUM
f=1
TT=55.855
T1=0.78
CHECKS=1337200
NODES=1511
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=3.093
T1=2.83
OPTIMUM
f=1
TT=2.832
T1=2.71
OPTIMUM
f=1
TT=0.04
T1=0
OPTIMUM
f=1
TT=0.099
T1=0.04
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-30/
normalized-kbtree-9-5-3-5-30-06_ext.xml
MOPT
f=10
TT=3.476
T1=1.97
MSAT (TO)
f=10
TT=3163.13
T1=1.97
MSAT (TO)
f=10
TT=2118.58
T1=2.19
MSAT (TO)
f=10
TT=3600.1

MSAT (TO)
f=10
TT=3600.07

OPTIMUM
f=10
TT=1882.03
T1=1604.73
OPTIMUM
f=10
TT=2598.39
T1=2249.09
OPTIMUM
f=10
TT=3.476
T1=3.05
OPTIMUM
f=10
TT=2.438
T1=1.78
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-30/
normalized-kbtree-9-5-3-5-30-13_ext.xml
MOPT
f=12
TT=1.22
T1=0
MSAT (TO)
f=12
TT=1584.58
T1=0.68
MSAT (TO)
f=12
TT=1840.59
T1=0.72
MSAT (TO)
f=12
TT=3600.06

MSAT (TO)
f=12
TT=3600.05

MSAT (TO)
f=13
TT=3600.12
T1=3297.24
MSAT (TO)
f=14
TT=3600.14
T1=1753.47
OPTIMUM
f=12
TT=1.22
T1=0
OPTIMUM
f=12
TT=1.156
T1=0.05
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-30/
normalized-kbtree-9-5-3-5-30-37_ext.xml
MOPT
f=9
TT=1.268
T1=0
MSAT (TO)
f=9
TT=1622.25
T1=0.77
MSAT (TO)
f=9
TT=1573.88
T1=0.77
MSAT (TO)
f=9
TT=3600.05

MSAT (TO)
f=9
TT=3600.09

OPTIMUM
f=9
TT=1071.96
T1=1019.53
OPTIMUM
f=9
TT=276.303
T1=273.02
OPTIMUM
f=9
TT=1.268
T1=0
OPTIMUM
f=9
TT=1.371
T1=0.04
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-40/
normalized-kbtree-9-5-3-5-40-09_ext.xml
MOPT
f=32
TT=20.568
T1=1.26
MSAT (TO)
f=32
TT=1593.15
T1=1.26
MSAT (TO)
f=32
TT=1584.5
T1=1.28
MSAT (TO)
f=32
TT=3600.03

MSAT (TO)
f=32
TT=3600.08

MSAT (TO)
f=57
TT=3600.1
T1=6.87
MSAT (TO)
f=63
TT=3600.12
T1=2.29
OPTIMUM
f=32
TT=20.568
T1=14.54
OPTIMUM
f=32
TT=12.283
T1=1.56
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-40/
normalized-kbtree-9-5-3-5-40-23_ext.xml
MOPT
f=29
TT=10.704
T1=5.72
MSAT (TO)
f=29
TT=1608.67
T1=26.92
MSAT (TO)
f=29
TT=1818.8
T1=25.12
MSAT (TO)
f=29
TT=3600.08

MSAT (TO)
f=29
TT=3600.05

MSAT (TO)
f=59
TT=3600.09
T1=1.91
MSAT (TO)
f=58
TT=3600.11
T1=2.05
OPTIMUM
f=29
TT=10.704
T1=5.72
OPTIMUM
f=29
TT=13.075
T1=8.01
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-40/
normalized-kbtree-9-5-3-5-40-41_ext.xml
MOPT
f=31
TT=24.482
T1=1.23
MSAT (TO)
f=31
TT=3600.17
T1=1.3
MSAT (TO)
f=31
TT=1909.83
T1=1.23
MSAT (TO)
f=31
TT=3600.08

MSAT (TO)
f=31
TT=3600.06

MSAT (TO)
f=61
TT=3600.09
T1=1.74
MSAT (TO)
f=54
TT=3600.06
T1=1.72
OPTIMUM
f=31
TT=24.482
T1=7.13
OPTIMUM
f=31
TT=33.239
T1=16.53
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-50/
normalized-kbtree-9-5-3-5-50-06_ext.xml
MOPT
f=49
TT=65.022
T1=0.64
MSAT (TO)
f=49
TT=2262.23
T1=0.66
MSAT (TO)
f=49
TT=3118.88
T1=0.64
MSAT (TO)
f=49
TT=3600.07

MSAT (TO)
f=49
TT=3600.02

MSAT (TO)
f=86
TT=3600.01
T1=1.26
MSAT (TO)
f=92
TT=3600.08
T1=1.22
OPTIMUM
f=49
TT=65.022
T1=50.08
OPTIMUM
f=49
TT=63.606
T1=36.16
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-50/
normalized-kbtree-9-5-3-5-50-08_ext.xml
MOPT
f=47
TT=20.035
T1=1.19
MSAT (TO)
f=47
TT=3529.28
T1=1.36
MSAT (TO)
f=47
TT=3600.16
T1=1.19
MSAT (TO)
f=47
TT=3600.06

MSAT (TO)
f=47
TT=3600.05

MSAT (TO)
f=86
TT=3600.03
T1=1.53
MSAT (TO)
f=98
TT=3600.13
T1=1.26
OPTIMUM
f=47
TT=20.035
T1=8.7
OPTIMUM
f=47
TT=31.052
T1=22.94
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-50/
normalized-kbtree-9-5-3-5-50-28_ext.xml
MOPT
f=46
TT=10.663
T1=0.61
MSAT (TO)
f=46
TT=3600.12
T1=0.61
MSAT (TO)
f=46
TT=2022.61
T1=0.77
MSAT (TO)
f=46
TT=3600.05

MSAT (TO)
f=46
TT=3600.05

MSAT (TO)
f=98
TT=3600.06
T1=1.34
MSAT (TO)
f=91
TT=3600.06
T1=1.32
OPTIMUM
f=46
TT=10.663
T1=6.62
OPTIMUM
f=46
TT=9.499
T1=3.45
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-60/
normalized-kbtree-9-5-3-5-60-05_ext.xml
MOPT
f=74
TT=14.717
T1=1.42
MSAT (TO)
f=74
TT=1688.74
T1=1.42
MSAT (TO)
f=74
TT=1561.05
T1=1.57
MSAT (TO)
f=74
TT=3600.07

MSAT (TO)
f=74
TT=3600.09

MSAT (TO)
f=110
TT=3600.07
T1=1.39
MSAT (TO)
f=116
TT=3600.1
T1=1.56
OPTIMUM
f=74
TT=14.717
T1=5.73
OPTIMUM
f=74
TT=12.245
T1=2.16
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-60/
normalized-kbtree-9-5-3-5-60-23_ext.xml
MOPT
f=76
TT=3.593
T1=1.37
MSAT (TO)
f=76
TT=1607.78
T1=1.37
MSAT (TO)
f=76
TT=1598.39
T1=1.39
MSAT (TO)
f=76
TT=3600.04

MSAT (TO)
f=76
TT=3600.04

MSAT (TO)
f=117
TT=3600.13
T1=1.28
MSAT (TO)
f=114
TT=3600.05
T1=1.53
OPTIMUM
f=76
TT=3.593
T1=1.67
OPTIMUM
f=76
TT=3.329
T1=1.52
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-60/
normalized-kbtree-9-5-3-5-60-33_ext.xml
MOPT
f=75
TT=18.828
T1=12.94
MSAT (TO)
f=75
TT=1607.22
T1=14.45
MSAT (TO)
f=75
TT=1660.6
T1=14.44
MSAT (TO)
f=75
TT=3600.02

MSAT (TO)
f=75
TT=3600.05

MSAT (TO)
f=104
TT=3600.03
T1=2.09
MSAT (TO)
f=112
TT=3600.1
T1=1.34
OPTIMUM
f=75
TT=18.828
T1=12.94
OPTIMUM
f=75
TT=16.986
T1=8.8
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-70/
normalized-kbtree-9-5-3-5-70-03_ext.xml
MOPT
f=100
TT=20.048
T1=1.66
MSAT (TO)
f=100
TT=1580.79
T1=1.66
MSAT (TO)
f=100
TT=2102.46
T1=1.85
MSAT (TO)
f=100
TT=3600.06

MSAT (TO)
f=100
TT=3600.05

MSAT (TO)
f=121
TT=3600.06
T1=294.15
MSAT (TO)
f=124
TT=3600.06
T1=6.45
OPTIMUM
f=100
TT=20.048
T1=10.44
OPTIMUM
f=100
TT=21.242
T1=13.66
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-70/
normalized-kbtree-9-5-3-5-70-09_ext.xml
MOPT
f=94
TT=4.298
T1=0.77
MSAT (TO)
f=94
TT=1943.86
T1=0.77
MSAT (TO)
f=94
TT=2318
T1=0.88
MSAT (TO)
f=94
TT=3600.1

MSAT (TO)
f=94
TT=3600.02

MSAT (TO)
f=119
TT=3600.08
T1=18.89
MSAT (TO)
f=124
TT=3600.05
T1=181.8
OPTIMUM
f=94
TT=4.298
T1=1.19
OPTIMUM
f=94
TT=5.211
T1=1.97
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-70/
normalized-kbtree-9-5-3-5-70-23_ext.xml
MOPT
f=99
TT=7.295
T1=1.77
MSAT (TO)
f=99
TT=1969.83
T1=5.17
MSAT (TO)
f=99
TT=1820.87
T1=5.15
MSAT (TO)
f=99
TT=3600.05

MSAT (TO)
f=99
TT=3600.1

MSAT (TO)
f=126
TT=3600.06
T1=3430.73
MSAT (TO)
f=124
TT=3600.06
T1=3.6
OPTIMUM
f=99
TT=7.295
T1=1.77
OPTIMUM
f=99
TT=8.064
T1=2.06
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-80/
normalized-kbtree-9-5-3-5-80-08_ext.xml
MOPT
f=134
TT=6.597
T1=0.77
MSAT (TO)
f=134
TT=1800.12
T1=0.77
MSAT (TO)
f=134
TT=1578.14
T1=0.78
MSAT (TO)
f=134
TT=3600.02

MSAT (TO)
f=134
TT=3600.01

? (TO)

TT=3600.03

? (TO)

TT=3600.11

OPTIMUM
f=134
TT=6.597
T1=1.98
OPTIMUM
f=134
TT=6.989
T1=1.67
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-80/
normalized-kbtree-9-5-3-5-80-23_ext.xml
MOPT
f=136
TT=67.89
T1=0.64
MSAT (TO)
f=136
TT=3600.14
T1=0.64
MSAT (TO)
f=136
TT=3480.39
T1=0.77
MSAT (TO)
f=136
TT=3600.02

MSAT (TO)
f=136
TT=3600.03

? (TO)

TT=3600.08

? (TO)

TT=3600.06

OPTIMUM
f=136
TT=67.89
T1=32.6
OPTIMUM
f=136
TT=64.477
T1=27.43
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-80/
normalized-kbtree-9-5-3-5-80-47_ext.xml
MOPT
f=129
TT=5.117
T1=0
MSAT (TO)
f=129
TT=1596.54
T1=7.21
MSAT (TO)
f=129
TT=2668.12
T1=7.32
MSAT (TO)
f=129
TT=3600.04

MSAT (TO)
f=129
TT=3600.06

? (TO)

TT=3600.07

? (TO)

TT=3600.11

OPTIMUM
f=129
TT=5.117
T1=0
OPTIMUM
f=129
TT=8.742
T1=6.02
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-90/
normalized-kbtree-9-5-3-5-90-10_ext.xml
MOPT
f=167
TT=3.418
T1=0.88
MSAT (TO)
f=167
TT=1765.81
T1=0.88
MSAT (TO)
f=167
TT=1552.84
T1=0.97
MSAT (TO)
f=167
TT=3600.01

MSAT (TO)
f=167
TT=3600.1

? (TO)

TT=3600.08

? (TO)

TT=3600.06

OPTIMUM
f=167
TT=3.418
T1=2.46
OPTIMUM
f=167
TT=2.711
T1=1.46
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-90/
normalized-kbtree-9-5-3-5-90-45_ext.xml
MOPT
f=163
TT=2.875
T1=0
MSAT (TO)
f=163
TT=2427.53
T1=0.78
MSAT (TO)
f=163
TT=1828.17
T1=0.76
MSAT (TO)
f=163
TT=3600.06

MSAT (TO)
f=163
TT=3600.06

? (TO)

TT=3600.01

? (TO)

TT=3600.12

OPTIMUM
f=163
TT=2.875
T1=0
OPTIMUM
f=163
TT=4.311
T1=2.06
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-90/
normalized-kbtree-9-5-3-5-90-47_ext.xml
MOPT
f=164
TT=3.306
T1=0.68
MSAT (TO)
f=164
TT=1798.96
T1=0.78
MSAT (TO)
f=164
TT=2578.38
T1=0.68
MSAT (TO)
f=164
TT=3600.01

MSAT (TO)
f=164
TT=3600.03

? (TO)

TT=3600.09

? (TO)

TT=3600.09

OPTIMUM
f=164
TT=3.306
T1=2.26
OPTIMUM
f=164
TT=3.229
T1=2.45
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-10/
normalized-kbtree-9-7-3-5-10-04_ext.xml
MOPT
f=0
TT=0.017
T1=0
OPTIMUM
f=0
TT=2.613
T1=0.56
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.627
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.412

CHECKS=4869
NODES=12
OPTIMUM
f=0
TT=0.429

CHECKS=4389
NODES=5
OPTIMUM
f=0
TT=2.489
T1=2.33
OPTIMUM
f=0
TT=2.096
T1=1.91
OPTIMUM
f=0
TT=0.017
T1=0
OPTIMUM
f=0
TT=0.064
T1=0
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-10/
normalized-kbtree-9-7-3-5-10-08_ext.xml
MOPT
f=0
TT=0.017
T1=0
OPTIMUM
f=0
TT=2.633
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.578
T1=0.48
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.407

CHECKS=4599
NODES=9
OPTIMUM
f=0
TT=0.437

CHECKS=4449
NODES=6
OPTIMUM
f=0
TT=2.317
T1=2.15
OPTIMUM
f=0
TT=1.979
T1=1.83
OPTIMUM
f=0
TT=0.017
T1=0
OPTIMUM
f=0
TT=0.066
T1=0
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-10/
normalized-kbtree-9-7-3-5-10-25_ext.xml
MOPT
f=0
TT=0.017
T1=0
OPTIMUM
f=0
TT=2.809
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.669
T1=0.58
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.409

CHECKS=4944
NODES=13
OPTIMUM
f=0
TT=0.433

CHECKS=4359
NODES=8
OPTIMUM
f=0
TT=2.309
T1=2.14
OPTIMUM
f=0
TT=2.058
T1=1.99
OPTIMUM
f=0
TT=0.017
T1=0
OPTIMUM
f=0
TT=0.066
T1=0
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-20/
normalized-kbtree-9-7-3-5-20-12_ext.xml
MOPT
f=1
TT=0.041
T1=0
OPTIMUM
f=1
TT=31.911
T1=0.62
CHECKS=51790
NODES=104
OPTIMUM
f=1
TT=41.263
T1=0.64
CHECKS=539451
NODES=756
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.02

OPTIMUM
f=1
TT=2.698
T1=2.48
OPTIMUM
f=1
TT=2.37
T1=2.19
OPTIMUM
f=1
TT=0.041
T1=0
OPTIMUM
f=1
TT=0.09
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-20/
normalized-kbtree-9-7-3-5-20-23_ext.xml
MOPT
f=1
TT=0.028
T1=0
OPTIMUM
f=1
TT=33.574
T1=0.63
CHECKS=146862
NODES=315
OPTIMUM
f=1
TT=39.666
T1=0.59
CHECKS=495167
NODES=747
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=2.356
T1=2.15
OPTIMUM
f=1
TT=2.143
T1=1.95
OPTIMUM
f=1
TT=0.028
T1=0
OPTIMUM
f=1
TT=0.082
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-20/
normalized-kbtree-9-7-3-5-20-40_ext.xml
MOPT
f=2
TT=0.065
T1=0
OPTIMUM
f=2
TT=45.573
T1=0.64
CHECKS=828515
NODES=1458
OPTIMUM
f=2
TT=154.971
T1=0.54
CHECKS=7253490
NODES=11033
MSAT (TO)
f=2
TT=3600.07

MSAT (TO)
f=2
TT=3600.03

OPTIMUM
f=2
TT=2.456
T1=2.29
OPTIMUM
f=2
TT=2.173
T1=2
OPTIMUM
f=2
TT=0.065
T1=0
OPTIMUM
f=2
TT=0.11
T1=0
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-30/
normalized-kbtree-9-7-3-5-30-10_ext.xml
MOPT
f=9
TT=0.437
T1=0
OPTIMUM
f=9
TT=586.822
T1=1.07
CHECKS=31659000
NODES=45340
OPTIMUM
f=9
TT=1347.74
T1=0.8
CHECKS=77745000
NODES=101893
MSAT (TO)
f=9
TT=3600.07

MSAT (TO)
f=9
TT=3600.05

OPTIMUM
f=9
TT=78.236
T1=78.08
OPTIMUM
f=9
TT=103.061
T1=102.85
OPTIMUM
f=9
TT=0.437
T1=0
OPTIMUM
f=9
TT=0.4
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-30/
normalized-kbtree-9-7-3-5-30-25_ext.xml
MOPT
f=7
TT=0.141
T1=0
OPTIMUM
f=7
TT=177.896
T1=0.86
CHECKS=7772960
NODES=10846
OPTIMUM
f=7
TT=593.711
T1=0.76
CHECKS=32168600
NODES=41274
MSAT (TO)
f=7
TT=3600

MSAT (TO)
f=7
TT=3600.09

OPTIMUM
f=7
TT=54.254
T1=47.02
OPTIMUM
f=7
TT=85.093
T1=80.07
OPTIMUM
f=7
TT=0.141
T1=0
OPTIMUM
f=7
TT=0.224
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-30/
normalized-kbtree-9-7-3-5-30-27_ext.xml
MOPT
f=5
TT=0.106
T1=0
OPTIMUM
f=5
TT=87.217
T1=0.77
CHECKS=2954480
NODES=4016
OPTIMUM
f=5
TT=319.098
T1=0.65
CHECKS=15131300
NODES=18459
MSAT (TO)
f=5
TT=3600.03

MSAT (TO)
f=5
TT=3600.04

OPTIMUM
f=5
TT=17.98
T1=17.31
OPTIMUM
f=5
TT=26.898
T1=26.65
OPTIMUM
f=5
TT=0.106
T1=0
OPTIMUM
f=5
TT=0.143
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-40/
normalized-kbtree-9-7-3-5-40-34_ext.xml
MOPT
f=23
TT=0.577
T1=0
MSAT (TO)
f=23
TT=1581.39
T1=0.63
MSAT (TO)
f=23
TT=1589.36
T1=0.75
MSAT (TO)
f=23
TT=3600.04

MSAT (TO)
f=23
TT=3600.09

MSAT (TO)
f=23
TT=3600.09
T1=2428.05
MSAT (TO)
f=41
TT=3600.07
T1=1.74
OPTIMUM
f=23
TT=0.577
T1=0
OPTIMUM
f=23
TT=0.682
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-40/
normalized-kbtree-9-7-3-5-40-39_ext.xml
MOPT
f=23
TT=1.596
T1=0.78
MSAT (TO)
f=23
TT=1582.78
T1=0.78
MSAT (TO)
f=23
TT=1592.96
T1=0.78
MSAT (TO)
f=23
TT=3600.03

MSAT (TO)
f=23
TT=3600.09

MSAT (TO)
f=44
TT=3600.08
T1=1.38
MSAT (TO)
f=46
TT=3600.1
T1=2.16
OPTIMUM
f=23
TT=1.596
T1=1.15
OPTIMUM
f=23
TT=1.107
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-40/
normalized-kbtree-9-7-3-5-40-49_ext.xml
MOPT
f=22
TT=1.434
T1=0.65
MSAT (TO)
f=22
TT=1585.65
T1=0.78
MSAT (TO)
f=22
TT=1574.89
T1=0.65
MSAT (TO)
f=22
TT=3600.03

MSAT (TO)
f=22
TT=3600.09

MSAT (TO)
f=44
TT=3600.13
T1=1.58
MSAT (TO)
f=45
TT=3600.12
T1=1.26
OPTIMUM
f=22
TT=1.434
T1=1.28
OPTIMUM
f=22
TT=1.27
T1=0.03
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-50/
normalized-kbtree-9-7-3-5-50-13_ext.xml
MOPT
f=36
TT=1.588
T1=0.58
MSAT (TO)
f=36
TT=1589.19
T1=0.58
MSAT (TO)
f=36
TT=1567.51
T1=0.68
MSAT (TO)
f=36
TT=3600.04

MSAT (TO)
f=36
TT=3600.04

MSAT (TO)
f=82
TT=3600.08
T1=1.32
MSAT (TO)
f=78
TT=3600.05
T1=1.3
OPTIMUM
f=36
TT=1.588
T1=1.38
OPTIMUM
f=36
TT=1.649
T1=1.07
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-50/
normalized-kbtree-9-7-3-5-50-39_ext.xml
MOPT
f=37
TT=1.223
T1=0
MSAT (TO)
f=37
TT=1591.99
T1=0.78
MSAT (TO)
f=37
TT=1578.52
T1=0.78
MSAT (TO)
f=37
TT=3600.07

MSAT (TO)
f=37
TT=3600.02

MSAT (TO)
f=70
TT=3600.05
T1=1.39
MSAT (TO)
f=67
TT=3600.13
T1=1.14
OPTIMUM
f=37
TT=1.223
T1=0
OPTIMUM
f=37
TT=1.902
T1=1.27
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-50/
normalized-kbtree-9-7-3-5-50-42_ext.xml
MOPT
f=30
TT=0.316
T1=0
MSAT (TO)
f=30
TT=1592.53
T1=0.67
MSAT (TO)
f=30
TT=1585.39
T1=0.78
MSAT (TO)
f=30
TT=3600.03

MSAT (TO)
f=30
TT=3600.04

MSAT (TO)
f=78
TT=3600.09
T1=1.2
MSAT (TO)
f=71
TT=3600.1
T1=1.23
OPTIMUM
f=30
TT=0.316
T1=0
OPTIMUM
f=30
TT=0.343
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-60/
normalized-kbtree-9-7-3-5-60-01_ext.xml
MOPT
f=54
TT=0.335
T1=0
MSAT (TO)
f=54
TT=1564.48
T1=0.63
MSAT (TO)
f=54
TT=1570.34
T1=0.66
MSAT (TO)
f=54
TT=3600.08

MSAT (TO)
f=54
TT=3600

MSAT (TO)
f=89
TT=3600.1
T1=1.14
MSAT (TO)
f=90
TT=3600.05
T1=1.28
OPTIMUM
f=54
TT=0.335
T1=0
OPTIMUM
f=54
TT=0.9
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-60/
normalized-kbtree-9-7-3-5-60-16_ext.xml
MOPT
f=62
TT=1.336
T1=0.98
MSAT (TO)
f=62
TT=1582.03
T1=1.23
MSAT (TO)
f=62
TT=1580.29
T1=1.08
MSAT (TO)
f=62
TT=3600.08

MSAT (TO)
f=62
TT=3600.07

MSAT (TO)
f=78
TT=3600.11
T1=1.16
MSAT (TO)
f=86
TT=3600.11
T1=1.15
OPTIMUM
f=62
TT=1.336
T1=0.98
OPTIMUM
f=62
TT=1.154
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-60/
normalized-kbtree-9-7-3-5-60-19_ext.xml
MOPT
f=59
TT=2.419
T1=0.74
MSAT (TO)
f=59
TT=1584.7
T1=0.74
MSAT (TO)
f=59
TT=1583.54
T1=0.78
MSAT (TO)
f=59
TT=3600.08

MSAT (TO)
f=59
TT=3600.02

MSAT (TO)
f=89
TT=3600.09
T1=1.32
MSAT (TO)
f=83
TT=3600.06
T1=1.89
OPTIMUM
f=59
TT=2.419
T1=1.68
OPTIMUM
f=59
TT=3.236
T1=2.76
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-70/
normalized-kbtree-9-7-3-5-70-33_ext.xml
MOPT
f=74
TT=1.329
T1=0
MSAT (TO)
f=74
TT=1597.33
T1=0.85
MSAT (TO)
f=74
TT=1579.45
T1=0.73
MSAT (TO)
f=74
TT=3600.05

MSAT (TO)
f=74
TT=3600.08

MSAT (TO)
f=93
TT=3600.13
T1=1.24
MSAT (TO)
f=92
TT=3600.09
T1=3.87
OPTIMUM
f=74
TT=1.329
T1=0
OPTIMUM
f=74
TT=1.678
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-70/
normalized-kbtree-9-7-3-5-70-43_ext.xml
MOPT
f=73
TT=0.992
T1=0
MSAT (TO)
f=73
TT=1587.62
T1=0.98
MSAT (TO)
f=73
TT=1598.38
T1=1.08
MSAT (TO)
f=73
TT=3600.03

MSAT (TO)
f=73
TT=3600

MSAT (TO)
f=89
TT=3600.13
T1=3.84
MSAT (TO)
f=91
TT=3600.11
T1=232.78
OPTIMUM
f=73
TT=0.992
T1=0
OPTIMUM
f=73
TT=1.342
T1=0.04
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-70/
normalized-kbtree-9-7-3-5-70-50_ext.xml
MOPT
f=72
TT=1.58
T1=0.64
MSAT (TO)
f=72
TT=1602.16
T1=0.64
MSAT (TO)
f=72
TT=1595.75
T1=0.64
MSAT (TO)
f=72
TT=3600.02

MSAT (TO)
f=72
TT=3600.06

? (TO)

TT=3600.05

? (TO)

TT=3600.07

OPTIMUM
f=72
TT=1.58
T1=1.17
OPTIMUM
f=72
TT=1.329
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-80/
normalized-kbtree-9-7-3-5-80-04_ext.xml
MOPT
f=100
TT=0.529
T1=0
MSAT (TO)
f=100
TT=1583.05
T1=0.74
MSAT (TO)
f=100
TT=1587.08
T1=0.74
MSAT (TO)
f=100
TT=3600.02

MSAT (TO)
f=100
TT=3600.05

? (TO)

TT=3600.08

? (TO)

TT=3600.05

OPTIMUM
f=100
TT=0.529
T1=0
OPTIMUM
f=100
TT=0.646
T1=0.04
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-80/
normalized-kbtree-9-7-3-5-80-05_ext.xml
MOPT
f=104
TT=1.218
T1=0
MSAT (TO)
f=104
TT=3040.41
T1=0.68
MSAT (TO)
f=104
TT=1575.84
T1=0.68
MSAT (TO)
f=104
TT=3600.08

MSAT (TO)
f=104
TT=3600.05

? (TO)

TT=3600.03

? (TO)

TT=3600.13

OPTIMUM
f=104
TT=1.218
T1=0
OPTIMUM
f=104
TT=1.048
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-80/
normalized-kbtree-9-7-3-5-80-50_ext.xml
MOPT
f=97
TT=0.846
T1=0
MSAT (TO)
f=97
TT=2894.07
T1=0.88
MSAT (TO)
f=97
TT=3600.14
T1=0.82
MSAT (TO)
f=97
TT=3600.08

MSAT (TO)
f=97
TT=3600.05

? (TO)

TT=3600.1

? (TO)

TT=3600.12

OPTIMUM
f=97
TT=0.846
T1=0
OPTIMUM
f=97
TT=0.892
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-90/
normalized-kbtree-9-7-3-5-90-08_ext.xml
MOPT
f=123
TT=0.311
T1=0
MSAT (TO)
f=123
TT=1577.88
T1=0.56
MSAT (TO)
f=123
TT=1591.91
T1=0.59
MSAT (TO)
f=123
TT=3600.03

MSAT (TO)
f=123
TT=3600.05

MSAT (TO)
f=139
TT=3600.08
T1=1639.28
MSAT (TO)
f=134
TT=3600.06
T1=2170.36
OPTIMUM
f=123
TT=0.311
T1=0
OPTIMUM
f=123
TT=0.359
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-90/
normalized-kbtree-9-7-3-5-90-11_ext.xml
MOPT
f=123
TT=0.338
T1=0
MSAT (TO)
f=123
TT=1590.14
T1=0.58
MSAT (TO)
f=123
TT=1580.57
T1=0.58
MSAT (TO)
f=123
TT=3600.1

MSAT (TO)
f=123
TT=3600.03

MSAT (TO)
f=141
TT=3600.09
T1=839.13
MSAT (TO)
f=141
TT=3600.11
T1=2433.4
OPTIMUM
f=123
TT=0.338
T1=0
OPTIMUM
f=123
TT=0.343
T1=0.03
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-90/
normalized-kbtree-9-7-3-5-90-27_ext.xml
MOPT
f=127
TT=2.14
T1=0.68
MSAT (TO)
f=127
TT=1599.22
T1=0.68
MSAT (TO)
f=127
TT=1591.72
T1=0.68
MSAT (TO)
f=127
TT=3600.05

MSAT (TO)
f=127
TT=3600.09

MSAT (TO)
f=142
TT=3600.04
T1=2125.55
MSAT (TO)
f=139
TT=3600.06
T1=2414.11
OPTIMUM
f=127
TT=2.14
T1=1.97
OPTIMUM
f=127
TT=1.983
T1=1.55
maxcsp/planning/
normalized-depot01cc_ext.xml
MOPT
f=3
TT=0.025
T1=0
OPTIMUM
f=3
TT=30.929
T1=0.67
CHECKS=1591
NODES=0
OPTIMUM
f=3
TT=30.979
T1=0.67
CHECKS=1591
NODES=0
MSAT (TO)
f=3
TT=3600.03

MSAT (TO)
f=3
TT=3600.08

OPTIMUM
f=3
TT=7.272
T1=6.28
OPTIMUM
f=3
TT=3.734
T1=3.5
OPTIMUM
f=3
TT=0.025
T1=0
OPTIMUM
f=3
TT=0.07
T1=0
maxcsp/planning/
normalized-driverlog01cc_ext.xml
MOPT
f=3
TT=0.026
T1=0
OPTIMUM
f=3
TT=31.022
T1=0.68
CHECKS=4543
NODES=7
OPTIMUM
f=3
TT=57.437
T1=0.63
CHECKS=1486200
NODES=2212
MSAT (TO)
f=3
TT=3600.02

MSAT (TO)
f=3
TT=3600.08

OPTIMUM
f=3
TT=7.51
T1=7.4
OPTIMUM
f=3
TT=4.185
T1=3.86
OPTIMUM
f=3
TT=0.026
T1=0
OPTIMUM
f=3
TT=0.074
T1=0.03
maxcsp/planning/
normalized-driverlog04cc_ext.xml
MOPT
f=6
TT=15.388
T1=0
MSAT (TO)
f=6
TT=1650.13
T1=3.45
MSAT (TO)
f=6
TT=1728.53
T1=3.82
MSAT (TO)
f=6
TT=3600.1

MSAT (TO)
f=6
TT=3600.05

?

TT=170.864

?

TT=176.921

OPTIMUM
f=6
TT=15.388
T1=0
OPTIMUM
f=6
TT=14.259
T1=14.17
maxcsp/planning/
normalized-driverlog05cc_ext.xml
MOPT
f=7
TT=124.021
T1=2.05
MSAT (TO)
f=7
TT=1667.6
T1=1667.54
MSAT (TO)
f=8
TT=1691.5
T1=10.21
MSAT (TO)
f=7
TT=3600.04

MSAT (TO)
f=7
TT=3600.06

?

TT=183.089

?

TT=177.969

OPTIMUM
f=7
TT=124.021
T1=2.05
OPTIMUM
f=7
TT=100.158
T1=100.04
maxcsp/planning/
normalized-driverlog08cc_ext.xml
MOPT
f=7
TT=6.139
T1=1.27
MSAT (TO)
f=7
TT=1710.3
T1=54.78
MSAT (TO)
f=7
TT=1716.35
T1=54.64
MSAT (TO)
f=7
TT=3600.08

MSAT (TO)
f=7
TT=3600.03

?

TT=193.951

?

TT=201.651

OPTIMUM
f=7
TT=6.139
T1=1.27
OPTIMUM
f=7
TT=10.819
T1=10.77
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/planning/
normalized-driverlog08c_ext.xml
MOPT
f=7
TT=6.394
T1=1.21
MSAT (TO)
f=7
TT=1686.64
T1=1686.6
MSAT (TO)
f=10
TT=1695.47
T1=14.73
MSAT (TO)
f=7
TT=3600.02

MSAT (TO)
f=7
TT=3600.03

?

TT=201.549

?

TT=203.556

OPTIMUM
f=7
TT=6.394
T1=1.21
OPTIMUM
f=7
TT=7.783
T1=7.71
maxcsp/planning/
normalized-driverlog09_ext.xml
MSAT TO
f=7
TT=1657.06
T1=6.12
MSAT (TO)
f=7
TT=1657.06
T1=6.5
MSAT (TO)
f=7
TT=1844.69
T1=6.12
MSAT (TO)
f=7
TT=3600.04

MSAT (TO)
f=7
TT=3600.03

?

TT=269.506

?

TT=283.515

? (TO)

TT=3600.06

? (TO)

TT=3600.07

maxcsp/planning/
normalized-mprime03bc_ext.xml
MOPT
f=3
TT=0.025
T1=0
OPTIMUM
f=3
TT=31.396
T1=0.78
CHECKS=15374
NODES=11
OPTIMUM
f=3
TT=334.611
T1=0.58
CHECKS=17178600
NODES=13078
MSAT (TO)
f=3
TT=3600.05

MSAT (TO)
f=3
TT=3600.04

OPTIMUM
f=3
TT=7.004
T1=6.79
OPTIMUM
f=3
TT=4.516
T1=4.28
OPTIMUM
f=3
TT=0.025
T1=0
OPTIMUM
f=3
TT=0.065
T1=0.03
maxcsp/planning/
normalized-mprime03cc_ext.xml
MOPT
f=3
TT=0.025
T1=0
OPTIMUM
f=3
TT=31.093
T1=0.68
CHECKS=15374
NODES=11
OPTIMUM
f=3
TT=422.856
T1=0.78
CHECKS=20461200
NODES=19561
MSAT (TO)
f=3
TT=3600.11

MSAT (TO)
f=3
TT=3600

OPTIMUM
f=3
TT=6.525
T1=6.32
OPTIMUM
f=3
TT=3.661
T1=3.43
OPTIMUM
f=3
TT=0.025
T1=0
OPTIMUM
f=3
TT=0.065
T1=0
maxcsp/planning/
normalized-mprime03c_ext.xml
MOPT
f=3
TT=0.026
T1=0
OPTIMUM
f=3
TT=31.277
T1=0.67
CHECKS=15374
NODES=11
OPTIMUM
f=3
TT=280.707
T1=0.68
CHECKS=14025400
NODES=10640
MSAT (TO)
f=3
TT=3600.06

MSAT (TO)
f=3
TT=3600.1

OPTIMUM
f=3
TT=6.432
T1=6.23
OPTIMUM
f=3
TT=3.676
T1=3.46
OPTIMUM
f=3
TT=0.026
T1=0
OPTIMUM
f=3
TT=0.066
T1=0.02
maxcsp/planning/
normalized-mprime04ac_ext.xml
MOPT
f=3
TT=1.088
T1=0.59
MSAT (TO)
f=3
TT=1686.22
T1=2.55
MSAT (TO)
f=3
TT=1682.51
T1=2.7
MSAT (TO)
f=3
TT=3600.07

MSAT (TO)
f=3
TT=3600.08

?

TT=210.735

?

TT=221.005

OPTIMUM
f=3
TT=1.088
T1=0.59
OPTIMUM
f=3
TT=4.87
T1=4.83
maxcsp/planning/
normalized-mprime04bc_ext.xml
MOPT
f=3
TT=1.079
T1=0.58
MSAT (TO)
f=3
TT=1684
T1=2.73
MSAT (TO)
f=3
TT=1673.02
T1=2.57
MSAT (TO)
f=3
TT=3600.03

MSAT (TO)
f=3
TT=3600.06

?

TT=219.634

?

TT=212.064

OPTIMUM
f=3
TT=1.079
T1=0.58
OPTIMUM
f=3
TT=4.84
T1=4.74
maxcsp/planning/
normalized-rovers02ac_ext.xml
MOPT
f=3
TT=0.503
T1=0
OPTIMUM
f=3
TT=540.454
T1=1.16
CHECKS=26317800
NODES=2202
MSAT (TO)
f=3
TT=1584.17
T1=1.07
MSAT (TO)
f=3
TT=3600.03

MSAT (TO)
f=3
TT=3600.01

? (MO)

TT=79.31

? (MO)

TT=81.214

OPTIMUM
f=3
TT=0.503
T1=0
OPTIMUM
f=3
TT=0.99
T1=0.29
maxcsp/planning/
normalized-zenotravel02bc_ext.xml
MOPT
f=3
TT=0.17
T1=0
OPTIMUM
f=3
TT=64.406
T1=1.17
CHECKS=1689430
NODES=99
OPTIMUM
f=3
TT=795.231
T1=1.37
CHECKS=40597100
NODES=3008
MSAT (TO)
f=3
TT=3600.07

MSAT (TO)
f=3
TT=3600.1

? (MO)

TT=80.139

? (MO)

TT=81.416

OPTIMUM
f=3
TT=0.17
T1=0
OPTIMUM
f=3
TT=0.561
T1=0.32
maxcsp/planning/
normalized-zenotravel04ac_ext.xml
MOPT
f=5
TT=0.596
T1=0
MSAT (TO)
f=5
TT=1699.24
T1=8.47
MSAT (TO)
f=5
TT=1783.13
T1=7.33
MSAT (TO)
f=5
TT=3600.09

MSAT (TO)
f=5
TT=3600.04

?

TT=212.916

?

TT=227.192

OPTIMUM
f=5
TT=0.596
T1=0
OPTIMUM
f=5
TT=2.067
T1=1.05
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/warehouses/
normalized-cap102_ext.xml
MOPT
f=0
TT=0.058
T1=0
OPTIMUM
f=0
TT=17.379
T1=0.87
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=16.097
T1=0.78
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=0.843

CHECKS=196116
NODES=285
OPTIMUM
f=0
TT=0.882

CHECKS=104695
NODES=138
OPTIMUM
f=0
TT=33.486
T1=33.36
OPTIMUM
f=0
TT=10.124
T1=9.82
OPTIMUM
f=0
TT=0.058
T1=0
OPTIMUM
f=0
TT=0.556
T1=0.42
maxcsp/warehouses/
normalized-cap103_ext.xml
MOPT
f=0
TT=0.063
T1=0
OPTIMUM
f=0
TT=16.203
T1=0.75
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=17.339
T1=0.88
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=0.838

CHECKS=196116
NODES=285
OPTIMUM
f=0
TT=0.875

CHECKS=104695
NODES=138
OPTIMUM
f=0
TT=36.41
T1=36.26
OPTIMUM
f=0
TT=9.842
T1=9.53
OPTIMUM
f=0
TT=0.063
T1=0
OPTIMUM
f=0
TT=0.517
T1=0.39
maxcsp/warehouses/
normalized-cap104_ext.xml
MOPT
f=0
TT=0.059
T1=0
OPTIMUM
f=0
TT=17.511
T1=0.87
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=16.014
T1=0.79
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=0.841

CHECKS=196116
NODES=285
OPTIMUM
f=0
TT=0.869

CHECKS=104695
NODES=138
OPTIMUM
f=0
TT=34.951
T1=34.65
OPTIMUM
f=0
TT=10.14
T1=9.82
OPTIMUM
f=0
TT=0.059
T1=0
OPTIMUM
f=0
TT=0.552
T1=0.42
maxcsp/warehouses/
normalized-cap113_ext.xml
MOPT
f=0
TT=0.187
T1=0
OPTIMUM
f=0
TT=31.322
T1=1.07
CHECKS=148
NODES=0
OPTIMUM
f=0
TT=31.261
T1=0.99
CHECKS=148
NODES=0
OPTIMUM
f=0
TT=1.779

CHECKS=473072
NODES=228
OPTIMUM
f=0
TT=1.733

CHECKS=331410
NODES=132
OPTIMUM
f=0
TT=343.015
T1=342.48
OPTIMUM
f=0
TT=30.581
T1=30.09
OPTIMUM
f=0
TT=0.187
T1=0
OPTIMUM
f=0
TT=1.855
T1=1.58
maxcsp/warehouses/
normalized-cap122_ext.xml
MOPT
f=0
TT=0.201
T1=0
OPTIMUM
f=0
TT=31.336
T1=1.08
CHECKS=148
NODES=0
OPTIMUM
f=0
TT=31.256
T1=0.99
CHECKS=148
NODES=0
OPTIMUM
f=0
TT=1.77

CHECKS=473072
NODES=228
OPTIMUM
f=0
TT=1.766

CHECKS=331410
NODES=132
OPTIMUM
f=0
TT=293.386
T1=292.96
OPTIMUM
f=0
TT=31.889
T1=31.37
OPTIMUM
f=0
TT=0.201
T1=0
OPTIMUM
f=0
TT=1.853
T1=1.57
maxcsp/warehouses/
normalized-cap44_ext.xml
MOPT
f=0
TT=0.035
T1=0
OPTIMUM
f=0
TT=7.077
T1=0.78
CHECKS=46
NODES=0
OPTIMUM
f=0
TT=6.533
T1=0.71
CHECKS=46
NODES=0
OPTIMUM
f=0
TT=0.701

CHECKS=99709
NODES=216
OPTIMUM
f=0
TT=0.643

CHECKS=56264
NODES=133
OPTIMUM
f=0
TT=16.16
T1=15.91
OPTIMUM
f=0
TT=6.076
T1=5.81
OPTIMUM
f=0
TT=0.035
T1=0
OPTIMUM
f=0
TT=0.243
T1=0.17
maxcsp/warehouses/
normalized-cap62_ext.xml
MOPT
f=0
TT=0.039
T1=0
OPTIMUM
f=0
TT=7.019
T1=0.77
CHECKS=46
NODES=0
OPTIMUM
f=0
TT=6.479
T1=0.69
CHECKS=46
NODES=0
OPTIMUM
f=0
TT=0.694

CHECKS=99709
NODES=216
OPTIMUM
f=0
TT=0.681

CHECKS=56264
NODES=133
OPTIMUM
f=0
TT=14.382
T1=14.13
OPTIMUM
f=0
TT=5.975
T1=5.71
OPTIMUM
f=0
TT=0.039
T1=0
OPTIMUM
f=0
TT=0.243
T1=0.16
maxcsp/warehouses/
normalized-cap91_ext.xml
MOPT
f=0
TT=0.059
T1=0
OPTIMUM
f=0
TT=17.291
T1=0.86
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=16.092
T1=0.78
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=0.947

CHECKS=196116
NODES=285
OPTIMUM
f=0
TT=0.875

CHECKS=104695
NODES=138
OPTIMUM
f=0
TT=36.294
T1=35.9
OPTIMUM
f=0
TT=9.486
T1=9.04
OPTIMUM
f=0
TT=0.059
T1=0
OPTIMUM
f=0
TT=0.52
T1=0.39
maxcsp/warehouses/
normalized-cap92_ext.xml
MOPT
f=0
TT=0.062
T1=0
OPTIMUM
f=0
TT=17.436
T1=0.91
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=17.437
T1=0.87
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=0.897

CHECKS=196116
NODES=285
OPTIMUM
f=0
TT=0.87

CHECKS=104695
NODES=138
OPTIMUM
f=0
TT=36.094
T1=35.8
OPTIMUM
f=0
TT=9.887
T1=9.57
OPTIMUM
f=0
TT=0.062
T1=0
OPTIMUM
f=0
TT=0.559
T1=0.42
maxcsp/warehouses/
normalized-cap93_ext.xml
MOPT
f=0
TT=0.063
T1=0
OPTIMUM
f=0
TT=17.129
T1=0.87
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=16.141
T1=0.82
CHECKS=73
NODES=0
OPTIMUM
f=0
TT=1.036

CHECKS=196116
NODES=285
OPTIMUM
f=0
TT=0.87

CHECKS=104695
NODES=138
OPTIMUM
f=0
TT=35.776
T1=35.49
OPTIMUM
f=0
TT=9.872
T1=9.72
OPTIMUM
f=0
TT=0.063
T1=0
OPTIMUM
f=0
TT=0.556
T1=0.41
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/warehouses/
normalized-capmo3_ext.xml
MOPT
f=1
TT=2.147
T1=2.08
OPTIMUM
f=1
TT=65.059
T1=15.46
CHECKS=1000300
NODES=0
OPTIMUM
f=1
TT=66.327
T1=16.39
CHECKS=1000300
NODES=0
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=2
TT=3600.08

?

TT=233.419

?

TT=226.019

OPTIMUM
f=1
TT=2.147
T1=2.08
OPTIMUM
f=1
TT=15.642
T1=15.52
maxcsp/warehouses/
normalized-capmo4_ext.xml
MOPT
f=1
TT=2.252
T1=2.16
OPTIMUM
f=1
TT=65.998
T1=16.46
CHECKS=1000300
NODES=0
OPTIMUM
f=1
TT=63.624
T1=15.17
CHECKS=1000300
NODES=0
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=2
TT=3600.03

?

TT=226.156

?

TT=230.674

OPTIMUM
f=1
TT=2.252
T1=2.16
OPTIMUM
f=1
TT=14.866
T1=14.74
maxcsp/warehouses/
normalized-capmo5_ext.xml
MOPT
f=1
TT=2.26
T1=2.18
OPTIMUM
f=1
TT=64.15
T1=15.22
CHECKS=1000300
NODES=0
OPTIMUM
f=1
TT=67.309
T1=16.42
CHECKS=1000300
NODES=0
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=2
TT=3600.03

?

TT=235.292

?

TT=208.754

OPTIMUM
f=1
TT=2.26
T1=2.18
OPTIMUM
f=1
TT=14.88
T1=14.74
maxcsp/warehouses/
normalized-capmp2_ext.xml
MOPT
f=1
TT=29.194
T1=28.9
MSAT (TO)
f=1
TT=1879.75
T1=1879.69
MSAT (TO)
f=1
TT=3342.87
T1=3342.75
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=2
TT=3600.08

?

TT=881.067

?

TT=464.726

OPTIMUM
f=1
TT=29.194
T1=28.9
Wrong Opt.
f=201
TT=127.845
T1=127.67
maxcsp/warehouses/
normalized-capmp4_ext.xml
MOPT
f=1
TT=27.963
T1=27.73
MSAT (TO)
f=1
TT=3518.22
T1=3518.12
MSAT (TO)
f=1
TT=1918.16
T1=1918.02
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=2
TT=3600.06

?

TT=436.861

?

TT=445.123

OPTIMUM
f=1
TT=27.963
T1=27.73
Wrong Opt.
f=201
TT=118.121
T1=117.88

Some statistics...

AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
Number of times the solver is able to give the best known answer5866624985811500
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)16015919417387841500
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)452184111490
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)322600041150