MAX-CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in intension (2-ARY-INT)

This page displays the results of the different solvers for each benchmark for category binary constraints in intension (2-ARY-INT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance
textthe solver was ended by a signal
textthe solver gave an incomplete answer
textthe solver was disqualified in the category
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
AbsconMax 112 pc-d
AbsconMax 112 pc-w
Concrete + CSP4J - MCRW Engine 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Sugar v1.13+minisat
Sugar++ v1.13+minisat-inc

Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/fapp/fapp01/
normalized-fapp01-0200-2.xml		 MSAT TO
f=4
TT=3600.01

 MSAT (TO)
f=9
TT=1641.28
T1=24.63
 MSAT (TO)
f=9
TT=1622.43
T1=23.3
 MSAT (TO)
f=4
TT=3600.01

 MSAT (TO)
f=12
TT=3600.01

 MSAT (TO)
f=186
TT=3600.15
T1=1001.64
 MSAT (TO)
f=196
TT=3600.23
T1=1974.35
csp/fapp/fapp02/
normalized-fapp02-0250-0.xml		 MSAT TO
f=16
TT=3600.02

 MSAT (TO)
f=26
TT=1727.15
T1=66.13
 MSAT (TO)
f=26
TT=1734.37
T1=64.35
 MSAT (TO)
f=16
TT=3600.02

 MSAT (TO)
f=48
TT=3600.06

 MSAT (TO)
f=474
TT=3600.34
T1=615.96
 No Cert.

TT=181.946
csp/fapp/fapp03/
normalized-fapp03-0300-0.xml		 MSAT TO
f=23
TT=3600.02

 ?

TT=259.121

 ?

TT=278.74

 MSAT (TO)
f=23
TT=3600.02

 MSAT (TO)
f=81
TT=3600.05

 ? (MO)

TT=99.191

 ? (MO)

TT=104.847
csp/fapp/fapp03/
normalized-fapp03-0300-4.xml		 MSAT TO
f=18
TT=3600.02

 ?

TT=150.758

 ?

TT=158.058

 MSAT (TO)
f=18
TT=3600.02

 MSAT (TO)
f=37
TT=3600.04

 ? (MO)

TT=98.4

 ? (MO)

TT=106.811
csp/fapp/fapp04/
normalized-fapp04-0300-0.xml		 MSAT TO
f=16
TT=3600.04

 ?

TT=165.45

 ?

TT=167.517

 MSAT (TO)
f=16
TT=3600.04

 MSAT (TO)
f=74
TT=3600.03

 ?

TT=82.841

 ? (MO)

TT=80.246
csp/fapp/fapp05/
normalized-fapp05-0350-1.xml		 MSAT TO
f=3
TT=3600.09

 ?

TT=99.71

 ?

TT=99.956

 MSAT (TO)
f=3
TT=3600.09

 MSAT (TO)
f=43
TT=3600.01

 ? (MO)

TT=131.238

 ? (MO)

TT=132.153
csp/fapp/fapp05/
normalized-fapp05-0350-6.xml		 MSAT TO
f=2
TT=3600.08

 ?

TT=207.95

 ?

TT=206.704

 MSAT (TO)
f=2
TT=3600.08

 MSAT (TO)
f=36
TT=3600.09

 ? (MO)

TT=127.376

 ? (MO)

TT=122.074
csp/fapp/fapp06/
normalized-fapp06-0500-0.xml		 MSAT TO
f=28
TT=3600.09

 ?

TT=197.517

 ?

TT=196.916

 MSAT (TO)
f=28
TT=3600.09

 MSAT (TO)
f=127
TT=3600.05

 ? (MO)

TT=275.704

 ? (MO)

TT=210.818
csp/fapp/fapp06/
normalized-fapp06-0500-4.xml		 MSAT TO
f=17
TT=3600.08

 ?

TT=223.496

 ?

TT=209.181

 MSAT (TO)
f=17
TT=3600.08

 MSAT (TO)
f=46
TT=3600.06

 ? (MO)

TT=196.555

 ? (MO)

TT=204.595
csp/fapp/fapp07/
normalized-fapp07-0600-6.xml		 MSAT TO
f=28
TT=3600.04

 ?

TT=198.7

 ?

TT=197.288

 MSAT (TO)
f=28
TT=3600.04

 MSAT (TO)
f=57
TT=3600.02

 ?

TT=220.065

 ?

TT=236.266
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/fapp/fapp07/
normalized-fapp07-0600-7.xml		 MSAT TO
f=25
TT=3600

 ?

TT=201.794

 ?

TT=165.632

 MSAT (TO)
f=25
TT=3600

 MSAT (TO)
f=47
TT=3600.05

 ?

TT=234.254

 ?

TT=238.989
csp/fapp/fapp08/
normalized-fapp08-0700-0.xml		 MSAT TO
f=73
TT=3600.1

 ?

TT=189.193

 ?

TT=202.501

 MSAT (TO)
f=73
TT=3600.1

 MSAT (TO)
f=136
TT=3600.01

 ?

TT=224.438

 ?

TT=223.73
csp/fapp/fapp08/
normalized-fapp08-0700-4.xml		 MSAT TO
f=17
TT=3600

 ?

TT=213.467

 ?

TT=211.484

 MSAT (TO)
f=17
TT=3600

 MSAT (TO)
f=58
TT=3600.01

 ?

TT=201.564

 ?

TT=203.859
csp/fapp/fapp09/
normalized-fapp09-0800-0.xml		 MSAT TO
f=78
TT=3600.02

 ?

TT=384.055

 ?

TT=368.735

 MSAT (TO)
f=78
TT=3600.02

 MSAT (TO)
f=114
TT=3600.04

 ?

TT=257.548

 ?

TT=239.961
csp/fapp/fapp10/
normalized-fapp10-0900-0.xml		 MSAT TO
f=95
TT=3600.01

 ?

TT=399.332

 ?

TT=424.144

 MSAT (TO)
f=95
TT=3600.01

 MSAT (TO)
f=213
TT=3600.07

 ?

TT=276.72

 ?

TT=272.374
csp/fapp/fapp11/
normalized-fapp11-1000-1.xml		 MSAT TO
f=37
TT=3600.06

 ?

TT=573.146

 ?

TT=542.742

 MSAT (TO)
f=37
TT=3600.06

 MSAT (TO)
f=210
TT=3600.07

 ?

TT=312.471

 ?

TT=298.186
csp/fapp/fapp11/
normalized-fapp11-1000-6.xml		 MSAT TO
f=29
TT=3600.05

 ?

TT=485.176

 ?

TT=510.293

 MSAT (TO)
f=29
TT=3600.05

 MSAT (TO)
f=151
TT=3600.01

 ?

TT=325.403

 ?

TT=294.067
csp/fapp/fapp12/
normalized-fapp12-1500-0.xml		 MSAT TO
f=92
TT=3600.03

 ?

TT=1153.59

 ?

TT=1098.92

 MSAT (TO)
f=92
TT=3600.03

 MSAT (TO)
f=750
TT=3600.02

 ?

TT=427.552

 ?

TT=403.068
csp/fapp/fapp14/
normalized-fapp14-2500-0.xml		 MSAT TO
f=1158
TT=3600

 ?

TT=2078.47

 ?

TT=2230.85

 MSAT (TO)
f=1158
TT=3600

 MSAT (TO)
f=1267
TT=3600.05

 ?

TT=508.169

 ?

TT=514.694
csp/fapp/fapp14/
normalized-fapp14-2500-2.xml		 MSAT TO
f=427
TT=3600.02

 ?

TT=1516.6

 ?

TT=1469.26

 MSAT (TO)
f=427
TT=3600.02

 MSAT (TO)
f=652
TT=3600.08

 ?

TT=539.893

 ?

TT=579.797
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/fapp/fapp15/
normalized-fapp15-3000-0.xml		 MSAT TO
f=1050
TT=3600.08

 ?

TT=588.141

 ?

TT=617.48

 MSAT (TO)
f=1050
TT=3600.08

 MSAT (TO)
f=1550
TT=3600.05

 ?

TT=337.108

 ?

TT=341.485
csp/fapp/fapp15/
normalized-fapp15-3000-2.xml		 MSAT TO
f=365
TT=3600.03

 ?

TT=837.628

 ?

TT=655.398

 MSAT (TO)
f=365
TT=3600.03

 MSAT (TO)
f=848
TT=3600.04

 ?

TT=349.705

 ?

TT=330.15
csp/fapp/fapp16/
normalized-fapp16-0260-10.xml		 MSAT TO
f=5
TT=1799.87
T1=53.19
 MSAT (TO)
f=5
TT=1806.33
T1=53.19
 MSAT (TO)
f=5
TT=1799.87
T1=53.25
 MSAT (TO)
f=5
TT=3600.05

 MSAT (TO)
f=5
TT=3600.01

 ? (MO)

TT=83.42

 ? (MO)

TT=81.395
csp/fapp/fapp16/
normalized-fapp16-0260-8.xml		 MSAT TO
f=5
TT=1770.96
T1=38.23
 MSAT (TO)
f=5
TT=1781.69
T1=38.23
 MSAT (TO)
f=5
TT=1770.96
T1=40.04
 MSAT (TO)
f=5
TT=3600.05

 MSAT (TO)
f=5
TT=3600.09

 ? (MO)

TT=85.164

 ? (MO)

TT=85.095
csp/fapp/fapp17/
normalized-fapp17-0300-0.xml		 MSAT TO
f=12
TT=3600.04

 ?

TT=96.711

 ?

TT=95.682

 MSAT (TO)
f=12
TT=3600.1

 MSAT (TO)
f=12
TT=3600.04

 ? (MO)

TT=98.127

 ? (MO)

TT=94.698
csp/fapp/fapp17/
normalized-fapp17-0300-1.xml		 MSAT TO
f=11
TT=3600.01

 ?

TT=98.718

 ?

TT=92.56

 MSAT (TO)
f=11
TT=3600.01

 MSAT (TO)
f=11
TT=3600.08

 ? (MO)

TT=98.306

 ? (MO)

TT=98.156
csp/fapp/fapp18/
normalized-fapp18-0350-4.xml		 MSAT TO
f=7
TT=3600.08

 ? (problem)

TT=138.182

CHECKS=4597100
NODES=0
 ? (problem)

TT=137.834

CHECKS=4597100
NODES=0
 MSAT (TO)
f=7
TT=3600.08

 MSAT (TO)
f=17
TT=3600.05

 ? (MO)

TT=98.06

 ? (MO)

TT=90.933
csp/fapp/fapp18/
normalized-fapp18-0350-6.xml		 MSAT TO
f=15
TT=3600.06

 ? (problem)

TT=103.779

CHECKS=4783750
NODES=0
 ? (problem)

TT=104.492

CHECKS=4792430
NODES=0
 MSAT (TO)
f=15
TT=3600.09

 MSAT (TO)
f=15
TT=3600.06

 ? (MO)

TT=91.585

 ? (MO)

TT=97.847
csp/fapp/fapp19/
normalized-fapp19-0350-2.xml		 MSAT TO
f=14
TT=3600.06

 ?

TT=399.739

 ?

TT=429.188

 MSAT (TO)
f=14
TT=3600.06

 MSAT (TO)
f=40
TT=3600.04

 ? (MO)

TT=301.224

 ? (MO)

TT=285.65
csp/fapp/fapp19/
normalized-fapp19-0350-5.xml		 MSAT TO
f=4
TT=3600.04

 ?

TT=515.052

 ?

TT=479.804

 MSAT (TO)
f=4
TT=3600.04

 MSAT (TO)
f=66
TT=3600.08

 ? (MO)

TT=284.115

 ? (MO)

TT=303.19
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/fapp/fapp20/
normalized-fapp20-0420-2.xml		 MSAT TO
f=14
TT=3600.02

 ?

TT=177.112

 ?

TT=178.005

 MSAT (TO)
f=14
TT=3600.02

 MSAT (TO)
f=23
TT=3600.03

 ? (MO)

TT=131.261

 ? (MO)

TT=130.97
csp/fapp/fapp20/
normalized-fapp20-0420-5.xml		 MSAT TO
f=8
TT=3600.06

 ?

TT=210.547

 ?

TT=193.025

 MSAT (TO)
f=8
TT=3600.06

 MSAT (TO)
f=15
TT=3600.07

 ? (MO)

TT=129.36

 ? (MO)

TT=131.054
csp/fapp/fapp22/
normalized-fapp22-1750-0.xml		 MSAT TO
f=172
TT=3600.06

 ?

TT=1825.25

 ?

TT=1818.59

 MSAT (TO)
f=330
TT=3600.01

 MSAT (TO)
f=172
TT=3600.06

 ?

TT=706.325

 ?

TT=713.638
csp/fapp/fapp22/
normalized-fapp22-1750-6.xml		 MSAT TO
f=309
TT=3600.03

 ?

TT=1995.8

 ?

TT=1986.04

 MSAT (TO)
f=309
TT=3600.03

 ? (TO)

TT=3600.01

 ?

TT=777.599

 ?

TT=848.893
csp/fapp/fapp23/
normalized-fapp23-1800-4.xml



?

TT=1720.88

 ?

TT=1789.78

 ? (TO)

TT=892.56

 ? (TO)

TT=938.59

 ?

TT=479.713

 ?

TT=509.303
csp/fapp/fapp24/
normalized-fapp24-2000-1.xml		 MSAT TO
f=23
TT=3600.02

 ?

TT=2132.59

 ?

TT=2174.8

 MSAT (TO)
f=23
TT=3600.02

 MSAT (TO)
f=257
TT=3600.05

 ?

TT=440.678

 ?

TT=455.087
csp/fapp/fapp25/
normalized-fapp25-2230-2.xml		 MSAT TO
f=621
TT=3600.04

 ?

TT=1159.69

 ?

TT=1068.63

 MSAT (TO)
f=621
TT=3600.04

 MSAT (TO)
f=862
TT=3600.08

 ?

TT=443.79

 ?

TT=425.457
csp/fapp/fapp26/
normalized-fapp26-2300-4.xml		 MSAT TO
f=61
TT=3600.01

 ?

TT=958.124

 ?

TT=913.63

 MSAT (TO)
f=61
TT=3600.01

 MSAT (TO)
f=700
TT=3600

 ?

TT=476.669

 ?

TT=459.035
csp/fapp/fapp27/
normalized-fapp27-2550-3.xml		 MSAT TO
f=262
TT=3600

 ?

TT=768.635

 ?

TT=787.213

 MSAT (TO)
f=262
TT=3600

 MSAT (TO)
f=363
TT=3600.07

 ?

TT=382.718

 ?

TT=389.025
csp/fapp/fapp29/
normalized-fapp29-2900-3.xml



No Cert.

TT=3600.12

 No Cert.

TT=3600.16

 ? (TO)

TT=963.04

 ? (TO)

TT=945.94

 ?

TT=980.256

 ?

TT=846.067
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/fapp/fapp30/
normalized-fapp30-3000-1.xml



No Cert.

TT=3600.14

 No Cert.

TT=3600.14

 ? (TO)

TT=1096.55

 ? (TO)

TT=1093.14

 ?

TT=869.3

 ?

TT=806.452
csp/fapp/fapp32/
normalized-fapp32-0550-1.xml		 MSAT TO
f=52
TT=3600.07

 ?

TT=588.596

 ?

TT=560.922

 MSAT (TO)
f=52
TT=3600.07

 MSAT (TO)
f=127
TT=3600.1

 ?

TT=607.339

 ?

TT=635.112
csp/fapp/fapp33/
normalized-fapp33-0650-3.xml		 MSAT TO
f=39
TT=3600.06

 ?

TT=475.987

 ?

TT=457.915

 MSAT (TO)
f=39
TT=3600.06

 MSAT (TO)
f=87
TT=3600.09

 ?

TT=310.04

 ?

TT=320.098
csp/fapp/fapp34/
normalized-fapp34-0750-0.xml		 MSAT TO
f=36
TT=3600.03

 ?

TT=503.924

 ?

TT=499.027

 MSAT (TO)
f=36
TT=3600.03

 MSAT (TO)
f=77
TT=3600.06

 ?

TT=336.024

 ?

TT=357.176
csp/fapp/fapp35/
normalized-fapp35-1500-3.xml		 MSAT TO
f=439
TT=3600.01

 ?

TT=2028.6

 ?

TT=2100.06

 MSAT (TO)
f=441
TT=3600.01

 MSAT (TO)
f=439
TT=3600.01

 ?

TT=721.902

 ?

TT=726.581
csp/fapp/fapp36/
normalized-fapp36-2000-3.xml		 MSAT TO
f=232
TT=3600.01

 ?

TT=729.694

 ?

TT=721.017

 MSAT (TO)
f=232
TT=3600.01

 MSAT (TO)
f=458
TT=3600.01

 ?

TT=552.1

 ?

TT=571.128
csp/fapp/fapp37/
normalized-fapp37-2250-2.xml



?

TT=1763.39

 ?

TT=1704.03

 ? (TO)

TT=633.91

 ? (TO)

TT=641.7

 ?

TT=1358.69

 ?

TT=1062.11
csp/fapp/fapp40/
normalized-fapp40-3000-2.xml



?

TT=2670.89

 ?

TT=2618.3

 ? (TO)

TT=865.67

 ? (TO)

TT=822.63

 ?

TT=642.451

 ?

TT=632.329
csp/graphColoring/
hos/
normalized-abb313GPIA-5.xml		 MSAT TO
f=2828
TT=3600.01

 MSAT (TO)
f=3931
TT=2007.57
T1=122.08
 MSAT (TO)
f=3931
TT=1774.91
T1=117
 MSAT (TO)
f=3029
TT=3600.04

 MSAT (TO)
f=2828
TT=3600.01

 ?

TT=185.855

 ?

TT=186.228
csp/graphColoring/
hos/
normalized-ash331GPIA-3.xml		 MSAT TO
f=177
TT=3600.09

 MSAT (TO)
f=222
TT=1798.84
T1=25.03
 MSAT (TO)
f=222
TT=1683.08
T1=24.63
 MSAT (TO)
f=177
TT=3600.09

 MSAT (TO)
f=214
TT=3600.02

 MSAT (MO)
f=816
TT=2675.65
T1=128.21
 ? (MO)

TT=61.214
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/
hos/
normalized-ash608GPIA-3.xml		 MSAT TO
f=322
TT=3600.03

 MSAT (TO)
f=426
TT=1811.22
T1=32.42
 MSAT (TO)
f=426
TT=1692.7
T1=30.55
 MSAT (TO)
f=322
TT=3600.03

 MSAT (TO)
f=380
TT=3600.01

 ? (MO)

TT=166.436

 ? (MO)

TT=168.748
csp/graphColoring/
hos/
normalized-ash958GPIA-3.xml		 MSAT TO
f=566
TT=3600.1

 MSAT (TO)
f=722
TT=1945.13
T1=41.48
 MSAT (TO)
f=722
TT=1707.75
T1=46.09
 MSAT (TO)
f=566
TT=3600.1

 MSAT (TO)
f=629
TT=3600.03

 ?

TT=219.453

 ?

TT=229.134
csp/graphColoring/
hos/
normalized-will199GPIA-6.xml		 MSAT TO
f=1
TT=3600.1

 MSAT (TO)
f=2
TT=1706.31
T1=20.36
 MSAT (TO)
f=2
TT=1701.65
T1=20.08
 MSAT (TO)
f=1
TT=3600.1

 MSAT (TO)
f=2
TT=3600.04

 ? (MO)

TT=135.461

 ? (MO)

TT=134.889
csp/graphColoring/insertion/
full-insertion/
normalized-1-fullins-3-3.xml		 MOPT
f=2
TT=1.52
T1=0.58
 OPTIMUM
f=2
TT=35.91
T1=0.58
CHECKS=287304
NODES=2681
 OPTIMUM
f=2
TT=38.939
T1=0.64
CHECKS=412448
NODES=2543
 MSAT (TO)
f=2
TT=3600.01

 MSAT (TO)
f=2
TT=3600.05

 OPTIMUM
f=2
TT=1.614
T1=1.47
 OPTIMUM
f=2
TT=1.52
T1=1.36
csp/graphColoring/insertion/
full-insertion/
normalized-1-fullins-5-5.xml		 MSAT TO
f=2
TT=1650.1
T1=1.34
 MSAT (TO)
f=2
TT=1670.8
T1=1.34
 MSAT (TO)
f=2
TT=1650.1
T1=1.36
 MSAT (TO)
f=2
TT=3600.06

 MSAT (TO)
f=2
TT=3600.01

 MSAT (TO)
f=2
TT=3600.13
T1=336.18
 MSAT (TO)
f=2
TT=3600.34
T1=43.22
csp/graphColoring/insertion/
full-insertion/
normalized-2-fullins-3-4.xml		 MOPT
f=1
TT=2.239
T1=0.62
 OPTIMUM
f=1
TT=493.17
T1=0.62
CHECKS=24447100
NODES=137974
 OPTIMUM
f=1
TT=157.779
T1=0.68
CHECKS=7763310
NODES=49935
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.03

 OPTIMUM
f=1
TT=2.477
T1=2.26
 OPTIMUM
f=1
TT=2.239
T1=2.02
csp/graphColoring/insertion/
full-insertion/
normalized-4-fullins-4-7.xml		 MSAT TO
f=1
TT=1657.69
T1=3.14
 MSAT (TO)
f=1
TT=1906.32
T1=3.53
 MSAT (TO)
f=1
TT=1657.69
T1=3.14
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.05

 ? (MO)

TT=115.371

 ? (MO)

TT=111.735
csp/graphColoring/insertion/
full-insertion/
normalized-5-fullins-3-6.xml		 MOPT
f=3
TT=9.822
T1=0.88
 MSAT (TO)
f=3
TT=1664.9
T1=0.97
 MSAT (TO)
f=3
TT=1632.94
T1=0.88
 MSAT (TO)
f=3
TT=3600.04

 MSAT (TO)
f=3
TT=3600.05

 OPTIMUM
f=3
TT=17.368
T1=13.22
 OPTIMUM
f=3
TT=9.822
T1=5.45
csp/graphColoring/insertion/
k-insertion/
normalized-1-insertions-4-3.xml		 MOPT
f=6
TT=935.497
T1=0.64
 MSAT (TO)
f=6
TT=1643.66
T1=0.64
 MSAT (TO)
f=6
TT=1634.26
T1=0.71
 MSAT (TO)
f=6
TT=3600.04

 MSAT (TO)
f=6
TT=3600.07

 OPTIMUM
f=6
TT=935.497
T1=935.28
 OPTIMUM
f=6
TT=1033.14
T1=1032.9
csp/graphColoring/insertion/
k-insertion/
normalized-2-insertions-3-3.xml		 MOPT
f=1
TT=1.435
T1=0.48
 OPTIMUM
f=1
TT=37.27
T1=0.58
CHECKS=466336
NODES=15688
 OPTIMUM
f=1
TT=45.945
T1=0.48
CHECKS=932054
NODES=14793
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.03

 OPTIMUM
f=1
TT=1.435
T1=1.23
 OPTIMUM
f=1
TT=1.445
T1=1.22
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/insertion/
k-insertion/
normalized-3-insertions-4-3.xml		 MSAT TO
f=10
TT=1640.33
T1=5.19
 MSAT (TO)
f=10
TT=1654.76
T1=5.62
 MSAT (TO)
f=10
TT=1640.33
T1=5.19
 MSAT (TO)
f=10
TT=3600.1

 MSAT (TO)
f=10
TT=3600.02

 MSAT (TO)
f=13
TT=3600.06
T1=567.55
 MSAT (TO)
f=17
TT=3600.08
T1=318.32
csp/graphColoring/insertion/
k-insertion/
normalized-3-insertions-5-3.xml		 MSAT TO
f=100
TT=3600.06

 MSAT (TO)
f=112
TT=1734.34
T1=13.12
 MSAT (TO)
f=112
TT=1711.98
T1=14.03
 MSAT (TO)
f=100
TT=3600.06

 MSAT (TO)
f=111
TT=3600.05

 ?

TT=199.057

 ?

TT=293.808
csp/graphColoring/insertion/
k-insertion/
normalized-4-insertions-4-3.xml		 MSAT TO
f=12
TT=1658.93
T1=6.54
 MSAT (TO)
f=12
TT=1690.9
T1=6.54
 MSAT (TO)
f=12
TT=1658.93
T1=7.02
 MSAT (TO)
f=12
TT=3600.04

 MSAT (TO)
f=12
TT=3600.02

 MSAT (TO)
f=30
TT=3600.07
T1=108.73
 MSAT (TO)
f=28
TT=3600.22
T1=107.19
csp/graphColoring/leighton/
leighton-15/
normalized-lei450-15b-08.xml		 MSAT TO
f=340
TT=3600.1

 MSAT (TO)
f=414
TT=1675.89
T1=41.29
 MSAT (TO)
f=414
TT=1682.94
T1=41.01
 MSAT (TO)
f=377
TT=3600.04

 MSAT (TO)
f=340
TT=3600.1

 ? (MO)

TT=176.686

 ? (MO)

TT=176.269
csp/graphColoring/leighton/
leighton-15/
normalized-lei450-15b-10.xml		 MSAT TO
f=185
TT=3600.09

 MSAT (TO)
f=241
TT=1720.72
T1=100.24
 MSAT (TO)
f=241
TT=1722.17
T1=102.5
 MSAT (TO)
f=207
TT=3600.05

 MSAT (TO)
f=185
TT=3600.09

 ? (MO)

TT=169.486

 ? (MO)

TT=178.224
csp/graphColoring/leighton/
leighton-15/
normalized-lei450-15c-13.xml		 MSAT TO
f=183
TT=3600.1

 MSAT (TO)
f=395
TT=1710.68
T1=92.54
 MSAT (TO)
f=395
TT=1715.63
T1=92.37
 MSAT (TO)
f=183
TT=3600.1

 MSAT (TO)
f=285
TT=3600.01

 ?

TT=241.212

 ?

TT=253.45
csp/graphColoring/leighton/
leighton-15/
normalized-lei450-15d-05.xml		 MSAT TO
f=2043
TT=3600.06

 MSAT (TO)
f=2264
TT=1702.02
T1=67.83
 MSAT (TO)
f=2264
TT=1718.63
T1=77.4
 MSAT (TO)
f=2043
TT=3600.06

 MSAT (TO)
f=2093
TT=3600.04

 ?

TT=218.313

 ?

TT=572.508
csp/graphColoring/leighton/
leighton-15/
normalized-lei450-15d-08.xml		 MSAT TO
f=892
TT=3600.05

 MSAT (TO)
f=1114
TT=1707
T1=73.94
 MSAT (TO)
f=1114
TT=1725.8
T1=73.87
 MSAT (TO)
f=892
TT=3600.05

 MSAT (TO)
f=927
TT=3600.08

 ?

TT=215.201

 ?

TT=221.21
csp/graphColoring/leighton/
leighton-25/
normalized-lei450-25a-15.xml		 MSAT TO
f=104
TT=3600.07

 MSAT (TO)
f=145
TT=1679.68
T1=88.69
 MSAT (TO)
f=145
TT=1695.88
T1=88.55
 MSAT (TO)
f=119
TT=3600.07

 MSAT (TO)
f=104
TT=3600.07

 ? (MO)

TT=192.686

 ? (MO)

TT=193.387
csp/graphColoring/leighton/
leighton-25/
normalized-lei450-25a-23.xml		 MSAT TO
f=13
TT=3600.05

 MSAT (TO)
f=23
TT=1651.98
T1=10.24
 MSAT (TO)
f=23
TT=1636.98
T1=10.81
 MSAT (TO)
f=13
TT=3600.05

 MSAT (TO)
f=13
TT=3600.06

 ? (MO)

TT=198.132

 ? (MO)

TT=188.238
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/leighton/
leighton-25/
normalized-lei450-25b-15.xml		 MSAT TO
f=109
TT=3600.01

 MSAT (TO)
f=148
TT=1702.58
T1=65.3
 MSAT (TO)
f=148
TT=1713.69
T1=69.77
 MSAT (TO)
f=126
TT=3600

 MSAT (TO)
f=109
TT=3600.01

 ? (MO)

TT=179.584

 ? (MO)

TT=174.709
csp/graphColoring/leighton/
leighton-25/
normalized-lei450-25b-24.xml		 MSAT TO
f=6
TT=3600.01

 MSAT (TO)
f=9
TT=1644.26
T1=12.58
 MSAT (TO)
f=9
TT=1640.59
T1=12.41
 MSAT (TO)
f=6
TT=3600.01

 MSAT (TO)
f=6
TT=3600.06

 ? (MO)

TT=180.605

 ? (MO)

TT=188.198
csp/graphColoring/leighton/
leighton-25/
normalized-lei450-25c-05.xml		 MSAT TO
f=2408
TT=3600.02

 MSAT (TO)
f=2569
TT=1761.46
T1=144.39
 MSAT (TO)
f=2569
TT=1757.59
T1=132.85
 MSAT (TO)
f=2412
TT=3600.04

 MSAT (TO)
f=2408
TT=3600.02

 ?

TT=167.749

 ?

TT=174.454
csp/graphColoring/leighton/
leighton-5/
normalized-lei450-05a-04.xml		 MSAT TO
f=393
TT=3600.08

 MSAT (TO)
f=444
TT=1690.83
T1=26.14
 MSAT (TO)
f=444
TT=1681.31
T1=24.85
 MSAT (TO)
f=393
TT=3600.08

 MSAT (TO)
f=401
TT=3600.08

 ? (MO)

TT=94.43

 ? (MO)

TT=96.393
csp/graphColoring/
mug/
normalized-mug100-1-3.xml		 MOPT
f=1
TT=2.174
T1=0.64
 MSAT (TO)
f=1
TT=1749.94
T1=0.7
 MSAT (TO)
f=1
TT=1707.26
T1=0.64
 MSAT (TO)
f=1
TT=3600

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=2.174
T1=1.96
 OPTIMUM
f=1
TT=2.452
T1=2
csp/graphColoring/
mug/
normalized-mug100-25-3.xml		 MOPT
f=1
TT=2.045
T1=0.64
 MSAT (TO)
f=1
TT=1713.9
T1=0.67
 MSAT (TO)
f=1
TT=1766.35
T1=0.64
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.01

 OPTIMUM
f=1
TT=2.21
T1=2
 OPTIMUM
f=1
TT=2.045
T1=1.85
csp/graphColoring/
mug/
normalized-mug88-1-3.xml		 MOPT
f=1
TT=1.879
T1=0.59
 MSAT (TO)
f=1
TT=1720.47
T1=0.59
 MSAT (TO)
f=1
TT=1727.56
T1=0.68
 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=2.007
T1=1.88
 OPTIMUM
f=1
TT=1.879
T1=1.69
csp/graphColoring/
mug/
normalized-mug88-25-3.xml		 MOPT
f=1
TT=1.857
T1=0.67
 MSAT (TO)
f=1
TT=1724.15
T1=0.68
 MSAT (TO)
f=1
TT=1721.03
T1=0.67
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.07

 OPTIMUM
f=1
TT=2.026
T1=1.84
 OPTIMUM
f=1
TT=1.857
T1=1.67
csp/graphColoring/
myciel/
normalized-myciel4-4.xml		 MOPT
f=1
TT=1.439
T1=0.55
 OPTIMUM
f=1
TT=35.341
T1=0.55
CHECKS=312660
NODES=6244
 OPTIMUM
f=1
TT=41.836
T1=0.57
CHECKS=586229
NODES=5261
 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=1.439
T1=1.23
 OPTIMUM
f=1
TT=4.047
T1=3.82
csp/graphColoring/
myciel/
normalized-myciel5-4.xml		 MOPT
f=4
TT=736.879
T1=0.6
 MSAT (TO)
f=4
TT=1632.26
T1=0.79
 MSAT (TO)
f=4
TT=1624.61
T1=0.6
 MSAT (TO)
f=4
TT=3600.01

 MSAT (TO)
f=4
TT=3600.03

 OPTIMUM
f=4
TT=736.879
T1=736.75
 OPTIMUM
f=4
TT=903.786
T1=903.71
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/
myciel/
normalized-myciel5-5.xml		 MOPT
f=1
TT=93.888
T1=0.58
 MSAT (TO)
f=1
TT=1648.38
T1=0.63
 MSAT (TO)
f=1
TT=1652.28
T1=0.58
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.02

 OPTIMUM
f=1
TT=93.888
T1=2.71
 OPTIMUM
f=1
TT=435.02
T1=2.13
csp/graphColoring/
myciel/
normalized-myciel7-4.xml		 MSAT TO
f=56
TT=1662.61
T1=25.06
 MSAT (TO)
f=56
TT=1667.8
T1=25.06
 MSAT (TO)
f=56
TT=1662.61
T1=25.77
 MSAT (TO)
f=56
TT=3600.08

 MSAT (TO)
f=56
TT=3600.03

 MSAT (TO)
f=200
TT=3600.08
T1=70.71
 MSAT (TO)
f=224
TT=3600.24
T1=24.17
csp/graphColoring/
myciel/
normalized-myciel7-5.xml		 MSAT TO
f=16
TT=1645.12
T1=16.91
 MSAT (TO)
f=16
TT=1645.12
T1=17.9
 MSAT (TO)
f=16
TT=1667.44
T1=16.91
 MSAT (TO)
f=16
TT=3600.07

 MSAT (TO)
f=16
TT=3600.1

 MSAT (TO)
f=42
TT=3600.05
T1=468.71
 MSAT (TO)
f=50
TT=3600.15
T1=990.95
csp/graphColoring/
register/fpsol/
normalized-fpsol2-i-1-55.xml		 MSAT TO
f=10
TT=1686.28
T1=61.45
 MSAT (TO)
f=10
TT=1686.28
T1=65.53
 MSAT (TO)
f=10
TT=1704.13
T1=61.45
 MSAT (TO)
f=10
TT=3600.09

 MSAT (TO)
f=15
TT=3600

 ?

TT=219.793

 ?

TT=212.651
csp/graphColoring/
register/fpsol/
normalized-fpsol2-i-2-10.xml		 MSAT TO
f=103
TT=3600

 MSAT (TO)
f=115
TT=1665.58
T1=11.96
 MSAT (TO)
f=115
TT=1658.75
T1=11.19
 MSAT (TO)
f=103
TT=3600

 MSAT (TO)
f=116
TT=3600.06

 ?

TT=183.93

 ?

TT=198.09
csp/graphColoring/
register/fpsol/
normalized-fpsol2-i-2-15.xml		 MSAT TO
f=44
TT=3600.06

 MSAT (TO)
f=47
TT=1634.45
T1=16.29
 MSAT (TO)
f=47
TT=1667.35
T1=17.35
 MSAT (TO)
f=44
TT=3600.06

 MSAT (TO)
f=64
TT=3600.01

 ?

TT=203.605

 ?

TT=188.678
csp/graphColoring/
register/fpsol/
normalized-fpsol2-i-2-27.xml		 MSAT TO
f=5
TT=1674.19
T1=89.04
 MSAT (TO)
f=5
TT=1684.8
T1=89.04
 MSAT (TO)
f=5
TT=1674.19
T1=91.12
 MSAT (TO)
f=5
TT=3600.01

 MSAT (TO)
f=24
TT=3600.04

 ?

TT=186.181

 ?

TT=199.154
csp/graphColoring/
register/fpsol/
normalized-fpsol2-i-3-27.xml		 MSAT TO
f=5
TT=1672.91
T1=56.65
 MSAT (TO)
f=5
TT=1699.49
T1=56.65
 MSAT (TO)
f=5
TT=1672.91
T1=56.7
 MSAT (TO)
f=5
TT=3600.02

 MSAT (TO)
f=26
TT=3600.03

 ?

TT=174.55

 ?

TT=190.319
csp/graphColoring/
register/inithx/
normalized-inithx-i-1-10.xml		 MSAT TO
f=307
TT=3600

 MSAT (TO)
f=406
TT=1709.61
T1=27.72
 MSAT (TO)
f=406
TT=1678.72
T1=27.79
 MSAT (TO)
f=307
TT=3600

 MSAT (TO)
f=341
TT=3600

 ?

TT=177.515

 ?

TT=174.692
csp/graphColoring/
register/inithx/
normalized-inithx-i-1-45.xml		 MSAT TO
f=9
TT=1781.18
T1=1781.12
 MSAT (TO)
f=14
TT=1738.01
T1=120.06
 MSAT (TO)
f=9
TT=1781.18
T1=1781.12
 MSAT (TO)
f=9
TT=3600.05

 MSAT (TO)
f=30
TT=3600.07

 ?

TT=167.823

 ?

TT=157.422
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/
register/inithx/
normalized-inithx-i-2-15.xml		 MSAT TO
f=47
TT=3600.02

 MSAT (TO)
f=50
TT=1712.78
T1=54.85
 MSAT (TO)
f=50
TT=1714.1
T1=51.45
 MSAT (TO)
f=47
TT=3600.02

 MSAT (TO)
f=128
TT=3600

 ?

TT=196.107

 ?

TT=194.252
csp/graphColoring/
register/inithx/
normalized-inithx-i-2-20.xml		 MSAT TO
f=20
TT=3600

 MSAT (TO)
f=37
TT=1684.28
T1=70.77
 MSAT (TO)
f=21
TT=1781.89
T1=1781.84
 MSAT (TO)
f=20
TT=3600

 MSAT (TO)
f=91
TT=3600.07

 ?

TT=196.206

 ?

TT=183.92
csp/graphColoring/
register/inithx/
normalized-inithx-i-3-28.xml		 MSAT TO
f=5
TT=1705.38
T1=1705.33
 MSAT (TO)
f=19
TT=1707.15
T1=80.47
 MSAT (TO)
f=5
TT=1705.38
T1=1705.33
 MSAT (TO)
f=6
TT=3600.01

 MSAT (TO)
f=54
TT=3600.08

 ?

TT=197.508

 ?

TT=194.102
csp/graphColoring/
register/mulsol/
normalized-mulsol-i-1-05.xml		 MSAT TO
f=389
TT=3600.02

 MSAT (TO)
f=420
TT=1622.41
T1=2.02
 MSAT (TO)
f=420
TT=1639.86
T1=2.19
 MSAT (TO)
f=389
TT=3600.02

 MSAT (TO)
f=389
TT=3600.06

 MSAT (TO)
f=661
TT=3600.3
T1=116.73
 No Cert.

TT=68.267
csp/graphColoring/
register/mulsol/
normalized-mulsol-i-1-25.xml		 MSAT TO
f=33
TT=3600.08

 MSAT (TO)
f=34
TT=1648.81
T1=34.38
 MSAT (TO)
f=34
TT=1690.57
T1=34.4
 MSAT (TO)
f=33
TT=3600.08

 MSAT (TO)
f=34
TT=3600.02

 MSAT (TO)
f=58
TT=3600.36
T1=220.06
 MSAT (MO)
f=244
TT=50.334
T1=49.61
csp/graphColoring/
register/mulsol/
normalized-mulsol-i-2-05.xml		 MSAT TO
f=223
TT=3600

 MSAT (TO)
f=254
TT=1666.07
T1=21.18
 MSAT (TO)
f=254
TT=1653.93
T1=19.86
 MSAT (TO)
f=223
TT=3600

 MSAT (TO)
f=223
TT=3600.08

 MSAT (TO)
f=697
TT=3600.32
T1=111.29
 MSAT (TO)
f=517
TT=3600.41
T1=79.79
csp/graphColoring/
register/mulsol/
normalized-mulsol-i-2-20.xml		 MSAT TO
f=22
TT=3568.04
T1=3567.91
 MSAT (TO)
f=23
TT=1643.28
T1=5.45
 MSAT (TO)
f=22
TT=3568.04
T1=3567.91
 MSAT (TO)
f=22
TT=3600.05

 MSAT (TO)
f=23
TT=3600.05

 MSAT (TO)
f=37
TT=3600.28
T1=348.6
 MSAT (MO)
f=307
TT=53.979
T1=50.98
csp/graphColoring/
register/mulsol/
normalized-mulsol-i-5-10.xml		 MSAT TO
f=77
TT=3600.05

 MSAT (TO)
f=84
TT=1640.48
T1=5.67
 MSAT (TO)
f=84
TT=1650.91
T1=6.05
 MSAT (TO)
f=77
TT=3600.05

 MSAT (TO)
f=77
TT=3600.07

 MSAT (TO)
f=167
TT=3600.28
T1=776.3
 MSAT (MO)
f=616
TT=52.689
T1=50.35
csp/graphColoring/
register/zeroin/
normalized-zeroin-i-1-45.xml		 MSAT TO
f=4
TT=1636.76
T1=7.63
 MSAT (TO)
f=4
TT=1643.49
T1=7.63
 MSAT (TO)
f=4
TT=1636.76
T1=7.66
 MSAT (TO)
f=4
TT=3600.08

 MSAT (TO)
f=7
TT=3600.08

 MSAT (TO)
f=7
TT=3600.26
T1=3003.81
 No Cert.

TT=57.727
csp/graphColoring/
register/zeroin/
normalized-zeroin-i-2-28.xml		 MSAT TO
f=2
TT=1646.92
T1=2.85
 MSAT (TO)
f=2
TT=1646.98
T1=2.85
 MSAT (TO)
f=2
TT=1646.92
T1=3.14
 MSAT (TO)
f=2
TT=3600.08

 MSAT (TO)
f=8
TT=3600.09

 MSAT (TO)
f=4
TT=3600.24
T1=581.8
 MSAT (TO)
f=3
TT=3600.31
T1=49.31
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/
school/
normalized-school1-13.xml		 MSAT TO
f=126
TT=3600.01

 MSAT (TO)
f=159
TT=1688.65
T1=25.59
 MSAT (TO)
f=159
TT=1678.1
T1=26.57
 MSAT (TO)
f=126
TT=3600.01

 MSAT (TO)
f=126
TT=3600.05

 ?

TT=170.977

 ?

TT=176.968
csp/graphColoring/
school/
normalized-school1-nsh-12.xml		 MSAT TO
f=177
TT=3600.08

 MSAT (TO)
f=243
TT=1673.68
T1=26.99
 MSAT (TO)
f=243
TT=1674.98
T1=28.51
 MSAT (TO)
f=177
TT=3600.08

 MSAT (TO)
f=177
TT=3600.09

 ?

TT=208.663

 ?

TT=201.168
csp/graphColoring/
school/
normalized-school1-nsh-13.xml		 MSAT TO
f=80
TT=3600.01

 MSAT (TO)
f=101
TT=1675.14
T1=37.3
 MSAT (TO)
f=101
TT=1702.25
T1=35.17
 MSAT (TO)
f=80
TT=3600.03

 MSAT (TO)
f=80
TT=3600.01

 ?

TT=204.962

 ?

TT=202.635
csp/graphColoring/
sgb/book/
normalized-anna-9.xml		 MOPT
f=2
TT=22.813
T1=0.81
 MSAT (TO)
f=2
TT=1628.02
T1=0.81
 MSAT (TO)
f=2
TT=1637.66
T1=0.87
 MSAT (TO)
f=2
TT=3600.06

 MSAT (TO)
f=2
TT=3600.02

 OPTIMUM
f=2
TT=24.803
T1=4.5
 OPTIMUM
f=2
TT=22.813
T1=3.62
csp/graphColoring/
sgb/book/
normalized-david-5.xml		 MSAT TO
f=20
TT=3600

 MSAT (TO)
f=21
TT=1613.85
T1=1.28
 MSAT (TO)
f=21
TT=1627.11
T1=1.36
 MSAT (TO)
f=20
TT=3600

 MSAT (TO)
f=20
TT=3600

 MSAT (TO)
f=35
TT=3600.04
T1=2.1
 MSAT (TO)
f=25
TT=3600.1
T1=199.04
csp/graphColoring/
sgb/book/
normalized-homer-12.xml		 MOPT
f=1
TT=163.587
T1=1.17
 MSAT (TO)
f=1
TT=1614.23
T1=1.17
 MSAT (TO)
f=1
TT=1735.3
T1=1.27
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.09

 OPTIMUM
f=1
TT=170.487
T1=62.09
 OPTIMUM
f=1
TT=163.587
T1=12.89
csp/graphColoring/
sgb/book/
normalized-huck-10.xml		 MOPT
f=1
TT=5.681
T1=0.67
 MSAT (TO)
f=1
TT=1631.26
T1=0.77
 MSAT (TO)
f=1
TT=1627.01
T1=0.67
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.08

 OPTIMUM
f=1
TT=5.681
T1=3.11
 OPTIMUM
f=1
TT=5.716
T1=2.63
csp/graphColoring/
sgb/book/
normalized-jean-5.xml		 MSAT TO
f=14
TT=1621.42
T1=2.54
 MSAT (TO)
f=14
TT=1645.87
T1=2.54
 MSAT (TO)
f=14
TT=1621.42
T1=2.55
 MSAT (TO)
f=14
TT=3600.1

 MSAT (TO)
f=14
TT=3600

 MSAT (TO)
f=16
TT=3600.07
T1=2.24
 MSAT (TO)
f=19
TT=3600.1
T1=1.7
csp/graphColoring/sgb/games/
normalized-games120-8.xml		 MOPT
f=2
TT=5.095
T1=0.84
 MSAT (TO)
f=2
TT=1631.37
T1=0.84
 MSAT (TO)
f=2
TT=1655.18
T1=0.88
 MSAT (TO)
f=2
TT=3600.03

 MSAT (TO)
f=2
TT=3600.03

 OPTIMUM
f=2
TT=9.558
T1=8.31
 OPTIMUM
f=2
TT=5.095
T1=4.72
csp/graphColoring/
sgb/miles/
normalized-miles1500-30.xml		 MSAT TO
f=58
TT=3600.01

 MSAT (TO)
f=68
TT=1624.14
T1=1.83
 MSAT (TO)
f=68
TT=1644.95
T1=2.07
 MSAT (TO)
f=61
TT=3600.01

 MSAT (TO)
f=58
TT=3600.01

 ? (MO)

TT=77.25

 ? (MO)

TT=81.259
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/graphColoring/
sgb/miles/
normalized-miles500-10.xml		 MSAT TO
f=18
TT=3600.08

 MSAT (TO)
f=21
TT=1618.47
T1=3.18
 MSAT (TO)
f=21
TT=1632.42
T1=2.94
 MSAT (TO)
f=19
TT=3600.03

 MSAT (TO)
f=18
TT=3600.08

 MSAT (TO)
f=34
TT=3600.05
T1=22.81
 MSAT (TO)
f=31
TT=3600.1
T1=220.87
csp/graphColoring/
sgb/miles/
normalized-miles500-15.xml		 MSAT TO
f=5
TT=1608.2
T1=1.36
 MSAT (TO)
f=5
TT=1608.2
T1=1.47
 MSAT (TO)
f=5
TT=1618.87
T1=1.36
 MSAT (TO)
f=5
TT=3600.03

 MSAT (TO)
f=5
TT=3600.06

 MSAT (TO)
f=6
TT=3600.03
T1=275.02
 MSAT (TO)
f=5
TT=3600.15
T1=1782.87
csp/graphColoring/
sgb/miles/
normalized-miles750-15.xml		 MSAT TO
f=28
TT=3600.02

 MSAT (TO)
f=33
TT=1645.07
T1=32.38
 MSAT (TO)
f=33
TT=1659.5
T1=32.26
 MSAT (TO)
f=29
TT=3600.01

 MSAT (TO)
f=28
TT=3600.02

 MSAT (TO)
f=62
TT=3600.09
T1=39.59
 MSAT (TO)
f=60
TT=3600.13
T1=20.34
csp/graphColoring/
sgb/miles/
normalized-miles750-29.xml		 MSAT TO
f=2
TT=1616.38
T1=1.35
 MSAT (TO)
f=2
TT=1624.85
T1=1.35
 MSAT (TO)
f=2
TT=1616.38
T1=1.47
 MSAT (TO)
f=2
TT=3600.02

 MSAT (TO)
f=2
TT=3600.04

 MSAT (TO)
f=2
TT=3600.04
T1=92.91
 MSAT (TO)
f=2
TT=3600.2
T1=22.39
csp/graphColoring/
sgb/queen/
normalized-queen12-12-11.xml		 MSAT TO
f=31
TT=3600.09

 MSAT (TO)
f=34
TT=1630.33
T1=13.91
 MSAT (TO)
f=34
TT=1627.5
T1=14.17
 MSAT (TO)
f=32
TT=3600.09

 MSAT (TO)
f=31
TT=3600.09

 MSAT (MO)
f=120
TT=3442.62
T1=59.33
 MSAT (MO)
f=97
TT=2944.87
T1=24.41
csp/graphColoring/
sgb/queen/
normalized-queen8-12-10.xml		 MSAT TO
f=16
TT=1618.64
T1=3.46
 MSAT (TO)
f=16
TT=1618.64
T1=3.46
 MSAT (TO)
f=16
TT=1639.77
T1=3.52
 MSAT (TO)
f=16
TT=3600.05

 MSAT (TO)
f=16
TT=3600.08

 MSAT (TO)
f=33
TT=3600.01
T1=625.43
 MSAT (TO)
f=51
TT=3600.19
T1=265.9
csp/haystacks/
normalized-haystacks-05.xml		 MOPT
f=1
TT=1.211
T1=1.07
 OPTIMUM
f=1
TT=1070.06
T1=1.08
CHECKS=91602700
NODES=1297980
 OPTIMUM
f=1
TT=846.722
T1=1.13
CHECKS=54165700
NODES=642818
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.09

 OPTIMUM
f=1
TT=1.211
T1=1.07
 OPTIMUM
f=1
TT=1.23
T1=1.08
csp/haystacks/
normalized-haystacks-08.xml		 MOPT
f=1
TT=2.722
T1=2.33
 MSAT (TO)
f=1
TT=1661.96
T1=4.59
 MSAT (TO)
f=1
TT=1650.67
T1=4.96
 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=1
TT=3600.1

 OPTIMUM
f=1
TT=3.089
T1=2.71
 OPTIMUM
f=1
TT=2.722
T1=2.33
csp/haystacks/
normalized-haystacks-10.xml		 MOPT
f=1
TT=6.646
T1=3.69
 MSAT (TO)
f=1
TT=1658.8
T1=11.66
 MSAT (TO)
f=1
TT=1650.87
T1=11.76
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.01

 OPTIMUM
f=1
TT=8.474
T1=5.88
 OPTIMUM
f=1
TT=6.646
T1=3.69
csp/haystacks/
normalized-haystacks-11.xml		 MOPT
f=1
TT=15.76
T1=2.35
 MSAT (TO)
f=1
TT=1642.39
T1=2.56
 MSAT (TO)
f=1
TT=1766.57
T1=2.35
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.02

 OPTIMUM
f=1
TT=17.67
T1=8.06
 OPTIMUM
f=1
TT=15.76
T1=4.58
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/haystacks/
normalized-haystacks-12.xml		 MOPT
f=1
TT=70.381
T1=4.45
 MSAT (TO)
f=1
TT=1646.57
T1=4.45
 MSAT (TO)
f=1
TT=1657.11
T1=4.53
 MSAT (TO)
f=1
TT=3600.05

 MSAT (TO)
f=1
TT=3600.08

 OPTIMUM
f=1
TT=70.381
T1=13.16
 OPTIMUM
f=1
TT=87.328
T1=5.26
csp/haystacks/
normalized-haystacks-15.xml		 MSAT TO
f=1
TT=1639.09
T1=1.34
 MSAT (TO)
f=1
TT=1650.02
T1=1.34
 MSAT (TO)
f=1
TT=1639.09
T1=1.37
 MSAT (TO)
f=1
TT=3600.04

 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.06
T1=74.36
 MSAT (TO)
f=1
TT=3600.24
T1=17
csp/haystacks/
normalized-haystacks-16.xml		 MSAT TO
f=1
TT=1661.73
T1=12.28
 MSAT (TO)
f=1
TT=1662.6
T1=12.35
 MSAT (TO)
f=1
TT=1661.73
T1=12.28
 MSAT (TO)
f=1
TT=3600.04

 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.06
T1=119.84
 MSAT (TO)
f=1
TT=3600.2
T1=42.63
csp/haystacks/
normalized-haystacks-20.xml		 MSAT TO
f=1
TT=1677.64
T1=23.49
 MSAT (TO)
f=1
TT=1690.57
T1=23.49
 MSAT (TO)
f=1
TT=1677.64
T1=25.04
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600

 MSAT (TO)
f=1
TT=3600.27
T1=949.79
 No Cert.

TT=129.979
csp/haystacks/
normalized-haystacks-29.xml		 MSAT TO
f=1
TT=3600.02

 MSAT (TO)
f=2
TT=1659.91
T1=7.49
 MSAT (TO)
f=2
TT=1721.24
T1=6.75
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.02

 ?

TT=233.223

 ?

TT=247.919
csp/haystacks/
normalized-haystacks-30.xml		 MSAT TO
f=1
TT=1691.9
T1=28.29
 MSAT (TO)
f=1
TT=1691.9
T1=28.51
 MSAT (TO)
f=1
TT=1810.18
T1=28.29
 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.01

 ?

TT=177.04

 ?

TT=183.826
csp/haystacks/
normalized-haystacks-35.xml		 MSAT TO
f=1
TT=1731.63
T1=22.53
 MSAT (TO)
f=1
TT=1770.9
T1=22.77
 MSAT (TO)
f=1
TT=1731.63
T1=22.53
 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=2
TT=3600.03

 ?

TT=241.426

 ?

TT=213.555
csp/haystacks/
normalized-haystacks-36.xml		 MSAT TO
f=1
TT=3600.03

 MSAT (TO)
f=2
TT=1727.45
T1=26.29
 MSAT (TO)
f=2
TT=1752.62
T1=24.22
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=2
TT=3600.04

 ?

TT=221.702

 ?

TT=207.488
csp/haystacks/
normalized-haystacks-43.xml		 MSAT TO
f=1
TT=3600.02

 ?

TT=90.091

 ?

TT=98.047

 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=2
TT=3600.04

 ?

TT=230.704

 ?

TT=224.265
csp/js-taillard-15/
normalized-js-taillard-15-95-2.xml		 MOPT
f=2
TT=1098.43
T1=1098.14
 ?

TT=165.866

 ?

TT=165.749

 MSAT (TO)
f=18
TT=3600.01

 MSAT (TO)
f=22
TT=3600.03

 OPTIMUM
f=2
TT=1506.77
T1=1506.58
 OPTIMUM
f=2
TT=1098.43
T1=1098.14
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/js-taillard-15/
normalized-js-taillard-15-95-4.xml		 MSAT TO
f=2
TT=3600.16
T1=304.62
 ?

TT=188.418

 ?

TT=188.621

 MSAT (TO)
f=17
TT=3600.07

 MSAT (TO)
f=22
TT=3600.09

 MSAT (TO)
f=2
TT=3600.16
T1=304.62
 MSAT (TO)
f=2
TT=3600.29
T1=712.07
csp/js-taillard-20/
normalized-js-taillard-20-95-7.xml		 MSAT TO
f=37
TT=3600.09

 ?

TT=131.296

 ?

TT=123.843

 MSAT (TO)
f=42
TT=3600.08

 MSAT (TO)
f=37
TT=3600.09

 ? (MO)

TT=78.67

 ? (MO)

TT=85.708
csp/knights/
normalized-knights-12-5.xml		 MOPT
f=1
TT=0.878
T1=0.66
 OPTIMUM
f=1
TT=36.657
T1=0.66
CHECKS=558698
NODES=143
 OPTIMUM
f=1
TT=36.55
T1=0.67
CHECKS=558698
NODES=143
 MSAT (TO)
f=1
TT=3600.1

 MSAT (TO)
f=1
TT=3600.07

 OPTIMUM
f=1
TT=0.878
T1=0.66
 OPTIMUM
f=1
TT=1.071
T1=0.84
csp/knights/
normalized-knights-12-9.xml		 MOPT
f=1
TT=44.701
T1=0.68
 OPTIMUM
f=1
TT=48.282
T1=0.69
CHECKS=1764220
NODES=385
 OPTIMUM
f=1
TT=44.701
T1=0.68
CHECKS=1236270
NODES=192
 MSAT (TO)
f=1
TT=3600.01

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=44.707
T1=1.11
 OPTIMUM
f=1
TT=68.079
T1=1.15
csp/knights/
normalized-knights-15-9.xml		 MOPT
f=1
TT=62.845
T1=0.57
 OPTIMUM
f=1
TT=79.581
T1=0.68
CHECKS=6625880
NODES=788
 OPTIMUM
f=1
TT=62.845
T1=0.57
CHECKS=4475070
NODES=342
 MSAT (TO)
f=1
TT=3600.09

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=150.35
T1=1.21
 OPTIMUM
f=1
TT=176.267
T1=1.12
csp/knights/
normalized-knights-25-5.xml		 MOPT
f=1
TT=1.188
T1=0.85
 OPTIMUM
f=1
TT=138.243
T1=0.99
CHECKS=36604800
NODES=624
 OPTIMUM
f=1
TT=131.193
T1=0.88
CHECKS=36604800
NODES=624
 MSAT (TO)
f=1
TT=3600.01

 MSAT (TO)
f=1
TT=3600

 OPTIMUM
f=1
TT=1.316
T1=0.89
 OPTIMUM
f=1
TT=1.188
T1=0.85
csp/knights/
normalized-knights-25-9.xml		 MOPT
f=1
TT=276.481
T1=0.99
 OPTIMUM
f=1
TT=387.217
T1=0.99
CHECKS=125474000
NODES=2903
 OPTIMUM
f=1
TT=276.481
T1=1.18
CHECKS=87069200
NODES=1095
 MSAT (TO)
f=1
TT=3600.09

 MSAT (TO)
f=1
TT=3600

 OPTIMUM
f=1
TT=614.707
T1=1.47
 OPTIMUM
f=1
TT=613.784
T1=1.26
csp/knights/
normalized-knights-50-9.xml		 MOPT
f=1
TT=2555.83
T1=1.81
 MSAT (TO)
f=1
TT=1606.05
T1=7.62
 MSAT (TO)
f=1
TT=1619.27
T1=7.8
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=2796.16
T1=3.32
 OPTIMUM
f=1
TT=2555.83
T1=1.81
csp/knights/
normalized-knights-8-5.xml		 MOPT
f=1
TT=0.871
T1=0.58
 OPTIMUM
f=1
TT=31.963
T1=0.58
CHECKS=56074
NODES=63
 OPTIMUM
f=1
TT=31.9
T1=0.59
CHECKS=56074
NODES=63
 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=0.961
T1=0.84
 OPTIMUM
f=1
TT=0.871
T1=0.68
csp/langford2/
normalized-langford-2-10.xml		 MOPT
f=1
TT=17.771
T1=0.68
 MSAT (TO)
f=1
TT=1619.66
T1=0.77
 OPTIMUM
f=1
TT=856.616
T1=0.68
CHECKS=47509100
NODES=169673
 MSAT (TO)
f=1
TT=3600.04

 MSAT (TO)
f=1
TT=3600.07

 OPTIMUM
f=1
TT=17.771
T1=2.2
 OPTIMUM
f=1
TT=51.021
T1=1.91
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/langford2/
normalized-langford-2-2.xml		 MOPT
f=1
TT=0.705
T1=0.48
 OPTIMUM
f=1
TT=30.674
T1=0.48
CHECKS=60
NODES=1
 OPTIMUM
f=1
TT=30.748
T1=0.57
CHECKS=60
NODES=1
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.02

 OPTIMUM
f=1
TT=0.705
T1=0.59
 OPTIMUM
f=1
TT=0.713
T1=0.48
csp/langford2/
normalized-langford-2-5.xml		 MOPT
f=1
TT=1.122
T1=0.59
 OPTIMUM
f=1
TT=31.039
T1=0.64
CHECKS=8018
NODES=83
 OPTIMUM
f=1
TT=31.211
T1=0.59
CHECKS=18102
NODES=113
 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=1
TT=3600.08

 OPTIMUM
f=1
TT=1.241
T1=1.09
 OPTIMUM
f=1
TT=1.122
T1=0.97
csp/langford3/
normalized-langford-3-11.xml		 MSAT TO
f=2
TT=1587.45
T1=3.73
 MSAT (TO)
f=2
TT=1587.45
T1=7.49
 MSAT (TO)
f=2
TT=1608.12
T1=7.57
 MSAT (TO)
f=2
TT=3600.07

 MSAT (TO)
f=2
TT=3600.01

 MSAT (TO)
f=3
TT=3600.08
T1=6.67
 MSAT (TO)
f=2
TT=3600.14
T1=3.73
csp/langford3/
normalized-langford-3-12.xml		 MSAT TO
f=2
TT=1613.25
T1=4.15
 MSAT (TO)
f=2
TT=1630.64
T1=11.97
 MSAT (TO)
f=2
TT=1613.25
T1=12.06
 MSAT (TO)
f=2
TT=3600.05

 MSAT (TO)
f=2
TT=3600.09

 MSAT (TO)
f=2
TT=3600.04
T1=7.82
 MSAT (TO)
f=2
TT=3600.18
T1=4.15
csp/langford3/
normalized-langford-3-13.xml		 MSAT TO
f=2
TT=3600.02
T1=5.33
 MSAT (TO)
f=3
TT=1613.71
T1=13.41
 MSAT (TO)
f=3
TT=1616.02
T1=12.37
 MSAT (TO)
f=2
TT=3600.02

 MSAT (TO)
f=2
TT=3600.06

 MSAT (TO)
f=2
TT=3600.09
T1=10.73
 MSAT (TO)
f=2
TT=3600.22
T1=5.33
csp/langford3/
normalized-langford-3-2.xml		 MOPT
f=2
TT=0.732
T1=0.47
 OPTIMUM
f=2
TT=30.886
T1=0.58
CHECKS=1892
NODES=21
 OPTIMUM
f=2
TT=30.765
T1=0.47
CHECKS=1793
NODES=17
 MSAT (TO)
f=2
TT=3600.06

 MSAT (TO)
f=2
TT=3600.02

 OPTIMUM
f=2
TT=0.732
T1=0.61
 OPTIMUM
f=2
TT=0.756
T1=0.62
csp/langford3/
normalized-langford-3-3.xml		 MOPT
f=2
TT=1.008
T1=0.49
 OPTIMUM
f=2
TT=32.055
T1=0.49
CHECKS=64646
NODES=246
 OPTIMUM
f=2
TT=31.575
T1=0.59
CHECKS=33100
NODES=148
 MSAT (TO)
f=2
TT=3600.05

 MSAT (TO)
f=2
TT=3600.03

 OPTIMUM
f=2
TT=1.008
T1=0.88
 OPTIMUM
f=2
TT=1.031
T1=0.9
csp/langford3/
normalized-langford-3-5.xml		 MOPT
f=2
TT=1.757
T1=0.58
 OPTIMUM
f=2
TT=1177.92
T1=0.58
CHECKS=68201700
NODES=69281
 OPTIMUM
f=2
TT=108.021
T1=0.6
CHECKS=4087010
NODES=5179
 MSAT (TO)
f=2
TT=3600

 MSAT (TO)
f=2
TT=3600.1

 OPTIMUM
f=2
TT=1.757
T1=1.59
 OPTIMUM
f=2
TT=1.937
T1=1.8
csp/langford3/
normalized-langford-3-6.xml		 MOPT
f=2
TT=2.174
T1=0.72
 MSAT (TO)
f=2
TT=1586.43
T1=0.72
 OPTIMUM
f=2
TT=1018.56
T1=0.78
CHECKS=53891200
NODES=40950
 MSAT (TO)
f=2
TT=3600.06

 MSAT (TO)
f=2
TT=3600.07

 OPTIMUM
f=2
TT=2.174
T1=1.94
 OPTIMUM
f=2
TT=2.185
T1=1.86
csp/langford4/
normalized-langford-4-11.xml		 MOPT
f=2
TT=542.383
T1=256.16
 MSAT (TO)
f=5
TT=1631.49
T1=23.16
 MSAT (TO)
f=5
TT=1643.94
T1=22.98
 MSAT (TO)
f=2
TT=3600.04

 MSAT (TO)
f=2
TT=3600.07

 OPTIMUM
f=2
TT=542.383
T1=256.16
 OPTIMUM
f=2
TT=600.328
T1=599.74
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/langford4/
normalized-langford-4-12.xml		 MOPT
f=2
TT=3296.4
T1=185.28
 MSAT (TO)
f=4
TT=1626.84
T1=49.96
 MSAT (TO)
f=4
TT=1637.86
T1=53.86
 MSAT (TO)
f=3
TT=3600.03

 MSAT (TO)
f=2
TT=3600.09

 MSAT (TO)
f=2
TT=3600.01
T1=185.28
 OPTIMUM
f=2
TT=3296.4
T1=3296.01
csp/langford4/
normalized-langford-4-14.xml		 MSAT TO
f=3
TT=3600.05
T1=142.62
 MSAT (TO)
f=8
TT=1608.74
T1=13.75
 MSAT (TO)
f=8
TT=1653.18
T1=13.52
 MSAT (TO)
f=4
TT=3600.05

 MSAT (TO)
f=3
TT=3600.05

 MSAT (TO)
f=5
TT=3600.06
T1=49.56
 MSAT (TO)
f=3
TT=3600.19
T1=142.62
csp/langford4/
normalized-langford-4-2.xml		 MOPT
f=2
TT=0.97
T1=0.48
 OPTIMUM
f=2
TT=31.101
T1=0.48
CHECKS=14067
NODES=63
 OPTIMUM
f=2
TT=31.205
T1=0.58
CHECKS=16354
NODES=78
 MSAT (TO)
f=2
TT=3600.04

 MSAT (TO)
f=2
TT=3600.06

 OPTIMUM
f=2
TT=0.973
T1=0.87
 OPTIMUM
f=2
TT=0.97
T1=0.82
csp/langford4/
normalized-langford-4-3.xml		 MOPT
f=2
TT=1.224
T1=0.67
 OPTIMUM
f=2
TT=47.868
T1=0.67
CHECKS=916726
NODES=1498
 OPTIMUM
f=2
TT=32.995
T1=0.69
CHECKS=103328
NODES=196
 MSAT (TO)
f=2
TT=3600

 MSAT (TO)
f=2
TT=3600.02

 OPTIMUM
f=2
TT=1.418
T1=1.25
 OPTIMUM
f=2
TT=1.224
T1=1.06
csp/langford4/
normalized-langford-4-4.xml		 MOPT
f=2
TT=1.688
T1=1.08
 OPTIMUM
f=2
TT=1123.77
T1=1.18
CHECKS=58578100
NODES=44959
 OPTIMUM
f=2
TT=104.942
T1=1.08
CHECKS=4059760
NODES=4269
 MSAT (TO)
f=2
TT=3600.07

 MSAT (TO)
f=2
TT=3600.09

 OPTIMUM
f=2
TT=1.843
T1=1.65
 OPTIMUM
f=2
TT=1.688
T1=1.52
csp/langford4/
normalized-langford-4-5.xml		 MOPT
f=3
TT=2.581
T1=0.86
 MSAT (TO)
f=3
TT=1609.43
T1=0.88
 MSAT (TO)
f=3
TT=1599.27
T1=0.86
 MSAT (TO)
f=3
TT=3600.01

 MSAT (TO)
f=3
TT=3600.05

 OPTIMUM
f=3
TT=2.753
T1=2.09
 OPTIMUM
f=3
TT=2.581
T1=2.41
csp/langford4/
normalized-langford-4-8.xml		 MOPT
f=1
TT=4.577
T1=4.36
 MSAT (TO)
f=2
TT=1598.83
T1=10.98
 MSAT (TO)
f=2
TT=1619.57
T1=11.62
 MSAT (TO)
f=1
TT=3600.01

 MSAT (TO)
f=1
TT=3600.03

 OPTIMUM
f=1
TT=9.165
T1=8.5
 OPTIMUM
f=1
TT=4.577
T1=4.36
csp/langford4/
normalized-langford-4-9.xml		 MOPT
f=2
TT=26.698
T1=17.67
 MSAT (TO)
f=3
TT=1611.48
T1=29.31
 MSAT (TO)
f=3
TT=1632.85
T1=29.09
 MSAT (TO)
f=2
TT=3600.06

 MSAT (TO)
f=2
TT=3600.01

 OPTIMUM
f=2
TT=26.698
T1=17.67
 OPTIMUM
f=2
TT=44.648
T1=44.38
csp/nengfa/
normalized-color.xml		 MSAT TO
f=1035
TT=3600.01

 MSAT (TO)
f=1119
TT=1725.88
T1=106.33
 MSAT (TO)
f=1119
TT=1714.33
T1=97.89
 MSAT (TO)
f=1035
TT=3600.01

 MSAT (TO)
f=1057
TT=3600.01

 ?

TT=280.022

 ?

TT=239.107
csp/os-gp/
normalized-gp10-01-1092.xml		 MOPT
f=1
TT=17.798
T1=16.82
 ?

TT=84.444

 ?

TT=87.821

 MSAT (TO)
f=8
TT=3600.09

 MSAT (TO)
f=10
TT=3600.07

 OPTIMUM
f=1
TT=48.585
T1=43.18
 OPTIMUM
f=1
TT=17.798
T1=16.82
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/os-gp/
normalized-gp10-02-1096.xml		 MOPT
f=1
TT=14.577
T1=13.95
 ?

TT=73.275

 ?

TT=74.891

 MSAT (TO)
f=7
TT=3600.05

 MSAT (TO)
f=11
TT=3600

 OPTIMUM
f=1
TT=45.645
T1=42.02
 OPTIMUM
f=1
TT=14.577
T1=13.95
csp/os-gp/
normalized-gp10-03-1080.xml		 MOPT
f=1
TT=21.037
T1=15.89
 ?

TT=98.459

 ?

TT=95.007

 MSAT (TO)
f=8
TT=3600.08

 MSAT (TO)
f=11
TT=3600.08

 OPTIMUM
f=1
TT=51.569
T1=43.51
 OPTIMUM
f=1
TT=21.037
T1=15.89
csp/os-gp/
normalized-gp10-04-1076.xml		 MOPT
f=1
TT=16.887
T1=15.91
 ?

TT=111.292

 ?

TT=105.801

 MSAT (TO)
f=8
TT=3600.02

 MSAT (TO)
f=11
TT=3600.08

 OPTIMUM
f=1
TT=46.365
T1=42.24
 OPTIMUM
f=1
TT=16.887
T1=15.91
csp/os-gp/
normalized-gp10-05-1070.xml		 MOPT
f=1
TT=27.825
T1=18.08
 ?

TT=76.84

 ?

TT=80.296

 MSAT (TO)
f=9
TT=3600.01

 MSAT (TO)
f=12
TT=3600.04

 OPTIMUM
f=1
TT=67.201
T1=53.08
 OPTIMUM
f=1
TT=27.825
T1=18.08
csp/os-gp/
normalized-gp10-06-1070.xml		 MOPT
f=1
TT=16.719
T1=15.65
 ?

TT=77.407

 ?

TT=81.241

 MSAT (TO)
f=7
TT=3600.04

 MSAT (TO)
f=11
TT=3600.08

 OPTIMUM
f=1
TT=51.194
T1=46.04
 OPTIMUM
f=1
TT=16.719
T1=15.65
csp/os-gp/
normalized-gp10-07-1078.xml		 MOPT
f=1
TT=17.835
T1=17.41
 ?

TT=114.973

 ?

TT=115.004

 MSAT (TO)
f=8
TT=3600.09

 MSAT (TO)
f=11
TT=3600.07

 OPTIMUM
f=1
TT=45.617
T1=41.43
 OPTIMUM
f=1
TT=17.835
T1=17.41
csp/os-gp/
normalized-gp10-08-1092.xml		 MOPT
f=1
TT=17.356
T1=16.04
 ?

TT=80.731

 ?

TT=77.314

 MSAT (TO)
f=7
TT=3600.02

 MSAT (TO)
f=10
TT=3600.03

 OPTIMUM
f=1
TT=45.893
T1=41.48
 OPTIMUM
f=1
TT=17.356
T1=16.04
csp/os-gp/
normalized-gp10-09-1111.xml		 MOPT
f=1
TT=14.631
T1=13.97
 ?

TT=98.964

 ?

TT=94.239

 MSAT (TO)
f=6
TT=3600.06

 MSAT (TO)
f=11
TT=3600.07

 OPTIMUM
f=1
TT=45.144
T1=41.37
 OPTIMUM
f=1
TT=14.631
T1=13.97
csp/os-gp/
normalized-gp10-10-1091.xml		 MOPT
f=1
TT=16.095
T1=14.64
 ?

TT=88.96

 ?

TT=85.297

 MSAT (TO)
f=7
TT=3600.04

 MSAT (TO)
f=11
TT=3600.04

 OPTIMUM
f=1
TT=45.62
T1=41.11
 OPTIMUM
f=1
TT=16.095
T1=14.64
csp/os-taillard-10/
normalized-os-taillard-10-95-1.xml		 MOPT
f=4
TT=210.432
T1=192.33
 ?

TT=92.94

 ?

TT=91.691

 MSAT (TO)
f=8
TT=3600.07

 MSAT (TO)
f=9
TT=3600.01

 OPTIMUM
f=4
TT=1045.37
T1=628.98
 OPTIMUM
f=4
TT=210.432
T1=192.33
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/os-taillard-10/
normalized-os-taillard-10-95-3.xml		 MOPT
f=4
TT=2152.9
T1=2152.55
 ?

TT=89.26

 ?

TT=60.445

 MSAT (TO)
f=9
TT=3600.08

 MSAT (TO)
f=9
TT=3600.03

 MSAT (TO)
f=5
TT=3600.03
T1=1782.57
 OPTIMUM
f=4
TT=2152.9
T1=2152.55
csp/os-taillard-10/
normalized-os-taillard-10-95-8.xml		 MOPT
f=3
TT=167.157
T1=142.53
 ?

TT=82.446

 ?

TT=78.977

 MSAT (TO)
f=12
TT=3600.04

 MSAT (TO)
f=11
TT=3600.08

 OPTIMUM
f=3
TT=778.149
T1=346.91
 OPTIMUM
f=3
TT=167.157
T1=142.53
csp/os-taillard-15/
normalized-os-taillard-15-95-2.xml		 MSAT TO
f=15
TT=3600.08

 ?

TT=122.641

 ?

TT=115.812

 MSAT (TO)
f=19
TT=3600.01

 MSAT (TO)
f=15
TT=3600.08

 MSAT (TO)
f=18
TT=3600.23
T1=333.05
 No Cert.

TT=50.932
csp/os-taillard-15/
normalized-os-taillard-15-95-9.xml		 MSAT TO
f=12
TT=3600.35
T1=399.33
 ?

TT=198.683

 ?

TT=199.271

 MSAT (TO)
f=18
TT=3600.1

 MSAT (TO)
f=18
TT=3600.01

 MSAT (TO)
f=12
TT=3600.35
T1=399.33
 No Cert.

TT=53.194
csp/os-taillard-20/
normalized-os-taillard-20-95-0.xml		 MSAT TO
f=26
TT=3600.02

 ?

TT=160.111

 ?

TT=151.312

 MSAT (TO)
f=33
TT=3600.07

 MSAT (TO)
f=26
TT=3600.02

 ?

TT=172.472

 ?

TT=172.451
csp/os-taillard-20/
normalized-os-taillard-20-95-2.xml		 MSAT TO
f=24
TT=3600.06

 ?

TT=189.454

 ?

TT=189.406

 MSAT (TO)
f=32
TT=3600.01

 MSAT (TO)
f=24
TT=3600.06

 ?

TT=171.329

 ?

TT=177.88
csp/os-taillard-20/
normalized-os-taillard-20-95-6.xml		 MSAT TO
f=25
TT=3600.02

 ?

TT=97.729

 ?

TT=102.909

 MSAT (TO)
f=32
TT=3600.09

 MSAT (TO)
f=25
TT=3600.02

 ?

TT=176.818

 ?

TT=169.137
csp/os-taillard-4/
normalized-os-taillard-4-95-4.xml		 MOPT
f=2
TT=1.299
T1=1.13
 MSAT (TO)
f=2
TT=1601.72
T1=1.37
 MSAT (TO)
f=2
TT=1592.83
T1=1.22
 MSAT (TO)
f=2
TT=3600.04

 MSAT (TO)
f=2
TT=3600.02

 OPTIMUM
f=2
TT=1.418
T1=1.26
 OPTIMUM
f=2
TT=1.299
T1=1.13
csp/os-taillard-4/
normalized-os-taillard-4-95-5.xml		 MOPT
f=3
TT=1.164
T1=0.96
 MSAT (TO)
f=3
TT=1600.35
T1=0.96
 MSAT (TO)
f=3
TT=1605.42
T1=1.07
 MSAT (TO)
f=3
TT=3600.06

 MSAT (TO)
f=3
TT=3600.07

 OPTIMUM
f=3
TT=1.367
T1=1.15
 OPTIMUM
f=3
TT=1.164
T1=1
csp/os-taillard-4/
normalized-os-taillard-4-95-8.xml		 MOPT
f=3
TT=1.423
T1=1.21
 MSAT (TO)
f=3
TT=1598.08
T1=2.67
 MSAT (TO)
f=3
TT=1602.14
T1=2.95
 MSAT (TO)
f=3
TT=3600.08

 MSAT (TO)
f=3
TT=3600.06

 OPTIMUM
f=3
TT=1.423
T1=1.21
 OPTIMUM
f=3
TT=1.524
T1=1.35
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/os-taillard-5/
normalized-os-taillard-5-95-5.xml		 MOPT
f=3
TT=2.634
T1=2.45
 MSAT (TO)
f=4
TT=1622.42
T1=8.19
 MSAT (TO)
f=4
TT=1589.88
T1=8.89
 MSAT (TO)
f=4
TT=3600.09

 MSAT (TO)
f=4
TT=3600.07

 OPTIMUM
f=3
TT=2.923
T1=2.48
 OPTIMUM
f=3
TT=2.634
T1=2.45
csp/os-taillard-5/
normalized-os-taillard-5-95-8.xml		 MOPT
f=5
TT=2.159
T1=1.52
 MSAT (TO)
f=5
TT=1603.16
T1=4.43
 MSAT (TO)
f=5
TT=1605.44
T1=4.09
 MSAT (TO)
f=5
TT=3600.01

 MSAT (TO)
f=5
TT=3600.05

 OPTIMUM
f=5
TT=3.047
T1=2.35
 OPTIMUM
f=5
TT=2.159
T1=1.52
csp/os-taillard-5/
normalized-os-taillard-5-95-9.xml		 MOPT
f=4
TT=2.126
T1=1.95
 MSAT (TO)
f=4
TT=1617.11
T1=3.54
 MSAT (TO)
f=4
TT=1599.26
T1=3.45
 MSAT (TO)
f=4
TT=3600.01

 MSAT (TO)
f=4
TT=3600.02

 OPTIMUM
f=4
TT=3.201
T1=3.03
 OPTIMUM
f=4
TT=2.126
T1=1.95
csp/os-taillard-7/
normalized-os-taillard-7-95-4.xml		 MOPT
f=3
TT=8.857
T1=8.64
 MSAT (TO)
f=6
TT=1599.45
T1=15.13
 MSAT (TO)
f=6
TT=1600.58
T1=13.86
 MSAT (TO)
f=6
TT=3600.08

 MSAT (TO)
f=6
TT=3600.09

 OPTIMUM
f=3
TT=13.43
T1=13.1
 OPTIMUM
f=3
TT=8.857
T1=8.64
csp/os-taillard-7/
normalized-os-taillard-7-95-7.xml		 MOPT
f=4
TT=7.419
T1=6.89
 MSAT (TO)
f=5
TT=1620.87
T1=42.77
 MSAT (TO)
f=5
TT=1619.42
T1=39.95
 MSAT (TO)
f=5
TT=3600.07

 MSAT (TO)
f=6
TT=3600.01

 OPTIMUM
f=4
TT=15.065
T1=9.62
 OPTIMUM
f=4
TT=7.419
T1=6.89
csp/os-taillard-7/
normalized-os-taillard-7-95-8.xml		 MOPT
f=3
TT=7.928
T1=7.69
 MSAT (TO)
f=5
TT=1655.02
T1=38.12
 MSAT (TO)
f=5
TT=1671.45
T1=45.85
 MSAT (TO)
f=6
TT=3600.08

 MSAT (TO)
f=6
TT=3600.05

 OPTIMUM
f=3
TT=20.158
T1=19.83
 OPTIMUM
f=3
TT=7.928
T1=7.69
csp/os-taillard-7/
normalized-os-taillard-7-95-9.xml		 MOPT
f=3
TT=13.742
T1=13.52
 MSAT (TO)
f=6
TT=1623
T1=19.5
 MSAT (TO)
f=6
TT=1576.93
T1=18.4
 MSAT (TO)
f=6
TT=3600.08

 MSAT (TO)
f=7
TT=3600.02

 OPTIMUM
f=3
TT=18.505
T1=18.18
 OPTIMUM
f=3
TT=13.742
T1=13.52
csp/pigeons/
normalized-pigeons-11.xml		 MOPT
f=1
TT=2.691
T1=0.53
 MSAT (TO)
f=1
TT=1647.82
T1=0.58
 MSAT (TO)
f=1
TT=1647.11
T1=0.53
 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.1

 OPTIMUM
f=1
TT=2.691
T1=0.99
 OPTIMUM
f=1
TT=3.191
T1=0.98
csp/pigeons/
normalized-pigeons-13.xml		 MOPT
f=1
TT=75.432
T1=0.53
 MSAT (TO)
f=1
TT=1639.2
T1=0.61
 MSAT (TO)
f=1
TT=1652.46
T1=0.53
 MSAT (TO)
f=1
TT=3600.04

 MSAT (TO)
f=1
TT=3600.06

 OPTIMUM
f=1
TT=75.432
T1=1.42
 OPTIMUM
f=1
TT=87.304
T1=1.18
csp/pigeons/
normalized-pigeons-14.xml		 MOPT
f=1
TT=505.13
T1=0.52
 MSAT (TO)
f=1
TT=1628.66
T1=0.57
 MSAT (TO)
f=1
TT=1643.48
T1=0.52
 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=649.361
T1=1.36
 OPTIMUM
f=1
TT=505.13
T1=1.33
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/pigeons/
normalized-pigeons-16.xml		 MSAT TO
f=1
TT=1636.18
T1=0.48
 MSAT (TO)
f=1
TT=1636.18
T1=0.48
 MSAT (TO)
f=1
TT=1649.9
T1=0.57
 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.05
T1=1.54
 MSAT (TO)
f=1
TT=3600.07
T1=1.46
csp/pigeons/
normalized-pigeons-30-ord.xml		 MOPT
f=1
TT=7.183
T1=0.99
 OPTIMUM
f=1
TT=297.481
T1=0.99
CHECKS=13959600
NODES=758
 MSAT (TO)
f=1
TT=1605.33
T1=0.99
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.01

 OPTIMUM
f=1
TT=16.425
T1=14.96
 OPTIMUM
f=1
TT=7.183
T1=7.11
csp/pigeons/
normalized-pigeons-30.xml		 MSAT TO
f=1
TT=1634.16
T1=0.87
 MSAT (TO)
f=1
TT=1651.66
T1=0.87
 MSAT (TO)
f=1
TT=1634.16
T1=0.91
 MSAT (TO)
f=1
TT=3600.09

 MSAT (TO)
f=1
TT=3600.01

 MSAT (TO)
f=1
TT=3600.09
T1=5.15
 MSAT (TO)
f=1
TT=3600.1
T1=2.87
csp/pigeons/
normalized-pigeons-35.xml		 MSAT TO
f=1
TT=1629.33
T1=0.78
 MSAT (TO)
f=1
TT=1639.53
T1=0.78
 MSAT (TO)
f=1
TT=1629.33
T1=0.88
 MSAT (TO)
f=1
TT=3600

 MSAT (TO)
f=1
TT=3600.09

 MSAT (TO)
f=1
TT=3600.04
T1=7.69
 MSAT (TO)
f=1
TT=3600.18
T1=4.27
csp/pigeons/
normalized-pigeons-40.xml		 MSAT TO
f=1
TT=1651.38
T1=0.97
 MSAT (TO)
f=1
TT=1654.42
T1=0.98
 MSAT (TO)
f=1
TT=1651.38
T1=0.97
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600

 MSAT (TO)
f=1
TT=3600.02
T1=13.81
 MSAT (TO)
f=1
TT=3600.18
T1=5.62
csp/pigeons/
normalized-pigeons-50.xml		 MSAT TO
f=1
TT=1654.74
T1=0.97
 MSAT (TO)
f=1
TT=1675.2
T1=1.17
 MSAT (TO)
f=1
TT=1654.74
T1=0.97
 MSAT (TO)
f=1
TT=3600.01

 MSAT (TO)
f=1
TT=3600.04

 MSAT (TO)
f=1
TT=3600.05
T1=31.41
 MSAT (TO)
f=1
TT=3600.13
T1=8.87
csp/pigeons/
normalized-pigeons-8.xml		 MOPT
f=1
TT=0.933
T1=0.57
 OPTIMUM
f=1
TT=36.74
T1=0.57
CHECKS=447418
NODES=6139
 OPTIMUM
f=1
TT=42.532
T1=0.58
CHECKS=938994
NODES=11217
 MSAT (TO)
f=1
TT=3600.04

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=1.073
T1=0.9
 OPTIMUM
f=1
TT=0.933
T1=0.78
csp/pseudo/mps/
normalized-mps-diamond.xml		 MOPT
f=1
TT=0.551
T1=0.43
 OPTIMUM
f=1
TT=3.293
T1=0.58
CHECKS=16
NODES=1
 OPTIMUM
f=1
TT=3.279
T1=0.58
CHECKS=16
NODES=1
 ? (TO)

TT=3600.02

 ? (TO)

TT=3600.03

 OPTIMUM
f=1
TT=0.551
T1=0.43
 OPTIMUM
f=1
TT=0.567
T1=0.44
csp/queenAttacking/
normalized-queenAttacking-3.xml		 MOPT
f=1
TT=1.06
T1=0.58
 OPTIMUM
f=1
TT=31.436
T1=0.58
CHECKS=24143
NODES=131
 OPTIMUM
f=1
TT=31.501
T1=0.58
CHECKS=30242
NODES=141
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.01

 OPTIMUM
f=1
TT=1.163
T1=1
 OPTIMUM
f=1
TT=1.06
T1=0.9
csp/queenAttacking/
normalized-queenAttacking-4.xml		 MOPT
f=1
TT=2.179
T1=0.63
 OPTIMUM
f=1
TT=67.472
T1=0.68
CHECKS=1995390
NODES=5374
 OPTIMUM
f=1
TT=80.595
T1=0.63
CHECKS=2905650
NODES=5891
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=2.179
T1=1.66
 OPTIMUM
f=1
TT=2.752
T1=2.18
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/queensKnights/
normalized-queensKnights-100-5-add.xml		 MSAT TO
f=1
TT=3600.06

 ?

TT=275.975

 ?

TT=259.238

 MSAT (TO)
f=1
TT=3600.07

 MSAT (TO)
f=1
TT=3600.06

 ? (MO)

TT=88.36

 ? (MO)

TT=90.713
csp/queensKnights/
normalized-queensKnights-100-5-mul.xml		 MSAT TO
f=1
TT=3600.02

 ?

TT=388.412

 ?

TT=364.143

 MSAT (TO)
f=1
TT=3600.02

 MSAT (TO)
f=1
TT=3600.06

 ? (MO)

TT=103.548

 ? (MO)

TT=103.512
csp/queensKnights/
normalized-queensKnights-10-5-mul.xml		 MOPT
f=1
TT=1.771
T1=0.57
 OPTIMUM
f=1
TT=33.824
T1=0.57
CHECKS=238773
NODES=99
 OPTIMUM
f=1
TT=34.064
T1=0.68
CHECKS=238773
NODES=99
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.02

 OPTIMUM
f=1
TT=1.952
T1=1.69
 OPTIMUM
f=1
TT=1.771
T1=1.52
csp/queensKnights/
normalized-queensKnights-12-5-mul.xml		 MOPT
f=1
TT=1.765
T1=0.68
 OPTIMUM
f=1
TT=36.78
T1=0.68
CHECKS=655259
NODES=143
 OPTIMUM
f=1
TT=37.381
T1=0.77
CHECKS=655259
NODES=143
 MSAT (TO)
f=1
TT=3600.09

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=1.765
T1=1.45
 OPTIMUM
f=1
TT=1.916
T1=1.64
csp/queensKnights/
normalized-queensKnights-20-5-mul.xml		 MOPT
f=1
TT=3.364
T1=0.98
 OPTIMUM
f=1
TT=76.176
T1=0.98
CHECKS=11540500
NODES=399
 OPTIMUM
f=1
TT=79.334
T1=1.16
CHECKS=11540500
NODES=399
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=4.765
T1=4.12
 OPTIMUM
f=1
TT=3.364
T1=2.9
csp/queensKnights/
normalized-queensKnights-50-5-add.xml		 MOPT
f=1
TT=21.138
T1=7.2
 MSAT (TO)
f=1
TT=1667.71
T1=7.2
 MSAT (TO)
f=1
TT=1669.91
T1=7.81
 MSAT (TO)
f=1
TT=3600.05

 MSAT (TO)
f=1
TT=3600.05

 OPTIMUM
f=1
TT=56.453
T1=51.27
 OPTIMUM
f=1
TT=21.138
T1=17.27
csp/queensKnights/
normalized-queensKnights-80-5-add.xml		 MOPT
f=1
TT=75.06
T1=4.64
 ?
f=1
TT=669.197
T1=4.64
 ?
f=1
TT=1049.58
T1=6.02
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.09

 OPTIMUM
f=1
TT=577.034
T1=526.86
 OPTIMUM
f=1
TT=75.06
T1=72.94
csp/queensKnights/
normalized-queensKnights-80-5-mul.xml		 MOPT
f=1
TT=974.987
T1=31.26
 MSAT
f=1
TT=1197.15
T1=33.49
 MSAT
f=1
TT=1137.45
T1=31.26
 MSAT (TO)
f=1
TT=3600.1

 MSAT (TO)
f=1
TT=3600.04

 OPTIMUM
f=1
TT=974.987
T1=906.83
 MSAT (MO)
f=214
TT=45.9
T1=45.27
csp/queensKnights/
normalized-queensKnights-8-5-add.xml		 MOPT
f=1
TT=1.272
T1=0.57
 OPTIMUM
f=1
TT=31.922
T1=0.57
CHECKS=56074
NODES=63
 OPTIMUM
f=1
TT=31.932
T1=0.57
CHECKS=56074
NODES=63
 MSAT (TO)
f=1
TT=3600.06

 MSAT (TO)
f=1
TT=3600.06

 OPTIMUM
f=1
TT=1.273
T1=1.07
 OPTIMUM
f=1
TT=1.272
T1=1.09
csp/queensKnights/
normalized-queensKnights-8-5-mul.xml		 MOPT
f=1
TT=1.647
T1=0.68
 OPTIMUM
f=1
TT=32.219
T1=0.68
CHECKS=67863
NODES=63
 OPTIMUM
f=1
TT=32.201
T1=0.68
CHECKS=67863
NODES=63
 MSAT (TO)
f=1
TT=3600.08

 MSAT (TO)
f=1
TT=3600.06

 OPTIMUM
f=1
TT=1.665
T1=1.45
 OPTIMUM
f=1
TT=1.647
T1=1.43
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/rlfapGraphsMod/
normalized-graph12-w1.xml		 MOPT
f=8
TT=58.589
T1=14.15
 MSAT (TO)
f=8
TT=1640.78
T1=32.75
 MSAT (TO)
f=8
TT=1647.07
T1=32.71
 MSAT (TO)
f=8
TT=3600.06

 MSAT (TO)
f=16
TT=3600.02

 OPTIMUM
f=8
TT=63.299
T1=63.11
 OPTIMUM
f=8
TT=58.589
T1=14.15
csp/rlfapGraphsMod/
normalized-graph13-w1.xml		 MOPT
f=9
TT=277.94
T1=277.41
 MSAT (TO)
f=12
TT=1657.29
T1=32.14
 MSAT (TO)
f=12
TT=1646.26
T1=35.5
 MSAT (TO)
f=9
TT=3600.07

 MSAT (TO)
f=19
TT=3600.07

 OPTIMUM
f=9
TT=277.94
T1=277.41
 OPTIMUM
f=9
TT=293.437
T1=292.86
csp/rlfapGraphsMod/
normalized-graph14-f28.xml		 MSAT TO
f=16
TT=3600.08

 MSAT (TO)
f=70
TT=1681.32
T1=43.63
 MSAT (TO)
f=70
TT=1668.78
T1=40.9
 MSAT (TO)
f=16
TT=3600.08

 MSAT (TO)
f=69
TT=3600.04

 ? (MO)

TT=69.19

 ? (MO)

TT=69.349
csp/rlfapGraphsMod/
normalized-graph8-f11.xml		 MSAT TO
f=5
TT=3600.3
T1=869.79
 MSAT (TO)
f=30
TT=1661.12
T1=27.65
 MSAT (TO)
f=30
TT=1653.5
T1=28.32
 MSAT (TO)
f=14
TT=3600

 MSAT (TO)
f=34
TT=3600.03

 MSAT (TO)
f=5
TT=3600.3
T1=869.79
 No Cert.

TT=57.312
csp/rlfapGraphsMod/
normalized-graph9-f10.xml		 MSAT TO
f=19
TT=3600.01

 MSAT (TO)
f=52
TT=1684.36
T1=49.54
 MSAT (TO)
f=52
TT=1676.65
T1=53.43
 MSAT (TO)
f=19
TT=3600.01

 MSAT (TO)
f=39
TT=3600.08

 ? (MO)

TT=92.055

 ? (MO)

TT=90.453
csp/rlfapGraphs/
normalized-graph11.xml		 MSAT TO
f=26
TT=3600.07

 MSAT (TO)
f=44
TT=1676.43
T1=45.44
 MSAT (TO)
f=44
TT=1655.52
T1=44.93
 MSAT (TO)
f=26
TT=3600.07

 MSAT (TO)
f=194
TT=3600.1

 MSAT (TO)
f=310
TT=3600.21
T1=3147.31
 No Cert.

TT=56.47
csp/rlfapGraphs/
normalized-graph6.xml		 MOPT
f=10
TT=586.984
T1=586.7
 MSAT (TO)
f=20
TT=1620.31
T1=15.25
 MSAT (TO)
f=20
TT=1628.72
T1=15.19
 MSAT (TO)
f=11
TT=3600.01

 MSAT (TO)
f=55
TT=3600.07

 OPTIMUM
f=10
TT=836.867
T1=708.53
 OPTIMUM
f=10
TT=586.984
T1=586.7
csp/rlfapGraphs/
normalized-graph7.xml		 MOPT
f=10
TT=245.576
T1=225.29
 MSAT (TO)
f=19
TT=1646.4
T1=19.29
 MSAT (TO)
f=19
TT=1631.99
T1=19.28
 MSAT (TO)
f=10
TT=3600.07

 MSAT (TO)
f=60
TT=3600.01

 OPTIMUM
f=10
TT=386.808
T1=350.83
 OPTIMUM
f=10
TT=245.576
T1=225.29
csp/rlfapScens11/
normalized-scen11-f10.xml		 MSAT TO
f=17
TT=3600.39
T1=786.4
 MSAT (TO)
f=26
TT=1623.02
T1=23.68
 MSAT (TO)
f=26
TT=1632.63
T1=25.3
 MSAT (TO)
f=27
TT=3600.07

 MSAT (TO)
f=20
TT=3600.05

 MSAT (TO)
f=17
TT=3600.39
T1=786.4
 ? (MO)

TT=64.096
csp/rlfapScens11/
normalized-scen11-f12.xml		 MSAT TO
f=20
TT=3600.32
T1=3193.59
 MSAT (TO)
f=28
TT=1672.53
T1=41.21
 MSAT (TO)
f=28
TT=1680.91
T1=44.13
 MSAT (TO)
f=35
TT=3600

 MSAT (TO)
f=29
TT=3600.09

 MSAT (TO)
f=20
TT=3600.32
T1=3193.59
 ? (MO)

TT=75.089
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/rlfapScens11/
normalized-scen11-f1.xml		 MOPT
f=2
TT=1525.22
T1=872.2
 MSAT (TO)
f=4
TT=1635.78
T1=7.1
 MSAT (TO)
f=4
TT=1630.98
T1=6.59
 MSAT (TO)
f=2
TT=3600.01

 MSAT (TO)
f=2
TT=3600.07

 OPTIMUM
f=2
TT=1525.22
T1=872.2
 No Cert.

TT=62.188
csp/rlfapScens11/
normalized-scen11-f2.xml		 MOPT
f=2
TT=1488.18
T1=23.96
 MSAT (TO)
f=2
TT=1636.64
T1=23.96
 MSAT (TO)
f=2
TT=1656.18
T1=25.81
 MSAT (TO)
f=2
TT=3600.09

 MSAT (TO)
f=2
TT=3600.07

 OPTIMUM
f=2
TT=1488.18
T1=833.77
 ? (MO)

TT=67.261
csp/rlfapScens11/
normalized-scen11-f3.xml		 MSAT TO
f=3
TT=1635.15
T1=10.69
 MSAT (TO)
f=3
TT=2135.45
T1=10.81
 MSAT (TO)
f=3
TT=1635.15
T1=10.69
 MSAT (TO)
f=3
TT=3600.06

 MSAT (TO)
f=3
TT=3600.07

 MSAT (TO)
f=3
TT=3600.42
T1=786.16
 No Cert.

TT=64.006
csp/rlfapScens11/
normalized-scen11-f4.xml		 MSAT TO
f=3
TT=1652.73
T1=38.17
 MSAT (TO)
f=3
TT=1652.73
T1=38.17
 MSAT (TO)
f=3
TT=1658.99
T1=40.56
 MSAT (TO)
f=3
TT=3600.08

 MSAT (TO)
f=3
TT=3600.04

 MSAT (TO)
f=4
TT=3600.34
T1=710.37
 MSAT (MO)
f=438
TT=69.168
T1=61.52
csp/rlfapScens11/
normalized-scen11-f5.xml		 MSAT TO
f=3
TT=1636.35
T1=23.62
 MSAT (TO)
f=3
TT=1636.35
T1=23.62
 MSAT (TO)
f=3
TT=1651.09
T1=25.91
 MSAT (TO)
f=4
TT=3600.07

 MSAT (TO)
f=3
TT=3600.01

 MSAT (TO)
f=3
TT=3600.29
T1=849.69
 No Cert.

TT=67.422
csp/rlfapScens11/
normalized-scen11-f6.xml		 MSAT TO
f=6
TT=3600.06
T1=766.98
 MSAT (TO)
f=10
TT=1634.42
T1=20.79
 MSAT (TO)
f=10
TT=1647.21
T1=19.76
 MSAT (TO)
f=7
TT=3600.05

 MSAT (TO)
f=6
TT=3600.06

 MSAT (TO)
f=6
TT=3600.35
T1=766.98
 ? (MO)

TT=111.966
csp/rlfapScens11/
normalized-scen11-f7.xml		 MSAT TO
f=5
TT=3600.33
T1=793.21
 MSAT (TO)
f=8
TT=1694.79
T1=39.93
 MSAT (TO)
f=8
TT=1668.84
T1=39.96
 MSAT (TO)
f=9
TT=3600.09

 MSAT (TO)
f=9
TT=3600.01

 MSAT (TO)
f=5
TT=3600.33
T1=793.21
 ? (MO)

TT=78.999
csp/rlfapScens11/
normalized-scen11-f8.xml		 MSAT TO
f=7
TT=3600.32
T1=907.34
 MSAT (TO)
f=11
TT=1636.61
T1=26.8
 MSAT (TO)
f=11
TT=1717.64
T1=25.05
 MSAT (TO)
f=16
TT=3600.06

 MSAT (TO)
f=12
TT=3600.01

 MSAT (TO)
f=7
TT=3600.32
T1=907.34
 ? (MO)

TT=74.464
csp/rlfapScens11/
normalized-scen11-f9.xml		 MSAT TO
f=8
TT=3600.37
T1=944.99
 MSAT (TO)
f=10
TT=1694.1
T1=84.47
 MSAT (TO)
f=10
TT=1690.29
T1=92.21
 MSAT (TO)
f=17
TT=3600

 MSAT (TO)
f=16
TT=3600.09

 MSAT (TO)
f=8
TT=3600.37
T1=944.99
 No Cert.

TT=62.663
csp/rlfapScensMod/
normalized-scen10-w1-f3.xml		 MOPT
f=1
TT=13.866
T1=13.72
 MSAT (TO)
f=2
TT=1641.15
T1=26.02
 MSAT (TO)
f=2
TT=1629.05
T1=23.69
 MSAT (TO)
f=1
TT=3600.05

 MSAT (TO)
f=16
TT=3600.05

 OPTIMUM
f=1
TT=34.622
T1=32.09
 OPTIMUM
f=1
TT=13.866
T1=13.72
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/rlfapScensMod/
normalized-scen1-f9.xml		 MSAT TO
f=2
TT=3600.07

 MSAT (TO)
f=12
TT=1665.15
T1=23.71
 MSAT (TO)
f=12
TT=1655.76
T1=23.82
 MSAT (TO)
f=2
TT=3600.07

 MSAT (TO)
f=11
TT=3600.04

 ? (MO)

TT=106.284

 ? (MO)

TT=105.846
csp/rlfapScensMod/
normalized-scen2-f25.xml		 MOPT
f=2
TT=12.633
T1=1.45
 MSAT (TO)
f=2
TT=1619.84
T1=1.45
 MSAT (TO)
f=2
TT=1611.21
T1=1.45
 MSAT (TO)
f=2
TT=3600.01

 MSAT (TO)
f=2
TT=3600.08

 OPTIMUM
f=2
TT=36.193
T1=35.86
 OPTIMUM
f=2
TT=12.633
T1=11.96
csp/rlfapScensMod/
normalized-scen3-f11.xml		 MOPT
f=1
TT=43.828
T1=43.21
 MSAT (TO)
f=12
TT=1626.71
T1=26.99
 MSAT (TO)
f=12
TT=1638.22
T1=29.2
 MSAT (TO)
f=3
TT=3600.04

 MSAT (TO)
f=11
TT=3600.03

 OPTIMUM
f=1
TT=352.936
T1=326.68
 OPTIMUM
f=1
TT=43.828
T1=43.21
csp/rlfapScensMod/
normalized-scen6-w1-f2.xml		 MOPT
f=1
TT=4.304
T1=4.03
 MSAT (TO)
f=1
TT=1617.13
T1=18.12
 MSAT (TO)
f=1
TT=1603.89
T1=16.67
 MSAT (TO)
f=1
TT=3600.03

 MSAT (TO)
f=1
TT=3600.01

 OPTIMUM
f=1
TT=5.336
T1=5.07
 OPTIMUM
f=1
TT=4.304
T1=4.03
csp/rlfapScensMod/
normalized-scen9-w1-f3.xml		 MOPT
f=1
TT=13.489
T1=13
 MSAT (TO)
f=2
TT=1649.06
T1=25.53
 MSAT (TO)
f=2
TT=1647.91
T1=23.75
 MSAT (TO)
f=1
TT=3600.05

 MSAT (TO)
f=15
TT=3600.06

 OPTIMUM
f=1
TT=34.263
T1=31.46
 OPTIMUM
f=1
TT=13.489
T1=13
csp/rlfapScens/
normalized-scen10.xml		 MSAT TO
f=67
TT=3600.03

 MSAT (TO)
f=115
TT=1656.96
T1=37.71
 MSAT (TO)
f=115
TT=1672.94
T1=37.32
 MSAT (TO)
f=67
TT=3600.03

 MSAT (TO)
f=145
TT=3600.01

 MSAT (TO)
f=196
TT=3600.34
T1=2403.55
 No Cert.

TT=110.572
csp/rlfapScens/
normalized-scen6.xml		 MSAT TO
f=29
TT=3600.06

 MSAT (TO)
f=32
TT=1637.34
T1=62
 MSAT (TO)
f=32
TT=1666.97
T1=67.46
 MSAT (TO)
f=29
TT=3600.06

 MSAT (TO)
f=37
TT=3600.05

 MSAT (TO)
f=56
TT=3600.03
T1=56.55
 MSAT (TO)
f=95
TT=3600.13
T1=376.79
csp/rlfapScens/
normalized-scen7.xml		 MSAT TO
f=56
TT=3600.08

 MSAT (TO)
f=111
TT=1653.32
T1=34.43
 MSAT (TO)
f=111
TT=1632.26
T1=34.04
 MSAT (TO)
f=56
TT=3600.08

 MSAT (TO)
f=79
TT=3600.01

 MSAT (TO)
f=452
TT=3600.18
T1=170.78
 MSAT (TO)
f=268
TT=3600.31
T1=3377.31
csp/rlfapScens/
normalized-scen8.xml		 MSAT TO
f=139
TT=3600.07

 MSAT (TO)
f=255
TT=1706.5
T1=110.9
 MSAT (TO)
f=255
TT=1726.94
T1=116.27
 MSAT (TO)
f=139
TT=3600.07

 MSAT (TO)
f=222
TT=3600.04

 ? (MO)

TT=108.56

 ? (MO)

TT=104.53
csp/rlfapScens/
normalized-scen9.xml		 MSAT TO
f=68
TT=3600.06

 MSAT (TO)
f=115
TT=1658.44
T1=39.75
 MSAT (TO)
f=115
TT=1697.32
T1=37.1
 MSAT (TO)
f=68
TT=3600.06

 MSAT (TO)
f=141
TT=3600.01

 MSAT (TO)
f=196
TT=3600.34
T1=2401.11
 MSAT (MO)
f=842
TT=116.646
T1=104.71
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/subs/
normalized-scen06-sub0.xml		 MOPT
f=6
TT=4.252
T1=1.26
 MSAT (TO)
f=6
TT=1589.1
T1=1.26
 MSAT (TO)
f=6
TT=1608.99
T1=1.38
 MSAT (TO)
f=6
TT=3600.03

 MSAT (TO)
f=6
TT=3600.1

 OPTIMUM
f=6
TT=5.627
T1=5.42
 OPTIMUM
f=6
TT=4.252
T1=4.15
csp/subs/
normalized-scen06-sub1.xml		 MSAT TO
f=21
TT=1662.53
T1=60.25
 MSAT (TO)
f=21
TT=1662.53
T1=60.25
 MSAT (TO)
f=22
TT=1622.44
T1=32.68
 MSAT (TO)
f=21
TT=3600.01

 MSAT (TO)
f=21
TT=3600.06

 MSAT (TO)
f=38
TT=3600.03
T1=3.9
 MSAT (TO)
f=34
TT=3600.09
T1=742.91
csp/subs/
normalized-scen06-sub2.xml		 MSAT TO
f=21
TT=1612.19
T1=31.77
 MSAT (TO)
f=22
TT=1569.84
T1=1.95
 MSAT (TO)
f=21
TT=1612.19
T1=31.77
 MSAT (TO)
f=21
TT=3600.04

 MSAT (TO)
f=21
TT=3600.01

 MSAT (TO)
f=41
TT=3600.04
T1=14.61
 MSAT (TO)
f=49
TT=3600.12
T1=1344.53
csp/subs/
normalized-scen06-sub3.xml		 MSAT TO
f=23
TT=3600.07

 MSAT (TO)
f=24
TT=1606.38
T1=1.75
 MSAT (TO)
f=24
TT=1595.32
T1=1.67
 MSAT (TO)
f=23
TT=3600.07

 MSAT (TO)
f=23
TT=3600.1

 MSAT (TO)
f=35
TT=3600.05
T1=1543.04
 MSAT (TO)
f=27
TT=3600.12
T1=685.62
csp/subs/
normalized-scen06-sub4.xml		 MSAT TO
f=23
TT=3600.04

 MSAT (TO)
f=27
TT=1615.65
T1=2.07
 MSAT (TO)
f=27
TT=1594.05
T1=2.06
 MSAT (TO)
f=23
TT=3600.04

 MSAT (TO)
f=23
TT=3600.04

 MSAT (TO)
f=26
TT=3600.03
T1=240.46
 MSAT (TO)
f=52
TT=3600.1
T1=366.18
csp/subs/
normalized-scen07-sub1.xml		 MSAT TO
f=17
TT=1595.52
T1=4.44
 MSAT (TO)
f=17
TT=1595.99
T1=4.44
 MSAT (TO)
f=17
TT=1595.52
T1=4.54
 MSAT (TO)
f=17
TT=3600.04

 MSAT (TO)
f=17
TT=3600.06

 MSAT (TO)
f=17
TT=3600.09
T1=3575.85
 MSAT (TO)
f=17
TT=3600.11
T1=2183.28
csp/subs/
normalized-scen07-sub2.xml		 MOPT
f=17
TT=3368.59
T1=9.16
 MSAT (TO)
f=17
TT=1598.76
T1=9.2
 MSAT (TO)
f=17
TT=1618.12
T1=9.16
 MSAT (TO)
f=17
TT=3600.02

 MSAT (TO)
f=17
TT=3600.02

 OPTIMUM
f=17
TT=3368.59
T1=783.79
 MSAT (TO)
f=17
TT=3600.05
T1=1508.13
csp/subs/
normalized-scen07-sub3.xml		 MSAT TO
f=19
TT=1609.48
T1=46.24
 MSAT (TO)
f=19
TT=1609.48
T1=46.73
 MSAT (TO)
f=19
TT=1625.17
T1=46.24
 MSAT (TO)
f=19
TT=3600.03

 MSAT (TO)
f=19
TT=3600.09

 MSAT (TO)
f=22
TT=3600.09
T1=2844.3
 MSAT (TO)
f=28
TT=3600.12
T1=4.64
csp/subs/
normalized-scen07-sub4.xml		 MSAT TO
f=19
TT=1607.5
T1=10.22
 MSAT (TO)
f=19
TT=1607.5
T1=10.22
 MSAT (TO)
f=19
TT=1618.06
T1=10.98
 MSAT (TO)
f=19
TT=3600.03

 MSAT (TO)
f=19
TT=3600.03

 MSAT (TO)
f=36
TT=3600.08
T1=5.85
 MSAT (TO)
f=29
TT=3600.08
T1=678.58
csp/super-js/super-js-taillard-15/
normalized-super-js-taillard-15-22.xml		 MSAT TO
f=51
TT=3600.03

 ?

TT=306.456

 ?

TT=327.093

 MSAT (TO)
f=51
TT=3600.03

 MSAT (TO)
f=85
TT=3600

 ? (MO)

TT=119.508

 ? (MO)

TT=113.873
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/super-js/super-js-taillard-15/
normalized-super-js-taillard-15-23.xml		 MSAT TO
f=48
TT=3600.08

 ?

TT=207.608

 ?

TT=232.194

 MSAT (TO)
f=48
TT=3600.08

 MSAT (TO)
f=82
TT=3600.04

 ? (MO)

TT=113.024

 ? (MO)

TT=116.238
csp/super-js/super-js-taillard-15/
normalized-super-js-taillard-15-30.xml		 MSAT TO
f=51
TT=3600.02

 ?

TT=445.473

 ?

TT=447.505

 MSAT (TO)
f=51
TT=3600.02

 MSAT (TO)
f=91
TT=3600.04

 ? (MO)

TT=334.809

 ? (MO)

TT=122.076
csp/super-js/super-js-taillard-20-15/
normalized-super-js-taillard-20-15-24.xml		 MSAT TO
f=89
TT=3600.07

 ?

TT=708.489

 ?

TT=693.797

 MSAT (TO)
f=89
TT=3600.07

 MSAT (TO)
f=141
TT=3600.08

 ?

TT=189.931

 ?

TT=190.403
csp/super-os/super-os-taillard-10/
normalized-super-os-taillard-10-24.xml		 MSAT TO
f=33
TT=3600.03

 ?

TT=149.672

 ?

TT=141.502

 MSAT (TO)
f=33
TT=3600.03

 MSAT (TO)
f=36
TT=3600.06

 MSAT (TO)
f=85
TT=3600.21
T1=160.21
 MSAT (TO)
f=120
TT=3600.33
T1=49.77
csp/super-os/super-os-taillard-15/
normalized-super-os-taillard-15-27.xml		 MSAT TO
f=56
TT=3600.03

 ?

TT=290.6

 ?

TT=276.361

 MSAT (TO)
f=56
TT=3600.03

 MSAT (TO)
f=58
TT=3600.09

 ?

TT=189.717

 ?

TT=194.978
csp/super-os/super-os-taillard-20/
normalized-super-os-taillard-20-27.xml		 MSAT TO
f=90
TT=3600.07

 ?

TT=154.219

 ?

TT=157.916

 MSAT (TO)
f=90
TT=3600.07

 MSAT (TO)
f=118
TT=3600.08

 ?

TT=227.641

 ?

TT=233.794
csp/super-os/super-os-taillard-20/
normalized-super-os-taillard-20-29.xml		 MSAT TO
f=94
TT=3600.03

 ?

TT=158.444

 ?

TT=171.015

 MSAT (TO)
f=94
TT=3600.03

 MSAT (TO)
f=115
TT=3600.02

 ?

TT=258.421

 ?

TT=246.549
csp/super-os/super-os-taillard-4/
normalized-super-os-taillard-4-5.xml		 MOPT
f=3
TT=13.353
T1=3.02
 MSAT (TO)
f=3
TT=1604.27
T1=3.02
 MSAT (TO)
f=3
TT=1581.49
T1=3.35
 MSAT (TO)
f=3
TT=3600.09

 MSAT (TO)
f=3
TT=3600.07

 OPTIMUM
f=3
TT=16.269
T1=16.1
 OPTIMUM
f=3
TT=13.353
T1=13.24
csp/super-os/super-os-taillard-4/
normalized-super-os-taillard-4-8.xml		 MOPT
f=3
TT=9.747
T1=1.56
 MSAT (TO)
f=3
TT=1608.58
T1=1.56
 MSAT (TO)
f=3
TT=1609.31
T1=1.67
 MSAT (TO)
f=3
TT=3600.09

 MSAT (TO)
f=3
TT=3600.05

 OPTIMUM
f=3
TT=9.747
T1=9.54
 OPTIMUM
f=3
TT=13.393
T1=13.2
csp/super-os/super-os-taillard-5/
normalized-super-os-taillard-5-1.xml		 MOPT
f=3
TT=411.296
T1=411.02
 MSAT (TO)
f=6
TT=1597.51
T1=8.23
 MSAT (TO)
f=6
TT=1611.68
T1=8.39
 MSAT (TO)
f=3
TT=3600.06

 MSAT (TO)
f=6
TT=3600.02

 OPTIMUM
f=3
TT=428.101
T1=427.88
 OPTIMUM
f=3
TT=411.296
T1=411.02
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/super-os/super-os-taillard-5/
normalized-super-os-taillard-5-21.xml		 MSAT TO
f=11
TT=3600.04

 MSAT (TO)
f=12
TT=1613.36
T1=31.31
 MSAT (TO)
f=12
TT=1640.1
T1=28.55
 MSAT (TO)
f=11
TT=3600.04

 MSAT (TO)
f=12
TT=3600.01

 MSAT (TO)
f=16
TT=3600.1
T1=48.39
 MSAT (TO)
f=14
TT=3600.12
T1=11.08
csp/super-os/super-os-taillard-5/
normalized-super-os-taillard-5-4.xml		 MSAT TO
f=3
TT=3600.09
T1=2503.36
 MSAT (TO)
f=7
TT=1600.46
T1=8.68
 MSAT (TO)
f=7
TT=1601.87
T1=8.95
 MSAT (TO)
f=9
TT=3600.07

 MSAT (TO)
f=12
TT=3600.09

 MSAT (TO)
f=4
TT=3600.06
T1=534.46
 MSAT (TO)
f=3
TT=3600.09
T1=2503.36
csp/super-os/super-os-taillard-5/
normalized-super-os-taillard-5-5.xml		 MSAT TO
f=3
TT=3600.02
T1=2917.04
 MSAT (TO)
f=11
TT=1602.96
T1=10.78
 MSAT (TO)
f=11
TT=1615.08
T1=9.83
 MSAT (TO)
f=6
TT=3600.07

 MSAT (TO)
f=9
TT=3600.02

 MSAT (TO)
f=3
TT=3600.02
T1=2917.04
 MSAT (TO)
f=3
TT=3600.1
T1=3591.6
csp/super-os/super-os-taillard-5/
normalized-super-os-taillard-5-7.xml		 MOPT
f=3
TT=645.598
T1=645.39
 MSAT (TO)
f=6
TT=1596.08
T1=3.22
 MSAT (TO)
f=6
TT=1625.03
T1=3.54
 MSAT (TO)
f=3
TT=3600.02

 MSAT (TO)
f=9
TT=3600.02

 OPTIMUM
f=3
TT=645.598
T1=645.39
 OPTIMUM
f=3
TT=702.724
T1=702.46
csp/super-os/super-os-taillard-7/
normalized-super-os-taillard-7-2.xml		 MSAT TO
f=5
TT=3600.08
T1=1040.23
 MSAT (TO)
f=13
TT=1679.33
T1=43.87
 MSAT (TO)
f=13
TT=1633.18
T1=38.14
 MSAT (TO)
f=15
TT=3600.08

 MSAT (TO)
f=21
TT=3600.02

 MSAT (TO)
f=5
TT=3600.08
T1=1040.23
 MSAT (TO)
f=5
TT=3600.2
T1=1123.98
csp/super-os/super-os-taillard-7/
normalized-super-os-taillard-7-30.xml		 MSAT TO
f=16
TT=3600.18
T1=3462.2
 MSAT (TO)
f=18
TT=1650.07
T1=42.36
 MSAT (TO)
f=18
TT=1659.66
T1=45.14
 MSAT (TO)
f=22
TT=3600

 MSAT (TO)
f=25
TT=3600.06

 MSAT (TO)
f=44
TT=3600.03
T1=48.19
 MSAT (TO)
f=16
TT=3600.18
T1=3462.2
csp/super-queens/
normalized-super-queens-11.xml		 MOPT
f=3
TT=0.944
T1=0.55
 OPTIMUM
f=3
TT=31.026
T1=0.68
CHECKS=4156
NODES=45
 OPTIMUM
f=3
TT=30.891
T1=0.55
CHECKS=5915
NODES=63
 MSAT (TO)
f=3
TT=3600.03

 MSAT (TO)
f=3
TT=3600.05

 OPTIMUM
f=3
TT=0.946
T1=0.82
 OPTIMUM
f=3
TT=0.944
T1=0.8
csp/super-queens/
normalized-super-queens-13.xml		 MOPT
f=4
TT=34.546
T1=0.62
 MSAT (TO)
f=4
TT=1591.9
T1=0.62
 OPTIMUM
f=4
TT=638.256
T1=0.67
CHECKS=33327100
NODES=75122
 MSAT (TO)
f=4
TT=3600.1

 MSAT (TO)
f=4
TT=3600.01

 OPTIMUM
f=4
TT=34.546
T1=9.45
 OPTIMUM
f=4
TT=45.132
T1=6.33
csp/super-queens/
normalized-super-queens-1.xml		 MOPT
f=4
TT=3088.74
T1=0.78
 MSAT (TO)
f=4
TT=1609.14
T1=0.78
 MSAT (TO)
f=4
TT=1601.3
T1=0.88
 MSAT (TO)
f=4
TT=3600.08

 MSAT (TO)
f=4
TT=3600.1

 OPTIMUM
f=4
TT=3088.74
T1=86.01
 OPTIMUM
f=4
TT=3564.83
T1=3564.64
csp/super-queens/
normalized-super-queens-2.xml		 MSAT TO
f=11
TT=1696.76
T1=97.29
 MSAT (TO)
f=11
TT=1714.73
T1=97.29
 MSAT (TO)
f=11
TT=1696.76
T1=104.87
 MSAT (TO)
f=12
TT=3600

 MSAT (TO)
f=20
TT=3600.06

 ?

TT=199.651

 ?

TT=198.342
Bench nameBest results
on this
instance		AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
csp/super-queens/
normalized-super-queens-3.xml		 MSAT TO
f=4
TT=1594.97
T1=1.15
 MSAT (TO)
f=4
TT=1598.14
T1=1.15
 MSAT (TO)
f=4
TT=1594.97
T1=1.19
 MSAT (TO)
f=4
TT=3600.03

 MSAT (TO)
f=4
TT=3600.01

 MSAT (TO)
f=6
TT=3600.06
T1=4.1
 MSAT (TO)
f=6
TT=3600.08
T1=3.56
csp/super-queens/
normalized-super-queens-4.xml		 MSAT TO
f=13
TT=3600.03

 MSAT (TO)
f=17
TT=1754.12
T1=162.35
 MSAT (TO)
f=17
TT=1742.28
T1=161.93
 MSAT (TO)
f=13
TT=3600.03

 MSAT (TO)
f=29
TT=3600.09

 ?

TT=286.988

 ?

TT=279.495
csp/super-queens/
normalized-super-queens-5.xml		 MSAT TO
f=3
TT=3600.03

 MSAT (TO)
f=4
TT=1598.08
T1=2.85
 MSAT (TO)
f=4
TT=1603.85
T1=3.05
 MSAT (TO)
f=3
TT=3600.09

 MSAT (TO)
f=3
TT=3600.03

 MSAT (TO)
f=5
TT=3600.04
T1=223.42
 MSAT (TO)
f=4
TT=3600.12
T1=1972.87
csp/super-queens/
normalized-super-queens-6.xml		 MSAT TO
f=16
TT=3600.08

 MSAT (TO)
f=68
TT=1686.98
T1=1686.93
 MSAT (TO)
f=86
TT=1733.27
T1=34.1
 MSAT (TO)
f=16
TT=3600.08

 MSAT (TO)
f=34
TT=3600.06

 ?

TT=202.593

 ?

TT=191.837
csp/super-queens/
normalized-super-queens-7.xml		 MSAT TO
f=22
TT=3600.06

 ?

TT=114.449

 ?

TT=120.974

 MSAT (TO)
f=22
TT=3600.06

 MSAT (TO)
f=41
TT=3600.1

 ?

TT=188.897

 ?

TT=192.826
csp/super-queens/
normalized-super-queens-8.xml		 MSAT TO
f=4
TT=1600.71
T1=2.87
 MSAT (TO)
f=4
TT=1600.71
T1=3.26
 MSAT (TO)
f=4
TT=1617.93
T1=2.87
 MSAT (TO)
f=4
TT=3600.04

 MSAT (TO)
f=4
TT=3600.05

 MSAT (TO)
f=9
TT=3600.02
T1=274.75
 MSAT (TO)
f=9
TT=3600.07
T1=113.11

Some statistics...

AbsconMax 112
pc-d		AbsconMax 112
pc-w		Concrete + CSP4J - MCRW Engine
2008-05-30		Concrete + CSP4J - Tabu Engine
2008-05-30		Sugar
v1.13+minisat		Sugar++
v1.13+minisat-inc
Number of times the solver is able to give the best known answer697413471127119
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)109112214145128120
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)133394384574
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)5945002142