MAX-CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory boolean problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory boolean problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance
textthe solver was ended by a signal
textthe solver gave an incomplete answer
textthe solver was disqualified in the category
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
AbsconMax 112 pc-d
AbsconMax 112 pc-w
Concrete + CSP4J - MCRW Engine 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Sugar v1.13+minisat
Sugar++ v1.13+minisat-inc
toulbar2 2008-06-27
toulbar2/BTD 2008-06-27

Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/aim-100/
normalized-aim-100-1-6-unsat-1_ext.xml
MOPT
f=1
TT=1.798
T1=0
MSAT (TO)
f=1
TT=3600.09
T1=0.58
OPTIMUM
f=1
TT=32.483
T1=0.49
CHECKS=277652
NODES=15461
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.1

OPTIMUM
f=1
TT=1.96
T1=1.79
OPTIMUM
f=1
TT=1.798
T1=1.61
OPTIMUM
f=1
TT=1.248
T1=0
OPTIMUM
f=1
TT=2.029
T1=0
csp/aim-100/
normalized-aim-100-1-6-unsat-2_ext.xml
MOPT
f=1
TT=0.275
T1=0.01
MSAT (TO)
f=1
TT=3275.47
T1=0.59
OPTIMUM
f=1
TT=32.974
T1=0.57
CHECKS=355827
NODES=18441
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=2.085
T1=1.89
OPTIMUM
f=1
TT=1.943
T1=1.87
OPTIMUM
f=1
TT=0.44
T1=0
OPTIMUM
f=1
TT=0.275
T1=0.01
csp/aim-100/
normalized-aim-100-1-6-unsat-3_ext.xml
MOPT
f=1
TT=1.859
T1=0.01
MSAT (TO)
f=1
TT=3600.08
T1=0.58
OPTIMUM
f=1
TT=38.019
T1=0.57
CHECKS=1555030
NODES=69058
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=1.982
T1=1.88
OPTIMUM
f=1
TT=1.859
T1=1.67
OPTIMUM
f=1
TT=6.363
T1=0.09
OPTIMUM
f=1
TT=7.666
T1=0.01
csp/aim-100/
normalized-aim-100-1-6-unsat-4_ext.xml
MOPT
f=1
TT=1.709
T1=0.02
MSAT (TO)
f=1
TT=3472.06
T1=0.58
OPTIMUM
f=1
TT=36.059
T1=0.57
CHECKS=821121
NODES=40404
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.05

OPTIMUM
f=1
TT=1.997
T1=1.86
OPTIMUM
f=1
TT=1.975
T1=1.86
OPTIMUM
f=1
TT=1.084
T1=0
OPTIMUM
f=1
TT=1.709
T1=0.02
csp/aim-100/
normalized-aim-100-2-0-unsat-1_ext.xml
MOPT
f=1
TT=1.689
T1=0.02
MSAT (TO)
f=1
TT=3600.1
T1=0.62
OPTIMUM
f=1
TT=31.201
T1=0.58
CHECKS=29274
NODES=1841
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=2.485
T1=2.25
OPTIMUM
f=1
TT=2.274
T1=2.08
OPTIMUM
f=1
TT=0.601
T1=0
OPTIMUM
f=1
TT=1.689
T1=0.02
csp/aim-100/
normalized-aim-100-2-0-unsat-2_ext.xml
MOPT
f=1
TT=1.988
T1=0.01
MSAT (TO)
f=1
TT=3600.09
T1=0.58
OPTIMUM
f=1
TT=31.894
T1=0.58
CHECKS=126742
NODES=6833
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=2.397
T1=2.15
OPTIMUM
f=1
TT=1.988
T1=1.8
OPTIMUM
f=1
TT=3.662
T1=0
OPTIMUM
f=1
TT=4.401
T1=0.01
csp/aim-100/
normalized-aim-100-2-0-unsat-3_ext.xml
MOPT
f=1
TT=1.671
T1=0.03
MSAT (TO)
f=1
TT=3584.45
T1=0.58
OPTIMUM
f=1
TT=32.625
T1=0.68
CHECKS=408221
NODES=15529
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.02

OPTIMUM
f=1
TT=2.426
T1=2.2
OPTIMUM
f=1
TT=2.394
T1=2.21
OPTIMUM
f=1
TT=2.964
T1=0
OPTIMUM
f=1
TT=1.671
T1=0.03
csp/aim-100/
normalized-aim-100-2-0-unsat-4_ext.xml
MOPT
f=1
TT=1.583
T1=0.02
MSAT (TO)
f=1
TT=3600.13
T1=0.58
OPTIMUM
f=1
TT=31.759
T1=0.56
CHECKS=198401
NODES=8471
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=1.823
T1=1.6
OPTIMUM
f=1
TT=1.583
T1=1.4
OPTIMUM
f=1
TT=2.339
T1=0
OPTIMUM
f=1
TT=1.86
T1=0.02
csp/aim-200/
normalized-aim-200-1-6-unsat-1_ext.xml
MOPT
f=1
TT=3.12
T1=0.04
MSAT (TO)
f=1
TT=3600.07
T1=0.57
OPTIMUM
f=1
TT=43.71
T1=0.67
CHECKS=1226560
NODES=58581
MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=1
TT=3600

OPTIMUM
f=1
TT=4.128
T1=3.9
OPTIMUM
f=1
TT=3.12
T1=2.89
OPTIMUM
f=1
TT=24.402
T1=0
OPTIMUM
f=1
TT=44.179
T1=0.04
csp/aim-200/
normalized-aim-200-1-6-unsat-2_ext.xml
MOPT
f=1
TT=3.073
T1=0.61
MSAT (TO)
f=1
TT=3600.04
T1=0.61
OPTIMUM
f=1
TT=1437.77
T1=0.65
CHECKS=303344000
NODES=9609300
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.08

OPTIMUM
f=1
TT=4.002
T1=3.63
OPTIMUM
f=1
TT=3.073
T1=2.9
? (TO)

TT=3600.03

? (TO)
f=1
TT=3600.09
T1=0.97
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/aim-200/
normalized-aim-200-1-6-unsat-3_ext.xml
MOPT
f=1
TT=2.788
T1=0.03
MSAT (TO)
f=1
TT=3600.1
T1=0.69
OPTIMUM
f=1
TT=2486.51
T1=0.68
CHECKS=573478000
NODES=15444300
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=3.397
T1=3.08
OPTIMUM
f=1
TT=2.788
T1=2.57
OPTIMUM
f=1
TT=783.953
T1=11.89
OPTIMUM
f=1
TT=258.687
T1=0.03
csp/aim-200/
normalized-aim-200-1-6-unsat-4_ext.xml
MOPT
f=1
TT=3.043
T1=0.04
MSAT (TO)
f=1
TT=3600.04
T1=0.59
OPTIMUM
f=1
TT=35.38
T1=0.67
CHECKS=366488
NODES=19645
MSAT (TO)
f=1
TT=3600

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=3.942
T1=3.61
OPTIMUM
f=1
TT=3.043
T1=2.77
OPTIMUM
f=1
TT=462.184
T1=0
OPTIMUM
f=1
TT=613.418
T1=0.04
csp/aim-200/
normalized-aim-200-2-0-unsat-1_ext.xml
MOPT
f=1
TT=3.177
T1=0.59
MSAT (TO)
f=1
TT=3600.15
T1=0.59
OPTIMUM
f=1
TT=45.585
T1=0.65
CHECKS=1472460
NODES=65282
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=4.865
T1=4.48
OPTIMUM
f=1
TT=3.177
T1=2.95
OPTIMUM
f=1
TT=303.014
T1=0
OPTIMUM
f=1
TT=324.894
T1=0.97
csp/aim-200/
normalized-aim-200-2-0-unsat-2_ext.xml
MOPT
f=1
TT=2.541
T1=0.58
MSAT (TO)
f=1
TT=3600.05
T1=0.58
OPTIMUM
f=1
TT=43.411
T1=0.68
CHECKS=1226880
NODES=49415
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.04

OPTIMUM
f=1
TT=3.221
T1=2.92
OPTIMUM
f=1
TT=2.541
T1=2.31
OPTIMUM
f=1
TT=426.483
T1=0
OPTIMUM
f=1
TT=1531.4
T1=1.16
csp/aim-200/
normalized-aim-200-2-0-unsat-3_ext.xml
MOPT
f=1
TT=3.674
T1=0.77
MSAT (TO)
f=1
TT=3600.1
T1=0.77
OPTIMUM
f=1
TT=33.373
T1=0.78
CHECKS=170226
NODES=9484
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=4.891
T1=4.49
OPTIMUM
f=1
TT=3.674
T1=3.45
OPTIMUM
f=1
TT=72.194
T1=0
OPTIMUM
f=1
TT=263.636
T1=1.07
csp/aim-200/
normalized-aim-200-2-0-unsat-4_ext.xml
MOPT
f=1
TT=3.348
T1=0.05
MSAT (TO)
f=1
TT=3600.09
T1=0.58
OPTIMUM
f=1
TT=38.91
T1=0.77
CHECKS=648852
NODES=29753
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=4.997
T1=4.54
OPTIMUM
f=1
TT=3.348
T1=3.12
OPTIMUM
f=1
TT=24.864
T1=0
OPTIMUM
f=1
TT=39.462
T1=0.05
csp/aim-50/
normalized-aim-50-1-6-unsat-1_ext.xml
MOPT
f=1
TT=0.044
T1=0
OPTIMUM
f=1
TT=32.973
T1=0.48
CHECKS=793173
NODES=39673
OPTIMUM
f=1
TT=30.839
T1=0.48
CHECKS=11415
NODES=742
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.11

OPTIMUM
f=1
TT=1.329
T1=1.17
OPTIMUM
f=1
TT=1.402
T1=1.25
OPTIMUM
f=1
TT=0.022
T1=0
OPTIMUM
f=1
TT=0.044
T1=0
csp/aim-50/
normalized-aim-50-1-6-unsat-2_ext.xml
MOPT
f=1
TT=0.184
T1=0
OPTIMUM
f=1
TT=34.002
T1=0.49
CHECKS=1926450
NODES=75711
OPTIMUM
f=1
TT=31.036
T1=0.48
CHECKS=44955
NODES=2642
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=1.356
T1=1.18
OPTIMUM
f=1
TT=1.312
T1=1.14
OPTIMUM
f=1
TT=0.157
T1=0
OPTIMUM
f=1
TT=0.184
T1=0
csp/aim-50/
normalized-aim-50-1-6-unsat-3_ext.xml
MOPT
f=1
TT=0.064
T1=0
OPTIMUM
f=1
TT=30.793
T1=0.49
CHECKS=11924
NODES=803
OPTIMUM
f=1
TT=30.919
T1=0.49
CHECKS=11455
NODES=782
MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=1.496
T1=1.33
OPTIMUM
f=1
TT=1.438
T1=1.27
OPTIMUM
f=1
TT=0.029
T1=0
OPTIMUM
f=1
TT=0.064
T1=0
csp/aim-50/
normalized-aim-50-1-6-unsat-4_ext.xml
MOPT
f=1
TT=0.044
T1=0
OPTIMUM
f=1
TT=36.364
T1=0.5
CHECKS=4157170
NODES=136597
OPTIMUM
f=1
TT=30.87
T1=0.48
CHECKS=5940
NODES=452
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=1.459
T1=1.3
OPTIMUM
f=1
TT=1.448
T1=1.29
OPTIMUM
f=1
TT=0.017
T1=0
OPTIMUM
f=1
TT=0.044
T1=0
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/aim-50/
normalized-aim-50-2-0-unsat-1_ext.xml
MOPT
f=1
TT=0.059
T1=0
OPTIMUM
f=1
TT=43.747
T1=0.49
CHECKS=8432010
NODES=284390
OPTIMUM
f=1
TT=30.932
T1=0.48
CHECKS=24849
NODES=1332
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.05

OPTIMUM
f=1
TT=1.775
T1=1.61
OPTIMUM
f=1
TT=1.496
T1=1.33
OPTIMUM
f=1
TT=0.026
T1=0
OPTIMUM
f=1
TT=0.059
T1=0
csp/aim-50/
normalized-aim-50-2-0-unsat-2_ext.xml
MOPT
f=1
TT=0.111
T1=0
OPTIMUM
f=1
TT=33.113
T1=0.56
CHECKS=1044300
NODES=44216
OPTIMUM
f=1
TT=30.827
T1=0.48
CHECKS=17337
NODES=1034
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.08

OPTIMUM
f=1
TT=1.554
T1=1.38
OPTIMUM
f=1
TT=1.506
T1=1.34
OPTIMUM
f=1
TT=0.058
T1=0
OPTIMUM
f=1
TT=0.111
T1=0
csp/aim-50/
normalized-aim-50-2-0-unsat-3_ext.xml
MOPT
f=1
TT=0.113
T1=0
OPTIMUM
f=1
TT=32.906
T1=0.58
CHECKS=1148320
NODES=44348
OPTIMUM
f=1
TT=31.049
T1=0.58
CHECKS=25420
NODES=1462
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=1.556
T1=1.39
OPTIMUM
f=1
TT=1.511
T1=1.34
OPTIMUM
f=1
TT=0.156
T1=0
OPTIMUM
f=1
TT=0.113
T1=0
csp/aim-50/
normalized-aim-50-2-0-unsat-4_ext.xml
MOPT
f=1
TT=0.066
T1=0
OPTIMUM
f=1
TT=32.713
T1=0.48
CHECKS=940733
NODES=30978
OPTIMUM
f=1
TT=30.908
T1=0.47
CHECKS=10606
NODES=600
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=1.573
T1=1.38
OPTIMUM
f=1
TT=1.444
T1=1.27
OPTIMUM
f=1
TT=0.035
T1=0
OPTIMUM
f=1
TT=0.066
T1=0
csp/dubois/
normalized-dubois-100_ext.xml
MOPT
f=1
TT=0.264
T1=0.03
MSAT (TO)
f=1
TT=3600.13
T1=0.58
MSAT (TO)
f=1
TT=3600.11
T1=0.68
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=2.991
T1=2.71
OPTIMUM
f=1
TT=2.624
T1=2.33
? (TO)

TT=3600.05

OPTIMUM
f=1
TT=0.264
T1=0.03
csp/dubois/
normalized-dubois-20_ext.xml
MOPT
f=1
TT=0.04
T1=0
OPTIMUM
f=1
TT=473.914
T1=0.39
CHECKS=343933000
NODES=24117200
OPTIMUM
f=1
TT=439.551
T1=0.48
CHECKS=331908000
NODES=21559200
MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=1.146
T1=0.97
OPTIMUM
f=1
TT=1.126
T1=0.97
OPTIMUM
f=1
TT=0.898
T1=0
OPTIMUM
f=1
TT=0.04
T1=0
csp/dubois/
normalized-dubois-21_ext.xml
MOPT
f=1
TT=0.042
T1=0
OPTIMUM
f=1
TT=1054.95
T1=0.48
CHECKS=744489000
NODES=50331600
OPTIMUM
f=1
TT=898.146
T1=0.48
CHECKS=721697000
NODES=44980600
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=1.224
T1=1.06
OPTIMUM
f=1
TT=1.276
T1=1.1
OPTIMUM
f=1
TT=1.453
T1=0
OPTIMUM
f=1
TT=0.042
T1=0
csp/dubois/
normalized-dubois-22_ext.xml
MOPT
f=1
TT=0.041
T1=0
OPTIMUM
f=1
TT=2144.53
T1=0.47
CHECKS=1606420000
NODES=104858000
OPTIMUM
f=1
TT=1729.86
T1=0.48
CHECKS=1461330000
NODES=87480400
MSAT (TO)
f=1
TT=3600.01

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=1.22
T1=1.06
OPTIMUM
f=1
TT=1.289
T1=1.13
OPTIMUM
f=1
TT=2.32
T1=0
OPTIMUM
f=1
TT=0.041
T1=0
csp/dubois/
normalized-dubois-23_ext.xml
MOPT
f=1
TT=0.043
T1=0
MSAT (TO)
f=1
TT=3600.09
T1=0.58
MSAT (TO)
f=1
TT=3600.1
T1=0.48
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.11

OPTIMUM
f=1
TT=1.25
T1=1.09
OPTIMUM
f=1
TT=1.239
T1=1.08
OPTIMUM
f=1
TT=3.795
T1=0
OPTIMUM
f=1
TT=0.043
T1=0
csp/dubois/
normalized-dubois-24_ext.xml
MOPT
f=1
TT=0.045
T1=0
MSAT (TO)
f=1
TT=3600.11
T1=0.48
MSAT (TO)
f=1
TT=3600.1
T1=0.48
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=1.177
T1=1.02
OPTIMUM
f=1
TT=1.176
T1=1.02
OPTIMUM
f=1
TT=6.06
T1=0
OPTIMUM
f=1
TT=0.045
T1=0
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/dubois/
normalized-dubois-25_ext.xml
MOPT
f=1
TT=0.048
T1=0
MSAT (TO)
f=1
TT=3600.13
T1=0.48
MSAT (TO)
f=1
TT=3600.04
T1=0.51
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=1.263
T1=1.1
OPTIMUM
f=1
TT=1.269
T1=1.1
OPTIMUM
f=1
TT=9.904
T1=0
OPTIMUM
f=1
TT=0.048
T1=0
csp/dubois/
normalized-dubois-26_ext.xml
MOPT
f=1
TT=0.049
T1=0
MSAT (TO)
f=1
TT=3600.1
T1=0.48
MSAT (TO)
f=1
TT=3600.13
T1=0.48
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600

OPTIMUM
f=1
TT=1.202
T1=1.05
OPTIMUM
f=1
TT=1.197
T1=1.06
OPTIMUM
f=1
TT=14.836
T1=0
OPTIMUM
f=1
TT=0.049
T1=0
csp/dubois/
normalized-dubois-27_ext.xml
MOPT
f=1
TT=0.05
T1=0
MSAT (TO)
f=1
TT=3600.11
T1=0.48
MSAT (TO)
f=1
TT=3600.14
T1=0.49
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.1

OPTIMUM
f=1
TT=1.324
T1=1.12
OPTIMUM
f=1
TT=1.292
T1=1.12
OPTIMUM
f=1
TT=25.799
T1=0
OPTIMUM
f=1
TT=0.05
T1=0
csp/dubois/
normalized-dubois-28_ext.xml
MOPT
f=1
TT=0.051
T1=0
MSAT (TO)
f=1
TT=3600.1
T1=0.48
MSAT (TO)
f=1
TT=3600.09
T1=0.46
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=1.304
T1=1.13
OPTIMUM
f=1
TT=1.293
T1=1.13
OPTIMUM
f=1
TT=41.836
T1=0
OPTIMUM
f=1
TT=0.051
T1=0
csp/dubois/
normalized-dubois-29_ext.xml
MOPT
f=1
TT=0.053
T1=0
MSAT (TO)
f=1
TT=3600.13
T1=0.48
MSAT (TO)
f=1
TT=3600.08
T1=0.49
MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.08

OPTIMUM
f=1
TT=1.238
T1=1.07
OPTIMUM
f=1
TT=1.244
T1=1.08
OPTIMUM
f=1
TT=62.776
T1=0
OPTIMUM
f=1
TT=0.053
T1=0
csp/dubois/
normalized-dubois-30_ext.xml
MOPT
f=1
TT=0.055
T1=0
MSAT (TO)
f=1
TT=3600.09
T1=0.57
MSAT (TO)
f=1
TT=3600.13
T1=0.49
MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=1.323
T1=1.15
OPTIMUM
f=1
TT=1.33
T1=1.16
OPTIMUM
f=1
TT=109.574
T1=0
OPTIMUM
f=1
TT=0.055
T1=0
csp/dubois/
normalized-dubois-50_ext.xml
MOPT
f=1
TT=0.097
T1=0.01
MSAT (TO)
f=1
TT=3600.14
T1=0.57
MSAT (TO)
f=1
TT=3600.12
T1=0.58
MSAT (TO)
f=1
TT=3600.05

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=1.745
T1=1.53
OPTIMUM
f=1
TT=1.69
T1=1.51
? (TO)

TT=3600.01

OPTIMUM
f=1
TT=0.097
T1=0.01
csp/jnhUnsat/
normalized-jnh02_ext.xml
MOPT
f=1
TT=6.801
T1=1.17
OPTIMUM
f=1
TT=34.141
T1=1.27
CHECKS=193643
NODES=3277
OPTIMUM
f=1
TT=32.153
T1=1.17
CHECKS=33182
NODES=462
MSAT (TO)
f=1
TT=3600

MSAT (TO)
f=1
TT=3600.04

OPTIMUM
f=1
TT=16.438
T1=14.92
OPTIMUM
f=1
TT=6.801
T1=6.52
OPTIMUM
f=1
TT=634.872
T1=634.72
OPTIMUM
f=1
TT=399.335
T1=399.18
csp/jnhUnsat/
normalized-jnh04_ext.xml
MOPT
f=1
TT=6.284
T1=2.76
OPTIMUM
f=1
TT=37.88
T1=2.76
CHECKS=584531
NODES=9694
OPTIMUM
f=1
TT=35.597
T1=3.15
CHECKS=149243
NODES=1678
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=16.814
T1=15.49
OPTIMUM
f=1
TT=6.284
T1=6.01
OPTIMUM
f=1
TT=374.24
T1=373.82
OPTIMUM
f=1
TT=355.704
T1=355.39
csp/jnhUnsat/
normalized-jnh06_ext.xml
MOPT
f=1
TT=6.794
T1=0.75
OPTIMUM
f=1
TT=45.314
T1=0.75
CHECKS=1991010
NODES=28840
OPTIMUM
f=1
TT=34.831
T1=0.78
CHECKS=287795
NODES=2919
MSAT (TO)
f=1
TT=3600

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=15.62
T1=14.34
OPTIMUM
f=1
TT=6.794
T1=6.53
OPTIMUM
f=1
TT=74.196
T1=73.65
OPTIMUM
f=1
TT=128.151
T1=127.57
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/jnhUnsat/
normalized-jnh14_ext.xml
MOPT
f=2
TT=7.228
T1=0.97
MSAT (TO)
f=2
TT=2402.45
T1=0.97
MSAT (TO)
f=2
TT=2340.22
T1=0.97
MSAT (TO)
f=2
TT=3600.09

MSAT (TO)
f=2
TT=3600.06

OPTIMUM
f=2
TT=16.975
T1=16.72
OPTIMUM
f=2
TT=7.228
T1=6.95
OPTIMUM
f=2
TT=710.679
T1=647.02
OPTIMUM
f=2
TT=669.129
T1=648.13
csp/jnhUnsat/
normalized-jnh19_ext.xml
MOPT
f=2
TT=8.746
T1=0.75
MSAT (TO)
f=2
TT=2428.03
T1=0.88
OPTIMUM
f=2
TT=2158.22
T1=0.75
CHECKS=268241000
NODES=1434910
MSAT (TO)
f=2
TT=3600.07

MSAT (TO)
f=2
TT=3600.08

OPTIMUM
f=2
TT=17.158
T1=16.92
OPTIMUM
f=2
TT=8.746
T1=8.47
Wrong Opt.
f=4
TT=570.474
T1=507.15
OPTIMUM
f=2
TT=883.8
T1=722.08
csp/jnhUnsat/
normalized-jnh203_ext.xml
MOPT
f=1
TT=7.679
T1=0.78
OPTIMUM
f=1
TT=38.941
T1=0.78
CHECKS=713883
NODES=12131
OPTIMUM
f=1
TT=33.858
T1=0.98
CHECKS=147232
NODES=1659
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.04

OPTIMUM
f=1
TT=15.154
T1=13.95
OPTIMUM
f=1
TT=7.679
T1=7.24
OPTIMUM
f=1
TT=64.528
T1=64.33
OPTIMUM
f=1
TT=133.747
T1=133.53
csp/jnhUnsat/
normalized-jnh206_ext.xml
MOPT
f=1
TT=4.883
T1=0.76
OPTIMUM
f=1
TT=46.575
T1=0.76
CHECKS=2096430
NODES=30150
OPTIMUM
f=1
TT=34.904
T1=0.77
CHECKS=301987
NODES=3181
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=9.59
T1=8.56
OPTIMUM
f=1
TT=4.883
T1=4.61
OPTIMUM
f=1
TT=13.176
T1=12.96
OPTIMUM
f=1
TT=14.953
T1=14.7
csp/jnhUnsat/
normalized-jnh211_ext.xml
MOPT
f=2
TT=7.678
T1=0.74
MSAT (TO)
f=2
TT=2207.96
T1=0.87
OPTIMUM
f=2
TT=462.304
T1=0.74
CHECKS=53909000
NODES=282453
MSAT (TO)
f=2
TT=3600.07

MSAT (TO)
f=2
TT=3600.05

OPTIMUM
f=2
TT=14.5
T1=14.25
OPTIMUM
f=2
TT=7.678
T1=7.41
OPTIMUM
f=2
TT=52.902
T1=36.06
OPTIMUM
f=2
TT=26.357
T1=16.72
csp/jnhUnsat/
normalized-jnh214_ext.xml
MOPT
f=1
TT=4.658
T1=1.56
OPTIMUM
f=1
TT=56.143
T1=1.56
CHECKS=2983620
NODES=39726
OPTIMUM
f=1
TT=35.25
T1=1.66
CHECKS=263045
NODES=2599
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=9.234
T1=8.11
OPTIMUM
f=1
TT=4.658
T1=4.4
OPTIMUM
f=1
TT=165.401
T1=164.8
OPTIMUM
f=1
TT=141.71
T1=141.02
csp/jnhUnsat/
normalized-jnh216_ext.xml
MOPT
f=1
TT=6.424
T1=0.86
OPTIMUM
f=1
TT=35.44
T1=0.86
CHECKS=398501
NODES=6514
OPTIMUM
f=1
TT=33.784
T1=0.97
CHECKS=169129
NODES=1746
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=13.716
T1=12.72
OPTIMUM
f=1
TT=6.424
T1=6.28
OPTIMUM
f=1
TT=40.103
T1=39.74
OPTIMUM
f=1
TT=36.067
T1=35.63
csp/jnhUnsat/
normalized-jnh219_ext.xml
MOPT
f=1
TT=6.487
T1=5.24
OPTIMUM
f=1
TT=40.232
T1=5.24
CHECKS=409685
NODES=7219
OPTIMUM
f=1
TT=37.515
T1=5.52
CHECKS=112319
NODES=1383
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=1
TT=3600.07

OPTIMUM
f=1
TT=9.365
T1=8.25
OPTIMUM
f=1
TT=6.487
T1=6.22
OPTIMUM
f=1
TT=79.319
T1=79.05
OPTIMUM
f=1
TT=99.31
T1=98.91
csp/jnhUnsat/
normalized-jnh302_ext.xml
MOPT
f=4
TT=17.65
T1=1.05
MSAT (TO)
f=4
TT=2452.14
T1=1.16
MSAT (TO)
f=4
TT=2248.2
T1=1.05
MSAT (TO)
f=4
TT=3600.07

MSAT (TO)
f=4
TT=3600.04

OPTIMUM
f=4
TT=22.955
T1=22.7
OPTIMUM
f=4
TT=17.65
T1=17.36
? (TO)

TT=3600.08

OPTIMUM
f=4
TT=2752.53
T1=2039.53
csp/jnhUnsat/
normalized-jnh303_ext.xml
MOPT
f=3
TT=18.853
T1=1.68
MSAT (TO)
f=3
TT=2329.44
T1=1.68
MSAT (TO)
f=3
TT=2279.97
T1=1.77
MSAT (TO)
f=3
TT=3600.03

MSAT (TO)
f=3
TT=3600.06

OPTIMUM
f=3
TT=31.837
T1=31.58
OPTIMUM
f=3
TT=18.853
T1=18.57
OPTIMUM
f=3
TT=573.152
T1=96.47
OPTIMUM
f=3
TT=757.63
T1=324.48
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/jnhUnsat/
normalized-jnh309_ext.xml
MOPT
f=2
TT=7.258
T1=0.88
MSAT (TO)
f=2
TT=2318.55
T1=0.88
MSAT (TO)
f=2
TT=2267.96
T1=0.88
MSAT (TO)
f=2
TT=3600.03

MSAT (TO)
f=2
TT=3600.01

OPTIMUM
f=2
TT=18.779
T1=18.53
OPTIMUM
f=2
TT=7.258
T1=7
? (TO)

TT=3600.02

OPTIMUM
f=2
TT=2773.5
T1=2751.61
csp/jnhUnsat/
normalized-jnh310_ext.xml
MOPT
f=3
TT=28.292
T1=1.08
MSAT (TO)
f=3
TT=2243.08
T1=1.08
MSAT (TO)
f=3
TT=2211.11
T1=1.27
MSAT (TO)
f=3
TT=3600.02

MSAT (TO)
f=3
TT=3600.02

OPTIMUM
f=3
TT=36.987
T1=36.86
OPTIMUM
f=3
TT=28.292
T1=27.74
OPTIMUM
f=3
TT=414.702
T1=295.87
OPTIMUM
f=3
TT=322.618
T1=174.02
csp/pret/
normalized-pret-150-25_ext.xml
MOPT
f=1
TT=0.536
T1=0
MSAT (TO)
f=1
TT=3600.05
T1=0.58
MSAT (TO)
f=1
TT=3600.08
T1=0.58
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=1.699
T1=1.51
OPTIMUM
f=1
TT=1.859
T1=1.65
OPTIMUM
f=1
TT=1290.9
T1=0
OPTIMUM
f=1
TT=0.536
T1=0
csp/pret/
normalized-pret-150-40_ext.xml
MOPT
f=1
TT=0.694
T1=0
MSAT (TO)
f=1
TT=3600.03
T1=0.58
MSAT (TO)
f=1
TT=3600.11
T1=0.5
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=1.673
T1=1.49
OPTIMUM
f=1
TT=1.607
T1=1.42
OPTIMUM
f=1
TT=1221.15
T1=0
OPTIMUM
f=1
TT=0.694
T1=0
csp/pret/
normalized-pret-150-60_ext.xml
MOPT
f=1
TT=0.684
T1=0.02
MSAT (TO)
f=1
TT=3600.15
T1=0.48
MSAT (TO)
f=1
TT=3600.13
T1=0.47
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.05

OPTIMUM
f=1
TT=1.751
T1=1.55
OPTIMUM
f=1
TT=1.705
T1=1.52
OPTIMUM
f=1
TT=1205.16
T1=0
OPTIMUM
f=1
TT=0.684
T1=0.02
csp/pret/
normalized-pret-150-75_ext.xml
MOPT
f=1
TT=0.697
T1=0.02
MSAT (TO)
f=1
TT=3600.08
T1=0.58
MSAT (TO)
f=1
TT=3600.15
T1=0.68
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.04

OPTIMUM
f=1
TT=1.66
T1=1.46
OPTIMUM
f=1
TT=1.588
T1=1.4
OPTIMUM
f=1
TT=1192.52
T1=3.89
OPTIMUM
f=1
TT=0.697
T1=0.02
csp/pret/
normalized-pret-60-25_ext.xml
MOPT
f=1
TT=0.045
T1=0
OPTIMUM
f=1
TT=384.516
T1=0.49
CHECKS=249237000
NODES=13284000
OPTIMUM
f=1
TT=468.309
T1=0.48
CHECKS=312887000
NODES=18680900
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.02

OPTIMUM
f=1
TT=1.161
T1=1
OPTIMUM
f=1
TT=1.154
T1=1
OPTIMUM
f=1
TT=0.166
T1=0
OPTIMUM
f=1
TT=0.045
T1=0
csp/pret/
normalized-pret-60-40_ext.xml
MOPT
f=1
TT=0.049
T1=0
OPTIMUM
f=1
TT=412.084
T1=0.48
CHECKS=249204000
NODES=13284000
OPTIMUM
f=1
TT=458.51
T1=0.45
CHECKS=310714000
NODES=19744500
MSAT (TO)
f=1
TT=3600.06

MSAT (TO)
f=1
TT=3600.05

OPTIMUM
f=1
TT=1.195
T1=1.02
OPTIMUM
f=1
TT=1.216
T1=1.05
OPTIMUM
f=1
TT=0.17
T1=0
OPTIMUM
f=1
TT=0.049
T1=0
csp/pret/
normalized-pret-60-60_ext.xml
MOPT
f=1
TT=0.048
T1=0
OPTIMUM
f=1
TT=413.198
T1=0.48
CHECKS=249197000
NODES=13284000
OPTIMUM
f=1
TT=489.43
T1=0.49
CHECKS=299840000
NODES=20414000
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.03

OPTIMUM
f=1
TT=1.177
T1=1.03
OPTIMUM
f=1
TT=1.196
T1=1.05
OPTIMUM
f=1
TT=0.212
T1=0
OPTIMUM
f=1
TT=0.048
T1=0
csp/pret/
normalized-pret-60-75_ext.xml
MOPT
f=1
TT=0.049
T1=0
OPTIMUM
f=1
TT=411.692
T1=0.48
CHECKS=248673000
NODES=13284000
OPTIMUM
f=1
TT=479.618
T1=0.5
CHECKS=282443000
NODES=18925700
MSAT (TO)
f=1
TT=3600.07

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=1.168
T1=1.03
OPTIMUM
f=1
TT=1.219
T1=1.06
OPTIMUM
f=1
TT=0.169
T1=0
OPTIMUM
f=1
TT=0.049
T1=0
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
csp/ssa/
normalized-ssa-0432-003_ext.xml
MOPT
f=1
TT=1.244
T1=0.76
MSAT (TO)
f=1
TT=2096.75
T1=0.76
OPTIMUM
f=1
TT=391.659
T1=0.84
CHECKS=17547500
NODES=138946
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.06

OPTIMUM
f=1
TT=12.529
T1=11.49
OPTIMUM
f=1
TT=6.462
T1=6.17
OPTIMUM
f=1
TT=0.171
T1=0
OPTIMUM
f=1
TT=1.244
T1=1.16
csp/ssa/
normalized-ssa-2670-130_ext.xml
MOPT
f=1
TT=26.901
T1=4.09
MSAT (TO)
f=1
TT=3600.15
T1=4.09
MSAT (TO)
f=1
TT=2219.9
T1=4.52
MSAT (TO)
f=1
TT=3600.03

MSAT (TO)
f=31
TT=3600.08

OPTIMUM
f=1
TT=275.081
T1=254.41
OPTIMUM
f=1
TT=26.901
T1=26.37
? (TO)

TT=3600.04

? (TO)

TT=3600.07

csp/varDimacs/
normalized-hole-06_ext.xml
MOPT
f=1
TT=0.215
T1=0
OPTIMUM
f=1
TT=33.729
T1=0.48
CHECKS=256657
NODES=4552
OPTIMUM
f=1
TT=43.981
T1=0.48
CHECKS=778301
NODES=5992
MSAT (TO)
f=1
TT=3600.1

MSAT (TO)
f=1
TT=3600.02

OPTIMUM
f=1
TT=1.76
T1=1.55
OPTIMUM
f=1
TT=1.654
T1=1.44
OPTIMUM
f=1
TT=0.205
T1=0
OPTIMUM
f=1
TT=0.215
T1=0
csp/varDimacs/
normalized-hole-07_ext.xml
MOPT
f=1
TT=1.574
T1=0
OPTIMUM
f=1
TT=51.947
T1=0.54
CHECKS=2598640
NODES=32099
OPTIMUM
f=1
TT=124.141
T1=0.46
CHECKS=6417830
NODES=55671
MSAT (TO)
f=1
TT=3600.09

MSAT (TO)
f=1
TT=3600.05

OPTIMUM
f=1
TT=2.471
T1=2.15
OPTIMUM
f=1
TT=2.33
T1=1.99
OPTIMUM
f=1
TT=1.648
T1=0
OPTIMUM
f=1
TT=1.574
T1=0
csp/varDimacs/
normalized-hole-08_ext.xml
MOPT
f=1
TT=4.127
T1=0.02
OPTIMUM
f=1
TT=230.975
T1=0.59
CHECKS=28817600
NODES=257651
OPTIMUM
f=1
TT=488.148
T1=0.58
CHECKS=36534800
NODES=450022
MSAT (TO)
f=1
TT=3600.02

MSAT (TO)
f=1
TT=3600.01

OPTIMUM
f=1
TT=4.212
T1=3.14
OPTIMUM
f=1
TT=4.127
T1=2.37
OPTIMUM
f=1
TT=16.089
T1=0
OPTIMUM
f=1
TT=15.686
T1=0.02
csp/varDimacs/
normalized-hole-09_ext.xml
MOPT
f=1
TT=6.776
T1=0.02
MSAT (TO)
f=1
TT=1667.93
T1=0.59
MSAT (TO)
f=1
TT=1684.89
T1=0.78
MSAT (TO)
f=1
TT=3600.04

MSAT (TO)
f=1
TT=3600

OPTIMUM
f=1
TT=6.776
T1=3.06
OPTIMUM
f=1
TT=20.089
T1=2.15
OPTIMUM
f=1
TT=168.138
T1=0
OPTIMUM
f=1
TT=164.619
T1=0.02
csp/varDimacs/
normalized-hole-10_ext.xml
MOPT
f=1
TT=63.061
T1=0.03
MSAT (TO)
f=1
TT=1678.4
T1=0.58
MSAT (TO)
f=1
TT=1661.41
T1=0.57
MSAT (TO)
f=1
TT=3600.08

MSAT (TO)
f=1
TT=3600.09

OPTIMUM
f=1
TT=63.061
T1=6.91
OPTIMUM
f=1
TT=312.215
T1=4.02
OPTIMUM
f=1
TT=2215.09
T1=0
OPTIMUM
f=1
TT=2117.91
T1=0.03
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-1000-261925_ext.xml
MOPT
f=60
TT=47.602
T1=5.2
MSAT (TO)
f=60
TT=3600.11
T1=5.31
MSAT (TO)
f=60
TT=3600.08
T1=5.2
MSAT (TO)
f=60
TT=3600.03

MSAT (TO)
f=60
TT=3600.07

MSAT (TO)
f=108
TT=3600.06
T1=7.39
MSAT (TO)
f=94
TT=3600.06
T1=45.9
OPTIMUM
f=60
TT=43.937
T1=0
OPTIMUM
f=60
TT=47.602
T1=11.51
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-1000-261927_ext.xml
MOPT
f=62
TT=49.134
T1=0.67
MSAT (TO)
f=62
TT=3600.11
T1=0.74
MSAT (TO)
f=62
TT=3600.15
T1=0.67
MSAT (TO)
f=62
TT=3600.01

MSAT (TO)
f=62
TT=3600.08

MSAT (TO)
f=114
TT=3600.01
T1=18.95
MSAT (TO)
f=115
TT=3600.07
T1=17.61
OPTIMUM
f=62
TT=54.694
T1=44.48
OPTIMUM
f=62
TT=49.134
T1=30.41
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-1000-261929_ext.xml
MOPT
f=62
TT=48.414
T1=1.05
MSAT (TO)
f=62
TT=3600.09
T1=1.27
MSAT (TO)
f=62
TT=3600.14
T1=1.05
MSAT (TO)
f=62
TT=3600.06

MSAT (TO)
f=62
TT=3600.08

MSAT (TO)
f=113
TT=3600.01
T1=6.82
MSAT (TO)
f=119
TT=3600.11
T1=6.52
OPTIMUM
f=62
TT=49.244
T1=17.76
OPTIMUM
f=62
TT=48.414
T1=15.56
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-100-730623_ext.xml
MOPT
f=0
TT=0.043
T1=0
OPTIMUM
f=0
TT=1.773
T1=0.48
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=1.667
T1=0.49
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.344

CHECKS=1460
NODES=5
OPTIMUM
f=0
TT=0.357

CHECKS=1422
NODES=6
OPTIMUM
f=0
TT=1.709
T1=1.56
OPTIMUM
f=0
TT=1.652
T1=1.48
OPTIMUM
f=0
TT=0.016
T1=0
OPTIMUM
f=0
TT=0.043
T1=0
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-100-730629_ext.xml
MOPT
f=0
TT=0.044
T1=0
OPTIMUM
f=0
TT=1.782
T1=0.48
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=1.651
T1=0.49
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.349

CHECKS=1854
NODES=20
OPTIMUM
f=0
TT=0.364

CHECKS=1911
NODES=20
OPTIMUM
f=0
TT=1.809
T1=1.66
OPTIMUM
f=0
TT=1.65
T1=1.49
OPTIMUM
f=0
TT=0.016
T1=0
OPTIMUM
f=0
TT=0.044
T1=0
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-800-810522_ext.xml
MOPT
f=42
TT=29.152
T1=1.18
OPTIMUM
f=42
TT=3004.63
T1=1.27
CHECKS=1490440000
NODES=5038460
OPTIMUM
f=42
TT=1578.24
T1=1.18
CHECKS=818403000
NODES=2894090
MSAT (TO)
f=42
TT=3600.03

MSAT (TO)
f=42
TT=3600.01

MSAT (TO)
f=72
TT=3600.05
T1=7.5
MSAT (TO)
f=85
TT=3600.11
T1=15.92
OPTIMUM
f=42
TT=33.263
T1=31.42
OPTIMUM
f=42
TT=29.152
T1=17.9
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-900-536226_ext.xml
MOPT
f=54
TT=53.436
T1=1.97
MSAT (TO)
f=54
TT=3600.1
T1=2.17
MSAT (TO)
f=54
TT=3600.09
T1=1.97
MSAT (TO)
f=54
TT=3600.07

MSAT (TO)
f=54
TT=3600.09

MSAT (TO)
f=100
TT=3600.07
T1=6.43
MSAT (TO)
f=111
TT=3600.12
T1=4.24
OPTIMUM
f=54
TT=49.988
T1=39.68
OPTIMUM
f=54
TT=53.436
T1=35.17
maxcsp/cnf/3-40-100-1000/
normalized-cnf-3-40-900-536230_ext.xml
MOPT
f=48
TT=46.447
T1=1.27
OPTIMUM
f=48
TT=2603.68
T1=1.27
CHECKS=1195180000
NODES=3835530
OPTIMUM
f=48
TT=1874.03
T1=1.37
CHECKS=847847000
NODES=2840190
MSAT (TO)
f=48
TT=3600.09

MSAT (TO)
f=48
TT=3600.02

MSAT (TO)
f=95
TT=3600.03
T1=8.16
MSAT (TO)
f=100
TT=3600.08
T1=4.38
OPTIMUM
f=48
TT=42.489
T1=39.44
OPTIMUM
f=48
TT=46.447
T1=39.75
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1200-713329_ext.xml
MOPT
f=79
TT=93.708
T1=0.87
MSAT (TO)
f=79
TT=3600.11
T1=0.87
MSAT (TO)
f=79
TT=3600.12
T1=0.95
MSAT (TO)
f=79
TT=3600.06

MSAT (TO)
f=79
TT=3600.07

MSAT (TO)
f=140
TT=3600
T1=89.79
MSAT (TO)
f=139
TT=3600.14
T1=8.73
OPTIMUM
f=79
TT=64.057
T1=41.61
OPTIMUM
f=79
TT=93.708
T1=63.82
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1500-890427_ext.xml
MOPT
f=109
TT=130.778
T1=0.87
MSAT (TO)
f=109
TT=3600.07
T1=0.87
MSAT (TO)
f=109
TT=3600.07
T1=1.06
MSAT (TO)
f=109
TT=3600.05

MSAT (TO)
f=109
TT=3600.04

MSAT (TO)
f=198
TT=3600.02
T1=14.68
MSAT (TO)
f=188
TT=3600.13
T1=8.78
OPTIMUM
f=109
TT=129.379
T1=15.15
OPTIMUM
f=109
TT=130.778
T1=17.52
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1600-616125_ext.xml
MOPT
f=122
TT=232.084
T1=1.76
MSAT (TO)
f=122
TT=3600.15
T1=1.76
MSAT (TO)
f=122
TT=3600.1
T1=1.83
MSAT (TO)
f=122
TT=3600.01

MSAT (TO)
f=122
TT=3600.03

MSAT (TO)
f=179
TT=3600.09
T1=20.31
MSAT (TO)
f=194
TT=3600.15
T1=13.22
OPTIMUM
f=122
TT=251.06
T1=126.3
OPTIMUM
f=122
TT=232.084
T1=66.53
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1700-341821_ext.xml
MOPT
f=128
TT=188.577
T1=16.56
MSAT (TO)
f=128
TT=3600.11
T1=18.2
MSAT (TO)
f=128
TT=3600.05
T1=16.56
MSAT (TO)
f=128
TT=3600.03

MSAT (TO)
f=128
TT=3600.04

MSAT (TO)
f=171
TT=3600.03
T1=189.65
MSAT (TO)
f=177
TT=3600.18
T1=2062.58
OPTIMUM
f=128
TT=197.083
T1=83.94
OPTIMUM
f=128
TT=188.577
T1=99.79
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1700-341823_ext.xml
MOPT
f=139
TT=461.862
T1=1.04
MSAT (TO)
f=139
TT=3600.11
T1=1.04
MSAT (TO)
f=139
TT=3600.12
T1=1.38
MSAT (TO)
f=139
TT=3600.07

MSAT (TO)
f=139
TT=3600.04

MSAT (TO)
f=206
TT=3600.05
T1=19.66
MSAT (TO)
f=222
TT=3600.15
T1=11
OPTIMUM
f=139
TT=468.467
T1=378.69
OPTIMUM
f=139
TT=461.862
T1=448.39
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1700-341827_ext.xml
MOPT
f=129
TT=140.874
T1=2.76
MSAT (TO)
f=129
TT=3600.07
T1=2.76
MSAT (TO)
f=129
TT=3600.1
T1=2.8
MSAT (TO)
f=129
TT=3600

MSAT (TO)
f=129
TT=3600.06

MSAT (TO)
f=190
TT=3600.03
T1=386.43
MSAT (TO)
f=196
TT=3600.12
T1=62.82
OPTIMUM
f=129
TT=142.766
T1=105.55
OPTIMUM
f=129
TT=140.874
T1=74.66
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1900-793223_ext.xml
MOPT
f=146
TT=201.079
T1=3.77
MSAT (TO)
f=146
TT=3600.06
T1=3.77
MSAT (TO)
f=146
TT=3600.11
T1=3.95
MSAT (TO)
f=146
TT=3600.01

MSAT (TO)
f=146
TT=3600.03

MSAT (TO)
f=213
TT=3600.07
T1=183.92
MSAT (TO)
f=219
TT=3600.12
T1=324.51
OPTIMUM
f=146
TT=206.596
T1=195.32
OPTIMUM
f=146
TT=201.079
T1=113.84
maxcsp/cnf/3-40-1100-2000/
normalized-cnf-3-40-1900-793224_ext.xml
MOPT
f=151
TT=231.85
T1=2.76
MSAT (TO)
f=151
TT=3600.08
T1=2.76
MSAT (TO)
f=151
TT=3600.04
T1=3.07
MSAT (TO)
f=151
TT=3600.05

MSAT (TO)
f=151
TT=3600.06

MSAT (TO)
f=223
TT=3600.03
T1=23.05
MSAT (TO)
f=226
TT=3600.19
T1=12.8
OPTIMUM
f=151
TT=241.943
T1=101.01
OPTIMUM
f=151
TT=231.85
T1=90.66
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2100-244628_ext.xml
MOPT
f=161
TT=211.045
T1=5.71
MSAT (TO)
f=161
TT=3600.05
T1=5.71
MSAT (TO)
f=161
TT=3600.16
T1=6.35
MSAT (TO)
f=161
TT=3600.05

MSAT (TO)
f=161
TT=3600.09

MSAT (TO)
f=208
TT=3600.05
T1=291.97
MSAT (TO)
f=237
TT=3600.17
T1=13.47
OPTIMUM
f=161
TT=219.512
T1=182.32
OPTIMUM
f=161
TT=211.045
T1=137.16
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2400-421722_ext.xml
MOPT
f=194
TT=236.737
T1=174.63
MSAT (TO)
f=195
TT=3600.11
T1=19.9
MSAT (TO)
f=195
TT=3600.11
T1=18.6
MSAT (TO)
f=194
TT=3600.05

MSAT (TO)
f=194
TT=3600.01

MSAT (TO)
f=249
TT=3600.01
T1=2785.49
MSAT (TO)
f=279
TT=3600.19
T1=62.01
OPTIMUM
f=194
TT=254.984
T1=187.85
OPTIMUM
f=194
TT=236.737
T1=174.63
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2500-147422_ext.xml
MOPT
f=210
TT=353.787
T1=25.65
MSAT (TO)
f=210
TT=3600.08
T1=25.65
MSAT (TO)
f=210
TT=3600.12
T1=29.44
MSAT (TO)
f=210
TT=3600

MSAT (TO)
f=210
TT=3600.02

MSAT (TO)
f=284
TT=3600.09
T1=70.14
MSAT (TO)
f=252
TT=3600.18
T1=599.91
OPTIMUM
f=210
TT=375.191
T1=149.18
OPTIMUM
f=210
TT=353.787
T1=107.54
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2500-147426_ext.xml
MOPT
f=215
TT=534.227
T1=23.23
MSAT (TO)
f=215
TT=3600.09
T1=23.84
MSAT (TO)
f=215
TT=3600.12
T1=23.23
MSAT (TO)
f=215
TT=3600.04

MSAT (TO)
f=215
TT=3600.05

MSAT (TO)
f=306
TT=3600.02
T1=46.56
MSAT (TO)
f=323
TT=3600.18
T1=21.48
OPTIMUM
f=215
TT=476.634
T1=167.8
OPTIMUM
f=215
TT=534.227
T1=221.34
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2500-147429_ext.xml
MOPT
f=195
TT=155.146
T1=7.94
MSAT (TO)
f=195
TT=3600.09
T1=9.41
MSAT (TO)
f=195
TT=3600.15
T1=7.94
MSAT (TO)
f=195
TT=3600

MSAT (TO)
f=195
TT=3600.07

MSAT (TO)
f=277
TT=3600.05
T1=2438.79
MSAT (TO)
f=319
TT=3600.14
T1=20.36
OPTIMUM
f=195
TT=125.462
T1=30.15
OPTIMUM
f=195
TT=155.146
T1=52.04
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2800-324527_ext.xml
MOPT
f=244
TT=572.623
T1=1.41
MSAT (TO)
f=244
TT=3600.08
T1=1.46
MSAT (TO)
f=244
TT=3600.12
T1=1.41
MSAT (TO)
f=244
TT=3600.07

MSAT (TO)
f=244
TT=3600.08

MSAT (TO)
f=305
TT=3600.13
T1=1592.27
MSAT (TO)
f=304
TT=3600.19
T1=839.98
OPTIMUM
f=244
TT=602.02
T1=513.72
OPTIMUM
f=244
TT=572.623
T1=375.12
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-2900-050222_ext.xml
MOPT
f=252
TT=543.269
T1=208.29
MSAT (TO)
f=257
TT=3600.13
T1=16.11
MSAT (TO)
f=257
TT=3600.07
T1=18.41
MSAT (TO)
f=252
TT=3600.06

MSAT (TO)
f=252
TT=3600.02

MSAT (TO)
f=352
TT=3600.05
T1=38.27
MSAT (TO)
f=312
TT=3600.2
T1=1638.8
OPTIMUM
f=252
TT=447.36
T1=38.29
OPTIMUM
f=252
TT=543.269
T1=208.29
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/cnf/3-40-2100-3000/
normalized-cnf-3-40-3000-775927_ext.xml
MOPT
f=269
TT=756.145
T1=30.84
MSAT (TO)
f=269
TT=3600.04
T1=30.84
MSAT (TO)
f=270
TT=3600.14
T1=18.59
MSAT (TO)
f=269
TT=3600

MSAT (TO)
f=269
TT=3600.09

MSAT (TO)
f=367
TT=3600.09
T1=71.58
MSAT (TO)
f=317
TT=3600.2
T1=1224
OPTIMUM
f=269
TT=659.506
T1=249.55
OPTIMUM
f=269
TT=756.145
T1=460.64
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-1000-266847_ext.xml
MSAT TO
f=43
TT=3600.02
T1=10.74
MSAT (TO)
f=43
TT=3600.12
T1=16.42
MSAT (TO)
f=43
TT=3600.06
T1=10.74
MSAT (TO)
f=43
TT=3600.06

MSAT (TO)
f=43
TT=3600.02

MSAT (TO)
f=85
TT=3600
T1=1860.68
MSAT (TO)
f=98
TT=3600.16
T1=47.13
? (TO)

TT=3600.07

? (TO)
f=48
TT=3600.03
T1=1262.88
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-1000-266849_ext.xml
MSAT TO
f=45
TT=3600.07
T1=4.12
MSAT (TO)
f=45
TT=3600.12
T1=4.12
MSAT (TO)
f=45
TT=3600.08
T1=4.24
MSAT (TO)
f=45
TT=3600.07

MSAT (TO)
f=45
TT=3600.07

MSAT (TO)
f=83
TT=3600.02
T1=89.73
MSAT (TO)
f=72
TT=3600.15
T1=12.07
? (TO)

TT=3600.08

? (TO)
f=54
TT=3600.04
T1=3543.84
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-100-735548_ext.xml
MOPT
f=0
TT=0.063
T1=0
OPTIMUM
f=0
TT=1.928
T1=0.48
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=1.929
T1=0.48
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.342

CHECKS=1330
NODES=5
OPTIMUM
f=0
TT=0.37

CHECKS=1443
NODES=11
OPTIMUM
f=0
TT=1.707
T1=1.55
OPTIMUM
f=0
TT=1.608
T1=1.45
OPTIMUM
f=0
TT=0.016
T1=0
OPTIMUM
f=0
TT=0.063
T1=0
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-200-461248_ext.xml
MOPT
f=0
TT=0.107
T1=0.02
OPTIMUM
f=0
TT=2.166
T1=0.48
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=2.179
T1=0.49
CHECKS=0
NODES=0
OPTIMUM
f=0
TT=0.546

CHECKS=3522
NODES=30
OPTIMUM
f=0
TT=0.438

CHECKS=4209
NODES=59
OPTIMUM
f=0
TT=2.833
T1=2.66
OPTIMUM
f=0
TT=2.333
T1=2.15
OPTIMUM
f=0
TT=0.023
T1=0
OPTIMUM
f=0
TT=0.107
T1=0.02
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-400-912642_ext.xml
MOPT
f=3
TT=10.377
T1=0.88
OPTIMUM
f=3
TT=2429.26
T1=1.02
CHECKS=945554000
NODES=9225760
OPTIMUM
f=3
TT=1099.49
T1=0.88
CHECKS=404837000
NODES=4164460
MSAT (TO)
f=3
TT=3600.03

MSAT (TO)
f=3
TT=3600.05

OPTIMUM
f=3
TT=10.377
T1=7.51
OPTIMUM
f=3
TT=13.047
T1=10.51
OPTIMUM
f=3
TT=29.58
T1=20.71
OPTIMUM
f=3
TT=25.294
T1=15.92
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-400-912648_ext.xml
MOPT
f=3
TT=7.635
T1=0.66
OPTIMUM
f=3
TT=2757.41
T1=0.78
CHECKS=984493000
NODES=10406600
OPTIMUM
f=3
TT=1436.68
T1=0.66
CHECKS=463786000
NODES=4912990
MSAT (TO)
f=3
TT=3600.06

MSAT (TO)
f=3
TT=3600.06

OPTIMUM
f=3
TT=7.635
T1=4.32
OPTIMUM
f=3
TT=8.523
T1=5.2
OPTIMUM
f=3
TT=15.082
T1=5.47
OPTIMUM
f=3
TT=18.263
T1=9.29
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-600-364044_ext.xml
MOPT
f=13
TT=3350.04
T1=1.55
MSAT (TO)
f=13
TT=3600.05
T1=1.55
MSAT (TO)
f=13
TT=3600.06
T1=1.63
MSAT (TO)
f=13
TT=3600.06

MSAT (TO)
f=13
TT=3600.09

MSAT (TO)
f=34
TT=3600.1
T1=4.37
MSAT (TO)
f=18
TT=3600.11
T1=2361.04
? (TO)

TT=3600.07

OPTIMUM
f=13
TT=3350.04
T1=2755.02
maxcsp/cnf/3-80-100-1000/
normalized-cnf-3-80-700-089745_ext.xml
MSAT TO
f=22
TT=3600
T1=1.67
MSAT (TO)
f=22
TT=3600.13
T1=1.96
MSAT (TO)
f=22
TT=3600.12
T1=1.67
MSAT (TO)
f=22
TT=3600

MSAT (TO)
f=22
TT=3600.03

MSAT (TO)
f=52
TT=3600.09
T1=5.83
MSAT (TO)
f=69
TT=3600.08
T1=4.08
? (TO)

TT=3600.09

? (TO)
f=24
TT=3600.08
T1=733.72
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1200-718245_ext.xml
MSAT TO
f=56
TT=3600.04
T1=17.23
MSAT (TO)
f=56
TT=3600.07
T1=18.02
MSAT (TO)
f=56
TT=3600.04
T1=17.23
MSAT (TO)
f=56
TT=3600.06

MSAT (TO)
f=56
TT=3600.05

MSAT (TO)
f=105
TT=3600.06
T1=14.52
MSAT (TO)
f=121
TT=3600.17
T1=7.98
? (TO)

TT=3600.1

? (TO)
f=73
TT=3600.09
T1=1747.17
Bench nameBest results
on this
instance
AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1200-718249_ext.xml
MSAT TO
f=55
TT=3600.09

MSAT (TO)
f=56
TT=3600.08
T1=17.84
MSAT (TO)
f=56
TT=3600.06
T1=19.04
MSAT (TO)
f=55
TT=3600.09

MSAT (TO)
f=55
TT=3600.09

MSAT (TO)
f=101
TT=3600.02
T1=38.14
MSAT (TO)
f=124
TT=3600.1
T1=12.13
? (TO)

TT=3600.11

? (TO)
f=63
TT=3600.08
T1=3283.92
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1200-718250_ext.xml
MSAT TO
f=58
TT=3600.03
T1=1.16
MSAT (TO)
f=58
TT=3600.13
T1=1.16
MSAT (TO)
f=58
TT=3600.14
T1=1.22
MSAT (TO)
f=58
TT=3600.03

MSAT (TO)
f=58
TT=3600.09

MSAT (TO)
f=163
TT=3600.05
T1=7.19
MSAT (TO)
f=155
TT=3600.21
T1=6.42
? (TO)

TT=3600.07

? (TO)
f=70
TT=3600.08
T1=3301.33
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1300-443942-ext.xml
MSAT TO
f=70
TT=3600.06
T1=2.47
MSAT (TO)
f=70
TT=3600.09
T1=2.76
MSAT (TO)
f=70
TT=3600.09
T1=2.47
MSAT (TO)
f=70
TT=3600.07

MSAT (TO)
f=70
TT=3600.06

MSAT (TO)
f=152
TT=3600.03
T1=19.47
MSAT (TO)
f=133
TT=3600.14
T1=16.74
? (TO)

TT=3600.07

? (TO)
f=82
TT=3600.03
T1=231.52
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1300-443943_ext.xml
MSAT TO
f=68
TT=3600.03

MSAT (TO)
f=69
TT=3600.1
T1=2.17
MSAT (TO)
f=69
TT=3600.11
T1=1.57
MSAT (TO)
f=68
TT=3600.07

MSAT (TO)
f=68
TT=3600.03

MSAT (TO)
f=124
TT=3600.04
T1=103.56
MSAT (TO)
f=127
TT=3600.13
T1=10.91
? (TO)

TT=3600.07

? (TO)
f=80
TT=3600.11
T1=336.55
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1500-895345_ext.xml
MSAT TO
f=87
TT=3600.04
T1=43.85
MSAT (TO)
f=87
TT=3600.1
T1=43.85
MSAT (TO)
f=89
TT=3600.12
T1=3.58
MSAT (TO)
f=87
TT=3600.04

MSAT (TO)
f=87
TT=3600.08

MSAT (TO)
f=152
TT=3600.04
T1=27.61
MSAT (TO)
f=166
TT=3600.12
T1=18.99
? (TO)

TT=3600.07

? (TO)
f=106
TT=3600.05
T1=2093.29
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1600-621045_ext.xml
MSAT TO
f=92
TT=3600.02
T1=26.87
MSAT (TO)
f=92
TT=3600.09
T1=27.53
MSAT (TO)
f=92
TT=3600.11
T1=26.87
MSAT (TO)
f=92
TT=3600.07

MSAT (TO)
f=92
TT=3600.02

MSAT (TO)
f=163
TT=3600.03
T1=176.41
MSAT (TO)
f=160
TT=3600.14
T1=54.52
? (TO)

TT=3600.04

? (TO)
f=104
TT=3600.06
T1=3472.5
maxcsp/cnf/3-80-1100-2000/
normalized-cnf-3-80-1600-621048_ext.xml
MSAT TO
f=85
TT=3600.02
T1=29.87
MSAT (TO)
f=85
TT=3600.09
T1=30
MSAT (TO)
f=85
TT=3600.04
T1=29.87
MSAT (TO)
f=85
TT=3600.04

MSAT (TO)
f=85
TT=3600.02

MSAT (TO)
f=178
TT=3600.06
T1=19.34
MSAT (TO)
f=198
TT=3600.1
T1=13.43
? (TO)

TT=3600.06

? (TO)
f=103
TT=3600.09
T1=1003.33

Some statistics...

AbsconMax 112
pc-d
AbsconMax 112
pc-w
Concrete + CSP4J - MCRW Engine
2008-05-30
Concrete + CSP4J - Tabu Engine
2008-05-30
Sugar
v1.13+minisat
Sugar++
v1.13+minisat-inc
toulbar2
2008-06-27
toulbar2/BTD
2008-06-27
Number of times the solver is able to give the best known answer436115157373094
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)1031011071067373094
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)981111429063
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)32230000052