CSP 2009 Competition: results by benchmark

Results by benchmark for category binary constraints in intension (2-ARY-INT), subcategory real world problems

This page displays the results of the different solvers for each benchmark for category binary constraints in intension (2-ARY-INT), subcategory real world problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver gave a definitive answer (SAT or UNSAT)
textthe solver performed better than the other ones on that instance
textthe solver was ended by a signal
textthe solver gave an incomplete answer
textthe solver was disqualified in the category
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC (complete)
Abscon 112v4 ESAC (complete)
bpsolver 09 (complete)
Choco2.1.1 2009-06-10 (complete)
Choco2.1.1b 2009-07-16 (complete)
Concrete 2009-07-14 (complete)
Concrete DC 2009-07-14 (complete)
Mistral 1.545 (complete)
pcs 0.3.2 (complete)
pcs-restart 0.3.2 (complete)
SAT4J CSP 2.1.1 (complete)
Sugar v1.14.6+minisat (complete)
Sugar v1.14.6+picosat (complete)

Bench nameBest results
on this
instance		Abscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp01/
normalized-fapp01-0200-10.xml 		SAT
TT=1.628

 SAT
TT=9.929

 SAT
TT=9.859

 ? (exit code)
TT=34.672

 SAT
TT=9.182

 SAT
TT=9.312

 SAT
TT=12.401

 ? (TO)
TT=1800.02

 SAT
TT=1.628

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.14

 SAT
TT=163.277

 SAT
TT=124.207

 SAT
TT=56.258
csp/fapp/fapp01/
normalized-fapp01-0200-4.xml 		SAT
TT=10.57

 SAT
TT=10.977

 SAT
TT=10.57

 ? (exit code)
TT=34.569

 ? (TO)
TT=1800.25

 ? (TO)
TT=1800.1

 SAT
TT=13.256

 ? (TO)
TT=1800.07

 SAT
TT=97.213

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.12

 SAT
TT=281.049

 SAT
TT=141.507

 SAT
TT=72.683
csp/fapp/fapp01/
normalized-fapp01-0200-5.xml 		SAT
TT=6.553

 SAT
TT=11.141

 SAT
TT=10.839

 ? (exit code)
TT=35

 ? (TO)
TT=1800.17

 SAT
TT=52.988

 SAT
TT=13.26

 ? (TO)
TT=1800.01

 SAT
TT=6.553

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.07

 SAT
TT=273.486

 SAT
TT=169.28

 SAT
TT=76.145
csp/fapp/fapp02/
normalized-fapp02-0250-0.xml 		UNSAT
TT=11.381

 ? (MO)
TT=17.456

 UNSAT
TT=17.528

 ? (exit code)
TT=34.719

 UNSAT
TT=17.212

 UNSAT
TT=14.3

 UNSAT
TT=21.301

 UNSAT
TT=20.523

 UNSAT
TT=11.381

 UNSAT
TT=489.594

 UNSAT
TT=989.735

 UNSAT
TT=291.881

 UNSAT
TT=23.989

 UNSAT
TT=54.157
csp/fapp/fapp02/
normalized-fapp02-0250-10.xml 		SAT
TT=17.261

 SAT
TT=18.374

 SAT
TT=17.261

 ? (exit code)
TT=34.915

 SAT
TT=18.452

 SAT
TT=61.811

 SAT
TT=20.321

 ? (TO)
TT=1800.02

 SAT
TT=18.42

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.08

 SAT
TT=314.571

 SAT
TT=403.486

 SAT
TT=140.365
csp/fapp/fapp02/
normalized-fapp02-0250-5.xml 		SAT
TT=19.168

 SAT
TT=19.168

 SAT
TT=19.414

 ? (exit code)
TT=32.663

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.2

 SAT
TT=23.805

 ? (TO)
TT=1800

 SAT
TT=388.803

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.08

 ?
TT=383.643

 SAT
TT=320.099

 SAT
TT=146.204
csp/fapp/fapp03/
normalized-fapp03-0300-4.xml 		UNSAT
TT=15.596

 UNSAT
TT=22.079

 UNSAT
TT=22.108

 ? (exit code)
TT=36.101

 UNSAT
TT=18.571

 UNSAT
TT=15.596

 UNSAT
TT=28.108

 UNSAT
TT=28.031

 UNSAT
TT=24.957

 UNSAT
TT=84.669

 UNSAT
TT=61.064

 ?
TT=424.987

 UNSAT
TT=35.81

 UNSAT
TT=106.223
csp/fapp/fapp03/
normalized-fapp03-0300-6.xml 		UNSAT
TT=22.412

 UNSAT
TT=22.535

 UNSAT
TT=22.412

 ? (exit code)
TT=35.23

 UNSAT
TT=54.831

 UNSAT
TT=35.979

 UNSAT
TT=27.362

 UNSAT
TT=27.822

 UNSAT
TT=27.174

 UNSAT
TT=434.267

 UNSAT
TT=322.136

 ?
TT=440.935

 UNSAT
TT=33.627

 UNSAT
TT=107.935
csp/fapp/fapp03/
normalized-fapp03-0300-7.xml 		SAT
TT=28.994

 SAT
TT=28.994

 SAT
TT=30.322

 ? (exit code)
TT=35.112

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.15

 SAT
TT=30.306

 ?
TT=945.661

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.08

 ?
TT=1607.15

 SAT
TT=939.669

 SAT
TT=300.739
csp/fapp/fapp04/
normalized-fapp04-0300-0.xml 		UNSAT
TT=5.165

 UNSAT
TT=21.834

 UNSAT
TT=21.841

 ? (exit code)
TT=33.772

 UNSAT
TT=18.203

 UNSAT
TT=18.353

 UNSAT
TT=28.286

 UNSAT
TT=26.529

 UNSAT
TT=5.165

 UNSAT
TT=315.879

 UNSAT
TT=270.699

 ?
TT=481.535

 UNSAT
TT=34.488

 UNSAT
TT=90.547
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp04/
normalized-fapp04-0300-4.xml 		SAT
TT=25.781

 SAT
TT=25.781

 SAT
TT=25.815

 ? (exit code)
TT=35.495

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.11

 SAT
TT=28.878

 ?
TT=1250.69

 SAT
TT=720.742

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.14

 ?
TT=456.228

 SAT
TT=964.126

 SAT
TT=265.779
csp/fapp/fapp04/
normalized-fapp04-0300-5.xml 		SAT
TT=24.269

 SAT
TT=24.587

 SAT
TT=24.269

 ? (exit code)
TT=34.801

 ? (TO)
TT=1800.18

 ? (TO)
TT=1800.09

 SAT
TT=27.3

 ?
TT=941.52

 SAT
TT=1498.21

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.13

 ?
TT=415.058

 SAT
TT=835.991

 SAT
TT=257.458
csp/fapp/fapp05/
normalized-fapp05-0350-3.xml 		UNSAT
TT=22.374

 UNSAT
TT=22.374

 UNSAT
TT=22.57

 ? (exit code)
TT=35.508

 UNSAT
TT=156.559

 UNSAT
TT=155.794

 UNSAT
TT=29.815

 UNSAT
TT=29.5

 UNSAT
TT=1035.98

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.1

 ?
TT=434.265

 UNSAT
TT=54.342

 UNSAT
TT=151.301
csp/fapp/fapp05/
normalized-fapp05-0350-6.xml 		UNSAT
TT=22.636

 UNSAT
TT=22.776

 UNSAT
TT=22.636

 ? (exit code)
TT=36.252

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.19

 UNSAT
TT=28.729

 UNSAT
TT=30.465

 ? (TO)
TT=1800.04

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.1

 ?
TT=1394.19

 UNSAT
TT=62.785

 UNSAT
TT=158.472
csp/fapp/fapp05/
normalized-fapp05-0350-8.xml 		UNSAT
TT=34.389

 UNSAT
TT=39.77

 UNSAT
TT=40.044

 ? (exit code)
TT=35.449

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.1

 UNSAT
TT=34.389

 UNSAT
TT=51.083

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.14

 ?
TT=769.023

 UNSAT
TT=72.015

 UNSAT
TT=167.152
csp/fapp/fapp06/
normalized-fapp06-0500-0.xml 		UNSAT
TT=12.596

 UNSAT
TT=23.614

 UNSAT
TT=23.289

 ? (exit code)
TT=64.482

 UNSAT
TT=22.664

 UNSAT
TT=23.863

 UNSAT
TT=52.725

 UNSAT
TT=54.233

 UNSAT
TT=12.596

 UNSAT
TT=31.569

 UNSAT
TT=395.889

 ?
TT=514.916

 UNSAT
TT=65.261

 UNSAT
TT=184.463
csp/fapp/fapp06/
normalized-fapp06-0500-2.xml 		UNSAT
TT=10.168

 UNSAT
TT=23.533

 UNSAT
TT=23.589

 ? (exit code)
TT=65.829

 UNSAT
TT=23.124

 UNSAT
TT=21.286

 UNSAT
TT=48.808

 UNSAT
TT=49.325

 UNSAT
TT=10.168

 UNSAT
TT=281.328

 UNSAT
TT=780.545

 ?
TT=1226.75

 UNSAT
TT=67.775

 UNSAT
TT=189.621
csp/fapp/fapp06/
normalized-fapp06-0500-4.xml 		UNSAT
TT=23.751

 UNSAT
TT=23.807

 UNSAT
TT=23.751

 ? (exit code)
TT=59.929

 UNSAT
TT=555.283

 UNSAT
TT=84.371

 UNSAT
TT=48.307

 UNSAT
TT=50.015

 UNSAT
TT=95.832

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.15

 ?
TT=487.453

 UNSAT
TT=74.646

 UNSAT
TT=191.024
csp/fapp/fapp07/
normalized-fapp07-0600-1.xml 		UNSAT
TT=8.321

 UNSAT
TT=25.293

 UNSAT
TT=24.745

 ? (exit code)
TT=64.868

 UNSAT
TT=20.253

 UNSAT
TT=17.099

 UNSAT
TT=65.466

 UNSAT
TT=70.838

 UNSAT
TT=8.321

 UNSAT
TT=55.498

 UNSAT
TT=39.52

 ?
TT=950.398

 UNSAT
TT=69.568

 UNSAT
TT=204.7
csp/fapp/fapp07/
normalized-fapp07-0600-7.xml 		UNSAT
TT=11.477

 UNSAT
TT=25.137

 UNSAT
TT=25.125

 ? (exit code)
TT=65.035

 UNSAT
TT=18.798

 UNSAT
TT=17.031

 UNSAT
TT=65.187

 UNSAT
TT=64.048

 UNSAT
TT=11.477

 UNSAT
TT=1015.7

 UNSAT
TT=692.459

 ?
TT=999.273

 UNSAT
TT=80.186

 UNSAT
TT=196.777
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp07/
normalized-fapp07-0600-8.xml 		UNSAT
TT=17.585

 UNSAT
TT=25.493

 UNSAT
TT=24.982

 ? (exit code)
TT=60.49

 UNSAT
TT=18.019

 UNSAT
TT=18.785

 UNSAT
TT=65.754

 UNSAT
TT=61.834

 UNSAT
TT=17.585

 UNSAT
TT=368.888

 ? (TO)
TT=1800.12

 ?
TT=407.768

 UNSAT
TT=123.398

 UNSAT
TT=200.101
csp/fapp/fapp08/
normalized-fapp08-0700-5.xml 		SAT
TT=48.658

 SAT
TT=52.583

 SAT
TT=48.658

 ? (exit code)
TT=62.66

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.2

 SAT
TT=56.785

 ?
TT=628.301

 ? (TO)
TT=1800.02

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.11

 ?
TT=447.677

 ? (TO)
TT=1800.21

 SAT
TT=975.771
csp/fapp/fapp08/
normalized-fapp08-0700-8.xml 		SAT
TT=33.975

 SAT
TT=33.975

 SAT
TT=37.467

 ? (exit code)
TT=60.302

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.12

 SAT
TT=53.578

 ?
TT=531.202

 SAT
TT=74.613

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.07

 ?
TT=429.499

 ? (TO)
TT=1800.33

 SAT
TT=699.39
csp/fapp/fapp08/
normalized-fapp08-0700-9.xml 		SAT
TT=13.877

 SAT
TT=32.497

 SAT
TT=33.141

 ? (exit code)
TT=61.719

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.17

 SAT
TT=51.464

 ?
TT=941.47

 SAT
TT=13.877

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.12

 ?
TT=654.38

 ? (TO)
TT=1800.3

 SAT
TT=628.188
csp/fapp/fapp09/
normalized-fapp09-0800-10.xml 		SAT
TT=10.033

 SAT
TT=32.16

 SAT
TT=32.226

 ? (exit code)
TT=60.698

 SAT
TT=1798.61

 SAT
TT=398.479

 SAT
TT=64.224

 ?
TT=539.36

 SAT
TT=10.033

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.15

 ?
TT=658.967

 ? (TO)
TT=1554.58

 SAT
TT=331.167
csp/fapp/fapp09/
normalized-fapp09-0800-3.xml 		SAT
TT=32.945

 SAT
TT=32.945

 SAT
TT=33.954

 ? (exit code)
TT=60.965

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.18

 SAT
TT=69.833

 ?
TT=533.99

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.07

 ?
TT=922.084

 ? (TO)
TT=1800.08

 SAT
TT=944.91
csp/fapp/fapp09/
normalized-fapp09-0800-6.xml 		SAT
TT=31.842

 SAT
TT=31.842

 SAT
TT=32.141

 ? (exit code)
TT=64.818

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.15

 SAT
TT=71.634

 ?
TT=646.968

 SAT
TT=195.612

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.12

 ?
TT=715.621

 ? (TO)
TT=1800.09

 SAT
TT=664.495
csp/fapp/fapp10/
normalized-fapp10-0900-0.xml 		UNSAT
TT=24.304

 UNSAT
TT=27.02

 UNSAT
TT=27.346

 ? (exit code)
TT=62.152

 UNSAT
TT=41.987

 UNSAT
TT=38.621

 UNSAT
TT=102.973

 UNSAT
TT=97.176

 UNSAT
TT=24.304

 UNSAT
TT=395.991

 UNSAT
TT=371.326

 ?
TT=507.754

 ? (MO)
TT=110.55

 UNSAT
TT=286.749
csp/fapp/fapp10/
normalized-fapp10-0900-4.xml 		UNSAT
TT=26.695

 UNSAT
TT=26.695

 UNSAT
TT=27.2

 ? (exit code)
TT=65.604

 UNSAT
TT=85.95

 UNSAT
TT=77.903

 UNSAT
TT=88.257

 UNSAT
TT=95.262

 UNSAT
TT=626.887

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.08

 ?
TT=1020.81

 ? (MO)
TT=98.35

 UNSAT
TT=317.395
csp/fapp/fapp10/
normalized-fapp10-0900-9.xml 		SAT
TT=64.803

 SAT
TT=70.1

 SAT
TT=64.803

 ? (exit code)
TT=67.529

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.12

 SAT
TT=112.744

 ?
TT=1601.97

 SAT
TT=759.188

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.07

 ?
TT=794.443

 ? (MO)
TT=111.71

 ? (MO)
TT=294.08
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp11/
normalized-fapp11-1000-3.xml 		UNSAT
TT=27.371

 UNSAT
TT=27.685

 UNSAT
TT=27.371

 ? (exit code)
TT=9.294

 UNSAT
TT=38.265

 UNSAT
TT=37.321

 UNSAT
TT=150.142

 UNSAT
TT=148.67

 ? (TO)
TT=1800.1

 UNSAT
TT=237.933

 ? (TO)
TT=1800.14

 ?
TT=439.424

 ? (MO)
TT=164.561

 ? (MO)
TT=325.224
csp/fapp/fapp11/
normalized-fapp11-1000-4.xml 		UNSAT
TT=27.068

 UNSAT
TT=27.155

 UNSAT
TT=27.068

 ? (exit code)
TT=9.234

 UNSAT
TT=39.377

 UNSAT
TT=36.625

 UNSAT
TT=154.644

 UNSAT
TT=146.59

 UNSAT
TT=115.995

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.09

 ?
TT=489.896

 ? (MO)
TT=160.96

 ? (MO)
TT=324.931
csp/fapp/fapp11/
normalized-fapp11-1000-5.xml 		UNSAT
TT=27.652

 UNSAT
TT=27.684

 UNSAT
TT=27.652

 ? (exit code)
TT=9.279

 UNSAT
TT=37.727

 UNSAT
TT=36.111

 UNSAT
TT=146.4

 UNSAT
TT=142.121

 UNSAT
TT=132.143

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.14

 ?
TT=471.018

 ? (MO)
TT=165.275

 ? (MO)
TT=323.94
csp/fapp/fapp12/
normalized-fapp12-1500-0.xml 		UNSAT
TT=28.982

 UNSAT
TT=29.757

 UNSAT
TT=28.982

 ? (exit code)
TT=11.769

 ? (TO)
TT=1800.21

 ? (TO)
TT=1800.14

 UNSAT
TT=155.544

 UNSAT
TT=166.339

 UNSAT
TT=51.467

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.11

 ?
TT=1001.41

 ?
TT=274.732

 ?
TT=264.716
csp/fapp/fapp12/
normalized-fapp12-1500-10.xml 		SAT
TT=1240.34

 SAT
TT=1240.34

 SAT
TT=1248.61

 ? (exit code)
TT=11.787

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.15

 ? (exit code)
TT=310.349

 ?
TT=383.548

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.13

 ?
TT=400.556

 ?
TT=305.762

 ?
TT=298.742
csp/fapp/fapp12/
normalized-fapp12-1500-9.xml 		SAT
TT=315.042

 SAT
TT=315.042

 SAT
TT=317.867

 ? (exit code)
TT=11.808

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.15

 ? (exit code)
TT=651.41

 ?
TT=639.398

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.08

 ?
TT=398.988

 ?
TT=296.579

 ?
TT=289.228
csp/fapp/fapp13/
normalized-fapp13-2000-2.xml 		UNSAT
TT=30.233

 UNSAT
TT=33.159

 UNSAT
TT=32.486

 ? (exit code)
TT=11.35

 UNSAT
TT=156.32

 UNSAT
TT=141.258

 UNSAT
TT=125.255

 UNSAT
TT=126.199

 UNSAT
TT=30.233

 UNSAT
TT=233.783

 ? (TO)
TT=1800.14

 ?
TT=361.086

 ? (MO)
TT=202.93

 ? (MO)
TT=255.846
csp/fapp/fapp13/
normalized-fapp13-2000-6.xml


? (TO)
TT=1800.08

 ? (TO)
TT=1800.07

 ? (exit code)
TT=11.914

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.18

 ? (TO)
TT=1800.09

 ?
TT=677.574

 ? (TO)
TT=1800.02

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.16

 ?
TT=1089.85

 ? (MO)
TT=192.394

 ? (MO)
TT=250.811
csp/fapp/fapp13/
normalized-fapp13-2000-7.xml 		SAT
TT=198.569

 SAT
TT=1435.35

 SAT
TT=198.569

 ? (exit code)
TT=11.997

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.01

 ?
TT=561.468

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.14

 ?
TT=965.825

 ? (MO)
TT=193.144

 ? (MO)
TT=260.351
csp/fapp/fapp14/
normalized-fapp14-2500-2.xml 		UNSAT
TT=36.249

 UNSAT
TT=36.249

 UNSAT
TT=36.364

 ? (exit code)
TT=15.372

 ? (TO)
TT=1800.24

 ? (TO)
TT=1800.16

 UNSAT
TT=376.798

 UNSAT
TT=350.864

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.13

 ?
TT=448.712

 ? (TO)
TT=259.253

 ?
TT=499.162
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp14/
normalized-fapp14-2500-4.xml


? (TO)
TT=1800.2

 ? (TO)
TT=1800.08

 ? (exit code)
TT=14.943

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.16

 ? (exit code)
TT=552.066

 ?
TT=524.867

 ? (TO)
TT=1800.04

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.08

 ?
TT=427.897

 ?
TT=499.26

 ?
TT=444.363
csp/fapp/fapp14/
normalized-fapp14-2500-9.xml 		SAT
TT=1515.09

 SAT
TT=1529.19

 SAT
TT=1515.09

 ? (exit code)
TT=16.017

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.28

 ? (exit code)
TT=609.433

 ?
TT=564.528

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.14

 ?
TT=999.751

 ?
TT=487.564

 ?
TT=483.035
csp/fapp/fapp15/
normalized-fapp15-3000-10.xml 		SAT
TT=62.88

 SAT
TT=62.88

 SAT
TT=66.349

 ? (exit code)
TT=13.769

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.18

 ? (exit code)
TT=563.223

 ?
TT=658.004

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.09

 ?
TT=445.818

 ?
TT=319.961

 ?
TT=316.55
csp/fapp/fapp15/
normalized-fapp15-3000-1.xml 		UNSAT
TT=31.948

 UNSAT
TT=31.948

 UNSAT
TT=31.982

 ? (exit code)
TT=12.85

 UNSAT
TT=76.083

 UNSAT
TT=113.21

 UNSAT
TT=155.907

 UNSAT
TT=146.548

 UNSAT
TT=507.481

 UNSAT
TT=392.891

 ? (TO)
TT=1800.09

 ?
TT=1062.2

 ? (TO)
TT=187.118

 ?
TT=316.208
csp/fapp/fapp15/
normalized-fapp15-3000-3.xml 		UNSAT
TT=32.029

 UNSAT
TT=32.029

 UNSAT
TT=32.036

 ? (exit code)
TT=13.777

 UNSAT
TT=103.606

 UNSAT
TT=137.111

 UNSAT
TT=138.285

 UNSAT
TT=150.35

 UNSAT
TT=1067.47

 ? (TO)
TT=1800.12

 UNSAT
TT=504.617

 ?
TT=1491.72

 ?
TT=319.7

 ?
TT=310.726
csp/fapp/fapp16/
normalized-fapp16-0260-10.xml 		UNSAT
TT=7.931

 UNSAT
TT=21.525

 UNSAT
TT=21.692

 ? (exit code)
TT=33.52

 UNSAT
TT=92.29

 UNSAT
TT=57.968

 UNSAT
TT=31.256

 UNSAT
TT=31.245

 UNSAT
TT=7.931

 UNSAT
TT=119.679

 UNSAT
TT=103.009

 ? (TO)
TT=1802.17

 UNSAT
TT=28.953

 UNSAT
TT=65.241
csp/fapp/fapp16/
normalized-fapp16-0260-2.xml 		UNSAT
TT=7.043

 UNSAT
TT=16.973

 UNSAT
TT=17.074

 ? (exit code)
TT=32.574

 UNSAT
TT=30.73

 UNSAT
TT=236.594

 UNSAT
TT=25.125

 UNSAT
TT=24.043

 UNSAT
TT=7.043

 UNSAT
TT=24.942

 UNSAT
TT=167.522

 ?
TT=855.6

 UNSAT
TT=26.173

 UNSAT
TT=58.035
csp/fapp/fapp16/
normalized-fapp16-0260-6.xml 		UNSAT
TT=8.263

 UNSAT
TT=21.318

 UNSAT
TT=21.385

 ? (exit code)
TT=36.521

 UNSAT
TT=43.918

 UNSAT
TT=219.169

 UNSAT
TT=29.246

 UNSAT
TT=27.544

 UNSAT
TT=8.263

 UNSAT
TT=101.089

 UNSAT
TT=75.108

 ?
TT=901.719

 UNSAT
TT=26.423

 UNSAT
TT=62.469
csp/fapp/fapp17/
normalized-fapp17-0300-0.xml 		UNSAT
TT=20.064

 UNSAT
TT=21.21

 UNSAT
TT=20.064

 ? (exit code)
TT=32.659

 UNSAT
TT=40.271

 UNSAT
TT=33.119

 UNSAT
TT=31.429

 UNSAT
TT=31.626

 UNSAT
TT=61.155

 UNSAT
TT=379.333

 UNSAT
TT=725.393

 ?
TT=778.776

 UNSAT
TT=34.408

 UNSAT
TT=99.974
csp/fapp/fapp17/
normalized-fapp17-0300-6.xml 		SAT
TT=12.407

 SAT
TT=22.157

 SAT
TT=22.01

 ? (exit code)
TT=34.184

 SAT
TT=26.208

 SAT
TT=22.604

 SAT
TT=41.516

 ?
TT=128.8

 SAT
TT=12.407

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.16

 ?
TT=778.654

 SAT
TT=144.944

 SAT
TT=155.11
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp17/
normalized-fapp17-0300-9.xml 		SAT
TT=15.784

 SAT
TT=22.053

 SAT
TT=22.009

 ? (exit code)
TT=35.753

 SAT
TT=20.56

 SAT
TT=23.762

 SAT
TT=41.428

 ?
TT=128.054

 SAT
TT=15.784

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.16

 ?
TT=535.174

 SAT
TT=169.242

 SAT
TT=161.629
csp/fapp/fapp18/
normalized-fapp18-0350-0.xml 		UNSAT
TT=4.316

 UNSAT
TT=16.868

 UNSAT
TT=16.979

 ? (exit code)
TT=35.046

 UNSAT
TT=5.298

 UNSAT
TT=4.316

 UNSAT
TT=26.408

 UNSAT
TT=26.435

 UNSAT
TT=5.116

 UNSAT
TT=5.274

 UNSAT
TT=5.232

 ?
TT=511.084

 UNSAT
TT=31.703

 UNSAT
TT=99.368
csp/fapp/fapp18/
normalized-fapp18-0350-2.xml 		UNSAT
TT=3.905

 UNSAT
TT=19.646

 UNSAT
TT=21.159

 ? (exit code)
TT=32.567

 UNSAT
TT=4.751

 UNSAT
TT=3.905

 UNSAT
TT=27.592

 UNSAT
TT=27.482

 UNSAT
TT=5.458

 UNSAT
TT=5.24

 UNSAT
TT=5.248

 ?
TT=509.198

 UNSAT
TT=32.533

 UNSAT
TT=97.437
csp/fapp/fapp18/
normalized-fapp18-0350-3.xml 		UNSAT
TT=4.11

 UNSAT
TT=21.157

 UNSAT
TT=21.336

 ? (exit code)
TT=32.381

 UNSAT
TT=4.929

 UNSAT
TT=4.11

 UNSAT
TT=29.416

 UNSAT
TT=28.446

 UNSAT
TT=5.407

 UNSAT
TT=5.229

 UNSAT
TT=5.242

 ?
TT=524.843

 UNSAT
TT=41.383

 UNSAT
TT=110.432
csp/fapp/fapp19/
normalized-fapp19-0350-1.xml 		UNSAT
TT=22.927

 UNSAT
TT=22.981

 UNSAT
TT=22.927

 ? (exit code)
TT=59.831

 UNSAT
TT=247.178

 UNSAT
TT=242.641

 UNSAT
TT=201.52

 UNSAT
TT=188.959

 UNSAT
TT=90.055

 UNSAT
TT=66.252

 ? (TO)
TT=1800.13

 ?
TT=0.743

 ? (MO)
TT=147

 UNSAT
TT=335.989
csp/fapp/fapp19/
normalized-fapp19-0350-2.xml 		UNSAT
TT=22.887

 UNSAT
TT=23.219

 UNSAT
TT=22.887

 ? (exit code)
TT=64.155

 UNSAT
TT=161.605

 UNSAT
TT=228.085

 UNSAT
TT=216.071

 UNSAT
TT=226.395

 UNSAT
TT=89.013

 ? (TO)
TT=1800.11

 UNSAT
TT=321.055

 ?
TT=0.756

 ? (MO)
TT=147.22

 UNSAT
TT=348.119
csp/fapp/fapp19/
normalized-fapp19-0350-8.xml 		SAT
TT=26.342

 SAT
TT=26.342

 SAT
TT=26.883

 ? (exit code)
TT=64.591

 SAT
TT=235.444

 SAT
TT=191.242

 SAT
TT=284.541

 ?
TT=318.425

 SAT
TT=550.804

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.13

 ?
TT=0.787

 ? (MO)
TT=167.1

 ? (MO)
TT=312.794
csp/fapp/fapp20/
normalized-fapp20-0420-0.xml 		UNSAT
TT=16.319

 UNSAT
TT=16.498

 UNSAT
TT=16.319

 ? (exit code)
TT=59.514

 UNSAT
TT=29.002

 UNSAT
TT=37.758

 UNSAT
TT=32.118

 UNSAT
TT=29.378

 UNSAT
TT=16.908

 UNSAT
TT=21.423

 UNSAT
TT=46.341

 ?
TT=464.423

 UNSAT
TT=48.692

 UNSAT
TT=113.059
csp/fapp/fapp20/
normalized-fapp20-0420-10.xml 		SAT
TT=11.632

 SAT
TT=22.762

 SAT
TT=22.721

 ? (exit code)
TT=61.157

 SAT
TT=31.691

 SAT
TT=34.619

 SAT
TT=49.802

 ?
TT=127.083

 SAT
TT=11.632

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.12

 ?
TT=906.7

 SAT
TT=217.684

 SAT
TT=200.52
csp/fapp/fapp20/
normalized-fapp20-0420-8.xml 		UNSAT
TT=17.724

 UNSAT
TT=22.333

 UNSAT
TT=22.098

 ? (exit code)
TT=59.43

 UNSAT
TT=48.948

 UNSAT
TT=40.721

 UNSAT
TT=39.782

 UNSAT
TT=43.066

 UNSAT
TT=17.724

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.16

 ?
TT=465.371

 UNSAT
TT=50.156

 UNSAT
TT=113.515
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp21/
normalized-fapp21-0500-1.xml 		UNSAT
TT=5.868

 UNSAT
TT=6.498

 UNSAT
TT=6.486

 ? (exit code)
TT=35.552

 UNSAT
TT=21.722

 UNSAT
TT=23.457

 UNSAT
TT=14.971

 UNSAT
TT=14.373

 UNSAT
TT=5.868

 UNSAT
TT=129.278

 ? (TO)
TT=1800.15

 ?
TT=477.128

 UNSAT
TT=53.858

 UNSAT
TT=118.718
csp/fapp/fapp21/
normalized-fapp21-0500-4.xml 		SAT
TT=18.212

 SAT
TT=18.212

 SAT
TT=19.375

 ? (exit code)
TT=33.577

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.14

 SAT
TT=21.975

 ?
TT=133.124

 ? (TO)
TT=1800.01

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.12

 ?
TT=490.697

 SAT
TT=206.746

 SAT
TT=189.267
csp/fapp/fapp21/
normalized-fapp21-0500-9.xml 		SAT
TT=21.93

 SAT
TT=21.93

 SAT
TT=22.029

 ? (exit code)
TT=32.626

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.15

 SAT
TT=25.437

 ?
TT=122.711

 SAT
TT=288.527

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.09

 ?
TT=984.5

 SAT
TT=243.869

 SAT
TT=214.174
csp/fapp/fapp22/
normalized-fapp22-1750-2.xml 		UNSAT
TT=30.778

 UNSAT
TT=30.96

 UNSAT
TT=30.778

 ? (exit code)
TT=13.604

 UNSAT
TT=225.966

 UNSAT
TT=241.485

 UNSAT
TT=320.081

 UNSAT
TT=327.654

 UNSAT
TT=418.582

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.06

 ?
TT=0.586

 ?
TT=685.597

 ?
TT=718.877
csp/fapp/fapp22/
normalized-fapp22-1750-5.xml 		UNSAT
TT=30.559

 UNSAT
TT=30.559

 UNSAT
TT=31.25

 ? (exit code)
TT=13.502

 UNSAT
TT=229.136

 UNSAT
TT=224.755

 UNSAT
TT=330.404

 UNSAT
TT=317.211

 UNSAT
TT=437.566

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.09

 ?
TT=0.581

 ?
TT=654.849

 ?
TT=720.916
csp/fapp/fapp22/
normalized-fapp22-1750-9.xml 		SAT
TT=36.614

 SAT
TT=36.614

 SAT
TT=37.91

 ? (exit code)
TT=12.673

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.18

 ? (exit code)
TT=509.423

 ?
TT=442.131

 SAT
TT=1049.08

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.11

 ?
TT=0.622

 ?
TT=655.899

 ?
TT=725.183
csp/fapp/fapp23/
normalized-fapp23-1800-0.xml 		UNSAT
TT=34.633

 UNSAT
TT=34.633

 UNSAT
TT=34.895

 ? (exit code)
TT=33.88

 UNSAT
TT=37.058

 UNSAT
TT=35.426

 UNSAT
TT=486.53

 UNSAT
TT=546.609

 UNSAT
TT=105.121

 UNSAT
TT=105.257

 UNSAT
TT=102.129

 ?
TT=1034.47

 ?
TT=420.033

 ?
TT=452.852
csp/fapp/fapp23/
normalized-fapp23-1800-10.xml 		SAT
TT=38.251

 SAT
TT=38.251

 SAT
TT=39.371

 ? (exit code)
TT=36.173

 SAT
TT=172.417

 SAT
TT=71.892

 ? (exit code)
TT=651.638

 ?
TT=698.409

 SAT
TT=122.734

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.16

 ?
TT=1340.34

 ?
TT=445.604

 ?
TT=422.064
csp/fapp/fapp23/
normalized-fapp23-1800-9.xml 		SAT
TT=38.195

 SAT
TT=38.195

 SAT
TT=38.566

 ? (exit code)
TT=36.792

 SAT
TT=104.891

 SAT
TT=142.769

 ? (exit code)
TT=691.024

 ?
TT=683.957

 SAT
TT=118.713

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.18

 ?
TT=464.684

 ?
TT=438.238

 ?
TT=691.828
csp/fapp/fapp24/
normalized-fapp24-2000-10.xml 		SAT
TT=28.728

 SAT
TT=28.728

 SAT
TT=29.234

 ? (exit code)
TT=12.27

 ? (TO)
TT=1800.2

 ? (TO)
TT=1800.17

 ? (exit code)
TT=333.142

 ?
TT=267.343

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.14

 ?
TT=472.498

 ?
TT=313.915

 ?
TT=316.702
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp24/
normalized-fapp24-2000-2.xml 		UNSAT
TT=25.559

 UNSAT
TT=25.559

 ? (MO)
TT=23.114

 ? (exit code)
TT=12.233

 UNSAT
TT=52.771

 UNSAT
TT=54.333

 UNSAT
TT=161.192

 UNSAT
TT=152.658

 UNSAT
TT=106.008

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.14

 ?
TT=476.685

 ?
TT=312.218

 ?
TT=300.546
csp/fapp/fapp24/
normalized-fapp24-2000-9.xml 		SAT
TT=29.181

 SAT
TT=29.181

 SAT
TT=29.203

 ? (exit code)
TT=11.48

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.22

 ? (exit code)
TT=307.34

 ?
TT=255.318

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.07

 ?
TT=500.93

 ?
TT=319.881

 ?
TT=311.121
csp/fapp/fapp25/
normalized-fapp25-2230-0.xml 		UNSAT
TT=9.51

 UNSAT
TT=24.595

 UNSAT
TT=24.631

 ? (exit code)
TT=10.124

 UNSAT
TT=9.51

 UNSAT
TT=16.186

 UNSAT
TT=101.423

 UNSAT
TT=94.333

 UNSAT
TT=47.286

 UNSAT
TT=32.619

 UNSAT
TT=32.652

 ?
TT=931.615

 ? (MO)
TT=226.666

 ? (MO)
TT=280.1
csp/fapp/fapp25/
normalized-fapp25-2230-1.xml 		UNSAT
TT=9.481

 UNSAT
TT=24.829

 UNSAT
TT=24.322

 ? (exit code)
TT=10.151

 UNSAT
TT=9.481

 UNSAT
TT=15.937

 UNSAT
TT=101.702

 UNSAT
TT=100.487

 UNSAT
TT=43.989

 UNSAT
TT=32.634

 UNSAT
TT=32.667

 ?
TT=415.605

 ? (MO)
TT=227.156

 ? (MO)
TT=280.138
csp/fapp/fapp25/
normalized-fapp25-2230-9.xml 		SAT
TT=29.05

 SAT
TT=29.05

 SAT
TT=29.134

 ? (exit code)
TT=10.044

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.18

 ? (exit code)
TT=432.872

 ?
TT=203.08

 SAT
TT=53.119

 ? (TO)
TT=1800.2

 ? (TO)
TT=1800.13

 ?
TT=429.607

 ? (MO)
TT=283.6

 ? (MO)
TT=291.415
csp/fapp/fapp26/
normalized-fapp26-2300-10.xml 		SAT
TT=29.399

 SAT
TT=29.746

 SAT
TT=29.399

 ? (exit code)
TT=10.969

 ? (TO)
TT=1800.21

 ? (TO)
TT=1800.11

 ? (exit code)
TT=341.661

 ?
TT=263.32

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.13

 ?
TT=482.274

 ?
TT=276.207

 ?
TT=275.592
csp/fapp/fapp26/
normalized-fapp26-2300-3.xml 		UNSAT
TT=25.464

 UNSAT
TT=25.464

 UNSAT
TT=25.672

 ? (exit code)
TT=11.727

 UNSAT
TT=35.768

 UNSAT
TT=38.016

 UNSAT
TT=168.579

 UNSAT
TT=151.509

 UNSAT
TT=306.657

 UNSAT
TT=107.977

 UNSAT
TT=93.056

 ?
TT=495.596

 ?
TT=283.044

 ?
TT=267.167
csp/fapp/fapp26/
normalized-fapp26-2300-6.xml 		UNSAT
TT=26.546

 UNSAT
TT=26.811

 UNSAT
TT=26.546

 ? (exit code)
TT=10.816

 UNSAT
TT=193.011

 UNSAT
TT=148.095

 UNSAT
TT=177.731

 UNSAT
TT=174.967

 UNSAT
TT=401.286

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.13

 ?
TT=1249.96

 ?
TT=279.445

 ?
TT=289.286
csp/fapp/fapp27/
normalized-fapp27-2550-10.xml 		SAT
TT=32.221

 SAT
TT=32.221

 SAT
TT=32.762

 ? (exit code)
TT=8.359

 ? (TO)
TT=1800.2

 ? (TO)
TT=1800.17

 SAT
TT=140.143

 ?
TT=200.429

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.17

 ?
TT=496.315

 ? (MO)
TT=143.483

 ? (MO)
TT=208.071
csp/fapp/fapp27/
normalized-fapp27-2550-6.xml 		SAT
TT=31.949

 SAT
TT=32.203

 SAT
TT=31.949

 ? (exit code)
TT=7.799

 ? (TO)
TT=1800.18

 ? (TO)
TT=1800.14

 SAT
TT=136.166

 ?
TT=176.081

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.18

 ? (TO)
TT=1800.12

 ?
TT=491.132

 ? (MO)
TT=155.856

 ? (MO)
TT=199.44
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp27/
normalized-fapp27-2550-8.xml 		SAT
TT=32.076

 SAT
TT=32.076

 SAT
TT=32.347

 ? (exit code)
TT=8.414

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.14

 SAT
TT=131.252

 ?
TT=184.347

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.13

 ?
TT=492.437

 ? (MO)
TT=158.722

 ? (MO)
TT=195.899
csp/fapp/fapp28/
normalized-fapp28-2800-2.xml 		UNSAT
TT=29.199

 UNSAT
TT=29.199

 UNSAT
TT=29.526

 ? (exit code)
TT=11.408

 UNSAT
TT=331.253

 UNSAT
TT=268.324

 UNSAT
TT=301.41

 UNSAT
TT=268.317

 ? (TO)
TT=1800.04

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.12

 ?
TT=0.787

 ?
TT=1062.84

 ?
TT=1036.12
csp/fapp/fapp28/
normalized-fapp28-2800-6.xml 		SAT
TT=47.057

 SAT
TT=47.765

 SAT
TT=47.057

 ? (exit code)
TT=11.461

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.11

 ? (exit code)
TT=499.149

 ?
TT=425.897

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.12

 ?
TT=0.762

 ?
TT=1083.01

 ?
TT=1018.33
csp/fapp/fapp28/
normalized-fapp28-2800-9.xml 		SAT
TT=49.046

 SAT
TT=49.046

 SAT
TT=51.62

 ? (exit code)
TT=11.507

 ? (TO)
TT=1800.22

 ? (TO)
TT=1800.16

 ? (exit code)
TT=494.438

 ?
TT=412.799

 ? (TO)
TT=1800.04

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.11

 ?
TT=0.756

 ?
TT=1049.21

 ?
TT=1075.39
csp/fapp/fapp29/
normalized-fapp29-2900-10.xml 		SAT
TT=46.767

 SAT
TT=47.341

 SAT
TT=46.767

 ? (exit code)
TT=34.775

 SAT
TT=1233.21

 ? (TO)
TT=1800.2

 ? (exit code)
TT=760.247

 ?
TT=659.335

 SAT
TT=413.286

 SAT
TT=256.216

 SAT
TT=243.978

 ?
TT=0.753

 ?
TT=1016.13

 ?
TT=941.442
csp/fapp/fapp29/
normalized-fapp29-2900-5.xml 		UNSAT
TT=16.847

 UNSAT
TT=41.405

 UNSAT
TT=41.909

 ? (exit code)
TT=36.917

 UNSAT
TT=28.776

 UNSAT
TT=16.847

 UNSAT
TT=602.23

 UNSAT
TT=601.795

 UNSAT
TT=259.825

 UNSAT
TT=210.373

 UNSAT
TT=210.215

 ?
TT=0.751

 ?
TT=977.707

 ?
TT=1008.36
csp/fapp/fapp29/
normalized-fapp29-2900-8.xml 		SAT
TT=45.933

 SAT
TT=45.933

 SAT
TT=46.743

 ? (exit code)
TT=37.257

 SAT
TT=115.673

 SAT
TT=62.565

 ? (exit code)
TT=780.236

 ?
TT=642.007

 SAT
TT=366.68

 SAT
TT=249.111

 SAT
TT=252.411

 ?
TT=0.751

 ?
TT=966.651

 ?
TT=954.894
csp/fapp/fapp30/
normalized-fapp30-3000-0.xml 		UNSAT
TT=37.818

 UNSAT
TT=37.818

 UNSAT
TT=38.074

 ? (exit code)
TT=35.59

 UNSAT
TT=357.587

 UNSAT
TT=290.669

 ? (TO)
TT=561.23

 ? (TO)
TT=586.42

 UNSAT
TT=904.873

 ? (TO)
TT=1800.13

 UNSAT
TT=477.927

 ?
TT=0.623

 ?
TT=1050.36

 ?
TT=1017.18
csp/fapp/fapp30/
normalized-fapp30-3000-3.xml 		UNSAT
TT=39.057

 UNSAT
TT=39.606

 UNSAT
TT=39.057

 ? (exit code)
TT=36.437

 UNSAT
TT=409.632

 UNSAT
TT=537.134

 ?
TT=576.61

 ? (TO)
TT=580.85

 UNSAT
TT=895.155

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.1

 ?
TT=0.644

 ?
TT=1400.63

 ?
TT=1006.45
csp/fapp/fapp30/
normalized-fapp30-3000-9.xml 		SAT
TT=89.789

 ? (MO)
TT=26.22

 SAT
TT=89.789

 ? (exit code)
TT=36.135

 ? (TO)
TT=1801.31

 ? (TO)
TT=1800.16

 ? (TO)
TT=579.77

 ? (TO)
TT=656.14

 ? (TO)
TT=1800.03

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.11

 ?
TT=0.617

 ?
TT=992.655

 ?
TT=1009.24
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp31/
normalized-fapp31-0400-2.xml 		UNSAT
TT=30.544

 UNSAT
TT=31.175

 UNSAT
TT=30.544

 ? (exit code)
TT=34.789

 ? (TO)
TT=1800.18

 ? (TO)
TT=1800.15

 UNSAT
TT=179.114

 UNSAT
TT=178.905

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.11

 ?
TT=0.611

 UNSAT
TT=102.67

 UNSAT
TT=181.294
csp/fapp/fapp31/
normalized-fapp31-0400-6.xml 		SAT
TT=138.089

 SAT
TT=138.089

 SAT
TT=145.125

 ? (exit code)
TT=35.057

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.14

 SAT
TT=207.028

 ?
TT=296.03

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.12

 ?
TT=0.627

 SAT
TT=529.172

 SAT
TT=319.843
csp/fapp/fapp31/
normalized-fapp31-0400-7.xml 		SAT
TT=176.203

 SAT
TT=184.471

 SAT
TT=176.203

 ? (exit code)
TT=35.476

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.07

 SAT
TT=193.646

 ?
TT=317.882

 ? (TO)
TT=1800.03

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.17

 ?
TT=0.611

 SAT
TT=518.969

 SAT
TT=343.025
csp/fapp/fapp32/
normalized-fapp32-0550-1.xml 		UNSAT
TT=26.041

 UNSAT
TT=26.467

 UNSAT
TT=26.041

 ? (exit code)
TT=66.368

 UNSAT
TT=281.905

 UNSAT
TT=368.764

 UNSAT
TT=259.515

 UNSAT
TT=277.362

 UNSAT
TT=427.772

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.08

 ?
TT=0.621

 ? (MO)
TT=368.85

 ? (MO)
TT=512.454
csp/fapp/fapp32/
normalized-fapp32-0550-4.xml 		UNSAT
TT=25.986

 UNSAT
TT=25.986

 UNSAT
TT=26.394

 ? (exit code)
TT=60.729

 UNSAT
TT=1103.08

 UNSAT
TT=341.431

 UNSAT
TT=287.612

 UNSAT
TT=282.527

 UNSAT
TT=1132.72

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.09

 ?
TT=0.636

 ? (MO)
TT=345.187

 ? (MO)
TT=500.196
csp/fapp/fapp32/
normalized-fapp32-0550-6.xml 		SAT
TT=33.825

 SAT
TT=33.825

 SAT
TT=35.173

 ? (exit code)
TT=64.986

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.13

 SAT
TT=333.35

 ?
TT=363.218

 ? (TO)
TT=1800.03

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.06

 ?
TT=0.602

 ? (MO)
TT=370.273

 ? (MO)
TT=588.85
csp/fapp/fapp33/
normalized-fapp33-0650-10.xml 		SAT
TT=29.787

 SAT
TT=29.787

 SAT
TT=30.284

 ? (exit code)
TT=60.777

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.2

 SAT
TT=187.621

 ?
TT=252.476

 ? (TO)
TT=1800.04

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.08

 ?
TT=663.705

 ? (MO)
TT=128.61

 ? (MO)
TT=301.736
csp/fapp/fapp33/
normalized-fapp33-0650-4.xml 		UNSAT
TT=24.614

 UNSAT
TT=24.932

 UNSAT
TT=24.614

 ? (exit code)
TT=65.277

 UNSAT
TT=65.779

 UNSAT
TT=80.912

 UNSAT
TT=142.071

 UNSAT
TT=146.477

 UNSAT
TT=48.523

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.09

 ?
TT=512.406

 ? (MO)
TT=125.18

 ? (MO)
TT=285.943
csp/fapp/fapp33/
normalized-fapp33-0650-7.xml 		SAT
TT=29.357

 SAT
TT=30.065

 SAT
TT=29.357

 ? (exit code)
TT=60.521

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.15

 SAT
TT=181.833

 ?
TT=218.568

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.13

 ?
TT=511.23

 ? (MO)
TT=126.09

 ? (MO)
TT=294.81
csp/fapp/fapp34/
normalized-fapp34-0750-10.xml 		SAT
TT=29.96

 SAT
TT=30.451

 SAT
TT=29.96

 ? (exit code)
TT=66.628

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.15

 SAT
TT=275.641

 ?
TT=324.231

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.13

 ?
TT=0.752

 ? (MO)
TT=135.56

 SAT
TT=804.443
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp34/
normalized-fapp34-0750-2.xml 		UNSAT
TT=25.395

 UNSAT
TT=25.434

 UNSAT
TT=25.395

 ? (exit code)
TT=67.386

 ? (TO)
TT=1800.12

 UNSAT
TT=398.146

 UNSAT
TT=248.892

 UNSAT
TT=241.35

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.16

 UNSAT
TT=867.982

 ?
TT=0.759

 ? (MO)
TT=140.24

 UNSAT
TT=307.044
csp/fapp/fapp34/
normalized-fapp34-0750-4.xml 		SAT
TT=28.36

 SAT
TT=28.36

 SAT
TT=28.689

 ? (exit code)
TT=62.506

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.12

 SAT
TT=275.155

 ?
TT=594.994

 ? (TO)
TT=1800.01

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.14

 ?
TT=0.716

 ? (MO)
TT=137.42

 SAT
TT=769.789
csp/fapp/fapp35/
normalized-fapp35-1500-4.xml 		UNSAT
TT=30.869

 UNSAT
TT=30.967

 UNSAT
TT=30.869

 ? (exit code)
TT=10.998

 UNSAT
TT=141.732

 UNSAT
TT=159.469

 UNSAT
TT=295.343

 UNSAT
TT=304.17

 UNSAT
TT=227.025

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.09

 ?
TT=0.602

 ? (MO)
TT=771.589

 ? (MO)
TT=565.149
csp/fapp/fapp35/
normalized-fapp35-1500-7.xml 		SAT
TT=63.302

 SAT
TT=63.302

 SAT
TT=64.875

 ? (exit code)
TT=10.428

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.25

 ? (exit code)
TT=516.198

 ?
TT=503.36

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.08

 ?
TT=0.612

 ? (MO)
TT=474.215

 ? (MO)
TT=554.542
csp/fapp/fapp35/
normalized-fapp35-1500-9.xml 		SAT
TT=57.561

 SAT
TT=57.561

 SAT
TT=59.652

 ? (exit code)
TT=10.269

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.14

 ? (exit code)
TT=491.275

 ?
TT=464.161

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.07

 ?
TT=0.615

 ? (MO)
TT=493.821

 ? (MO)
TT=596.687
csp/fapp/fapp36/
normalized-fapp36-2000-0.xml 		UNSAT
TT=27.494

 UNSAT
TT=27.494

 UNSAT
TT=27.535

 ? (exit code)
TT=9.602

 UNSAT
TT=53.325

 UNSAT
TT=53.359

 UNSAT
TT=221.071

 UNSAT
TT=243.897

 UNSAT
TT=384.663

 UNSAT
TT=66.282

 UNSAT
TT=42.182

 ?
TT=714.674

 ? (MO)
TT=278.321

 ? (MO)
TT=348.653
csp/fapp/fapp36/
normalized-fapp36-2000-1.xml 		UNSAT
TT=27.524

 UNSAT
TT=27.524

 UNSAT
TT=27.961

 ? (exit code)
TT=10.215

 UNSAT
TT=53.92

 UNSAT
TT=58.236

 UNSAT
TT=231.325

 UNSAT
TT=225.953

 UNSAT
TT=69.092

 ? (TO)
TT=1800.11

 UNSAT
TT=512.165

 ?
TT=1735.04

 ? (MO)
TT=287.233

 ? (MO)
TT=325.884
csp/fapp/fapp36/
normalized-fapp36-2000-3.xml 		UNSAT
TT=27.348

 UNSAT
TT=27.795

 UNSAT
TT=27.348

 ? (exit code)
TT=10.344

 UNSAT
TT=58.081

 UNSAT
TT=58.716

 UNSAT
TT=227.869

 UNSAT
TT=251.455

 UNSAT
TT=75.152

 UNSAT
TT=132.841

 UNSAT
TT=133.138

 ?
TT=476.093

 ? (MO)
TT=286.659

 ? (MO)
TT=341.419
csp/fapp/fapp37/
normalized-fapp37-2250-2.xml 		UNSAT
TT=41.48

 UNSAT
TT=41.671

 UNSAT
TT=41.48

 ? (exit code)
TT=28.963

 UNSAT
TT=242.688

 UNSAT
TT=278.686

 UNSAT
TT=407.251

 UNSAT
TT=400.58

 UNSAT
TT=1205.7

 ? (TO)
TT=1800.19

 ? (TO)
TT=1800.1

 ?
TT=0.749

 ?
TT=1060.32

 ?
TT=1089.9
csp/fapp/fapp37/
normalized-fapp37-2250-4.xml 		UNSAT
TT=46.751

 UNSAT
TT=48.355

 UNSAT
TT=46.751

 ? (exit code)
TT=31.048

 ? (TO)
TT=1800.18

 ? (TO)
TT=1800.22

 UNSAT
TT=429.165

 UNSAT
TT=412.629

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.16

 ?
TT=0.753

 ?
TT=1035.1

 ?
TT=1112.39
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/fapp/fapp37/
normalized-fapp37-2250-9.xml 		SAT
TT=65.045

 SAT
TT=65.045

 SAT
TT=66.167

 ? (exit code)
TT=30.995

 ? (TO)
TT=1800.23

 ? (TO)
TT=1800.2

 ? (exit code)
TT=583.586

 ?
TT=518.65

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.11

 ?
TT=0.76

 ?
TT=1070.34

 ?
TT=1033.95
csp/fapp/fapp38/
normalized-fapp38-2500-3.xml 		SAT
TT=65.029

 SAT
TT=67.06

 SAT
TT=65.029

 ? (exit code)
TT=36.955

 ? (problem)
TT=158.071

 ? (TO)
TT=1800.15

 ?
TT=748.292

 ?
TT=889.567

 ? (TO)
TT=1800.03

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.17

 ?
TT=0.578

 ?
TT=755.859

 ?
TT=762.012
csp/fapp/fapp38/
normalized-fapp38-2500-4.xml 		SAT
TT=65.795

 SAT
TT=65.795

 SAT
TT=66.569

 ? (exit code)
TT=35.205

 ? (problem)
TT=143.576

 ? (TO)
TT=1800.15

 ? (exit code)
TT=698.3

 ?
TT=1422.42

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.12

 ?
TT=0.586

 ?
TT=761.625

 ?
TT=793.276
csp/fapp/fapp38/
normalized-fapp38-2500-9.xml 		SAT
TT=76.995

 SAT
TT=80.076

 SAT
TT=76.995

 ? (exit code)
TT=35.762

 ? (problem)
TT=149.631

 ? (TO)
TT=1800.26

 ? (exit code)
TT=812.447

 ?
TT=999.977

 ? (TO)
TT=1800.02

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.14

 ?
TT=0.614

 ?
TT=1011.82

 ?
TT=765.171
csp/fapp/fapp39/
normalized-fapp39-2750-10.xml


? (TO)
TT=1800.15

 ? (TO)
TT=1800.11

 ? (exit code)
TT=11.566

 ? (TO)
TT=1800.2

 ? (TO)
TT=1800.13

 ? (exit code)
TT=676.078

 ?
TT=633.528

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.09

 ?
TT=0.617

 ?
TT=561.938

 ?
TT=551.089
csp/fapp/fapp39/
normalized-fapp39-2750-2.xml 		UNSAT
TT=464.573

 UNSAT
TT=466.512

 UNSAT
TT=464.573

 ? (exit code)
TT=10.679

 ? (TO)
TT=1800.17

 ? (TO)
TT=1800.19

 ? (exit code)
TT=861.361

 ?
TT=926.535

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.15

 ?
TT=0.657

 ?
TT=640.519

 ?
TT=548.838
csp/fapp/fapp39/
normalized-fapp39-2750-3.xml 		SAT
TT=643.335

 SAT
TT=693.789

 SAT
TT=643.335

 ? (exit code)
TT=10.728

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.19

 ? (exit code)
TT=923.649

 ?
TT=626.115

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.17

 ?
TT=0.562

 ?
TT=555.472

 ?
TT=536.669
csp/fapp/fapp40/
normalized-fapp40-3000-10.xml 		SAT
TT=91.555

 SAT
TT=91.555

 SAT
TT=93.563

 ? (exit code)
TT=33.897

 ? (problem)
TT=141.717

 ? (TO)
TT=1800.13

 ? (exit code)
TT=1393.32

 ?
TT=925.33

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.13

 ?
TT=0.592

 ?
TT=727.095

 ?
TT=710.702
csp/fapp/fapp40/
normalized-fapp40-3000-2.xml 		UNSAT
TT=44.245

 UNSAT
TT=44.245

 UNSAT
TT=44.627

 ? (exit code)
TT=34.267

 ? (problem)
TT=149.232

 ? (TO)
TT=1800.25

 UNSAT
TT=523.125

 UNSAT
TT=528.374

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.16

 ? (TO)
TT=1800.06

 ?
TT=0.61

 ?
TT=727.828

 ?
TT=676.127
csp/fapp/fapp40/
normalized-fapp40-3000-7.xml 		SAT
TT=71.449

 SAT
TT=73.78

 SAT
TT=71.449

 ? (exit code)
TT=34.71

 ? (problem)
TT=147.519

 ? (TO)
TT=1800.25

 ? (TO)
TT=1800.04

 ?
TT=1263.32

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.09

 ?
TT=0.629

 ?
TT=689.835

 ?
TT=727.693
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/ogdPuzzle/
normalized-crossword-m1-ogd-puzzle01.xml 		SAT
TT=0.008

 SAT
TT=0.709

 SAT
TT=0.666

 SAT
TT=0.029

 SAT
TT=0.515

 SAT
TT=0.532

 SAT
TT=1.057

 SAT
TT=1.139

 SAT
TT=0.008

 SAT
TT=0.017

 SAT
TT=0.017

 SAT
TT=0.729

 SAT
TT=0.54

 SAT
TT=0.546
csp/rlfapGraphsMod/
normalized-graph12-w0.xml 		SAT
TT=0.084

 SAT
TT=2.324

 SAT
TT=1.946

 SAT
TT=0.166

 SAT
TT=1.437

 SAT
TT=1.413

 SAT
TT=3.069

 SAT
TT=7.479

 SAT
TT=0.084

 SAT
TT=0.52

 SAT
TT=0.498

 SAT
TT=3.968

 SAT
TT=2.652

 SAT
TT=3.301
csp/rlfapGraphsMod/
normalized-graph12-w1.xml 		UNSAT
TT=0.217

 UNSAT
TT=1.91

 UNSAT
TT=1.776

 ? (TO)
TT=1800.03

 UNSAT
TT=1.496

 UNSAT
TT=1.414

 UNSAT
TT=3.705

 UNSAT
TT=5.322

 UNSAT
TT=0.217

 UNSAT
TT=9.523

 UNSAT
TT=8.915

 UNSAT
TT=7.128

 UNSAT
TT=3.774

 UNSAT
TT=4.297
csp/rlfapGraphsMod/
normalized-graph13-w0.xml 		SAT
TT=0.124

 SAT
TT=3.753

 SAT
TT=3.272

 SAT
TT=0.211

 SAT
TT=1.761

 SAT
TT=1.663

 SAT
TT=4.317

 SAT
TT=11.847

 SAT
TT=0.124

 SAT
TT=0.708

 SAT
TT=0.712

 SAT
TT=4.345

 SAT
TT=3.442

 SAT
TT=3.829
csp/rlfapGraphsMod/
normalized-graph13-w1.xml 		UNSAT
TT=0.247

 UNSAT
TT=2.203

 UNSAT
TT=1.854

 UNSAT
TT=1341.77

 UNSAT
TT=1.342

 UNSAT
TT=1.233

 UNSAT
TT=4.587

 UNSAT
TT=4.576

 UNSAT
TT=0.247

 UNSAT
TT=9.319

 UNSAT
TT=9.274

 UNSAT
TT=8.926

 UNSAT
TT=4.616

 UNSAT
TT=6.054
csp/rlfapGraphsMod/
normalized-graph14-f27.xml 		SAT
TT=0.52

 SAT
TT=4.747

 SAT
TT=9.383

 ? (TO)
TT=1800.04

 SAT
TT=13.117

 SAT
TT=9.733

 SAT
TT=23.094

 SAT
TT=608.265

 SAT
TT=0.52

 SAT
TT=69.236

 SAT
TT=64.173

 SAT
TT=18.051

 SAT
TT=12.529

 SAT
TT=6.713
csp/rlfapGraphsMod/
normalized-graph2-f24.xml 		SAT
TT=0.174

 SAT
TT=2.217

 SAT
TT=6.528

 SAT
TT=0.384

 SAT
TT=2.615

 SAT
TT=2.658

 SAT
TT=4.534

 SAT
TT=142.24

 SAT
TT=0.174

 SAT
TT=6.247

 SAT
TT=5.314

 SAT
TT=7.504

 SAT
TT=3.449

 SAT
TT=4.104
csp/rlfapGraphsMod/
normalized-graph2-f25.xml 		UNSAT
TT=0.654

 UNSAT
TT=3.558

 UNSAT
TT=5.12

 ? (TO)
TT=1800.04

 UNSAT
TT=3.099

 UNSAT
TT=3.2

 UNSAT
TT=4.989

 UNSAT
TT=13.914

 UNSAT
TT=0.654

 UNSAT
TT=16.498

 UNSAT
TT=7.481

 UNSAT
TT=6.132

 UNSAT
TT=3.086

 UNSAT
TT=3.603
csp/rlfapGraphsMod/
normalized-graph8-f10.xml 		SAT
TT=0.946

 SAT
TT=4.334

 SAT
TT=3.92

 ? (TO)
TT=1800.05

 SAT
TT=5.74

 SAT
TT=5.576

 SAT
TT=11.607

 SAT
TT=313.133

 SAT
TT=0.946

 SAT
TT=554.684

 SAT
TT=529.598

 SAT
TT=12.897

 SAT
TT=18.664

 SAT
TT=8.45
csp/rlfapGraphsMod/
normalized-graph9-f10.xml 		UNSAT
TT=2.332

 UNSAT
TT=7.003

 UNSAT
TT=8.171

 ? (TO)
TT=1800.01

 UNSAT
TT=6.022

 UNSAT
TT=6.154

 UNSAT
TT=8.675

 UNSAT
TT=46.971

 UNSAT
TT=2.332

 UNSAT
TT=510.313

 UNSAT
TT=657.161

 UNSAT
TT=19.634

 UNSAT
TT=9.692

 UNSAT
TT=11.927
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/rlfapGraphsMod/
normalized-graph9-f9.xml 		SAT
TT=2.615

 SAT
TT=5.915

 SAT
TT=6.222

 ? (TO)
TT=1800.11

 SAT
TT=17.334

 SAT
TT=16.235

 SAT
TT=25.757

 SAT
TT=286.841

 SAT
TT=2.615

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.14

 SAT
TT=30.948

 SAT
TT=37.572

 SAT
TT=12.418
csp/rlfapGraphs/
normalized-graph10.xml 		SAT
TT=0.593

 SAT
TT=4.143

 SAT
TT=4.55

 SAT
TT=1341.99

 SAT
TT=18.297

 SAT
TT=67.98

 SAT
TT=9.213

 ? (TO)
TT=1800.08

 SAT
TT=0.593

 SAT
TT=112.958

 SAT
TT=290.927

 SAT
TT=19.337

 SAT
TT=10.17

 SAT
TT=10.952
csp/rlfapGraphs/
normalized-graph11.xml 		UNSAT
TT=0.248

 UNSAT
TT=3.013

 UNSAT
TT=3.006

 UNSAT
TT=0.655

 UNSAT
TT=1.848

 UNSAT
TT=1.757

 UNSAT
TT=7.768

 UNSAT
TT=8.298

 UNSAT
TT=0.248

 UNSAT
TT=13.061

 UNSAT
TT=13.042

 UNSAT
TT=15.41

 UNSAT
TT=8.146

 UNSAT
TT=9.745
csp/rlfapGraphs/
normalized-graph12.xml 		UNSAT
TT=0.291

 UNSAT
TT=3.216

 UNSAT
TT=3.094

 UNSAT
TT=0.701

 UNSAT
TT=1.958

 UNSAT
TT=1.784

 UNSAT
TT=7.871

 UNSAT
TT=7.417

 UNSAT
TT=0.291

 UNSAT
TT=12.973

 UNSAT
TT=13.553

 UNSAT
TT=15.82

 UNSAT
TT=7.721

 UNSAT
TT=10.088
csp/rlfapGraphs/
normalized-graph14.xml 		SAT
TT=0.598

 SAT
TT=4.791

 SAT
TT=3.663

 SAT
TT=0.878

 SAT
TT=6.688

 SAT
TT=6.942

 SAT
TT=8.307

 SAT
TT=187.019

 SAT
TT=0.598

 SAT
TT=64.785

 SAT
TT=63.771

 SAT
TT=23.971

 SAT
TT=11.711

 SAT
TT=14.325
csp/rlfapGraphs/
normalized-graph1.xml 		SAT
TT=0.148

 SAT
TT=1.62

 SAT
TT=1.671

 SAT
TT=0.23

 SAT
TT=2.529

 SAT
TT=2.261

 SAT
TT=3.355

 SAT
TT=11.66

 SAT
TT=0.148

 SAT
TT=22.761

 SAT
TT=23.228

 SAT
TT=6.067

 SAT
TT=3.183

 SAT
TT=3.742
csp/rlfapGraphs/
normalized-graph2.xml 		SAT
TT=0.275

 SAT
TT=2.382

 SAT
TT=2.385

 SAT
TT=0.423

 SAT
TT=4.089

 SAT
TT=3.431

 SAT
TT=4.886

 SAT
TT=40.814

 SAT
TT=0.275

 SAT
TT=45.899

 SAT
TT=44.034

 SAT
TT=11.97

 SAT
TT=5.85

 SAT
TT=6.962
csp/rlfapGraphs/
normalized-graph3.xml 		SAT
TT=0.21

 SAT
TT=2.321

 SAT
TT=1.602

 SAT
TT=0.235

 SAT
TT=3.109

 SAT
TT=3.062

 SAT
TT=3.892

 SAT
TT=1385.92

 SAT
TT=0.21

 SAT
TT=19.011

 SAT
TT=20.811

 SAT
TT=7.369

 SAT
TT=3.635

 SAT
TT=4.246
csp/rlfapGraphs/
normalized-graph4.xml 		SAT
TT=0.389

 SAT
TT=2.8

 SAT
TT=2.45

 SAT
TT=0.426

 SAT
TT=12.222

 SAT
TT=24.722

 SAT
TT=5.563

 ? (TO)
TT=1800.09

 SAT
TT=0.389

 SAT
TT=151.608

 SAT
TT=55.915

 SAT
TT=13.145

 SAT
TT=6.027

 SAT
TT=6.984
csp/rlfapGraphs/
normalized-graph5.xml 		UNSAT
TT=0.094

 UNSAT
TT=1.55

 UNSAT
TT=1.572

 UNSAT
TT=0.204

 UNSAT
TT=1.145

 UNSAT
TT=1.216

 UNSAT
TT=4.111

 UNSAT
TT=4.053

 UNSAT
TT=0.094

 UNSAT
TT=3.875

 UNSAT
TT=3.985

 UNSAT
TT=6.191

 UNSAT
TT=2.78

 UNSAT
TT=3.114
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/rlfapGraphs/
normalized-graph6.xml 		UNSAT
TT=0.127

 UNSAT
TT=2.127

 UNSAT
TT=2.176

 UNSAT
TT=0.397

 UNSAT
TT=1.472

 UNSAT
TT=1.643

 UNSAT
TT=5.679

 UNSAT
TT=5.488

 UNSAT
TT=0.127

 UNSAT
TT=9.499

 UNSAT
TT=9.756

 UNSAT
TT=10.525

 UNSAT
TT=4.706

 UNSAT
TT=5.761
csp/rlfapScens11/
normalized-scen11-f10.xml 		UNSAT
TT=0.66

 UNSAT
TT=2.72

 UNSAT
TT=2.831

 ? (TO)
TT=1800.05

 UNSAT
TT=4.393

 UNSAT
TT=3.892

 UNSAT
TT=4.92

 UNSAT
TT=128.034

 UNSAT
TT=0.66

 UNSAT
TT=226.347

 UNSAT
TT=53.292

 UNSAT
TT=15.057

 UNSAT
TT=7.514

 UNSAT
TT=9.975
csp/rlfapScens11/
normalized-scen11-f11.xml 		UNSAT
TT=0.656

 UNSAT
TT=2.505

 UNSAT
TT=2.498

 ? (TO)
TT=1800.02

 UNSAT
TT=4.19

 UNSAT
TT=4.404

 UNSAT
TT=4.861

 UNSAT
TT=133.789

 UNSAT
TT=0.656

 UNSAT
TT=19.361

 UNSAT
TT=19.107

 UNSAT
TT=14.281

 UNSAT
TT=7.502

 UNSAT
TT=9.731
csp/rlfapScens11/
normalized-scen11-f12.xml 		UNSAT
TT=0.606

 UNSAT
TT=2.478

 UNSAT
TT=2.63

 ? (TO)
TT=1800.11

 UNSAT
TT=6.349

 UNSAT
TT=4.029

 UNSAT
TT=5.436

 UNSAT
TT=134.754

 UNSAT
TT=0.606

 UNSAT
TT=22.065

 UNSAT
TT=23.846

 UNSAT
TT=13.126

 UNSAT
TT=7.874

 UNSAT
TT=9.611
csp/rlfapScens11/
normalized-scen11-f1.xml 		UNSAT
TT=13.004

 UNSAT
TT=31.562

 UNSAT
TT=31.742

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.15

 ? (TO)
TT=1800.06

 ? (TO)
TT=1800.01

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.37

 UNSAT
TT=13.004

 UNSAT
TT=17.805
csp/rlfapScens11/
normalized-scen11-f2.xml 		UNSAT
TT=12.992

 UNSAT
TT=13.751

 UNSAT
TT=13.998

 ? (TO)
TT=1800.09

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.14

 ? (TO)
TT=1800.08

 ? (TO)
TT=1800.03

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.07

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.49

 UNSAT
TT=12.992

 UNSAT
TT=17.16
csp/rlfapScens11/
normalized-scen11-f3.xml 		UNSAT
TT=6.098

 UNSAT
TT=6.098

 UNSAT
TT=6.291

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.13

 ? (TO)
TT=1800.01

 ? (TO)
TT=1800.05

 UNSAT
TT=581.217

 ? (TO)
TT=1800.12

 ? (TO)
TT=1800.1

 ? (TO)
TT=1800.31

 UNSAT
TT=9.77

 UNSAT
TT=13.413
csp/rlfapScens11/
normalized-scen11-f4.xml 		UNSAT
TT=3.635

 UNSAT
TT=4.008

 UNSAT
TT=3.635

 ? (TO)
TT=1800.01

 UNSAT
TT=467.8

 UNSAT
TT=565.792

 UNSAT
TT=602.354

 UNSAT
TT=693.166

 UNSAT
TT=169.181

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.14

 UNSAT
TT=399.949

 UNSAT
TT=9.762

 UNSAT
TT=12.869
csp/rlfapScens11/
normalized-scen11-f6.xml 		UNSAT
TT=2.645

 UNSAT
TT=2.968

 UNSAT
TT=2.645

 ? (TO)
TT=1800.02

 UNSAT
TT=20.06

 UNSAT
TT=23.723

 UNSAT
TT=32.786

 UNSAT
TT=107.852

 UNSAT
TT=7.338

 ? (TO)
TT=1800.11

 ? (TO)
TT=1800.06

 UNSAT
TT=27.625

 UNSAT
TT=8.314

 UNSAT
TT=10.647
csp/rlfapScens11/
normalized-scen11-f7.xml 		UNSAT
TT=2.663

 UNSAT
TT=3.098

 UNSAT
TT=2.663

 ? (TO)
TT=1800.08

 UNSAT
TT=11.969

 UNSAT
TT=11.557

 UNSAT
TT=21.058

 UNSAT
TT=92.841

 UNSAT
TT=4.193

 ? (TO)
TT=1800.05

 ? (TO)
TT=1800.12

 UNSAT
TT=20.891

 UNSAT
TT=7.933

 UNSAT
TT=9.373
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/rlfapScens11/
normalized-scen11-f9.xml 		UNSAT
TT=1.566

 UNSAT
TT=2.757

 UNSAT
TT=2.732

 ? (TO)
TT=1800.04

 UNSAT
TT=5.074

 UNSAT
TT=4.852

 UNSAT
TT=6.759

 UNSAT
TT=68.646

 UNSAT
TT=1.566

 UNSAT
TT=350.835

 UNSAT
TT=440.418

 UNSAT
TT=15.951

 UNSAT
TT=7.15

 UNSAT
TT=9.456
csp/rlfapScensMod/
normalized-scen10-w1-f3.xml 		UNSAT
TT=0.217

 UNSAT
TT=1.617

 UNSAT
TT=1.533

 UNSAT
TT=0.257

 UNSAT
TT=2.249

 UNSAT
TT=2.118

 UNSAT
TT=2.942

 UNSAT
TT=4.874

 UNSAT
TT=0.217

 UNSAT
TT=9.308

 UNSAT
TT=10.028

 UNSAT
TT=7.795

 UNSAT
TT=3.775

 UNSAT
TT=4.64
csp/rlfapScensMod/
normalized-scen1-f8.xml 		SAT
TT=0.53

 SAT
TT=4.182

 SAT
TT=4.411

 SAT
TT=1.126

 SAT
TT=5.652

 SAT
TT=6.318

 SAT
TT=9.366

 SAT
TT=142.799

 SAT
TT=0.53

 SAT
TT=86.943

 SAT
TT=135.682

 SAT
TT=20.01

 SAT
TT=16.953

 SAT
TT=13.201
csp/rlfapScensMod/
normalized-scen1-f9.xml 		UNSAT
TT=0.754

 UNSAT
TT=5.169

 UNSAT
TT=5.663

 ? (TO)
TT=1800.02

 UNSAT
TT=6.325

 UNSAT
TT=5.591

 UNSAT
TT=8.143

 UNSAT
TT=133.74

 UNSAT
TT=0.754

 UNSAT
TT=279.13

 UNSAT
TT=312.466

 UNSAT
TT=19.297

 UNSAT
TT=9.811

 UNSAT
TT=12.319
csp/rlfapScensMod/
normalized-scen2-f24.xml 		SAT
TT=0.095

 SAT
TT=1.637

 SAT
TT=1.673

 SAT
TT=0.243

 SAT
TT=2.18

 SAT
TT=2.128

 SAT
TT=2.538

 SAT
TT=9.146

 SAT
TT=0.095

 SAT
TT=1.873

 SAT
TT=1.645

 SAT
TT=5.419

 SAT
TT=2.307

 SAT
TT=2.889
csp/rlfapScensMod/
normalized-scen2-f25.xml 		UNSAT
TT=0.454

 UNSAT
TT=4.402

 UNSAT
TT=4.431

 UNSAT
TT=1693.32

 UNSAT
TT=2.521

 UNSAT
TT=2.554

 UNSAT
TT=2.902

 UNSAT
TT=12.72

 UNSAT
TT=0.454

 UNSAT
TT=7.111

 UNSAT
TT=7.476

 UNSAT
TT=5.398

 UNSAT
TT=2.512

 UNSAT
TT=2.903
csp/rlfapScensMod/
normalized-scen3-f10.xml 		SAT
TT=0.273

 SAT
TT=2.348

 SAT
TT=2.375

 SAT
TT=0.492

 SAT
TT=3.184

 SAT
TT=3.222

 SAT
TT=4.234

 SAT
TT=41.335

 SAT
TT=0.273

 SAT
TT=207.324

 SAT
TT=37.472

 SAT
TT=11.731

 SAT
TT=6.917

 SAT
TT=6.67
csp/rlfapScensMod/
normalized-scen6-w1.xml 		SAT
TT=0.073

 SAT
TT=1.181

 SAT
TT=1.132

 SAT
TT=0.099

 SAT
TT=1.365

 SAT
TT=1.495

 SAT
TT=1.996

 SAT
TT=26.207

 SAT
TT=0.073

 SAT
TT=7.535

 SAT
TT=9.817

 SAT
TT=4.19

 SAT
TT=1.917

 SAT
TT=2.179
csp/rlfapScensMod/
normalized-scen6-w2.xml 		UNSAT
TT=0.209

 UNSAT
TT=1.301

 UNSAT
TT=1.332

 UNSAT
TT=1345.1

 UNSAT
TT=1.844

 UNSAT
TT=1.764

 UNSAT
TT=2.713

 UNSAT
TT=2.516

 UNSAT
TT=0.209

 UNSAT
TT=17.353

 UNSAT
TT=6.971

 UNSAT
TT=5.333

 UNSAT
TT=2.577

 UNSAT
TT=3.08
csp/rlfapScensMod/
normalized-scen7-w1-f4.xml 		SAT
TT=0.158

 SAT
TT=1.459

 SAT
TT=1.81

 SAT
TT=0.179

 SAT
TT=2.482

 SAT
TT=2.362

 SAT
TT=2.855

 SAT
TT=49.632

 SAT
TT=0.158

 SAT
TT=9.739

 SAT
TT=7.305

 SAT
TT=5.193

 SAT
TT=2.566

 SAT
TT=3.346
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/rlfapScensMod/
normalized-scen7-w1-f5.xml 		UNSAT
TT=0.145

 UNSAT
TT=1.478

 UNSAT
TT=1.317

 ? (TO)
TT=1800.05

 UNSAT
TT=1.725

 UNSAT
TT=1.987

 UNSAT
TT=2.554

 UNSAT
TT=3.713

 UNSAT
TT=0.145

 UNSAT
TT=5.054

 UNSAT
TT=4.962

 UNSAT
TT=4.867

 UNSAT
TT=2.578

 UNSAT
TT=2.884
csp/rlfapScens/
normalized-scen10.xml 		UNSAT
TT=0.319

 UNSAT
TT=3.151

 UNSAT
TT=3.139

 UNSAT
TT=0.73

 UNSAT
TT=1.941

 UNSAT
TT=2.787

 UNSAT
TT=6.662

 UNSAT
TT=6.756

 UNSAT
TT=0.319

 UNSAT
TT=22.51

 UNSAT
TT=22.062

 UNSAT
TT=17.705

 UNSAT
TT=8.876

 UNSAT
TT=9.904
csp/rlfapScens/
normalized-scen11.xml 		SAT
TT=3.024

 SAT
TT=3.315

 SAT
TT=3.024

 SAT
TT=90.878

 SAT
TT=7.358

 SAT
TT=11.968

 SAT
TT=6.695

 SAT
TT=90.664

 SAT
TT=4.638

 SAT
TT=142.703

 SAT
TT=132.045

 SAT
TT=20.969

 SAT
TT=9.812

 SAT
TT=11.605
csp/rlfapScens/
normalized-scen1.xml 		SAT
TT=0.639

 SAT
TT=4.562

 SAT
TT=3.493

 SAT
TT=1.051

 SAT
TT=8.313

 SAT
TT=8.23

 SAT
TT=9.182

 SAT
TT=216.443

 SAT
TT=0.639

 SAT
TT=109.148

 SAT
TT=120.23

 SAT
TT=24.968

 SAT
TT=11.788

 SAT
TT=16.141
csp/rlfapScens/
normalized-scen2.xml 		SAT
TT=0.136

 SAT
TT=1.605

 SAT
TT=1.553

 SAT
TT=0.236

 SAT
TT=2.552

 SAT
TT=2.475

 SAT
TT=2.475

 SAT
TT=9.927

 SAT
TT=0.136

 SAT
TT=19.532

 SAT
TT=22.736

 SAT
TT=8.42

 SAT
TT=3.884

 SAT
TT=4.817
csp/rlfapScens/
normalized-scen3.xml 		SAT
TT=0.333

 SAT
TT=2.388

 SAT
TT=2.23

 SAT
TT=0.506

 SAT
TT=4.787

 SAT
TT=4.419

 SAT
TT=3.903

 SAT
TT=35.627

 SAT
TT=0.333

 SAT
TT=60.401

 SAT
TT=67.228

 SAT
TT=14.433

 SAT
TT=6.916

 SAT
TT=8.036
csp/rlfapScens/
normalized-scen4.xml 		SAT
TT=0.527

 SAT
TT=4.09

 SAT
TT=4.779

 SAT
TT=0.73

 SAT
TT=53.933

 SAT
TT=6.98

 SAT
TT=9.009

 SAT
TT=29.779

 SAT
TT=0.527

 SAT
TT=38.552

 SAT
TT=38.646

 SAT
TT=17.597

 SAT
TT=8.507

 SAT
TT=9.545
csp/rlfapScens/
normalized-scen5.xml 		SAT
TT=0.334

 SAT
TT=2.728

 SAT
TT=2.86

 SAT
TT=0.445

 SAT
TT=3.301

 SAT
TT=3.525

 SAT
TT=5.547

 SAT
TT=12.687

 SAT
TT=0.334

 SAT
TT=19.157

 SAT
TT=18.626

 SAT
TT=13.298

 SAT
TT=5.488

 SAT
TT=6.468
csp/rlfapScens/
normalized-scen7.xml 		UNSAT
TT=0.251

 UNSAT
TT=2.695

 UNSAT
TT=2.411

 UNSAT
TT=0.457

 UNSAT
TT=1.722

 UNSAT
TT=2.366

 UNSAT
TT=5.517

 UNSAT
TT=5.677

 UNSAT
TT=0.251

 UNSAT
TT=14.915

 UNSAT
TT=13.869

 UNSAT
TT=13.721

 UNSAT
TT=5.774

 UNSAT
TT=7.002
csp/rlfapScens/
normalized-scen8.xml 		UNSAT
TT=0.557

 UNSAT
TT=4.036

 UNSAT
TT=3.783

 UNSAT
TT=0.928

 UNSAT
TT=2.119

 UNSAT
TT=3.334

 UNSAT
TT=8.772

 UNSAT
TT=8.126

 UNSAT
TT=0.557

 UNSAT
TT=28.113

 UNSAT
TT=28.113

 UNSAT
TT=22.745

 UNSAT
TT=11.608

 UNSAT
TT=14.06
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/rlfapScens/
normalized-scen9.xml 		UNSAT
TT=0.307

 UNSAT
TT=3.121

 UNSAT
TT=3.152

 UNSAT
TT=0.708

 UNSAT
TT=1.956

 UNSAT
TT=2.751

 UNSAT
TT=6.738

 UNSAT
TT=6.39

 UNSAT
TT=0.307

 UNSAT
TT=23.531

 UNSAT
TT=23.55

 UNSAT
TT=17.682

 UNSAT
TT=8.619

 UNSAT
TT=10.88
csp/subs/
normalized-scen06-sub0.xml 		UNSAT
TT=0.066

 UNSAT
TT=1.045

 UNSAT
TT=1.036

 UNSAT
TT=0.067

 UNSAT
TT=1.041

 UNSAT
TT=1.009

 UNSAT
TT=1.943

 UNSAT
TT=1.771

 UNSAT
TT=0.066

 UNSAT
TT=6.2

 UNSAT
TT=3.338

 UNSAT
TT=3.159

 UNSAT
TT=1.316

 UNSAT
TT=1.639
csp/subs/
normalized-scen06-sub1.xml 		UNSAT
TT=0.077

 UNSAT
TT=1.003

 UNSAT
TT=1.01

 UNSAT
TT=0.077

 UNSAT
TT=1.135

 UNSAT
TT=1.249

 UNSAT
TT=1.745

 UNSAT
TT=1.872

 UNSAT
TT=0.081

 UNSAT
TT=3.932

 UNSAT
TT=4.325

 UNSAT
TT=3.674

 UNSAT
TT=1.643

 UNSAT
TT=1.761
csp/subs/
normalized-scen06-sub2.xml 		UNSAT
TT=0.08

 UNSAT
TT=1.054

 UNSAT
TT=1.075

 UNSAT
TT=0.092

 UNSAT
TT=1.162

 UNSAT
TT=1.222

 UNSAT
TT=2.035

 UNSAT
TT=1.888

 UNSAT
TT=0.08

 UNSAT
TT=4.504

 UNSAT
TT=4.418

 UNSAT
TT=3.817

 UNSAT
TT=1.836

 UNSAT
TT=2.002
csp/subs/
normalized-scen06-sub3.xml 		UNSAT
TT=0.088

 UNSAT
TT=1.134

 UNSAT
TT=1.144

 UNSAT
TT=0.106

 UNSAT
TT=1.304

 UNSAT
TT=1.37

 UNSAT
TT=2.11

 UNSAT
TT=2.1

 UNSAT
TT=0.088

 UNSAT
TT=5.426

 UNSAT
TT=6.719

 UNSAT
TT=4.438

 UNSAT
TT=2.187

 UNSAT
TT=2.228
csp/subs/
normalized-scen06-sub4.xml 		UNSAT
TT=0.071

 UNSAT
TT=1.153

 UNSAT
TT=1.176

 UNSAT
TT=0.112

 UNSAT
TT=1.361

 UNSAT
TT=1.45

 UNSAT
TT=2.122

 UNSAT
TT=2.265

 UNSAT
TT=0.071

 UNSAT
TT=6.263

 UNSAT
TT=5.952

 UNSAT
TT=4.79

 UNSAT
TT=2.191

 UNSAT
TT=2.283
csp/subs/
normalized-scen07-sub1.xml 		UNSAT
TT=0.06

 UNSAT
TT=1.049

 UNSAT
TT=1.001

 UNSAT
TT=0.073

 UNSAT
TT=1.098

 UNSAT
TT=1.09

 UNSAT
TT=1.889

 UNSAT
TT=1.755

 UNSAT
TT=0.06

 UNSAT
TT=4.936

 UNSAT
TT=5.165

 UNSAT
TT=3.712

 UNSAT
TT=1.714

 UNSAT
TT=1.845
csp/subs/
normalized-scen07-sub2.xml 		UNSAT
TT=0.092

 UNSAT
TT=1.122

 UNSAT
TT=1.045

 UNSAT
TT=0.092

 UNSAT
TT=1.212

 UNSAT
TT=1.306

 UNSAT
TT=2.023

 UNSAT
TT=1.936

 UNSAT
TT=0.094

 UNSAT
TT=3.678

 UNSAT
TT=4.591

 UNSAT
TT=4.124

 UNSAT
TT=1.832

 UNSAT
TT=2.019
csp/subs/
normalized-scen07-sub3.xml 		UNSAT
TT=0.104

 UNSAT
TT=1.09

 UNSAT
TT=1.142

 UNSAT
TT=0.105

 UNSAT
TT=1.283

 UNSAT
TT=1.292

 UNSAT
TT=2.124

 UNSAT
TT=1.979

 UNSAT
TT=0.104

 UNSAT
TT=7.813

 UNSAT
TT=6.785

 UNSAT
TT=4.456

 UNSAT
TT=1.969

 UNSAT
TT=2.297
csp/subs/
normalized-scen07-sub4.xml 		UNSAT
TT=0.102

 UNSAT
TT=1.191

 UNSAT
TT=1.129

 UNSAT
TT=0.122

 UNSAT
TT=1.399

 UNSAT
TT=1.443

 UNSAT
TT=2.1

 UNSAT
TT=2.229

 UNSAT
TT=0.102

 UNSAT
TT=8.158

 UNSAT
TT=7.579

 UNSAT
TT=4.888

 UNSAT
TT=2.254

 UNSAT
TT=2.208
Bench nameBest resultsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
csp/ukPuzzle/
normalized-crossword-m1-uk-puzzle01.xml 		SAT
TT=0.007

 SAT
TT=0.72

 SAT
TT=0.711

 SAT
TT=0.029

 SAT
TT=0.575

 SAT
TT=0.541

 SAT
TT=1.059

 SAT
TT=1.016

 SAT
TT=0.007

 SAT
TT=0.017

 SAT
TT=0.015

 SAT
TT=0.793

 SAT
TT=0.552

 SAT
TT=0.541
csp/wordsPuzzle/
normalized-crossword-m1-words-puzzle01.xml 		SAT
TT=0.006

 SAT
TT=0.644

 SAT
TT=0.664

 SAT
TT=0.024

 SAT
TT=0.494

 SAT
TT=0.473

 SAT
TT=0.963

 SAT
TT=1.063

 SAT
TT=0.006

 SAT
TT=0.016

 SAT
TT=0.017

 SAT
TT=0.749

 SAT
TT=0.492

 SAT
TT=0.504



StatisticsAbscon 112v4
AC
(complete)		Abscon 112v4
ESAC
(complete)		bpsolver
09
(complete)		Choco2.1.1
2009-06-10
(complete)		Choco2.1.1b
2009-07-16
(complete)		Concrete
2009-07-14
(complete)		Concrete DC
2009-07-14
(complete)		Mistral
1.545
(complete)		pcs
0.3.2
(complete)		pcs-restart
0.3.2
(complete)		SAT4J CSP
2.1.1
(complete)		Sugar
v1.14.6+minisat
(complete)		Sugar
v1.14.6+picosat
(complete)
Number of times the solver is able to give the best known answer17717844121122147114133878664101114
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)		4746225107400020