2018 XCSP3 competition: mini-solvers track: benchmarks results per solver
Result page for solver NACRE
1.0.4
(complete)
Category "decision problem" (CSP)
Solver proved unsatisfiability (UNSATISFIABLE) (43 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
Haystacks/
Haystacks-ext-04_c18.xml
UNSAT
0.003922
0.00453491
4299584
Dubois/
Dubois-018_c18.xml
UNSAT
0.005713
0.00659606
4299504
Haystacks/
Haystacks-ext-05_c18.xml
UNSAT
0.006076
0.00730709
4299544
Dubois/
Dubois-020_c18.xml
UNSAT
0.006265
0.00713789
4299472
Dubois/
Dubois-021_c18.xml
UNSAT
0.006358
0.00731
4299464
Dubois/
Dubois-022_c18.xml
UNSAT
0.006944
0.00775901
4299496
Dubois/
Dubois-023_c18.xml
UNSAT
0.007064
0.00809012
4299456
Dubois/
Dubois-024_c18.xml
UNSAT
0.007439
0.00842707
4299512
Dubois/
Dubois-025_c18.xml
UNSAT
0.007448
0.00827396
4299520
Dubois/
Dubois-030_c18.xml
UNSAT
0.009283
0.0102171
4299488
Haystacks/
Haystacks-ext-06_c18.xml
UNSAT
0.009598
0.0104811
4299576
Dubois/
Dubois-040_c18.xml
UNSAT
0.013902
0.014848
4299480
Dubois/
Dubois-050_c18.xml
UNSAT
0.019171
0.0196891
4299440
Haystacks/
Haystacks-ext-07_c18.xml
UNSAT
0.023932
0.0247409
4299592
Dubois/
Dubois-075_c18.xml
UNSAT
0.034358
0.0346169
4299448
Dubois/
Dubois-100_c18.xml
UNSAT
0.055915
0.056367
4299528
Haystacks/
Haystacks-ext-08_c18.xml
UNSAT
0.125109
0.126022
4299568
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f12_c18.xml
UNSAT
0.242566
0.24339
4298064
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f10_c18.xml
UNSAT
0.24873
0.249567
4298080
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f11_c18.xml
UNSAT
0.253028
0.253861
4298072
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f09_c18.xml
UNSAT
0.275334
0.280231
4298112
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f08_c18.xml
UNSAT
0.304921
0.307248
4298104
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f07_c18.xml
UNSAT
0.381064
0.381283
4298128
Quasigroups_mini/
QuasiGroup-v7-07_mini_c18.xml
UNSAT
0.415015
0.417841
4299090
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f06_c18.xml
UNSAT
0.438058
0.43922
4298088
Langford/
LangfordBin-06_c18.xml
UNSAT
0.535821
0.536408
4299325
Quasigroups_mini/
QuasiGroup-v4-07_mini_c18.xml
UNSAT
0.783834
0.785095
4299154
Subisomorphism/
Subisomorphism-g34-g36_c18.xml
UNSAT
0.852392
0.853185
4299826
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f05_c18.xml
UNSAT
1.3796
1.38042
4298048
Haystacks/
Haystacks-ext-09_c18.xml
UNSAT
2.80839
2.8146
4299552
MagicHexagon/
MagicHexagon-04-0017_c18.xml
UNSAT
3.94413
3.94673
4300172
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f04_c18.xml
UNSAT
4.84628
4.85655
4298096
ColouredQueens/
ColouredQueens-06_c18.xml
UNSAT
7.15592
7.19123
4297952
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f03_c18.xml
UNSAT
21.1636
21.1796
4298056
Quasigroups_mini/
QuasiGroup-v7-08_mini_c18.xml
UNSAT
30.7381
30.7407
4299162
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f02_c18.xml
UNSAT
89.7844
89.838
4298040
PseudoBoolean-dec/
Pb-chnl10-11_c18.xml
UNSAT
187.07
187.122
4298807
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f01_c18.xml
UNSAT
310.657
310.725
4298120
Subisomorphism/
Subisomorphism-g11-g30_c18.xml
UNSAT
507.993
508.108
4299818
Haystacks/
Haystacks-ext-10_c18.xml
UNSAT
543.859
543.949
4299608
Quasigroups_mini/
QuasiGroup-v4-08_mini_c18.xml
UNSAT
582.11
582.235
4299074
Subisomorphism/
Subisomorphism-g11-g44_c18.xml
UNSAT
1992.94
1993.13
4299866
Crossword/
Crossword-m18-ogd2008-vg-16-17_c18.xml
UNSAT
2188.27
2188.44
4299714
Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (43 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
ColouredQueens/
ColouredQueens-05_c18.xml
SAT
0.003788
0.00435989
4298016
MagicSquare/
MagicSquare-04-sum_c18.xml
SAT
0.003844
0.00484889
4299930
ColouredQueens/
ColouredQueens-07_c18.xml
SAT
0.003986
0.00474709
4297960
Langford/
LangfordBin-07_c18.xml
SAT
0.004664
0.005595
4299301
Langford/
LangfordBin-08_c18.xml
SAT
0.005749
0.00586505
4299293
Langford/
LangfordBin-15_c18.xml
SAT
0.006486
0.00768006
4299285
Langford/
LangfordBin-11_c18.xml
SAT
0.006639
0.00718401
4299269
Eternity/
Eternity-04-04_c18.xml
SAT
0.006996
0.00799199
4300486
MagicSquare/
MagicSquare-06-sum_c18.xml
SAT
0.010117
0.0108391
4299906
MagicSquare/
MagicSquare-05-sum_c18.xml
SAT
0.014767
0.0153289
4299922
Langford/
LangfordBin-16_c18.xml
SAT
0.017017
0.0176691
4299317
Eternity/
Eternity-05-05_c18.xml
SAT
0.052625
0.0538619
4300558
MagicSquare/
MagicSquare-07-sum_c18.xml
SAT
0.069563
0.070845
4299986
Crossword/
Crossword-m18-ogd2008-vg-04-05_c18.xml
SAT
0.101203
0.108789
4299730
Frb/
frb-30-15-1_c18.xml
SAT
0.111886
0.112917
4300362
Quasigroups_mini/
QuasiGroup-v7-09_mini_c18.xml
SAT
0.114057
0.114727
4299098
Quasigroups_mini/
QuasiGroup-v4-09_mini_c18.xml
SAT
0.176047
0.176858
4299066
PseudoBoolean-dec/
Pb-robin08_c18.xml
SAT
0.189783
0.19046
4298799
GracefulGraph/
GracefulGraph-K03-P03_c18.xml
SAT
0.217265
0.218566
4298581
Crossword/
Crossword-m18-ogd2008-vg-05-06_c18.xml
SAT
0.302692
0.308285
4299746
GracefulGraph/
GracefulGraph-K04-P02_c18.xml
SAT
0.526656
0.527822
4298549
MagicHexagon/
MagicHexagon-04-0003_c18.xml
SAT
0.552906
0.558492
4300188
PseudoBoolean-dec/
Pb-robin10_c18.xml
SAT
0.912364
0.91376
4298775
Eternity/
Eternity-06-06_c18.xml
SAT
1.05899
1.06006
4300478
Eternity/
Eternity-10-04_c18.xml
SAT
1.06941
1.07383
4300526
PseudoBoolean-dec/
Pb-fpga25-25-sat_c18.xml
SAT
1.39384
1.39481
4298743
Frb/
frb-35-17-1_c18.xml
SAT
2.72641
2.73305
4300298
Crossword/
Crossword-m18-ogd2008-vg-06-07_c18.xml
SAT
3.47193
3.47297
4299754
GracefulGraph/
GracefulGraph-K02-P09_c18.xml
SAT
5.26173
5.26486
4298605
PseudoBoolean-dec/
Pb-fpga45-45-sat_c18.xml
SAT
6.82484
6.83168
4298735
MagicHexagon/
MagicHexagon-04-m004_c18.xml
SAT
7.69379
7.69467
4300156
Frb/
frb-40-19-1-mgd_c18.xml
SAT
9.36715
9.37434
4300378
Eternity/
Eternity-10-05_c18.xml
SAT
20.3526
20.3644
4300494
MagicHexagon/
MagicHexagon-05-0006_c18.xml
SAT
27.8856
27.8989
4300164
Subisomorphism/
Subisomorphism-g08-g43_c18.xml
SAT
28.9418
28.9677
4299834
MagicSquare/
MagicSquare-10-sum_c18.xml
SAT
29.5201
29.5217
4299962
PseudoBoolean-dec/
Pb-robin12_c18.xml
SAT
76.9432
76.9491
4298783
MagicHexagon/
MagicHexagon-05-m003_c18.xml
SAT
164.971
164.986
4300124
GracefulGraph/
GracefulGraph-K04-P03_c18.xml
SAT
179.596
179.627
4298557
Quasigroups_mini/
QuasiGroup-v4-12_mini_c18.xml
SAT
196.295
196.333
4299106
Eternity/
Eternity-07-07_c18.xml
SAT
375.479
375.487
4300590
Subisomorphism/
Subisomorphism-g10-g27_c18.xml
SAT
412.542
412.561
4299890
Crossword/
Crossword-m18-ogd2008-vg-07-08_c18.xml
SAT
1913.96
1914.05
4299786
Solver timed out (no solution given) (90 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
PseudoBoolean-dec/
Pb-chnl50-51_c18.xml
? (TO)
2519.34
2520.04
4298759
Eternity/
Eternity-12-12_c18.xml
? (TO)
2519.36
2520.03
4300582
Quasigroups_mini/
QuasiGroup-v4-14_mini_c18.xml
? (TO)
2519.4
2520.04
4299042
Eternity/
Eternity-10-10_c18.xml
? (TO)
2519.4
2520.03
4300550
Quasigroups_mini/
QuasiGroup-v4-10_mini_c18.xml
? (TO)
2519.5
2520.02
4299082
MagicSquare/
MagicSquare-09-sum_c18.xml
? (TO)
2519.51
2520.02
4299946
ColouredQueens/
ColouredQueens-15_c18.xml
? (TO)
2519.53
2520.02
4297944
PseudoBoolean-dec/
Pb-chnl15-16_c18.xml
? (TO)
2519.54
2520.02
4298791
PseudoBoolean-dec/
Pb-robin14_c18.xml
? (TO)
2519.54
2520.02
4298751
MagicSquare/
MagicSquare-08-sum_c18.xml
? (TO)
2519.54
2520.03
4299914
Subisomorphism/
Subisomorphism-g19-g43_c18.xml
? (TO)
2519.55
2520.03
4299842
Subisomorphism/
Subisomorphism-g17-g37_c18.xml
? (TO)
2519.56
2520.02
4299898
ColouredQueens/
ColouredQueens-16_c18.xml
? (TO)
2519.58
2520.02
4297976
MagicHexagon/
MagicHexagon-06-m001_c18.xml
? (TO)
2519.61
2520.06
4300140
Quasigroups_mini/
QuasiGroup-v7-12_mini_c18.xml
? (TO)
2519.61
2520.01
4299114
PseudoBoolean-dec/
Pb-chnl30-31_c18.xml
? (TO)
2519.62
2520.06
4298815
Eternity/
Eternity-15-15_c18.xml
? (TO)
2519.63
2520.03
4300510
Subisomorphism/
Subisomorphism-g29-g50_c18.xml
? (TO)
2519.63
2520.04
4299882
Eternity/
Eternity-09-09_c18.xml
? (TO)
2519.63
2520.02
4300542
MagicHexagon/
MagicHexagon-06-0010_c18.xml
? (TO)
2519.63
2520.01
4300132
Quasigroups_mini/
QuasiGroup-v7-14_mini_c18.xml
? (TO)
2519.63
2520.01
4299050
Subisomorphism/
Subisomorphism-g19-g45_c18.xml
? (TO)
2519.63
2520.02
4299858
MagicHexagon/
MagicHexagon-07-0002_c18.xml
? (TO)
2519.64
2520.03
4300116
Eternity/
Eternity-10-06_c18.xml
? (TO)
2519.66
2520.02
4300502
Quasigroups_mini/
QuasiGroup-v7-16_mini_c18.xml
? (TO)
2519.67
2520.02
4299122
Eternity/
Eternity-11-11_c18.xml
? (TO)
2519.69
2520.03
4300518
MagicSquare/
MagicSquare-11-sum_c18.xml
? (TO)
2519.7
2520.02
4299954
MagicHexagon/
MagicHexagon-07-m011_c18.xml
? (TO)
2519.71
2520.05
4300180
Eternity/
Eternity-14-14_c18.xml
? (TO)
2519.71
2520.03
4300566
Eternity/
Eternity-13-13_c18.xml
? (TO)
2519.72
2520.02
4300534
MagicHexagon/
MagicHexagon-08-m009_c18.xml
? (TO)
2519.72
2520.02
4300108
MagicHexagon/
MagicHexagon-08-0006_c18.xml
? (TO)
2519.72
2520.02
4300148
MagicSquare/
MagicSquare-13-sum_c18.xml
? (TO)
2519.73
2520.02
4299994
GracefulGraph/
GracefulGraph-K07-P02_c18.xml
? (TO)
2519.73
2520.01
4298629
Langford/
LangfordBin-13_c18.xml
? (TO)
2519.73
2520.01
4299333
ColouredQueens/
ColouredQueens-13_c18.xml
? (TO)
2519.73
2520.01
4297992
Frb/
frb-59-26-3-mgd_c18.xml
? (TO)
2519.75
2520.01
4300274
MagicSquare/
MagicSquare-15-sum_c18.xml
? (TO)
2519.75
2520.01
4299970
MagicSquare/
MagicSquare-16-sum_c18.xml
? (TO)
2519.75
2520.03
4300002
Crossword/
Crossword-m18-ogd2008-vg-15-16_c18.xml
? (TO)
2519.76
2520.01
4299810
Eternity/
Eternity-08-08_c18.xml
? (TO)
2519.78
2520.01
4300574
Quasigroups_mini/
QuasiGroup-v7-10_mini_c18.xml
? (TO)
2519.79
2520.01
4299058
Langford/
LangfordBin-12_c18.xml
? (TO)
2519.79
2520.01
4299261
Langford/
LangfordBin-09_c18.xml
? (TO)
2519.8
2520.01
4299341
Langford/
LangfordBin-14_c18.xml
? (TO)
2519.8
2520.01
4299277
ColouredQueens/
ColouredQueens-12_c18.xml
? (TO)
2519.8
2520.01
4298024
Subisomorphism/
Subisomorphism-g10-g23_c18.xml
? (TO)
2519.8
2520.02
4299850
Frb/
frb-50-23-2-mgd_c18.xml
? (TO)
2519.8
2520.01
4300346
ColouredQueens/
ColouredQueens-10_c18.xml
? (TO)
2519.81
2520.01
4297984
Frb/
frb-53-24-1-mgd_c18.xml
? (TO)
2519.81
2520.01
4300306
Subisomorphism/
Subisomorphism-g17-g42_c18.xml
? (TO)
2519.81
2520.01
4299874
MagicSquare/
MagicSquare-12-sum_c18.xml
? (TO)
2519.81
2520.01
4299938
Frb/
frb-50-23-3-mgd_c18.xml
? (TO)
2519.81
2520.01
4300314
PseudoBoolean-dec/
Pb-robin18_c18.xml
? (TO)
2519.82
2520.04
4298823
PseudoBoolean-dec/
Pb-chnl20-21_c18.xml
? (TO)
2519.82
2520.05
4298831
Quasigroups_mini/
QuasiGroup-v4-20_mini_c18.xml
? (TO)
2519.82
2520.04
4299138
Frb/
frb-56-25-3-mgd_c18.xml
? (TO)
2519.82
2520.01
4300386
Crossword/
Crossword-m18-ogd2008-vg-12-13_c18.xml
? (TO)
2519.83
2520.02
4299802
Quasigroups_mini/
QuasiGroup-v7-20_mini_c18.xml
? (TO)
2519.83
2520.02
4299130
Frb/
frb-56-25-1-mgd_c18.xml
? (TO)
2519.83
2520.01
4300330
Frb/
frb-59-26-2-mgd_c18.xml
? (TO)
2519.83
2520.01
4300322
Langford/
LangfordBin-10_c18.xml
? (TO)
2519.84
2520.01
4299309
GracefulGraph/
GracefulGraph-K05-P03_c18.xml
? (TO)
2519.84
2520.01
4298573
GracefulGraph/
GracefulGraph-K04-P04_c18.xml
? (TO)
2519.85
2520.01
4298565
Frb/
frb-50-23-1-mgd_c18.xml
? (TO)
2519.85
2520.01
4300354
Frb/
frb-53-24-3-mgd_c18.xml
? (TO)
2519.86
2520.01
4300282
ColouredQueens/
ColouredQueens-14_c18.xml
? (TO)
2519.86
2520.01
4298000
Crossword/
Crossword-m18-ogd2008-vg-10-11_c18.xml
? (TO)
2519.86
2522.01
4299722
ColouredQueens/
ColouredQueens-09_c18.xml
? (TO)
2519.87
2520.01
4297968
GracefulGraph/
GracefulGraph-K05-P02_c18.xml
? (TO)
2519.88
2520.01
4298613
ColouredQueens/
ColouredQueens-11_c18.xml
? (TO)
2519.88
2520.01
4298008
Crossword/
Crossword-m18-ogd2008-vg-08-09_c18.xml
? (TO)
2519.89
2520.02
4299770
ColouredQueens/
ColouredQueens-08_c18.xml
? (TO)
2519.89
2520.01
4298032
GracefulGraph/
GracefulGraph-K06-P02_c18.xml
? (TO)
2519.9
2520.01
4298589
Frb/
frb-45-21-1_c18.xml
? (TO)
2519.9
2520.01
4300338
Crossword/
Crossword-m18-ogd2008-vg-14-15_c18.xml
? (TO)
2519.9
2520.01
4299738
GracefulGraph/
GracefulGraph-K07-P03_c18.xml
? (TO)
2519.92
2520.01
4298621
Crossword/
Crossword-m18-ogd2008-vg-09-10_c18.xml
? (TO)
2519.92
2520.02
4299778
Frb/
frb-59-26-1-mgd_c18.xml
? (TO)
2519.93
2520.01
4300266
Crossword/
Crossword-m18-ogd2008-vg-13-14_c18.xml
? (TO)
2519.93
2520.01
4299762
Frb/
frb-56-25-2-mgd_c18.xml
? (TO)
2519.93
2520.01
4300290
Crossword/
Crossword-m18-ogd2008-vg-11-12_c18.xml
? (TO)
2519.94
2520.02
4299794
GracefulGraph/
GracefulGraph-K06-P03_c18.xml
? (TO)
2519.94
2520.01
4298597
Haystacks/
Haystacks-ext-12_c18.xml
? (TO)
2519.96
2520.01
4299600
Haystacks/
Haystacks-ext-11_c18.xml
? (TO)
2519.96
2520.01
4299536
MagicSquare/
MagicSquare-14-sum_c18.xml
? (TO)
2519.96
2520.02
4299978
Frb/
frb-53-24-2-mgd_c18.xml
? (TO)
2519.96
2520.01
4300370
Haystacks/
Haystacks-ext-13_c18.xml
? (TO)
2519.99
2520.01
4299560
PseudoBoolean-dec/
Pb-robin16_c18.xml
? (TO)
2520.03
2520.2
4298767
Quasigroups_mini/
QuasiGroup-v4-16_mini_c18.xml
? (TO)
2520.03
2520.23
4299146