2017 XCSP3 competition: mini-solver track (sequential and parallel solvers): solvers page (tabular format, summary)

Some explanations

Category "optimization problem" (COP)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
cosoco-mini
1.12
(complete)
11742
(35.9%)
0
(0%)
42
(35.9%)
73
(62.39%)
2
(1.71%)
0
(0%)
cosoco-mini
1.1 (2017-06-27)
(complete)
11742
(35.9%)
0
(0%)
42
(35.9%)
5
(4.27%)
70
(59.83%)
0
(0%)
cosoco-mini
1.1 (2017-07-29)
(complete)
11742
(35.9%)
0
(0%)
42
(35.9%)
73
(62.39%)
2
(1.71%)
0
(0%)
Naxos
1.1.0
(complete)
11733
(28.21%)
0
(0%)
33
(28.21%)
60
(51.28%)
24
(20.51%)
0
(0%)

Solver NameProgress
cosoco-mini
1.12
(complete)
done
117
OPT/SAT
42
SAT (TO/MO)
73
?
2
cosoco-mini
1.1 (2017-06-27)
(complete)
done
117
OPT/SAT
42
SAT (TO/MO)
5
?
70
cosoco-mini
1.1 (2017-07-29)
(complete)
done
117
OPT/SAT
42
SAT (TO/MO)
73
?
2
Naxos
1.1.0
(complete)
done
117
OPT/SAT
33
SAT (TO/MO)
60
?
24

Category "decision problem" (CSP)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
cosoco-mini
1.12
(complete)
242181
(74.79%)
62
(25.62%)
119
(49.17%)
0
(0%)
61
(25.21%)
0
(0%)
cosoco-mini
1.1 (2017-06-27)
(complete)
242180
(74.38%)
62
(25.62%)
118
(48.76%)
0
(0%)
61
(25.21%)
1
(0.41%)
cosoco-mini
1.1 (2017-07-29)
(complete)
242181
(74.79%)
62
(25.62%)
119
(49.17%)
0
(0%)
61
(25.21%)
0
(0%)
miniBTD
2017-06-30
(complete)
242162
(66.94%)
58
(23.97%)
104
(42.98%)
0
(0%)
79
(32.64%)
1
(0.41%)
miniBTD
2017-08-10
(complete)
242163
(67.36%)
58
(23.97%)
105
(43.39%)
0
(0%)
79
(32.64%)
0
(0%)
Naxos
1.1.0
(complete)
242143
(59.09%)
41
(16.94%)
102
(42.15%)
0
(0%)
99
(40.91%)
0
(0%)

Solver NameProgress
cosoco-mini
1.12
(complete)
done
242
UNSAT
62
OPT/SAT
119
?
61
cosoco-mini
1.1 (2017-06-27)
(complete)
done
242
UNSAT
62
OPT/SAT
118
?
61
ERR
1
cosoco-mini
1.1 (2017-07-29)
(complete)
done
242
UNSAT
62
OPT/SAT
119
?
61
miniBTD
2017-06-30
(complete)
done
242
UNSAT
58
OPT/SAT
104
?
79
ERR
1
miniBTD
2017-08-10
(complete)
done
242
UNSAT
58
OPT/SAT
105
?
79
Naxos
1.1.0
(complete)
done
242
UNSAT
41
OPT/SAT
102
?
99

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
cosoco-mini
1.12
(complete)
359223
(62.12%)
62
(17.27%)
161
(44.85%)
73
(20.33%)
63
(17.55%)
0
(0%)
cosoco-mini
1.1 (2017-06-27)
(complete)
359222
(61.84%)
62
(17.27%)
160
(44.57%)
5
(1.39%)
131
(36.49%)
1
(0.28%)
cosoco-mini
1.1 (2017-07-29)
(complete)
359223
(62.12%)
62
(17.27%)
161
(44.85%)
73
(20.33%)
63
(17.55%)
0
(0%)
Naxos
1.1.0
(complete)
359176
(49.03%)
41
(11.42%)
135
(37.6%)
60
(16.71%)
123
(34.26%)
0
(0%)

Solver NameProgress
cosoco-mini
1.12
(complete)
done
359
UNSAT
62
OPT/SAT
161
SAT (TO/MO)
73
?
63
cosoco-mini
1.1 (2017-06-27)
(complete)
done
359
UNSAT
62
OPT/SAT
160
SAT (TO/MO)
5
?
131
ERR
1
cosoco-mini
1.1 (2017-07-29)
(complete)
done
359
UNSAT
62
OPT/SAT
161
SAT (TO/MO)
73
?
63
Naxos
1.1.0
(complete)
done
359
UNSAT
41
OPT/SAT
135
SAT (TO/MO)
60
?
123

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
cosoco-mini
1.12
(complete)
359223
(62.12%)
62
(17.27%)
161
(44.85%)
73
(20.33%)
63
(17.55%)
0
(0%)
cosoco-mini
1.1 (2017-06-27)
(complete)
359222
(61.84%)
62
(17.27%)
160
(44.57%)
5
(1.39%)
131
(36.49%)
1
(0.28%)
cosoco-mini
1.1 (2017-07-29)
(complete)
359223
(62.12%)
62
(17.27%)
161
(44.85%)
73
(20.33%)
63
(17.55%)
0
(0%)
miniBTD
2017-06-30
(complete)
242162
(66.94%)
58
(23.97%)
104
(42.98%)
0
(0%)
79
(32.64%)
1
(0.41%)
miniBTD
2017-08-10
(complete)
242163
(67.36%)
58
(23.97%)
105
(43.39%)
0
(0%)
79
(32.64%)
0
(0%)
Naxos
1.1.0
(complete)
359176
(49.03%)
41
(11.42%)
135
(37.6%)
60
(16.71%)
123
(34.26%)
0
(0%)

Solver NameProgress
cosoco-mini
1.12
(complete)
done
359
UNSAT
62
OPT/SAT
161
SAT (TO/MO)
73
?
63
cosoco-mini
1.1 (2017-06-27)
(complete)
done
359
UNSAT
62
OPT/SAT
160
SAT (TO/MO)
5
?
131
ERR
1
cosoco-mini
1.1 (2017-07-29)
(complete)
done
359
UNSAT
62
OPT/SAT
161
SAT (TO/MO)
73
?
63
miniBTD
2017-06-30
(complete)
done
242
UNSAT
58
OPT/SAT
104
?
79
ERR
1
miniBTD
2017-08-10
(complete)
done
242
UNSAT
58
OPT/SAT
105
?
79
Naxos
1.1.0
(complete)
done
359
UNSAT
41
OPT/SAT
135
SAT (TO/MO)
60
?
123