2019 XCSP3 competition: main track (CSP and COP, sequential and parallel solvers): solvers page (tabular format, summary)

Some explanations

Category "optimization problem" (COP)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
AbsCon
2019-07-23
(complete)		 300193
(64.33%)		 2
(0.67%)		 191
(63.67%)		 55
(18.33%)		 52
(17.33%)		 0
(0%)
choco-solver
2019-06-14
(complete)		 300206
(68.67%)		 2
(0.67%)		 204
(68%)		 73
(24.33%)		 21
(7%)		 0
(0%)
choco-solver
2019-06-14 parallel
(complete)		 300191
(63.67%)		 2
(0.67%)		 189
(63%)		 53
(17.67%)		 17
(5.67%)		 39
(13%)
choco-solver
2019-09-16
(complete)		 300210
(70%)		 2
(0.67%)		 208
(69.33%)		 70
(23.33%)		 20
(6.67%)		 0
(0%)
choco-solver
2019-09-16 parallel
(complete)		 300218
(72.67%)		 2
(0.67%)		 216
(72%)		 65
(21.67%)		 17
(5.67%)		 0
(0%)
choco-solver
2019-09-20
(complete)		 300192
(64%)		 2
(0.67%)		 190
(63.33%)		 68
(22.67%)		 20
(6.67%)		 20
(6.67%)
choco-solver
2019-09-20 parallel
(complete)		 300197
(65.67%)		 2
(0.67%)		 195
(65%)		 66
(22%)		 17
(5.67%)		 20
(6.67%)
choco-solver
2019-09-24
(complete)		 300180
(60%)		 1
(0.33%)		 179
(59.67%)		 88
(29.33%)		 32
(10.67%)		 0
(0%)
choco-solver
2019-09-24 parallel
(complete)		 300217
(72.33%)		 2
(0.67%)		 215
(71.67%)		 65
(21.67%)		 18
(6%)		 0
(0%)
Concrete
3.10
(complete)		 300154
(51.33%)		 1
(0.33%)		 153
(51%)		 108
(36%)		 24
(8%)		 14
(4.67%)
Concrete
3.12.2
(complete)		 300159
(53%)		 1
(0.33%)		 158
(52.67%)		 108
(36%)		 33
(11%)		 0
(0%)
Concrete
3.12.2
(complete)		 300123
(41%)		 1
(0.33%)		 122
(40.67%)		 144
(48%)		 33
(11%)		 0
(0%)
Concrete
3.12.3
(complete)		 300174
(58%)		 1
(0.33%)		 173
(57.67%)		 99
(33%)		 27
(9%)		 0
(0%)
cosoco
2
(complete)		 300117
(39%)		 1
(0.33%)		 116
(38.67%)		 107
(35.67%)		 76
(25.33%)		 0
(0%)
cosoco
2.0
(complete)		 300118
(39.33%)		 1
(0.33%)		 117
(39%)		 106
(35.33%)		 76
(25.33%)		 0
(0%)
cosoco
2.0
(complete)		 300118
(39.33%)		 1
(0.33%)		 117
(39%)		 106
(35.33%)		 76
(25.33%)		 0
(0%)
cosoco
2.0 parallel
(complete)		 300161
(53.67%)		 2
(0.67%)		 159
(53%)		 76
(25.33%)		 63
(21%)		 0
(0%)
cosoco
2.O parallel
(complete)		 300152
(50.67%)		 2
(0.67%)		 150
(50%)		 77
(25.67%)		 63
(21%)		 8
(2.67%)
PicatSAT
2019-09-12
(complete)		 300221
(73.67%)		 2
(0.67%)		 219
(73%)		 0
(0%)		 79
(26.33%)		 0
(0%)

Solver NameProgress
AbsCon
2019-07-23
(complete)
done
300
UNSAT
2		OPT/SAT
191		SAT (TO/MO)
55		?
52
choco-solver
2019-06-14
(complete)
done
300
UNSAT
2		OPT/SAT
204		SAT (TO/MO)
73		?
21
choco-solver
2019-06-14 parallel
(complete)
done
300
UNSAT
2		OPT/SAT
189		SAT (TO/MO)
53		?
17		ERR
39
choco-solver
2019-09-16
(complete)
done
300
UNSAT
2		OPT/SAT
208		SAT (TO/MO)
70		?
20
choco-solver
2019-09-16 parallel
(complete)
done
300
UNSAT
2		OPT/SAT
216		SAT (TO/MO)
65		?
17
choco-solver
2019-09-20
(complete)
done
300
UNSAT
2		OPT/SAT
190		SAT (TO/MO)
68		?
20		ERR
20
choco-solver
2019-09-20 parallel
(complete)
done
300
UNSAT
2		OPT/SAT
195		SAT (TO/MO)
66		?
17		ERR
20
choco-solver
2019-09-24
(complete)
done
300
UNSAT
1		OPT/SAT
179		SAT (TO/MO)
88		?
32
choco-solver
2019-09-24 parallel
(complete)
done
300
UNSAT
2		OPT/SAT
215		SAT (TO/MO)
65		?
18
Concrete
3.10
(complete)
done
300
UNSAT
1		OPT/SAT
153		SAT (TO/MO)
108		?
24		ERR
14
Concrete
3.12.2
(complete)
done
300
UNSAT
1		OPT/SAT
158		SAT (TO/MO)
108		?
33
Concrete
3.12.2
(complete)
done
300
UNSAT
1		OPT/SAT
122		SAT (TO/MO)
144		?
33
Concrete
3.12.3
(complete)
done
300
UNSAT
1		OPT/SAT
173		SAT (TO/MO)
99		?
27
cosoco
2
(complete)
done
300
UNSAT
1		OPT/SAT
116		SAT (TO/MO)
107		?
76
cosoco
2.0
(complete)
done
300
UNSAT
1		OPT/SAT
117		SAT (TO/MO)
106		?
76
cosoco
2.0
(complete)
done
300
UNSAT
1		OPT/SAT
117		SAT (TO/MO)
106		?
76
cosoco
2.0 parallel
(complete)
done
300
UNSAT
2		OPT/SAT
159		SAT (TO/MO)
76		?
63
cosoco
2.O parallel
(complete)
done
300
UNSAT
2		OPT/SAT
150		SAT (TO/MO)
77		?
63		ERR
8
PicatSAT
2019-09-12
(complete)
done
300
UNSAT
2		OPT/SAT
219		?
79

Category "decision problem" (CSP)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
AbsCon
2019-07-23
(complete)		 300168
(56%)		 53
(17.67%)		 115
(38.33%)		 0
(0%)		 132
(44%)		 0
(0%)
BTD
19.07.01
(complete)		 300135
(45%)		 51
(17%)		 84
(28%)		 0
(0%)		 165
(55%)		 0
(0%)
choco-solver
2019-06-14
(complete)		 300168
(56%)		 48
(16%)		 120
(40%)		 0
(0%)		 132
(44%)		 0
(0%)
choco-solver
2019-06-14 parallel
(complete)		 300188
(62.67%)		 57
(19%)		 131
(43.67%)		 0
(0%)		 112
(37.33%)		 0
(0%)
choco-solver
2019-09-16
(complete)		 300165
(55%)		 47
(15.67%)		 118
(39.33%)		 0
(0%)		 134
(44.67%)		 1
(0.33%)
choco-solver
2019-09-16 parallel
(complete)		 300186
(62%)		 55
(18.33%)		 131
(43.67%)		 0
(0%)		 113
(37.67%)		 1
(0.33%)
choco-solver
2019-09-20
(complete)		 300165
(55%)		 47
(15.67%)		 118
(39.33%)		 0
(0%)		 135
(45%)		 0
(0%)
choco-solver
2019-09-20 parallel
(complete)		 300185
(61.67%)		 54
(18%)		 131
(43.67%)		 0
(0%)		 115
(38.33%)		 0
(0%)
choco-solver
2019-09-24
(complete)		 300149
(49.67%)		 48
(16%)		 101
(33.67%)		 0
(0%)		 151
(50.33%)		 0
(0%)
choco-solver
2019-09-24 parallel
(complete)		 300185
(61.67%)		 54
(18%)		 131
(43.67%)		 0
(0%)		 115
(38.33%)		 0
(0%)
Concrete
3.10
(complete)		 300165
(55%)		 53
(17.67%)		 112
(37.33%)		 0
(0%)		 135
(45%)		 0
(0%)
Concrete
3.12.2
(complete)		 300156
(52%)		 49
(16.33%)		 107
(35.67%)		 0
(0%)		 143
(47.67%)		 1
(0.33%)
Concrete
3.12.2
(complete)		 300133
(44.33%)		 39
(13%)		 94
(31.33%)		 0
(0%)		 167
(55.67%)		 0
(0%)
Concrete
3.12.3
(complete)		 300156
(52%)		 50
(16.67%)		 106
(35.33%)		 0
(0%)		 144
(48%)		 0
(0%)
cosoco
2
(complete)		 300127
(42.33%)		 45
(15%)		 82
(27.33%)		 0
(0%)		 172
(57.33%)		 1
(0.33%)
cosoco
2.0
(complete)		 300126
(42%)		 44
(14.67%)		 82
(27.33%)		 0
(0%)		 174
(58%)		 0
(0%)
cosoco
2.0
(complete)		 300127
(42.33%)		 45
(15%)		 82
(27.33%)		 0
(0%)		 173
(57.67%)		 0
(0%)
cosoco
2.0 parallel
(complete)		 300147
(49%)		 51
(17%)		 96
(32%)		 0
(0%)		 153
(51%)		 0
(0%)
cosoco
2.O parallel
(complete)		 300151
(50.33%)		 52
(17.33%)		 99
(33%)		 0
(0%)		 149
(49.67%)		 0
(0%)
Fun-sCOP
hybrid+CryptoMiniSat (2019-06-15)
(complete)		 300209
(69.67%)		 77
(25.67%)		 132
(44%)		 0
(0%)		 91
(30.33%)		 0
(0%)
Fun-sCOP
hybrid+ManyGlucose (2019-06-15)
(complete)		 300217
(72.33%)		 83
(27.67%)		 134
(44.67%)		 0
(0%)		 83
(27.67%)		 0
(0%)
Fun-sCOP
hybrid+ManyGlucose (2019-09-22)
(complete)		 300219
(73%)		 82
(27.33%)		 137
(45.67%)		 0
(0%)		 81
(27%)		 0
(0%)
Fun-sCOP
order+GlueMiniSat (2019-06-15)
(complete)		 300190
(63.33%)		 68
(22.67%)		 122
(40.67%)		 0
(0%)		 110
(36.67%)		 0
(0%)
Fun-sCOP
order+ManyGlucose (2019-06-15)
(complete)		 300205
(68.33%)		 75
(25%)		 130
(43.33%)		 0
(0%)		 95
(31.67%)		 0
(0%)
Fun-sCOP
order+ManyGlucose (2019-09-22)
(complete)		 300211
(70.33%)		 76
(25.33%)		 135
(45%)		 0
(0%)		 89
(29.67%)		 0
(0%)
PicatSAT
2019-09-12
(complete)		 300246
(82%)		 82
(27.33%)		 164
(54.67%)		 0
(0%)		 54
(18%)		 0
(0%)

Solver NameProgress
AbsCon
2019-07-23
(complete)
done
300
UNSAT
53		OPT/SAT
115		?
132
BTD
19.07.01
(complete)
done
300
UNSAT
51		OPT/SAT
84		?
165
choco-solver
2019-06-14
(complete)
done
300
UNSAT
48		OPT/SAT
120		?
132
choco-solver
2019-06-14 parallel
(complete)
done
300
UNSAT
57		OPT/SAT
131		?
112
choco-solver
2019-09-16
(complete)
done
300
UNSAT
47		OPT/SAT
118		?
134		ERR
1
choco-solver
2019-09-16 parallel
(complete)
done
300
UNSAT
55		OPT/SAT
131		?
113		ERR
1
choco-solver
2019-09-20
(complete)
done
300
UNSAT
47		OPT/SAT
118		?
135
choco-solver
2019-09-20 parallel
(complete)
done
300
UNSAT
54		OPT/SAT
131		?
115
choco-solver
2019-09-24
(complete)
done
300
UNSAT
48		OPT/SAT
101		?
151
choco-solver
2019-09-24 parallel
(complete)
done
300
UNSAT
54		OPT/SAT
131		?
115
Concrete
3.10
(complete)
done
300
UNSAT
53		OPT/SAT
112		?
135
Concrete
3.12.2
(complete)
done
300
UNSAT
49		OPT/SAT
107		?
143		ERR
1
Concrete
3.12.2
(complete)
done
300
UNSAT
39		OPT/SAT
94		?
167
Concrete
3.12.3
(complete)
done
300
UNSAT
50		OPT/SAT
106		?
144
cosoco
2
(complete)
done
300
UNSAT
45		OPT/SAT
82		?
172		ERR
1
cosoco
2.0
(complete)
done
300
UNSAT
44		OPT/SAT
82		?
174
cosoco
2.0
(complete)
done
300
UNSAT
45		OPT/SAT
82		?
173
cosoco
2.0 parallel
(complete)
done
300
UNSAT
51		OPT/SAT
96		?
153
cosoco
2.O parallel
(complete)
done
300
UNSAT
52		OPT/SAT
99		?
149
Fun-sCOP
hybrid+CryptoMiniSat (2019-06-15)
(complete)
done
300
UNSAT
77		OPT/SAT
132		?
91
Fun-sCOP
hybrid+ManyGlucose (2019-06-15)
(complete)
done
300
UNSAT
83		OPT/SAT
134		?
83
Fun-sCOP
hybrid+ManyGlucose (2019-09-22)
(complete)
done
300
UNSAT
82		OPT/SAT
137		?
81
Fun-sCOP
order+GlueMiniSat (2019-06-15)
(complete)
done
300
UNSAT
68		OPT/SAT
122		?
110
Fun-sCOP
order+ManyGlucose (2019-06-15)
(complete)
done
300
UNSAT
75		OPT/SAT
130		?
95
Fun-sCOP
order+ManyGlucose (2019-09-22)
(complete)
done
300
UNSAT
76		OPT/SAT
135		?
89
PicatSAT
2019-09-12
(complete)
done
300
UNSAT
82		OPT/SAT
164		?
54

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
AbsCon
2019-07-23
(complete)		 600361
(60.17%)		 55
(9.17%)		 306
(51%)		 55
(9.17%)		 184
(30.67%)		 0
(0%)
choco-solver
2019-06-14
(complete)		 600374
(62.33%)		 50
(8.33%)		 324
(54%)		 73
(12.17%)		 153
(25.5%)		 0
(0%)
choco-solver
2019-06-14 parallel
(complete)		 600379
(63.17%)		 59
(9.83%)		 320
(53.33%)		 53
(8.83%)		 129
(21.5%)		 39
(6.5%)
choco-solver
2019-09-16
(complete)		 600375
(62.5%)		 49
(8.17%)		 326
(54.33%)		 70
(11.67%)		 154
(25.67%)		 1
(0.17%)
choco-solver
2019-09-16 parallel
(complete)		 600404
(67.33%)		 57
(9.5%)		 347
(57.83%)		 65
(10.83%)		 130
(21.67%)		 1
(0.17%)
choco-solver
2019-09-20
(complete)		 600357
(59.5%)		 49
(8.17%)		 308
(51.33%)		 68
(11.33%)		 155
(25.83%)		 20
(3.33%)
choco-solver
2019-09-20 parallel
(complete)		 600382
(63.67%)		 56
(9.33%)		 326
(54.33%)		 66
(11%)		 132
(22%)		 20
(3.33%)
choco-solver
2019-09-24
(complete)		 600329
(54.83%)		 49
(8.17%)		 280
(46.67%)		 88
(14.67%)		 183
(30.5%)		 0
(0%)
choco-solver
2019-09-24 parallel
(complete)		 600402
(67%)		 56
(9.33%)		 346
(57.67%)		 65
(10.83%)		 133
(22.17%)		 0
(0%)
Concrete
3.10
(complete)		 600319
(53.17%)		 54
(9%)		 265
(44.17%)		 108
(18%)		 159
(26.5%)		 14
(2.33%)
Concrete
3.12.2
(complete)		 600315
(52.5%)		 50
(8.33%)		 265
(44.17%)		 108
(18%)		 176
(29.33%)		 1
(0.17%)
Concrete
3.12.2
(complete)		 600256
(42.67%)		 40
(6.67%)		 216
(36%)		 144
(24%)		 200
(33.33%)		 0
(0%)
Concrete
3.12.3
(complete)		 600330
(55%)		 51
(8.5%)		 279
(46.5%)		 99
(16.5%)		 171
(28.5%)		 0
(0%)
cosoco
2
(complete)		 600244
(40.67%)		 46
(7.67%)		 198
(33%)		 107
(17.83%)		 248
(41.33%)		 1
(0.17%)
cosoco
2.0
(complete)		 600245
(40.83%)		 46
(7.67%)		 199
(33.17%)		 106
(17.67%)		 249
(41.5%)		 0
(0%)
cosoco
2.0
(complete)		 600244
(40.67%)		 45
(7.5%)		 199
(33.17%)		 106
(17.67%)		 250
(41.67%)		 0
(0%)
cosoco
2.0 parallel
(complete)		 600308
(51.33%)		 53
(8.83%)		 255
(42.5%)		 76
(12.67%)		 216
(36%)		 0
(0%)
cosoco
2.O parallel
(complete)		 600303
(50.5%)		 54
(9%)		 249
(41.5%)		 77
(12.83%)		 212
(35.33%)		 8
(1.33%)
PicatSAT
2019-09-12
(complete)		 600467
(77.83%)		 84
(14%)		 383
(63.83%)		 0
(0%)		 133
(22.17%)		 0
(0%)

Solver NameProgress
AbsCon
2019-07-23
(complete)
done
600
UNSAT
55		OPT/SAT
306		SAT (TO/MO)
55		?
184
choco-solver
2019-06-14
(complete)
done
600
UNSAT
50		OPT/SAT
324		SAT (TO/MO)
73		?
153
choco-solver
2019-06-14 parallel
(complete)
done
600
UNSAT
59		OPT/SAT
320		SAT (TO/MO)
53		?
129		ERR
39
choco-solver
2019-09-16
(complete)
done
600
UNSAT
49		OPT/SAT
326		SAT (TO/MO)
70		?
154		ERR
1
choco-solver
2019-09-16 parallel
(complete)
done
600
UNSAT
57		OPT/SAT
347		SAT (TO/MO)
65		?
130		ERR
1
choco-solver
2019-09-20
(complete)
done
600
UNSAT
49		OPT/SAT
308		SAT (TO/MO)
68		?
155		ERR
20
choco-solver
2019-09-20 parallel
(complete)
done
600
UNSAT
56		OPT/SAT
326		SAT (TO/MO)
66		?
132		ERR
20
choco-solver
2019-09-24
(complete)
done
600
UNSAT
49		OPT/SAT
280		SAT (TO/MO)
88		?
183
choco-solver
2019-09-24 parallel
(complete)
done
600
UNSAT
56		OPT/SAT
346		SAT (TO/MO)
65		?
133
Concrete
3.10
(complete)
done
600
UNSAT
54		OPT/SAT
265		SAT (TO/MO)
108		?
159		ERR
14
Concrete
3.12.2
(complete)
done
600
UNSAT
50		OPT/SAT
265		SAT (TO/MO)
108		?
176		ERR
1
Concrete
3.12.2
(complete)
done
600
UNSAT
40		OPT/SAT
216		SAT (TO/MO)
144		?
200
Concrete
3.12.3
(complete)
done
600
UNSAT
51		OPT/SAT
279		SAT (TO/MO)
99		?
171
cosoco
2
(complete)
done
600
UNSAT
46		OPT/SAT
198		SAT (TO/MO)
107		?
248		ERR
1
cosoco
2.0
(complete)
done
600
UNSAT
46		OPT/SAT
199		SAT (TO/MO)
106		?
249
cosoco
2.0
(complete)
done
600
UNSAT
45		OPT/SAT
199		SAT (TO/MO)
106		?
250
cosoco
2.0 parallel
(complete)
done
600
UNSAT
53		OPT/SAT
255		SAT (TO/MO)
76		?
216
cosoco
2.O parallel
(complete)
done
600
UNSAT
54		OPT/SAT
249		SAT (TO/MO)
77		?
212		ERR
8
PicatSAT
2019-09-12
(complete)
done
600
UNSAT
84		OPT/SAT
383		?
133

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
AbsCon
2019-07-23
(complete)		 600361
(60.17%)		 55
(9.17%)		 306
(51%)		 55
(9.17%)		 184
(30.67%)		 0
(0%)
BTD
19.07.01
(complete)		 300135
(45%)		 51
(17%)		 84
(28%)		 0
(0%)		 165
(55%)		 0
(0%)
choco-solver
2019-06-14
(complete)		 600374
(62.33%)		 50
(8.33%)		 324
(54%)		 73
(12.17%)		 153
(25.5%)		 0
(0%)
choco-solver
2019-06-14 parallel
(complete)		 600379
(63.17%)		 59
(9.83%)		 320
(53.33%)		 53
(8.83%)		 129
(21.5%)		 39
(6.5%)
choco-solver
2019-09-16
(complete)		 600375
(62.5%)		 49
(8.17%)		 326
(54.33%)		 70
(11.67%)		 154
(25.67%)		 1
(0.17%)
choco-solver
2019-09-16 parallel
(complete)		 600404
(67.33%)		 57
(9.5%)		 347
(57.83%)		 65
(10.83%)		 130
(21.67%)		 1
(0.17%)
choco-solver
2019-09-20
(complete)		 600357
(59.5%)		 49
(8.17%)		 308
(51.33%)		 68
(11.33%)		 155
(25.83%)		 20
(3.33%)
choco-solver
2019-09-20 parallel
(complete)		 600382
(63.67%)		 56
(9.33%)		 326
(54.33%)		 66
(11%)		 132
(22%)		 20
(3.33%)
choco-solver
2019-09-24
(complete)		 600329
(54.83%)		 49
(8.17%)		 280
(46.67%)		 88
(14.67%)		 183
(30.5%)		 0
(0%)
choco-solver
2019-09-24 parallel
(complete)		 600402
(67%)		 56
(9.33%)		 346
(57.67%)		 65
(10.83%)		 133
(22.17%)		 0
(0%)
Concrete
3.10
(complete)		 600319
(53.17%)		 54
(9%)		 265
(44.17%)		 108
(18%)		 159
(26.5%)		 14
(2.33%)
Concrete
3.12.2
(complete)		 600315
(52.5%)		 50
(8.33%)		 265
(44.17%)		 108
(18%)		 176
(29.33%)		 1
(0.17%)
Concrete
3.12.2
(complete)		 600256
(42.67%)		 40
(6.67%)		 216
(36%)		 144
(24%)		 200
(33.33%)		 0
(0%)
Concrete
3.12.3
(complete)		 600330
(55%)		 51
(8.5%)		 279
(46.5%)		 99
(16.5%)		 171
(28.5%)		 0
(0%)
cosoco
2
(complete)		 600244
(40.67%)		 46
(7.67%)		 198
(33%)		 107
(17.83%)		 248
(41.33%)		 1
(0.17%)
cosoco
2.0
(complete)		 600245
(40.83%)		 46
(7.67%)		 199
(33.17%)		 106
(17.67%)		 249
(41.5%)		 0
(0%)
cosoco
2.0
(complete)		 600244
(40.67%)		 45
(7.5%)		 199
(33.17%)		 106
(17.67%)		 250
(41.67%)		 0
(0%)
cosoco
2.0 parallel
(complete)		 600308
(51.33%)		 53
(8.83%)		 255
(42.5%)		 76
(12.67%)		 216
(36%)		 0
(0%)
cosoco
2.O parallel
(complete)		 600303
(50.5%)		 54
(9%)		 249
(41.5%)		 77
(12.83%)		 212
(35.33%)		 8
(1.33%)
Fun-sCOP
hybrid+CryptoMiniSat (2019-06-15)
(complete)		 300209
(69.67%)		 77
(25.67%)		 132
(44%)		 0
(0%)		 91
(30.33%)		 0
(0%)
Fun-sCOP
hybrid+ManyGlucose (2019-06-15)
(complete)		 300217
(72.33%)		 83
(27.67%)		 134
(44.67%)		 0
(0%)		 83
(27.67%)		 0
(0%)
Fun-sCOP
hybrid+ManyGlucose (2019-09-22)
(complete)		 300219
(73%)		 82
(27.33%)		 137
(45.67%)		 0
(0%)		 81
(27%)		 0
(0%)
Fun-sCOP
order+GlueMiniSat (2019-06-15)
(complete)		 300190
(63.33%)		 68
(22.67%)		 122
(40.67%)		 0
(0%)		 110
(36.67%)		 0
(0%)
Fun-sCOP
order+ManyGlucose (2019-06-15)
(complete)		 300205
(68.33%)		 75
(25%)		 130
(43.33%)		 0
(0%)		 95
(31.67%)		 0
(0%)
Fun-sCOP
order+ManyGlucose (2019-09-22)
(complete)		 300211
(70.33%)		 76
(25.33%)		 135
(45%)		 0
(0%)		 89
(29.67%)		 0
(0%)
PicatSAT
2019-09-12
(complete)		 600467
(77.83%)		 84
(14%)		 383
(63.83%)		 0
(0%)		 133
(22.17%)		 0
(0%)

Solver NameProgress
AbsCon
2019-07-23
(complete)
done
600
UNSAT
55		OPT/SAT
306		SAT (TO/MO)
55		?
184
BTD
19.07.01
(complete)
done
300
UNSAT
51		OPT/SAT
84		?
165
choco-solver
2019-06-14
(complete)
done
600
UNSAT
50		OPT/SAT
324		SAT (TO/MO)
73		?
153
choco-solver
2019-06-14 parallel
(complete)
done
600
UNSAT
59		OPT/SAT
320		SAT (TO/MO)
53		?
129		ERR
39
choco-solver
2019-09-16
(complete)
done
600
UNSAT
49		OPT/SAT
326		SAT (TO/MO)
70		?
154		ERR
1
choco-solver
2019-09-16 parallel
(complete)
done
600
UNSAT
57		OPT/SAT
347		SAT (TO/MO)
65		?
130		ERR
1
choco-solver
2019-09-20
(complete)
done
600
UNSAT
49		OPT/SAT
308		SAT (TO/MO)
68		?
155		ERR
20
choco-solver
2019-09-20 parallel
(complete)
done
600
UNSAT
56		OPT/SAT
326		SAT (TO/MO)
66		?
132		ERR
20
choco-solver
2019-09-24
(complete)
done
600
UNSAT
49		OPT/SAT
280		SAT (TO/MO)
88		?
183
choco-solver
2019-09-24 parallel
(complete)
done
600
UNSAT
56		OPT/SAT
346		SAT (TO/MO)
65		?
133
Concrete
3.10
(complete)
done
600
UNSAT
54		OPT/SAT
265		SAT (TO/MO)
108		?
159		ERR
14
Concrete
3.12.2
(complete)
done
600
UNSAT
50		OPT/SAT
265		SAT (TO/MO)
108		?
176		ERR
1
Concrete
3.12.2
(complete)
done
600
UNSAT
40		OPT/SAT
216		SAT (TO/MO)
144		?
200
Concrete
3.12.3
(complete)
done
600
UNSAT
51		OPT/SAT
279		SAT (TO/MO)
99		?
171
cosoco
2
(complete)
done
600
UNSAT
46		OPT/SAT
198		SAT (TO/MO)
107		?
248		ERR
1
cosoco
2.0
(complete)
done
600
UNSAT
46		OPT/SAT
199		SAT (TO/MO)
106		?
249
cosoco
2.0
(complete)
done
600
UNSAT
45		OPT/SAT
199		SAT (TO/MO)
106		?
250
cosoco
2.0 parallel
(complete)
done
600
UNSAT
53		OPT/SAT
255		SAT (TO/MO)
76		?
216
cosoco
2.O parallel
(complete)
done
600
UNSAT
54		OPT/SAT
249		SAT (TO/MO)
77		?
212		ERR
8
Fun-sCOP
hybrid+CryptoMiniSat (2019-06-15)
(complete)
done
300
UNSAT
77		OPT/SAT
132		?
91
Fun-sCOP
hybrid+ManyGlucose (2019-06-15)
(complete)
done
300
UNSAT
83		OPT/SAT
134		?
83
Fun-sCOP
hybrid+ManyGlucose (2019-09-22)
(complete)
done
300
UNSAT
82		OPT/SAT
137		?
81
Fun-sCOP
order+GlueMiniSat (2019-06-15)
(complete)
done
300
UNSAT
68		OPT/SAT
122		?
110
Fun-sCOP
order+ManyGlucose (2019-06-15)
(complete)
done
300
UNSAT
75		OPT/SAT
130		?
95
Fun-sCOP
order+ManyGlucose (2019-09-22)
(complete)
done
300
UNSAT
76		OPT/SAT
135		?
89
PicatSAT
2019-09-12
(complete)
done
600
UNSAT
84		OPT/SAT
383		?
133