PB'24 competition: solvers page (tabular format, summary)

Some explanations

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN)

Solver Name#benchsSolvedUNSATCUNSATOPTC/SATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)		 397273
(68.77%)		 0
(0%)		 149
(37.53%)		 0
(0%)		 124
(31.23%)		 0
(0%)		 124
(31.23%)		 0
(0%)
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)		 397268
(67.51%)		 0
(0%)		 149
(37.53%)		 0
(0%)		 119
(29.97%)		 0
(0%)		 129
(32.49%)		 0
(0%)
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)		 397267
(67.25%)		 0
(0%)		 154
(38.79%)		 0
(0%)		 113
(28.46%)		 0
(0%)		 130
(32.75%)		 0
(0%)
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)		 397267
(67.25%)		 0
(0%)		 154
(38.79%)		 0
(0%)		 113
(28.46%)		 0
(0%)		 130
(32.75%)		 0
(0%)
DLS-PBO
2024-07-09
(incomplete)		 397121
(30.48%)		 0
(0%)		 10
(2.52%)		 0
(0%)		 111
(27.96%)		 0
(0%)		 276
(69.52%)		 0
(0%)
Exact
2024-07-05
(complete)		 397286
(72.04%)		 0
(0%)		 184
(46.35%)		 0
(0%)		 102
(25.69%)		 0
(0%)		 111
(27.96%)		 0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)		 397275
(69.27%)		 0
(0%)		 171
(43.07%)		 0
(0%)		 104
(26.2%)		 0
(0%)		 122
(30.73%)		 0
(0%)
Exact_veripb2
2024-07-05
(complete)		 397291
(73.3%)		 175
(44.08%)		 8
(2.02%)		 0
(0%)		 108
(27.2%)		 0
(0%)		 106
(26.7%)		 0
(0%)
Exact_veripb2_no_SoPlex
2024-07-05
(complete)		 397284
(71.54%)		 165
(41.56%)		 7
(1.76%)		 0
(0%)		 112
(28.21%)		 0
(0%)		 113
(28.46%)		 0
(0%)
FiberSCIP
2024-07-02
(complete)		 397236
(59.45%)		 0
(0%)		 159
(40.05%)		 0
(0%)		 77
(19.4%)		 0
(0%)		 161
(40.55%)		 0
(0%)
FiberSCIP
2024-07-30
(complete)		 397235
(59.19%)		 0
(0%)		 159
(40.05%)		 0
(0%)		 76
(19.14%)		 0
(0%)		 162
(40.81%)		 0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)		 397268
(67.51%)		 0
(0%)		 167
(42.07%)		 0
(0%)		 101
(25.44%)		 0
(0%)		 129
(32.49%)		 0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)		 397269
(67.76%)		 0
(0%)		 170
(42.82%)		 0
(0%)		 99
(24.94%)		 0
(0%)		 128
(32.24%)		 0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)		 397270
(68.01%)		 0
(0%)		 169
(42.57%)		 0
(0%)		 101
(25.44%)		 0
(0%)		 127
(31.99%)		 0
(0%)
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)		 397312
(78.59%)		 0
(0%)		 186
(46.85%)		 0
(0%)		 126
(31.74%)		 0
(0%)		 85
(21.41%)		 0
(0%)
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)		 397309
(77.83%)		 0
(0%)		 186
(46.85%)		 0
(0%)		 123
(30.98%)		 0
(0%)		 88
(22.17%)		 0
(0%)
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)		 397117
(29.47%)		 0
(0%)		 0
(0%)		 0
(0%)		 117
(29.47%)		 0
(0%)		 280
(70.53%)		 0
(0%)
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)		 397130
(32.75%)		 0
(0%)		 0
(0%)		 0
(0%)		 130
(32.75%)		 0
(0%)		 267
(67.25%)		 0
(0%)
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)		 397115
(28.97%)		 0
(0%)		 0
(0%)		 0
(0%)		 115
(28.97%)		 0
(0%)		 282
(71.03%)		 0
(0%)
LS-Mab
2024-07-10
(incomplete)		 397105
(26.45%)		 0
(0%)		 0
(0%)		 0
(0%)		 105
(26.45%)		 0
(0%)		 292
(73.55%)		 0
(0%)
LS-MabP
2024-07-10
(incomplete)		 397108
(27.2%)		 0
(0%)		 0
(0%)		 0
(0%)		 108
(27.2%)		 0
(0%)		 289
(72.8%)		 0
(0%)
LS-MabS
2024-07-10
(incomplete)		 397110
(27.71%)		 0
(0%)		 0
(0%)		 0
(0%)		 110
(27.71%)		 0
(0%)		 287
(72.29%)		 0
(0%)
LS-MabSP
2024-07-10
(incomplete)		 397112
(28.21%)		 0
(0%)		 0
(0%)		 0
(0%)		 112
(28.21%)		 0
(0%)		 285
(71.79%)		 0
(0%)
NaPS
1.03
(complete)		 397273
(68.77%)		 0
(0%)		 151
(38.04%)		 0
(0%)		 122
(30.73%)		 0
(0%)		 124
(31.23%)		 0
(0%)
NaPS-GM
1.03
(complete)		 397241
(60.71%)		 0
(0%)		 150
(37.78%)		 0
(0%)		 91
(22.92%)		 0
(0%)		 156
(39.29%)		 0
(0%)
NaPS-PB16
1.02b5
(complete)		 397236
(59.45%)		 0
(0%)		 150
(37.78%)		 0
(0%)		 86
(21.66%)		 0
(0%)		 161
(40.55%)		 0
(0%)
ParLS-PBO-1.1
2024-07-09
(incomplete)		 397122
(30.73%)		 0
(0%)		 10
(2.52%)		 0
(0%)		 112
(28.21%)		 0
(0%)		 275
(69.27%)		 0
(0%)
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)		 397134
(33.75%)		 0
(0%)		 10
(2.52%)		 0
(0%)		 124
(31.23%)		 0
(0%)		 263
(66.25%)		 0
(0%)
Picat
2024-06-18
(complete)		 397273
(68.77%)		 0
(0%)		 150
(37.78%)		 0
(0%)		 123
(30.98%)		 0
(0%)		 124
(31.23%)		 0
(0%)
RoundingSat
log (1)
(complete)		 39798
(24.69%)		 0
(0%)		 0
(0%)		 0
(0%)		 98
(24.69%)		 0
(0%)		 110
(27.71%)		 189
(47.61%)
RoundingSat
log (2)
(complete)		 397287
(72.29%)		 189
(47.61%)		 0
(0%)		 0
(0%)		 98
(24.69%)		 0
(0%)		 110
(27.71%)		 0
(0%)
RoundingSat
log (3)
(complete)		 397288
(72.54%)		 189
(47.61%)		 0
(0%)		 0
(0%)		 99
(24.94%)		 0
(0%)		 109
(27.46%)		 0
(0%)
RoundingSat
nolog (1)
(complete)		 39797
(24.43%)		 0
(0%)		 0
(0%)		 0
(0%)		 97
(24.43%)		 0
(0%)		 0
(0%)		 300
(75.57%)
RoundingSat
nolog (2)
(complete)		 397282
(71.03%)		 0
(0%)		 184
(46.35%)		 0
(0%)		 98
(24.69%)		 0
(0%)		 115
(28.97%)		 0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)		 397199
(50.13%)		 0
(0%)		 139
(35.01%)		 0
(0%)		 60
(15.11%)		 0
(0%)		 198
(49.87%)		 0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)		 397217
(54.66%)		 0
(0%)		 149
(37.53%)		 0
(0%)		 68
(17.13%)		 0
(0%)		 180
(45.34%)		 0
(0%)
Sat4j Resolution 2024
2024-07-07
(complete)		 397244
(61.46%)		 141
(35.52%)		 1
(0.25%)		 0
(0%)		 102
(25.69%)		 0
(0%)		 153
(38.54%)		 0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)		 397246
(61.96%)		 0
(0%)		 142
(35.77%)		 0
(0%)		 104
(26.2%)		 0
(0%)		 151
(38.04%)		 0
(0%)
SCIP
2024-07-07
(complete)		 397241
(60.71%)		 0
(0%)		 161
(40.55%)		 0
(0%)		 80
(20.15%)		 0
(0%)		 156
(39.29%)		 0
(0%)

Solver NameProgress
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
done
397
UNSAT
149		OPT/SAT
124		?
124
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
done
397
UNSAT
149		OPT/SAT
119		?
129
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
done
397
UNSAT
154		OPT/SAT
113		?
130
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
done
397
UNSAT
154		OPT/SAT
113		?
130
DLS-PBO
2024-07-09
(incomplete)
done
397
UNSAT
10		OPT/SAT
111		?
276
Exact
2024-07-05
(complete)
done
397
UNSAT
184		OPT/SAT
102		?
111
Exact_no_SoPlex
2024-07-05
(complete)
done
397
UNSAT
171		OPT/SAT
104		?
122
Exact_veripb2
2024-07-05
(complete)
done
397
UNSATC
175		UNSAT
8		OPT/SAT
108		?
106
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
done
397
UNSATC
165		UNSAT
7		OPT/SAT
112		?
113
FiberSCIP
2024-07-02
(complete)
done
397
UNSAT
159		OPT/SAT
77		?
161
FiberSCIP
2024-07-30
(complete)
done
397
UNSAT
159		OPT/SAT
76		?
162
FiberSCIP
20 cores, 2024-07-30
(complete)
done
397
UNSAT
167		OPT/SAT
101		?
129
FiberSCIP
20 cores, 2024-08-09
(complete)
done
397
UNSAT
170		OPT/SAT
99		?
128
FiberSCIP
20 cores, 2024-08-12
(complete)
done
397
UNSAT
169		OPT/SAT
101		?
127
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
done
397
UNSAT
186		OPT/SAT
126		?
85
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
done
397
UNSAT
186		OPT/SAT
123		?
88
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
done
397
OPT/SAT
117		?
280
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
done
397
OPT/SAT
130		?
267
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
done
397
OPT/SAT
115		?
282
LS-Mab
2024-07-10
(incomplete)
done
397
OPT/SAT
105		?
292
LS-MabP
2024-07-10
(incomplete)
done
397
OPT/SAT
108		?
289
LS-MabS
2024-07-10
(incomplete)
done
397
OPT/SAT
110		?
287
LS-MabSP
2024-07-10
(incomplete)
done
397
OPT/SAT
112		?
285
NaPS
1.03
(complete)
done
397
UNSAT
151		OPT/SAT
122		?
124
NaPS-GM
1.03
(complete)
done
397
UNSAT
150		OPT/SAT
91		?
156
NaPS-PB16
1.02b5
(complete)
done
397
UNSAT
150		OPT/SAT
86		?
161
ParLS-PBO-1.1
2024-07-09
(incomplete)
done
397
UNSAT
10		OPT/SAT
112		?
275
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
done
397
UNSAT
10		OPT/SAT
124		?
263
Picat
2024-06-18
(complete)
done
397
UNSAT
150		OPT/SAT
123		?
124
RoundingSat
log (1)
(complete)
done
397
OPT/SAT
98		?
110		ERR
189
RoundingSat
log (2)
(complete)
done
397
UNSATC
189		OPT/SAT
98		?
110
RoundingSat
log (3)
(complete)
done
397
UNSATC
189		OPT/SAT
99		?
109
RoundingSat
nolog (1)
(complete)
done
397
OPT/SAT
97		ERR
300
RoundingSat
nolog (2)
(complete)
done
397
UNSAT
184		OPT/SAT
98		?
115
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
397
UNSAT
139		OPT/SAT
60		?
198
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
397
UNSAT
149		OPT/SAT
68		?
180
Sat4j Resolution 2024
2024-07-07
(complete)
done
397
UNSATC
141		UNSAT
1		OPT/SAT
102		?
153
Sat4j Resolution Default
2024-07-07
(complete)
done
397
UNSAT
142		OPT/SAT
104		?
151
SCIP
2024-07-07
(complete)
done
397
UNSAT
161		OPT/SAT
80		?
156

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC)

Solver Name#benchsSolvedUNSATCUNSATOPTC/SATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
Exact
2024-07-05
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)
FiberSCIP
2024-07-02
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)
FiberSCIP
2024-07-30
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)		 1010
(100%)		 0
(0%)		 2
(20%)		 0
(0%)		 8
(80%)		 0
(0%)		 0
(0%)		 0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)		 1010
(100%)		 0
(0%)		 2
(20%)		 0
(0%)		 8
(80%)		 0
(0%)		 0
(0%)		 0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)		 1010
(100%)		 0
(0%)		 2
(20%)		 0
(0%)		 8
(80%)		 0
(0%)		 0
(0%)		 0
(0%)
Picat
2024-06-18
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)		 100
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 10
(100%)		 0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)		 103
(30%)		 0
(0%)		 2
(20%)		 0
(0%)		 1
(10%)		 0
(0%)		 7
(70%)		 0
(0%)
SCIP
2024-07-07
(complete)		 109
(90%)		 0
(0%)		 2
(20%)		 0
(0%)		 7
(70%)		 0
(0%)		 1
(10%)		 0
(0%)

Solver NameProgress
Exact
2024-07-05
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1
Exact_no_SoPlex
2024-07-05
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1
FiberSCIP
2024-07-02
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1
FiberSCIP
2024-07-30
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1
FiberSCIP
20 cores, 2024-07-30
(complete)
done
10
UNSAT
2		OPT/SAT
8
FiberSCIP
20 cores, 2024-08-09
(complete)
done
10
UNSAT
2		OPT/SAT
8
FiberSCIP
20 cores, 2024-08-12
(complete)
done
10
UNSAT
2		OPT/SAT
8
Picat
2024-06-18
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
10
?
10
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1
Sat4j Resolution Default
2024-07-07
(complete)
done
10
UNSAT
2		OPT/SAT
1		?
7
SCIP
2024-07-07
(complete)
done
10
UNSAT
2		OPT/SAT
7		?
1

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Solver Name#benchsSolvedUNSATCUNSATOPTC/SATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)		 478235
(49.16%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 223
(46.65%)		 191
(39.96%)		 52
(10.88%)		 0
(0%)
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)		 478235
(49.16%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 222
(46.44%)		 194
(40.59%)		 49
(10.25%)		 0
(0%)
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)		 478232
(48.54%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 220
(46.03%)		 192
(40.17%)		 54
(11.3%)		 0
(0%)
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)		 478231
(48.33%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 218
(45.61%)		 197
(41.21%)		 50
(10.46%)		 0
(0%)
DLS-PBO
2024-07-09
(incomplete)		 4788
(1.67%)		 0
(0%)		 8
(1.67%)		 0
(0%)		 0
(0%)		 412
(86.19%)		 45
(9.41%)		 13
(2.72%)
Exact
2024-07-05
(complete)		 478252
(52.72%)		 0
(0%)		 14
(2.93%)		 0
(0%)		 238
(49.79%)		 187
(39.12%)		 39
(8.16%)		 0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)		 478226
(47.28%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 213
(44.56%)		 232
(48.54%)		 20
(4.18%)		 0
(0%)
Exact_veripb2
2024-07-05
(complete)		 478239
(50%)		 13
(2.72%)		 1
(0.21%)		 169
(35.36%)		 56
(11.72%)		 193
(40.38%)		 46
(9.62%)		 0
(0%)
Exact_veripb2_no_SoPlex
2024-07-05
(complete)		 478195
(40.79%)		 12
(2.51%)		 1
(0.21%)		 144
(30.13%)		 38
(7.95%)		 244
(51.05%)		 39
(8.16%)		 0
(0%)
FiberSCIP
2024-07-02
(complete)		 478253
(52.93%)		 0
(0%)		 15
(3.14%)		 0
(0%)		 238
(49.79%)		 164
(34.31%)		 60
(12.55%)		 1
(0.21%)
FiberSCIP
2024-07-30
(complete)		 478245
(51.26%)		 0
(0%)		 15
(3.14%)		 0
(0%)		 230
(48.12%)		 173
(36.19%)		 60
(12.55%)		 0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)		 478263
(55.02%)		 0
(0%)		 17
(3.56%)		 0
(0%)		 246
(51.46%)		 0
(0%)		 215
(44.98%)		 0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)		 478259
(54.18%)		 0
(0%)		 16
(3.35%)		 0
(0%)		 243
(50.84%)		 0
(0%)		 219
(45.82%)		 0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)		 478245
(51.26%)		 0
(0%)		 15
(3.14%)		 0
(0%)		 230
(48.12%)		 157
(32.85%)		 76
(15.9%)		 0
(0%)
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)		 478259
(54.18%)		 0
(0%)		 14
(2.93%)		 0
(0%)		 245
(51.26%)		 197
(41.21%)		 22
(4.6%)		 0
(0%)
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)		 478254
(53.14%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 241
(50.42%)		 199
(41.63%)		 25
(5.23%)		 0
(0%)
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 447
(93.51%)		 31
(6.49%)		 0
(0%)
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 439
(91.84%)		 39
(8.16%)		 0
(0%)
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 449
(93.93%)		 29
(6.07%)		 0
(0%)
IPBHS-GUROBI
2024-07-09
(complete)		 478257
(53.77%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 244
(51.05%)		 0
(0%)		 221
(46.23%)		 0
(0%)
IPBHS-GUROBI-SYM
2024-07-09
(complete)		 478258
(53.97%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 245
(51.26%)		 0
(0%)		 219
(45.82%)		 1
(0.21%)
IPBHS-SCIP
2024-07-09
(complete)		 478245
(51.26%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 232
(48.54%)		 0
(0%)		 233
(48.74%)		 0
(0%)
LS-Mab
2024-07-10
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 432
(90.38%)		 46
(9.62%)		 0
(0%)
LS-MabP
2024-07-10
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 433
(90.59%)		 45
(9.41%)		 0
(0%)
LS-MabS
2024-07-10
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 431
(90.17%)		 47
(9.83%)		 0
(0%)
LS-MabSP
2024-07-10
(incomplete)		 4780
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 433
(90.59%)		 45
(9.41%)		 0
(0%)
mixed-bag
2024-07-02
(complete)		 478273
(57.11%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 260
(54.39%)		 87
(18.2%)		 111
(23.22%)		 7
(1.46%)
mixed-bag
2024-07-19
(complete)		 478279
(58.37%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 266
(55.65%)		 87
(18.2%)		 111
(23.22%)		 1
(0.21%)
NaPS
1.03
(complete)		 478208
(43.51%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 196
(41%)		 209
(43.72%)		 61
(12.76%)		 0
(0%)
NaPS-GM
1.03
(complete)		 478204
(42.68%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 191
(39.96%)		 214
(44.77%)		 60
(12.55%)		 0
(0%)
NaPS-PB16
1.02b5
(complete)		 478203
(42.47%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 190
(39.75%)		 224
(46.86%)		 51
(10.67%)		 0
(0%)
ParLS-PBO-1.1
2024-07-09
(incomplete)		 4788
(1.67%)		 0
(0%)		 8
(1.67%)		 0
(0%)		 0
(0%)		 430
(89.96%)		 40
(8.37%)		 0
(0%)
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)		 4788
(1.67%)		 0
(0%)		 8
(1.67%)		 0
(0%)		 0
(0%)		 439
(91.84%)		 31
(6.49%)		 0
(0%)
pb-oll-rs
2024-07-02
(complete)		 478207
(43.31%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 195
(40.79%)		 218
(45.61%)		 52
(10.88%)		 1
(0.21%)
pb-oll-rs
2024-07-19
(complete)		 478208
(43.51%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 196
(41%)		 217
(45.4%)		 53
(11.09%)		 0
(0%)
Picat
2024-06-18
(complete)		 478201
(42.05%)		 0
(0%)		 14
(2.93%)		 0
(0%)		 187
(39.12%)		 0
(0%)		 277
(57.95%)		 0
(0%)
RoundingSat
log (1)
(complete)		 478229
(47.91%)		 0
(0%)		 0
(0%)		 202
(42.26%)		 27
(5.65%)		 171
(35.77%)		 43
(9%)		 35
(7.32%)
RoundingSat
log (2)
(complete)		 478245
(51.26%)		 13
(2.72%)		 0
(0%)		 204
(42.68%)		 28
(5.86%)		 98
(20.5%)		 55
(11.51%)		 80
(16.74%)
RoundingSat
log (3)
(complete)		 478254
(53.14%)		 13
(2.72%)		 0
(0%)		 218
(45.61%)		 23
(4.81%)		 110
(23.01%)		 53
(11.09%)		 61
(12.76%)
RoundingSat
nolog (1)
(complete)		 478243
(50.84%)		 0
(0%)		 0
(0%)		 0
(0%)		 243
(50.84%)		 203
(42.47%)		 1
(0.21%)		 31
(6.49%)
RoundingSat
nolog (2)
(complete)		 478256
(53.56%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 243
(50.84%)		 168
(35.15%)		 54
(11.3%)		 0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)		 478133
(27.82%)		 0
(0%)		 10
(2.09%)		 0
(0%)		 123
(25.73%)		 258
(53.97%)		 83
(17.36%)		 4
(0.84%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)		 478146
(30.54%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 134
(28.03%)		 271
(56.69%)		 61
(12.76%)		 0
(0%)
Sat4j Resolution 2024
2024-07-07
(complete)		 478126
(26.36%)		 6
(1.26%)		 0
(0%)		 118
(24.69%)		 2
(0.42%)		 274
(57.32%)		 68
(14.23%)		 10
(2.09%)
Sat4j Resolution Default
2024-07-07
(complete)		 478128
(26.78%)		 0
(0%)		 11
(2.3%)		 0
(0%)		 117
(24.48%)		 262
(54.81%)		 73
(15.27%)		 15
(3.14%)
SCIP
2024-07-07
(complete)		 478263
(55.02%)		 0
(0%)		 15
(3.14%)		 0
(0%)		 248
(51.88%)		 155
(32.43%)		 60
(12.55%)		 0
(0%)

Solver NameProgress
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
done
478
UNSAT
12		OPT/SAT
223		SAT (TO/MO)
191		?
52
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
done
478
UNSAT
13		OPT/SAT
222		SAT (TO/MO)
194		?
49
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
done
478
UNSAT
12		OPT/SAT
220		SAT (TO/MO)
192		?
54
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
done
478
UNSAT
13		OPT/SAT
218		SAT (TO/MO)
197		?
50
DLS-PBO
2024-07-09
(incomplete)
done
478
UNSAT
8		SAT (TO/MO)
412		?
45		ERR
13
Exact
2024-07-05
(complete)
done
478
UNSAT
14		OPT/SAT
238		SAT (TO/MO)
187		?
39
Exact_no_SoPlex
2024-07-05
(complete)
done
478
UNSAT
13		OPT/SAT
213		SAT (TO/MO)
232		?
20
Exact_veripb2
2024-07-05
(complete)
done
478
UNSATC
13		UNSAT
1		OPTC
169		OPT/SAT
56		SAT (TO/MO)
193		?
46
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
done
478
UNSATC
12		UNSAT
1		OPTC
144		OPT/SAT
38		SAT (TO/MO)
244		?
39
FiberSCIP
2024-07-02
(complete)
done
478
UNSAT
15		OPT/SAT
238		SAT (TO/MO)
164		?
60		ERR
1
FiberSCIP
2024-07-30
(complete)
done
478
UNSAT
15		OPT/SAT
230		SAT (TO/MO)
173		?
60
FiberSCIP
20 cores, 2024-07-30
(complete)
done
478
UNSAT
17		OPT/SAT
246		?
215
FiberSCIP
20 cores, 2024-08-09
(complete)
done
478
UNSAT
16		OPT/SAT
243		?
219
FiberSCIP
20 cores, 2024-08-12
(complete)
done
478
UNSAT
15		OPT/SAT
230		SAT (TO/MO)
157		?
76
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
done
478
UNSAT
14		OPT/SAT
245		SAT (TO/MO)
197		?
22
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
done
478
UNSAT
13		OPT/SAT
241		SAT (TO/MO)
199		?
25
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
done
478
SAT (TO/MO)
447		?
31
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
done
478
SAT (TO/MO)
439		?
39
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
done
478
SAT (TO/MO)
449		?
29
IPBHS-GUROBI
2024-07-09
(complete)
done
478
UNSAT
13		OPT/SAT
244		?
221
IPBHS-GUROBI-SYM
2024-07-09
(complete)
done
478
UNSAT
13		OPT/SAT
245		?
219		ERR
1
IPBHS-SCIP
2024-07-09
(complete)
done
478
UNSAT
13		OPT/SAT
232		?
233
LS-Mab
2024-07-10
(incomplete)
done
478
SAT (TO/MO)
432		?
46
LS-MabP
2024-07-10
(incomplete)
done
478
SAT (TO/MO)
433		?
45
LS-MabS
2024-07-10
(incomplete)
done
478
SAT (TO/MO)
431		?
47
LS-MabSP
2024-07-10
(incomplete)
done
478
SAT (TO/MO)
433		?
45
mixed-bag
2024-07-02
(complete)
done
478
UNSAT
13		OPT/SAT
260		SAT (TO/MO)
87		?
111		ERR
7
mixed-bag
2024-07-19
(complete)
done
478
UNSAT
13		OPT/SAT
266		SAT (TO/MO)
87		?
111		ERR
1
NaPS
1.03
(complete)
done
478
UNSAT
12		OPT/SAT
196		SAT (TO/MO)
209		?
61
NaPS-GM
1.03
(complete)
done
478
UNSAT
13		OPT/SAT
191		SAT (TO/MO)
214		?
60
NaPS-PB16
1.02b5
(complete)
done
478
UNSAT
13		OPT/SAT
190		SAT (TO/MO)
224		?
51
ParLS-PBO-1.1
2024-07-09
(incomplete)
done
478
UNSAT
8		SAT (TO/MO)
430		?
40
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
done
478
UNSAT
8		SAT (TO/MO)
439		?
31
pb-oll-rs
2024-07-02
(complete)
done
478
UNSAT
12		OPT/SAT
195		SAT (TO/MO)
218		?
52		ERR
1
pb-oll-rs
2024-07-19
(complete)
done
478
UNSAT
12		OPT/SAT
196		SAT (TO/MO)
217		?
53
Picat
2024-06-18
(complete)
done
478
UNSAT
14		OPT/SAT
187		?
277
RoundingSat
log (1)
(complete)
done
478
OPTC
202		OPT/SAT
27		SAT (TO/MO)
171		?
43		ERR
35
RoundingSat
log (2)
(complete)
done
478
UNSATC
13		OPTC
204		OPT/SAT
28		SAT (TO/MO)
98		?
55		ERR
80
RoundingSat
log (3)
(complete)
done
478
UNSATC
13		OPTC
218		OPT/SAT
23		SAT (TO/MO)
110		?
53		ERR
61
RoundingSat
nolog (1)
(complete)
done
478
OPT/SAT
243		SAT (TO/MO)
203		?
1		ERR
31
RoundingSat
nolog (2)
(complete)
done
478
UNSAT
13		OPT/SAT
243		SAT (TO/MO)
168		?
54
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
478
UNSAT
10		OPT/SAT
123		SAT (TO/MO)
258		?
83		ERR
4
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
478
UNSAT
12		OPT/SAT
134		SAT (TO/MO)
271		?
61
Sat4j Resolution 2024
2024-07-07
(complete)
done
478
UNSATC
6		OPTC
118		OPT/SAT
2		SAT (TO/MO)
274		?
68		ERR
10
Sat4j Resolution Default
2024-07-07
(complete)
done
478
UNSAT
11		OPT/SAT
117		SAT (TO/MO)
262		?
73		ERR
15
SCIP
2024-07-07
(complete)
done
478
UNSAT
15		OPT/SAT
248		SAT (TO/MO)
155		?
60

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Solver Name#benchsSolvedUNSATCUNSATOPTC/SATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
Exact
2024-07-05
(complete)		 5430
(55.56%)		 0
(0%)		 0
(0%)		 0
(0%)		 30
(55.56%)		 21
(38.89%)		 3
(5.56%)		 0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)		 5427
(50%)		 0
(0%)		 0
(0%)		 0
(0%)		 27
(50%)		 27
(50%)		 0
(0%)		 0
(0%)
FiberSCIP
2024-07-02
(complete)		 5437
(68.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 37
(68.52%)		 17
(31.48%)		 0
(0%)		 0
(0%)
FiberSCIP
2024-07-30
(complete)		 5437
(68.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 37
(68.52%)		 17
(31.48%)		 0
(0%)		 0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)		 5436
(66.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 36
(66.67%)		 0
(0%)		 17
(31.48%)		 1
(1.85%)
FiberSCIP
20 cores, 2024-08-09
(complete)		 5436
(66.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 36
(66.67%)		 0
(0%)		 17
(31.48%)		 1
(1.85%)
FiberSCIP
20 cores, 2024-08-12
(complete)		 5436
(66.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 36
(66.67%)		 18
(33.33%)		 0
(0%)		 0
(0%)
Picat
2024-06-18
(complete)		 5425
(46.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 25
(46.3%)		 0
(0%)		 29
(53.7%)		 0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)		 5413
(24.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 13
(24.07%)		 37
(68.52%)		 4
(7.41%)		 0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)		 5420
(37.04%)		 0
(0%)		 0
(0%)		 0
(0%)		 20
(37.04%)		 34
(62.96%)		 0
(0%)		 0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)		 5419
(35.19%)		 0
(0%)		 0
(0%)		 0
(0%)		 19
(35.19%)		 32
(59.26%)		 3
(5.56%)		 0
(0%)
SCIP
2024-07-07
(complete)		 5437
(68.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 37
(68.52%)		 17
(31.48%)		 0
(0%)		 0
(0%)

Solver NameProgress
Exact
2024-07-05
(complete)
done
54
OPT/SAT
30		SAT (TO/MO)
21		?
3
Exact_no_SoPlex
2024-07-05
(complete)
done
54
OPT/SAT
27		SAT (TO/MO)
27
FiberSCIP
2024-07-02
(complete)
done
54
OPT/SAT
37		SAT (TO/MO)
17
FiberSCIP
2024-07-30
(complete)
done
54
OPT/SAT
37		SAT (TO/MO)
17
FiberSCIP
20 cores, 2024-07-30
(complete)
done
54
OPT/SAT
36		?
17		ERR
1
FiberSCIP
20 cores, 2024-08-09
(complete)
done
54
OPT/SAT
36		?
17		ERR
1
FiberSCIP
20 cores, 2024-08-12
(complete)
done
54
OPT/SAT
36		SAT (TO/MO)
18
Picat
2024-06-18
(complete)
done
54
OPT/SAT
25		?
29
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
54
OPT/SAT
13		SAT (TO/MO)
37		?
4
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
54
OPT/SAT
20		SAT (TO/MO)
34
Sat4j Resolution Default
2024-07-07
(complete)
done
54
OPT/SAT
19		SAT (TO/MO)
32		?
3
SCIP
2024-07-07
(complete)
done
54
OPT/SAT
37		SAT (TO/MO)
17

All categories for solvers registered in all categories

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATCUNSATOPTC/SATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)		 875508
(58.06%)		 0
(0%)		 161
(18.4%)		 0
(0%)		 347
(39.66%)		 191
(21.83%)		 176
(20.11%)		 0
(0%)
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)		 875503
(57.49%)		 0
(0%)		 162
(18.51%)		 0
(0%)		 341
(38.97%)		 194
(22.17%)		 178
(20.34%)		 0
(0%)
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)		 875499
(57.03%)		 0
(0%)		 166
(18.97%)		 0
(0%)		 333
(38.06%)		 192
(21.94%)		 184
(21.03%)		 0
(0%)
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)		 875498
(56.91%)		 0
(0%)		 167
(19.09%)		 0
(0%)		 331
(37.83%)		 197
(22.51%)		 180
(20.57%)		 0
(0%)
DLS-PBO
2024-07-09
(incomplete)		 875129
(14.74%)		 0
(0%)		 18
(2.06%)		 0
(0%)		 111
(12.69%)		 412
(47.09%)		 321
(36.69%)		 13
(1.49%)
Exact
2024-07-05
(complete)		 939577
(61.45%)		 0
(0%)		 200
(21.3%)		 0
(0%)		 377
(40.15%)		 208
(22.15%)		 154
(16.4%)		 0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)		 939537
(57.19%)		 0
(0%)		 186
(19.81%)		 0
(0%)		 351
(37.38%)		 259
(27.58%)		 143
(15.23%)		 0
(0%)
Exact_veripb2
2024-07-05
(complete)		 875530
(60.57%)		 188
(21.49%)		 9
(1.03%)		 169
(19.31%)		 164
(18.74%)		 193
(22.06%)		 152
(17.37%)		 0
(0%)
Exact_veripb2_no_SoPlex
2024-07-05
(complete)		 875479
(54.74%)		 177
(20.23%)		 8
(0.91%)		 144
(16.46%)		 150
(17.14%)		 244
(27.89%)		 152
(17.37%)		 0
(0%)
FiberSCIP
2024-07-02
(complete)		 939535
(56.98%)		 0
(0%)		 176
(18.74%)		 0
(0%)		 359
(38.23%)		 181
(19.28%)		 222
(23.64%)		 1
(0.11%)
FiberSCIP
2024-07-30
(complete)		 939526
(56.02%)		 0
(0%)		 176
(18.74%)		 0
(0%)		 350
(37.27%)		 190
(20.23%)		 223
(23.75%)		 0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)		 939577
(61.45%)		 0
(0%)		 186
(19.81%)		 0
(0%)		 391
(41.64%)		 0
(0%)		 361
(38.45%)		 1
(0.11%)
FiberSCIP
20 cores, 2024-08-09
(complete)		 939574
(61.13%)		 0
(0%)		 188
(20.02%)		 0
(0%)		 386
(41.11%)		 0
(0%)		 364
(38.76%)		 1
(0.11%)
FiberSCIP
20 cores, 2024-08-12
(complete)		 939561
(59.74%)		 0
(0%)		 186
(19.81%)		 0
(0%)		 375
(39.94%)		 175
(18.64%)		 203
(21.62%)		 0
(0%)
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)		 875571
(65.26%)		 0
(0%)		 200
(22.86%)		 0
(0%)		 371
(42.4%)		 197
(22.51%)		 107
(12.23%)		 0
(0%)
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)		 875563
(64.34%)		 0
(0%)		 199
(22.74%)		 0
(0%)		 364
(41.6%)		 199
(22.74%)		 113
(12.91%)		 0
(0%)
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)		 875117
(13.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 117
(13.37%)		 447
(51.09%)		 311
(35.54%)		 0
(0%)
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)		 875130
(14.86%)		 0
(0%)		 0
(0%)		 0
(0%)		 130
(14.86%)		 439
(50.17%)		 306
(34.97%)		 0
(0%)
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)		 875115
(13.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 115
(13.14%)		 449
(51.31%)		 311
(35.54%)		 0
(0%)
IPBHS-GUROBI
2024-07-09
(complete)		 478257
(53.77%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 244
(51.05%)		 0
(0%)		 221
(46.23%)		 0
(0%)
IPBHS-GUROBI-SYM
2024-07-09
(complete)		 478258
(53.97%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 245
(51.26%)		 0
(0%)		 219
(45.82%)		 1
(0.21%)
IPBHS-SCIP
2024-07-09
(complete)		 478245
(51.26%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 232
(48.54%)		 0
(0%)		 233
(48.74%)		 0
(0%)
LS-Mab
2024-07-10
(incomplete)		 875105
(12%)		 0
(0%)		 0
(0%)		 0
(0%)		 105
(12%)		 432
(49.37%)		 338
(38.63%)		 0
(0%)
LS-MabP
2024-07-10
(incomplete)		 875108
(12.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 108
(12.34%)		 433
(49.49%)		 334
(38.17%)		 0
(0%)
LS-MabS
2024-07-10
(incomplete)		 875110
(12.57%)		 0
(0%)		 0
(0%)		 0
(0%)		 110
(12.57%)		 431
(49.26%)		 334
(38.17%)		 0
(0%)
LS-MabSP
2024-07-10
(incomplete)		 875112
(12.8%)		 0
(0%)		 0
(0%)		 0
(0%)		 112
(12.8%)		 433
(49.49%)		 330
(37.71%)		 0
(0%)
mixed-bag
2024-07-02
(complete)		 478273
(57.11%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 260
(54.39%)		 87
(18.2%)		 111
(23.22%)		 7
(1.46%)
mixed-bag
2024-07-19
(complete)		 478279
(58.37%)		 0
(0%)		 13
(2.72%)		 0
(0%)		 266
(55.65%)		 87
(18.2%)		 111
(23.22%)		 1
(0.21%)
NaPS
1.03
(complete)		 875481
(54.97%)		 0
(0%)		 163
(18.63%)		 0
(0%)		 318
(36.34%)		 209
(23.89%)		 185
(21.14%)		 0
(0%)
NaPS-GM
1.03
(complete)		 875445
(50.86%)		 0
(0%)		 163
(18.63%)		 0
(0%)		 282
(32.23%)		 214
(24.46%)		 216
(24.69%)		 0
(0%)
NaPS-PB16
1.02b5
(complete)		 875439
(50.17%)		 0
(0%)		 163
(18.63%)		 0
(0%)		 276
(31.54%)		 224
(25.6%)		 212
(24.23%)		 0
(0%)
ParLS-PBO-1.1
2024-07-09
(incomplete)		 875130
(14.86%)		 0
(0%)		 18
(2.06%)		 0
(0%)		 112
(12.8%)		 430
(49.14%)		 315
(36%)		 0
(0%)
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)		 875142
(16.23%)		 0
(0%)		 18
(2.06%)		 0
(0%)		 124
(14.17%)		 439
(50.17%)		 294
(33.6%)		 0
(0%)
pb-oll-rs
2024-07-02
(complete)		 478207
(43.31%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 195
(40.79%)		 218
(45.61%)		 52
(10.88%)		 1
(0.21%)
pb-oll-rs
2024-07-19
(complete)		 478208
(43.51%)		 0
(0%)		 12
(2.51%)		 0
(0%)		 196
(41%)		 217
(45.4%)		 53
(11.09%)		 0
(0%)
Picat
2024-06-18
(complete)		 939508
(54.1%)		 0
(0%)		 166
(17.68%)		 0
(0%)		 342
(36.42%)		 0
(0%)		 431
(45.9%)		 0
(0%)
RoundingSat
log (1)
(complete)		 875327
(37.37%)		 0
(0%)		 0
(0%)		 202
(23.09%)		 125
(14.29%)		 171
(19.54%)		 153
(17.49%)		 224
(25.6%)
RoundingSat
log (2)
(complete)		 875532
(60.8%)		 202
(23.09%)		 0
(0%)		 204
(23.31%)		 126
(14.4%)		 98
(11.2%)		 165
(18.86%)		 80
(9.14%)
RoundingSat
log (3)
(complete)		 875542
(61.94%)		 202
(23.09%)		 0
(0%)		 218
(24.91%)		 122
(13.94%)		 110
(12.57%)		 162
(18.51%)		 61
(6.97%)
RoundingSat
nolog (1)
(complete)		 875340
(38.86%)		 0
(0%)		 0
(0%)		 0
(0%)		 340
(38.86%)		 203
(23.2%)		 1
(0.11%)		 331
(37.83%)
RoundingSat
nolog (2)
(complete)		 875538
(61.49%)		 0
(0%)		 197
(22.51%)		 0
(0%)		 341
(38.97%)		 168
(19.2%)		 169
(19.31%)		 0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)		 939345
(36.74%)		 0
(0%)		 149
(15.87%)		 0
(0%)		 196
(20.87%)		 295
(31.42%)		 295
(31.42%)		 4
(0.43%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)		 939392
(41.75%)		 0
(0%)		 163
(17.36%)		 0
(0%)		 229
(24.39%)		 305
(32.48%)		 242
(25.77%)		 0
(0%)
Sat4j Resolution 2024
2024-07-07
(complete)		 875370
(42.29%)		 147
(16.8%)		 1
(0.11%)		 118
(13.49%)		 104
(11.89%)		 274
(31.31%)		 221
(25.26%)		 10
(1.14%)
Sat4j Resolution Default
2024-07-07
(complete)		 939396
(42.17%)		 0
(0%)		 155
(16.51%)		 0
(0%)		 241
(25.67%)		 294
(31.31%)		 234
(24.92%)		 15
(1.6%)
SCIP
2024-07-07
(complete)		 939550
(58.57%)		 0
(0%)		 178
(18.96%)		 0
(0%)		 372
(39.62%)		 172
(18.32%)		 217
(23.11%)		 0
(0%)

Solver NameProgress
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
done
875
UNSAT
161		OPT/SAT
347		SAT (TO/MO)
191		?
176
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
done
875
UNSAT
162		OPT/SAT
341		SAT (TO/MO)
194		?
178
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
done
875
UNSAT
166		OPT/SAT
333		SAT (TO/MO)
192		?
184
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
done
875
UNSAT
167		OPT/SAT
331		SAT (TO/MO)
197		?
180
DLS-PBO
2024-07-09
(incomplete)
done
875
UNSAT
18		OPT/SAT
111		SAT (TO/MO)
412		?
321		ERR
13
Exact
2024-07-05
(complete)
done
939
UNSAT
200		OPT/SAT
377		SAT (TO/MO)
208		?
154
Exact_no_SoPlex
2024-07-05
(complete)
done
939
UNSAT
186		OPT/SAT
351		SAT (TO/MO)
259		?
143
Exact_veripb2
2024-07-05
(complete)
done
875
UNSATC
188		UNSAT
9		OPTC
169		OPT/SAT
164		SAT (TO/MO)
193		?
152
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
done
875
UNSATC
177		UNSAT
8		OPTC
144		OPT/SAT
150		SAT (TO/MO)
244		?
152
FiberSCIP
2024-07-02
(complete)
done
939
UNSAT
176		OPT/SAT
359		SAT (TO/MO)
181		?
222		ERR
1
FiberSCIP
2024-07-30
(complete)
done
939
UNSAT
176		OPT/SAT
350		SAT (TO/MO)
190		?
223
FiberSCIP
20 cores, 2024-07-30
(complete)
done
939
UNSAT
186		OPT/SAT
391		?
361		ERR
1
FiberSCIP
20 cores, 2024-08-09
(complete)
done
939
UNSAT
188		OPT/SAT
386		?
364		ERR
1
FiberSCIP
20 cores, 2024-08-12
(complete)
done
939
UNSAT
186		OPT/SAT
375		SAT (TO/MO)
175		?
203
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
done
875
UNSAT
200		OPT/SAT
371		SAT (TO/MO)
197		?
107
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
done
875
UNSAT
199		OPT/SAT
364		SAT (TO/MO)
199		?
113
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
done
875
OPT/SAT
117		SAT (TO/MO)
447		?
311
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
done
875
OPT/SAT
130		SAT (TO/MO)
439		?
306
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
done
875
OPT/SAT
115		SAT (TO/MO)
449		?
311
IPBHS-GUROBI
2024-07-09
(complete)
done
478
UNSAT
13		OPT/SAT
244		?
221
IPBHS-GUROBI-SYM
2024-07-09
(complete)
done
478
UNSAT
13		OPT/SAT
245		?
219		ERR
1
IPBHS-SCIP
2024-07-09
(complete)
done
478
UNSAT
13		OPT/SAT
232		?
233
LS-Mab
2024-07-10
(incomplete)
done
875
OPT/SAT
105		SAT (TO/MO)
432		?
338
LS-MabP
2024-07-10
(incomplete)
done
875
OPT/SAT
108		SAT (TO/MO)
433		?
334
LS-MabS
2024-07-10
(incomplete)
done
875
OPT/SAT
110		SAT (TO/MO)
431		?
334
LS-MabSP
2024-07-10
(incomplete)
done
875
OPT/SAT
112		SAT (TO/MO)
433		?
330
mixed-bag
2024-07-02
(complete)
done
478
UNSAT
13		OPT/SAT
260		SAT (TO/MO)
87		?
111		ERR
7
mixed-bag
2024-07-19
(complete)
done
478
UNSAT
13		OPT/SAT
266		SAT (TO/MO)
87		?
111		ERR
1
NaPS
1.03
(complete)
done
875
UNSAT
163		OPT/SAT
318		SAT (TO/MO)
209		?
185
NaPS-GM
1.03
(complete)
done
875
UNSAT
163		OPT/SAT
282		SAT (TO/MO)
214		?
216
NaPS-PB16
1.02b5
(complete)
done
875
UNSAT
163		OPT/SAT
276		SAT (TO/MO)
224		?
212
ParLS-PBO-1.1
2024-07-09
(incomplete)
done
875
UNSAT
18		OPT/SAT
112		SAT (TO/MO)
430		?
315
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
done
875
UNSAT
18		OPT/SAT
124		SAT (TO/MO)
439		?
294
pb-oll-rs
2024-07-02
(complete)
done
478
UNSAT
12		OPT/SAT
195		SAT (TO/MO)
218		?
52		ERR
1
pb-oll-rs
2024-07-19
(complete)
done
478
UNSAT
12		OPT/SAT
196		SAT (TO/MO)
217		?
53
Picat
2024-06-18
(complete)
done
939
UNSAT
166		OPT/SAT
342		?
431
RoundingSat
log (1)
(complete)
done
875
OPTC
202		OPT/SAT
125		SAT (TO/MO)
171		?
153		ERR
224
RoundingSat
log (2)
(complete)
done
875
UNSATC
202		OPTC
204		OPT/SAT
126		SAT (TO/MO)
98		?
165		ERR
80
RoundingSat
log (3)
(complete)
done
875
UNSATC
202		OPTC
218		OPT/SAT
122		SAT (TO/MO)
110		?
162		ERR
61
RoundingSat
nolog (1)
(complete)
done
875
OPT/SAT
340		SAT (TO/MO)
203		?
1		ERR
331
RoundingSat
nolog (2)
(complete)
done
875
UNSAT
197		OPT/SAT
341		SAT (TO/MO)
168		?
169
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
939
UNSAT
149		OPT/SAT
196		SAT (TO/MO)
295		?
295		ERR
4
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
939
UNSAT
163		OPT/SAT
229		SAT (TO/MO)
305		?
242
Sat4j Resolution 2024
2024-07-07
(complete)
done
875
UNSATC
147		UNSAT
1		OPTC
118		OPT/SAT
104		SAT (TO/MO)
274		?
221		ERR
10
Sat4j Resolution Default
2024-07-07
(complete)
done
939
UNSAT
155		OPT/SAT
241		SAT (TO/MO)
294		?
234		ERR
15
SCIP
2024-07-07
(complete)
done
939
UNSAT
178		OPT/SAT
372		SAT (TO/MO)
172		?
217