PB'24 competition: solvers page (tabular format, detailed results)

Some explanations

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN)

Solver Name#benchsSolvedUNSATCUNSAT.OPTCOPTSATSAT (subopt.)SAT (timeout)SAT (out of mem.)UNKNOWNUNKNOWN (no support)UNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG MSG.WRONG CERT.WRONG OPT.WRONG OPTCWRONG UNSAT.WRONG UNSATC
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
397273
(68.77%)
0
(0%)
149
(37.53%)
0
(0%)
0
(0%)
124
(31.23%)
0
(0%)
0
(0%)
0
(0%)
15
(3.78%)
0
(0%)
109
(27.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
397268
(67.51%)
0
(0%)
149
(37.53%)
0
(0%)
0
(0%)
119
(29.97%)
0
(0%)
0
(0%)
0
(0%)
14
(3.53%)
0
(0%)
114
(28.72%)
1
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
397267
(67.25%)
0
(0%)
154
(38.79%)
0
(0%)
0
(0%)
113
(28.46%)
0
(0%)
0
(0%)
0
(0%)
14
(3.53%)
0
(0%)
115
(28.97%)
1
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
397267
(67.25%)
0
(0%)
154
(38.79%)
0
(0%)
0
(0%)
113
(28.46%)
0
(0%)
0
(0%)
0
(0%)
12
(3.02%)
0
(0%)
115
(28.97%)
1
(0.25%)
0
(0%)
0
(0%)
2
(0.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
DLS-PBO
2024-07-09
(incomplete)
397121
(30.48%)
0
(0%)
10
(2.52%)
0
(0%)
0
(0%)
111
(27.96%)
0
(0%)
0
(0%)
0
(0%)
269
(67.76%)
0
(0%)
4
(1.01%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact
2024-07-05
(complete)
397286
(72.04%)
0
(0%)
184
(46.35%)
0
(0%)
0
(0%)
102
(25.69%)
0
(0%)
0
(0%)
0
(0%)
2
(0.5%)
0
(0%)
106
(26.7%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)
397275
(69.27%)
0
(0%)
171
(43.07%)
0
(0%)
0
(0%)
104
(26.2%)
0
(0%)
0
(0%)
0
(0%)
2
(0.5%)
0
(0%)
117
(29.47%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_veripb2
2024-07-05
(complete)
397291
(73.3%)
175
(44.08%)
8
(2.02%)
0
(0%)
0
(0%)
108
(27.2%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
106
(26.7%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
397284
(71.54%)
165
(41.56%)
7
(1.76%)
0
(0%)
0
(0%)
112
(28.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
113
(28.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-02
(complete)
397236
(59.45%)
0
(0%)
159
(40.05%)
0
(0%)
0
(0%)
77
(19.4%)
0
(0%)
0
(0%)
0
(0%)
151
(38.04%)
0
(0%)
9
(2.27%)
0
(0%)
0
(0%)
0
(0%)
1
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-30
(complete)
397235
(59.19%)
0
(0%)
159
(40.05%)
0
(0%)
0
(0%)
76
(19.14%)
0
(0%)
0
(0%)
0
(0%)
152
(38.29%)
0
(0%)
9
(2.27%)
0
(0%)
0
(0%)
0
(0%)
1
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)
397268
(67.51%)
0
(0%)
167
(42.07%)
0
(0%)
0
(0%)
101
(25.44%)
0
(0%)
0
(0%)
0
(0%)
6
(1.51%)
0
(0%)
120
(30.23%)
2
(0.5%)
0
(0%)
0
(0%)
1
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)
397269
(67.76%)
0
(0%)
170
(42.82%)
0
(0%)
0
(0%)
99
(24.94%)
0
(0%)
0
(0%)
0
(0%)
6
(1.51%)
0
(0%)
119
(29.97%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)
397270
(68.01%)
0
(0%)
169
(42.57%)
0
(0%)
0
(0%)
101
(25.44%)
0
(0%)
0
(0%)
0
(0%)
92
(23.17%)
0
(0%)
21
(5.29%)
3
(0.76%)
0
(0%)
0
(0%)
11
(2.77%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
397312
(78.59%)
0
(0%)
186
(46.85%)
0
(0%)
0
(0%)
126
(31.74%)
0
(0%)
0
(0%)
0
(0%)
79
(19.9%)
0
(0%)
0
(0%)
3
(0.76%)
0
(0%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
397309
(77.83%)
0
(0%)
186
(46.85%)
0
(0%)
0
(0%)
123
(30.98%)
0
(0%)
0
(0%)
0
(0%)
84
(21.16%)
0
(0%)
0
(0%)
4
(1.01%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
397117
(29.47%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
117
(29.47%)
0
(0%)
0
(0%)
0
(0%)
277
(69.77%)
0
(0%)
0
(0%)
1
(0.25%)
0
(0%)
2
(0.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
397130
(32.75%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
130
(32.75%)
0
(0%)
0
(0%)
0
(0%)
267
(67.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
397115
(28.97%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
115
(28.97%)
0
(0%)
0
(0%)
0
(0%)
280
(70.53%)
0
(0%)
0
(0%)
2
(0.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-Mab
2024-07-10
(incomplete)
397105
(26.45%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
105
(26.45%)
0
(0%)
0
(0%)
0
(0%)
279
(70.28%)
0
(0%)
10
(2.52%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabP
2024-07-10
(incomplete)
397108
(27.2%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
108
(27.2%)
0
(0%)
0
(0%)
0
(0%)
275
(69.27%)
0
(0%)
11
(2.77%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabS
2024-07-10
(incomplete)
397110
(27.71%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
110
(27.71%)
0
(0%)
0
(0%)
0
(0%)
276
(69.52%)
0
(0%)
8
(2.02%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabSP
2024-07-10
(incomplete)
397112
(28.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
112
(28.21%)
0
(0%)
0
(0%)
0
(0%)
270
(68.01%)
0
(0%)
12
(3.02%)
3
(0.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS
1.03
(complete)
397273
(68.77%)
0
(0%)
151
(38.04%)
0
(0%)
0
(0%)
122
(30.73%)
0
(0%)
0
(0%)
0
(0%)
11
(2.77%)
0
(0%)
108
(27.2%)
0
(0%)
5
(1.26%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS-GM
1.03
(complete)
397241
(60.71%)
0
(0%)
150
(37.78%)
0
(0%)
0
(0%)
91
(22.92%)
0
(0%)
0
(0%)
0
(0%)
11
(2.77%)
0
(0%)
140
(35.26%)
1
(0.25%)
4
(1.01%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS-PB16
1.02b5
(complete)
397236
(59.45%)
0
(0%)
150
(37.78%)
0
(0%)
0
(0%)
86
(21.66%)
0
(0%)
0
(0%)
0
(0%)
1
(0.25%)
0
(0%)
158
(39.8%)
2
(0.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ParLS-PBO-1.1
2024-07-09
(incomplete)
397122
(30.73%)
0
(0%)
10
(2.52%)
0
(0%)
0
(0%)
112
(28.21%)
0
(0%)
0
(0%)
0
(0%)
7
(1.76%)
0
(0%)
268
(67.51%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
397134
(33.75%)
0
(0%)
10
(2.52%)
0
(0%)
0
(0%)
124
(31.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
263
(66.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Picat
2024-06-18
(complete)
397273
(68.77%)
0
(0%)
150
(37.78%)
0
(0%)
0
(0%)
123
(30.98%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
121
(30.48%)
0
(0%)
0
(0%)
1
(0.25%)
2
(0.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
log (1)
(complete)
39798
(24.69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
98
(24.69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
110
(27.71%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
189
(47.61%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
log (2)
(complete)
397287
(72.29%)
189
(47.61%)
0
(0%)
0
(0%)
0
(0%)
98
(24.69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
110
(27.71%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
log (3)
(complete)
397288
(72.54%)
189
(47.61%)
0
(0%)
0
(0%)
0
(0%)
99
(24.94%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
109
(27.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
nolog (1)
(complete)
39797
(24.43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
97
(24.43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
184
(46.35%)
116
(29.22%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
nolog (2)
(complete)
397282
(71.03%)
0
(0%)
184
(46.35%)
0
(0%)
0
(0%)
98
(24.69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
115
(28.97%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)
397199
(50.13%)
0
(0%)
139
(35.01%)
0
(0%)
0
(0%)
60
(15.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
198
(49.87%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
397217
(54.66%)
0
(0%)
149
(37.53%)
0
(0%)
0
(0%)
68
(17.13%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
180
(45.34%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution 2024
2024-07-07
(complete)
397244
(61.46%)
141
(35.52%)
1
(0.25%)
0
(0%)
0
(0%)
102
(25.69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
153
(38.54%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)
397246
(61.96%)
0
(0%)
142
(35.77%)
0
(0%)
0
(0%)
104
(26.2%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
150
(37.78%)
0
(0%)
1
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SCIP
2024-07-07
(complete)
397241
(60.71%)
0
(0%)
161
(40.55%)
0
(0%)
0
(0%)
80
(20.15%)
0
(0%)
0
(0%)
0
(0%)
131
(33%)
0
(0%)
25
(6.3%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
done
397
UNSAT.
149
SAT
124
?
15
? (TO)
109
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
done
397
UNSAT.
149
SAT
119
?
14
? (TO)
114
? (MO)
1
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
done
397
UNSAT.
154
SAT
113
?
14
? (TO)
115
? (MO)
1
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
done
397
UNSAT.
154
SAT
113
?
12
? (TO)
115
? (MO)
1
? (SIG)
2
DLS-PBO
2024-07-09
(incomplete)
done
397
UNSAT.
10
SAT
111
?
269
? (TO)
4
? (MO)
3
Exact
2024-07-05
(complete)
done
397
UNSAT.
184
SAT
102
?
2
? (TO)
106
? (MO)
3
Exact_no_SoPlex
2024-07-05
(complete)
done
397
UNSAT.
171
SAT
104
?
2
? (TO)
117
? (MO)
3
Exact_veripb2
2024-07-05
(complete)
done
397
UNSATC
175
UNSAT.
8
SAT
108
? (TO)
106
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
done
397
UNSATC
165
UNSAT.
7
SAT
112
? (TO)
113
FiberSCIP
2024-07-02
(complete)
done
397
UNSAT.
159
SAT
77
?
151
? (TO)
9
? (SIG)
1
FiberSCIP
2024-07-30
(complete)
done
397
UNSAT.
159
SAT
76
?
152
? (TO)
9
? (SIG)
1
FiberSCIP
20 cores, 2024-07-30
(complete)
done
397
UNSAT.
167
SAT
101
?
6
? (TO)
120
? (MO)
2
? (SIG)
1
FiberSCIP
20 cores, 2024-08-09
(complete)
done
397
UNSAT.
170
SAT
99
?
6
? (TO)
119
? (MO)
3
FiberSCIP
20 cores, 2024-08-12
(complete)
done
397
UNSAT.
169
SAT
101
?
92
? (TO)
21
? (MO)
3
? (SIG)
11
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
done
397
UNSAT.
186
SAT
126
?
79
? (MO)
3
? (?)
3
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
done
397
UNSAT.
186
SAT
123
?
84
? (MO)
4
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
done
397
SAT
117
?
277
? (MO)
1
? (?)
2
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
done
397
SAT
130
?
267
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
done
397
SAT
115
?
280
? (MO)
2
LS-Mab
2024-07-10
(incomplete)
done
397
SAT
105
?
279
? (TO)
10
? (MO)
3
LS-MabP
2024-07-10
(incomplete)
done
397
SAT
108
?
275
? (TO)
11
? (MO)
3
LS-MabS
2024-07-10
(incomplete)
done
397
SAT
110
?
276
? (TO)
8
? (MO)
3
LS-MabSP
2024-07-10
(incomplete)
done
397
SAT
112
?
270
? (TO)
12
? (MO)
3
NaPS
1.03
(complete)
done
397
UNSAT.
151
SAT
122
?
11
? (TO)
108
? (EC)
5
NaPS-GM
1.03
(complete)
done
397
UNSAT.
150
SAT
91
?
11
? (TO)
140
? (MO)
1
? (EC)
4
NaPS-PB16
1.02b5
(complete)
done
397
UNSAT.
150
SAT
86
?
1
? (TO)
158
? (MO)
2
ParLS-PBO-1.1
2024-07-09
(incomplete)
done
397
UNSAT.
10
SAT
112
?
7
? (TO)
268
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
done
397
UNSAT.
10
SAT
124
? (TO)
263
Picat
2024-06-18
(complete)
done
397
UNSAT.
150
SAT
123
? (TO)
121
? (?)
1
? (SIG)
2
RoundingSat
log (1)
(complete)
done
397
SAT
98
? (TO)
110
NO CERT.
189
RoundingSat
log (2)
(complete)
done
397
UNSATC
189
SAT
98
? (TO)
110
RoundingSat
log (3)
(complete)
done
397
UNSATC
189
SAT
99
? (TO)
109
RoundingSat
nolog (1)
(complete)
done
397
SAT
97
ERR MSG
184
ERR CERT
116
RoundingSat
nolog (2)
(complete)
done
397
UNSAT.
184
SAT
98
? (TO)
115
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
397
UNSAT.
139
SAT
60
? (TO)
198
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
397
UNSAT.
149
SAT
68
? (TO)
180
Sat4j Resolution 2024
2024-07-07
(complete)
done
397
UNSATC
141
UNSAT.
1
SAT
102
? (TO)
153
Sat4j Resolution Default
2024-07-07
(complete)
done
397
UNSAT.
142
SAT
104
? (TO)
150
? (EC)
1
SCIP
2024-07-07
(complete)
done
397
UNSAT.
161
SAT
80
?
131
? (TO)
25

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC)

Solver Name#benchsSolvedUNSATCUNSAT.OPTCOPTSATSAT (subopt.)SAT (timeout)SAT (out of mem.)UNKNOWNUNKNOWN (no support)UNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG MSG.WRONG CERT.WRONG OPT.WRONG OPTCWRONG UNSAT.WRONG UNSATC
Exact
2024-07-05
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-02
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-30
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)
1010
(100%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
8
(80%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)
1010
(100%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
8
(80%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)
1010
(100%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
8
(80%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Picat
2024-06-18
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)
100
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
10
(100%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)
103
(30%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SCIP
2024-07-07
(complete)
109
(90%)
0
(0%)
2
(20%)
0
(0%)
0
(0%)
7
(70%)
0
(0%)
0
(0%)
0
(0%)
1
(10%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
Exact
2024-07-05
(complete)
done
10
UNSAT.
2
SAT
7
? (TO)
1
Exact_no_SoPlex
2024-07-05
(complete)
done
10
UNSAT.
2
SAT
7
? (TO)
1
FiberSCIP
2024-07-02
(complete)
done
10
UNSAT.
2
SAT
7
?
1
FiberSCIP
2024-07-30
(complete)
done
10
UNSAT.
2
SAT
7
?
1
FiberSCIP
20 cores, 2024-07-30
(complete)
done
10
UNSAT.
2
SAT
8
FiberSCIP
20 cores, 2024-08-09
(complete)
done
10
UNSAT.
2
SAT
8
FiberSCIP
20 cores, 2024-08-12
(complete)
done
10
UNSAT.
2
SAT
8
Picat
2024-06-18
(complete)
done
10
UNSAT.
2
SAT
7
? (TO)
1
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
10
?
10
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
10
UNSAT.
2
SAT
7
? (TO)
1
Sat4j Resolution Default
2024-07-07
(complete)
done
10
UNSAT.
2
SAT
1
? (TO)
7
SCIP
2024-07-07
(complete)
done
10
UNSAT.
2
SAT
7
?
1

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Solver Name#benchsSolvedUNSATCUNSAT.OPTCOPTSATSAT (subopt.)SAT (timeout)SAT (out of mem.)UNKNOWNUNKNOWN (no support)UNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG MSG.WRONG CERT.WRONG OPT.WRONG OPTCWRONG UNSAT.WRONG UNSATC
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
478235
(49.16%)
0
(0%)
12
(2.51%)
0
(0%)
223
(46.65%)
0
(0%)
0
(0%)
190
(39.75%)
1
(0.21%)
3
(0.63%)
0
(0%)
47
(9.83%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
478235
(49.16%)
0
(0%)
13
(2.72%)
0
(0%)
222
(46.44%)
0
(0%)
0
(0%)
192
(40.17%)
2
(0.42%)
2
(0.42%)
0
(0%)
44
(9.21%)
3
(0.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
478232
(48.54%)
0
(0%)
12
(2.51%)
0
(0%)
220
(46.03%)
0
(0%)
0
(0%)
191
(39.96%)
1
(0.21%)
3
(0.63%)
0
(0%)
48
(10.04%)
3
(0.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
478231
(48.33%)
0
(0%)
13
(2.72%)
0
(0%)
218
(45.61%)
0
(0%)
0
(0%)
195
(40.79%)
2
(0.42%)
1
(0.21%)
0
(0%)
44
(9.21%)
2
(0.42%)
0
(0%)
0
(0%)
3
(0.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
DLS-PBO
2024-07-09
(incomplete)
4788
(1.67%)
0
(0%)
8
(1.67%)
0
(0%)
0
(0%)
0
(0%)
399
(83.47%)
13
(2.72%)
0
(0%)
33
(6.9%)
0
(0%)
1
(0.21%)
11
(2.3%)
0
(0%)
0
(0%)
0
(0%)
11
(2.3%)
0
(0%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact
2024-07-05
(complete)
478252
(52.72%)
0
(0%)
14
(2.93%)
0
(0%)
238
(49.79%)
0
(0%)
4
(0.84%)
183
(38.28%)
0
(0%)
1
(0.21%)
0
(0%)
38
(7.95%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)
478226
(47.28%)
0
(0%)
13
(2.72%)
0
(0%)
213
(44.56%)
0
(0%)
6
(1.26%)
226
(47.28%)
0
(0%)
1
(0.21%)
0
(0%)
19
(3.97%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_veripb2
2024-07-05
(complete)
478239
(50%)
13
(2.72%)
1
(0.21%)
169
(35.36%)
56
(11.72%)
0
(0%)
6
(1.26%)
187
(39.12%)
0
(0%)
0
(0%)
0
(0%)
46
(9.62%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
478195
(40.79%)
12
(2.51%)
1
(0.21%)
144
(30.13%)
38
(7.95%)
0
(0%)
5
(1.05%)
239
(50%)
0
(0%)
0
(0%)
0
(0%)
39
(8.16%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-02
(complete)
478253
(52.93%)
0
(0%)
15
(3.14%)
0
(0%)
238
(49.79%)
0
(0%)
164
(34.31%)
0
(0%)
0
(0%)
43
(9%)
0
(0%)
9
(1.88%)
7
(1.46%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-30
(complete)
478245
(51.26%)
0
(0%)
15
(3.14%)
0
(0%)
230
(48.12%)
0
(0%)
173
(36.19%)
0
(0%)
0
(0%)
43
(9%)
0
(0%)
9
(1.88%)
7
(1.46%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)
478263
(55.02%)
0
(0%)
17
(3.56%)
0
(0%)
246
(51.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
203
(42.47%)
7
(1.46%)
0
(0%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)
478259
(54.18%)
0
(0%)
16
(3.35%)
0
(0%)
243
(50.84%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
207
(43.31%)
8
(1.67%)
0
(0%)
0
(0%)
4
(0.84%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)
478245
(51.26%)
0
(0%)
15
(3.14%)
0
(0%)
230
(48.12%)
0
(0%)
157
(32.85%)
0
(0%)
0
(0%)
16
(3.35%)
0
(0%)
38
(7.95%)
9
(1.88%)
0
(0%)
0
(0%)
13
(2.72%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
478259
(54.18%)
0
(0%)
14
(2.93%)
0
(0%)
245
(51.26%)
0
(0%)
197
(41.21%)
0
(0%)
0
(0%)
14
(2.93%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
3
(0.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
478254
(53.14%)
0
(0%)
13
(2.72%)
0
(0%)
241
(50.42%)
0
(0%)
199
(41.63%)
0
(0%)
0
(0%)
21
(4.39%)
0
(0%)
4
(0.84%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
447
(93.51%)
0
(0%)
0
(0%)
24
(5.02%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
439
(91.84%)
0
(0%)
0
(0%)
38
(7.95%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
449
(93.93%)
0
(0%)
0
(0%)
28
(5.86%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
IPBHS-GUROBI
2024-07-09
(complete)
478257
(53.77%)
0
(0%)
13
(2.72%)
0
(0%)
244
(51.05%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
221
(46.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
IPBHS-GUROBI-SYM
2024-07-09
(complete)
478258
(53.97%)
0
(0%)
13
(2.72%)
0
(0%)
245
(51.26%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
219
(45.82%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
IPBHS-SCIP
2024-07-09
(complete)
478245
(51.26%)
0
(0%)
13
(2.72%)
0
(0%)
232
(48.54%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
230
(48.12%)
0
(0%)
0
(0%)
0
(0%)
3
(0.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-Mab
2024-07-10
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
398
(83.26%)
34
(7.11%)
0
(0%)
34
(7.11%)
0
(0%)
1
(0.21%)
11
(2.3%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabP
2024-07-10
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
433
(90.59%)
0
(0%)
0
(0%)
34
(7.11%)
0
(0%)
1
(0.21%)
10
(2.09%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabS
2024-07-10
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
431
(90.17%)
0
(0%)
0
(0%)
34
(7.11%)
0
(0%)
2
(0.42%)
11
(2.3%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabSP
2024-07-10
(incomplete)
4780
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
433
(90.59%)
0
(0%)
0
(0%)
33
(6.9%)
0
(0%)
2
(0.42%)
10
(2.09%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
mixed-bag
2024-07-02
(complete)
478273
(57.11%)
0
(0%)
13
(2.72%)
0
(0%)
260
(54.39%)
0
(0%)
0
(0%)
87
(18.2%)
0
(0%)
0
(0%)
0
(0%)
107
(22.38%)
2
(0.42%)
0
(0%)
0
(0%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(1.46%)
0
(0%)
mixed-bag
2024-07-19
(complete)
478279
(58.37%)
0
(0%)
13
(2.72%)
0
(0%)
266
(55.65%)
0
(0%)
0
(0%)
87
(18.2%)
0
(0%)
0
(0%)
0
(0%)
107
(22.38%)
2
(0.42%)
0
(0%)
0
(0%)
2
(0.42%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS
1.03
(complete)
478208
(43.51%)
0
(0%)
12
(2.51%)
0
(0%)
196
(41%)
0
(0%)
1
(0.21%)
205
(42.89%)
3
(0.63%)
1
(0.21%)
0
(0%)
30
(6.28%)
5
(1.05%)
25
(5.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS-GM
1.03
(complete)
478204
(42.68%)
0
(0%)
13
(2.72%)
0
(0%)
191
(39.96%)
0
(0%)
2
(0.42%)
207
(43.31%)
5
(1.05%)
0
(0%)
0
(0%)
35
(7.32%)
6
(1.26%)
19
(3.97%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS-PB16
1.02b5
(complete)
478203
(42.47%)
0
(0%)
13
(2.72%)
0
(0%)
190
(39.75%)
0
(0%)
17
(3.56%)
199
(41.63%)
8
(1.67%)
2
(0.42%)
0
(0%)
40
(8.37%)
8
(1.67%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ParLS-PBO-1.1
2024-07-09
(incomplete)
4788
(1.67%)
0
(0%)
8
(1.67%)
0
(0%)
0
(0%)
0
(0%)
43
(9%)
387
(80.96%)
0
(0%)
2
(0.42%)
0
(0%)
37
(7.74%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
4788
(1.67%)
0
(0%)
8
(1.67%)
0
(0%)
0
(0%)
0
(0%)
3
(0.63%)
436
(91.21%)
0
(0%)
0
(0%)
0
(0%)
31
(6.49%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
pb-oll-rs
2024-07-02
(complete)
478207
(43.31%)
0
(0%)
12
(2.51%)
0
(0%)
195
(40.79%)
0
(0%)
0
(0%)
218
(45.61%)
0
(0%)
0
(0%)
0
(0%)
46
(9.62%)
1
(0.21%)
0
(0%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
pb-oll-rs
2024-07-19
(complete)
478208
(43.51%)
0
(0%)
12
(2.51%)
0
(0%)
196
(41%)
0
(0%)
0
(0%)
217
(45.4%)
0
(0%)
0
(0%)
0
(0%)
47
(9.83%)
1
(0.21%)
0
(0%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Picat
2024-06-18
(complete)
478201
(42.05%)
0
(0%)
14
(2.93%)
0
(0%)
187
(39.12%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
275
(57.53%)
0
(0%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
log (1)
(complete)
478229
(47.91%)
0
(0%)
0
(0%)
202
(42.26%)
27
(5.65%)
0
(0%)
4
(0.84%)
166
(34.73%)
1
(0.21%)
0
(0%)
0
(0%)
41
(8.58%)
1
(0.21%)
0
(0%)
0
(0%)
1
(0.21%)
21
(4.39%)
0
(0%)
0
(0%)
0
(0%)
14
(2.93%)
0
(0%)
0
(0%)
RoundingSat
log (2)
(complete)
478245
(51.26%)
13
(2.72%)
0
(0%)
204
(42.68%)
28
(5.86%)
0
(0%)
5
(1.05%)
91
(19.04%)
2
(0.42%)
0
(0%)
0
(0%)
53
(11.09%)
1
(0.21%)
0
(0%)
0
(0%)
1
(0.21%)
69
(14.44%)
0
(0%)
0
(0%)
0
(0%)
11
(2.3%)
0
(0%)
0
(0%)
RoundingSat
log (3)
(complete)
478254
(53.14%)
13
(2.72%)
0
(0%)
218
(45.61%)
23
(4.81%)
0
(0%)
5
(1.05%)
104
(21.76%)
1
(0.21%)
0
(0%)
0
(0%)
51
(10.67%)
1
(0.21%)
0
(0%)
0
(0%)
1
(0.21%)
60
(12.55%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
RoundingSat
nolog (1)
(complete)
478243
(50.84%)
0
(0%)
0
(0%)
0
(0%)
243
(50.84%)
0
(0%)
4
(0.84%)
198
(41.42%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
31
(6.49%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
nolog (2)
(complete)
478256
(53.56%)
0
(0%)
13
(2.72%)
0
(0%)
243
(50.84%)
0
(0%)
4
(0.84%)
163
(34.1%)
1
(0.21%)
0
(0%)
0
(0%)
53
(11.09%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)
478133
(27.82%)
0
(0%)
10
(2.09%)
0
(0%)
123
(25.73%)
0
(0%)
0
(0%)
258
(53.97%)
0
(0%)
0
(0%)
0
(0%)
83
(17.36%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.42%)
0
(0%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
478146
(30.54%)
0
(0%)
12
(2.51%)
0
(0%)
134
(28.03%)
0
(0%)
0
(0%)
271
(56.69%)
0
(0%)
0
(0%)
0
(0%)
61
(12.76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution 2024
2024-07-07
(complete)
478126
(26.36%)
6
(1.26%)
0
(0%)
118
(24.69%)
2
(0.42%)
0
(0%)
3
(0.63%)
271
(56.69%)
0
(0%)
6
(1.26%)
0
(0%)
62
(12.97%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
10
(2.09%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)
478128
(26.78%)
0
(0%)
11
(2.3%)
0
(0%)
117
(24.48%)
0
(0%)
2
(0.42%)
260
(54.39%)
0
(0%)
0
(0%)
0
(0%)
58
(12.13%)
0
(0%)
15
(3.14%)
0
(0%)
0
(0%)
14
(2.93%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SCIP
2024-07-07
(complete)
478263
(55.02%)
0
(0%)
15
(3.14%)
0
(0%)
248
(51.88%)
0
(0%)
153
(32.01%)
2
(0.42%)
0
(0%)
40
(8.37%)
0
(0%)
14
(2.93%)
2
(0.42%)
0
(0%)
0
(0%)
4
(0.84%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
done
478
UNSAT.
12
OPT
223
SAT (TO)
190
SAT (MO)
1
?
3
? (TO)
47
? (MO)
2
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
done
478
UNSAT.
13
OPT
222
SAT (TO)
192
SAT (MO)
2
?
2
? (TO)
44
? (MO)
3
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
done
478
UNSAT.
12
OPT
220
SAT (TO)
191
SAT (MO)
1
?
3
? (TO)
48
? (MO)
3
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
done
478
UNSAT.
13
OPT
218
SAT (TO)
195
SAT (MO)
2
?
1
? (TO)
44
? (MO)
2
? (SIG)
3
DLS-PBO
2024-07-09
(incomplete)
done
478
UNSAT.
8
SAT (subopt.)
399
SAT (TO)
13
?
33
? (TO)
1
? (MO)
11
NO CERT.
11
ERR CERT
2
Exact
2024-07-05
(complete)
done
478
UNSAT.
14
OPT
238
SAT (subopt.)
4
SAT (TO)
183
?
1
? (TO)
38
Exact_no_SoPlex
2024-07-05
(complete)
done
478
UNSAT.
13
OPT
213
SAT (subopt.)
6
SAT (TO)
226
?
1
? (TO)
19
Exact_veripb2
2024-07-05
(complete)
done
478
UNSATC
13
UNSAT.
1
OPTC
169
OPT
56
SAT (subopt.)
6
SAT (TO)
187
? (TO)
46
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
done
478
UNSATC
12
UNSAT.
1
OPTC
144
OPT
38
SAT (subopt.)
5
SAT (TO)
239
? (TO)
39
FiberSCIP
2024-07-02
(complete)
done
478
UNSAT.
15
OPT
238
SAT (subopt.)
164
?
43
? (TO)
9
? (MO)
7
? (SIG)
1
ERR OPT
1
FiberSCIP
2024-07-30
(complete)
done
478
UNSAT.
15
OPT
230
SAT (subopt.)
173
?
43
? (TO)
9
? (MO)
7
? (SIG)
1
FiberSCIP
20 cores, 2024-07-30
(complete)
done
478
UNSAT.
17
OPT
246
? (TO)
203
? (MO)
7
? (SIG)
5
FiberSCIP
20 cores, 2024-08-09
(complete)
done
478
UNSAT.
16
OPT
243
? (TO)
207
? (MO)
8
? (SIG)
4
FiberSCIP
20 cores, 2024-08-12
(complete)
done
478
UNSAT.
15
OPT
230
SAT (subopt.)
157
?
16
? (TO)
38
? (MO)
9
? (SIG)
13
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
done
478
UNSAT.
14
OPT
245
SAT (subopt.)
197
?
14
? (TO)
5
? (?)
3
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
done
478
UNSAT.
13
OPT
241
SAT (subopt.)
199
?
21
? (TO)
4
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
done
478
SAT (subopt.)
447
?
24
? (TO)
5
? (?)
2
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
done
478
SAT (subopt.)
439
?
38
? (?)
1
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
done
478
SAT (subopt.)
449
?
28
? (TO)
1
IPBHS-GUROBI
2024-07-09
(complete)
done
478
UNSAT.
13
OPT
244
? (TO)
221
IPBHS-GUROBI-SYM
2024-07-09
(complete)
done
478
UNSAT.
13
OPT
245
? (TO)
219
ERR OPT
1
IPBHS-SCIP
2024-07-09
(complete)
done
478
UNSAT.
13
OPT
232
? (TO)
230
? (SIG)
3
LS-Mab
2024-07-10
(incomplete)
done
478
SAT (subopt.)
398
SAT (TO)
34
?
34
? (TO)
1
? (MO)
11
LS-MabP
2024-07-10
(incomplete)
done
478
SAT (subopt.)
433
?
34
? (TO)
1
? (MO)
10
LS-MabS
2024-07-10
(incomplete)
done
478
SAT (subopt.)
431
?
34
? (TO)
2
? (MO)
11
LS-MabSP
2024-07-10
(incomplete)
done
478
SAT (subopt.)
433
?
33
? (TO)
2
? (MO)
10
mixed-bag
2024-07-02
(complete)
done
478
UNSAT.
13
OPT
260
SAT (TO)
87
? (TO)
107
? (MO)
2
? (SIG)
2
ERR UNSAT
7
mixed-bag
2024-07-19
(complete)
done
478
UNSAT.
13
OPT
266
SAT (TO)
87
? (TO)
107
? (MO)
2
? (SIG)
2
NO CERT.
1
NaPS
1.03
(complete)
done
478
UNSAT.
12
OPT
196
SAT (subopt.)
1
SAT (TO)
205
SAT (MO)
3
?
1
? (TO)
30
? (MO)
5
? (EC)
25
NaPS-GM
1.03
(complete)
done
478
UNSAT.
13
OPT
191
SAT (subopt.)
2
SAT (TO)
207
SAT (MO)
5
? (TO)
35
? (MO)
6
? (EC)
19
NaPS-PB16
1.02b5
(complete)
done
478
UNSAT.
13
OPT
190
SAT (subopt.)
17
SAT (TO)
199
SAT (MO)
8
?
2
? (TO)
40
? (MO)
8
? (EC)
1
ParLS-PBO-1.1
2024-07-09
(incomplete)
done
478
UNSAT.
8
SAT (subopt.)
43
SAT (TO)
387
?
2
? (TO)
37
? (SIG)
1
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
done
478
UNSAT.
8
SAT (subopt.)
3
SAT (TO)
436
? (TO)
31
pb-oll-rs
2024-07-02
(complete)
done
478
UNSAT.
12
OPT
195
SAT (TO)
218
? (TO)
46
? (MO)
1
? (SIG)
5
ERR OPT
1
pb-oll-rs
2024-07-19
(complete)
done
478
UNSAT.
12
OPT
196
SAT (TO)
217
? (TO)
47
? (MO)
1
? (SIG)
5
Picat
2024-06-18
(complete)
done
478
UNSAT.
14
OPT
187
? (TO)
275
? (EC)
2
RoundingSat
log (1)
(complete)
done
478
OPTC
202
OPT
27
SAT (subopt.)
4
SAT (TO)
166
SAT (MO)
1
? (TO)
41
? (MO)
1
? (SIG)
1
NO CERT.
21
ERR OPTC
14
RoundingSat
log (2)
(complete)
done
478
UNSATC
13
OPTC
204
OPT
28
SAT (subopt.)
5
SAT (TO)
91
SAT (MO)
2
? (TO)
53
? (MO)
1
? (SIG)
1
NO CERT.
69
ERR OPTC
11
RoundingSat
log (3)
(complete)
done
478
UNSATC
13
OPTC
218
OPT
23
SAT (subopt.)
5
SAT (TO)
104
SAT (MO)
1
? (TO)
51
? (MO)
1
? (SIG)
1
NO CERT.
60
ERR OPTC
1
RoundingSat
nolog (1)
(complete)
done
478
OPT
243
SAT (subopt.)
4
SAT (TO)
198
SAT (MO)
1
? (MO)
1
ERR CERT
31
RoundingSat
nolog (2)
(complete)
done
478
UNSAT.
13
OPT
243
SAT (subopt.)
4
SAT (TO)
163
SAT (MO)
1
? (TO)
53
? (MO)
1
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
478
UNSAT.
10
OPT
123
SAT (TO)
258
? (TO)
83
NO CERT.
2
ERR CERT
2
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
478
UNSAT.
12
OPT
134
SAT (TO)
271
? (TO)
61
Sat4j Resolution 2024
2024-07-07
(complete)
done
478
UNSATC
6
OPTC
118
OPT
2
SAT (subopt.)
3
SAT (TO)
271
?
6
? (TO)
62
NO CERT.
10
Sat4j Resolution Default
2024-07-07
(complete)
done
478
UNSAT.
11
OPT
117
SAT (subopt.)
2
SAT (TO)
260
? (TO)
58
? (EC)
15
NO CERT.
14
ERR CERT
1
SCIP
2024-07-07
(complete)
done
478
UNSAT.
15
OPT
248
SAT (subopt.)
153
SAT (TO)
2
?
40
? (TO)
14
? (MO)
2
? (SIG)
4

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Solver Name#benchsSolvedUNSATCUNSAT.OPTCOPTSATSAT (subopt.)SAT (timeout)SAT (out of mem.)UNKNOWNUNKNOWN (no support)UNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG MSG.WRONG CERT.WRONG OPT.WRONG OPTCWRONG UNSAT.WRONG UNSATC
Exact
2024-07-05
(complete)
5430
(55.56%)
0
(0%)
0
(0%)
0
(0%)
30
(55.56%)
0
(0%)
0
(0%)
21
(38.89%)
0
(0%)
0
(0%)
0
(0%)
3
(5.56%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)
5427
(50%)
0
(0%)
0
(0%)
0
(0%)
27
(50%)
0
(0%)
0
(0%)
27
(50%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-02
(complete)
5437
(68.52%)
0
(0%)
0
(0%)
0
(0%)
37
(68.52%)
0
(0%)
17
(31.48%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-30
(complete)
5437
(68.52%)
0
(0%)
0
(0%)
0
(0%)
37
(68.52%)
0
(0%)
17
(31.48%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)
5436
(66.67%)
0
(0%)
0
(0%)
0
(0%)
36
(66.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
17
(31.48%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(1.85%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)
5436
(66.67%)
0
(0%)
0
(0%)
0
(0%)
36
(66.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
17
(31.48%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(1.85%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)
5436
(66.67%)
0
(0%)
0
(0%)
0
(0%)
36
(66.67%)
0
(0%)
18
(33.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Picat
2024-06-18
(complete)
5425
(46.3%)
0
(0%)
0
(0%)
0
(0%)
25
(46.3%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
29
(53.7%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)
5413
(24.07%)
0
(0%)
0
(0%)
0
(0%)
13
(24.07%)
0
(0%)
9
(16.67%)
28
(51.85%)
0
(0%)
2
(3.7%)
0
(0%)
2
(3.7%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
5420
(37.04%)
0
(0%)
0
(0%)
0
(0%)
20
(37.04%)
0
(0%)
0
(0%)
34
(62.96%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)
5419
(35.19%)
0
(0%)
0
(0%)
0
(0%)
19
(35.19%)
0
(0%)
0
(0%)
32
(59.26%)
0
(0%)
0
(0%)
0
(0%)
2
(3.7%)
0
(0%)
1
(1.85%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SCIP
2024-07-07
(complete)
5437
(68.52%)
0
(0%)
0
(0%)
0
(0%)
37
(68.52%)
0
(0%)
17
(31.48%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
Exact
2024-07-05
(complete)
done
54
OPT
30
SAT (TO)
21
? (TO)
3
Exact_no_SoPlex
2024-07-05
(complete)
done
54
OPT
27
SAT (TO)
27
FiberSCIP
2024-07-02
(complete)
done
54
OPT
37
SAT (subopt.)
17
FiberSCIP
2024-07-30
(complete)
done
54
OPT
37
SAT (subopt.)
17
FiberSCIP
20 cores, 2024-07-30
(complete)
done
54
OPT
36
? (TO)
17
ERR OPT
1
FiberSCIP
20 cores, 2024-08-09
(complete)
done
54
OPT
36
? (TO)
17
ERR OPT
1
FiberSCIP
20 cores, 2024-08-12
(complete)
done
54
OPT
36
SAT (subopt.)
18
Picat
2024-06-18
(complete)
done
54
OPT
25
? (TO)
29
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
54
OPT
13
SAT (subopt.)
9
SAT (TO)
28
?
2
? (TO)
2
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
54
OPT
20
SAT (TO)
34
Sat4j Resolution Default
2024-07-07
(complete)
done
54
OPT
19
SAT (TO)
32
? (TO)
2
? (EC)
1
SCIP
2024-07-07
(complete)
done
54
OPT
37
SAT (subopt.)
17

All categories for solvers registered in all categories

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATCUNSAT.OPTCOPTSATSAT (subopt.)SAT (timeout)SAT (out of mem.)UNKNOWNUNKNOWN (no support)UNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG MSG.WRONG CERT.WRONG OPT.WRONG OPTCWRONG UNSAT.WRONG UNSATC
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
875508
(58.06%)
0
(0%)
161
(18.4%)
0
(0%)
223
(25.49%)
124
(14.17%)
0
(0%)
190
(21.71%)
1
(0.11%)
18
(2.06%)
0
(0%)
156
(17.83%)
2
(0.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
875503
(57.49%)
0
(0%)
162
(18.51%)
0
(0%)
222
(25.37%)
119
(13.6%)
0
(0%)
192
(21.94%)
2
(0.23%)
16
(1.83%)
0
(0%)
158
(18.06%)
4
(0.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
875499
(57.03%)
0
(0%)
166
(18.97%)
0
(0%)
220
(25.14%)
113
(12.91%)
0
(0%)
191
(21.83%)
1
(0.11%)
17
(1.94%)
0
(0%)
163
(18.63%)
4
(0.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
875498
(56.91%)
0
(0%)
167
(19.09%)
0
(0%)
218
(24.91%)
113
(12.91%)
0
(0%)
195
(22.29%)
2
(0.23%)
13
(1.49%)
0
(0%)
159
(18.17%)
3
(0.34%)
0
(0%)
0
(0%)
5
(0.57%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
DLS-PBO
2024-07-09
(incomplete)
875129
(14.74%)
0
(0%)
18
(2.06%)
0
(0%)
0
(0%)
111
(12.69%)
399
(45.6%)
13
(1.49%)
0
(0%)
302
(34.51%)
0
(0%)
5
(0.57%)
14
(1.6%)
0
(0%)
0
(0%)
0
(0%)
11
(1.26%)
0
(0%)
2
(0.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact
2024-07-05
(complete)
939577
(61.45%)
0
(0%)
200
(21.3%)
0
(0%)
268
(28.54%)
109
(11.61%)
4
(0.43%)
204
(21.73%)
0
(0%)
3
(0.32%)
0
(0%)
148
(15.76%)
3
(0.32%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_no_SoPlex
2024-07-05
(complete)
939537
(57.19%)
0
(0%)
186
(19.81%)
0
(0%)
240
(25.56%)
111
(11.82%)
6
(0.64%)
253
(26.94%)
0
(0%)
3
(0.32%)
0
(0%)
137
(14.59%)
3
(0.32%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_veripb2
2024-07-05
(complete)
875530
(60.57%)
188
(21.49%)
9
(1.03%)
169
(19.31%)
56
(6.4%)
108
(12.34%)
6
(0.69%)
187
(21.37%)
0
(0%)
0
(0%)
0
(0%)
152
(17.37%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
875479
(54.74%)
177
(20.23%)
8
(0.91%)
144
(16.46%)
38
(4.34%)
112
(12.8%)
5
(0.57%)
239
(27.31%)
0
(0%)
0
(0%)
0
(0%)
152
(17.37%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-02
(complete)
939535
(56.98%)
0
(0%)
176
(18.74%)
0
(0%)
275
(29.29%)
84
(8.95%)
181
(19.28%)
0
(0%)
0
(0%)
195
(20.77%)
0
(0%)
18
(1.92%)
7
(0.75%)
0
(0%)
0
(0%)
2
(0.21%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
2024-07-30
(complete)
939526
(56.02%)
0
(0%)
176
(18.74%)
0
(0%)
267
(28.43%)
83
(8.84%)
190
(20.23%)
0
(0%)
0
(0%)
196
(20.87%)
0
(0%)
18
(1.92%)
7
(0.75%)
0
(0%)
0
(0%)
2
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-07-30
(complete)
939577
(61.45%)
0
(0%)
186
(19.81%)
0
(0%)
282
(30.03%)
109
(11.61%)
0
(0%)
0
(0%)
0
(0%)
6
(0.64%)
0
(0%)
340
(36.21%)
9
(0.96%)
0
(0%)
0
(0%)
6
(0.64%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-09
(complete)
939574
(61.13%)
0
(0%)
188
(20.02%)
0
(0%)
279
(29.71%)
107
(11.4%)
0
(0%)
0
(0%)
0
(0%)
6
(0.64%)
0
(0%)
343
(36.53%)
11
(1.17%)
0
(0%)
0
(0%)
4
(0.43%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
FiberSCIP
20 cores, 2024-08-12
(complete)
939561
(59.74%)
0
(0%)
186
(19.81%)
0
(0%)
266
(28.33%)
109
(11.61%)
175
(18.64%)
0
(0%)
0
(0%)
108
(11.5%)
0
(0%)
59
(6.28%)
12
(1.28%)
0
(0%)
0
(0%)
24
(2.56%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
875571
(65.26%)
0
(0%)
200
(22.86%)
0
(0%)
245
(28%)
126
(14.4%)
197
(22.51%)
0
(0%)
0
(0%)
93
(10.63%)
0
(0%)
5
(0.57%)
3
(0.34%)
0
(0%)
6
(0.69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
875563
(64.34%)
0
(0%)
199
(22.74%)
0
(0%)
241
(27.54%)
123
(14.06%)
199
(22.74%)
0
(0%)
0
(0%)
105
(12%)
0
(0%)
4
(0.46%)
4
(0.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
875117
(13.37%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
117
(13.37%)
447
(51.09%)
0
(0%)
0
(0%)
301
(34.4%)
0
(0%)
5
(0.57%)
1
(0.11%)
0
(0%)
4
(0.46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
875130
(14.86%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
130
(14.86%)
439
(50.17%)
0
(0%)
0
(0%)
305
(34.86%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
875115
(13.14%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
115
(13.14%)
449
(51.31%)
0
(0%)
0
(0%)
308
(35.2%)
0
(0%)
1
(0.11%)
2
(0.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
IPBHS-GUROBI
2024-07-09
(complete)
478257
(53.77%)
0
(0%)
13
(2.72%)
0
(0%)
244
(51.05%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
221
(46.23%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
IPBHS-GUROBI-SYM
2024-07-09
(complete)
478258
(53.97%)
0
(0%)
13
(2.72%)
0
(0%)
245
(51.26%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
219
(45.82%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
IPBHS-SCIP
2024-07-09
(complete)
478245
(51.26%)
0
(0%)
13
(2.72%)
0
(0%)
232
(48.54%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
230
(48.12%)
0
(0%)
0
(0%)
0
(0%)
3
(0.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-Mab
2024-07-10
(incomplete)
875105
(12%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
105
(12%)
398
(45.49%)
34
(3.89%)
0
(0%)
313
(35.77%)
0
(0%)
11
(1.26%)
14
(1.6%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabP
2024-07-10
(incomplete)
875108
(12.34%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
108
(12.34%)
433
(49.49%)
0
(0%)
0
(0%)
309
(35.31%)
0
(0%)
12
(1.37%)
13
(1.49%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabS
2024-07-10
(incomplete)
875110
(12.57%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
110
(12.57%)
431
(49.26%)
0
(0%)
0
(0%)
310
(35.43%)
0
(0%)
10
(1.14%)
14
(1.6%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
LS-MabSP
2024-07-10
(incomplete)
875112
(12.8%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
112
(12.8%)
433
(49.49%)
0
(0%)
0
(0%)
303
(34.63%)
0
(0%)
14
(1.6%)
13
(1.49%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
mixed-bag
2024-07-02
(complete)
478273
(57.11%)
0
(0%)
13
(2.72%)
0
(0%)
260
(54.39%)
0
(0%)
0
(0%)
87
(18.2%)
0
(0%)
0
(0%)
0
(0%)
107
(22.38%)
2
(0.42%)
0
(0%)
0
(0%)
2
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(1.46%)
0
(0%)
mixed-bag
2024-07-19
(complete)
478279
(58.37%)
0
(0%)
13
(2.72%)
0
(0%)
266
(55.65%)
0
(0%)
0
(0%)
87
(18.2%)
0
(0%)
0
(0%)
0
(0%)
107
(22.38%)
2
(0.42%)
0
(0%)
0
(0%)
2
(0.42%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS
1.03
(complete)
875481
(54.97%)
0
(0%)
163
(18.63%)
0
(0%)
196
(22.4%)
122
(13.94%)
1
(0.11%)
205
(23.43%)
3
(0.34%)
12
(1.37%)
0
(0%)
138
(15.77%)
5
(0.57%)
30
(3.43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS-GM
1.03
(complete)
875445
(50.86%)
0
(0%)
163
(18.63%)
0
(0%)
191
(21.83%)
91
(10.4%)
2
(0.23%)
207
(23.66%)
5
(0.57%)
11
(1.26%)
0
(0%)
175
(20%)
7
(0.8%)
23
(2.63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
NaPS-PB16
1.02b5
(complete)
875439
(50.17%)
0
(0%)
163
(18.63%)
0
(0%)
190
(21.71%)
86
(9.83%)
17
(1.94%)
199
(22.74%)
8
(0.91%)
3
(0.34%)
0
(0%)
198
(22.63%)
10
(1.14%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ParLS-PBO-1.1
2024-07-09
(incomplete)
875130
(14.86%)
0
(0%)
18
(2.06%)
0
(0%)
0
(0%)
112
(12.8%)
43
(4.91%)
387
(44.23%)
0
(0%)
9
(1.03%)
0
(0%)
305
(34.86%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
875142
(16.23%)
0
(0%)
18
(2.06%)
0
(0%)
0
(0%)
124
(14.17%)
3
(0.34%)
436
(49.83%)
0
(0%)
0
(0%)
0
(0%)
294
(33.6%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
pb-oll-rs
2024-07-02
(complete)
478207
(43.31%)
0
(0%)
12
(2.51%)
0
(0%)
195
(40.79%)
0
(0%)
0
(0%)
218
(45.61%)
0
(0%)
0
(0%)
0
(0%)
46
(9.62%)
1
(0.21%)
0
(0%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
0
(0%)
1
(0.21%)
0
(0%)
0
(0%)
0
(0%)
pb-oll-rs
2024-07-19
(complete)
478208
(43.51%)
0
(0%)
12
(2.51%)
0
(0%)
196
(41%)
0
(0%)
0
(0%)
217
(45.4%)
0
(0%)
0
(0%)
0
(0%)
47
(9.83%)
1
(0.21%)
0
(0%)
0
(0%)
5
(1.05%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Picat
2024-06-18
(complete)
939508
(54.1%)
0
(0%)
166
(17.68%)
0
(0%)
212
(22.58%)
130
(13.84%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
426
(45.37%)
0
(0%)
2
(0.21%)
1
(0.11%)
2
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
log (1)
(complete)
875327
(37.37%)
0
(0%)
0
(0%)
202
(23.09%)
27
(3.09%)
98
(11.2%)
4
(0.46%)
166
(18.97%)
1
(0.11%)
0
(0%)
0
(0%)
151
(17.26%)
1
(0.11%)
0
(0%)
0
(0%)
1
(0.11%)
210
(24%)
0
(0%)
0
(0%)
0
(0%)
14
(1.6%)
0
(0%)
0
(0%)
RoundingSat
log (2)
(complete)
875532
(60.8%)
202
(23.09%)
0
(0%)
204
(23.31%)
28
(3.2%)
98
(11.2%)
5
(0.57%)
91
(10.4%)
2
(0.23%)
0
(0%)
0
(0%)
163
(18.63%)
1
(0.11%)
0
(0%)
0
(0%)
1
(0.11%)
69
(7.89%)
0
(0%)
0
(0%)
0
(0%)
11
(1.26%)
0
(0%)
0
(0%)
RoundingSat
log (3)
(complete)
875542
(61.94%)
202
(23.09%)
0
(0%)
218
(24.91%)
23
(2.63%)
99
(11.31%)
5
(0.57%)
104
(11.89%)
1
(0.11%)
0
(0%)
0
(0%)
160
(18.29%)
1
(0.11%)
0
(0%)
0
(0%)
1
(0.11%)
60
(6.86%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
RoundingSat
nolog (1)
(complete)
875340
(38.86%)
0
(0%)
0
(0%)
0
(0%)
243
(27.77%)
97
(11.09%)
4
(0.46%)
198
(22.63%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
184
(21.03%)
147
(16.8%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RoundingSat
nolog (2)
(complete)
875538
(61.49%)
0
(0%)
197
(22.51%)
0
(0%)
243
(27.77%)
98
(11.2%)
4
(0.46%)
163
(18.63%)
1
(0.11%)
0
(0%)
0
(0%)
168
(19.2%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Cutting Planes 2024
2024-07-12
(complete)
939345
(36.74%)
0
(0%)
149
(15.87%)
0
(0%)
136
(14.48%)
60
(6.39%)
9
(0.96%)
286
(30.46%)
0
(0%)
12
(1.28%)
0
(0%)
283
(30.14%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.21%)
0
(0%)
2
(0.21%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
939392
(41.75%)
0
(0%)
163
(17.36%)
0
(0%)
154
(16.4%)
75
(7.99%)
0
(0%)
305
(32.48%)
0
(0%)
0
(0%)
0
(0%)
242
(25.77%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution 2024
2024-07-07
(complete)
875370
(42.29%)
147
(16.8%)
1
(0.11%)
118
(13.49%)
2
(0.23%)
102
(11.66%)
3
(0.34%)
271
(30.97%)
0
(0%)
6
(0.69%)
0
(0%)
215
(24.57%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
10
(1.14%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sat4j Resolution Default
2024-07-07
(complete)
939396
(42.17%)
0
(0%)
155
(16.51%)
0
(0%)
136
(14.48%)
105
(11.18%)
2
(0.21%)
292
(31.1%)
0
(0%)
0
(0%)
0
(0%)
217
(23.11%)
0
(0%)
17
(1.81%)
0
(0%)
0
(0%)
14
(1.49%)
0
(0%)
1
(0.11%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SCIP
2024-07-07
(complete)
939550
(58.57%)
0
(0%)
178
(18.96%)
0
(0%)
285
(30.35%)
87
(9.27%)
170
(18.1%)
2
(0.21%)
0
(0%)
172
(18.32%)
0
(0%)
39
(4.15%)
2
(0.21%)
0
(0%)
0
(0%)
4
(0.43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
CASHWMaxSAT-DisjCad-S
2024-07-10
(complete)
done
875
UNSAT.
161
OPT
223
SAT
124
SAT (TO)
190
SAT (MO)
1
?
18
? (TO)
156
? (MO)
2
CASHWMaxSAT-DisjCad-SP
2024-07-10
(complete)
done
875
UNSAT.
162
OPT
222
SAT
119
SAT (TO)
192
SAT (MO)
2
?
16
? (TO)
158
? (MO)
4
CASHWMaxSAT-DisjCom-S
2024-07-10
(complete)
done
875
UNSAT.
166
OPT
220
SAT
113
SAT (TO)
191
SAT (MO)
1
?
17
? (TO)
163
? (MO)
4
CASHWMaxSAT-DisjCom-SP
2024-07-10
(complete)
done
875
UNSAT.
167
OPT
218
SAT
113
SAT (TO)
195
SAT (MO)
2
?
13
? (TO)
159
? (MO)
3
? (SIG)
5
DLS-PBO
2024-07-09
(incomplete)
done
875
UNSAT.
18
SAT
111
SAT (subopt.)
399
SAT (TO)
13
?
302
? (TO)
5
? (MO)
14
NO CERT.
11
ERR CERT
2
Exact
2024-07-05
(complete)
done
939
UNSAT.
200
OPT
268
SAT
109
SAT (subopt.)
4
SAT (TO)
204
?
3
? (TO)
148
? (MO)
3
Exact_no_SoPlex
2024-07-05
(complete)
done
939
UNSAT.
186
OPT
240
SAT
111
SAT (subopt.)
6
SAT (TO)
253
?
3
? (TO)
137
? (MO)
3
Exact_veripb2
2024-07-05
(complete)
done
875
UNSATC
188
UNSAT.
9
OPTC
169
OPT
56
SAT
108
SAT (subopt.)
6
SAT (TO)
187
? (TO)
152
Exact_veripb2_no_SoPlex
2024-07-05
(complete)
done
875
UNSATC
177
UNSAT.
8
OPTC
144
OPT
38
SAT
112
SAT (subopt.)
5
SAT (TO)
239
? (TO)
152
FiberSCIP
2024-07-02
(complete)
done
939
UNSAT.
176
OPT
275
SAT
84
SAT (subopt.)
181
?
195
? (TO)
18
? (MO)
7
? (SIG)
2
ERR OPT
1
FiberSCIP
2024-07-30
(complete)
done
939
UNSAT.
176
OPT
267
SAT
83
SAT (subopt.)
190
?
196
? (TO)
18
? (MO)
7
? (SIG)
2
FiberSCIP
20 cores, 2024-07-30
(complete)
done
939
UNSAT.
186
OPT
282
SAT
109
?
6
? (TO)
340
? (MO)
9
? (SIG)
6
ERR OPT
1
FiberSCIP
20 cores, 2024-08-09
(complete)
done
939
UNSAT.
188
OPT
279
SAT
107
?
6
? (TO)
343
? (MO)
11
? (SIG)
4
ERR OPT
1
FiberSCIP
20 cores, 2024-08-12
(complete)
done
939
UNSAT.
186
OPT
266
SAT
109
SAT (subopt.)
175
?
108
? (TO)
59
? (MO)
12
? (SIG)
24
Hybrid-CASHWMaxSATDisjCadSP+Exact
2024-07-11
(complete)
done
875
UNSAT.
200
OPT
245
SAT
126
SAT (subopt.)
197
?
93
? (TO)
5
? (MO)
3
? (?)
6
Hybrid-CASHWMaxSATDisjComS+Exact
2024-07-11
(complete)
done
875
UNSAT.
199
OPT
241
SAT
123
SAT (subopt.)
199
?
105
? (TO)
4
? (MO)
4
Hybrid-LSMabP+Exact
2024-07-11
(incomplete)
done
875
SAT
117
SAT (subopt.)
447
?
301
? (TO)
5
? (MO)
1
? (?)
4
Hybrid-LSMabSP+CASHWMaxSATDisjCom
2024-07-11
(incomplete)
done
875
SAT
130
SAT (subopt.)
439
?
305
? (?)
1
Hybrid-LSMabSP+Exact
2024-07-11
(incomplete)
done
875
SAT
115
SAT (subopt.)
449
?
308
? (TO)
1
? (MO)
2
IPBHS-GUROBI
2024-07-09
(complete)
done
478
UNSAT.
13
OPT
244
? (TO)
221
IPBHS-GUROBI-SYM
2024-07-09
(complete)
done
478
UNSAT.
13
OPT
245
? (TO)
219
ERR OPT
1
IPBHS-SCIP
2024-07-09
(complete)
done
478
UNSAT.
13
OPT
232
? (TO)
230
? (SIG)
3
LS-Mab
2024-07-10
(incomplete)
done
875
SAT
105
SAT (subopt.)
398
SAT (TO)
34
?
313
? (TO)
11
? (MO)
14
LS-MabP
2024-07-10
(incomplete)
done
875
SAT
108
SAT (subopt.)
433
?
309
? (TO)
12
? (MO)
13
LS-MabS
2024-07-10
(incomplete)
done
875
SAT
110
SAT (subopt.)
431
?
310
? (TO)
10
? (MO)
14
LS-MabSP
2024-07-10
(incomplete)
done
875
SAT
112
SAT (subopt.)
433
?
303
? (TO)
14
? (MO)
13
mixed-bag
2024-07-02
(complete)
done
478
UNSAT.
13
OPT
260
SAT (TO)
87
? (TO)
107
? (MO)
2
? (SIG)
2
ERR UNSAT
7
mixed-bag
2024-07-19
(complete)
done
478
UNSAT.
13
OPT
266
SAT (TO)
87
? (TO)
107
? (MO)
2
? (SIG)
2
NO CERT.
1
NaPS
1.03
(complete)
done
875
UNSAT.
163
OPT
196
SAT
122
SAT (subopt.)
1
SAT (TO)
205
SAT (MO)
3
?
12
? (TO)
138
? (MO)
5
? (EC)
30
NaPS-GM
1.03
(complete)
done
875
UNSAT.
163
OPT
191
SAT
91
SAT (subopt.)
2
SAT (TO)
207
SAT (MO)
5
?
11
? (TO)
175
? (MO)
7
? (EC)
23
NaPS-PB16
1.02b5
(complete)
done
875
UNSAT.
163
OPT
190
SAT
86
SAT (subopt.)
17
SAT (TO)
199
SAT (MO)
8
?
3
? (TO)
198
? (MO)
10
? (EC)
1
ParLS-PBO-1.1
2024-07-09
(incomplete)
done
875
UNSAT.
18
SAT
112
SAT (subopt.)
43
SAT (TO)
387
?
9
? (TO)
305
? (SIG)
1
ParLS-PBO-1.1
20 cores, 2024-07-09
(incomplete)
done
875
UNSAT.
18
SAT
124
SAT (subopt.)
3
SAT (TO)
436
? (TO)
294
pb-oll-rs
2024-07-02
(complete)
done
478
UNSAT.
12
OPT
195
SAT (TO)
218
? (TO)
46
? (MO)
1
? (SIG)
5
ERR OPT
1
pb-oll-rs
2024-07-19
(complete)
done
478
UNSAT.
12
OPT
196
SAT (TO)
217
? (TO)
47
? (MO)
1
? (SIG)
5
Picat
2024-06-18
(complete)
done
939
UNSAT.
166
OPT
212
SAT
130
? (TO)
426
? (EC)
2
? (?)
1
? (SIG)
2
RoundingSat
log (1)
(complete)
done
875
OPTC
202
OPT
27
SAT
98
SAT (subopt.)
4
SAT (TO)
166
SAT (MO)
1
? (TO)
151
? (MO)
1
? (SIG)
1
NO CERT.
210
ERR OPTC
14
RoundingSat
log (2)
(complete)
done
875
UNSATC
202
OPTC
204
OPT
28
SAT
98
SAT (subopt.)
5
SAT (TO)
91
SAT (MO)
2
? (TO)
163
? (MO)
1
? (SIG)
1
NO CERT.
69
ERR OPTC
11
RoundingSat
log (3)
(complete)
done
875
UNSATC
202
OPTC
218
OPT
23
SAT
99
SAT (subopt.)
5
SAT (TO)
104
SAT (MO)
1
? (TO)
160
? (MO)
1
? (SIG)
1
NO CERT.
60
ERR OPTC
1
RoundingSat
nolog (1)
(complete)
done
875
OPT
243
SAT
97
SAT (subopt.)
4
SAT (TO)
198
SAT (MO)
1
? (MO)
1
ERR MSG
184
ERR CERT
147
RoundingSat
nolog (2)
(complete)
done
875
UNSAT.
197
OPT
243
SAT
98
SAT (subopt.)
4
SAT (TO)
163
SAT (MO)
1
? (TO)
168
? (MO)
1
Sat4j Cutting Planes 2024
2024-07-12
(complete)
done
939
UNSAT.
149
OPT
136
SAT
60
SAT (subopt.)
9
SAT (TO)
286
?
12
? (TO)
283
NO CERT.
2
ERR CERT
2
Sat4j Partial RoundingSAT 2024
2024-07-12
(complete)
done
939
UNSAT.
163
OPT
154
SAT
75
SAT (TO)
305
? (TO)
242
Sat4j Resolution 2024
2024-07-07
(complete)
done
875
UNSATC
147
UNSAT.
1
OPTC
118
OPT
2
SAT
102
SAT (subopt.)
3
SAT (TO)
271
?
6
? (TO)
215
NO CERT.
10
Sat4j Resolution Default
2024-07-07
(complete)
done
939
UNSAT.
155
OPT
136
SAT
105
SAT (subopt.)
2
SAT (TO)
292
? (TO)
217
? (EC)
17
NO CERT.
14
ERR CERT
1
SCIP
2024-07-07
(complete)
done
939
UNSAT.
178
OPT
285
SAT
87
SAT (subopt.)
170
SAT (TO)
2
?
172
? (TO)
39
? (MO)
2
? (SIG)
4