PB'10 competition: satisfaction and optimization track: solvers page (tabular format, summary)

Some explanations

Category "no optimisation, small integers, linear constraints" (DEC-SMALLINT-LIN)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
borg-pb
10.05.30
(complete)		 452415
(91.81%)		 236
(52.21%)		 179
(39.6%)		 0
(0%)		 37
(8.19%)		 0
(0%)
bsolo
3.2 Card
(complete)		 452380
(84.07%)		 208
(46.02%)		 172
(38.05%)		 0
(0%)		 72
(15.93%)		 0
(0%)
bsolo
3.2 Cl
(complete)		 452355
(78.54%)		 185
(40.93%)		 170
(37.61%)		 0
(0%)		 97
(21.46%)		 0
(0%)
pb_cplex
2010-06-29
(complete)		 452337
(74.56%)		 182
(40.27%)		 155
(34.29%)		 0
(0%)		 115
(25.44%)		 0
(0%)
PB/CT
0.1
(complete)		 452352
(77.88%)		 203
(44.91%)		 149
(32.96%)		 0
(0%)		 82
(18.14%)		 18
(3.98%)
PB/CT
0.1 fixed
(complete)		 452369
(81.64%)		 205
(45.35%)		 164
(36.28%)		 0
(0%)		 83
(18.36%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 45249
(10.84%)		 29
(6.42%)		 20
(4.42%)		 0
(0%)		 386
(85.4%)		 17
(3.76%)
PB-wave
alpha 2
(incomplete)		 45266
(14.6%)		 0
(0%)		 66
(14.6%)		 0
(0%)		 386
(85.4%)		 0
(0%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 452228
(50.44%)		 122
(26.99%)		 106
(23.45%)		 0
(0%)		 224
(49.56%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 452382
(84.51%)		 209
(46.24%)		 173
(38.27%)		 0
(0%)		 70
(15.49%)		 0
(0%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 452367
(81.19%)		 193
(42.7%)		 174
(38.5%)		 0
(0%)		 85
(18.81%)		 0
(0%)
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		 452344
(76.11%)		 200
(44.25%)		 144
(31.86%)		 0
(0%)		 108
(23.89%)		 0
(0%)
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		 452288
(63.72%)		 134
(29.65%)		 154
(34.07%)		 0
(0%)		 164
(36.28%)		 0
(0%)
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 452351
(77.65%)		 210
(46.46%)		 141
(31.19%)		 0
(0%)		 101
(22.35%)		 0
(0%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 452351
(77.65%)		 212
(46.9%)		 139
(30.75%)		 0
(0%)		 101
(22.35%)		 0
(0%)
wbo
1.4a
(complete)		 452378
(83.63%)		 207
(45.8%)		 171
(37.83%)		 0
(0%)		 74
(16.37%)		 0
(0%)

Solver NameProgress
borg-pb
10.05.30
(complete)
done
452
UNSAT
236		OPT/SAT
179		?
37
bsolo
3.2 Card
(complete)
done
452
UNSAT
208		OPT/SAT
172		?
72
bsolo
3.2 Cl
(complete)
done
452
UNSAT
185		OPT/SAT
170		?
97
pb_cplex
2010-06-29
(complete)
done
452
UNSAT
182		OPT/SAT
155		?
115
PB/CT
0.1
(complete)
done
452
UNSAT
203		OPT/SAT
149		?
82		ERR
18
PB/CT
0.1 fixed
(complete)
done
452
UNSAT
205		OPT/SAT
164		?
83
PBPASSolver
2010-06-13
(complete)
done
452
UNSAT
29		OPT/SAT
20		?
386		ERR
17
PB-wave
alpha 2
(incomplete)
done
452
OPT/SAT
66		?
386
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
452
UNSAT
122		OPT/SAT
106		?
224
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
452
UNSAT
209		OPT/SAT
173		?
70
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
452
UNSAT
193		OPT/SAT
174		?
85
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)
done
452
UNSAT
200		OPT/SAT
144		?
108
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)
done
452
UNSAT
134		OPT/SAT
154		?
164
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
452
UNSAT
210		OPT/SAT
141		?
101
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
452
UNSAT
212		OPT/SAT
139		?
101
wbo
1.4a
(complete)
done
452
UNSAT
207		OPT/SAT
171		?
74

Category "no optimisation, small integers, non linear constraints" (DEC-SMALLINT-NLC)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
borg-pb
10.05.30
(complete)		 10027
(27%)		 10
(10%)		 17
(17%)		 0
(0%)		 24
(24%)		 49
(49%)
bsolo
3.2 Card
(complete)		 10061
(61%)		 15
(15%)		 46
(46%)		 0
(0%)		 39
(39%)		 0
(0%)
bsolo
3.2 Cl
(complete)		 10026
(26%)		 10
(10%)		 16
(16%)		 0
(0%)		 74
(74%)		 0
(0%)
pb_cplex
2010-06-29
(complete)		 10070
(70%)		 20
(20%)		 50
(50%)		 0
(0%)		 30
(30%)		 0
(0%)
PB/CT
0.1
(complete)		 10065
(65%)		 15
(15%)		 50
(50%)		 0
(0%)		 35
(35%)		 0
(0%)
PB/CT
0.1 fixed
(complete)		 10063
(63%)		 13
(13%)		 50
(50%)		 0
(0%)		 37
(37%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 1005
(5%)		 5
(5%)		 0
(0%)		 0
(0%)		 50
(50%)		 45
(45%)
PB-wave
alpha 2
(incomplete)		 10025
(25%)		 0
(0%)		 25
(25%)		 0
(0%)		 75
(75%)		 0
(0%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 10065
(65%)		 15
(15%)		 50
(50%)		 0
(0%)		 35
(35%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 10065
(65%)		 15
(15%)		 50
(50%)		 0
(0%)		 35
(35%)		 0
(0%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 10025
(25%)		 15
(15%)		 10
(10%)		 0
(0%)		 75
(75%)		 0
(0%)
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		 10069
(69%)		 19
(19%)		 50
(50%)		 0
(0%)		 31
(31%)		 0
(0%)
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		 10049
(49%)		 10
(10%)		 39
(39%)		 0
(0%)		 51
(51%)		 0
(0%)
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 10069
(69%)		 19
(19%)		 50
(50%)		 0
(0%)		 31
(31%)		 0
(0%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 10070
(70%)		 20
(20%)		 50
(50%)		 0
(0%)		 30
(30%)		 0
(0%)
wbo
1.4a
(complete)		 10057
(57%)		 15
(15%)		 42
(42%)		 0
(0%)		 43
(43%)		 0
(0%)

Solver NameProgress
borg-pb
10.05.30
(complete)
done
100
UNSAT
10		OPT/SAT
17		?
24		ERR
49
bsolo
3.2 Card
(complete)
done
100
UNSAT
15		OPT/SAT
46		?
39
bsolo
3.2 Cl
(complete)
done
100
UNSAT
10		OPT/SAT
16		?
74
pb_cplex
2010-06-29
(complete)
done
100
UNSAT
20		OPT/SAT
50		?
30
PB/CT
0.1
(complete)
done
100
UNSAT
15		OPT/SAT
50		?
35
PB/CT
0.1 fixed
(complete)
done
100
UNSAT
13		OPT/SAT
50		?
37
PBPASSolver
2010-06-13
(complete)
done
100
UNSAT
5		?
50		ERR
45
PB-wave
alpha 2
(incomplete)
done
100
OPT/SAT
25		?
75
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
100
UNSAT
15		OPT/SAT
50		?
35
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
100
UNSAT
15		OPT/SAT
50		?
35
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
100
UNSAT
15		OPT/SAT
10		?
75
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)
done
100
UNSAT
19		OPT/SAT
50		?
31
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)
done
100
UNSAT
10		OPT/SAT
39		?
51
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
100
UNSAT
19		OPT/SAT
50		?
31
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
100
UNSAT
20		OPT/SAT
50		?
30
wbo
1.4a
(complete)
done
100
UNSAT
15		OPT/SAT
42		?
43

Category "optimisation, big integers, linear constraints" (OPT-BIGINT-LIN)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
PB/CT
0.1
(complete)		 53282
(15.41%)		 45
(8.46%)		 37
(6.95%)		 94
(17.67%)		 314
(59.02%)		 42
(7.89%)
PB/CT
0.1 fixed
(complete)		 53287
(16.35%)		 34
(6.39%)		 53
(9.96%)		 108
(20.3%)		 337
(63.35%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 53232
(6.02%)		 29
(5.45%)		 3
(0.56%)		 0
(0%)		 499
(93.8%)		 1
(0.19%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 532168
(31.58%)		 58
(10.9%)		 110
(20.68%)		 157
(29.51%)		 207
(38.91%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 532205
(38.53%)		 59
(11.09%)		 146
(27.44%)		 151
(28.38%)		 176
(33.08%)		 0
(0%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 532198
(37.22%)		 57
(10.71%)		 141
(26.5%)		 156
(29.32%)		 178
(33.46%)		 0
(0%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 532224
(42.11%)		 79
(14.85%)		 145
(27.26%)		 1
(0.19%)		 140
(26.32%)		 127
(23.87%)

Solver NameProgress
PB/CT
0.1
(complete)
done
532
UNSAT
45		OPT/SAT
37		SAT (TO/MO)
94		?
314		ERR
42
PB/CT
0.1 fixed
(complete)
done
532
UNSAT
34		OPT/SAT
53		SAT (TO/MO)
108		?
337
PBPASSolver
2010-06-13
(complete)
done
532
UNSAT
29		OPT/SAT
3		?
499		ERR
1
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
532
UNSAT
58		OPT/SAT
110		SAT (TO/MO)
157		?
207
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
532
UNSAT
59		OPT/SAT
146		SAT (TO/MO)
151		?
176
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
532
UNSAT
57		OPT/SAT
141		SAT (TO/MO)
156		?
178
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
532
UNSAT
79		OPT/SAT
145		SAT (TO/MO)
1		?
140		ERR
127

Category "optimisation, small integers, linear constraints" (OPT-SMALLINT-LIN)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
bsolo
3.2 Card
(complete)		 699333
(47.64%)		 33
(4.72%)		 300
(42.92%)		 12
(1.72%)		 46
(6.58%)		 0
(0%)
bsolo
3.2 Cl
(complete)		 699328
(46.92%)		 33
(4.72%)		 295
(42.2%)		 13
(1.86%)		 47
(6.72%)		 0
(0%)
pb_cplex
2010-06-29
(complete)		 699417
(59.66%)		 33
(4.72%)		 384
(54.94%)		 2
(0.29%)		 229
(32.76%)		 11
(1.57%)
PB/CT
0.1
(complete)		 699264
(37.77%)		 26
(3.72%)		 238
(34.05%)		 335
(47.93%)		 66
(9.44%)		 34
(4.86%)
PB/CT
0.1 fixed
(complete)		 699283
(40.49%)		 32
(4.58%)		 251
(35.91%)		 343
(49.07%)		 73
(10.44%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 69988
(12.59%)		 28
(4.01%)		 60
(8.58%)		 0
(0%)		 610
(87.27%)		 1
(0.14%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 699255
(36.48%)		 29
(4.15%)		 226
(32.33%)		 366
(52.36%)		 78
(11.16%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 699315
(45.06%)		 33
(4.72%)		 282
(40.34%)		 292
(41.77%)		 86
(12.3%)		 3
(0.43%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 699303
(43.35%)		 33
(4.72%)		 270
(38.63%)		 347
(49.64%)		 49
(7.01%)		 0
(0%)
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		 699319
(45.64%)		 33
(4.72%)		 286
(40.92%)		 185
(26.47%)		 195
(27.9%)		 0
(0%)
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		 699187
(26.75%)		 29
(4.15%)		 158
(22.6%)		 326
(46.64%)		 186
(26.61%)		 0
(0%)
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 699317
(45.35%)		 33
(4.72%)		 284
(40.63%)		 188
(26.9%)		 194
(27.75%)		 0
(0%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 699354
(50.64%)		 33
(4.72%)		 321
(45.92%)		 0
(0%)		 160
(22.89%)		 0
(0%)
wbo
1.4b
(complete)		 699309
(44.21%)		 9
(1.29%)		 300
(42.92%)		 0
(0%)		 306
(43.78%)		 82
(11.73%)
wbo
1.4b (fixed)
(complete)		 699334
(47.78%)		 30
(4.29%)		 304
(43.49%)		 0
(0%)		 359
(51.36%)		 4
(0.57%)

Solver NameProgress
bsolo
3.2 Card
(complete)
done
699
UNSAT
33		OPT/SAT
300		SAT (TO/MO)
12		?
46
bsolo
3.2 Cl
(complete)
done
699
UNSAT
33		OPT/SAT
295		SAT (TO/MO)
13		?
47
pb_cplex
2010-06-29
(complete)
done
699
UNSAT
33		OPT/SAT
384		SAT (TO/MO)
2		?
229		ERR
11
PB/CT
0.1
(complete)
done
699
UNSAT
26		OPT/SAT
238		SAT (TO/MO)
335		?
66		ERR
34
PB/CT
0.1 fixed
(complete)
done
699
UNSAT
32		OPT/SAT
251		SAT (TO/MO)
343		?
73
PBPASSolver
2010-06-13
(complete)
done
699
UNSAT
28		OPT/SAT
60		?
610		ERR
1
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
699
UNSAT
29		OPT/SAT
226		SAT (TO/MO)
366		?
78
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
699
UNSAT
33		OPT/SAT
282		SAT (TO/MO)
292		?
86		ERR
3
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
699
UNSAT
33		OPT/SAT
270		SAT (TO/MO)
347		?
49
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)
done
699
UNSAT
33		OPT/SAT
286		SAT (TO/MO)
185		?
195
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)
done
699
UNSAT
29		OPT/SAT
158		SAT (TO/MO)
326		?
186
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
699
UNSAT
33		OPT/SAT
284		SAT (TO/MO)
188		?
194
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
699
UNSAT
33		OPT/SAT
321		?
160
wbo
1.4b
(complete)
done
699
UNSAT
9		OPT/SAT
300		?
306		ERR
82
wbo
1.4b (fixed)
(complete)
done
699
UNSAT
30		OPT/SAT
304		?
359		ERR
4

Category "optimisation, small integers, non linear constraints" (OPT-SMALLINT-NLC)

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
bsolo
3.2 Card
(complete)		 409217
(53.06%)		 0
(0%)		 217
(53.06%)		 11
(2.69%)		 20
(4.89%)		 0
(0%)
bsolo
3.2 Cl
(complete)		 409230
(56.23%)		 0
(0%)		 230
(56.23%)		 12
(2.93%)		 13
(3.18%)		 0
(0%)
pb_cplex
2010-06-29
(complete)		 409134
(32.76%)		 0
(0%)		 134
(32.76%)		 0
(0%)		 250
(61.12%)		 20
(4.89%)
PB/CT
0.1
(complete)		 409194
(47.43%)		 0
(0%)		 194
(47.43%)		 190
(46.45%)		 25
(6.11%)		 0
(0%)
PB/CT
0.1 fixed
(complete)		 409186
(45.48%)		 0
(0%)		 186
(45.48%)		 198
(48.41%)		 25
(6.11%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 40994
(22.98%)		 0
(0%)		 94
(22.98%)		 0
(0%)		 310
(75.79%)		 5
(1.22%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 409117
(28.61%)		 0
(0%)		 117
(28.61%)		 232
(56.72%)		 60
(14.67%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 409250
(61.12%)		 0
(0%)		 250
(61.12%)		 134
(32.76%)		 25
(6.11%)		 0
(0%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 409271
(66.26%)		 0
(0%)		 271
(66.26%)		 132
(32.27%)		 6
(1.47%)		 0
(0%)
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		 409278
(67.97%)		 0
(0%)		 278
(67.97%)		 94
(22.98%)		 33
(8.07%)		 4
(0.98%)
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		 409260
(63.57%)		 0
(0%)		 260
(63.57%)		 126
(30.81%)		 23
(5.62%)		 0
(0%)
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 409284
(69.44%)		 0
(0%)		 284
(69.44%)		 92
(22.49%)		 29
(7.09%)		 4
(0.98%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 409288
(70.42%)		 0
(0%)		 288
(70.42%)		 0
(0%)		 5
(1.22%)		 0
(0%)
wbo
1.4b
(complete)		 409219
(53.55%)		 0
(0%)		 219
(53.55%)		 0
(0%)		 95
(23.23%)		 94
(22.98%)
wbo
1.4b (fixed)
(complete)		 409214
(52.32%)		 0
(0%)		 214
(52.32%)		 0
(0%)		 167
(40.83%)		 26
(6.36%)

Solver NameProgress
bsolo
3.2 Card
(complete)
done
409
OPT/SAT
217		SAT (TO/MO)
11		?
20
bsolo
3.2 Cl
(complete)
done
409
OPT/SAT
230		SAT (TO/MO)
12		?
13
pb_cplex
2010-06-29
(complete)
done
409
OPT/SAT
134		?
250		ERR
20
PB/CT
0.1
(complete)
done
409
OPT/SAT
194		SAT (TO/MO)
190		?
25
PB/CT
0.1 fixed
(complete)
done
409
OPT/SAT
186		SAT (TO/MO)
198		?
25
PBPASSolver
2010-06-13
(complete)
done
409
OPT/SAT
94		?
310		ERR
5
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
409
OPT/SAT
117		SAT (TO/MO)
232		?
60
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
409
OPT/SAT
250		SAT (TO/MO)
134		?
25
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
409
OPT/SAT
271		SAT (TO/MO)
132		?
6
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)
done
409
OPT/SAT
278		SAT (TO/MO)
94		?
33		ERR
4
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)
done
409
OPT/SAT
260		SAT (TO/MO)
126		?
23
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
409
OPT/SAT
284		SAT (TO/MO)
92		?
29		ERR
4
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
409
OPT/SAT
288		?
5
wbo
1.4b
(complete)
done
409
OPT/SAT
219		?
95		ERR
94
wbo
1.4b (fixed)
(complete)
done
409
OPT/SAT
214		?
167		ERR
26

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
PB/CT
0.1
(complete)		 2192957
(43.66%)		 289
(13.18%)		 668
(30.47%)		 619
(28.24%)		 522
(23.81%)		 94
(4.29%)
PB/CT
0.1 fixed
(complete)		 2192988
(45.07%)		 284
(12.96%)		 704
(32.12%)		 649
(29.61%)		 555
(25.32%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 2192268
(12.23%)		 91
(4.15%)		 177
(8.07%)		 0
(0%)		 1855
(84.63%)		 69
(3.15%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 2192833
(38%)		 224
(10.22%)		 609
(27.78%)		 755
(34.44%)		 604
(27.55%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 21921217
(55.52%)		 316
(14.42%)		 901
(41.1%)		 577
(26.32%)		 392
(17.88%)		 3
(0.14%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 21921164
(53.1%)		 298
(13.59%)		 866
(39.51%)		 635
(28.97%)		 393
(17.93%)		 0
(0%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 21921287
(58.71%)		 344
(15.69%)		 943
(43.02%)		 1
(0.05%)		 436
(19.89%)		 127
(5.79%)

Solver NameProgress
PB/CT
0.1
(complete)
done
2192
UNSAT
289		OPT/SAT
668		SAT (TO/MO)
619		?
522		ERR
94
PB/CT
0.1 fixed
(complete)
done
2192
UNSAT
284		OPT/SAT
704		SAT (TO/MO)
649		?
555
PBPASSolver
2010-06-13
(complete)
done
2192
UNSAT
91		OPT/SAT
177		?
1855		ERR
69
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
2192
UNSAT
224		OPT/SAT
609		SAT (TO/MO)
755		?
604
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
2192
UNSAT
316		OPT/SAT
901		SAT (TO/MO)
577		?
392		ERR
3
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
2192
UNSAT
298		OPT/SAT
866		SAT (TO/MO)
635		?
393
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
2192
UNSAT
344		OPT/SAT
943		SAT (TO/MO)
1		?
436		ERR
127

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATOPT/SATSAT (TO/MO)UNKNOWNBad Answers
borg-pb
10.05.30
(complete)		 552442
(80.07%)		 246
(44.57%)		 196
(35.51%)		 0
(0%)		 61
(11.05%)		 49
(8.88%)
bsolo
3.2 Card
(complete)		 1660991
(59.7%)		 256
(15.42%)		 735
(44.28%)		 23
(1.39%)		 177
(10.66%)		 0
(0%)
bsolo
3.2 Cl
(complete)		 1660939
(56.57%)		 228
(13.73%)		 711
(42.83%)		 25
(1.51%)		 231
(13.92%)		 0
(0%)
pb_cplex
2010-06-29
(complete)		 1660958
(57.71%)		 235
(14.16%)		 723
(43.55%)		 2
(0.12%)		 624
(37.59%)		 31
(1.87%)
PB/CT
0.1
(complete)		 2192957
(43.66%)		 289
(13.18%)		 668
(30.47%)		 619
(28.24%)		 522
(23.81%)		 94
(4.29%)
PB/CT
0.1 fixed
(complete)		 2192988
(45.07%)		 284
(12.96%)		 704
(32.12%)		 649
(29.61%)		 555
(25.32%)		 0
(0%)
PBPASSolver
2010-06-13
(complete)		 2192268
(12.23%)		 91
(4.15%)		 177
(8.07%)		 0
(0%)		 1855
(84.63%)		 69
(3.15%)
PB-wave
alpha 2
(incomplete)		 55291
(16.49%)		 0
(0%)		 91
(16.49%)		 0
(0%)		 461
(83.51%)		 0
(0%)
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		 2192833
(38%)		 224
(10.22%)		 609
(27.78%)		 755
(34.44%)		 604
(27.55%)		 0
(0%)
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		 21921217
(55.52%)		 316
(14.42%)		 901
(41.1%)		 577
(26.32%)		 392
(17.88%)		 3
(0.14%)
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		 21921164
(53.1%)		 298
(13.59%)		 866
(39.51%)		 635
(28.97%)		 393
(17.93%)		 0
(0%)
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		 16601010
(60.84%)		 252
(15.18%)		 758
(45.66%)		 279
(16.81%)		 367
(22.11%)		 4
(0.24%)
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		 1660784
(47.23%)		 173
(10.42%)		 611
(36.81%)		 452
(27.23%)		 424
(25.54%)		 0
(0%)
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 16601021
(61.51%)		 262
(15.78%)		 759
(45.72%)		 280
(16.87%)		 355
(21.39%)		 4
(0.24%)
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		 21921287
(58.71%)		 344
(15.69%)		 943
(43.02%)		 1
(0.05%)		 436
(19.89%)		 127
(5.79%)
wbo
1.4a
(complete)		 552435
(78.8%)		 222
(40.22%)		 213
(38.59%)		 0
(0%)		 117
(21.2%)		 0
(0%)
wbo
1.4b
(complete)		 1108528
(47.65%)		 9
(0.81%)		 519
(46.84%)		 0
(0%)		 401
(36.19%)		 176
(15.88%)
wbo
1.4b (fixed)
(complete)		 1108548
(49.46%)		 30
(2.71%)		 518
(46.75%)		 0
(0%)		 526
(47.47%)		 30
(2.71%)

Solver NameProgress
borg-pb
10.05.30
(complete)
done
552
UNSAT
246		OPT/SAT
196		?
61		ERR
49
bsolo
3.2 Card
(complete)
done
1660
UNSAT
256		OPT/SAT
735		SAT (TO/MO)
23		?
177
bsolo
3.2 Cl
(complete)
done
1660
UNSAT
228		OPT/SAT
711		SAT (TO/MO)
25		?
231
pb_cplex
2010-06-29
(complete)
done
1660
UNSAT
235		OPT/SAT
723		SAT (TO/MO)
2		?
624		ERR
31
PB/CT
0.1
(complete)
done
2192
UNSAT
289		OPT/SAT
668		SAT (TO/MO)
619		?
522		ERR
94
PB/CT
0.1 fixed
(complete)
done
2192
UNSAT
284		OPT/SAT
704		SAT (TO/MO)
649		?
555
PBPASSolver
2010-06-13
(complete)
done
2192
UNSAT
91		OPT/SAT
177		?
1855		ERR
69
PB-wave
alpha 2
(incomplete)
done
552
OPT/SAT
91		?
461
SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)
done
2192
UNSAT
224		OPT/SAT
609		SAT (TO/MO)
755		?
604
SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
done
2192
UNSAT
316		OPT/SAT
901		SAT (TO/MO)
577		?
392		ERR
3
SAT4J PB Resolution
2.2.0 2010-05-26
(complete)
done
2192
UNSAT
298		OPT/SAT
866		SAT (TO/MO)
635		?
393
SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)
done
1660
UNSAT
252		OPT/SAT
758		SAT (TO/MO)
279		?
367		ERR
4
SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)
done
1660
UNSAT
173		OPT/SAT
611		SAT (TO/MO)
452		?
424
SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
1660
UNSAT
262		OPT/SAT
759		SAT (TO/MO)
280		?
355		ERR
4
SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
done
2192
UNSAT
344		OPT/SAT
943		SAT (TO/MO)
1		?
436		ERR
127
wbo
1.4a
(complete)
done
552
UNSAT
222		OPT/SAT
213		?
117
wbo
1.4b
(complete)
done
1108
UNSAT
9		OPT/SAT
519		?
401		ERR
176
wbo
1.4b (fixed)
(complete)
done
1108
UNSAT
30		OPT/SAT
518		?
526		ERR
30

WARNING: 40 jobs are unclassified for solver 1213 in category OPT-BIGINT-LIN/
WARNING: 308 jobs are unclassified for solver 1162 in category OPT-SMALLINT-LIN/
WARNING: 311 jobs are unclassified for solver 1163 in category OPT-SMALLINT-LIN/
WARNING: 40 jobs are unclassified for solver 1209 in category OPT-SMALLINT-LIN/
WARNING: 3 jobs are unclassified for solver 1166 in category OPT-SMALLINT-LIN/
WARNING: 185 jobs are unclassified for solver 1213 in category OPT-SMALLINT-LIN/
WARNING: 2 jobs are unclassified for solver 1161 in category OPT-SMALLINT-LIN/
WARNING: 2 jobs are unclassified for solver 1190 in category OPT-SMALLINT-LIN/
WARNING: 161 jobs are unclassified for solver 1162 in category OPT-SMALLINT-NLC/
WARNING: 154 jobs are unclassified for solver 1163 in category OPT-SMALLINT-NLC/
WARNING: 5 jobs are unclassified for solver 1209 in category OPT-SMALLINT-NLC/
WARNING: 116 jobs are unclassified for solver 1213 in category OPT-SMALLINT-NLC/
WARNING: 1 jobs are unclassified for solver 1161 in category OPT-SMALLINT-NLC/
WARNING: 2 jobs are unclassified for solver 1190 in category OPT-SMALLINT-NLC/
WARNING: 3 jobs are unclassified for solver 1166 in category /
WARNING: 341 jobs are unclassified for solver 1213 in category /
WARNING: 469 jobs are unclassified for solver 1162 in category /
WARNING: 465 jobs are unclassified for solver 1163 in category /
WARNING: 45 jobs are unclassified for solver 1209 in category /
WARNING: 3 jobs are unclassified for solver 1166 in category /
WARNING: 341 jobs are unclassified for solver 1213 in category /
WARNING: 3 jobs are unclassified for solver 1161 in category /
WARNING: 4 jobs are unclassified for solver 1190 in category /