PB'10 competition: satisfaction and optimization track: ranking of solvers

This page presents the ranking of the different solvers. Solvers are ranked on the number of solved instances. Ties are broken by considering the minimum total solution time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

The Virtual Best Solver (VBS) is a theoretical construction which returns the best answer provided by one of the submitted solver. It corresponds to the 'Best result' column in the bench per bench view of the results. It can be considered as a meta solver which uses a perfect oracle to guess instantaneously which of the submitted solver will be the most efficient to solve the instance. Another way to look at it is to consider this VBS as a solver which would run all other solvers in parallel, bringing together all the solvers strenghs. This VBS is essentially the same notion as State Of The Art (SOTA) solver defined in "Evaluating general purpose automated theorem proving systems", Artificial Intelligence, Volume 131, Issues 1-2, September 2001, Pages 39-54 Geoff Sutcliffe, Christian Suttner. However, SOTA is a more general notion: the VBS can be seen as the least powerful SOTA solver.

Category "no optimisation, small integers, linear constraints" (DEC-SMALLINT-LIN): SAT+UNSAT answers

Rank	Solver	Version	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 452
Virtual Best Solver (VBS)			432	180 SAT, 252 UNSAT	96%	100%	18241.79	42.23
1	borg-pb	10.05.30	415	179 SAT, 236 UNSAT	92%	96%	38544.74	92.88
2	SAT4J PB RES // CP	2.2.0 2010-05-31	382	173 SAT, 209 UNSAT	85%	88%	31891.63	83.49
3	bsolo	3.2 Card	380	172 SAT, 208 UNSAT	84%	88%	50981.11	134.16
4	wbo	1.4a	378	171 SAT, 207 UNSAT	84%	88%	27704.32	73.29
5	PB/CT	0.1 fixed	369	164 SAT, 205 UNSAT	82%	85%	35145.84	95.25
6	SAT4J PB Resolution	2.2.0 2010-05-26	367	174 SAT, 193 UNSAT	81%	85%	46664.10	127.15
7	bsolo	3.2 Cl	355	170 SAT, 185 UNSAT	79%	82%	61733.63	173.90
8	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	351	139 SAT, 212 UNSAT	78%	81%	62141.26	177.04
9	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	351	141 SAT, 210 UNSAT	78%	81%	65260.84	185.93
10	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	344	144 SAT, 200 UNSAT	76%	80%	54632.83	158.82
11	pb_cplex	2010-06-29	337	155 SAT, 182 UNSAT	75%	78%	39196.42	116.31
12	SCIPnone	SCIP 1.2.1.2 without any LP solver	288	154 SAT, 134 UNSAT	64%	67%	53015.70	184.08
13	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	228	106 SAT, 122 UNSAT	50%	53%	25513.09	111.90
14	PB-wave	alpha 2	66	66 SAT	15%	15%	7400.95	112.14

Category "no optimisation, small integers, linear constraints" (DEC-SMALLINT-LIN): SAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 452
Virtual Best Solver (VBS)			180	40%	100%	2818.12	15.66
1	borg-pb	10.05.30	179	40%	99%	4865.19	27.18
2	SAT4J PB Resolution	2.2.0 2010-05-26	174	38%	97%	5484.02	31.52
3	SAT4J PB RES // CP	2.2.0 2010-05-31	173	38%	96%	4583.74	26.50
4	bsolo	3.2 Card	172	38%	96%	7202.65	41.88
5	wbo	1.4a	171	38%	95%	2626.58	15.36
6	bsolo	3.2 Cl	170	38%	94%	6568.04	38.64
7	PB/CT	0.1 fixed	164	36%	91%	7973.53	48.62
8	pb_cplex	2010-06-29	155	34%	86%	8761.56	56.53
9	SCIPnone	SCIP 1.2.1.2 without any LP solver	154	34%	86%	25547.99	165.90
10	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	144	32%	80%	10507.84	72.97
11	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	141	31%	78%	13582.96	96.33
12	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	139	31%	77%	11901.46	85.62
13	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	106	23%	59%	13708.38	129.32
14	PB-wave	alpha 2	66	15%	37%	7400.95	112.14

Category "no optimisation, small integers, linear constraints" (DEC-SMALLINT-LIN): UNSAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 452
Virtual Best Solver (VBS)			252	56%	100%	15423.67	61.21
1	borg-pb	10.05.30	236	52%	94%	33679.55	142.71
2	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	212	47%	84%	50239.80	236.98
3	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	210	46%	83%	51677.88	246.09
4	SAT4J PB RES // CP	2.2.0 2010-05-31	209	46%	83%	27307.89	130.66
5	bsolo	3.2 Card	208	46%	83%	43778.46	210.47
6	wbo	1.4a	207	46%	82%	25077.74	121.15
7	PB/CT	0.1 fixed	205	45%	81%	27172.30	132.55
8	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	200	44%	79%	44124.99	220.62
9	SAT4J PB Resolution	2.2.0 2010-05-26	193	43%	77%	41180.08	213.37
10	bsolo	3.2 Cl	185	41%	73%	55165.59	298.19
11	pb_cplex	2010-06-29	182	40%	72%	30434.85	167.22
12	SCIPnone	SCIP 1.2.1.2 without any LP solver	134	30%	53%	27467.71	204.98
13	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	122	27%	48%	11804.71	96.76
14	PB-wave	alpha 2	0	0%	0%	0.00	-

Category "no optimisation, small integers, non linear constraints" (DEC-SMALLINT-NLC): SAT+UNSAT answers

Rank	Solver	Version	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 100
Virtual Best Solver (VBS)			70	50 SAT, 20 UNSAT	70%	100%	1356.15	19.37
1	pb_cplex	2010-06-29	70	50 SAT, 20 UNSAT	70%	100%	1406.26	20.09
2	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	70	50 SAT, 20 UNSAT	70%	100%	11994.98	171.36
3	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	69	50 SAT, 19 UNSAT	69%	99%	8482.10	122.93
4	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	69	50 SAT, 19 UNSAT	69%	99%	11303.51	163.82
5	SAT4J PB RES // CP	2.2.0 2010-05-31	65	50 SAT, 15 UNSAT	65%	93%	4362.98	67.12
6	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	65	50 SAT, 15 UNSAT	65%	93%	4630.45	71.24
7	PB/CT	0.1	65	50 SAT, 15 UNSAT	65%	93%	8247.30	126.88
8	PB/CT	0.1 fixed	63	50 SAT, 13 UNSAT	63%	90%	5300.45	84.13
9	bsolo	3.2 Card	61	46 SAT, 15 UNSAT	61%	87%	4592.19	75.28
10	wbo	1.4a	57	42 SAT, 15 UNSAT	57%	81%	5931.80	104.07
11	SCIPnone	SCIP 1.2.1.2 without any LP solver	49	39 SAT, 10 UNSAT	49%	70%	1115.08	22.76
12	borg-pb	10.05.30	27	17 SAT, 10 UNSAT	27%	39%	6266.28	232.08
13	bsolo	3.2 Cl	26	16 SAT, 10 UNSAT	26%	37%	4905.10	188.66
14	PB-wave	alpha 2	25	25 SAT	25%	36%	6.91	0.28
15	SAT4J PB Resolution	2.2.0 2010-05-26	25	10 SAT, 15 UNSAT	25%	36%	6419.25	256.77

Category "no optimisation, small integers, non linear constraints" (DEC-SMALLINT-NLC): SAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 100
Virtual Best Solver (VBS)			50	50%	100%	56.38	1.13
1	pb_cplex	2010-06-29	50	50%	100%	106.27	2.13
2	PB/CT	0.1 fixed	50	50%	100%	306.68	6.13
3	PB/CT	0.1	50	50%	100%	325.60	6.51
4	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	50	50%	100%	1341.60	26.83
5	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	50	50%	100%	3330.68	66.61
6	SAT4J PB RES // CP	2.2.0 2010-05-31	50	50%	100%	3451.98	69.04
7	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	50	50%	100%	3996.30	79.93
8	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	50	50%	100%	4185.78	83.72
9	bsolo	3.2 Card	46	46%	92%	2025.40	44.03
10	wbo	1.4a	42	42%	84%	2087.45	49.70
11	SCIPnone	SCIP 1.2.1.2 without any LP solver	39	39%	78%	1114.30	28.57
12	PB-wave	alpha 2	25	25%	50%	6.91	0.28
13	borg-pb	10.05.30	17	17%	34%	3909.48	229.97
14	bsolo	3.2 Cl	16	16%	32%	4905.05	306.57
15	SAT4J PB Resolution	2.2.0 2010-05-26	10	10%	20%	501.34	50.13

Category "no optimisation, small integers, non linear constraints" (DEC-SMALLINT-NLC): UNSAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 100
Virtual Best Solver (VBS)			20	20%	100%	1299.77	64.99
1	pb_cplex	2010-06-29	20	20%	100%	1299.99	65.00
2	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	20	20%	100%	8664.30	433.22
3	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	19	19%	95%	7140.50	375.82
4	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	19	19%	95%	7307.20	384.59
5	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	15	15%	75%	444.67	29.64
6	SAT4J PB RES // CP	2.2.0 2010-05-31	15	15%	75%	911.00	60.73
7	bsolo	3.2 Card	15	15%	75%	2566.78	171.12
8	wbo	1.4a	15	15%	75%	3844.35	256.29
9	SAT4J PB Resolution	2.2.0 2010-05-26	15	15%	75%	5917.91	394.53
10	PB/CT	0.1	15	15%	75%	7921.70	528.11
11	PB/CT	0.1 fixed	13	13%	65%	4993.78	384.14
12	bsolo	3.2 Cl	10	10%	50%	0.05	0.00
13	SCIPnone	SCIP 1.2.1.2 without any LP solver	10	10%	50%	0.78	0.08
14	borg-pb	10.05.30	10	10%	50%	2356.80	235.68
15	PB-wave	alpha 2	0	0%	0%	0.00	-

Category "optimisation, big integers, linear constraints" (OPT-BIGINT-LIN): OPT+UNSAT answers

Rank	Solver	Version	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 532
Virtual Best Solver (VBS)			211	152 OPT, 59 UNSAT	40%	100%	14601.27	69.20
1	SAT4J PB RES // CP	2.2.0 2010-05-31	205	146 OPT, 59 UNSAT	39%	97%	23603.19	115.14
2	SAT4J PB Resolution	2.2.0 2010-05-26	198	141 OPT, 57 UNSAT	37%	94%	15088.39	76.20
3	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	168	110 OPT, 58 UNSAT	32%	80%	6182.48	36.80
4	PB/CT	0.1 fixed	87	53 OPT, 34 UNSAT	16%	41%	11035.46	126.84

Category "optimisation, big integers, linear constraints" (OPT-BIGINT-LIN): OPT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 532
Virtual Best Solver (VBS)			152	29%	100%	14281.25	93.96
1	SAT4J PB RES // CP	2.2.0 2010-05-31	146	27%	96%	23118.22	158.34
2	SAT4J PB Resolution	2.2.0 2010-05-26	141	27%	93%	14762.21	104.70
3	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	110	21%	72%	5752.74	52.30
4	PB/CT	0.1 fixed	53	10%	35%	6700.38	126.42

Category "optimisation, big integers, linear constraints" (OPT-BIGINT-LIN): UNSAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 532
Virtual Best Solver (VBS)			59	11%	100%	320.03	5.42
1	SAT4J PB RES // CP	2.2.0 2010-05-31	59	11%	100%	484.98	8.22
2	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	58	11%	98%	429.74	7.41
3	SAT4J PB Resolution	2.2.0 2010-05-26	57	11%	97%	326.18	5.72
4	PB/CT	0.1 fixed	34	6%	58%	4335.09	127.50

Category "optimisation, small integers, linear constraints" (OPT-SMALLINT-LIN): OPT+UNSAT answers

Rank	Solver	Version	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 699
Virtual Best Solver (VBS)			472	439 OPT, 33 UNSAT	68%	100%	19877.90	42.11
1	pb_cplex	2010-06-29	417	384 OPT, 33 UNSAT	60%	88%	37700.68	90.41
2	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	354	321 OPT, 33 UNSAT	51%	75%	45520.92	128.59
3	bsolo	3.2 Card	333	300 OPT, 33 UNSAT	48%	71%	47182.34	141.69
4	bsolo	3.2 Cl	328	295 OPT, 33 UNSAT	47%	69%	42827.61	130.57
5	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	319	286 OPT, 33 UNSAT	46%	68%	25689.98	80.53
6	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	317	284 OPT, 33 UNSAT	45%	67%	24202.46	76.35
7	SAT4J PB RES // CP	2.2.0 2010-05-31	315	282 OPT, 33 UNSAT	45%	67%	29160.61	92.57
8	SAT4J PB Resolution	2.2.0 2010-05-26	303	270 OPT, 33 UNSAT	43%	64%	14709.64	48.55
9	PB/CT	0.1 fixed	283	251 OPT, 32 UNSAT	40%	60%	25446.64	89.92
10	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	255	226 OPT, 29 UNSAT	36%	54%	29801.79	116.87
11	SCIPnone	SCIP 1.2.1.2 without any LP solver	187	158 OPT, 29 UNSAT	27%	40%	26322.18	140.76

Category "optimisation, small integers, linear constraints" (OPT-SMALLINT-LIN): OPT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 699
Virtual Best Solver (VBS)			439	63%	100%	19500.50	44.42
1	pb_cplex	2010-06-29	384	55%	87%	36911.59	96.12
2	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	321	46%	73%	42813.11	133.37
3	bsolo	3.2 Card	300	43%	68%	45682.24	152.27
4	bsolo	3.2 Cl	295	42%	67%	41779.56	141.63
5	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	286	41%	65%	23759.85	83.08
6	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	284	41%	65%	21417.81	75.41
7	SAT4J PB RES // CP	2.2.0 2010-05-31	282	40%	64%	27689.06	98.19
8	SAT4J PB Resolution	2.2.0 2010-05-26	270	39%	62%	13976.24	51.76
9	PB/CT	0.1 fixed	251	36%	57%	22820.96	90.92
10	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	226	32%	51%	29751.47	131.64
11	SCIPnone	SCIP 1.2.1.2 without any LP solver	158	23%	36%	24833.05	157.17

Category "optimisation, small integers, linear constraints" (OPT-SMALLINT-LIN): UNSAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 699
Virtual Best Solver (VBS)			33	5%	100%	377.40	11.44
1	SAT4J PB Resolution	2.2.0 2010-05-26	33	5%	100%	733.41	22.22
2	pb_cplex	2010-06-29	33	5%	100%	789.09	23.91
3	bsolo	3.2 Cl	33	5%	100%	1048.05	31.76
4	SAT4J PB RES // CP	2.2.0 2010-05-31	33	5%	100%	1471.55	44.59
5	bsolo	3.2 Card	33	5%	100%	1500.10	45.46
6	SCIPclp	SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver	33	5%	100%	1930.13	58.49
7	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	33	5%	100%	2707.81	82.05
8	SCIPspx	SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	33	5%	100%	2784.65	84.38
9	PB/CT	0.1 fixed	32	5%	97%	2625.68	82.05
10	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	29	4%	88%	50.32	1.74
11	SCIPnone	SCIP 1.2.1.2 without any LP solver	29	4%	88%	1489.14	51.35

Category "optimisation, small integers, non linear constraints" (OPT-SMALLINT-NLC): OPT+UNSAT answers

Rank	Solver	Version	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 409
Virtual Best Solver (VBS)			289	289 OPT	71%	100%	14768.57	51.10
1	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	288	288 OPT	70%	100%	14279.54	49.58
2	SAT4J PB Resolution	2.2.0 2010-05-26	271	271 OPT	66%	94%	35154.59	129.72
3	SCIPnone	SCIP 1.2.1.2 without any LP solver	260	260 OPT	64%	90%	35886.35	138.02
4	SAT4J PB RES // CP	2.2.0 2010-05-31	250	250 OPT	61%	87%	32638.71	130.55
5	bsolo	3.2 Cl	230	230 OPT	56%	80%	28395.38	123.46
6	bsolo	3.2 Card	217	217 OPT	53%	75%	25679.76	118.34
7	PB/CT	0.1	194	194 OPT	47%	67%	45145.12	232.71
8	PB/CT	0.1 fixed	186	186 OPT	45%	64%	41362.89	222.38
9	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	117	117 OPT	29%	40%	19379.60	165.64

Category "optimisation, small integers, non linear constraints" (OPT-SMALLINT-NLC): OPT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 409
Virtual Best Solver (VBS)			289	71%	100%	14768.57	51.10
1	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	288	70%	100%	14279.54	49.58
2	SAT4J PB Resolution	2.2.0 2010-05-26	271	66%	94%	35154.59	129.72
3	SCIPnone	SCIP 1.2.1.2 without any LP solver	260	64%	90%	35886.35	138.02
4	SAT4J PB RES // CP	2.2.0 2010-05-31	250	61%	87%	32638.71	130.55
5	bsolo	3.2 Cl	230	56%	80%	28395.38	123.46
6	bsolo	3.2 Card	217	53%	75%	25679.76	118.34
7	PB/CT	0.1	194	47%	67%	45145.12	232.71
8	PB/CT	0.1 fixed	186	45%	64%	41362.89	222.38
9	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	117	29%	40%	19379.60	165.64

Category "optimisation, small integers, non linear constraints" (OPT-SMALLINT-NLC): UNSAT answers

Rank	Solver	Version	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Average CPU time per solved instance
Total number of instances in the category: 409
Virtual Best Solver (VBS)			0	0%	-	0.00	-
1	bsolo	3.2 Card	0	0%	-	0.00	-
2	bsolo	3.2 Cl	0	0%	-	0.00	-
3	SAT4J PB Resolution	2.2.0 2010-05-26	0	0%	-	0.00	-
4	SAT4J PB CuttingPlanes	2.2.0 2010-05-26	0	0%	-	0.00	-
5	SAT4J PB RES // CP	2.2.0 2010-05-31	0	0%	-	0.00	-
6	SCIPnone	SCIP 1.2.1.2 without any LP solver	0	0%	-	0.00	-
7	PB/CT	0.1	0	0%	-	0.00	-
8	PB/CT	0.1 fixed	0	0%	-	0.00	-
9	SCIPspx	SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver	0	0%	-	0.00	-