PB'09 competition: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial, subsubcategory UCLID Benchmarks

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial, subsubcategory UCLID Benchmarks

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
BoolVar 2009-04-26 (complete)
bsolo 3.1 (complete)
bsolo 3.1 cl (complete)
bsolo 3.1 pb (complete)
pbclasp 2009-04-24 (complete)
SAT4J Pseudo CP 2.1.1 (complete)
SAT4J Pseudo Resolution 2.1.1 (complete)
SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)
SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
wbo 1.0 (complete)

Bench name	Best results on this instance	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-22s.smv.opb	UNSAT TT=0.139	UNSAT TT=4.788	UNSAT TT=0.969	UNSAT TT=0.963	UNSAT TT=0.963	UNSAT TT=0.371	UNSAT TT=2.457	UNSAT TT=2.423	UNSAT TT=530.552	UNSAT TT=538.227	UNSAT TT=0.139
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-25s.smv.opb	UNSAT TT=0.098	UNSAT TT=3.491	UNSAT TT=0.45	UNSAT TT=0.45	UNSAT TT=0.45	UNSAT TT=0.239	UNSAT TT=2.221	UNSAT TT=2.255	UNSAT TT=138.862	UNSAT TT=1102.55	UNSAT TT=0.098
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-37s.smv.opb	UNSAT TT=0.024	UNSAT TT=0.587	UNSAT TT=0.069	UNSAT TT=0.068	UNSAT TT=0.071	UNSAT TT=0.055	UNSAT TT=1.913	UNSAT TT=1.418	UNSAT TT=39.773	UNSAT TT=52.584	UNSAT TT=0.024
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-43s.smv.opb	UNSAT TT=0.265	UNSAT TT=2.431	UNSAT TT=0.492	UNSAT TT=0.588	UNSAT TT=0.867	UNSAT TT=0.455	UNSAT TT=8.584	UNSAT TT=3.276	? (TO) TT=1800.33	? TT=1799.89	UNSAT TT=0.265
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-44s.smv.opb	UNSAT TT=0.014	UNSAT TT=0.464	UNSAT TT=0.014	UNSAT TT=0.027	UNSAT TT=0.023	UNSAT TT=0.037	UNSAT TT=2.485	UNSAT TT=1.375	UNSAT TT=2.712	UNSAT TT=4.983	UNSAT TT=0.021
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-46s.smv.opb	UNSAT TT=0.055	UNSAT TT=0.943	UNSAT TT=0.161	UNSAT TT=0.185	UNSAT TT=0.168	UNSAT TT=0.105	UNSAT TT=4.278	UNSAT TT=1.917	UNSAT TT=378.096	UNSAT TT=56.99	UNSAT TT=0.055
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-2.ucl.opb	UNSAT TT=0.013	UNSAT TT=0.351	UNSAT TT=0.016	UNSAT TT=0.013	UNSAT TT=0.024	UNSAT TT=0.027	UNSAT TT=5.586	UNSAT TT=1.015	UNSAT TT=0.045	UNSAT TT=0.043	UNSAT TT=0.024
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-3.ucl.opb	UNSAT TT=0.003	UNSAT TT=0.354	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.019	UNSAT TT=0.5	UNSAT TT=0.503	UNSAT TT=0.032	UNSAT TT=0.032	UNSAT TT=0.003
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-4.ucl.opb	UNSAT TT=0.003	UNSAT TT=0.356	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.019	UNSAT TT=0.444	UNSAT TT=0.442	UNSAT TT=0.03	UNSAT TT=0.029	UNSAT TT=0.003
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-6.ucl.opb	UNSAT TT=0.036	UNSAT TT=0.835	UNSAT TT=0.092	UNSAT TT=0.08	UNSAT TT=0.125	UNSAT TT=0.048	UNSAT TT=1.238	UNSAT TT=1.811	UNSAT TT=0.144	UNSAT TT=0.147	UNSAT TT=0.036
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-7.ucl.opb	UNSAT TT=0.042	UNSAT TT=3.248	UNSAT TT=0.052	UNSAT TT=0.052	UNSAT TT=0.053	UNSAT TT=0.113	UNSAT TT=2.175	UNSAT TT=2.194	UNSAT TT=0.793	UNSAT TT=0.786	UNSAT TT=0.042
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-8.ucl.opb	UNSAT TT=0.046	UNSAT TT=3.675	UNSAT TT=0.05	UNSAT TT=0.046	UNSAT TT=0.049	UNSAT TT=0.112	UNSAT TT=2.35	UNSAT TT=2.175	UNSAT TT=0.858	UNSAT TT=0.82	UNSAT TT=0.053
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan2.ucl.opb	UNSAT TT=0.073	UNSAT TT=2.478	UNSAT TT=0.159	UNSAT TT=0.152	UNSAT TT=0.177	UNSAT TT=0.107	UNSAT TT=2.019	UNSAT TT=2.919	UNSAT TT=0.5	UNSAT TT=0.499	UNSAT TT=0.073
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan3.ucl.opb	UNSAT TT=0.365	UNSAT TT=21.364	UNSAT TT=0.384	UNSAT TT=0.383	UNSAT TT=0.384	UNSAT TT=0.921	UNSAT TT=4.03	UNSAT TT=4.087	UNSAT TT=2.488	UNSAT TT=2.492	UNSAT TT=0.365
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl.opb	UNSAT TT=371.789	UNSAT TT=1249.66	UNSAT TT=371.789	? TT=1798.03	? TT=1798.11	? (TO) TT=1800.02	? (TO) TT=1800.28	? (TO) TT=1800.43	? (TO) TT=1802.21	? (TO) TT=1802.26	? (TO) TT=1800.15
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl.opb	UNSAT TT=32.599	UNSAT TT=34.405	UNSAT TT=266.642	UNSAT TT=397.38	UNSAT TT=212.733	UNSAT TT=42.298	UNSAT TT=727.433	UNSAT TT=104.611	? (TO) TT=1802.2	? (TO) TT=1802.22	UNSAT TT=32.599
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Icl2arity.ucl.opb	UNSAT TT=2.387	UNSAT TT=9.979	UNSAT TT=57.716	UNSAT TT=65.394	UNSAT TT=59.253	UNSAT TT=2.533	UNSAT TT=37.95	UNSAT TT=8.279	? TT=1796.71	? TT=1795.73	UNSAT TT=2.387
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih1arity.ucl.opb	UNSAT TT=606.201	? (MO) TT=47.787	UNSAT TT=606.201	? TT=1798.13	? TT=1798.1	? (TO) TT=1800.1	? (TO) TT=1800.28	? (TO) TT=1800.25	? (MO) TT=119.629	? (MO) TT=153.429	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih2arity.ucl.opb	SAT TT=1.905 T1=1.87	SAT TT=90.147 T1=89.96	SAT TT=180.843 T1=180.86	SAT TT=189.812 T1=189.84	SAT TT=181.488 T1=181.51	SAT TT=4.128 T1=3.24	SAT TT=9.531 T1=7	SAT TT=8.681 T1=6.85	? (TO) TT=1802.18	? (TO) TT=1802.22	SAT TT=1.905 T1=1.87
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv10.ucl.opb	UNSAT TT=0.12	UNSAT TT=2.393	UNSAT TT=0.194	UNSAT TT=0.196	UNSAT TT=0.18	UNSAT TT=0.351	UNSAT TT=2.216	UNSAT TT=2.419	UNSAT TT=195.905	UNSAT TT=178.783	UNSAT TT=0.12
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv12.ucl.opb	UNSAT TT=9.679	UNSAT TT=9.679	UNSAT TT=68.982	UNSAT TT=115.651	UNSAT TT=106.771	UNSAT TT=10.438	? (TO) TT=1800.2	UNSAT TT=33.338	? TT=1798.26	? TT=1795.71	UNSAT TT=24.611
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv14.ucl.opb	UNSAT TT=354.115	UNSAT TT=867.379	UNSAT TT=354.115	? TT=1798.09	? TT=1798.21	? (TO) TT=1800.06	? (TO) TT=1800.2	? (TO) TT=1800.35	? TT=1799.45	? (TO) TT=1802.15	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv8.ucl.opb	UNSAT TT=0.029	UNSAT TT=0.785	UNSAT TT=0.032	UNSAT TT=0.031	UNSAT TT=0.032	UNSAT TT=0.089	UNSAT TT=1.205	UNSAT TT=1.208	UNSAT TT=0.427	UNSAT TT=0.427	UNSAT TT=0.029
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl.opb	UNSAT TT=0.407	UNSAT TT=2.38	UNSAT TT=4.069	UNSAT TT=3.748	UNSAT TT=4.217	UNSAT TT=0.535	UNSAT TT=4.404	UNSAT TT=3.999	? (TO) TT=1800.38	? TT=1795.89	UNSAT TT=0.407
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem.ucl.opb	UNSAT TT=0.544	UNSAT TT=2.972	UNSAT TT=7.192	UNSAT TT=7.18	UNSAT TT=6.977	UNSAT TT=0.642	UNSAT TT=4.752	UNSAT TT=4.172	? (TO) TT=1800.33	? TT=1795.8	UNSAT TT=0.544
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.ucl.opb	UNSAT TT=0.226	UNSAT TT=2.073	UNSAT TT=2.444	UNSAT TT=2.321	UNSAT TT=2.753	UNSAT TT=0.369	UNSAT TT=9.189	UNSAT TT=3.444	UNSAT TT=543.928	UNSAT TT=1303.35	UNSAT TT=0.226
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf10.ucl.opb	UNSAT TT=6.26	UNSAT TT=20.18	UNSAT TT=164.359	UNSAT TT=158.532	UNSAT TT=166.6	UNSAT TT=6.26	UNSAT TT=28.284	UNSAT TT=11.341	? (TO) TT=1800.17	? TT=1799.92	UNSAT TT=6.778
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf6.ucl.opb	UNSAT TT=0.001	UNSAT TT=0.178	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.017	UNSAT TT=0.346	UNSAT TT=0.328	UNSAT TT=0.029	UNSAT TT=0.031	UNSAT TT=0.003
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf7.ucl.opb	UNSAT TT=0.021	UNSAT TT=0.631	UNSAT TT=0.091	UNSAT TT=0.092	UNSAT TT=0.092	UNSAT TT=0.055	UNSAT TT=1.327	UNSAT TT=1.17	UNSAT TT=21.62	UNSAT TT=29.456	UNSAT TT=0.021
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf8.ucl.opb	UNSAT TT=0.124	UNSAT TT=2.023	UNSAT TT=1.229	UNSAT TT=1.218	UNSAT TT=1.231	UNSAT TT=0.245	UNSAT TT=2.784	UNSAT TT=2.498	UNSAT TT=154.914	UNSAT TT=273.718	UNSAT TT=0.124
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf9.ucl.opb	UNSAT TT=0.737	UNSAT TT=6.46	UNSAT TT=18	UNSAT TT=17.899	UNSAT TT=18.072	UNSAT TT=1.103	UNSAT TT=5.57	UNSAT TT=4.273	? TT=1798.96	? TT=1796.99	UNSAT TT=0.737
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.2.accl.ucl.opb	UNSAT TT=1.278	UNSAT TT=1.774	UNSAT TT=1.444	UNSAT TT=4.713	UNSAT TT=5.927	UNSAT TT=1.278	UNSAT TT=568.782	UNSAT TT=6.109	? (TO) TT=1800.48	UNSAT TT=1563.18	UNSAT TT=1.561
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.3.accl.ucl.opb	UNSAT TT=2.525	UNSAT TT=4.927	UNSAT TT=2.525	UNSAT TT=17.297	UNSAT TT=30.113	UNSAT TT=3.506	UNSAT TT=1450.01	UNSAT TT=13.096	? (TO) TT=1800.35	? TT=1797.94	UNSAT TT=5.288
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.4.accl.ucl.opb	UNSAT TT=0.262	UNSAT TT=1.86	UNSAT TT=0.43	UNSAT TT=0.402	UNSAT TT=0.433	UNSAT TT=0.262	UNSAT TT=2.913	UNSAT TT=2.367	UNSAT TT=191.864	UNSAT TT=232.965	UNSAT TT=0.28
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.6.accl.ucl.opb	UNSAT TT=130.554	? (TO) TT=1800.09	UNSAT TT=130.554	? TT=1798.19	? TT=1798.21	? (TO) TT=1800.04	? (TO) TT=1800.31	? (TO) TT=1800.48	? TT=1798.9	? TT=1795.33	? (MO) TT=1407.44
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.8.accl.ucl.opb	UNSAT TT=74.257	UNSAT TT=610.698	UNSAT TT=74.257	? TT=1798.09	? TT=1798.19	UNSAT TT=384.105	? (TO) TT=1800.23	UNSAT TT=859.407	? TT=1797.34	? TT=1794.98	? (TO) TT=1800.27
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.RobRegValid_bar.ucl.opb	UNSAT TT=61.669	UNSAT TT=97.363	UNSAT TT=155.892	UNSAT TT=376.163	UNSAT TT=620.841	UNSAT TT=954.181	? (TO) TT=1800.29	UNSAT TT=78.058	? (TO) TT=1800.1	? TT=1798.72	UNSAT TT=61.669
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl.opb	UNSAT TT=306.9	? (MO) TT=37.133	UNSAT TT=306.9	? TT=1798.1	? TT=1798.23	? (TO) TT=1800.05	? (TO) TT=1800.28	? (TO) TT=1800.48	? (TO) TT=1802.25	? (TO) TT=1802.3	UNSAT TT=948.922
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl.opb	UNSAT TT=324.171	? (MO) TT=319.2	UNSAT TT=324.171	? TT=1798.07	? TT=1798.15	? (TO) TT=1800	? (TO) TT=1800.25	? (TO) TT=1800.5	? (TO) TT=1802.23	? (TO) TT=1802.22	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LsqHdStrong.ucl.opb	UNSAT TT=383.07	? (MO) TT=44.2	UNSAT TT=383.07	? TT=1798.06	? TT=1798.05	? (TO) TT=1800.06	? (TO) TT=1800.35	? (TO) TT=1800.37	? (MO) TT=127.901	? (MO) TT=268.757	? (TO) TT=1800.18
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf10.ucl.opb	UNSAT TT=11.592	UNSAT TT=11.592	UNSAT TT=354.596	UNSAT TT=133.589	UNSAT TT=211.616	UNSAT TT=12.015	UNSAT TT=563.231	UNSAT TT=48.915	? TT=1797.81	? TT=1794.93	UNSAT TT=35.616
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf6.ucl.opb	UNSAT TT=0.043	UNSAT TT=0.7	UNSAT TT=0.195	UNSAT TT=0.243	UNSAT TT=0.195	UNSAT TT=0.08	UNSAT TT=2.026	UNSAT TT=1.954	UNSAT TT=51.605	UNSAT TT=88.329	UNSAT TT=0.043
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf7.ucl.opb	UNSAT TT=0.132	UNSAT TT=1.277	UNSAT TT=0.89	UNSAT TT=1.275	UNSAT TT=0.911	UNSAT TT=0.185	UNSAT TT=4.373	UNSAT TT=2.832	UNSAT TT=203.884	UNSAT TT=227.965	UNSAT TT=0.132
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf8.ucl.opb	UNSAT TT=0.577	UNSAT TT=2.573	UNSAT TT=4.539	UNSAT TT=7.38	UNSAT TT=5.056	UNSAT TT=0.579	UNSAT TT=9.364	UNSAT TT=4.27	? (TO) TT=1800.56	? TT=1796.04	UNSAT TT=0.577
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf9.ucl.opb	UNSAT TT=1.839	UNSAT TT=3.694	UNSAT TT=25.824	UNSAT TT=28.041	UNSAT TT=30.08	UNSAT TT=1.839	UNSAT TT=24.357	UNSAT TT=16.697	? (TO) TT=1800.38	? TT=1796.94	UNSAT TT=3.135
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag10.ucl.opb	UNSAT TT=2.834	UNSAT TT=2.834	UNSAT TT=11.268	UNSAT TT=59.51	UNSAT TT=16.481	UNSAT TT=3.994	? (TO) TT=1800.18	UNSAT TT=33.735	? TT=1799.87	? TT=1794.86	UNSAT TT=28.319
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag12.ucl.opb	UNSAT TT=6.494	UNSAT TT=6.494	UNSAT TT=163.691	UNSAT TT=476.505	UNSAT TT=71.602	UNSAT TT=14.57	? (TO) TT=1800.23	UNSAT TT=150.707	? TT=1797.68	? TT=1794.97	UNSAT TT=135.486
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag14.ucl.opb	UNSAT TT=22.008	UNSAT TT=22.008	? TT=1798.06	UNSAT TT=1357.5	UNSAT TT=734.276	UNSAT TT=37.634	? (TO) TT=1800.22	UNSAT TT=530.384	? TT=1797.73	? TT=1799.17	? (TO) TT=1800.12
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag8.ucl.opb	UNSAT TT=0.438	UNSAT TT=1.332	UNSAT TT=6.017	UNSAT TT=4.438	UNSAT TT=1.362	UNSAT TT=0.438	UNSAT TT=580.757	UNSAT TT=6.266	? (TO) TT=1800.1	UNSAT TT=327.843	UNSAT TT=2.714
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.unbounded.all.ucl.opb	UNSAT TT=293.39	UNSAT TT=293.39	UNSAT TT=521.168	? TT=1798.04	? TT=1798.27	? (TO) TT=1800.09	? (TO) TT=1800.31	UNSAT TT=1609.61	? (TO) TT=1802.19	? (TO) TT=1802.23	UNSAT TT=968.691

Statistics		BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
Number of times the solver is able to give the best known answer		45	49	41	41	42	36	43	22	24	42
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		6	10	3	0	5	0	0	0	0	26