PB'09 competition: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
BoolVar 2009-04-26 (complete)
bsolo 3.1 (complete)
bsolo 3.1 cl (complete)
bsolo 3.1 pb (complete)
pbclasp 2009-04-24 (complete)
SAT4J Pseudo CP 2.1.1 (complete)
SAT4J Pseudo Resolution 2.1.1 (complete)
SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)
SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
wbo 1.0 (complete)

Bench name	Best results on this instance	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_11_pb.cnf.cr.opb	UNSAT TT=0.007	UNSAT TT=22.247	UNSAT TT=0.007	UNSAT TT=147.349	UNSAT TT=3.972	UNSAT TT=119.432	UNSAT TT=0.361	UNSAT TT=231.335	UNSAT TT=0.032	UNSAT TT=0.034	UNSAT TT=337.337
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_15_pb.cnf.cr.opb	UNSAT TT=0.008	UNSAT TT=318.64	UNSAT TT=0.009	UNSAT TT=422.903	UNSAT TT=0.008	UNSAT TT=127.133	UNSAT TT=0.361	? (TO) TT=1800.41	UNSAT TT=0.034	UNSAT TT=0.038	? (TO) TT=1800.2
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_20_pb.cnf.cr.opb	UNSAT TT=0.01	UNSAT TT=289.527	UNSAT TT=0.01	? TT=1798	UNSAT TT=0.011	UNSAT TT=139.5	UNSAT TT=0.405	? (TO) TT=1800.44	UNSAT TT=0.037	UNSAT TT=0.042	? (TO) TT=1800.18
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_16_pb.cnf.cr.opb	UNSAT TT=0.017	? (TO) TT=1800.13	UNSAT TT=0.017	? TT=1798.01	UNSAT TT=0.068	? (TO) TT=1800.03	UNSAT TT=0.518	? (TO) TT=1800.42	UNSAT TT=0.04	UNSAT TT=0.043	? (TO) TT=1800.2
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_20_pb.cnf.cr.opb	UNSAT TT=0.023	? (TO) TT=1800.07	UNSAT TT=0.023	? TT=1798.01	UNSAT TT=0.066	? (TO) TT=1800.04	UNSAT TT=0.462	? (TO) TT=1800.34	UNSAT TT=0.045	UNSAT TT=0.048	? (TO) TT=1800.2
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr.opb	UNSAT TT=0.026	? (TO) TT=1800.05	UNSAT TT=0.026	? TT=1798.03	UNSAT TT=0.071	? (TO) TT=1800.11	UNSAT TT=0.516	? (TO) TT=1800.37	UNSAT TT=0.047	UNSAT TT=0.059	? (TO) TT=1800.26
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_21_pb.cnf.cr.opb	UNSAT TT=0.041	? (TO) TT=1800.13	UNSAT TT=0.042	? TT=1798.04	UNSAT TT=0.041	? (TO) TT=1800.1	UNSAT TT=0.687	? (TO) TT=1800.4	UNSAT TT=0.053	UNSAT TT=0.061	? (TO) TT=1800.18
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_25_pb.cnf.cr.opb	UNSAT TT=0.039	? (TO) TT=1800.1	UNSAT TT=0.039	? TT=1798.04	UNSAT TT=0.238	? (TO) TT=1800.09	UNSAT TT=0.558	? (TO) TT=1800.37	UNSAT TT=0.055	UNSAT TT=0.069	? (TO) TT=1800.16
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_30_pb.cnf.cr.opb	UNSAT TT=0.052	? (TO) TT=1800.07	UNSAT TT=0.052	? TT=1798.05	UNSAT TT=0.411	? (TO) TT=1800.08	UNSAT TT=0.665	? (TO) TT=1800.36	UNSAT TT=0.063	UNSAT TT=0.079	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_31_pb.cnf.cr.opb	UNSAT TT=0.092	? (TO) TT=1800.13	UNSAT TT=0.114	? TT=1798.14	UNSAT TT=0.097	? (TO) TT=1800.11	UNSAT TT=1.299	? (TO) TT=1800.4	UNSAT TT=0.092	UNSAT TT=0.113	? (TO) TT=1800.19
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_35_pb.cnf.cr.opb	UNSAT TT=0.1	? (TO) TT=1800.15	UNSAT TT=0.125	? TT=1798.16	UNSAT TT=0.126	? (TO) TT=1800.12	UNSAT TT=0.819	? (TO) TT=1800.42	UNSAT TT=0.1	UNSAT TT=0.133	? (TO) TT=1800.31
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_40_pb.cnf.cr.opb	UNSAT TT=0.108	? (MO) TT=308.988	UNSAT TT=0.184	? TT=1798.13	UNSAT TT=0.214	? (TO) TT=1800.11	UNSAT TT=0.843	? (TO) TT=1800.42	UNSAT TT=0.108	UNSAT TT=0.139	? (TO) TT=1800.21
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_36_pb.cnf.cr.opb	UNSAT TT=0.123	? (MO) TT=101.715	UNSAT TT=0.186	? TT=1798.41	UNSAT TT=0.166	? (TO) TT=1800.04	UNSAT TT=1.688	? (TO) TT=1800.44	UNSAT TT=0.123	UNSAT TT=0.149	? (TO) TT=1800.26
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_40_pb.cnf.cr.opb	UNSAT TT=0.131	? (MO) TT=93.108	UNSAT TT=0.306	? TT=1798.37	UNSAT TT=0.396	? (TO) TT=1800.05	UNSAT TT=1.053	? (TO) TT=1800.44	UNSAT TT=0.131	UNSAT TT=0.157	? (TO) TT=1800.24
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_45_pb.cnf.cr.opb	UNSAT TT=0.139	? (MO) TT=172.651	UNSAT TT=0.223	? TT=1798.19	UNSAT TT=1.031	? (TO) TT=1800.06	UNSAT TT=1.074	? (TO) TT=1800.41	UNSAT TT=0.139	UNSAT TT=0.171	? (TO) TT=1800.25
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_41_pb.cnf.cr.opb	UNSAT TT=0.161	? (MO) TT=38.912	UNSAT TT=0.293	? TT=1798.32	UNSAT TT=0.887	? (TO) TT=1800.13	UNSAT TT=1.85	? (TO) TT=1800.45	UNSAT TT=0.161	UNSAT TT=0.183	? (TO) TT=1800.35
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_45_pb.cnf.cr.opb	UNSAT TT=0.174	? (MO) TT=76.21	UNSAT TT=0.279	? TT=1798.26	UNSAT TT=1.839	? (TO) TT=1800.06	UNSAT TT=1.124	? (TO) TT=1800.38	UNSAT TT=0.174	UNSAT TT=0.211	? (TO) TT=1800.29
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_50_pb.cnf.cr.opb	UNSAT TT=0.199	? (MO) TT=638.054	UNSAT TT=0.371	? TT=1798.32	UNSAT TT=1.566	? (TO) TT=1800.06	UNSAT TT=1.166	? (TO) TT=1800.6	UNSAT TT=0.199	UNSAT TT=0.229	? (TO) TT=1800.27
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_51_pb.cnf.cr.opb	UNSAT TT=0.272	? (MO) TT=99.574	UNSAT TT=0.644	? (MO) TT=1170.09	UNSAT TT=12.873	? (TO) TT=1800.11	UNSAT TT=2.379	? (TO) TT=1800.41	UNSAT TT=0.272	UNSAT TT=0.301	? (TO) TT=1800.36
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_55_pb.cnf.cr.opb	UNSAT TT=0.297	? (MO) TT=173.527	UNSAT TT=0.897	? (MO) TT=1290.24	? TT=1798.43	? (TO) TT=1800.08	UNSAT TT=1.697	? (TO) TT=1800.46	UNSAT TT=0.297	UNSAT TT=0.317	? (TO) TT=1800.33
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_60_pb.cnf.cr.opb	UNSAT TT=0.299	? (MO) TT=82.658	UNSAT TT=5.138	? (MO) TT=1468.41	UNSAT TT=0.922	? (TO) TT=1800.05	UNSAT TT=2.973	? (TO) TT=1800.43	UNSAT TT=0.299	UNSAT TT=0.333	? (TO) TT=1800.3
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_10_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.265 T1=0.19	SAT TT=0.006 T1=0	SAT TT=0.009 T1=0	SAT TT=0.007 T1=0	SAT TT=0.042 T1=0.03	SAT TT=0.596 T1=0.46	SAT TT=1.054 T1=0.73	SAT TT=0.056 T1=0.04	SAT TT=0.063 T1=0.05	SAT TT=0.005 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_8_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.225 T1=0.17	SAT TT=0.005 T1=0	SAT TT=0.005 T1=0	SAT TT=0.004 T1=0	SAT TT=0.024 T1=0.02	SAT TT=8.865 T1=6.54	SAT TT=5.602 T1=5.03	SAT TT=0.06 T1=0.05	SAT TT=0.059 T1=0.05	SAT TT=0.002 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_9_sat_pb.cnf.cr.opb	SAT TT=0.01 T1=0.01	SAT TT=0.294 T1=0.49	SAT TT=0.023 T1=0.02	SAT TT=0.02 T1=0.02	SAT TT=0.022 T1=0.02	SAT TT=0.02 T1=0.01	SAT TT=2.408 T1=1.36	SAT TT=3.896 T1=3.37	SAT TT=0.062 T1=0.05	SAT TT=0.064 T1=0.05	SAT TT=0.01 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_10_sat_pb.cnf.cr.opb	SAT TT=0.003 T1=0	SAT TT=0.259 T1=0.2	SAT TT=0.006 T1=0	SAT TT=0.005 T1=0	SAT TT=0.005 T1=0	SAT TT=0.035 T1=0.03	SAT TT=0.7 T1=0.5	SAT TT=18.034 T1=17.45	SAT TT=0.071 T1=0.06	SAT TT=0.073 T1=0.06	SAT TT=0.003 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_11_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.276 T1=0.21	SAT TT=0.006 T1=0	SAT TT=0.005 T1=0	SAT TT=0.006 T1=0	SAT TT=0.227 T1=0.22	SAT TT=2.222 T1=1.23	SAT TT=32.323 T1=31.78	SAT TT=0.064 T1=0.05	SAT TT=0.081 T1=0.07	SAT TT=0.002 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_9_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.259 T1=0.18	SAT TT=0.004 T1=0	SAT TT=0.006 T1=0	SAT TT=0.005 T1=0	SAT TT=0.074 T1=0.07	SAT TT=2.701 T1=1.53	SAT TT=193.242 T1=192.78	SAT TT=0.067 T1=0.05	SAT TT=0.075 T1=0.06	SAT TT=0.002 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_10_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.278 T1=0.2	SAT TT=0.005 T1=0	SAT TT=0.005 T1=0	SAT TT=0.005 T1=0	SAT TT=0.619 T1=0.61	SAT TT=19.418 T1=17.16	? (TO) TT=1801.47	SAT TT=0.076 T1=0.06	SAT TT=0.085 T1=0.07	SAT TT=0.002 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_11_sat_pb.cnf.cr.opb	SAT TT=0.013 T1=0.01	SAT TT=0.293 T1=0.23	SAT TT=0.032 T1=0.03	SAT TT=0.042 T1=0.04	SAT TT=0.019 T1=0.01	SAT TT=0.06 T1=0.05	SAT TT=2.85 T1=1.72	? (TO) TT=1800.44	SAT TT=0.084 T1=0.07	SAT TT=0.106 T1=0.09	SAT TT=0.013 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_12_sat_pb.cnf.cr.opb	SAT TT=0.003 T1=0	SAT TT=0.319 T1=0.24	SAT TT=0.007 T1=0	SAT TT=0.008 T1=0	SAT TT=0.006 T1=0	SAT TT=0.106 T1=0.1	SAT TT=2.695 T1=1.55	SAT TT=1012.96 T1=1012.63	SAT TT=0.078 T1=0.07	SAT TT=0.094 T1=0.08	SAT TT=0.003 T1=0
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_11_sat_pb.cnf.cr.opb	SAT TT=0.003 T1=0	SAT TT=0.301 T1=0.22	SAT TT=0.25 T1=0.25	SAT TT=0.478 T1=0.47	SAT TT=0.011 T1=0.01	SAT TT=0.043 T1=0.04	SAT TT=298.823 T1=294.3	? (TO) TT=1800.46	SAT TT=0.091 T1=0.08	SAT TT=0.111 T1=0.1	SAT TT=0.003 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_12_sat_pb.cnf.cr.opb	SAT TT=0.008 T1=0	SAT TT=0.333 T1=0.24	SAT TT=0.009 T1=0	SAT TT=0.015 T1=0.01	SAT TT=0.008 T1=0	SAT TT=0.114 T1=0.11	SAT TT=0.946 T1=0.65	SAT TT=1512.85 T1=1511.78	SAT TT=0.097 T1=0.08	SAT TT=0.193 T1=0.18	SAT TT=0.011 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_13_sat_pb.cnf.cr.opb	SAT TT=0.007 T1=0	? (TO) TT=1800.1	SAT TT=0.009 T1=0.01	SAT TT=0.014 T1=0.01	SAT TT=0.011 T1=0.01	SAT TT=0.785 T1=0.77	SAT TT=1.574 T1=0.91	? (TO) TT=1800.32	SAT TT=0.091 T1=0.08	SAT TT=0.128 T1=0.11	SAT TT=0.007 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_12_sat_pb.cnf.cr.opb	SAT TT=0.113 T1=0.1	SAT TT=0.342 T1=0.25	SAT TT=0.269 T1=0.26	SAT TT=0.8 T1=0.79	SAT TT=0.652 T1=0.65	SAT TT=12.418 T1=12.41	? (TO) TT=1800.27	? (TO) TT=1800.33	SAT TT=0.113 T1=0.1	SAT TT=0.113 T1=0.1	SAT TT=0.161 T1=0.16
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_13_sat_pb.cnf.cr.opb	SAT TT=0.004 T1=0	? (TO) TT=1800.11	SAT TT=0.008 T1=0	SAT TT=0.01 T1=0	SAT TT=0.008 T1=0	SAT TT=5.281 T1=5.27	SAT TT=4.869 T1=3.23	? (TO) TT=1800.28	SAT TT=0.11 T1=0.1	SAT TT=0.132 T1=0.12	SAT TT=0.004 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_14_sat_pb.cnf.cr.opb	SAT TT=0.008 T1=0	? (TO) TT=1800.06	SAT TT=0.012 T1=0.01	SAT TT=0.024 T1=0.02	SAT TT=0.012 T1=0.01	SAT TT=0.645 T1=0.64	SAT TT=1.429 T1=0.79	? (TO) TT=1800.35	SAT TT=0.106 T1=0.09	SAT TT=0.124 T1=0.11	SAT TT=0.008 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_13_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.422 T1=0.6	SAT TT=0.009 T1=0	SAT TT=0.009 T1=0	SAT TT=0.009 T1=0	SAT TT=1122.34 T1=1122.62	SAT TT=136.291 T1=133.2	? (TO) TT=1800.37	SAT TT=0.123 T1=0.11	SAT TT=0.157 T1=0.14	SAT TT=0.005 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_14_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.387 T1=0.3	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	SAT TT=14.185 T1=14.18	SAT TT=1.53 T1=0.92	? (TO) TT=1800.42	SAT TT=0.131 T1=0.12	SAT TT=0.174 T1=0.16	SAT TT=0.005 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_15_sat_pb.cnf.cr.opb	SAT TT=0.01 T1=0	? (TO) TT=1800.08	SAT TT=0.012 T1=0.01	SAT TT=0.019 T1=0.01	SAT TT=0.012 T1=0.01	SAT TT=4.371 T1=4.36	SAT TT=11.375 T1=9.44	? (TO) TT=1800.35	SAT TT=0.124 T1=0.11	SAT TT=0.174 T1=0.16	SAT TT=0.01 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_18_sat_pb.cnf.cr.opb	SAT TT=0.02 T1=0.02	SAT TT=0.624 T1=0.53	SAT TT=0.029 T1=0.02	SAT TT=5.243 T1=5.24	SAT TT=0.106 T1=0.1	? (TO) TT=1800.04	? (TO) TT=1800.25	? (TO) TT=1801.08	SAT TT=0.287 T1=0.27	SAT TT=0.426 T1=0.41	SAT TT=0.02 T1=0.02
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_19_sat_pb.cnf.cr.opb	SAT TT=0.009 T1=0.01	SAT TT=84.916 T1=84.85	SAT TT=0.022 T1=0.02	SAT TT=0.022 T1=0.02	SAT TT=0.023 T1=0.02	? (TO) TT=1800.09	SAT TT=425.71 T1=421	? (TO) TT=1800.4	SAT TT=0.36 T1=0.34	SAT TT=0.446 T1=0.43	SAT TT=0.009 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_20_sat_pb.cnf.cr.opb	SAT TT=0.01 T1=0	? (TO) TT=1800.07	SAT TT=0.026 T1=0.02	SAT TT=0.025 T1=0.02	SAT TT=0.026 T1=0.02	? (TO) TT=1800.08	SAT TT=58.333 T1=54.64	? (TO) TT=1800.39	SAT TT=0.787 T1=0.77	SAT TT=0.433 T1=0.42	SAT TT=0.01 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_23_sat_pb.cnf.cr.opb	SAT TT=0.048 T1=0.04	SAT TT=1.234 T1=1.13	SAT TT=11.532 T1=11.52	SAT TT=155.8 T1=155.83	SAT TT=0.048 T1=0.04	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.32	SAT TT=50.913 T1=50.91	SAT TT=31.335 T1=31.35	SAT TT=0.208 T1=0.2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_24_sat_pb.cnf.cr.opb	SAT TT=0.091 T1=0.08	SAT TT=1.318 T1=1.22	SAT TT=0.702 T1=0.7	SAT TT=0.091 T1=0.08	SAT TT=0.22 T1=0.21	? (TO) TT=1800.05	? (TO) TT=1800.22	? (TO) TT=1800.33	SAT TT=2.957 T1=2.94	SAT TT=32.725 T1=32.71	SAT TT=0.162 T1=0.16
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_25_sat_pb.cnf.cr.opb	SAT TT=0.037 T1=0.03	? (TO) TT=1800.09	SAT TT=0.056 T1=0.05	SAT TT=0.102 T1=0.1	SAT TT=0.239 T1=0.23	? (TO) TT=1800.04	SAT TT=601.689 T1=595.02	? (TO) TT=1800.4	SAT TT=25.745 T1=25.73	SAT TT=33.54 T1=33.53	SAT TT=0.037 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_28_sat_pb.cnf.cr.opb	SAT TT=0.023 T1=0.02	SAT TT=2.152 T1=2.05	SAT TT=0.076 T1=0.07	SAT TT=0.075 T1=0.07	SAT TT=0.076 T1=0.07	? (TO) TT=1800.03	? (TO) TT=1800.35	? (TO) TT=1800.41	SAT TT=54.5 T1=54.5	SAT TT=57.339 T1=57.34	SAT TT=0.023 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_29_sat_pb.cnf.cr.opb	SAT TT=0.139 T1=0.13	SAT TT=28.795 T1=28.7	SAT TT=0.258 T1=0.25	SAT TT=0.139 T1=0.13	SAT TT=0.584 T1=0.58	? (TO) TT=1800.12	? (TO) TT=1800.25	? (TO) TT=1800.37	SAT TT=42.653 T1=42.64	SAT TT=61.202 T1=61.2	SAT TT=0.532 T1=0.53
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_30_sat_pb.cnf.cr.opb	SAT TT=0.025 T1=0.02	? (TO) TT=1800.09	SAT TT=0.088 T1=0.08	SAT TT=0.088 T1=0.08	SAT TT=0.089 T1=0.08	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.33	SAT TT=47.436 T1=47.42	SAT TT=56.226 T1=56.23	SAT TT=0.025 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_33_sat_pb.cnf.cr.opb	SAT TT=0.167 T1=0.16	SAT TT=4.122 T1=4.34	SAT TT=1.055 T1=1.05	SAT TT=0.167 T1=0.16	SAT TT=4.788 T1=4.78	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.33	SAT TT=60.276 T1=60.27	SAT TT=84.59 T1=84.59	SAT TT=25.397 T1=25.39
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_34_sat_pb.cnf.cr.opb	SAT TT=0.037 T1=0.03	SAT TT=4.23 T1=4.14	SAT TT=0.148 T1=0.14	SAT TT=0.15 T1=0.14	SAT TT=0.149 T1=0.14	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.38	SAT TT=85.835 T1=85.83	SAT TT=91.021 T1=91.05	SAT TT=0.037 T1=0.03
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_35_sat_pb.cnf.cr.opb	SAT TT=0.057 T1=0.05	? (TO) TT=1800.14	SAT TT=0.187 T1=0.18	SAT TT=0.204 T1=0.2	SAT TT=0.199 T1=0.19	? (TO) TT=1800.06	SAT TT=252.658 T1=247.93	? (TO) TT=1800.41	SAT TT=116.591 T1=116.58	SAT TT=116.318 T1=116.32	SAT TT=0.057 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_38_sat_pb.cnf.cr.opb	SAT TT=0.054 T1=0.05	SAT TT=6.957 T1=6.84	SAT TT=0.24 T1=0.23	SAT TT=0.238 T1=0.23	SAT TT=0.222 T1=0.22	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.41	SAT TT=147.678 T1=147.68	SAT TT=161.067 T1=161.07	SAT TT=0.054 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_39_sat_pb.cnf.cr.opb	SAT TT=0.498 T1=0.49	SAT TT=157.891 T1=157.86	SAT TT=0.498 T1=0.49	SAT TT=4.126 T1=4.12	SAT TT=3.624 T1=3.62	? (TO) TT=1800.08	? (TO) TT=1800.25	? (TO) TT=1800.45	SAT TT=108.591 T1=108.58	SAT TT=169.322 T1=169.34	SAT TT=1.172 T1=1.17
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_40_sat_pb.cnf.cr.opb	SAT TT=0.315 T1=0.31	? (MO) TT=449.54	SAT TT=0.315 T1=0.31	SAT TT=0.315 T1=0.31	SAT TT=0.327 T1=0.32	? (TO) TT=1800.07	SAT TT=59.422 T1=56.35	? (TO) TT=1800.41	SAT TT=167.5 T1=167.51	SAT TT=144.613 T1=144.62	SAT TT=0.424 T1=0.42
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_43_sat_pb.cnf.cr.opb	SAT TT=0.406 T1=0.4	SAT TT=12.226 T1=12.13	SAT TT=2.169 T1=2.16	SAT TT=0.406 T1=0.4	? TT=1799.62	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.41	SAT TT=170.595 T1=170.58	SAT TT=304.098 T1=304.13	SAT TT=336.862 T1=336.9
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_44_sat_pb.cnf.cr.opb	SAT TT=0.458 T1=0.45	SAT TT=11.098 T1=10.99	SAT TT=0.61 T1=0.6	SAT TT=0.458 T1=0.45	SAT TT=1.131 T1=1.12	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.47	SAT TT=200.066 T1=200.07	SAT TT=325.7 T1=325.77	SAT TT=0.619 T1=0.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_45_sat_pb.cnf.cr.opb	SAT TT=0.141 T1=0.14	? (MO) TT=120.018	SAT TT=0.736 T1=0.73	SAT TT=0.597 T1=0.59	SAT TT=13.257 T1=13.25	? (TO) TT=1800.08	? (TO) TT=1800.24	? (TO) TT=1800.4	SAT TT=274.825 T1=274.84	SAT TT=309.648 T1=309.68	SAT TT=0.141 T1=0.14
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-22s.smv.opb	UNSAT TT=0.139	UNSAT TT=4.788	UNSAT TT=0.969	UNSAT TT=0.963	UNSAT TT=0.963	UNSAT TT=0.371	UNSAT TT=2.457	UNSAT TT=2.423	UNSAT TT=530.552	UNSAT TT=538.227	UNSAT TT=0.139
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-25s.smv.opb	UNSAT TT=0.098	UNSAT TT=3.491	UNSAT TT=0.45	UNSAT TT=0.45	UNSAT TT=0.45	UNSAT TT=0.239	UNSAT TT=2.221	UNSAT TT=2.255	UNSAT TT=138.862	UNSAT TT=1102.55	UNSAT TT=0.098
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-37s.smv.opb	UNSAT TT=0.024	UNSAT TT=0.587	UNSAT TT=0.069	UNSAT TT=0.068	UNSAT TT=0.071	UNSAT TT=0.055	UNSAT TT=1.913	UNSAT TT=1.418	UNSAT TT=39.773	UNSAT TT=52.584	UNSAT TT=0.024
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-43s.smv.opb	UNSAT TT=0.265	UNSAT TT=2.431	UNSAT TT=0.492	UNSAT TT=0.588	UNSAT TT=0.867	UNSAT TT=0.455	UNSAT TT=8.584	UNSAT TT=3.276	? (TO) TT=1800.33	? TT=1799.89	UNSAT TT=0.265
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-44s.smv.opb	UNSAT TT=0.014	UNSAT TT=0.464	UNSAT TT=0.014	UNSAT TT=0.027	UNSAT TT=0.023	UNSAT TT=0.037	UNSAT TT=2.485	UNSAT TT=1.375	UNSAT TT=2.712	UNSAT TT=4.983	UNSAT TT=0.021
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-46s.smv.opb	UNSAT TT=0.055	UNSAT TT=0.943	UNSAT TT=0.161	UNSAT TT=0.185	UNSAT TT=0.168	UNSAT TT=0.105	UNSAT TT=4.278	UNSAT TT=1.917	UNSAT TT=378.096	UNSAT TT=56.99	UNSAT TT=0.055
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-2.ucl.opb	UNSAT TT=0.013	UNSAT TT=0.351	UNSAT TT=0.016	UNSAT TT=0.013	UNSAT TT=0.024	UNSAT TT=0.027	UNSAT TT=5.586	UNSAT TT=1.015	UNSAT TT=0.045	UNSAT TT=0.043	UNSAT TT=0.024
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-3.ucl.opb	UNSAT TT=0.003	UNSAT TT=0.354	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.019	UNSAT TT=0.5	UNSAT TT=0.503	UNSAT TT=0.032	UNSAT TT=0.032	UNSAT TT=0.003
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-4.ucl.opb	UNSAT TT=0.003	UNSAT TT=0.356	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.019	UNSAT TT=0.444	UNSAT TT=0.442	UNSAT TT=0.03	UNSAT TT=0.029	UNSAT TT=0.003
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-6.ucl.opb	UNSAT TT=0.036	UNSAT TT=0.835	UNSAT TT=0.092	UNSAT TT=0.08	UNSAT TT=0.125	UNSAT TT=0.048	UNSAT TT=1.238	UNSAT TT=1.811	UNSAT TT=0.144	UNSAT TT=0.147	UNSAT TT=0.036
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-7.ucl.opb	UNSAT TT=0.042	UNSAT TT=3.248	UNSAT TT=0.052	UNSAT TT=0.052	UNSAT TT=0.053	UNSAT TT=0.113	UNSAT TT=2.175	UNSAT TT=2.194	UNSAT TT=0.793	UNSAT TT=0.786	UNSAT TT=0.042
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-8.ucl.opb	UNSAT TT=0.046	UNSAT TT=3.675	UNSAT TT=0.05	UNSAT TT=0.046	UNSAT TT=0.049	UNSAT TT=0.112	UNSAT TT=2.35	UNSAT TT=2.175	UNSAT TT=0.858	UNSAT TT=0.82	UNSAT TT=0.053
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan2.ucl.opb	UNSAT TT=0.073	UNSAT TT=2.478	UNSAT TT=0.159	UNSAT TT=0.152	UNSAT TT=0.177	UNSAT TT=0.107	UNSAT TT=2.019	UNSAT TT=2.919	UNSAT TT=0.5	UNSAT TT=0.499	UNSAT TT=0.073
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan3.ucl.opb	UNSAT TT=0.365	UNSAT TT=21.364	UNSAT TT=0.384	UNSAT TT=0.383	UNSAT TT=0.384	UNSAT TT=0.921	UNSAT TT=4.03	UNSAT TT=4.087	UNSAT TT=2.488	UNSAT TT=2.492	UNSAT TT=0.365
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl.opb	UNSAT TT=371.789	UNSAT TT=1249.66	UNSAT TT=371.789	? TT=1798.03	? TT=1798.11	? (TO) TT=1800.02	? (TO) TT=1800.28	? (TO) TT=1800.43	? (TO) TT=1802.21	? (TO) TT=1802.26	? (TO) TT=1800.15
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl.opb	UNSAT TT=32.599	UNSAT TT=34.405	UNSAT TT=266.642	UNSAT TT=397.38	UNSAT TT=212.733	UNSAT TT=42.298	UNSAT TT=727.433	UNSAT TT=104.611	? (TO) TT=1802.2	? (TO) TT=1802.22	UNSAT TT=32.599
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Icl2arity.ucl.opb	UNSAT TT=2.387	UNSAT TT=9.979	UNSAT TT=57.716	UNSAT TT=65.394	UNSAT TT=59.253	UNSAT TT=2.533	UNSAT TT=37.95	UNSAT TT=8.279	? TT=1796.71	? TT=1795.73	UNSAT TT=2.387
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih1arity.ucl.opb	UNSAT TT=606.201	? (MO) TT=47.787	UNSAT TT=606.201	? TT=1798.13	? TT=1798.1	? (TO) TT=1800.1	? (TO) TT=1800.28	? (TO) TT=1800.25	? (MO) TT=119.629	? (MO) TT=153.429	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih2arity.ucl.opb	SAT TT=1.905 T1=1.87	SAT TT=90.147 T1=89.96	SAT TT=180.843 T1=180.86	SAT TT=189.812 T1=189.84	SAT TT=181.488 T1=181.51	SAT TT=4.128 T1=3.24	SAT TT=9.531 T1=7	SAT TT=8.681 T1=6.85	? (TO) TT=1802.18	? (TO) TT=1802.22	SAT TT=1.905 T1=1.87
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv10.ucl.opb	UNSAT TT=0.12	UNSAT TT=2.393	UNSAT TT=0.194	UNSAT TT=0.196	UNSAT TT=0.18	UNSAT TT=0.351	UNSAT TT=2.216	UNSAT TT=2.419	UNSAT TT=195.905	UNSAT TT=178.783	UNSAT TT=0.12
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv12.ucl.opb	UNSAT TT=9.679	UNSAT TT=9.679	UNSAT TT=68.982	UNSAT TT=115.651	UNSAT TT=106.771	UNSAT TT=10.438	? (TO) TT=1800.2	UNSAT TT=33.338	? TT=1798.26	? TT=1795.71	UNSAT TT=24.611
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv14.ucl.opb	UNSAT TT=354.115	UNSAT TT=867.379	UNSAT TT=354.115	? TT=1798.09	? TT=1798.21	? (TO) TT=1800.06	? (TO) TT=1800.2	? (TO) TT=1800.35	? TT=1799.45	? (TO) TT=1802.15	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv8.ucl.opb	UNSAT TT=0.029	UNSAT TT=0.785	UNSAT TT=0.032	UNSAT TT=0.031	UNSAT TT=0.032	UNSAT TT=0.089	UNSAT TT=1.205	UNSAT TT=1.208	UNSAT TT=0.427	UNSAT TT=0.427	UNSAT TT=0.029
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl.opb	UNSAT TT=0.407	UNSAT TT=2.38	UNSAT TT=4.069	UNSAT TT=3.748	UNSAT TT=4.217	UNSAT TT=0.535	UNSAT TT=4.404	UNSAT TT=3.999	? (TO) TT=1800.38	? TT=1795.89	UNSAT TT=0.407
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem.ucl.opb	UNSAT TT=0.544	UNSAT TT=2.972	UNSAT TT=7.192	UNSAT TT=7.18	UNSAT TT=6.977	UNSAT TT=0.642	UNSAT TT=4.752	UNSAT TT=4.172	? (TO) TT=1800.33	? TT=1795.8	UNSAT TT=0.544
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.ucl.opb	UNSAT TT=0.226	UNSAT TT=2.073	UNSAT TT=2.444	UNSAT TT=2.321	UNSAT TT=2.753	UNSAT TT=0.369	UNSAT TT=9.189	UNSAT TT=3.444	UNSAT TT=543.928	UNSAT TT=1303.35	UNSAT TT=0.226
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf10.ucl.opb	UNSAT TT=6.26	UNSAT TT=20.18	UNSAT TT=164.359	UNSAT TT=158.532	UNSAT TT=166.6	UNSAT TT=6.26	UNSAT TT=28.284	UNSAT TT=11.341	? (TO) TT=1800.17	? TT=1799.92	UNSAT TT=6.778
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf6.ucl.opb	UNSAT TT=0.001	UNSAT TT=0.178	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.017	UNSAT TT=0.346	UNSAT TT=0.328	UNSAT TT=0.029	UNSAT TT=0.031	UNSAT TT=0.003
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf7.ucl.opb	UNSAT TT=0.021	UNSAT TT=0.631	UNSAT TT=0.091	UNSAT TT=0.092	UNSAT TT=0.092	UNSAT TT=0.055	UNSAT TT=1.327	UNSAT TT=1.17	UNSAT TT=21.62	UNSAT TT=29.456	UNSAT TT=0.021
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf8.ucl.opb	UNSAT TT=0.124	UNSAT TT=2.023	UNSAT TT=1.229	UNSAT TT=1.218	UNSAT TT=1.231	UNSAT TT=0.245	UNSAT TT=2.784	UNSAT TT=2.498	UNSAT TT=154.914	UNSAT TT=273.718	UNSAT TT=0.124
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf9.ucl.opb	UNSAT TT=0.737	UNSAT TT=6.46	UNSAT TT=18	UNSAT TT=17.899	UNSAT TT=18.072	UNSAT TT=1.103	UNSAT TT=5.57	UNSAT TT=4.273	? TT=1798.96	? TT=1796.99	UNSAT TT=0.737
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.2.accl.ucl.opb	UNSAT TT=1.278	UNSAT TT=1.774	UNSAT TT=1.444	UNSAT TT=4.713	UNSAT TT=5.927	UNSAT TT=1.278	UNSAT TT=568.782	UNSAT TT=6.109	? (TO) TT=1800.48	UNSAT TT=1563.18	UNSAT TT=1.561
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.3.accl.ucl.opb	UNSAT TT=2.525	UNSAT TT=4.927	UNSAT TT=2.525	UNSAT TT=17.297	UNSAT TT=30.113	UNSAT TT=3.506	UNSAT TT=1450.01	UNSAT TT=13.096	? (TO) TT=1800.35	? TT=1797.94	UNSAT TT=5.288
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.4.accl.ucl.opb	UNSAT TT=0.262	UNSAT TT=1.86	UNSAT TT=0.43	UNSAT TT=0.402	UNSAT TT=0.433	UNSAT TT=0.262	UNSAT TT=2.913	UNSAT TT=2.367	UNSAT TT=191.864	UNSAT TT=232.965	UNSAT TT=0.28
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.6.accl.ucl.opb	UNSAT TT=130.554	? (TO) TT=1800.09	UNSAT TT=130.554	? TT=1798.19	? TT=1798.21	? (TO) TT=1800.04	? (TO) TT=1800.31	? (TO) TT=1800.48	? TT=1798.9	? TT=1795.33	? (MO) TT=1407.44
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.8.accl.ucl.opb	UNSAT TT=74.257	UNSAT TT=610.698	UNSAT TT=74.257	? TT=1798.09	? TT=1798.19	UNSAT TT=384.105	? (TO) TT=1800.23	UNSAT TT=859.407	? TT=1797.34	? TT=1794.98	? (TO) TT=1800.27
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.RobRegValid_bar.ucl.opb	UNSAT TT=61.669	UNSAT TT=97.363	UNSAT TT=155.892	UNSAT TT=376.163	UNSAT TT=620.841	UNSAT TT=954.181	? (TO) TT=1800.29	UNSAT TT=78.058	? (TO) TT=1800.1	? TT=1798.72	UNSAT TT=61.669
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl.opb	UNSAT TT=306.9	? (MO) TT=37.133	UNSAT TT=306.9	? TT=1798.1	? TT=1798.23	? (TO) TT=1800.05	? (TO) TT=1800.28	? (TO) TT=1800.48	? (TO) TT=1802.25	? (TO) TT=1802.3	UNSAT TT=948.922
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl.opb	UNSAT TT=324.171	? (MO) TT=319.2	UNSAT TT=324.171	? TT=1798.07	? TT=1798.15	? (TO) TT=1800	? (TO) TT=1800.25	? (TO) TT=1800.5	? (TO) TT=1802.23	? (TO) TT=1802.22	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LsqHdStrong.ucl.opb	UNSAT TT=383.07	? (MO) TT=44.2	UNSAT TT=383.07	? TT=1798.06	? TT=1798.05	? (TO) TT=1800.06	? (TO) TT=1800.35	? (TO) TT=1800.37	? (MO) TT=127.901	? (MO) TT=268.757	? (TO) TT=1800.18
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf10.ucl.opb	UNSAT TT=11.592	UNSAT TT=11.592	UNSAT TT=354.596	UNSAT TT=133.589	UNSAT TT=211.616	UNSAT TT=12.015	UNSAT TT=563.231	UNSAT TT=48.915	? TT=1797.81	? TT=1794.93	UNSAT TT=35.616
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf6.ucl.opb	UNSAT TT=0.043	UNSAT TT=0.7	UNSAT TT=0.195	UNSAT TT=0.243	UNSAT TT=0.195	UNSAT TT=0.08	UNSAT TT=2.026	UNSAT TT=1.954	UNSAT TT=51.605	UNSAT TT=88.329	UNSAT TT=0.043
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf7.ucl.opb	UNSAT TT=0.132	UNSAT TT=1.277	UNSAT TT=0.89	UNSAT TT=1.275	UNSAT TT=0.911	UNSAT TT=0.185	UNSAT TT=4.373	UNSAT TT=2.832	UNSAT TT=203.884	UNSAT TT=227.965	UNSAT TT=0.132
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf8.ucl.opb	UNSAT TT=0.577	UNSAT TT=2.573	UNSAT TT=4.539	UNSAT TT=7.38	UNSAT TT=5.056	UNSAT TT=0.579	UNSAT TT=9.364	UNSAT TT=4.27	? (TO) TT=1800.56	? TT=1796.04	UNSAT TT=0.577
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf9.ucl.opb	UNSAT TT=1.839	UNSAT TT=3.694	UNSAT TT=25.824	UNSAT TT=28.041	UNSAT TT=30.08	UNSAT TT=1.839	UNSAT TT=24.357	UNSAT TT=16.697	? (TO) TT=1800.38	? TT=1796.94	UNSAT TT=3.135
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag10.ucl.opb	UNSAT TT=2.834	UNSAT TT=2.834	UNSAT TT=11.268	UNSAT TT=59.51	UNSAT TT=16.481	UNSAT TT=3.994	? (TO) TT=1800.18	UNSAT TT=33.735	? TT=1799.87	? TT=1794.86	UNSAT TT=28.319
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag12.ucl.opb	UNSAT TT=6.494	UNSAT TT=6.494	UNSAT TT=163.691	UNSAT TT=476.505	UNSAT TT=71.602	UNSAT TT=14.57	? (TO) TT=1800.23	UNSAT TT=150.707	? TT=1797.68	? TT=1794.97	UNSAT TT=135.486
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag14.ucl.opb	UNSAT TT=22.008	UNSAT TT=22.008	? TT=1798.06	UNSAT TT=1357.5	UNSAT TT=734.276	UNSAT TT=37.634	? (TO) TT=1800.22	UNSAT TT=530.384	? TT=1797.73	? TT=1799.17	? (TO) TT=1800.12
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag8.ucl.opb	UNSAT TT=0.438	UNSAT TT=1.332	UNSAT TT=6.017	UNSAT TT=4.438	UNSAT TT=1.362	UNSAT TT=0.438	UNSAT TT=580.757	UNSAT TT=6.266	? (TO) TT=1800.1	UNSAT TT=327.843	UNSAT TT=2.714
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.unbounded.all.ucl.opb	UNSAT TT=293.39	UNSAT TT=293.39	UNSAT TT=521.168	? TT=1798.04	? TT=1798.27	? (TO) TT=1800.09	? (TO) TT=1800.31	UNSAT TT=1609.61	? (TO) TT=1802.19	? (TO) TT=1802.23	UNSAT TT=968.691

Statistics		BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
Number of times the solver is able to give the best known answer		74	106	79	96	63	79	52	79	81	79
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		6	19	9	4	5	0	0	13	1	52