PB'11 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Industrial

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
borg pb-dec-11.04.03 (complete)
bsolo 3.2 (complete)
clasp 2.0-R4191 (complete)
MinisatID 2.4.8 [DEPRECATED] (complete)
MinisatID 2.4.8-gmp [DEPRECATED] (complete)
MinisatID 2.5.2 (fixed) (complete)
MinisatID 2.5.2-gmp (fixed) (complete)
Sat4j CuttingPlanes 2.3.0 (complete)
Sat4j Res//CP 2.3.0 (complete)
Sat4j Resolution 2.3.0 (complete)
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx 2 2011-06-10 (fixed) (complete)
SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx E_2 2011-06-10 (fixed) (complete)
wbo 1.6 (complete)

Bench name	Best results on this instance	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_11_pb.cnf.cr.opb	UNSAT TT=0.004	UNSAT TT=0.468	UNSAT TT=0.004	UNSAT TT=23.347	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=203.056	UNSAT TT=205.898	UNSAT TT=0.187	UNSAT TT=0.275	UNSAT TT=1001.22	UNSAT TT=0.016	UNSAT TT=0.015	UNSAT TT=0.017	UNSAT TT=0.016	UNSAT TT=109.266
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_15_pb.cnf.cr.opb	UNSAT TT=0.003	UNSAT TT=0.467	UNSAT TT=0.003	UNSAT TT=24.733	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=166.631	UNSAT TT=191.445	UNSAT TT=0.196	UNSAT TT=0.23	? (TO) TT=1800.13	UNSAT TT=0.019	UNSAT TT=0.017	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=458.821
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_20_pb.cnf.cr.opb	UNSAT TT=0.005	UNSAT TT=0.476	UNSAT TT=0.005	UNSAT TT=25.133	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=195.175	UNSAT TT=186.274	UNSAT TT=0.204	UNSAT TT=0.242	UNSAT TT=801.533	UNSAT TT=0.019	UNSAT TT=0.018	UNSAT TT=0.021	UNSAT TT=0.019	UNSAT TT=132.562
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_16_pb.cnf.cr.opb	UNSAT TT=0.009	UNSAT TT=0.511	UNSAT TT=0.009	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.245	UNSAT TT=0.382	? (TO) TT=1800.15	UNSAT TT=0.019	UNSAT TT=0.018	UNSAT TT=0.02	UNSAT TT=0.02	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_20_pb.cnf.cr.opb	UNSAT TT=0.014	UNSAT TT=0.477	UNSAT TT=0.014	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.222	UNSAT TT=0.283	? (TO) TT=1800.05	UNSAT TT=0.022	UNSAT TT=0.02	UNSAT TT=0.022	UNSAT TT=0.022	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr.opb	UNSAT TT=0.014	UNSAT TT=0.501	UNSAT TT=0.014	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.252	UNSAT TT=0.319	? (TO) TT=1800.15	UNSAT TT=0.024	UNSAT TT=0.022	UNSAT TT=0.024	UNSAT TT=0.024	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_21_pb.cnf.cr.opb	UNSAT TT=0.023	UNSAT TT=0.489	UNSAT TT=0.025	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.318	UNSAT TT=0.667	? (TO) TT=1800.06	UNSAT TT=0.025	UNSAT TT=0.023	UNSAT TT=0.026	UNSAT TT=0.025	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_25_pb.cnf.cr.opb	UNSAT TT=0.021	UNSAT TT=0.494	UNSAT TT=0.021	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.274	UNSAT TT=0.38	? (TO) TT=1800.13	UNSAT TT=0.026	UNSAT TT=0.027	UNSAT TT=0.03	UNSAT TT=0.026	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_30_pb.cnf.cr.opb	UNSAT TT=0.027	UNSAT TT=0.503	UNSAT TT=0.028	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.308	UNSAT TT=0.446	? (TO) TT=1800.12	UNSAT TT=0.029	UNSAT TT=0.027	UNSAT TT=0.03	UNSAT TT=0.028	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_31_pb.cnf.cr.opb	UNSAT TT=0.039	UNSAT TT=0.522	UNSAT TT=0.068	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.549	UNSAT TT=1.088	? (TO) TT=1800.14	UNSAT TT=0.039	UNSAT TT=0.039	UNSAT TT=0.039	UNSAT TT=0.041	? (TO) TT=1800.08
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_35_pb.cnf.cr.opb	UNSAT TT=0.044	UNSAT TT=0.532	UNSAT TT=0.074	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.386	UNSAT TT=0.588	? (TO) TT=1800.06	UNSAT TT=0.05	UNSAT TT=0.044	UNSAT TT=0.045	UNSAT TT=0.044	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_40_pb.cnf.cr.opb	UNSAT TT=0.047	UNSAT TT=0.548	UNSAT TT=0.116	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.397	UNSAT TT=0.631	? (TO) TT=1800.14	UNSAT TT=0.049	UNSAT TT=0.047	UNSAT TT=0.051	UNSAT TT=0.048	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_36_pb.cnf.cr.opb	UNSAT TT=0.047	UNSAT TT=0.609	UNSAT TT=0.113	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.739	UNSAT TT=1.552	? (TO) TT=1800.08	UNSAT TT=0.049	UNSAT TT=0.047	UNSAT TT=0.049	UNSAT TT=0.051	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_40_pb.cnf.cr.opb	UNSAT TT=0.05	UNSAT TT=0.618	UNSAT TT=0.234	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.463	UNSAT TT=0.794	? (TO) TT=1800.13	UNSAT TT=0.053	UNSAT TT=0.05	UNSAT TT=0.054	UNSAT TT=0.056	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_45_pb.cnf.cr.opb	UNSAT TT=0.055	UNSAT TT=0.584	UNSAT TT=0.132	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.484	UNSAT TT=0.822	? (TO) TT=1800.14	UNSAT TT=0.058	UNSAT TT=0.055	UNSAT TT=0.06	UNSAT TT=0.057	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_41_pb.cnf.cr.opb	UNSAT TT=0.059	UNSAT TT=0.612	UNSAT TT=0.207	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.876	UNSAT TT=1.604	? (TO) TT=1800.16	UNSAT TT=0.061	UNSAT TT=0.059	UNSAT TT=0.066	UNSAT TT=0.06	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_45_pb.cnf.cr.opb	UNSAT TT=0.067	UNSAT TT=0.61	UNSAT TT=0.182	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.511	UNSAT TT=0.93	? (TO) TT=1800.1	UNSAT TT=0.071	UNSAT TT=0.067	UNSAT TT=0.071	UNSAT TT=0.068	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_50_pb.cnf.cr.opb	UNSAT TT=0.074	UNSAT TT=0.635	UNSAT TT=0.234	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.503	UNSAT TT=0.938	? (TO) TT=1800.08	UNSAT TT=0.078	UNSAT TT=0.074	UNSAT TT=0.083	UNSAT TT=0.074	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_51_pb.cnf.cr.opb	UNSAT TT=0.084	UNSAT TT=0.709	UNSAT TT=0.371	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=1.236	UNSAT TT=2.139	? (TO) TT=1800.08	UNSAT TT=0.088	UNSAT TT=0.091	UNSAT TT=0.088	UNSAT TT=0.084	? (TO) TT=1800.12
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_55_pb.cnf.cr.opb	UNSAT TT=0.091	UNSAT TT=0.707	UNSAT TT=0.534	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.73	UNSAT TT=1.146	? (TO) TT=1800.18	UNSAT TT=0.096	UNSAT TT=0.091	UNSAT TT=0.096	UNSAT TT=0.092	? (TO) TT=1800.09
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_60_pb.cnf.cr.opb	UNSAT TT=0.098	UNSAT TT=0.726	UNSAT TT=3.959	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.713	UNSAT TT=1.186	? (TO) TT=1800.1	UNSAT TT=0.102	UNSAT TT=0.098	UNSAT TT=0.102	UNSAT TT=0.098	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_10_sat_pb.cnf.cr.opb	SAT TT=0.003 T1=0	SAT TT=0.78 T1=0.82	SAT TT=0.003 T1=0	SAT TT=0.01 T1=0.01	SAT TT=0.003 T1=0.01	SAT TT=0.01 T1=0.01	SAT TT=0.004 T1=0	SAT TT=0.01 T1=0.01	SAT TT=0.302 T1=0.2	SAT TT=0.529 T1=0.66	SAT TT=0.349 T1=0.21	SAT TT=0.126 T1=0.12	SAT TT=0.124 T1=0.12	SAT TT=0.126 T1=0.12	SAT TT=0.127 T1=0.12	SAT TT=0.004 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_8_sat_pb.cnf.cr.opb	SAT TT=0.001 T1=0	SAT TT=0.487 T1=0.66	SAT TT=0.001 T1=0	SAT TT=0.004 T1=0.01	SAT TT=0.003 T1=0	SAT TT=0.007 T1=0	SAT TT=0.003 T1=0	SAT TT=0.007 T1=0	SAT TT=1.628 T1=0.65	SAT TT=0.571 T1=0.65	SAT TT=0.314 T1=0.19	SAT TT=0.039 T1=0.03	SAT TT=0.038 T1=0.03	SAT TT=0.042 T1=0.03	SAT TT=0.041 T1=0.03	SAT TT=0.001 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_9_sat_pb.cnf.cr.opb	SAT TT=0.003 T1=0	SAT TT=0.461 T1=0.53	SAT TT=0.013 T1=0.01	SAT TT=0.008 T1=0	SAT TT=0.003 T1=0	SAT TT=0.009 T1=0	SAT TT=0.003 T1=0	SAT TT=0.009 T1=0	SAT TT=1.339 T1=0.56	SAT TT=0.654 T1=0.66	SAT TT=0.385 T1=0.22	SAT TT=0.105 T1=0.1	SAT TT=0.105 T1=0.1	SAT TT=0.108 T1=0.1	SAT TT=0.108 T1=0.1	SAT TT=0.004 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_10_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.822 T1=0.97	SAT TT=0.003 T1=0	SAT TT=0.091 T1=0.09	SAT TT=0.005 T1=0	SAT TT=0.011 T1=0.01	SAT TT=0.004 T1=0	SAT TT=0.012 T1=0.01	SAT TT=0.333 T1=0.22	SAT TT=0.615 T1=0.66	SAT TT=0.376 T1=0.22	SAT TT=0.168 T1=0.16	SAT TT=0.167 T1=0.16	SAT TT=0.17 T1=0.16	SAT TT=0.171 T1=0.16	SAT TT=0.002 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_11_sat_pb.cnf.cr.opb	SAT TT=0.001 T1=0	SAT TT=0.851 T1=1.08	SAT TT=0.002 T1=0	SAT TT=0.011 T1=0.01	SAT TT=0.004 T1=0.01	SAT TT=0.012 T1=0.01	SAT TT=0.004 T1=0	SAT TT=0.012 T1=0.01	SAT TT=1.022 T1=0.45	SAT TT=0.753 T1=0.67	SAT TT=0.394 T1=0.23	SAT TT=0.136 T1=0.13	SAT TT=0.133 T1=0.13	SAT TT=0.137 T1=0.13	SAT TT=0.139 T1=0.13	SAT TT=0.001 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_9_sat_pb.cnf.cr.opb	SAT TT=0.001 T1=0	SAT TT=0.467 T1=0.61	SAT TT=0.001 T1=0	SAT TT=0.033 T1=0.03	SAT TT=0.004 T1=0	SAT TT=0.009 T1=0	SAT TT=0.003 T1=0	SAT TT=0.009 T1=0	SAT TT=1.799 T1=0.75	SAT TT=0.564 T1=0.67	SAT TT=0.354 T1=0.21	SAT TT=0.219 T1=0.21	SAT TT=0.22 T1=0.21	SAT TT=0.22 T1=0.21	SAT TT=0.223 T1=0.21	SAT TT=0.001 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_10_sat_pb.cnf.cr.opb	SAT TT=0.001 T1=0	SAT TT=0.476 T1=0.69	SAT TT=0.002 T1=0	SAT TT=0.028 T1=0.02	SAT TT=0.044 T1=0.04	SAT TT=0.068 T1=0.08	SAT TT=0.005 T1=0	SAT TT=0.013 T1=0.01	SAT TT=72.39 T1=70.69	SAT TT=0.694 T1=0.67	SAT TT=0.416 T1=0.24	SAT TT=1.041 T1=1.03	SAT TT=1.06 T1=1.05	SAT TT=1.04 T1=1.03	SAT TT=1.069 T1=1.06	SAT TT=0.001 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_11_sat_pb.cnf.cr.opb	SAT TT=0.006 T1=0	SAT TT=0.907 T1=0.92	SAT TT=0.019 T1=0.01	SAT TT=0.015 T1=0.01	SAT TT=0.182 T1=0.18	SAT TT=0.239 T1=0.24	SAT TT=0.007 T1=0	SAT TT=0.02 T1=0.02	SAT TT=1.512 T1=0.68	SAT TT=0.755 T1=0.67	SAT TT=0.459 T1=0.25	SAT TT=0.197 T1=0.19	SAT TT=0.178 T1=0.17	SAT TT=0.179 T1=0.17	SAT TT=0.194 T1=0.18	SAT TT=0.006 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_12_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.896 T1=1.21	SAT TT=0.004 T1=0	SAT TT=0.004 T1=0	SAT TT=0.055 T1=0.06	SAT TT=0.074 T1=0.07	SAT TT=0.007 T1=0	SAT TT=0.019 T1=0.01	SAT TT=1.282 T1=0.54	SAT TT=0.701 T1=0.69	SAT TT=0.415 T1=0.24	SAT TT=0.16 T1=0.15	SAT TT=0.175 T1=0.17	SAT TT=0.161 T1=0.15	SAT TT=0.163 T1=0.15	SAT TT=0.002 T1=0
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_11_sat_pb.cnf.cr.opb	SAT TT=0.001 T1=0	SAT TT=0.502 T1=0.8	SAT TT=0.155 T1=0.15	SAT TT=0.16 T1=0.16	SAT TT=0.004 T1=0.01	SAT TT=0.014 T1=0.01	SAT TT=0.006 T1=0	SAT TT=0.014 T1=0.01	SAT TT=145.362 T1=143.04	SAT TT=0.665 T1=0.68	SAT TT=0.412 T1=0.23	SAT TT=1.208 T1=1.2	SAT TT=1.352 T1=1.34	SAT TT=1.209 T1=1.2	SAT TT=1.245 T1=1.23	SAT TT=0.001 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_12_sat_pb.cnf.cr.opb	SAT TT=0.004 T1=0	SAT TT=0.836 T1=1.18	SAT TT=0.004 T1=0	SAT TT=1.032 T1=1.03	SAT TT=0.005 T1=0	SAT TT=0.016 T1=0.01	SAT TT=0.006 T1=0	SAT TT=0.017 T1=0.01	SAT TT=0.417 T1=0.31	SAT TT=0.602 T1=0.68	SAT TT=0.396 T1=0.23	SAT TT=0.236 T1=0.23	SAT TT=0.249 T1=0.24	SAT TT=0.236 T1=0.23	SAT TT=0.239 T1=0.23	SAT TT=0.004 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_13_sat_pb.cnf.cr.opb	SAT TT=0.004 T1=0	SAT TT=0.915 T1=2.57	SAT TT=0.005 T1=0	SAT TT=0.726 T1=0.72	SAT TT=0.252 T1=0.25	SAT TT=0.288 T1=0.28	SAT TT=0.008 T1=0	SAT TT=0.021 T1=0.02	SAT TT=0.665 T1=0.33	SAT TT=0.838 T1=0.7	SAT TT=0.457 T1=0.26	SAT TT=0.234 T1=0.23	SAT TT=0.207 T1=0.2	SAT TT=0.21 T1=0.2	SAT TT=0.211 T1=0.2	SAT TT=0.004 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_12_sat_pb.cnf.cr.opb	SAT TT=0.006 T1=0	SAT TT=1.404 T1=1.5	SAT TT=0.184 T1=0.18	SAT TT=0.095 T1=0.09	SAT TT=0.006 T1=0	SAT TT=0.016 T1=0.01	SAT TT=0.006 T1=0	SAT TT=0.016 T1=0.01	SAT TT=187.642 T1=185.45	SAT TT=2.955 T1=1.2	SAT TT=0.97 T1=0.67	SAT TT=6.191 T1=6.18	SAT TT=6.88 T1=6.87	SAT TT=6.173 T1=6.16	SAT TT=6.946 T1=6.93	SAT TT=0.006 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_13_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=0.962 T1=0.81	SAT TT=0.004 T1=0	SAT TT=0.463 T1=0.46	SAT TT=0.007 T1=0	SAT TT=0.022 T1=0.02	SAT TT=0.007 T1=0	SAT TT=0.022 T1=0.02	SAT TT=1.908 T1=0.8	SAT TT=1.093 T1=0.69	SAT TT=0.524 T1=0.29	SAT TT=0.492 T1=0.48	SAT TT=0.546 T1=0.54	SAT TT=0.535 T1=0.52	SAT TT=0.498 T1=0.49	SAT TT=0.002 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_14_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.918 T1=0.79	SAT TT=0.006 T1=0	SAT TT=0.254 T1=0.25	SAT TT=0.009 T1=0	SAT TT=0.028 T1=0.02	SAT TT=0.009 T1=0	SAT TT=0.026 T1=0.02	SAT TT=0.66 T1=0.33	SAT TT=0.846 T1=0.69	SAT TT=0.475 T1=0.27	SAT TT=0.307 T1=0.3	SAT TT=0.279 T1=0.27	SAT TT=0.282 T1=0.27	SAT TT=0.281 T1=0.27	SAT TT=0.005 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_13_sat_pb.cnf.cr.opb	SAT TT=0.002 T1=0	SAT TT=2.662 T1=2.54	SAT TT=0.004 T1=0	SAT TT=0.436 T1=0.43	SAT TT=0.007 T1=0	SAT TT=0.022 T1=0.02	SAT TT=0.007 T1=0	SAT TT=0.022 T1=0.02	? (TO) TT=1800.31	SAT TT=5.321 T1=2.22	SAT TT=2.31 T1=1.94	SAT TT=0.693 T1=0.68	SAT TT=0.679 T1=0.67	SAT TT=0.613 T1=0.6	SAT TT=0.622 T1=0.61	SAT TT=0.002 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_14_sat_pb.cnf.cr.opb	SAT TT=0.003 T1=0	SAT TT=0.959 T1=1.23	SAT TT=0.005 T1=0	SAT TT=43.215 T1=43.21	SAT TT=0.108 T1=0.11	SAT TT=0.144 T1=0.14	SAT TT=0.011 T1=0.01	SAT TT=0.033 T1=0.03	SAT TT=0.565 T1=0.31	SAT TT=0.839 T1=0.7	SAT TT=0.504 T1=0.27	SAT TT=0.504 T1=0.49	SAT TT=0.546 T1=0.54	SAT TT=0.501 T1=0.49	SAT TT=0.547 T1=0.54	SAT TT=0.003 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_15_sat_pb.cnf.cr.opb	SAT TT=0.004 T1=0	SAT TT=1.015 T1=1.19	SAT TT=0.006 T1=0	SAT TT=3.243 T1=3.24	SAT TT=2.264 T1=2.26	SAT TT=2.491 T1=2.49	SAT TT=0.015 T1=0.01	SAT TT=0.04 T1=0.03	SAT TT=2.293 T1=1.02	SAT TT=1.058 T1=0.7	SAT TT=0.546 T1=0.3	SAT TT=0.335 T1=0.33	SAT TT=0.333 T1=0.32	SAT TT=0.335 T1=0.32	SAT TT=0.338 T1=0.33	SAT TT=0.004 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_18_sat_pb.cnf.cr.opb	SAT TT=0.011 T1=0.01	SAT TT=0.504 T1=0.61	SAT TT=0.015 T1=0.01	? (TO) TT=1800.06	SAT TT=14.511 T1=14.51	SAT TT=15.279 T1=15.28	SAT TT=0.02 T1=0.02	SAT TT=0.061 T1=0.06	? (TO) TT=1800.31	SAT TT=1.312 T1=0.74	SAT TT=0.581 T1=0.31	? (TO) TT=1800.07	? TT=1797.08	? (TO) TT=1800.07	? TT=1797.05	SAT TT=0.011 T1=0.02
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_19_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.482 T1=0.56	SAT TT=0.011 T1=0.01	? (TO) TT=1800.08	SAT TT=0.018 T1=0.01	SAT TT=0.056 T1=0.05	SAT TT=0.017 T1=0.01	SAT TT=0.059 T1=0.05	SAT TT=19.145 T1=17.71	SAT TT=1.616 T1=0.74	SAT TT=0.685 T1=0.39	SAT TT=0.982 T1=0.97	SAT TT=0.978 T1=0.97	SAT TT=0.977 T1=0.97	SAT TT=0.988 T1=0.98	SAT TT=0.005 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_20_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.522 T1=1.19	SAT TT=0.013 T1=0.01	? (TO) TT=1800.08	SAT TT=0.019 T1=0.01	SAT TT=0.062 T1=0.06	SAT TT=0.019 T1=0.02	SAT TT=0.062 T1=0.06	SAT TT=7.419 T1=5.94	SAT TT=1.583 T1=0.75	SAT TT=0.677 T1=0.35	SAT TT=1.653 T1=1.65	SAT TT=1.658 T1=1.65	SAT TT=1.636 T1=1.63	SAT TT=1.66 T1=1.65	SAT TT=0.005 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_23_sat_pb.cnf.cr.opb	SAT TT=0.088 T1=0.08	SAT TT=1.095 T1=1.33	SAT TT=0.621 T1=0.62	? (TO) TT=1800.06	SAT TT=66.066 T1=66.06	SAT TT=69.097 T1=69.09	SAT TT=0.088 T1=0.08	SAT TT=0.216 T1=0.21	? (TO) TT=1800.19	SAT TT=5.47 T1=2.3	SAT TT=2.42 T1=1.83	SAT TT=4.107 T1=4.1	SAT TT=4.409 T1=4.4	SAT TT=4.064 T1=4.05	SAT TT=4.161 T1=4.15	SAT TT=2.354 T1=2.35
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_24_sat_pb.cnf.cr.opb	SAT TT=0.018 T1=0.01	SAT TT=1.257 T1=1.04	SAT TT=0.43 T1=0.43	? (TO) TT=1800.1	SAT TT=139.428 T1=139.42	SAT TT=148.066 T1=148.06	SAT TT=0.111 T1=0.11	SAT TT=0.268 T1=0.26	SAT TT=331.876 T1=329.46	SAT TT=1.658 T1=0.78	SAT TT=0.813 T1=0.41	SAT TT=603.498 T1=603.46	SAT TT=630.766 T1=630.72	SAT TT=595.78 T1=595.74	SAT TT=612.948 T1=612.91	SAT TT=0.018 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_25_sat_pb.cnf.cr.opb	SAT TT=0.019 T1=0.01	SAT TT=1.377 T1=1	SAT TT=0.028 T1=0.02	? (TO) TT=1800.07	SAT TT=133.887 T1=133.88	SAT TT=140.656 T1=140.65	SAT TT=0.073 T1=0.07	SAT TT=0.219 T1=0.21	SAT TT=142.085 T1=140.03	SAT TT=2.079 T1=0.79	SAT TT=0.872 T1=0.44	SAT TT=2.212 T1=2.2	SAT TT=2.434 T1=2.42	SAT TT=2.197 T1=2.18	SAT TT=2.245 T1=2.23	SAT TT=0.019 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_28_sat_pb.cnf.cr.opb	SAT TT=0.012 T1=0.01	SAT TT=2.33 T1=3.34	SAT TT=0.035 T1=0.03	? (TO) TT=1800.04	SAT TT=0.059 T1=0.06	SAT TT=0.211 T1=0.21	SAT TT=0.059 T1=0.05	SAT TT=0.189 T1=0.18	? (TO) TT=1800.3	SAT TT=3.898 T1=1.81	SAT TT=1.704 T1=1.2	? (TO) TT=1800.04	? TT=1797.13	? (TO) TT=1800.07	? TT=1797.07	SAT TT=0.012 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_29_sat_pb.cnf.cr.opb	SAT TT=0.026 T1=0.02	SAT TT=1.555 T1=1.25	SAT TT=0.161 T1=0.16	? (TO) TT=1800.06	SAT TT=469.597 T1=469.58	SAT TT=536.217 T1=536.2	SAT TT=0.137 T1=0.13	SAT TT=0.375 T1=0.37	? (TO) TT=1800.25	SAT TT=2.403 T1=0.81	SAT TT=1.069 T1=0.6	SAT TT=11.754 T1=11.74	SAT TT=12.885 T1=12.87	SAT TT=11.718 T1=11.7	SAT TT=13.095 T1=13.08	SAT TT=0.026 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_30_sat_pb.cnf.cr.opb	SAT TT=0.014 T1=0.01	SAT TT=1.56 T1=1.35	SAT TT=0.044 T1=0.04	? (TO) TT=1800.05	SAT TT=718.085 T1=718.04	SAT TT=816.857 T1=816.81	SAT TT=0.181 T1=0.18	SAT TT=0.44 T1=0.43	SAT TT=8.018 T1=6.57	SAT TT=2.589 T1=0.82	SAT TT=1.218 T1=0.63	? (TO) TT=1800.09	? TT=1797.07	? (TO) TT=1800.07	? TT=1797.09	SAT TT=0.014 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_33_sat_pb.cnf.cr.opb	SAT TT=0.298 T1=0.29	SAT TT=1.892 T1=2.04	SAT TT=0.6 T1=0.6	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.298 T1=0.29	SAT TT=0.721 T1=0.72	? (TO) TT=1800.24	SAT TT=3.131 T1=1.35	SAT TT=1.281 T1=0.67	SAT TT=1755.78 T1=1755.7	? TT=1797.07	SAT TT=1742.67 T1=1742.59	? TT=1797.08	SAT TT=43.849 T1=43.84
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_34_sat_pb.cnf.cr.opb	SAT TT=0.019 T1=0.01	SAT TT=1.67 T1=1.56	SAT TT=0.065 T1=0.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.377 T1=0.37	SAT TT=0.885 T1=0.88	? (TO) TT=1800.2	SAT TT=2.549 T1=0.85	SAT TT=1.231 T1=0.59	SAT TT=17.67 T1=17.65	SAT TT=16.317 T1=16.3	SAT TT=16.088 T1=16.07	SAT TT=16.289 T1=16.27	SAT TT=0.019 T1=0.01
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_35_sat_pb.cnf.cr.opb	SAT TT=0.027 T1=0.02	SAT TT=1.748 T1=1.23	SAT TT=0.086 T1=0.08	? (TO) TT=1800.08	SAT TT=290.957 T1=290.94	SAT TT=304.153 T1=304.14	SAT TT=0.334 T1=0.33	SAT TT=0.862 T1=0.86	SAT TT=430.97 T1=428.52	SAT TT=2.544 T1=0.87	SAT TT=1.205 T1=0.6	? (TO) TT=1800.09	? TT=1797.09	? (TO) TT=1800.07	? TT=1797.13	SAT TT=0.027 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_38_sat_pb.cnf.cr.opb	SAT TT=0.027 T1=0.02	SAT TT=1.587 T1=1.88	SAT TT=0.103 T1=0.1	? (TO) TT=1800.07	SAT TT=0.198 T1=0.19	SAT TT=0.627 T1=0.62	SAT TT=0.3 T1=0.29	SAT TT=0.872 T1=0.87	? (TO) TT=1800.21	SAT TT=3.464 T1=1.44	SAT TT=1.704 T1=1.04	SAT TT=20.558 T1=20.54	SAT TT=22.359 T1=22.34	SAT TT=20.487 T1=20.47	SAT TT=22.298 T1=22.28	SAT TT=0.027 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_39_sat_pb.cnf.cr.opb	SAT TT=0.265 T1=0.26	SAT TT=1.084 T1=1.16	SAT TT=0.265 T1=0.26	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.05	SAT TT=0.648 T1=0.64	SAT TT=1.587 T1=1.58	? (TO) TT=1800.26	SAT TT=3.52 T1=1.39	SAT TT=1.809 T1=1.09	? (TO) TT=1800.07	? TT=1797.1	? (TO) TT=1800.03	? TT=1797.08	SAT TT=1.134 T1=1.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_40_sat_pb.cnf.cr.opb	SAT TT=0.058 T1=0.06	SAT TT=1.827 T1=1.89	SAT TT=0.14 T1=0.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.725 T1=0.72	SAT TT=1.657 T1=1.65	SAT TT=3.805 T1=2.66	SAT TT=3.074 T1=1.43	SAT TT=1.524 T1=0.88	SAT TT=29.764 T1=29.74	SAT TT=33.072 T1=33.05	SAT TT=29.628 T1=29.6	SAT TT=30.083 T1=30.06	SAT TT=0.058 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_43_sat_pb.cnf.cr.opb	SAT TT=0.055 T1=0.05	SAT TT=3.948 T1=4.07	SAT TT=0.222 T1=0.22	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.728 T1=0.72	SAT TT=1.808 T1=1.8	? (TO) TT=1800.29	SAT TT=21.208 T1=10.02	SAT TT=10.55 T1=9.68	SAT TT=40.101 T1=40.08	SAT TT=40.627 T1=40.6	SAT TT=39.811 T1=39.79	SAT TT=40.565 T1=40.54	SAT TT=0.055 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_44_sat_pb.cnf.cr.opb	SAT TT=0.284 T1=0.28	SAT TT=1.744 T1=2.5	SAT TT=0.284 T1=0.28	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.899 T1=0.89	SAT TT=2.132 T1=2.12	? (TO) TT=1800.27	SAT TT=3.428 T1=1.44	SAT TT=1.753 T1=0.99	? (TO) TT=1800.07	? TT=1797.08	? (TO) TT=1800.07	? TT=1797.09	SAT TT=8.352 T1=8.34
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_45_sat_pb.cnf.cr.opb	SAT TT=0.073 T1=0.07	SAT TT=1.467 T1=1.7	SAT TT=0.387 T1=0.38	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.772 T1=0.77	SAT TT=1.943 T1=1.93	SAT TT=1170.9 T1=1166.64	SAT TT=3.724 T1=1.42	SAT TT=1.741 T1=1.02	SAT TT=25.169 T1=25.14	SAT TT=28.39 T1=28.36	SAT TT=25.07 T1=25.04	SAT TT=25.967 T1=25.94	SAT TT=0.073 T1=0.07
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-22s.smv.opb	UNSAT TT=0.073	UNSAT TT=0.81	UNSAT TT=0.455	UNSAT TT=0.096	UNSAT TT=294.905	UNSAT TT=366.55	UNSAT TT=8.793	UNSAT TT=46.38	UNSAT TT=1.363	UNSAT TT=1.85	UNSAT TT=1.341	UNSAT TT=101.337	UNSAT TT=100.068	UNSAT TT=101.534	UNSAT TT=99.993	UNSAT TT=0.073
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-25s.smv.opb	UNSAT TT=0.035	UNSAT TT=0.754	UNSAT TT=0.212	UNSAT TT=0.035	UNSAT TT=137.048	UNSAT TT=160.733	UNSAT TT=1.529	UNSAT TT=7.369	UNSAT TT=1.172	UNSAT TT=1.486	UNSAT TT=1.33	UNSAT TT=49.243	UNSAT TT=44.173	UNSAT TT=44.64	UNSAT TT=44.16	UNSAT TT=0.053
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-37s.smv.opb	UNSAT TT=0.011	UNSAT TT=0.524	UNSAT TT=0.035	UNSAT TT=0.011	UNSAT TT=3.542	UNSAT TT=7.12	UNSAT TT=0.256	UNSAT TT=1.29	UNSAT TT=0.922	UNSAT TT=0.898	UNSAT TT=0.733	UNSAT TT=11.965	UNSAT TT=11.927	UNSAT TT=11.935	UNSAT TT=11.941	UNSAT TT=0.013
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-43s.smv.opb	UNSAT TT=0.108	UNSAT TT=0.734	UNSAT TT=0.364	UNSAT TT=0.146	UNSAT TT=112.068	UNSAT TT=156.106	UNSAT TT=1.766	UNSAT TT=8.801	UNSAT TT=16.786	UNSAT TT=2.55	UNSAT TT=1.326	UNSAT TT=51.431	UNSAT TT=48.712	UNSAT TT=48.303	UNSAT TT=48.669	UNSAT TT=0.108
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-44s.smv.opb	UNSAT TT=0.007	UNSAT TT=0.481	UNSAT TT=0.011	UNSAT TT=0.008	UNSAT TT=0.069	UNSAT TT=0.393	UNSAT TT=0.039	UNSAT TT=0.169	UNSAT TT=1.039	UNSAT TT=0.824	UNSAT TT=0.54	UNSAT TT=1.26	UNSAT TT=1.273	UNSAT TT=1.256	UNSAT TT=1.278	UNSAT TT=0.007
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-46s.smv.opb	UNSAT TT=0.023	UNSAT TT=0.533	UNSAT TT=0.099	UNSAT TT=0.023	UNSAT TT=3.165	UNSAT TT=6.81	UNSAT TT=0.282	UNSAT TT=1.305	UNSAT TT=2.39	UNSAT TT=1.491	UNSAT TT=0.918	UNSAT TT=16.952	UNSAT TT=17.095	UNSAT TT=16.876	UNSAT TT=17.132	UNSAT TT=0.024
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-2.ucl.opb	UNSAT TT=0.007	UNSAT TT=0.985	UNSAT TT=0.014	UNSAT TT=0.008	UNSAT TT=0.117	UNSAT TT=0.895	UNSAT TT=0.038	UNSAT TT=0.26	UNSAT TT=2.396	UNSAT TT=1.089	UNSAT TT=0.419	UNSAT TT=0.019	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=0.007
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-3.ucl.opb	UNSAT TT=0.001	UNSAT TT=0.678	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.005	UNSAT TT=0.014	UNSAT TT=0.006	UNSAT TT=0.014	UNSAT TT=0.24	UNSAT TT=0.265	UNSAT TT=0.244	UNSAT TT=0.016	UNSAT TT=0.015	UNSAT TT=0.016	UNSAT TT=0.015	UNSAT TT=0.001
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-4.ucl.opb	UNSAT TT=0.001	UNSAT TT=0.479	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.004	UNSAT TT=0.011	UNSAT TT=0.004	UNSAT TT=0.011	UNSAT TT=0.223	UNSAT TT=0.241	UNSAT TT=0.224	UNSAT TT=0.015	UNSAT TT=0.013	UNSAT TT=0.015	UNSAT TT=0.014	UNSAT TT=0.002
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-6.ucl.opb	UNSAT TT=0.013	UNSAT TT=0.52	UNSAT TT=0.065	UNSAT TT=0.016	UNSAT TT=0.09	UNSAT TT=0.651	UNSAT TT=0.068	UNSAT TT=0.441	UNSAT TT=0.481	UNSAT TT=0.824	UNSAT TT=0.739	UNSAT TT=0.09	UNSAT TT=0.088	UNSAT TT=0.086	UNSAT TT=0.083	UNSAT TT=0.013
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-7.ucl.opb	UNSAT TT=0.015	UNSAT TT=1.432	UNSAT TT=0.026	UNSAT TT=0.015	UNSAT TT=0.076	UNSAT TT=0.242	UNSAT TT=0.083	UNSAT TT=0.239	UNSAT TT=0.829	UNSAT TT=1.209	UNSAT TT=0.808	UNSAT TT=0.262	UNSAT TT=0.223	UNSAT TT=0.233	UNSAT TT=0.219	UNSAT TT=0.027
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-8.ucl.opb	UNSAT TT=0.01	UNSAT TT=1.554	UNSAT TT=0.025	UNSAT TT=0.01	UNSAT TT=0.092	UNSAT TT=0.263	UNSAT TT=0.093	UNSAT TT=0.262	UNSAT TT=0.941	UNSAT TT=1.285	UNSAT TT=0.906	UNSAT TT=0.246	UNSAT TT=0.213	UNSAT TT=0.221	UNSAT TT=0.211	UNSAT TT=0.023
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan2.ucl.opb	UNSAT TT=0.023	UNSAT TT=1.871	UNSAT TT=0.089	UNSAT TT=0.023	UNSAT TT=0.077	UNSAT TT=0.322	UNSAT TT=0.08	UNSAT TT=0.323	UNSAT TT=0.712	UNSAT TT=1.373	UNSAT TT=1.205	UNSAT TT=0.141	UNSAT TT=0.151	UNSAT TT=0.14	UNSAT TT=0.137	UNSAT TT=0.034
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan3.ucl.opb	UNSAT TT=0.067	UNSAT TT=1.724	UNSAT TT=0.184	UNSAT TT=0.067	UNSAT TT=0.838	UNSAT TT=2.226	UNSAT TT=0.902	UNSAT TT=2.204	UNSAT TT=1.707	UNSAT TT=2.203	UNSAT TT=1.619	UNSAT TT=1.078	UNSAT TT=1.011	UNSAT TT=1.012	UNSAT TT=0.953	UNSAT TT=0.16
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl.opb	UNSAT TT=850.051	? (MO) TT=1640.75	UNSAT TT=850.051	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.21	? (TO) TT=1800.4	? (TO) TT=1800.15	? (TO) TT=1801.32	? (TO) TT=1800.13	? (TO) TT=1802.12	? (TO) TT=1800.1	UNSAT TT=1073.59
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl.opb	UNSAT TT=5.562	UNSAT TT=10.995	UNSAT TT=204.752	UNSAT TT=5.562	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	UNSAT TT=177.096	UNSAT TT=131.259	UNSAT TT=55.848	? (TO) TT=1802.12	? (TO) TT=1800.09	? (TO) TT=1802.11	? TT=1800.03	UNSAT TT=15.77
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Icl2arity.ucl.opb	UNSAT TT=0.58	UNSAT TT=2.112	UNSAT TT=17.102	UNSAT TT=0.58	? (TO) TT=1800.06	? (TO) TT=1800.13	UNSAT TT=333.202	UNSAT TT=1401.64	UNSAT TT=14.049	UNSAT TT=10.603	UNSAT TT=4.493	? (TO) TT=1800.29	? TT=1797.31	? (TO) TT=1800.32	? TT=1797.35	UNSAT TT=0.59
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih1arity.ucl.opb	UNSAT TT=836.829	? (MO) TT=569.23	UNSAT TT=836.829	UNSAT TT=1357.15	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.29	? (TO) TT=1800.35	? (TO) TT=1800.22	? (TO) TT=1802.18	? (TO) TT=1800.13	? (TO) TT=1802.18	? (TO) TT=1802.12	UNSAT TT=1327.47
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih2arity.ucl.opb	SAT TT=0.386 T1=0.36	SAT TT=4.527 T1=4.57	SAT TT=185.076 T1=185.06	SAT TT=0.386 T1=0.36	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=4.065 T1=2.8	SAT TT=5.224 T1=2.8	SAT TT=3.302 T1=2.25	? (TO) TT=1802.13	? (TO) TT=1800.1	? (TO) TT=1802.1	? (TO) TT=1802.1	SAT TT=1.229 T1=1.2
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv10.ucl.opb	UNSAT TT=0.074	UNSAT TT=0.948	UNSAT TT=0.088	UNSAT TT=0.074	UNSAT TT=840.219	UNSAT TT=977.919	UNSAT TT=8.318	UNSAT TT=40.095	UNSAT TT=1.126	UNSAT TT=1.401	UNSAT TT=1.181	UNSAT TT=92.646	UNSAT TT=80.691	UNSAT TT=81.833	UNSAT TT=80.237	UNSAT TT=0.079
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv12.ucl.opb	UNSAT TT=1.09	UNSAT TT=2.877	UNSAT TT=44.214	UNSAT TT=1.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1051.13	UNSAT TT=32	UNSAT TT=13.124	? (TO) TT=1800.1	? TT=1797.38	? (TO) TT=1800.09	? TT=1797.33	UNSAT TT=5.042
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv14.ucl.opb	UNSAT TT=357.773	? (MO) TT=1693	UNSAT TT=1039.79	UNSAT TT=357.773	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.25	? (TO) TT=1800.27	? (TO) TT=1800.11	? (TO) TT=1801.66	? TT=1798.86	? (TO) TT=1800.8	? (TO) TT=1800.09	UNSAT TT=1054.99
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv8.ucl.opb	UNSAT TT=0.007	UNSAT TT=0.568	UNSAT TT=0.015	UNSAT TT=0.007	UNSAT TT=0.116	UNSAT TT=0.359	UNSAT TT=0.153	UNSAT TT=0.631	UNSAT TT=0.61	UNSAT TT=0.846	UNSAT TT=0.633	UNSAT TT=0.17	UNSAT TT=0.172	UNSAT TT=0.162	UNSAT TT=0.164	UNSAT TT=0.013
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl.opb	UNSAT TT=0.145	UNSAT TT=1	UNSAT TT=1.601	UNSAT TT=0.145	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=30.733	UNSAT TT=146.026	UNSAT TT=1.994	UNSAT TT=2.295	UNSAT TT=1.664	UNSAT TT=438.837	UNSAT TT=390.559	UNSAT TT=436.681	UNSAT TT=426.459	UNSAT TT=0.179
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem.ucl.opb	UNSAT TT=0.134	UNSAT TT=1.029	UNSAT TT=2.951	UNSAT TT=0.134	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=34.1	UNSAT TT=159.333	UNSAT TT=2.409	UNSAT TT=3.087	UNSAT TT=1.777	UNSAT TT=734.481	UNSAT TT=728.753	UNSAT TT=734.791	UNSAT TT=726.238	UNSAT TT=0.244
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.ucl.opb	UNSAT TT=0.081	UNSAT TT=0.815	UNSAT TT=1.076	UNSAT TT=0.081	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=6.969	UNSAT TT=35.469	UNSAT TT=2.055	UNSAT TT=2.328	UNSAT TT=1.59	UNSAT TT=1176.17	UNSAT TT=1162.93	UNSAT TT=1176.91	UNSAT TT=1268.71	UNSAT TT=0.103
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf10.ucl.opb	UNSAT TT=1.172	UNSAT TT=4.347	UNSAT TT=59.157	UNSAT TT=1.172	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=11.272	UNSAT TT=12.153	UNSAT TT=5.732	? (TO) TT=1800.61	? TT=1797.55	? (TO) TT=1800.61	? TT=1798.39	UNSAT TT=1.917
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf6.ucl.opb	UNSAT TT=0.001	UNSAT TT=0.508	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.007	UNSAT TT=0.003	UNSAT TT=0.007	UNSAT TT=0.172	UNSAT TT=0.183	UNSAT TT=0.175	UNSAT TT=0.015	UNSAT TT=0.014	UNSAT TT=0.016	UNSAT TT=0.015	UNSAT TT=0.001
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf7.ucl.opb	UNSAT TT=0.009	UNSAT TT=0.509	UNSAT TT=0.046	UNSAT TT=0.009	UNSAT TT=2.104	UNSAT TT=4.211	UNSAT TT=0.21	UNSAT TT=0.943	UNSAT TT=0.66	UNSAT TT=0.877	UNSAT TT=0.597	UNSAT TT=0.234	UNSAT TT=0.262	UNSAT TT=0.232	UNSAT TT=0.254	UNSAT TT=0.012
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf8.ucl.opb	UNSAT TT=0.045	UNSAT TT=0.753	UNSAT TT=0.527	UNSAT TT=0.045	UNSAT TT=1389.35	UNSAT TT=1629.12	UNSAT TT=5.666	UNSAT TT=26.733	UNSAT TT=1.43	UNSAT TT=1.502	UNSAT TT=1.193	UNSAT TT=71.244	UNSAT TT=70.582	UNSAT TT=71.382	UNSAT TT=70.565	UNSAT TT=0.065
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf9.ucl.opb	UNSAT TT=0.23	UNSAT TT=1.303	UNSAT TT=5.671	UNSAT TT=0.23	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=833.35	? (TO) TT=1800.07	UNSAT TT=2.778	UNSAT TT=2.867	UNSAT TT=1.879	UNSAT TT=447.638	UNSAT TT=441.013	UNSAT TT=450.27	UNSAT TT=440.372	UNSAT TT=0.313
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.2.accl.ucl.opb	UNSAT TT=0.411	UNSAT TT=1.074	UNSAT TT=2.49	UNSAT TT=0.411	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=4.083	UNSAT TT=20.679	UNSAT TT=205.902	UNSAT TT=5.909	UNSAT TT=2.585	UNSAT TT=290.625	UNSAT TT=346.255	UNSAT TT=289.635	UNSAT TT=313.329	UNSAT TT=0.529
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.3.accl.ucl.opb	UNSAT TT=1.073	UNSAT TT=1.935	UNSAT TT=7.738	UNSAT TT=1.073	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=33.126	UNSAT TT=165.627	UNSAT TT=596.966	UNSAT TT=11.574	UNSAT TT=5.477	? (TO) TT=1800.09	? TT=1797.13	? (TO) TT=1800.21	? TT=1797.12	UNSAT TT=1.559
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.4.accl.ucl.opb	UNSAT TT=0.056	UNSAT TT=0.68	UNSAT TT=0.217	UNSAT TT=0.056	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=16.053	UNSAT TT=79.179	UNSAT TT=1.528	UNSAT TT=1.575	UNSAT TT=1.57	UNSAT TT=41.905	UNSAT TT=41.875	UNSAT TT=41.762	UNSAT TT=41.877	UNSAT TT=0.112
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.6.accl.ucl.opb	UNSAT TT=1637.97	? (MO) TT=581.53	? TT=1798.05	UNSAT TT=1637.97	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.24	? (TO) TT=1800.33	? (TO) TT=1800.21	? (TO) TT=1800.06	? TT=1797.31	? (TO) TT=1800.09	? TT=1797.33	? (TO) TT=1800.15
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.8.accl.ucl.opb	UNSAT TT=87.162	? (MO) TT=577.9	? TT=1798.04	UNSAT TT=87.162	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.31	UNSAT TT=845.149	UNSAT TT=354.414	? (TO) TT=1800.39	? TT=1797.32	? (TO) TT=1800.09	? TT=1797.29	UNSAT TT=1230.29
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.RobRegValid_bar.ucl.opb	UNSAT TT=22.452	UNSAT TT=123.953	UNSAT TT=96.16	UNSAT TT=22.452	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.3	UNSAT TT=93.895	UNSAT TT=37.777	? (TO) TT=1800.77	? TT=1798.69	? (TO) TT=1800.65	? TT=1797.54	UNSAT TT=25.887
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl.opb	UNSAT TT=438.709	? (MO) TT=1647.12	? TT=1798.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.34	? (TO) TT=1800.3	UNSAT TT=698.413	? (TO) TT=1802.12	? (TO) TT=1800.09	? (TO) TT=1802.1	? (TO) TT=1801.63	UNSAT TT=438.709
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl.opb		? (MO) TT=1399.81	? TT=1798.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.25	? (TO) TT=1800.38	? (TO) TT=1800.24	? (TO) TT=1802.1	? (TO) TT=1800.1	? (TO) TT=1802.07	? (TO) TT=1802.09	? (TO) TT=1800.12
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LsqHdStrong.ucl.opb	UNSAT TT=1056.77	? (MO) TT=1071.53	? TT=1798.03	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.29	? (TO) TT=1800.39	? (TO) TT=1800.23	? (TO) TT=1801.9	? TT=1798.79	? (TO) TT=1801.9	? TT=1798.93	UNSAT TT=1056.77
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf10.ucl.opb	UNSAT TT=2.832	UNSAT TT=5.795	UNSAT TT=74.994	UNSAT TT=2.832	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=540.195	UNSAT TT=32.773	UNSAT TT=12.829	? (TO) TT=1800.14	? TT=1797.28	? (TO) TT=1800.37	? TT=1797.28	UNSAT TT=4.567
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf6.ucl.opb	UNSAT TT=0.014	UNSAT TT=0.517	UNSAT TT=0.098	UNSAT TT=0.014	UNSAT TT=17.62	UNSAT TT=30.373	UNSAT TT=0.537	UNSAT TT=2.256	UNSAT TT=0.979	UNSAT TT=1.117	UNSAT TT=0.783	UNSAT TT=17.608	UNSAT TT=17.535	UNSAT TT=17.477	UNSAT TT=19.442	UNSAT TT=0.02
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf7.ucl.opb	UNSAT TT=0.039	UNSAT TT=0.632	UNSAT TT=0.494	UNSAT TT=0.039	UNSAT TT=1563.98	? (TO) TT=1800.06	UNSAT TT=2.058	UNSAT TT=10.894	UNSAT TT=2.433	UNSAT TT=2.093	UNSAT TT=1.493	UNSAT TT=45.587	UNSAT TT=45.137	UNSAT TT=45.461	UNSAT TT=45.157	UNSAT TT=0.072
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf8.ucl.opb	UNSAT TT=0.114	UNSAT TT=0.91	UNSAT TT=1.782	UNSAT TT=0.114	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=15.339	UNSAT TT=74.524	UNSAT TT=4.226	UNSAT TT=3.195	UNSAT TT=1.756	UNSAT TT=395.366	UNSAT TT=389.997	UNSAT TT=394.81	UNSAT TT=389.036	UNSAT TT=0.304
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf9.ucl.opb	UNSAT TT=0.414	UNSAT TT=1.899	UNSAT TT=8.218	UNSAT TT=0.414	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=219.023	UNSAT TT=883.022	UNSAT TT=12.818	UNSAT TT=11.64	UNSAT TT=5.148	? (TO) TT=1800.62	? TT=1797.15	? (TO) TT=1800.56	? TT=1797.21	UNSAT TT=0.842
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag10.ucl.opb	UNSAT TT=0.397	UNSAT TT=2.267	UNSAT TT=4.46	UNSAT TT=0.397	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=49.982	UNSAT TT=227.11	? (TO) TT=1800.21	UNSAT TT=22.852	UNSAT TT=10.461	UNSAT TT=347.924	UNSAT TT=316.189	UNSAT TT=327.307	UNSAT TT=351.165	UNSAT TT=2.497
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag12.ucl.opb	UNSAT TT=0.759	UNSAT TT=3.885	UNSAT TT=35.497	UNSAT TT=0.759	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=822.732	? (TO) TT=1800.06	? (TO) TT=1800.27	UNSAT TT=237.731	UNSAT TT=91.392	? (TO) TT=1800.33	? TT=1797.24	? (TO) TT=1800.05	? TT=1797.26	UNSAT TT=5.833
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag14.ucl.opb	UNSAT TT=8.833	UNSAT TT=13.013	UNSAT TT=714.177	UNSAT TT=8.833	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.3	UNSAT TT=666.315	UNSAT TT=244.084	? (TO) TT=1800.49	? TT=1799.94	? (TO) TT=1800.49	? TT=1799.59	UNSAT TT=97.194
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag8.ucl.opb	UNSAT TT=0.062	UNSAT TT=0.828	UNSAT TT=2.259	UNSAT TT=0.062	UNSAT TT=1199.17	UNSAT TT=1699.92	UNSAT TT=2.201	UNSAT TT=10.265	UNSAT TT=223.554	UNSAT TT=6.165	UNSAT TT=2.995	UNSAT TT=47	UNSAT TT=46.506	UNSAT TT=47.072	UNSAT TT=51.694	UNSAT TT=0.623
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.unbounded.all.ucl.opb	UNSAT TT=94.659	? (MO) TT=1423.18	UNSAT TT=650.771	UNSAT TT=94.659	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.27	UNSAT TT=1166.94	UNSAT TT=440.884	? (TO) TT=1800.97	? TT=1798.41	? (TO) TT=1800.99	? TT=1797.95	UNSAT TT=178.715

Statistics		borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
Number of times the solver is able to give the best known answer		98	102	67	0	0	73	71	83	100	82	81	80	81	80	87
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	18	37	0	0	4	0	0	0	0	1	12	1	4	39