PB'16 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Reduced MPS to OPB

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Reduced MPS to OPB

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)
cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)
minisatp 2012-10-02 git-d91742b (complete)
NaPS 1.02 (complete)
Open-WBO PB16 (complete)
Open-WBO-LSU PB16 (complete)
Sat4j PB 2.3.6 Res+CP PB16 (complete)
Sat4j PB 2.3.6 Resolution PB16 (complete)
toysat 2016-05-02 (complete)

Bench name	Best results on this instance	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-25fv47.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.27	? TT=143.055	? TT=147.209	? (TO) TT=1800.83	? (TO) TT=1800.65	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-80bau3b.opb	UNSAT TT=0.511	UNSAT TT=0.572	UNSAT TT=0.511	UNSAT TT=3.268	UNSAT TT=3.513	? (MO) TT=64.354	? TT=60.395	UNSAT TT=4.393	UNSAT TT=3.176	UNSAT TT=20.375
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-adlittle.opb	SAT f=12 TT=1800.79 T1=153.44	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=95 TT=1800.08 T1=1800.4	? TT=142.792	? TT=137.031	SAT (TO) f=12 TT=1800.79 T1=153.44	? (TO) TT=1800.84	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-afiro.opb	OPT f=-66 TT=6.932 T1=6.92	OPT f=-66 TT=6.932 T1=6.92	OPT f=-66 TT=1141.65 T1=1141.82	SAT (TO) f=-48 TT=1800.02 T1=1800.3	OPT f=-66 TT=46.055 T1=46.06	? TT=158.976	? TT=150.227	OPT f=-66 TT=1609.84 T1=140.29	SAT (TO) f=-62 TT=1800.05 T1=1178.3	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg2.opb	SAT f=16917 TT=1800.19 T1=233.91	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.14	? TT=152.984	? TT=147.859	SAT (TO) f=16917 TT=1800.19 T1=233.91	SAT (TO) f=22499 TT=1800.04 T1=46.44	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg3.opb	SAT f=975 TT=1800.05 T1=1.17	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=142.914	? TT=154.201	SAT (TO) f=49318 TT=1800.81 T1=25.23	SAT (TO) f=975 TT=1800.05 T1=1.17	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg.opb	SAT f=-5638 TT=1800.02 T1=9.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=128.962	? TT=127.287	SAT (TO) f=-5638 TT=1800.02 T1=9.07	SAT (TO) f=751 TT=1800.07 T1=1.43	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bandm.opb	UNSAT TT=0.103	UNSAT TT=0.167	UNSAT TT=0.103	UNSAT TT=6.7	UNSAT TT=80.18	? TT=153.988	? TT=162.486	UNSAT TT=3.544	UNSAT TT=1.415	UNSAT TT=1.156
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-beaconfd.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.13	? TT=138.23	? TT=140.01	? (TO) TT=1800.18	? (TO) TT=1800	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-blend.opb	OPT f=-24 TT=68.247 T1=68.25	OPT f=-24 TT=235.139 T1=235.16	OPT f=-24 TT=68.247 T1=68.25	? (TO) TT=1800.06	SAT (TO) f=-19 TT=1800.09 T1=1800.4	? TT=145.648	? TT=139.537	OPT f=-24 TT=562.188 T1=258.32	? (TO) TT=1800	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl1.opb	UNSAT TT=1.223	UNSAT TT=1.248	UNSAT TT=1.223	UNSAT TT=10.852	UNSAT TT=107.417	? TT=166.262	? TT=156.853	UNSAT TT=2.754	UNSAT TT=2.155	UNSAT TT=3.419
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl2.opb	UNSAT TT=2.586	UNSAT TT=2.677	UNSAT TT=2.586	UNSAT TT=67.176	? (TO) TT=1800.41	? TT=139.526	? TT=139.523	UNSAT TT=85.38	UNSAT TT=3.903	UNSAT TT=33.725
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing1.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	? TT=129.306	? TT=128.373	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing2.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=138.725	? TT=137.201	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bore3d.opb	UNSAT TT=0.036	UNSAT TT=0.05	UNSAT TT=0.036	UNSAT TT=0.329	UNSAT TT=0.543	? TT=131.177	? TT=132.967	UNSAT TT=1.613	UNSAT TT=0.988	UNSAT TT=0.486
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-brandy.opb	UNSAT TT=0.222	UNSAT TT=0.248	UNSAT TT=0.222	? (TO) TT=1800.09	UNSAT TT=279.797	? TT=83.682	? TT=84.986	UNSAT TT=2.335	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-capri.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=129.676	? TT=130.533	? (TO) TT=1800.05	? (TO) TT=1800.59	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-cycle.opb		? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.32	? (MO) TT=106.555	? (MO) TT=107.558	? (TO) TT=1800.03	? (TO) TT=1800.59	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-czprob.opb	UNSAT TT=2.403	UNSAT TT=3.316	UNSAT TT=3.318	UNSAT TT=51.113	UNSAT TT=193.705	? TT=178.757	? TT=177.271	UNSAT TT=3.395	UNSAT TT=2.403	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d2q06c.opb	UNSAT TT=52.644	UNSAT TT=52.644	UNSAT TT=54.733	? (TO) TT=1800.02	? (TO) TT=1800.14	? TT=131.639	? TT=133.21	? (TO) TT=1800.84	? (TO) TT=1800.02	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d6cube.opb	UNSAT TT=4.31	UNSAT TT=4.93	UNSAT TT=4.31	? (TO) TT=1800.02	Signal TT=319.173	? TT=114.477	? TT=112.789	UNSAT TT=12.261	UNSAT TT=15.551	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen2.opb	UNSAT TT=0.391	UNSAT TT=0.483	UNSAT TT=0.391	? (TO) TT=1800.1	UNSAT TT=91.733	? TT=96.698	? TT=97.186	UNSAT TT=54.905	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen3.opb	UNSAT TT=1154.83	UNSAT TT=1154.83	UNSAT TT=1277.7	? (TO) TT=1800.04	? (TO) TT=1800.34	? TT=99.512	? TT=98.082	? (TO) TT=1800.06	? (TO) TT=1800.55	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-dfl001.opb		? (exit code) TT=0.537	? (exit code) TT=0.006	? (TO) TT=1800.17	? (TO) TT=1800.07	? TT=122.023	? TT=123.465	? (TO) TT=1800.72	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-e226.opb	UNSAT TT=0.145	UNSAT TT=0.195	UNSAT TT=0.145	UNSAT TT=7.66	UNSAT TT=102.175	? TT=163.856	? TT=164.165	UNSAT TT=3.984	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-etamacro.opb	SAT f=9 TT=1800.64 T1=51.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT (TO) f=136 TT=1800.08 T1=1800.4	? TT=138.964	? TT=137.962	SAT (TO) f=9 TT=1800.64 T1=51.11	SAT (TO) f=32 TT=1800.05 T1=19.26	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fffff800.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=98.572	? TT=98.294	? (TO) TT=1800.67	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1d.opb		? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.21	? TT=96.786	? TT=97.488	? (TO) TT=1800	? (TO) TT=1801.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1p.opb	OPT f=0 TT=1.079 T1=1.06	OPT f=0 TT=4.013 T1=3.99	OPT f=0 TT=1.079 T1=1.06	? (TO) TT=1800.03	? (MO) TT=1568.85	? TT=67.975	? TT=68.271	OPT f=0 TT=4.543 T1=2.51	OPT f=0 TT=2.643 T1=1.42	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2d.opb		? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	Signal TT=215.112	? (MO) TT=70.013	? (MO) TT=70.295	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2p.opb	SAT f=208 TT=1800.36 T1=41.32	? (exit code) TT=0.732	? (exit code) TT=0.006	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=69.141	? TT=69.49	SAT (TO) f=1782 TT=1800.92 T1=56.41	SAT (TO) f=208 TT=1800.36 T1=41.32	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-forplan.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? TT=78.305	? TT=80.221	? (TO) TT=1800.9	? (TO) TT=1800.91	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ganges.opb		? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=61.795	? TT=62.596	? (TO) TT=1800.03	? (TO) TT=1800.65	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-gfrd-pnc.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? TT=140.022	? TT=143.276	? (TO) TT=1800.02	? (TO) TT=1800.64	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbea.opb		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=223.064	? TT=229.849	? (TO) TT=1800.89	? (TO) TT=1800.04	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbeb.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.16	? TT=318.776	? TT=318.522	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow15.opb		? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=76.754	? TT=77.472	? (TO) TT=1800.9	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow22.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=74.315	? TT=75.326	? (TO) TT=1800.84	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow7.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.2	? TT=76.18	? TT=75.879	? (TO) TT=1800.79	? (TO) TT=1801.24	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-israel.opb	OPT f=-41 TT=321.257 T1=321.3	OPT f=-41 TT=1571.14 T1=1571.35	OPT f=-41 TT=321.257 T1=321.3	? (TO) TT=1800.03	SAT (TO) f=14 TT=1800.09 T1=1800.5	? TT=157.71	? TT=154.596	OPT f=-41 TT=1643.33 T1=806.1	? (TO) TT=1800.01	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-kb2.opb	OPT f=-293850 TT=0.117 T1=0.12	OPT f=-293850 TT=0.145 T1=0.14	OPT f=-293850 TT=0.117 T1=0.12	OPT f=-293850 TT=98.238 T1=98.25	OPT f=-293850 TT=51.118 T1=51.11	? TT=149.131	? TT=154.173	OPT f=-293850 TT=6.295 T1=4.91	SAT (TO) f=-136357 TT=1800.05 T1=1.79	OPT f=-293850 TT=190.322 T1=190.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-lotfi.opb		? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=163.188	? TT=159.427	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2	? TT=130.08	? TT=128.204	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros-r7.opb		? (exit code) TT=0.929	? (exit code) TT=0.005	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=144.815	? TT=149.352	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-modszk1.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.26	? TT=134.075	? TT=135.312	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-nesm.opb		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.43	? TT=64.202	? TT=64.186	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-perold.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	? (MO) TT=108.104	? (MO) TT=107.988	? (TO) TT=1800.67	? (TO) TT=1800.71	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot4.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=112.48	? TT=112.261	? (TO) TT=1800.65	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot87.opb	UNSAT TT=0.627	UNSAT TT=0.904	UNSAT TT=0.627	UNSAT TT=4.741	UNSAT TT=4.754	? (MO) TT=113.162	? (MO) TT=116.526	UNSAT TT=4.242	UNSAT TT=2.724	UNSAT TT=11.516
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.opb	UNSAT TT=0.248	UNSAT TT=0.482	UNSAT TT=0.248	UNSAT TT=5.396	UNSAT TT=6.038	? TT=136.342	? TT=134.66	UNSAT TT=4.773	UNSAT TT=2.963	UNSAT TT=7.872
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.we.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=106.127	? TT=104.569	? (TO) TT=1800.8	? (TO) TT=1800.69	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-recipe.opb	SAT f=-122041 TT=1800.33 T1=842.8	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=201.047	? TT=204.697	SAT (TO) f=-122041 TT=1800.33 T1=842.8	SAT (TO) f=-121839 TT=1800.71 T1=0.96	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc105.opb	SAT f=-14 TT=1800.23 T1=869.91	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT (TO) f=0 TT=1800.07 T1=1800.4	? TT=125.11	? TT=124.592	SAT (TO) f=-14 TT=1800.23 T1=869.91	SAT (TO) f=-3 TT=1800.01 T1=908.73	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc205.opb	SAT f=0 TT=1800.08 T1=0.97	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (MO) TT=123.862	? TT=124.592	SAT (TO) f=0 TT=1800.16 T1=0.97	SAT (TO) f=0 TT=1800.08 T1=1273.47	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50a.opb	SAT f=-35 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-6 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.02 T1=1800.3	? TT=123.345	? TT=123.767	SAT (TO) f=-29 TT=1800.52 T1=838.01	SAT (TO) f=-21 TT=1800.06 T1=435.04	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50b.opb	OPT f=-45 TT=242.948 T1=242.98	OPT f=-45 TT=242.948 T1=242.98	OPT f=-45 TT=895.616 T1=895.75	SAT (TO) f=-17 TT=1800.02 T1=1800.3	SAT (TO) f=-27 TT=1800.1 T1=1800.4	? TT=123.294	? TT=123.786	SAT (TO) f=-35 TT=1800.72 T1=450.24	SAT (TO) f=-23 TT=1800.58 T1=1586.45	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr25.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=123.764	? TT=123.135	? (TO) TT=1800.69	? (TO) TT=1800.63	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr7.opb	SAT f=527 TT=1800.65 T1=106.48	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=124.275	? TT=123.361	SAT (TO) f=527 TT=1800.65 T1=106.48	SAT (TO) f=552 TT=1800.01 T1=70.72	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm1.opb		? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=155.571	? TT=156.397	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm2.opb		? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=142.148	? TT=144.376	? (TO) TT=1800.79	? (TO) TT=1800.01	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm3.opb		? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=137.614	? TT=138.281	? (TO) TT=1800.14	? (TO) TT=1800.58	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scorpion.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=137.105	? TT=129.592	? (TO) TT=1800.13	? (TO) TT=1800.58	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scrs8.opb	UNSAT TT=0.166	UNSAT TT=0.227	UNSAT TT=0.166	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=261.209	? TT=259.487	UNSAT TT=4.322	UNSAT TT=44.477	UNSAT TT=33.895
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd1.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=96.98	? TT=97.645	? (TO) TT=1800.77	? (TO) TT=1800.81	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd6.opb		? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=100.503	? TT=99.177	? (TO) TT=1800.74	? (TO) TT=1800.03	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd8.opb		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=118.744	? TT=120.584	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap1.opb	SAT f=297 TT=1800.08 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT (TO) f=297 TT=1800.08 T1=1800.4	? TT=143.087	? TT=137.184	SAT (TO) f=846 TT=1800.04 T1=4.57	No Cert. TT=1800.06	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap2.opb	SAT f=653 TT=1800.04 T1=44.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=816 TT=1800.37 T1=1800.4	? TT=135.63	? TT=136.451	SAT (TO) f=653 TT=1800.04 T1=44.05	No Cert. TT=1801.26	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap3.opb	SAT f=838 TT=1800.79 T1=5.22	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=2093 TT=1800.44 T1=1800.5	? TT=141.92	? TT=141.946	SAT (TO) f=838 TT=1800.79 T1=5.22	No Cert. TT=1800.04	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-seba.opb	UNSAT TT=0.151	UNSAT TT=0.22	UNSAT TT=0.151	UNSAT TT=4.717	UNSAT TT=219.266	? (MO) TT=115.517	? (MO) TT=111.087	UNSAT TT=2.573	UNSAT TT=11.451	UNSAT TT=61.898
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share1b.opb	UNSAT TT=26.507	UNSAT TT=26.507	UNSAT TT=26.983	? (TO) TT=1800.03	UNSAT TT=318.86	? TT=179.033	? TT=187.413	UNSAT TT=182.196	? (TO) TT=1800.02	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share2b.opb	OPT f=-52 TT=0.52 T1=0.51	OPT f=-52 TT=0.683 T1=0.68	OPT f=-52 TT=0.52 T1=0.51	? (TO) TT=1800.03	OPT f=-52 TT=180.735 T1=180.74	? TT=107.464	? TT=107.128	OPT f=-52 TT=4.474 T1=4.01	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-shell.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.18	? (MO) TT=110.808	? (MO) TT=111.087	? (TO) TT=1800.86	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04l.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=103.421	? TT=100.502	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04s.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=86.07	? TT=88.71	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08l.opb		? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.22	? TT=105.927	? TT=107.347	? (TO) TT=1800.79	? (TO) TT=1800.01	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08s.opb		? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=92.338	? TT=89.041	? (TO) TT=1800.72	? (TO) TT=1800.63	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12l.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.32	? TT=86.13	? TT=86.514	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12s.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.51	? TT=99.914	? TT=100.242	? (TO) TT=1800.71	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sierra.opb		? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.19	? TT=70.453	? TT=72.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stair.opb	UNSAT TT=2.102	UNSAT TT=2.102	UNSAT TT=2.163	? (TO) TT=1800.07	UNSAT TT=1198.35	? TT=133.672	? TT=132.598	UNSAT TT=140.923	UNSAT TT=1650.43	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standata.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=154.456	? TT=151.969	? (TO) TT=1800.63	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standgub.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=75.756	? TT=75.69	? (TO) TT=1800.18	? (TO) TT=1800.77	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor1.opb	SAT f=-40 TT=1800.02 T1=206.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT (TO) f=4399 TT=1800.07 T1=1800.4	? TT=135.475	? TT=137.552	SAT (TO) f=-40 TT=1800.02 T1=206.02	? (TO) TT=1800.54	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor2.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.23	? TT=137.3	? TT=136.97	? (TO) TT=1800.72	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-tuff.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=143.599	? TT=144.997	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-vtp.base.opb	UNSAT TT=5.814	UNSAT TT=13.496	UNSAT TT=13.744	UNSAT TT=108.669	UNSAT TT=59.054	? TT=134.935	? TT=138.653	UNSAT TT=5.814	? (TO) TT=1800.04	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-wood1p.opb	UNSAT TT=193.848	UNSAT TT=198.437	UNSAT TT=193.848	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=72.903	? TT=76.732	? (TO) TT=1800.92	UNSAT TT=1284.91	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-woodw.opb		? (exit code) TT=0.518	? (exit code) TT=0.006	? (TO) TT=1800.05	? (TO) TT=1800.17	? TT=84.58	? TT=85.71	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-a1c1s1.opb	UNSAT TT=1.45	UNSAT TT=1.592	UNSAT TT=1.45	? (TO) TT=1800.09	UNSAT TT=745.75	? TT=117.609	? TT=116.819	UNSAT TT=8.175	UNSAT TT=3.893	UNSAT TT=214.709
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow30a.opb	SAT f=3405 TT=1800.36 T1=847.63	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=107.26	? TT=107.537	SAT (TO) f=3405 TT=1800.36 T1=847.63	No Cert. TT=1800.99	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow40b.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.17	? (MO) TT=65.343	? (MO) TT=63.659	? (TO) TT=1800.11	? (TO) TT=1800.71	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air04.opb	SAT f=5967 TT=1800.09 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=5967 TT=1800.09 T1=1800.4	SAT (TO) f=5991 TT=1800.06 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.79	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air05.opb	SAT f=4098 TT=1800.12 T1=1800.4	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=4482 TT=1800.12 T1=1800.4	SAT (TO) f=4609 TT=1800.08 T1=1800.4	SAT (TO) f=4098 TT=1800.12 T1=1800.4	? TT=69.455	SAT (TO) f=5293 TT=1800.48 T1=721.7	SAT (TO) f=5852 TT=1800.67 T1=2.85	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-arki001.opb	UNSAT TT=2.515	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=100.018	? TT=92.396	UNSAT TT=2.515	? (TO) TT=1800.01	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-atlanta-ip.opb	UNSAT TT=0.651	UNSAT TT=0.942	UNSAT TT=0.651	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=85.139	? (MO) TT=83.942	UNSAT TT=8.252	UNSAT TT=5.014	UNSAT TT=46.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-dano3mip.opb		? (exit code) TT=0.911	? (exit code) TT=0.006	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=148.843	? TT=139.689	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-danoint.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=142.231	? TT=137.849	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-fiber.opb	OPT f=4372 TT=1413.34 T1=1413.32	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=195272 TT=1800.09 T1=1800.4	OPT f=4372 TT=1413.34 T1=1413.32	? TT=152.988	? TT=150.847	SAT (TO) f=8209 TT=1800.14 T1=1.81	SAT (TO) f=7552 TT=1800.01 T1=0.46	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-fixnet6.opb		? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=100.805	? (MO) TT=103.289	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-gesa2-o.opb	SAT f=756 TT=1800.06 T1=34.03	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=1018 TT=1800.08 T1=1800.4	SAT (TO) f=1004 TT=1800.05 T1=1800.4	? TT=141.856	? TT=136.556	SAT (TO) f=786 TT=1800.04 T1=12.11	SAT (TO) f=756 TT=1800.06 T1=34.03	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-gesa2.opb	SAT f=738 TT=1800.04 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=1615 TT=1800.05 T1=1800.4	SAT (TO) f=738 TT=1800.04 T1=1800.4	? TT=143.756	? TT=145.155	SAT (TO) f=777 TT=1800.07 T1=2.95	No Cert. TT=1801.22	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1212 TT=1800.92 T1=492.7	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=5736 TT=1800.06 T1=1800.4	SAT (TO) f=1273 TT=1800.06 T1=1800.4	? TT=144.688	? TT=144.858	SAT (TO) f=1212 TT=1800.92 T1=492.7	No Cert. TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-harp2.opb	SAT f=-8127 TT=1800.71 T1=1.3	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=-7377 TT=1800.02 T1=1800.3	SAT (TO) f=-5841 TT=1800.08 T1=1800.4	? TT=123.805	? TT=120.743	SAT (TO) f=-8127 TT=1800.71 T1=1.3	SAT (TO) f=-7153 TT=1800.09 T1=6.37	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-liu.opb	SAT f=688 TT=1800.61 T1=1375.81	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=137.095	? TT=138.771	SAT (TO) f=768 TT=1800.22 T1=882.69	SAT (TO) f=688 TT=1800.61 T1=1375.81	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare1.opb	SAT f=9 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.02 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	? TT=158.595	? TT=166.508	SAT (TO) f=41 TT=1800.3 T1=871.14	SAT (TO) f=44 TT=1800.06 T1=1605.69	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare2.opb	SAT f=9 TT=1800.02 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	? TT=149	? TT=146.176	SAT (TO) f=29 TT=1800.85 T1=282.1	SAT (TO) f=68 TT=1800.02 T1=0.37	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas74.opb	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.025 T1=0.02	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.093 T1=0.09	OPT f=1 TT=0.051 T1=0.05	? (MO) TT=239.926	? (MO) TT=239.32	OPT f=1 TT=0.365 T1=0.75	OPT f=1 TT=0.344 T1=0.19	OPT f=1 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas76.opb	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.025 T1=0.02	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.097 T1=0.09	OPT f=1 TT=0.043 T1=0.04	? (MO) TT=238.243	? (MO) TT=230.73	OPT f=1 TT=0.352 T1=0.71	OPT f=1 TT=0.325 T1=0.22	OPT f=1 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-misc07.opb	OPT f=262858 TT=140.83 T1=17.91	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=262859 TT=1800.02 T1=1800.3	OPT f=262858 TT=784.752 T1=784.86	? TT=130.498	? TT=135.985	OPT f=262858 TT=686.832 T1=44.38	OPT f=262858 TT=140.83 T1=17.91	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-mkc.opb	SAT f=-3323 TT=1800.1 T1=1800.4	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=-3323 TT=1800.1 T1=1800.4	SAT (TO) f=4426 TT=1800.03 T1=1800.4	? TT=91.242	? TT=92.336	SAT (TO) f=-3137 TT=1800.18 T1=572.22	SAT (TO) f=-3121 TT=1800.03 T1=0.56	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mod011.opb		? (exit code) TT=0.385	? (exit code) TT=0.007	? (TO) TT=1800.03	? (TO) TT=1800.48	? TT=66.209	? TT=66.829	? (TO) TT=1800.78	? (TO) TT=1800.68	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-modglob.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=155.43	? TT=154.355	? (TO) TT=1800.85	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum1.opb	UNSAT TT=0.426	UNSAT TT=0.458	UNSAT TT=0.426	UNSAT TT=2.363	UNSAT TT=2.343	? (MO) TT=416.496	? (MO) TT=385.918	UNSAT TT=4.344	UNSAT TT=2.456	UNSAT TT=4.722
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum2.opb	UNSAT TT=1.573	UNSAT TT=1.913	UNSAT TT=1.573	UNSAT TT=17.015	UNSAT TT=16.979	? (MO) TT=199.839	? (MO) TT=200.91	UNSAT TT=11.662	UNSAT TT=7.033	UNSAT TT=802.808
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum3.opb	SAT f=407422 TT=1800.19 T1=158.45	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=85.413	? (MO) TT=86.557	SAT (TO) f=407422 TT=1800.19 T1=158.45	SAT (TO) f=408052 TT=1800.06 T1=190.01	? (TO) TT=1800.42
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-msc98-ip.opb	UNSAT TT=1373.53	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=78.814	? TT=79.051	UNSAT TT=1373.53	? (TO) TT=1800.58	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-noswot.opb	OPT f=-7 TT=0.024 T1=0.02	OPT f=-7 TT=0.038 T1=0.03	OPT f=-7 TT=0.024 T1=0.02	OPT f=-7 TT=7.142 T1=7.13	OPT f=-7 TT=3.188 T1=3.18	? TT=144.21	? TT=144.393	OPT f=-7 TT=1.324 T1=0.79	SAT (TO) f=-7 TT=1800.58 T1=0.33	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-nsrand-ipx.opb	SAT f=295446 TT=1800.82 T1=701.63	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=520663 TT=1800.1 T1=1800.5	SAT (TO) f=497871 TT=1800.04 T1=1800.7	? TT=81.19	? TT=80.391	SAT (TO) f=295446 TT=1800.82 T1=701.63	SAT (TO) f=524296 TT=1800.05 T1=0.95	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-nw04.opb	SAT f=73 TT=1800.04 T1=1800.3	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT f=96 TT=236.13 T1=235.6	SAT (TO) f=142 TT=1800.05 T1=1800.3	SAT (TO) f=73 TT=1800.04 T1=1800.3	SAT (TO) f=86 TT=1800.19 T1=800.61	No Cert. TT=1800.06	? (TO) TT=1800.13
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pk1.opb	SAT f=21 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.02 T1=1800.3	SAT (TO) f=33 TT=1800.09 T1=1800.4	? TT=131.466	? TT=133.149	? (TO) TT=1800.64	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pp08aCUTS.opb	SAT f=8084 TT=1800.24 T1=880.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=138.508	? (MO) TT=137.953	SAT (TO) f=8084 TT=1800.24 T1=880.08	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-pp08a.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=130.01	? TT=129.132	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-qiu.opb		? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=208.163	? TT=206.102	? (TO) TT=1800.57	? (TO) TT=1800.66	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-rd-rplusc-21.opb		? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=126.996	? TT=128.184	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.33
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=450588 TT=1800.03 T1=1657.34	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=77.272	? TT=78.156	SAT (TO) f=507933 TT=1800.53 T1=845.8	SAT (TO) f=450588 TT=1800.03 T1=1657.34	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-rout.opb	SAT f=262441 TT=1800.7 T1=195.94	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=262484 TT=1800.01 T1=1800.3	SAT (TO) f=262548 TT=1800.08 T1=1800.4	? TT=115.573	? TT=122.411	SAT (TO) f=262441 TT=1800.7 T1=195.94	SAT (TO) f=262475 TT=1800.09 T1=252.53	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-set1ch.opb	SAT f=1755 TT=1800.02 T1=68.81	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=7008 TT=1800.04 T1=1800.4	? TT=138.194	? TT=138.121	SAT (TO) f=5458 TT=1800.09 T1=9.16	SAT (TO) f=1755 TT=1800.02 T1=68.81	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=52 TT=1800.04 T1=9.22	? (exit code) TT=2.433	? (exit code) TT=0.006	SAT (TO) f=57 TT=1800.15 T1=1800.4	SAT (TO) f=57 TT=1800.16 T1=1800.4	? TT=77.366	? TT=77.799	SAT (TO) f=52 TT=1800.04 T1=9.22	No Cert. TT=1800.79	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-stp3d.opb		? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.73	? (TO) TT=1800.09	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-swath.opb	SAT f=262299 TT=1800.63 T1=371.28	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=72.197	? TT=73.22	SAT (TO) f=262299 TT=1800.63 T1=371.28	SAT (TO) f=266262 TT=1800.08 T1=853.37	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-t1717.opb	SAT f=660 TT=113.085 T1=112.5	? (TO) TT=1800.04	? (TO) TT=1801.29	SAT (TO) f=660 TT=1800.04 T1=1800.4	SAT (MO) f=660 TT=113.085 T1=112.5	SAT (TO) f=664 TT=1800.09 T1=1800.4	SAT (TO) f=664 TT=1800.1 T1=1800.4	SAT (TO) f=1170 TT=1800 T1=13.36	No Cert. TT=1800.09	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab1.opb	SAT f=162257 TT=1800.11 T1=1.88	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=142.282	? TT=137.577	SAT (TO) f=162257 TT=1800.11 T1=1.88	SAT (TO) f=181135 TT=1800.04 T1=0.6	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab2.opb	SAT f=202233 TT=1800.12 T1=1.95	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=128.999	? (MO) TT=130.078	SAT (TO) f=202233 TT=1800.12 T1=1.95	SAT (TO) f=212655 TT=1800.04 T1=1.22	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.06	? TT=137.926	? TT=138.459	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1800.96 T1=45.5	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=134.452	? TT=159.149	SAT (TO) f=39649 TT=1800.96 T1=45.5	SAT (TO) f=41696 TT=1801 T1=12.94	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-vpm2.opb	SAT f=66 TT=1800.61 T1=1756.25	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=133.083	? TT=130.007	SAT (TO) f=157 TT=1800.85 T1=2.32	SAT (TO) f=66 TT=1800.61 T1=1756.25	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-blend2.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.79	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-gesa3_o.opb	SAT f=673 TT=1800.58 T1=97.77	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=862 TT=1800.04 T1=1800.4	SAT (TO) f=936 TT=1800.05 T1=1800.4	? TT=155.665	? TT=152.38	SAT (TO) f=724 TT=1800.1 T1=7.61	SAT (TO) f=673 TT=1800.58 T1=97.77	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gesa3.opb	SAT f=238 TT=1800.12 T1=1800.5	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1462 TT=1800.03 T1=1800.4	SAT (TO) f=238 TT=1800.12 T1=1800.5	? TT=124.353	? TT=122.085	SAT (TO) f=548 TT=1800.19 T1=6.35	SAT (TO) f=548 TT=1800.03 T1=3.15	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gt2.opb	OPT f=3591 TT=3.122 T1=2.22	? (TO) TT=1800.02	OPT f=3591 TT=1024 T1=1024.16	SAT (TO) f=9457 TT=1800.02 T1=1800.3	SAT (TO) f=4818 TT=1800.09 T1=1800.4	SAT (TO) f=5521 TT=1800.28 T1=1800.4	? TT=110.703	OPT f=3591 TT=3.122 T1=2.22	SAT (TO) f=3591 TT=1800.03 T1=647.87	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-qnet1_o.opb	SAT f=209 TT=1800.07 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=1815 TT=1800.1 T1=1800.4	SAT (TO) f=209 TT=1800.07 T1=1800.4	? TT=156.075	? TT=151.649	SAT (TO) f=359 TT=1800.1 T1=1.9	SAT (TO) f=355 TT=1800.65 T1=0.62	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-qnet1.opb	SAT f=316 TT=1800.08 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=1836 TT=1800.08 T1=1800.4	SAT (TO) f=316 TT=1800.08 T1=1800.4	? TT=153.983	? TT=154.123	SAT (TO) f=426 TT=1800.06 T1=0.84	SAT (TO) f=426 TT=1800.09 T1=0.55	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air01.opb	OPT f=1496 TT=1.234 T1=0.52	OPT f=1496 TT=18.549 T1=18.54	OPT f=1496 TT=2.876 T1=2.87	OPT f=1496 TT=1591.61 T1=1591.91	OPT f=1496 TT=41.585 T1=41.48	OPT f=1496 TT=1.234 T1=1.23	OPT f=1496 TT=32.099 T1=31.92	OPT f=1496 TT=5.05 T1=4.78	OPT f=1496 TT=2.142 T1=0.52	OPT f=1496 TT=91.451 T1=91.4
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air02.opb	OPT f=313 TT=209.34 T1=200.17	OPT f=313 TT=912.239 T1=912.41	OPT f=313 TT=1687.85 T1=1688.11	SAT (TO) f=399 TT=1800.04 T1=1800.4	SAT (TO) f=521 TT=1800.18 T1=1800.4	SAT (TO) f=313 TT=1800.04 T1=1800.3	? TT=71.605	SAT (TO) f=340 TT=1800.19 T1=743.65	OPT f=313 TT=209.34 T1=200.17	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air03.opb	SAT f=7962 TT=1800.09 T1=555.93	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=8372 TT=1800.15 T1=1800.4	SAT (TO) f=8804 TT=1800.16 T1=1800.4	SAT (TO) f=25111 TT=1800.03 T1=1800.3	? TT=73.106	SAT (TO) f=7962 TT=1800.09 T1=555.93	No Cert. TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air06.opb	SAT f=6016 TT=1800.14 T1=1800.4	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT (TO) f=7479 TT=1800.07 T1=1800.4	SAT (TO) f=6016 TT=1800.14 T1=1800.4	SAT (TO) f=7206 TT=1800.02 T1=1800.3	? TT=165.421	SAT (TO) f=7565 TT=1800.18 T1=677.55	SAT (TO) f=7491 TT=1800.05 T1=1144.59	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3a.opb	SAT f=720 TT=1800.08 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=17938 TT=1800.08 T1=1800.4	SAT (TO) f=720 TT=1800.08 T1=1800.4	? TT=130.573	? TT=133.674	SAT (TO) f=815 TT=1800 T1=11.88	SAT (TO) f=1814 TT=1800.01 T1=374.47	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3b.opb	SAT f=989 TT=1800.18 T1=185.88	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=27699 TT=1800.1 T1=1800.4	SAT (TO) f=998 TT=1800.07 T1=1800.4	? TT=124.932	? TT=129.182	SAT (TO) f=989 TT=1800.18 T1=185.88	SAT (TO) f=1864 TT=1800.09 T1=769.03	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell4.opb	SAT f=1381 TT=1800.45 T1=738.6	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=16765 TT=1800.1 T1=1800.4	SAT (TO) f=1546 TT=1800.09 T1=1800.4	? TT=125.252	? TT=126.184	SAT (TO) f=1381 TT=1800.45 T1=738.6	SAT (TO) f=1664 TT=1800 T1=1739.9	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell5.opb	SAT f=788 TT=1800.64 T1=41.78	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2943 TT=1800.09 T1=1800.4	SAT (TO) f=1021 TT=1800.09 T1=1800.4	? TT=120.245	? TT=122.767	SAT (TO) f=956 TT=1800.68 T1=58.31	SAT (TO) f=788 TT=1800.64 T1=41.78	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-dcmulti.opb	SAT f=922 TT=1800.13 T1=265.41	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=122.252	? TT=124.523	SAT (TO) f=922 TT=1800.13 T1=265.41	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-egout.opb	SAT f=117 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=182 TT=1800.02 T1=1800.3	SAT (TO) f=117 TT=1800.1 T1=1800.4	? (MO) TT=448.769	? (MO) TT=469.296	SAT (TO) f=125 TT=1800 T1=548.51	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-enigma.opb	OPT f=0 TT=0.127 T1=0.12	OPT f=0 TT=0.312 T1=0.31	OPT f=0 TT=0.454 T1=0.45	OPT f=0 TT=61.967 T1=61.97	OPT f=0 TT=2.002 T1=2	? TT=142.042	? TT=136.871	OPT f=0 TT=0.984 T1=0.65	OPT f=0 TT=0.505 T1=0.25	OPT f=0 TT=0.127 T1=0.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet3.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (MO) TT=102.24	? (MO) TT=102.781	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet4.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (MO) TT=104.229	? (MO) TT=104.065	? (TO) TT=1800.71	? (TO) TT=1801.15	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-flugpl.opb	OPT f=91 TT=0.131 T1=0.13	OPT f=91 TT=0.131 T1=0.13	OPT f=91 TT=0.167 T1=0.16	OPT f=91 TT=1.813 T1=1.81	OPT f=91 TT=1.465 T1=1.46	? TT=140.968	? TT=140.325	OPT f=91 TT=4.483 T1=6.69	OPT f=91 TT=629.4 T1=527.63	OPT f=91 TT=408.705 T1=68.84
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-gen.opb	SAT f=551 TT=1800.01 T1=3.65	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=1433 TT=1800.09 T1=1800.4	SAT (TO) f=784 TT=1800.06 T1=1800.4	? TT=135.253	? TT=134.549	SAT (TO) f=551 TT=1800.01 T1=3.65	? (TO) TT=1800.76	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib/normalized-reduced-mps-v2-20-10-khb05250.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.91	? (TO) TT=1800.06	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc01.opb	OPT f=262288 TT=0.241 T1=0.24	OPT f=262288 TT=0.28 T1=0.28	OPT f=262288 TT=0.241 T1=0.24	OPT f=262288 TT=3.192 T1=3.19	OPT f=262288 TT=5.211 T1=5.21	OPT f=262288 TT=1262.79 T1=1262.89	OPT f=262288 TT=185.679 T1=185.49	OPT f=262288 TT=3.984 T1=2.66	OPT f=262288 TT=1.984 T1=0.77	OPT f=262288 TT=7.698 T1=7.48
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc02.opb	OPT f=262571 TT=0.041 T1=0.04	OPT f=262571 TT=0.055 T1=0.05	OPT f=262571 TT=0.041 T1=0.04	OPT f=262571 TT=1.141 T1=1.14	OPT f=262571 TT=4.246 T1=4.24	OPT f=262571 TT=388.744 T1=388.39	OPT f=262571 TT=178.565 T1=178.04	OPT f=262571 TT=2.885 T1=2.15	OPT f=262571 TT=1.204 T1=0.37	OPT f=262571 TT=2.197 T1=1.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc03.opb	OPT f=262989 TT=4.492 T1=1.92	OPT f=262989 TT=7.418 T1=7.41	OPT f=262989 TT=6.997 T1=7	OPT f=262989 TT=86.474 T1=86.49	OPT f=262989 TT=24.645 T1=24.64	? TT=127.651	? TT=125.476	OPT f=262989 TT=10.701 T1=7.21	OPT f=262989 TT=4.492 T1=1.92	OPT f=262989 TT=27.686 T1=20.53
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc04.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=110.494	? TT=106.196	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc05.opb	UNSAT TT=0.028	UNSAT TT=0.043	UNSAT TT=0.028	UNSAT TT=0.727	UNSAT TT=39.408	? TT=114.376	? TT=115.811	UNSAT TT=18.191	UNSAT TT=5.673	UNSAT TT=129.436
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc06.opb		? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? TT=136.412	? TT=143.031	? (TO) TT=1800.68	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-mod013.opb	OPT f=19 TT=5.998 T1=5.99	? (TO) TT=1800.02	OPT f=19 TT=214.627 T1=214.66	OPT f=19 TT=43.357 T1=43.36	OPT f=19 TT=5.998 T1=5.99	? TT=148.679	? TT=153.705	SAT (TO) f=19 TT=1800.08 T1=66.81	SAT (TO) f=21 TT=1800.9 T1=114.43	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0282.opb	OPT f=104028 TT=0.799 T1=0.49	OPT f=104028 TT=4.239 T1=4.24	OPT f=104028 TT=6.389 T1=6.41	OPT f=104028 TT=704.545 T1=704.65	OPT f=104028 TT=19.928 T1=19.89	OPT f=104028 TT=1297.66 T1=1297.92	? TT=90.841	OPT f=104028 TT=3.014 T1=11.23	OPT f=104028 TT=1.104 T1=0.49	OPT f=104028 TT=0.799 T1=0.53
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0291.opb	OPT f=7985 TT=0.102 T1=0.1	OPT f=7985 TT=0.11 T1=0.11	OPT f=7985 TT=0.102 T1=0.1	OPT f=7985 TT=27.377 T1=27.36	OPT f=7985 TT=8.976 T1=8.96	OPT f=7985 TT=2.44 T1=2.43	? TT=123.666	OPT f=7985 TT=1.145 T1=5.7	OPT f=7985 TT=0.483 T1=0.24	OPT f=7985 TT=0.275 T1=0.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p6000.opb	SAT f=-73511 TT=1800.71 T1=173.76	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=70.097	? TT=70.262	SAT (TO) f=-73511 TT=1800.71 T1=173.76	? (TO) TT=1800.06	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-pipex.opb	OPT f=164393 TT=0.25 T1=0.25	OPT f=164393 TT=1.022 T1=1.02	OPT f=164393 TT=0.25 T1=0.25	OPT f=164393 TT=64.922 T1=64.92	OPT f=164393 TT=8.156 T1=8.15	OPT f=164393 TT=75.223 T1=75.23	? TT=129.307	OPT f=164393 TT=6.274 T1=7.66	OPT f=164393 TT=9.372 T1=6.79	OPT f=164393 TT=61.876 T1=49.17
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-rgn.opb	SAT f=90984 TT=1800.86 T1=31.3	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=129.445	? TT=134.755	SAT (TO) f=90984 TT=1800.86 T1=31.3	SAT (TO) f=102879 TT=1800.72 T1=759.85	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-sample2.opb	OPT f=5 TT=0.114 T1=0.11	OPT f=5 TT=0.114 T1=0.11	OPT f=5 TT=0.431 T1=0.42	OPT f=5 TT=9.156 T1=9.15	OPT f=5 TT=1.263 T1=1.25	? TT=189.335	? TT=191.118	OPT f=5 TT=18.42 T1=10.76	OPT f=5 TT=155.34 T1=153.28	OPT f=5 TT=6.852 T1=6.79
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1al.opb	SAT f=9004 TT=1800.83 T1=57.38	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT (TO) f=10699 TT=1800.06 T1=1800.4	? TT=83.169	? TT=82.992	SAT (TO) f=9004 TT=1800.83 T1=57.38	? (TO) TT=1800.62	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1cl.opb	SAT f=2649 TT=1800.04 T1=289.94	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT (TO) f=12465 TT=1800.07 T1=1800.4	? TT=81.43	? TT=82.82	SAT (TO) f=2649 TT=1800.04 T1=289.94	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-vpm1.opb	OPT f=20 TT=67.765 T1=67.71	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.629	? TT=153.479	? (TO) TT=1800.74	? (TO) TT=1800.68	OPT f=20 TT=67.765 T1=67.71
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bal8x12.opb	UNSAT TT=0.032	UNSAT TT=0.047	UNSAT TT=0.032	UNSAT TT=41.496	UNSAT TT=23.977	? TT=142.034	? TT=140.991	UNSAT TT=3.033	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bk4x3.opb	OPT f=14 TT=0.181 T1=0.18	OPT f=14 TT=0.181 T1=0.18	OPT f=14 TT=0.193 T1=0.19	OPT f=14 TT=5.112 T1=5.11	OPT f=14 TT=1.077 T1=1.07	OPT f=14 TT=151.634 T1=151.35	OPT f=14 TT=259.434 T1=259.13	OPT f=14 TT=552.569 T1=14.2	SAT (TO) f=15 TT=1800.06 T1=19.29	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-gr4x6.opb	UNSAT TT=0.016	UNSAT TT=0.027	UNSAT TT=0.016	UNSAT TT=7.499	UNSAT TT=0.569	? TT=148.972	? TT=159.598	UNSAT TT=1.154	? (TO) TT=1800	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3700.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=141.138	? TT=142.973	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3701.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? TT=141.57	? TT=148.229	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3702.opb		? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=141.251	? TT=143.537	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3703.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=138.241	? TT=140.204	? (TO) TT=1800.98	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3704.opb		? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=140.591	? TT=147.996	? (TO) TT=1800.72	? (TO) TT=1800.79	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3705.opb		? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=141.298	? TT=144.219	? (TO) TT=1800.02	? (TO) TT=1800.62	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3706.opb		? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=141.792	? TT=145.338	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3707.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=139.199	? TT=144.035	? (TO) TT=1802.21	? (TO) TT=1800.61	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3708.opb		? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=140.82	? TT=144.369	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3709.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=141.111	? TT=143.915	? (TO) TT=1800.14	? (TO) TT=1800.75	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370a.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=140.965	? TT=144.116	? (TO) TT=1800.17	? (TO) TT=1800.65	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370b.opb		? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=141.729	? TT=145.616	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370c.opb		? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=140.697	? TT=145.309	? (TO) TT=1800.77	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370e.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=147.291	? TT=143.748	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10a.opb	OPT f=20 TT=0.261 T1=0.26	OPT f=20 TT=1.044 T1=1.04	OPT f=20 TT=0.261 T1=0.26	OPT f=20 TT=2.346 T1=2.34	OPT f=20 TT=1.563 T1=1.55	? TT=160.558	? TT=160.033	SAT (TO) f=20 TT=1800.91 T1=0.85	SAT (TO) f=20 TT=1800.03 T1=0.35	OPT f=20 TT=0.307 T1=0.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10b.opb	UNSAT TT=0.023	UNSAT TT=0.036	UNSAT TT=0.023	UNSAT TT=5.907	UNSAT TT=14.24	? TT=162.964	? TT=161.446	UNSAT TT=1.974	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10c.opb	UNSAT TT=0.026	UNSAT TT=0.04	UNSAT TT=0.026	UNSAT TT=5.394	UNSAT TT=9.901	? TT=163.407	? TT=158.649	UNSAT TT=3.033	? (TO) TT=1800.7	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x12.opb	UNSAT TT=0.03	UNSAT TT=0.046	UNSAT TT=0.03	UNSAT TT=19.302	UNSAT TT=20.594	? TT=139.484	? TT=140.85	UNSAT TT=5.613	? (TO) TT=1800.13	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x26.opb	UNSAT TT=0.064	UNSAT TT=0.088	UNSAT TT=0.064	UNSAT TT=38.406	UNSAT TT=43.132	? TT=132.604	? TT=133.335	UNSAT TT=4.703	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x12.opb	UNSAT TT=0.034	UNSAT TT=0.051	UNSAT TT=0.034	UNSAT TT=643.936	UNSAT TT=386.504	? TT=134.085	? TT=139.905	UNSAT TT=5.234	? (TO) TT=1800.09	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x21.opb	UNSAT TT=0.062	UNSAT TT=0.083	UNSAT TT=0.062	UNSAT TT=34.867	UNSAT TT=201.639	? TT=154.623	? TT=149.867	UNSAT TT=4.361	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran13x13.opb	UNSAT TT=0.04	UNSAT TT=0.058	UNSAT TT=0.04	UNSAT TT=1203.33	? (TO) TT=1800.11	? TT=147.873	? TT=154.964	UNSAT TT=6.493	? (TO) TT=1800.66	? (TO) TT=1800.13
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran14x18.opb	UNSAT TT=0.064	UNSAT TT=0.085	UNSAT TT=0.064	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=155.32	? TT=153.895	UNSAT TT=8.543	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran16x16.opb	OPT f=35 TT=4.984 T1=4.91	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=35 TT=1800.02 T1=1800.3	OPT f=35 TT=6.705 T1=6.69	? TT=153.376	? TT=165.753	SAT (TO) f=37 TT=1800.84 T1=1.57	SAT (TO) f=37 TT=1800.03 T1=0.61	OPT f=35 TT=4.984 T1=4.91
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran17x17.opb	OPT f=35 TT=5.327 T1=5.25	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=35 TT=1800.02 T1=1800.3	OPT f=35 TT=8.624 T1=8.59	? TT=132.755	? TT=140.775	SAT (TO) f=36 TT=1800.01 T1=87.13	SAT (TO) f=38 TT=1800.06 T1=0.7	OPT f=35 TT=5.327 T1=5.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran4x64.opb	UNSAT TT=0.065	UNSAT TT=0.09	UNSAT TT=0.065	UNSAT TT=1.603	UNSAT TT=0.737	? TT=148.465	? TT=147.092	UNSAT TT=3.703	? (TO) TT=1800.87	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran6x43.opb	UNSAT TT=0.071	UNSAT TT=0.093	UNSAT TT=0.071	UNSAT TT=1.608	UNSAT TT=1.144	? TT=128.651	? TT=132.049	UNSAT TT=3.443	? (TO) TT=1800.92	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran8x32.opb	UNSAT TT=0.074	UNSAT TT=0.098	UNSAT TT=0.074	UNSAT TT=3.451	UNSAT TT=4.119	? TT=145.285	? TT=143.78	UNSAT TT=4.103	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome11.opb		? (exit code) TT=1.074	? (exit code) TT=0.006	? (TO) TT=1800.27	? (TO) TT=1800.1	? TT=125.571	? TT=126.811	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bc1.opb	UNSAT TT=183.597	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? (MO) TT=101.459	? (MO) TT=102.63	UNSAT TT=363.81	UNSAT TT=183.597	UNSAT TT=447.611
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst1.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=129.726	? TT=125.807	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst2.opb		? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=132.63	? TT=135.853	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_3.opb		? (exit code) TT=0.941	? (exit code) TT=0.005	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=112.769	? TT=111.572	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_4.opb		? (exit code) TT=0.945	? (exit code) TT=0.005	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=111.52	? TT=110.412	? (TO) TT=1800.7	? (TO) TT=1800.66	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_5.opb		? (exit code) TT=0.938	? (exit code) TT=0.006	? (TO) TT=1800.02	? (TO) TT=1800.14	? TT=111.393	? TT=111.334	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare1_1.opb	OPT f=0 TT=37.742 T1=37.74	OPT f=0 TT=37.742 T1=37.74	OPT f=0 TT=230.281 T1=230.31	SAT (TO) f=24 TT=1800.02 T1=1800.3	SAT (TO) f=7 TT=1800.01 T1=1800.3	? TT=142.284	? TT=152.27	SAT (TO) f=24 TT=1800.74 T1=1.69	SAT (TO) f=21 TT=1800 T1=1494.93	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare2_1.opb	OPT f=0 TT=55.86 T1=55.86	OPT f=0 TT=55.86 T1=55.86	OPT f=0 TT=420.676 T1=420.75	SAT (TO) f=46 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.02 T1=1800.3	? TT=145.625	? TT=141.762	SAT (TO) f=42 TT=1800.08 T1=875.93	SAT (TO) f=51 TT=1800.03 T1=448.37	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-mkc1.opb	SAT f=-2552 TT=1800.67 T1=1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT (TO) f=1595 TT=1800.28 T1=1800.4	? TT=85.573	? TT=86.437	SAT (TO) f=-2552 TT=1800.67 T1=2.08	SAT (TO) f=-2552 TT=1802.19 T1=1	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos11.opb	UNSAT TT=0.071	UNSAT TT=0.113	UNSAT TT=0.071	UNSAT TT=0.889	UNSAT TT=20.323	? (MO) TT=146.399	? (MO) TT=148.107	UNSAT TT=3.035	UNSAT TT=1.784	UNSAT TT=1.177
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos12.opb	UNSAT TT=0.24	UNSAT TT=0.373	UNSAT TT=0.24	UNSAT TT=3.612	UNSAT TT=53.351	? TT=145.47	? TT=147.52	UNSAT TT=3.594	UNSAT TT=2.432	UNSAT TT=3.803
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos13.opb	SAT f=-18596 TT=1800.04 T1=167.25	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? TT=121.817	? TT=120.651	SAT (TO) f=-18596 TT=1800.04 T1=167.25	? (TO) TT=1800.89	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos14.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=139.976	? TT=140.374	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos15.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=139.115	? TT=140.65	? (TO) TT=1800.73	? (TO) TT=1800.76	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos17.opb	UNSAT TT=0.073	UNSAT TT=0.112	UNSAT TT=0.073	UNSAT TT=2.863	UNSAT TT=18.24	? TT=137.351	? TT=134.863	UNSAT TT=2.086	UNSAT TT=1.273	UNSAT TT=0.522
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos20.opb	OPT f=-71 TT=53.063 T1=53.07	OPT f=-71 TT=124.471 T1=124.48	OPT f=-71 TT=53.063 T1=53.07	SAT (TO) f=-63 TT=1800.02 T1=1800.3	SAT (TO) f=-68 TT=1800.06 T1=1800.4	? (MO) TT=106.068	? (MO) TT=106.575	SAT (TO) f=-60 TT=1801.03 T1=109.06	SAT (TO) f=-56 TT=1800.08 T1=30.37	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos2.opb	OPT f=3 TT=3.94 T1=3.93	OPT f=3 TT=4.462 T1=4.45	OPT f=3 TT=3.94 T1=3.93	OPT f=3 TT=81.522 T1=81.51	OPT f=3 TT=254.119 T1=254.14	? TT=72.848	? TT=73.663	SAT (TO) f=3 TT=1800.01 T1=31.22	SAT (TO) f=3 TT=1800.04 T1=76.95	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos3.opb	OPT f=2 TT=6.906 T1=6.89	OPT f=2 TT=10.612 T1=10.6	OPT f=2 TT=6.906 T1=6.89	OPT f=2 TT=168.813 T1=168.84	OPT f=2 TT=372.008 T1=371.94	? TT=72.798	? TT=73.412	OPT f=2 TT=195.234 T1=96.84	OPT f=2 TT=555.922 T1=552.51	OPT f=2 TT=312.332 T1=310.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos6.opb	OPT f=0 TT=82.16 T1=82.11	OPT f=0 TT=82.16 T1=82.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=131.055	? TT=131.755	? (TO) TT=1800.12	? (TO) TT=1800.75	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos7.opb	SAT f=43 TT=1800.03 T1=1.74	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=101 TT=1800.07 T1=1800.4	SAT (TO) f=132 TT=1800.08 T1=1800.4	? TT=111.993	? TT=111.635	SAT (TO) f=48 TT=1800.96 T1=1.72	SAT (TO) f=43 TT=1800.03 T1=1.74	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos9.opb		? (exit code) TT=1.647	? (exit code) TT=0.006	? (TO) TT=1800.21	? (TO) TT=1800.29	? TT=38.888	? TT=38.594	? (TO) TT=1800.73	? (TO) TT=1800.62	? (TO) TT=1800.38
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-nug08.opb	OPT f=18 TT=6.155 T1=0.96	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=18 TT=1800.04 T1=1800.4	OPT f=18 TT=446.427 T1=446.4	? TT=141.871	? TT=143.133	SAT (TO) f=18 TT=1800.74 T1=1.5	SAT (TO) f=18 TT=1800.08 T1=0.96	OPT f=18 TT=6.155 T1=3.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-qap10.opb	SAT f=29 TT=1800.06 T1=2.02	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=29 TT=1800.08 T1=1800.4	SAT (TO) f=29 TT=1800.12 T1=1800.4	? TT=142.808	? TT=144.062	SAT (TO) f=29 TT=1800.92 T1=2.88	SAT (TO) f=29 TT=1800.06 T1=2.02	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-seymour1.opb	SAT f=106974 TT=1800.16 T1=287.52	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=192220 TT=1800.05 T1=1800.4	SAT (TO) f=126479 TT=1800.17 T1=1800.4	? (MO) TT=79.923	? (MO) TT=80.134	SAT (TO) f=106974 TT=1800.16 T1=287.52	SAT (TO) f=107713 TT=1800.42 T1=1.04	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath1.opb		? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? TT=1352.1	? TT=75.546	? TT=71.64	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath2.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1301.36	? TT=71.78	? TT=71.864	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath3.opb		? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1265.05	? TT=72.448	? TT=72.338	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A1C1S1.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? TT=143.685	? TT=143.465	? (TO) TT=1800.76	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A2C1S1.opb	UNSAT TT=875.798	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=875.798	? TT=142.198	? TT=142.154	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B1C1S1.opb	UNSAT TT=275.589	UNSAT TT=1188.27	UNSAT TT=1225.1	? (TO) TT=1800.08	UNSAT TT=275.589	? TT=152.686	? TT=149.697	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B2C1S1.opb	UNSAT TT=275.909	UNSAT TT=943.417	UNSAT TT=973.663	? (TO) TT=1800.1	UNSAT TT=275.909	? TT=152.153	? TT=150.262	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-berlin_5_8_0.opb	OPT f=2 TT=87.959 T1=87.94	OPT f=2 TT=87.959 T1=87.94	OPT f=2 TT=197.613 T1=197.63	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=93.973	? TT=96.533	SAT (TO) f=40 TT=1800.27 T1=810.53	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-bg512142.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=136.692	? TT=141.355	? (TO) TT=1801.05	? (TO) TT=1800.61	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-biella1.opb	UNSAT TT=0.456	UNSAT TT=0.545	UNSAT TT=0.456	? (TO) TT=1800.08	UNSAT TT=1676.99	? TT=117.297	? TT=116.68	UNSAT TT=212.822	? (TO) TT=1801.1	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ar98.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.34	? TT=142.493	? TT=146.345	? (TO) TT=1800.11	? (TO) TT=1800.57	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic97.opb	SAT f=264293 TT=1800.06 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=264293 TT=1800.06 T1=1800.3	? (TO) TT=1800.14	? TT=190.767	? TT=190.103	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic98.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.26	? TT=160.666	? TT=158.889	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ir98.opb	SAT f=264086 TT=1800.14 T1=291.92	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=141.356	? TT=138.579	SAT (TO) f=264086 TT=1800.14 T1=291.92	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-CMS750_4.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.29	? (TO) TT=1800.01	? (MO) TT=95.244	? (MO) TT=96.023	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2536-691.opb	SAT f=534 TT=1800.08 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT (TO) f=5863 TT=1800.08 T1=1800.4	SAT (TO) f=635 TT=1800.06 T1=1800.4	SAT (TO) f=651 TT=1800.1 T1=1800.4	SAT (TO) f=534 TT=1800.08 T1=1800.4	SAT (TO) f=581 TT=1800.63 T1=161.2	SAT (TO) f=584 TT=1800.01 T1=1.53	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2586-950.opb	SAT f=786 TT=1800.09 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=3923 TT=1800.06 T1=1800.4	SAT (TO) f=947 TT=1800.12 T1=1800.5	SAT (TO) f=910 TT=1800.01 T1=1800.3	SAT (TO) f=786 TT=1800.09 T1=1800.4	SAT (TO) f=790 TT=1800.6 T1=112.06	SAT (TO) f=792 TT=1800.06 T1=0.59	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4284-1064.opb	SAT f=899 TT=1800.1 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT (TO) f=6152 TT=1800.1 T1=1800.4	SAT (TO) f=1082 TT=1800.07 T1=1800.4	SAT (TO) f=1043 TT=1800.1 T1=1800.4	SAT (TO) f=899 TT=1800.1 T1=1800.4	SAT (TO) f=908 TT=1800.72 T1=123.65	SAT (TO) f=909 TT=1800.72 T1=1.18	? (TO) TT=1800.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4872-1529.opb	SAT f=1320 TT=1800.43 T1=602.56	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=8401 TT=1800.09 T1=1800.4	SAT (TO) f=1541 TT=1800.11 T1=1800.4	SAT (TO) f=1506 TT=1800.12 T1=1800.4	SAT (TO) f=1506 TT=1800.08 T1=1800.4	SAT (TO) f=1320 TT=1800.43 T1=602.56	SAT (TO) f=1323 TT=1800.1 T1=1.52	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1c.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=137.975	? TT=137.613	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1l.opb	SAT f=26800 TT=1800.96 T1=284.8	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.4	? TT=115.655	? TT=116.54	SAT (TO) f=26800 TT=1800.96 T1=284.8	? (TO) TT=1800.02	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dg012142.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=139.496	? TT=131.08	? (TO) TT=1800.8	? (TO) TT=1800.07	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dolom1.opb	UNSAT TT=0.374	UNSAT TT=0.533	UNSAT TT=0.374	UNSAT TT=645.074	UNSAT TT=517.258	? TT=123.7	? TT=124.407	UNSAT TT=5.483	UNSAT TT=45.766	UNSAT TT=158.727
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1100 TT=1800.05 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=8246 TT=1800.06 T1=1800.4	SAT (TO) f=1100 TT=1800.05 T1=1800.4	? TT=141.887	? TT=139.038	SAT (TO) f=1365 TT=1800.77 T1=579.45	SAT (TO) f=1289 TT=1800.02 T1=494.81	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-NSR8K.opb	UNSAT TT=1.185	UNSAT TT=1.529	UNSAT TT=1.185	? (TO) TT=1800.03	Signal TT=740.926	? (MO) TT=135.913	? (MO) TT=137.629	UNSAT TT=12.212	UNSAT TT=31.297	UNSAT TT=134.964
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-nsrand_ipx.opb	SAT f=393877 TT=1800.56 T1=878.37	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=499109 TT=1800.09 T1=1800.4	SAT (TO) f=505240 TT=1800.06 T1=1800.5	? TT=81.066	? TT=82.105	SAT (TO) f=393877 TT=1800.56 T1=878.37	No Cert. TT=1801.15	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-rail507.opb	SAT f=167 TT=1800.75 T1=212.7	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	Signal TT=3.426	SAT (TO) f=200 TT=1800.11 T1=1800.4	SAT (TO) f=200 TT=1800.14 T1=1800.4	SAT (TO) f=167 TT=1800.75 T1=212.7	No Cert. TT=1800	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-railway_8_1_0.opb	OPT f=147 TT=33.618 T1=33.59	OPT f=147 TT=33.618 T1=33.59	OPT f=147 TT=48.591 T1=48.59	? (TO) TT=1800.04	? (TO) TT=1800.11	? TT=93.897	? TT=96.352	? (TO) TT=1800.92	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=261403 TT=1800.01 T1=210.38	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=80.227	? TT=78.308	SAT (TO) f=262172 TT=1800.16 T1=219.74	SAT (TO) f=261403 TT=1800.01 T1=210.38	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-siena1.opb	UNSAT TT=0.411	UNSAT TT=0.612	UNSAT TT=0.411	UNSAT TT=709.349	UNSAT TT=985.152	? TT=115.946	? TT=115.878	UNSAT TT=5.584	UNSAT TT=20.641	UNSAT TT=97.141
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=1588 TT=1800.15 T1=2.13	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=17543 TT=1800.14 T1=1800.5	SAT (TO) f=3600 TT=1800.14 T1=1800.3	? TT=67.416	? TT=67.633	SAT (TO) f=1588 TT=1800.15 T1=2.13	SAT (TO) f=1602 TT=1800.07 T1=1.37	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ic.opb	SAT f=639 TT=1800.12 T1=1.99	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=15473 TT=1800.08 T1=1800.5	SAT (TO) f=1017 TT=1800.1 T1=1800.4	? TT=69.894	? TT=70.475	SAT (TO) f=639 TT=1800.12 T1=1.99	SAT (TO) f=640 TT=1800.92 T1=1.28	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ar.opb	SAT f=1144 TT=1800.01 T1=2.11	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=14268 TT=1800.05 T1=1800.4	SAT (TO) f=1810 TT=1800.17 T1=1800.4	? TT=69.509	? TT=69.654	SAT (TO) f=1144 TT=1800.01 T1=2.11	SAT (TO) f=1147 TT=1800.01 T1=1.69	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ic.opb	SAT f=712 TT=1800.45 T1=588.98	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=14674 TT=1800.13 T1=1800.5	SAT (TO) f=1071 TT=1800.16 T1=1800.4	? TT=72.698	? TT=72.512	SAT (TO) f=712 TT=1800.45 T1=588.98	SAT (TO) f=715 TT=1800.05 T1=793.36	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=124.584	? TT=125.444	? (TO) TT=1800.9	? (TO) TT=1800.58	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-trento1.opb	UNSAT TT=0.753	UNSAT TT=0.848	UNSAT TT=0.753	? (TO) TT=1800.09	? (TO) TT=1800.13	? (MO) TT=78.59	? TT=127.549	UNSAT TT=409.141	? (TO) TT=1800.47	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-UMTS.opb		? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=128.598	? TT=127.109	? (TO) TT=1802.09	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-usAbbrv.8.25_70.opb	OPT f=-5 TT=179.208 T1=179.22	OPT f=-5 TT=192.087 T1=192.08	OPT f=-5 TT=179.208 T1=179.22	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=93.906	? TT=99.028	? (TO) TT=1800.77	? (TO) TT=1800.65	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1800.24 T1=847.98	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=133.147	? TT=127.957	SAT (TO) f=39649 TT=1800.24 T1=847.98	SAT (TO) f=41696 TT=1800.08 T1=52.53	? (TO) TT=1800.27
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-maros.opb	OPT f=12 TT=0.014 T1=0.01	OPT f=12 TT=0.022 T1=0.02	OPT f=12 TT=0.014 T1=0.01	OPT f=12 TT=29.509 T1=29.51	OPT f=12 TT=1.272 T1=1.27	OPT f=12 TT=46.27 T1=46.26	OPT f=12 TT=53.905 T1=53.89	OPT f=12 TT=0.324 T1=1.64	SAT (TO) f=14 TT=1800.69 T1=0.14	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-nazareth.opb	OPT f=-174776 TT=0.012 T1=0.01	OPT f=-174776 TT=0.023 T1=0.02	OPT f=-174776 TT=0.012 T1=0.01	OPT f=-174776 TT=0.822 T1=0.82	OPT f=-174776 TT=5.01 T1=5.01	OPT f=-174776 TT=9.487 T1=9.44	OPT f=-174776 TT=13.203 T1=13.13	OPT f=-174776 TT=0.174 T1=0.63	OPT f=-174776 TT=0.165 T1=0.12	OPT f=-174776 TT=0.085 T1=0.08
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-testprob.opb	OPT f=262130 TT=0.014 T1=0.01	OPT f=262130 TT=0.025 T1=0.02	OPT f=262130 TT=0.014 T1=0.01	OPT f=262130 TT=0.122 T1=0.12	OPT f=262130 TT=4.3 T1=4.3	OPT f=262130 TT=22.833 T1=22.79	OPT f=262130 TT=37.33 T1=37.28	OPT f=262130 TT=0.184 T1=0.63	OPT f=262130 TT=0.514 T1=0.12	OPT f=262130 TT=3.391 T1=3.29

Statistics		cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
Number of times the solver is able to give the best known answer		83	84	59	81	11	11	118	57	42
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		14	60	5	19	2	4	50	19	6