PB'07 evaluation: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Reduced MPS to OPB

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Reduced MPS to OPB

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
absconPseudo 102
bsolo 3.0.16
bsolo 3.0.17
glpPB 0.2
minisat+ 1.14
oree 0.1.2 alpha
PB-clasp 2007-03-23
PB-clasp 2007-04-10
PBS4 2007-03-23
PBS4_v2 2007-03-23
Pueblo 1.4
sat4jPseudoCP 2007-03-23
sat4jPseudoCPClause 2007-03-23
SAT4JPseudoResolution 2007-03-23
wildcat-rnp 2007-03-21
wildcat-skc 2007-03-21

Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-25fv47.opb		? (TO) TT=1800.2	Signal TT=486.076	Signal TT=486.354	? (exit code) TT=93.018	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.23	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-80bau3b.opb	UNSAT TT=1.877	? TT=9.269	UNSAT TT=1.872	UNSAT TT=1.877	UNSAT TT=31.144	UNSAT TT=7.734	UNSAT TT=3.285	? (TO) TT=1800.24	? (TO) TT=1802.18	UNSAT TT=192.912	UNSAT TT=193.334	UNSAT TT=9.319	UNSAT TT=9.339	UNSAT TT=8.985	UNSAT TT=8.947	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-adlittle.opb	SAT f=13 TT=1782.73 T1=1782.69	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.14	? (exit code) TT=1.343	? (TO) TT=1800.08	? (TO) TT=1800.35	? (TO) TT=1800.21	? (TO) TT=1800.1	No Cert. TT=1800.1	SAT (TO) f=9129 TT=1800.05 T1=1800.03	SAT f=13 TT=1782.73 T1=1782.69	SAT (TO) f=21 TT=1800.35 T1=500.71	SAT (TO) f=16 TT=1800.33 T1=1361.15	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-afiro.opb	SAT f=-65 TT=1800.26 T1=384.79	? (TO) TT=1800.13	SAT (TO) f=-15 TT=1800.07 T1=12.46	SAT (TO) f=-15 TT=1800.06 T1=12.49	? (exit code) TT=7.166	SAT (TO) f=88 TT=1800.06 T1=937.15	? (TO) TT=1800.14	? (TO) TT=1800.21	? (TO) TT=1800.13	No Cert. TT=1800.03	SAT (TO) f=-34 TT=1800.1 T1=1800.08	SAT f=-18 TT=1782.73 T1=1782.64	SAT (TO) f=-65 TT=1800.26 T1=384.79	SAT (TO) f=-57 TT=1800.15 T1=1629.79	SAT (TO) f=-28 TT=1800.27 T1=1503.5	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg2.opb		? (TO) TT=1800.14	Signal TT=5.646	Signal TT=5.715	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.24	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.28	? (TO) TT=1800.36	? (TO) TT=1800.47	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg3.opb		? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (exit code) TT=767.302	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.25	? (TO) TT=1800.36	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg.opb	SAT f=-3762 TT=1782.75 T1=1782.69	? (TO) TT=1800.12	SAT (TO) f=24697 TT=1800.15 T1=777.87	SAT (TO) f=24697 TT=1800.24 T1=770.07	? (exit code) TT=866.718	? (TO) TT=1800.14	? (TO) TT=1800.3	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT f=-3762 TT=1782.75 T1=1782.69	? (TO) TT=1800.21	SAT (TO) f=34499 TT=1800.4 T1=33.38	SAT (TO) f=87738 TT=1800.5 T1=122.58	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bandm.opb	UNSAT TT=0.456	? (TO) TT=1800.1	UNSAT TT=0.453	UNSAT TT=0.456	UNSAT TT=0.513	UNSAT TT=15.154	? (TO) TT=1800.11	? (TO) TT=1800.43	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=1.65	UNSAT TT=17.324	UNSAT TT=18.015	UNSAT TT=5.557	? (TO) TT=1800.02	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-beaconfd.opb	SAT f=1238 TT=1802.04 T1=3.28	? (TO) TT=1800.17	? TT=1800.05	? (TO) TT=1800.07	? (exit code) TT=314.368	? (TO) TT=1800.15	? (TO) TT=1800.18	? (MO) TT=40.78	SAT (TO) f=1238 TT=1802.04 T1=3.28	No Cert. TT=1800.07	SAT (TO) f=12336 TT=1800.09 T1=1633.2	? (TO) TT=1800.05	SAT (TO) f=3098 TT=1800.34 T1=504.83	? (TO) TT=1800.28	? (TO) TT=1800.19	? (TO) TT=1800.18	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-blend.opb	SAT f=-22 TT=1800.34 T1=417.04	? (TO) TT=1800.17	Signal TT=0.472	Signal TT=0.451	? (exit code) TT=1.498	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.26	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	SAT f=-5 TT=1782.73 T1=1782.67	SAT (TO) f=-22 TT=1800.34 T1=417.04	? (TO) TT=1800.42	? (TO) TT=1800.28	? (TO) TT=1800.09	? (TO) TT=1800.02
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl1.opb	UNSAT TT=2.758	? (TO) TT=1800.15	UNSAT TT=5.777	UNSAT TT=5.79	? (exit code) TT=6.778	UNSAT TT=25.273	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=1525.55	UNSAT TT=1435.16	UNSAT TT=2.758	UNSAT TT=4.846	UNSAT TT=4.865	UNSAT TT=6.399	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl2.opb	UNSAT TT=3.472	? (TO) TT=1800.36	UNSAT TT=3.463	UNSAT TT=3.472	? (exit code) TT=80.945	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=48.793	UNSAT TT=59.944	? (TO) TT=1800.27	? (TO) TT=1800.26	? (TO) TT=1800.65	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing1.opb		? (TO) TT=1800.06	Signal TT=1.913	Signal TT=1.979	? (exit code) TT=50.353	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.25	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing2.opb		? (TO) TT=1800.14	Signal TT=0.647	Signal TT=0.647	? (exit code) TT=34.506	? (TO) TT=1800.08	? (TO) TT=1800.82	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.21	? (TO) TT=1800.25	? (TO) TT=1800.31	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bore3d.opb	UNSAT TT=0.141	UNSAT TT=0.902	UNSAT TT=0.143	UNSAT TT=0.141	UNSAT TT=0.223	UNSAT TT=0.958	UNSAT TT=0.226	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=0.456	UNSAT TT=0.453	UNSAT TT=0.23	UNSAT TT=2.345	UNSAT TT=2.338	UNSAT TT=2.347	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-brandy.opb	UNSAT TT=6.579	? (TO) TT=1800.05	? TT=1800.07	? (TO) TT=1800.1	? (exit code) TT=0.996	? (TO) TT=1800.14	? (TO) TT=1800.27	? (MO) TT=43.44	? (TO) TT=1802.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=6.579	UNSAT TT=9.616	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-capri.opb		? (TO) TT=1800.14	Signal TT=252.762	Signal TT=252.854	? (exit code) TT=56.466	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.21	? (TO) TT=1800.22	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-cycle.opb	SAT f=-1 TT=1782.84 T1=1782.69	? (TO) TT=1800.29	? (TO) TT=1800.09	? (TO) TT=1800.1	? (exit code) TT=656.304	? (TO) TT=1800.1	? (TO) TT=1800.26	? (TO) TT=1800.28	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT f=-1 TT=1782.84 T1=1782.69	? (TO) TT=1800.22	? (TO) TT=1800.26	? (TO) TT=1800.2	? (TO) TT=1800.12	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-czprob.opb	UNSAT TT=7.144	? (TO) TT=1800.25	Signal TT=91.88	Signal TT=92.475	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.18	UNSAT TT=518.774	UNSAT TT=515.92	UNSAT TT=314.188	UNSAT TT=7.454	UNSAT TT=7.144	UNSAT TT=8.727	? (TO) TT=1800.11	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d2q06c.opb	UNSAT TT=1744.78	? TT=12.583	Signal TT=412.187	Signal TT=411.075	? (exit code) TT=267.753	? (TO) TT=1800.22	? (TO) TT=1800.1	? (TO) TT=1800.23	? (TO) TT=1800.08	UNSAT TT=1745.41	UNSAT TT=1744.78	? (TO) TT=1800.09	? (TO) TT=1800.26	? (TO) TT=1800.24	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.09
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d6cube.opb	UNSAT TT=254.249	? (TO) TT=1800.26	UNSAT TT=254.027	UNSAT TT=254.249	? (exit code) TT=769.81	Signal TT=1518.92	? (TO) TT=1802.08	? (TO) TT=1801.99	? (TO) TT=1802	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=728.93	? (TO) TT=1800.21	? (TO) TT=1800.21	UNSAT TT=1467.99	? (TO) TT=1801.49	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen2.opb	UNSAT TT=24.655	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.05	? (exit code) TT=5.269	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=36.025	UNSAT TT=24.655	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen3.opb		? (TO) TT=1800.18	? (MO) TT=356.536	? (MO) TT=354.74	? (exit code) TT=394.252	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.2	? (TO) TT=1800.23	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.22	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-dfl001.opb		? TT=12.496	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.08	? (MO) TT=584.876	? (TO) TT=1800.24	? (MO) TT=928	? (TO) TT=1802.02	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.26	? (TO) TT=1800.26	? (TO) TT=1800.2	? (TO) TT=1800.11	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-e226.opb	UNSAT TT=9.713	? (TO) TT=1800.13	UNSAT TT=142.037	UNSAT TT=142.172	? (exit code) TT=37.076	UNSAT TT=16.757	? (TO) TT=1800.33	? (TO) TT=1800.14	? (TO) TT=1800.07	UNSAT TT=24.378	UNSAT TT=24.047	UNSAT TT=60.379	UNSAT TT=9.713	UNSAT TT=10.163	UNSAT TT=11.216	? (TO) TT=1800.11	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-etamacro.opb	SAT f=41 TT=1782.75 T1=1782.63	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT f=41 TT=1782.75 T1=1782.63	? (TO) TT=1800.22	? (TO) TT=1800.23	? (TO) TT=1800.25	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fffff800.opb		? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.1	? (exit code) TT=22.619	? (TO) TT=1800.12	? (TO) TT=1800.13	? (MO) TT=39.49	? (TO) TT=1802.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.26	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1d.opb	SAT f=0 TT=1783.19 T1=1783.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.16	? (MO) TT=589.814	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT f=0 TT=1783.19 T1=1783.13	? (TO) TT=1800.16	? (TO) TT=1800.24	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1p.opb	OPT f=0 TT=6.461 T1=6.38	? (TO) TT=1800.12	OPT f=0 TT=17.314 T1=17.18	OPT f=0 TT=16.994 T1=16.78	OPT f=0 TT=6.461 T1=6.38	? (TO) TT=1800.17	? (TO) TT=1800.26	? (MO) TT=67.484	OPT f=0 TT=132.195 T1=130.41	? (TO) TT=1800.09	? (TO) TT=1800.06	OPT f=0 TT=7.583 T1=7.49	OPT f=0 TT=12.546 T1=9.4	OPT f=0 TT=12.328 T1=9.29	OPT f=0 TT=12.277 T1=9.08	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2d.opb		? TT=8.584	Signal TT=203.206	Signal TT=200.255	? (TO) TT=1800.06	Signal TT=29.173	? (MO) TT=828.419	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.2	? (TO) TT=1802.16	? (TO) TT=1800.07
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2p.opb	SAT f=1059 TT=1800.25 T1=432.08	? TT=11.714	Wrong Cert. TT=1800.29	SAT (TO) f=1059 TT=1800.25 T1=432.08	? (TO) TT=1800.09	? (TO) TT=1800.3	? (TO) TT=1800.2	? (MO) TT=1572.14	? (TO) TT=1802.03	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.26	? (TO) TT=1800.49	? (TO) TT=1800.21	? (TO) TT=1800.53	? (TO) TT=1800.92
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-forplan.opb		? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.49	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ganges.opb		? (TO) TT=1800.24	Signal TT=524.555	Signal TT=510.165	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.28	? (TO) TT=1800.19	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.24	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-gfrd-pnc.opb		? (TO) TT=1800.18	? (TO) TT=1800.2	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.16	? (MO) TT=48.213	? (TO) TT=1802.04	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbea.opb		? TT=8.938	Signal TT=56.125	Signal TT=56.084	? (exit code) TT=1765.22	? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.21	? (TO) TT=1800.25	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbeb.opb		? TT=8.737	Signal TT=46.682	Signal TT=46.46	? (exit code) TT=1416.92	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.32	? (TO) TT=1802.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.19	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow15.opb	SAT f=0 TT=1782.75 T1=0.49	? (TO) TT=1800.14	Signal TT=3.94	Signal TT=3.875	? (exit code) TT=735.622	? (TO) TT=1800.12	? (TO) TT=1800.49	? (TO) TT=1800.2	? (TO) TT=1800.06	No Cert. TT=1800.09	SAT (TO) f=0 TT=1800.13 T1=1800.09	SAT f=0 TT=1782.75 T1=0.49	? (TO) TT=1800.27	? (TO) TT=1800.26	? (TO) TT=1800.27	? (TO) TT=1800.08	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow22.opb	SAT f=0 TT=1782.76 T1=0.79	? (TO) TT=1800.12	Signal TT=5.713	Signal TT=5.711	? (exit code) TT=1363.98	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.25	? (TO) TT=1800.08	No Cert. TT=1800.13	SAT (TO) f=0 TT=1800.08 T1=1800.02	SAT f=0 TT=1782.76 T1=0.79	? (TO) TT=1800.22	? (TO) TT=1800.34	? (TO) TT=1800.33	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow7.opb	SAT f=0 TT=1782.75 T1=0.19	? (TO) TT=1800.08	Signal TT=1.771	Signal TT=1.833	? (exit code) TT=53.641	? (TO) TT=1800.06	? (TO) TT=1801.01	? (TO) TT=1800.2	? (TO) TT=1800.11	No Cert. TT=1800.03	SAT (TO) f=0 TT=1800.1 T1=1800.07	SAT f=0 TT=1782.75 T1=0.19	? (TO) TT=1800.28	? (TO) TT=1800.26	? (TO) TT=1800.28	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-israel.opb	SAT f=-35 TT=1800.28 T1=1626.83	? (TO) TT=1800.13	SAT (TO) f=8 TT=1800.06 T1=204.82	SAT (TO) f=8 TT=1800.1 T1=205.22	? (exit code) TT=72.686	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	No Cert. TT=1800.04	SAT (TO) f=45 TT=1800.09 T1=1800.08	SAT f=-30 TT=1782.74 T1=1782.63	SAT (TO) f=-35 TT=1800.28 T1=1626.83	SAT (TO) f=-31 TT=1800.48 T1=1363.32	SAT (TO) f=-25 TT=1800.31 T1=8.11	? (TO) TT=1800.07	? (TO) TT=1800.02
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-kb2.opb	OPT f=-293850 TT=7.713 T1=7.6	? (TO) TT=1800.05	SAT f=-132361 TT=1800.05 T1=896.47	SAT (TO) f=-132361 TT=1800.07 T1=896.15	? (exit code) TT=1.102	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.05	No Cert. TT=1800.06	SAT (TO) f=-293735 TT=1800.09 T1=1800.06	SAT f=-32343 TT=1782.73 T1=1782.66	OPT f=-293850 TT=8.975 T1=8.85	OPT f=-293850 TT=7.713 T1=7.6	OPT f=-293850 TT=87.03 T1=87.03	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-lotfi.opb		? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.17	? (exit code) TT=0.885	? (TO) TT=1800.12	? (TO) TT=1800.49	? (TO) TT=1800.41	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.26	? (TO) TT=1800.34	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros.opb		? (TO) TT=1800.14	Signal TT=15.097	Signal TT=15.058	? (exit code) TT=35.868	? (TO) TT=1800.13	? (TO) TT=1800.26	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.26	? (TO) TT=1800.35	? (TO) TT=1800.19	? (TO) TT=1800.05	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros-r7.opb	SAT f=51973 TT=1514.15 T1=166.9	? TT=14.173	SAT (MO) f=51973 TT=1515.78 T1=167.25	SAT (MO) f=51973 TT=1514.15 T1=166.9	? (problem) TT=1133.62	? (TO) TT=1800.1	SAT (TO) f=258330 TT=1801.7 T1=1570.42	? (MO) TT=946.424	? (TO) TT=1802.02	No Cert. TT=1800.14	SAT (TO) f=236137 TT=1800.24 T1=427.94	? (TO) TT=1800.14	? (TO) TT=1800.29	? (TO) TT=1800.28	? (TO) TT=1800.21	? (TO) TT=1800.15	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-modszk1.opb	SAT f=161 TT=1801.99 T1=26.76	SAT (TO) f=263 TT=1800.19 T1=1559.98	? (TO) TT=1800.17	? (TO) TT=1800.24	? (exit code) TT=622.75	? (TO) TT=1800.12	? (TO) TT=1800.35	? (MO) TT=55.127	SAT (TO) f=161 TT=1801.99 T1=26.76	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-nesm.opb		? (TO) TT=1800.24	? (TO) TT=1800.16	? (TO) TT=1800.24	? (exit code) TT=142.837	? (TO) TT=1800.16	? (TO) TT=1800.15	? (MO) TT=49.492	? (TO) TT=1801.98	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.22	? (TO) TT=1800.38	? (TO) TT=1800.21	? (TO) TT=1800.06	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-perold.opb		? (TO) TT=1800.13	Signal TT=99.583	Signal TT=98.833	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1802.14	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.3	? (TO) TT=1800.29	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot4.opb		? (TO) TT=1800.09	? TT=1800.08	? (TO) TT=1800.1	? (exit code) TT=49.446	? (TO) TT=1800.13	? (TO) TT=1800.26	? (TO) TT=1802.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.27	? (TO) TT=1800.28	? (TO) TT=1800.32	? (TO) TT=1800.11	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot87.opb	UNSAT TT=3.208	? TT=14.837	UNSAT TT=3.191	UNSAT TT=3.208	? (TO) TT=1800.11	UNSAT TT=10.476	UNSAT TT=4.507	? (TO) TT=1800.29	? (TO) TT=1800.21	UNSAT TT=22.704	UNSAT TT=22.693	UNSAT TT=8.133	UNSAT TT=8.35	UNSAT TT=8.074	UNSAT TT=8.359	? (TO) TT=1800.12	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.opb	UNSAT TT=1.928	UNSAT TT=8.867	UNSAT TT=1.92	UNSAT TT=1.928	? (TO) TT=1800.04	UNSAT TT=12.216	UNSAT TT=2.621	? (TO) TT=1800.22	? (TO) TT=1800.23	UNSAT TT=12.126	UNSAT TT=11.339	UNSAT TT=4.852	UNSAT TT=8.819	UNSAT TT=8.533	UNSAT TT=8.73	? (TO) TT=1800.16	? (TO) TT=1800.05
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.we.opb		? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.19	? (exit code) TT=162.327	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.27	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-recipe.opb	SAT f=-111787 TT=1800.47 T1=277.7	? (TO) TT=1800.1	Signal TT=0.535	Signal TT=0.502	? (exit code) TT=34.735	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT f=-82060 TT=1782.74 T1=1782.64	SAT (TO) f=-61066 TT=1800.29 T1=3.25	SAT (TO) f=-52384 TT=1800.28 T1=65.28	SAT (TO) f=-111787 TT=1800.47 T1=277.7	? (TO) TT=1800.1	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc105.opb	SAT f=-2 TT=1782.74 T1=1782.64	? (TO) TT=1800.06	SAT f=0 TT=1800.04 T1=0.09	SAT (TO) f=0 TT=1800.05 T1=0.09	? (exit code) TT=2.183	? (TO) TT=1800.07	? (TO) TT=1800.67	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT f=-2 TT=1782.74 T1=1782.64	SAT (TO) f=0 TT=1800.47 T1=2.78	SAT (TO) f=0 TT=1800.34 T1=3.99	? (TO) TT=1800.24	? (TO) TT=1800.03	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc205.opb	SAT f=0 TT=1782.74 T1=0	? (TO) TT=1800.15	SAT f=0 TT=1800.04 T1=0.09	SAT (TO) f=0 TT=1800.09 T1=0.2	? (exit code) TT=6.966	? (TO) TT=1800.16	? (TO) TT=1800.36	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT f=0 TT=1782.74 T1=0	? (TO) TT=1800.28	SAT (TO) f=0 TT=1800.43 T1=4.84	? (TO) TT=1800.26	? (TO) TT=1800.1	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50a.opb	SAT f=-11 TT=1800.28 T1=816.26	? (TO) TT=1800.1	SAT f=-10 TT=1800.01 T1=672.53	SAT (TO) f=-10 TT=1800.09 T1=670	? (exit code) TT=0.196	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	No Cert. TT=1800.03	SAT (TO) f=0 TT=1800.03 T1=1800.01	SAT f=-9 TT=1782.74 T1=1782.65	SAT (TO) f=-11 TT=1800.28 T1=816.26	SAT (TO) f=-9 TT=1800.19 T1=305.99	SAT (TO) f=0 TT=1800.26 T1=2.93	? (TO) TT=1800.03	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50b.opb	SAT f=-12 TT=1800.22 T1=235.43	? (TO) TT=1800.14	SAT f=-3 TT=1800.01 T1=28.88	SAT (TO) f=-3 TT=1800.05 T1=28.68	? (exit code) TT=5.74	? (TO) TT=1800.1	? (TO) TT=1800.62	? (TO) TT=1800.11	? (TO) TT=1800.04	No Cert. TT=1800.03	SAT (TO) f=0 TT=1800.07 T1=1800.04	SAT f=-7 TT=1782.74 T1=1782.71	SAT (TO) f=-12 TT=1800.26 T1=235.43	SAT (TO) f=-12 TT=1800.22 T1=458.61	SAT (TO) f=-3 TT=1800.69 T1=164.71	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr25.opb		? (TO) TT=1800.08	Signal TT=62.913	Signal TT=62.796	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1800.17	? (TO) TT=1800.26	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr7.opb	SAT f=472 TT=1782.74 T1=1782.65	? (TO) TT=1800.09	Signal TT=263.691	Signal TT=263.173	? (exit code) TT=40.852	? (TO) TT=1800.12	? (TO) TT=1800.28	? (TO) TT=1800.4	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT f=472 TT=1782.74 T1=1782.65	SAT (TO) f=605 TT=1800.39 T1=107.38	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm1.opb		? (TO) TT=1800.06	Signal TT=1120.54	Signal TT=1117.82	? (exit code) TT=30.165	? (TO) TT=1800.11	? (TO) TT=1800.25	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.27	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm2.opb		? (TO) TT=1800.1	Signal TT=1522.35	Signal TT=1518.38	? (exit code) TT=185.645	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.29	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.19	? (TO) TT=1800.24	? (TO) TT=1800.33	? (TO) TT=1800.05	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm3.opb		? (TO) TT=1800.12	Signal TT=133.527	Signal TT=115.188	? (exit code) TT=19.65	? (TO) TT=1800.11	? (TO) TT=1800.36	? (TO) TT=1800.22	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.25	? (TO) TT=1800.33	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scorpion.opb		? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.12	? (exit code) TT=0.645	? (TO) TT=1800.11	? (TO) TT=1800.31	? (MO) TT=42.45	? (TO) TT=1802.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.26	? (TO) TT=1800.19	? (TO) TT=1800.31	? (TO) TT=1800.02	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scrs8.opb	UNSAT TT=0.876	? (TO) TT=1800.12	? TT=1800.09	? (TO) TT=1800.19	UNSAT TT=0.876	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.22	? (TO) TT=1800.29	? (TO) TT=1800.22	? (TO) TT=1800.16	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd1.opb	SAT f=4 TT=1800.07 T1=20.08	? (TO) TT=1800.11	SAT (TO) f=4 TT=1800.13 T1=18.79	SAT (TO) f=4 TT=1800.07 T1=20.08	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.34	? (MO) TT=46.981	SAT (TO) f=1567 TT=1802.01 T1=18.07	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.31	? (TO) TT=1800.16	? (TO) TT=1800.28	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd6.opb		? (TO) TT=1800.1	? (MO) TT=724.251	? (MO) TT=720.158	? (exit code) TT=502.766	? (TO) TT=1800.12	? (TO) TT=1801.03	? (MO) TT=66.084	? (TO) TT=1801.97	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.24	? (TO) TT=1800.24	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd8.opb		? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1801.29	? (MO) TT=162.3	? (TO) TT=1802.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.29	? (TO) TT=1800.28	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap1.opb	SAT f=224 TT=1800.15 T1=251.22	? (TO) TT=1800.12	SAT (TO) f=224 TT=1800.12 T1=240.94	SAT (TO) f=224 TT=1800.15 T1=251.22	? (exit code) TT=80.902	? (TO) TT=1800.07	? (TO) TT=1800.03	? (MO) TT=43.43	SAT (TO) f=2956 TT=1802.05 T1=5.34	No Cert. TT=1800.03	SAT (TO) f=3426 TT=1800.05 T1=1.99	SAT f=545 TT=1782.76 T1=976.62	SAT (TO) f=7121 TT=1800.76 T1=582.78	SAT (TO) f=6549 TT=1800.8 T1=1293.71	SAT (TO) f=4562 TT=1800.87 T1=357.35	? (TO) TT=1800.13	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap2.opb	SAT f=885 TT=1782.77 T1=752.98	? (TO) TT=1800.24	? (TO) TT=1800.15	? (TO) TT=1800.19	? (exit code) TT=36.066	? (TO) TT=1800.19	? (TO) TT=1800.25	? (MO) TT=73.584	SAT (TO) f=1360 TT=1801.98 T1=92.92	No Cert. TT=1800.09	SAT (TO) f=7949 TT=1800.1 T1=40.68	SAT f=885 TT=1782.77 T1=752.98	? (TO) TT=1800.24	? (TO) TT=1800.19	? (TO) TT=1800.33	? (TO) TT=1800.23	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap3.opb	SAT f=1895 TT=1802 T1=165.11	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.18	? (exit code) TT=231.244	? (TO) TT=1800.14	? (TO) TT=1800.34	? (MO) TT=95.122	SAT (TO) f=1895 TT=1802 T1=165.11	No Cert. TT=1800.04	SAT (TO) f=9462 TT=1800.09 T1=313.51	SAT f=2519 TT=1782.78 T1=3.89	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.26	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-seba.opb	UNSAT TT=5.45	? (TO) TT=1800.13	? TT=1800.01	? (TO) TT=1800.03	? (exit code) TT=72.339	UNSAT TT=8.802	UNSAT TT=809.855	? (MO) TT=46.592	UNSAT TT=226.682	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1682.21	UNSAT TT=5.45	UNSAT TT=5.455	UNSAT TT=304.393	? (TO) TT=1800.13	? (TO) TT=1800.09
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share1b.opb		? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.24	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share2b.opb	OPT f=-52 TT=64.568 T1=11.26	? (TO) TT=1800.12	SAT (TO) f=-27 TT=1800.03 T1=3.08	SAT (TO) f=-27 TT=1800.05 T1=3.09	? (exit code) TT=0.76	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT f=-24 TT=1782.74 T1=1782.71	SAT (TO) f=-52 TT=1800.32 T1=11.26	OPT f=-52 TT=64.568 T1=11.35	? (TO) TT=1800.27	? (TO) TT=1800.02	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-shell.opb		? (TO) TT=1800.22	? (TO) TT=1800.1	? (TO) TT=1800.18	? (exit code) TT=439.013	? (TO) TT=1800.14	? (TO) TT=1800.2	? (MO) TT=66.564	? (TO) TT=1802	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04l.opb	SAT f=1776 TT=1800.15 T1=43.46	? (TO) TT=1800.17	? (TO) TT=1800.31	? (TO) TT=1800.24	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.28	? (MO) TT=105.59	? (TO) TT=1801.99	No Cert. TT=1800.06	SAT (TO) f=1776 TT=1800.15 T1=43.46	? (TO) TT=1800.13	? (TO) TT=1800.2	? (TO) TT=1800.24	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04s.opb	SAT f=2333 TT=1800.06 T1=280.2	? (TO) TT=1800.13	? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.01	? (TO) TT=1800.12	? (MO) TT=1657.04	? (MO) TT=73.969	? (TO) TT=1802.01	No Cert. TT=1800.02	SAT (TO) f=2333 TT=1800.06 T1=280.2	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08l.opb	SAT f=2684 TT=1800.15 T1=278.02	? (TO) TT=1800.2	? (TO) TT=1800.24	? (TO) TT=1800.25	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.26	? (MO) TT=396.032	? (TO) TT=1801.99	No Cert. TT=1800.07	SAT (TO) f=2684 TT=1800.15 T1=278.02	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08s.opb		? (TO) TT=1800.19	? TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.87	? (MO) TT=127.785	? (TO) TT=1801.99	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.27	? (TO) TT=1800.14	? (TO) TT=1802.07	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12l.opb		? (TO) TT=1800.34	? (TO) TT=1800.15	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1801.13	? (MO) TT=666.317	? (TO) TT=1801.99	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.27	? (TO) TT=1800.24	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12s.opb		? (TO) TT=1800.23	? (TO) TT=1800.18	? (TO) TT=1800.23	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.94	? (MO) TT=162.07	? (TO) TT=1801.96	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.28	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sierra.opb		? (TO) TT=1800.24	? (TO) TT=1800.18	? (TO) TT=1800.25	? (exit code) TT=258.668	? (TO) TT=1800.17	? (TO) TT=1800.11	? (MO) TT=57.207	? (TO) TT=1801.96	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.27	? (TO) TT=1800.16	? (TO) TT=1800.62	? (TO) TT=1800.3	? (TO) TT=1800.11
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stair.opb	UNSAT TT=18.319	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (exit code) TT=2.6	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=53.555	UNSAT TT=20.357	UNSAT TT=18.319	? (TO) TT=1800.02	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standata.opb		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.23	? (exit code) TT=327.332	? (TO) TT=1800.11	? (TO) TT=1800.12	? (MO) TT=41.33	? (TO) TT=1802.05	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.26	? (TO) TT=1800.37	? (TO) TT=1800.13	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standgub.opb		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.14	? (exit code) TT=355.75	? (TO) TT=1800.07	? (TO) TT=1800.19	? (MO) TT=41.53	? (TO) TT=1802.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.2	? (TO) TT=1800.26	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor1.opb	SAT f=-37 TT=1800.31 T1=1679.72	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.12	? (exit code) TT=8.84	? (TO) TT=1800.12	? (TO) TT=1800.32	? (TO) TT=1800.21	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT f=3530 TT=1782.73 T1=1782.7	SAT (TO) f=-37 TT=1800.31 T1=1679.72	SAT (TO) f=-19 TT=1800.36 T1=222.48	? (TO) TT=1800.24	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor2.opb		? (TO) TT=1800.26	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.25	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.25	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-tuff.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.11	? (exit code) TT=25.014	? (TO) TT=1800.12	? (TO) TT=1800.9	? (MO) TT=49.777	? (TO) TT=1801.94	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-vtp.base.opb	UNSAT TT=78.792	? (TO) TT=1800.12	? TT=1800.05	? (TO) TT=1800.15	? (exit code) TT=8.013	UNSAT TT=1121.56	? (TO) TT=1800.41	? (MO) TT=43.41	? (TO) TT=1802.12	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=78.792	? (TO) TT=1800.18	? (TO) TT=1800.26	? (TO) TT=1800.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-wood1p.opb	UNSAT TT=845.991	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1802.07	? (MO) TT=675.145	UNSAT TT=845.991	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.24	? (TO) TT=1800.2	? (TO) TT=1800.18	? (TO) TT=1800.48	? (TO) TT=1800.18
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-woodw.opb		? TT=20.981	? (TO) TT=1800.05	? (TO) TT=1800.1	? (exit code) TT=195.626	? (TO) TT=1800.08	? (TO) TT=1802.13	? (MO) TT=238.818	? (TO) TT=1802.02	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-a1c1s1.opb	UNSAT TT=10.038	? TT=8.618	UNSAT TT=71.345	UNSAT TT=70.652	? (exit code) TT=124.769	? (TO) TT=1800.23	? (TO) TT=1800.09	? (MO) TT=74.211	UNSAT TT=44.713	? (TO) TT=1800.11	? (TO) TT=1800.11	UNSAT TT=12.711	? (TO) TT=1800.19	UNSAT TT=334.614	UNSAT TT=10.038	? (TO) TT=1800.24	? (TO) TT=1800.06
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow30a.opb	SAT f=3248 TT=1782.76 T1=158.75	? (TO) TT=1800.16	? (MO) TT=970.434	? (MO) TT=970.506	? (exit code) TT=64.092	? (TO) TT=1800.08	? (TO) TT=1800.35	? (MO) TT=38.5	? (TO) TT=1802.08	No Cert. TT=1800.08	SAT (TO) f=4687 TT=1800.05 T1=0.19	SAT f=3248 TT=1782.76 T1=158.75	? (TO) TT=1800.22	? (TO) TT=1800.22	SAT (TO) f=5110 TT=1800.37 T1=394.78	? (TO) TT=1800.12	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow40b.opb	SAT f=8046 TT=1800.07 T1=5.79	? (TO) TT=1800.13	? (MO) TT=561.96	? (MO) TT=593.373	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1801.1	? (MO) TT=34.714	? (TO) TT=1802.04	No Cert. TT=1800.09	SAT (TO) f=8046 TT=1800.07 T1=5.79	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air04.opb	SAT f=5953 TT=1800.16 T1=1.99	? (TO) TT=1800.08	SAT (TO) f=5953 TT=1800.12 T1=1.96	SAT (TO) f=5953 TT=1800.16 T1=1.99	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1802.09	? (TO) TT=1801.98	? (TO) TT=1802.08	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.22	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air05.opb	SAT f=4324 TT=1800.35 T1=2.19	? (TO) TT=1800.13	SAT (TO) f=4324 TT=1800.29 T1=2.09	SAT (TO) f=4324 TT=1800.35 T1=2.19	? (TO) TT=1800.05	SAT (TO) f=5462 TT=1800.18 T1=179.33	? (TO) TT=1801.22	SAT (MO) f=6369 TT=76.42 T1=37.75	SAT (TO) f=5233 TT=1802.08 T1=1478.95	No Cert. TT=1800.05	SAT (TO) f=5380 TT=1800.04 T1=587.31	SAT f=5278 TT=1782.74 T1=872.95	SAT (TO) f=5415 TT=1800.44 T1=173.82	SAT (TO) f=5799 TT=1800.44 T1=138.41	SAT (TO) f=5423 TT=1800.48 T1=636.73	SAT (TO) f=5639 TT=1800.09 T1=1228.69	SAT (TO) f=5084 TT=1800.04 T1=1500
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-arki001.opb	UNSAT TT=3.24	? (TO) TT=1800.29	? (TO) TT=1800.08	? (TO) TT=1800.17	UNSAT TT=3.24	? (TO) TT=1800.12	? (TO) TT=1800.22	? (MO) TT=40.3	? (TO) TT=1802.15	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=3.825	? (TO) TT=1800.29	? (TO) TT=1800.22	? (TO) TT=1800.11	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-atlanta-ip.opb	UNSAT TT=10.145	? TT=7.91	UNSAT TT=22.173	UNSAT TT=22.531	UNSAT TT=227.081	? (TO) TT=1800.05	UNSAT TT=631.265	? (MO) TT=63.295	UNSAT TT=199.989	UNSAT TT=10.2	UNSAT TT=10.145	UNSAT TT=13.906	UNSAT TT=14.981	UNSAT TT=14.917	UNSAT TT=11.188	? (TO) TT=1800.13	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-dano3mip.opb		? TT=16.375	? TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.37	? (TO) TT=1800.25	? (MO) TT=204.413	? (TO) TT=1802.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.3	? (TO) TT=1800.22	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-danoint.opb		? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.14	? (MO) TT=39.48	? (TO) TT=1801.94	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-fiber.opb	SAT f=6456 TT=1800.32 T1=427.33	? (TO) TT=1800.15	SAT f=12190 TT=1800.02 T1=1.59	SAT (TO) f=12190 TT=1800.12 T1=1.59	? (TO) TT=1800.09	SAT (TO) f=174173 TT=1800.12 T1=563.13	? (TO) TT=1800.2	? (MO) TT=36.47	SAT (TO) f=101458 TT=1802.1 T1=1584.19	No Cert. TT=1800.03	SAT (TO) f=12331 TT=1800.03 T1=1045.21	SAT f=9681 TT=1782.74 T1=109.93	SAT (TO) f=9407 TT=1800.34 T1=80.61	SAT (TO) f=11149 TT=1800.29 T1=56.36	SAT (TO) f=6456 TT=1800.32 T1=427.33	? (TO) TT=1800.1	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-fixnet6.opb		? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.15	? (exit code) TT=112.932	? (TO) TT=1800.08	? (TO) TT=1800.83	? (MO) TT=34.31	? (TO) TT=1801.97	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.23	? (TO) TT=1800.18	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.07
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-gesa2-o.opb	SAT f=799 TT=1800.27 T1=21.39	? (TO) TT=1800.17	SAT (TO) f=799 TT=1800.23 T1=21.96	SAT (TO) f=799 TT=1800.27 T1=21.39	? (exit code) TT=246.944	? (TO) TT=1800.09	? (TO) TT=1800.32	? (MO) TT=42.87	? (TO) TT=1801.96	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.19	? (TO) TT=1800.28	? (TO) TT=1800.31	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-gesa2.opb	SAT f=493 TT=1801.99 T1=10.75	SAT (TO) f=1919 TT=1800.25 T1=128.52	SAT (MO) f=873 TT=1107.49 T1=65.37	SAT (MO) f=873 TT=1101.67 T1=64.37	? (exit code) TT=42.583	? (TO) TT=1800.13	? (TO) TT=1800.13	? (MO) TT=42.02	SAT (TO) f=493 TT=1801.99 T1=10.75	No Cert. TT=1800.08	SAT (TO) f=1432 TT=1800.1 T1=1584.61	SAT f=676 TT=1782.76 T1=3.29	SAT (TO) f=2050 TT=1800.89 T1=7.45	SAT (TO) f=2044 TT=1801.01 T1=6.9	SAT (TO) f=1324 TT=1801.04 T1=1613.58	? (TO) TT=1800.1	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1174 TT=1800.02 T1=851.26	? (TO) TT=1800.14	SAT (TO) f=1248 TT=1800.05 T1=56.58	SAT (TO) f=1248 TT=1800.09 T1=56.36	? (exit code) TT=58.152	? (TO) TT=1800.06	? (TO) TT=1800.14	? (MO) TT=34.93	SAT (TO) f=1322 TT=1802.12 T1=23.72	No Cert. TT=1800.04	SAT (TO) f=1174 TT=1800.02 T1=851.26	SAT f=8289 TT=1782.73 T1=191.03	SAT (TO) f=524423 TT=1800.2 T1=93.42	SAT (TO) f=524437 TT=1800.26 T1=4.08	SAT (TO) f=1310 TT=1800.21 T1=197.95	SAT (TO) f=297530 TT=1800.09 T1=1705.29	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-harp2.opb	SAT f=-7980 TT=1800.09 T1=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=-7120 TT=1800.12 T1=1747.87	SAT (TO) f=-6430 TT=1800.57 T1=537.03	? (TO) TT=1800.12	? (TO) TT=1800.06	No Cert. TT=1800.11	SAT (TO) f=-7980 TT=1800.09 T1=1800.03	SAT f=-442 TT=1782.75 T1=1782.68	SAT (TO) f=-7775 TT=1800.36 T1=46.94	SAT (TO) f=-7497 TT=1800.47 T1=15.78	SAT (TO) f=-7835 TT=1800.21 T1=2.88	SAT (TO) f=-7275 TT=1800.08 T1=1468.23	SAT (TO) f=-7326 TT=1800.1 T1=580.87
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-liu.opb	SAT f=34564 TT=1802.04 T1=1278.68	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.39	? (TO) TT=1800.18	? (MO) TT=43.38	SAT (TO) f=34564 TT=1802.04 T1=1278.68	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.22	SAT (TO) f=524060 TT=1800.33 T1=449.09	? (TO) TT=1800.06	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare1.opb	SAT f=15 TT=1802.07 T1=1696.79	? (TO) TT=1800.1	SAT f=97 TT=1800.01 T1=574.73	SAT (TO) f=97 TT=1800.04 T1=573.94	? (exit code) TT=0.145	SAT (TO) f=60 TT=1800.03 T1=587.19	SAT (TO) f=24 TT=1800.34 T1=311.71	? (MO) TT=32.65	SAT (TO) f=15 TT=1802.07 T1=1696.79	No Cert. TT=1800.12	SAT (TO) f=35 TT=1800.05 T1=160.38	SAT f=65 TT=1782.73 T1=690.22	SAT (TO) f=34 TT=1800.2 T1=2.88	SAT (TO) f=17 TT=1800.21 T1=5.83	SAT (TO) f=27 TT=1800.27 T1=21.62	SAT (TO) f=42 TT=1800.01 T1=260.4	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare2.opb	SAT f=29 TT=1800.34 T1=54.93	? (TO) TT=1800.15	SAT f=75 TT=1800.01 T1=17.98	SAT (TO) f=75 TT=1800.03 T1=17.79	? (exit code) TT=0.237	SAT (TO) f=98 TT=1800.03 T1=155.05	? (TO) TT=1800.1	? (MO) TT=32.75	SAT (TO) f=61 TT=1802.06 T1=33.58	No Cert. TT=1800.05	SAT (TO) f=41 TT=1800.08 T1=1037.94	SAT f=84 TT=1782.73 T1=1760	SAT (TO) f=60 TT=1800.18 T1=34.09	SAT (TO) f=30 TT=1800.1 T1=546.07	SAT (TO) f=29 TT=1800.34 T1=54.93	SAT (TO) f=53 TT=1800.02 T1=920.04	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas74.opb	OPT f=1 TT=0.015 T1=0	OPT f=1 TT=0.647 T1=0.54	OPT f=1 TT=0.33 T1=0.29	OPT f=1 TT=0.333 T1=0.29	OPT f=1 TT=0.015 T1=0	OPT f=1 TT=0.105 T1=0.09	OPT f=1 TT=0.019 T1=0	OPT f=1 TT=0.66 T1=0.34	OPT f=1 TT=0.104 T1=0.04	OPT f=1 TT=0.081 T1=0.03	OPT f=1 TT=0.081 T1=0.06	OPT f=1 TT=0.04 T1=0	OPT f=1 TT=0.678 T1=0.48	OPT f=1 TT=0.674 T1=0.48	OPT f=1 TT=0.68 T1=0.64	SAT (TO) f=1 TT=1800.03 T1=417.88	SAT (TO) f=1 TT=1800.07 T1=175.63
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas76.opb	OPT f=1 TT=0.013 T1=0	OPT f=1 TT=0.631 T1=0.53	OPT f=1 TT=0.352 T1=0.29	OPT f=1 TT=0.356 T1=0.29	OPT f=1 TT=0.013 T1=0	OPT f=1 TT=0.098 T1=0.07	OPT f=1 TT=0.018 T1=0	OPT f=1 TT=0.606 T1=0.31	OPT f=1 TT=0.106 T1=0	OPT f=1 TT=0.062 T1=0.05	OPT f=1 TT=0.059 T1=0	OPT f=1 TT=0.041 T1=0	OPT f=1 TT=0.713 T1=0.48	OPT f=1 TT=0.715 T1=0.66	OPT f=1 TT=0.71 T1=0.66	SAT (TO) f=1 TT=1800.01 T1=379.99	SAT (TO) f=1 TT=1800.08 T1=155.46
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-misc07.opb	OPT f=262858 TT=496.259 T1=11.39	? (TO) TT=1800.14	SAT f=262859 TT=1800.04 T1=271.1	SAT (TO) f=262859 TT=1800.06 T1=269.98	? (exit code) TT=286.555	SAT (TO) f=262858 TT=1800.02 T1=1405.32	SAT (TO) f=262965 TT=1800.12 T1=1000.64	? (MO) TT=35.52	OPT f=262858 TT=496.259 T1=122.94	No Cert. TT=1800.05	SAT (TO) f=262858 TT=1800.05 T1=11.39	SAT f=262858 TT=1782.74 T1=44.27	SAT (TO) f=262858 TT=1800.24 T1=863.47	SAT (TO) f=262874 TT=1800.23 T1=193.17	SAT (TO) f=262858 TT=1800.12 T1=1319.54	? (TO) TT=1800.04	? (TO) TT=1800.03
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-mkc.opb	SAT f=-4362 TT=1800.06 T1=195.24	SAT (TO) f=-2889 TT=1800.1 T1=1.13	SAT (MO) f=-4010 TT=377.224 T1=16.49	SAT (MO) f=-4010 TT=376.842 T1=16.48	? (exit code) TT=33.719	SAT (TO) f=-3261 TT=1800.15 T1=1254.41	SAT (TO) f=-2503 TT=1800.23 T1=1039.54	? (TO) TT=1800.17	? (TO) TT=1800.08	No Cert. TT=1800.17	SAT (TO) f=-3970 TT=1800.17 T1=1800.03	SAT f=-342 TT=1782.77 T1=1782.68	SAT (TO) f=-3819 TT=1800.38 T1=705.4	SAT (TO) f=-3121 TT=1800.44 T1=3.35	SAT (TO) f=-4099 TT=1800.37 T1=2.98	SAT (TO) f=-4362 TT=1800.06 T1=195.24	SAT (TO) f=-665 TT=1800.09 T1=473.95
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mod011.opb	SAT f=0 TT=1783.02 T1=185.42	? TT=11.813	Wrong Cert. TT=1800.26	SAT (TO) f=0 TT=1800.21 T1=185.42	? (exit code) TT=415.303	? (TO) TT=1800.24	? (TO) TT=1800.11	? (TO) TT=1800.21	? (TO) TT=1800.35	No Cert. TT=1800.11	SAT (TO) f=0 TT=1800.26 T1=1800.04	SAT f=0 TT=1783.02 T1=1782.7	? (TO) TT=1800.38	? (TO) TT=1800.3	? (TO) TT=1800.53	? (TO) TT=1800.11	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-modglob.opb	SAT f=104 TT=1782.74 T1=0.19	? (TO) TT=1800.1	SAT (TO) f=242 TT=1800.18 T1=0.89	SAT (TO) f=242 TT=1800.22 T1=0.89	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT (TO) f=104 TT=1800.23 T1=0.89	? (MO) TT=33.64	SAT (TO) f=104 TT=1802.07 T1=2.27	No Cert. TT=1800.12	SAT (TO) f=666 TT=1800.08 T1=3.79	SAT f=104 TT=1782.74 T1=0.19	? (TO) TT=1800.23	? (TO) TT=1800.27	? (TO) TT=1800.59	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum1.opb	UNSAT TT=1.052	? TT=8.621	UNSAT TT=1.04	UNSAT TT=1.052	UNSAT TT=815.22	UNSAT TT=5.297	UNSAT TT=3.192	? (MO) TT=63.878	UNSAT TT=21.711	UNSAT TT=7.385	UNSAT TT=7.376	UNSAT TT=8.304	UNSAT TT=6.709	UNSAT TT=6.507	UNSAT TT=6.7	? (TO) TT=1800.07	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum2.opb	UNSAT TT=6.527	? TT=13.192	UNSAT TT=6.364	UNSAT TT=6.527	? (problem) TT=38.523	UNSAT TT=38.522	UNSAT TT=9.863	? (TO) TT=1800.04	? (TO) TT=1800.39	UNSAT TT=26.712	UNSAT TT=26.656	UNSAT TT=13.732	UNSAT TT=26.668	UNSAT TT=24.469	UNSAT TT=26.481	? (TO) TT=1802.07	? (TO) TT=1802.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum3.opb	SAT f=410088 TT=1800.14 T1=1173.29	? TT=8.259	Wrong Cert. TT=1800.14	SAT (TO) f=410088 TT=1800.14 T1=1173.29	? (TO) TT=1800.24	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1801.36	? (TO) TT=1801.1	No Cert. TT=1800.09	SAT (TO) f=413465 TT=1800.18 T1=1800.05	? (TO) TT=1800.15	SAT (TO) f=415733 TT=1804.17 T1=350.87	SAT (TO) f=413511 TT=1804.23 T1=1634.72	? (TO) TT=1800.24	? (TO) TT=1802.23	? (TO) TT=1802.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-msc98-ip.opb		? TT=7.984	? TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.34	? (MO) TT=43.803	? (TO) TT=1801.93	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.21	? (TO) TT=1800.12	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-noswot.opb	OPT f=-7 TT=172.392 T1=0.8	SAT (TO) f=-7 TT=1800.08 T1=0.8	? (MO) TT=32.327	? (MO) TT=32.557	? (exit code) TT=1.61	OPT f=-7 TT=172.392 T1=136.35	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	No Cert. TT=1800.13	SAT (TO) f=-7 TT=1800.08 T1=1800.02	SAT f=-7 TT=1782.73 T1=1782.65	SAT f=-7 TT=3.193 T1=2.95	SAT (TO) f=-7 TT=1800.16 T1=4.43	SAT (TO) f=-7 TT=1800.37 T1=2.22	? (TO) TT=1800.05	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-nsrand-ipx.opb	SAT f=294914 TT=1800.24 T1=9.39	? (TO) TT=1800.1	SAT (TO) f=294914 TT=1800.24 T1=8.59	SAT (TO) f=294914 TT=1800.24 T1=9.39	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.17	? (MO) TT=45.821	SAT (TO) f=311299 TT=1802.04 T1=13.47	No Cert. TT=1800.04	SAT (TO) f=455592 TT=1800.04 T1=1743.04	SAT f=393218 TT=1782.74 T1=0.89	SAT (TO) f=524214 TT=1800.29 T1=1733.85	SAT (TO) f=524276 TT=1800.43 T1=1771.22	SAT (TO) f=392219 TT=1800.24 T1=1718.42	SAT (TO) f=392823 TT=1800.3 T1=27.98	SAT (TO) f=357784 TT=1800.09 T1=12.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-nw04.opb	OPT f=41 TT=34.024 T1=33.97	? (TO) TT=1800.13	? (MO) TT=1574.61	? (MO) TT=1545.67	OPT f=41 TT=34.024 T1=33.97	? (TO) TT=1800.08	? (TO) TT=1802.18	? (MO) TT=366.248	SAT (TO) f=66 TT=1802.04 T1=1640	No Cert. TT=1800.13	SAT (TO) f=45 TT=1800.2 T1=400.47	SAT f=139 TT=1785.26 T1=391.94	? (TO) TT=1800.14	? (TO) TT=1800.08	No Cert. TT=625.113	? (TO) TT=1800.09	SAT (TO) f=76 TT=1800.28 T1=952.27
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pk1.opb	SAT f=27 TT=1800.1 T1=1498.97	? (TO) TT=1800.06	SAT (TO) f=27 TT=1800.01 T1=1504	SAT (TO) f=27 TT=1800.1 T1=1498.97	? (exit code) TT=0.069	SAT (TO) f=262659 TT=1800.06 T1=1778.14	? (TO) TT=1800.28	? (MO) TT=41.1	SAT (TO) f=27 TT=1802.15 T1=1706.43	No Cert. TT=1800.05	SAT (TO) f=39 TT=1800.04 T1=1697.74	SAT f=42 TT=1782.73 T1=2.2	? (TO) TT=1800.26	? (TO) TT=1800.25	SAT f=114667 TT=1063.14 T1=809.3	? (TO) TT=1800.05	SAT (TO) f=262172 TT=1800.03 T1=562.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pp08aCUTS.opb	SAT f=69 TT=1782.74 T1=0.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.19	? (exit code) TT=0.36	? (TO) TT=1800.1	? (TO) TT=1800.21	? (MO) TT=41.19	? (TO) TT=1802.06	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT f=69 TT=1782.74 T1=0.09	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.33	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-pp08a.opb		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	? (exit code) TT=0.333	? (TO) TT=1800.05	? (TO) TT=1800.12	? (MO) TT=41.22	? (TO) TT=1802.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.27	? (TO) TT=1800.26	? (TO) TT=1800.38	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-qiu.opb		? (TO) TT=1800.16	? TT=1800.02	? (TO) TT=1800.09	? (exit code) TT=458.26	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.38	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.25	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-rd-rplusc-21.opb		? TT=49.825	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.28	? (TO) TT=1800.34	? (MO) TT=204.127	? (TO) TT=1802.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.54	? (TO) TT=1800.21	? (TO) TT=1800.3	? (MO) TT=23.688	? (MO) TT=23.581
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=273432 TT=1800.43 T1=22.13	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (exit code) TT=454.981	? (TO) TT=1800.09	? (TO) TT=1800.54	? (MO) TT=39.24	? (TO) TT=1802.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.19	? (TO) TT=1800.23	SAT (TO) f=273432 TT=1800.43 T1=22.13	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-rout.opb	SAT f=262449 TT=1800.44 T1=1471.3	? (TO) TT=1800.14	SAT (TO) f=262735 TT=1800.22 T1=19.39	SAT (TO) f=262735 TT=1800.16 T1=19.39	? (exit code) TT=5.233	SAT (TO) f=262562 TT=1800.12 T1=463.52	? (TO) TT=1800.21	? (MO) TT=40.68	SAT (TO) f=262481 TT=1802.11 T1=1676.56	No Cert. TT=1800.12	SAT (TO) f=262724 TT=1800.11 T1=0.49	? (TO) TT=1800.03	SAT (TO) f=262449 TT=1800.44 T1=1471.3	SAT (TO) f=262476 TT=1800.35 T1=355.51	SAT (TO) f=262490 TT=1800.39 T1=1147.04	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-set1ch.opb	SAT f=14010 TT=1782.78 T1=1558.83	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	? (exit code) TT=11.329	? (TO) TT=1800.08	? (TO) TT=1800.22	? (MO) TT=40.42	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT f=14010 TT=1782.78 T1=1558.83	SAT (TO) f=22791 TT=1800.64 T1=477.07	? (TO) TT=1800.25	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=50 TT=1149.15 T1=203.14	? TT=149.092	SAT (MO) f=50 TT=1104.07 T1=203.1	SAT (MO) f=50 TT=1149.15 T1=203.14	? (exit code) TT=1675.51	Signal TT=1580.47	SAT (TO) f=52 TT=1801.7 T1=704.4	? (TO) TT=1802.03	? (TO) TT=1802.05	? (TO) TT=1800.13	? (TO) TT=1800.13	SAT f=51 TT=1783.28 T1=251.01	SAT (TO) f=52 TT=1804.09 T1=114.7	SAT (TO) f=52 TT=1804.12 T1=111.89	SAT (TO) f=52 TT=1804.05 T1=117.05	? (TO) TT=1802.08	? (TO) TT=1802.12
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-stp3d.opb		? TT=9.644	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.25	? (MO) TT=172.41	? (TO) TT=1801.98	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.21	? (TO) TT=1800.24	? (TO) TT=1800.43	? (TO) TT=1800.16
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-swath.opb	OPT f=262224 TT=0.788 T1=0.69	? (TO) TT=1800.1	Wrong Cert. TT=1800.11	SAT (TO) f=262483 TT=1800.14 T1=44.38	OPT f=262224 TT=0.788 T1=0.69	? (TO) TT=1800.06	? (TO) TT=1800.2	? (MO) TT=49.98	? (TO) TT=1802.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT (TO) f=262518 TT=1800.34 T1=657.88	? (TO) TT=1800.2	SAT (TO) f=262381 TT=1800.51 T1=332.54	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-t1717.opb	SAT f=660 TT=1800.13 T1=171.63	? (TO) TT=1800.18	SAT (TO) f=660 TT=1800.06 T1=171.65	SAT (TO) f=660 TT=1800.13 T1=171.63	? (TO) TT=1800.09	Signal TT=491.425	SAT (TO) f=1212 TT=1800.67 T1=170.84	? (MO) TT=153.717	SAT (TO) f=1354 TT=1801.97 T1=372.49	No Cert. TT=1800.12	SAT (TO) f=1224 TT=1800.14 T1=1160.23	SAT f=664 TT=1782.9 T1=17.29	SAT (TO) f=1321 TT=1804.14 T1=1145.67	SAT (TO) f=1321 TT=1804.07 T1=548.64	SAT (TO) f=1330 TT=1804.21 T1=27.02	SAT (TO) f=1343 TT=1800.19 T1=902.83	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab1.opb	SAT f=171974 TT=1782.75 T1=1361.23	? (TO) TT=1800.05	SAT f=175464 TT=1800.09 T1=1773.31	SAT (TO) f=175464 TT=1800.12 T1=1769.12	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.31	? (MO) TT=40.98	SAT (TO) f=185275 TT=1802.03 T1=1469.87	No Cert. TT=1800.12	SAT (TO) f=189661 TT=1800.07 T1=1532.01	SAT f=171974 TT=1782.75 T1=1361.23	? (TO) TT=1800.32	? (TO) TT=1800.15	SAT (TO) f=185793 TT=1800.19 T1=178.9	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab2.opb	SAT f=197642 TT=1800.31 T1=1452.57	? (TO) TT=1800.11	SAT (TO) f=197642 TT=1800.24 T1=1455.06	SAT (TO) f=197642 TT=1800.31 T1=1452.57	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.28	? (MO) TT=41.89	SAT (TO) f=221170 TT=1802.07 T1=1769.68	No Cert. TT=1800.06	SAT (TO) f=227877 TT=1800.07 T1=1091.09	SAT f=197999 TT=1782.74 T1=1429.3	? (TO) TT=1800.22	? (TO) TT=1800.23	SAT (TO) f=210536 TT=1800.51 T1=97.04	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.35	? (MO) TT=39.21	? (TO) TT=1802	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.21	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=41696 TT=1782.95 T1=56.41	? TT=7.953	SAT (TO) f=41696 TT=1800.34 T1=222.79	SAT (TO) f=41696 TT=1800.35 T1=301.7	? (TO) TT=1800.1	? (TO) TT=1800.21	SAT (TO) f=41696 TT=1800.75 T1=1408.07	? (MO) TT=168.257	SAT (TO) f=45673 TT=1802 T1=989.59	No Cert. TT=1800.08	SAT (TO) f=50013 TT=1800.15 T1=1460.74	SAT f=41696 TT=1782.95 T1=74.83	SAT (TO) f=43866 TT=1800.85 T1=46.45	SAT (TO) f=43866 TT=1800.83 T1=44.24	SAT (TO) f=41696 TT=1800.73 T1=56.41	? (TO) TT=1800.26	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-vpm2.opb		? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (exit code) TT=1.786	? (TO) TT=1800.1	? (TO) TT=1800.36	? (MO) TT=36.82	? (TO) TT=1802.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.2	? (TO) TT=1800.71	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-blend2.opb		? (TO) TT=1800.17	? (MO) TT=386.902	? (MO) TT=382.277	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.13	? (MO) TT=19.51	? (TO) TT=1802.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.22	? (TO) TT=1800.27	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-gesa3_o.opb	SAT f=498 TT=1800.1 T1=1288.94	? (TO) TT=1800.14	SAT (TO) f=748 TT=1800.18 T1=1225.08	SAT (TO) f=748 TT=1800.19 T1=1220.16	? (exit code) TT=76.427	? (TO) TT=1800.13	? (TO) TT=1800.57	? (MO) TT=42.85	SAT (TO) f=498 TT=1800.1 T1=1288.94	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT f=848 TT=1782.75 T1=1569.17	SAT (TO) f=956 TT=1800.94 T1=1748.86	? (TO) TT=1800.2	? (TO) TT=1800.24	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gesa3.opb	SAT f=550 TT=1802.03 T1=12.91	SAT (TO) f=1320 TT=1800.17 T1=5.24	SAT (TO) f=767 TT=1800.27 T1=1483.19	SAT (TO) f=767 TT=1800.27 T1=1472.49	? (exit code) TT=569.313	? (TO) TT=1800.07	SAT (TO) f=859 TT=1800.44 T1=395.43	? (MO) TT=42.47	SAT (TO) f=550 TT=1802.03 T1=12.91	No Cert. TT=1800.06	SAT (TO) f=1750 TT=1800.1 T1=794.1	SAT f=900 TT=1782.76 T1=1735.48	SAT (TO) f=1716 TT=1800.91 T1=11.07	SAT (TO) f=2083 TT=1800.85 T1=8.65	SAT (TO) f=1036 TT=1800.81 T1=36.92	? (TO) TT=1800.12	? (TO) TT=1800.05
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gt2.opb	SAT f=3591 TT=1800.04 T1=581.07	? (TO) TT=1800.16	SAT f=3591 TT=1800.01 T1=581.93	SAT (TO) f=3591 TT=1800.04 T1=581.07	? (TO) TT=1800.07	SAT (TO) f=12272 TT=1800.11 T1=1476.86	SAT (TO) f=42569 TT=1800.07 T1=1409.6	? (MO) TT=43.59	SAT (TO) f=5073 TT=1802.07 T1=951.92	No Cert. TT=1800.12	SAT (TO) f=7475 TT=1800.06 T1=1513.49	SAT f=5197 TT=1782.74 T1=765.6	SAT (TO) f=4716 TT=1800.24 T1=126.03	SAT (TO) f=25320 TT=1800.22 T1=5.08	? (TO) TT=1800.21	SAT (TO) f=3591 TT=1800.05 T1=672.12	SAT (TO) f=4317 TT=1800.03 T1=1513.62
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-qnet1_o.opb	SAT f=319 TT=1782.74 T1=1544.8	? (TO) TT=1800.17	SAT (TO) f=331 TT=1800.1 T1=2.39	SAT (TO) f=331 TT=1800.09 T1=2.29	? (TO) TT=1800.07	SAT (TO) f=1695 TT=1800.12 T1=1720.81	SAT (TO) f=2391 TT=1800.54 T1=14.59	? (MO) TT=38.86	SAT (TO) f=350 TT=1802.09 T1=65.7	No Cert. TT=1800.05	SAT (TO) f=1121 TT=1800.06 T1=566.19	SAT f=319 TT=1782.74 T1=1544.8	SAT (TO) f=1036 TT=1800.39 T1=3.66	SAT (TO) f=734 TT=1800.4 T1=8.41	SAT (TO) f=427 TT=1800.44 T1=3.75	? (TO) TT=1800.07	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-qnet1.opb	SAT f=301 TT=1782.74 T1=0.19	? (TO) TT=1800.06	SAT f=316 TT=1800.05 T1=0.08	SAT (TO) f=316 TT=1800.13 T1=0.09	? (TO) TT=1800.07	SAT (TO) f=1874 TT=1800.08 T1=858.04	SAT (TO) f=2391 TT=1800.38 T1=14.48	? (MO) TT=31.2	SAT (TO) f=485 TT=1802.09 T1=1.27	No Cert. TT=1800.04	SAT (TO) f=774 TT=1800.06 T1=85.37	SAT f=301 TT=1782.74 T1=0.19	SAT (TO) f=677 TT=1800.36 T1=9.31	SAT (TO) f=649 TT=1800.39 T1=7.48	SAT (TO) f=345 TT=1800.52 T1=4.95	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air01.opb	OPT f=1496 TT=0.033 T1=0	OPT f=1496 TT=22.33 T1=1.53	OPT f=1496 TT=0.314 T1=0.29	OPT f=1496 TT=0.299 T1=0.19	OPT f=1496 TT=0.033 T1=0	SAT (TO) f=1496 TT=1800.06 T1=1546.28	OPT f=1496 TT=958.576 T1=399.54	SAT (MO) f=2984 TT=47.97 T1=2.66	OPT f=1496 TT=9.532 T1=5.61	OPT f=1496 TT=22.33 T1=17.78	OPT f=1496 TT=22.348 T1=17.78	OPT f=1496 TT=15.431 T1=7.88	OPT f=1496 TT=54.122 T1=53.96	OPT f=1496 TT=18.355 T1=15.68	OPT f=1496 TT=11.589 T1=2.61	SAT (TO) f=1496 TT=1800.1 T1=309.81	SAT (TO) f=1498 TT=1800.11 T1=728
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air02.opb	OPT f=313 TT=1.573 T1=1.49	SAT (TO) f=358 TT=1800.12 T1=283.87	SAT (TO) f=609 TT=1800.26 T1=1748.66	SAT (TO) f=609 TT=1800.3 T1=1726.09	OPT f=313 TT=1.573 T1=1.49	SAT (TO) f=1328 TT=1800.16 T1=1537.85	SAT (TO) f=12422 TT=1801.97 T1=402.74	? (MO) TT=91.76	OPT f=313 TT=964.696 T1=736.64	No Cert. TT=1800.13	SAT (TO) f=358 TT=1800.06 T1=912.75	SAT f=402 TT=1782.84 T1=345.39	SAT (TO) f=362 TT=1800.47 T1=303.91	SAT (TO) f=362 TT=1800.42 T1=498.49	SAT f=326 TT=768.898 T1=594.04	SAT (TO) f=344 TT=1800.03 T1=778.08	SAT (TO) f=377 TT=1800.1 T1=455.93
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air03.opb	OPT f=6502 TT=1.843 T1=1.78	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	OPT f=6502 TT=1.843 T1=1.78	SAT (TO) f=10603 TT=1800.12 T1=1356.99	? (MO) TT=1395.4	? (MO) TT=80.08	SAT (TO) f=7539 TT=1802.05 T1=1744.5	No Cert. TT=1800.11	SAT (TO) f=7576 TT=1800.14 T1=1449.16	SAT f=7709 TT=1782.92 T1=1234.86	SAT (TO) f=7981 TT=1800.7 T1=225.92	SAT (TO) f=7981 TT=1800.68 T1=241.22	SAT f=8515 TT=757.335 T1=681.8	SAT (TO) f=7765 TT=1800.12 T1=817.16	SAT (TO) f=8902 TT=1800.04 T1=1720.83
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air06.opb	OPT f=5727 TT=42.578 T1=42.48	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.17	OPT f=5727 TT=42.578 T1=42.48	SAT (TO) f=7817 TT=1800.15 T1=1693.35	? (TO) TT=1802.27	SAT (MO) f=5855 TT=72.62 T1=32.74	SAT (TO) f=7780 TT=1802.01 T1=1374.61	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT f=7293 TT=1782.76 T1=1536.28	SAT (TO) f=7984 TT=1800.49 T1=1160.46	? (TO) TT=1800.15	SAT (TO) f=7772 TT=1800.59 T1=1343.58	? (TO) TT=1800.11	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3a.opb	SAT f=1448 TT=1800.23 T1=9.99	? (TO) TT=1800.1	SAT f=3888 TT=1800.02 T1=46.58	SAT (TO) f=3888 TT=1800.09 T1=46.38	? (exit code) TT=7.351	? (TO) TT=1800.08	SAT (TO) f=36350 TT=1800.28 T1=321.51	? (MO) TT=40.64	SAT (TO) f=8314 TT=1802.12 T1=1700.2	No Cert. TT=1800.06	SAT (TO) f=5766 TT=1800.05 T1=170.14	SAT f=1552 TT=1782.74 T1=938.73	SAT (TO) f=1448 TT=1800.23 T1=9.99	SAT (TO) f=2232 TT=1800.33 T1=1699.69	SAT (TO) f=11833 TT=1800.36 T1=1252.43	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3b.opb	SAT f=1087 TT=1800.29 T1=763.13	? (TO) TT=1800.16	SAT (TO) f=1620 TT=1800.05 T1=1414.64	SAT (TO) f=1620 TT=1800.07 T1=1410.35	? (exit code) TT=26.047	? (TO) TT=1800.13	? (TO) TT=1800.27	? (MO) TT=40.82	SAT (TO) f=18992 TT=1802.12 T1=1798.99	No Cert. TT=1800.03	SAT (TO) f=4309 TT=1800.06 T1=4.09	? (TO) TT=1800.04	SAT (TO) f=1087 TT=1800.29 T1=763.13	SAT (TO) f=1411 TT=1800.33 T1=575.76	SAT (TO) f=13397 TT=1800.5 T1=1723.24	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell4.opb	SAT f=1496 TT=1800.25 T1=880.3	? (TO) TT=1800.04	SAT (TO) f=4427 TT=1800.02 T1=1141	SAT (TO) f=4427 TT=1800.11 T1=1139.65	? (exit code) TT=18.379	? (TO) TT=1800.05	? (TO) TT=1800.14	? (MO) TT=39.84	SAT (TO) f=6281 TT=1802.76 T1=1733.02	No Cert. TT=1800.1	SAT (TO) f=2991 TT=1800.03 T1=10.59	SAT f=1621 TT=1782.74 T1=738.14	SAT (TO) f=1496 TT=1800.25 T1=880.3	SAT (TO) f=2608 TT=1800.4 T1=176.95	SAT (TO) f=14343 TT=1800.38 T1=1723.52	? (TO) TT=1800.02	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell5.opb	SAT f=862 TT=1782.73 T1=192.03	? (TO) TT=1800.14	SAT f=978 TT=1800.02 T1=16.58	SAT (TO) f=978 TT=1800.04 T1=16.36	? (exit code) TT=64.383	SAT (TO) f=4635 TT=1800.1 T1=524.57	SAT (TO) f=5316 TT=1800.51 T1=1754.3	? (MO) TT=40.02	SAT (TO) f=1382 TT=1802.09 T1=1797.05	No Cert. TT=1800.02	SAT (TO) f=1626 TT=1800.07 T1=1310.73	SAT f=862 TT=1782.73 T1=192.03	SAT (TO) f=970 TT=1800.35 T1=1539.41	SAT (TO) f=1250 TT=1800.31 T1=1737.18	SAT (TO) f=2114 TT=1800.37 T1=8.64	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-dcmulti.opb		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.21	? (exit code) TT=262.114	? (TO) TT=1800.14	? (TO) TT=1800.4	? (MO) TT=48.22	? (TO) TT=1802.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.21	? (TO) TT=1800.2	? (TO) TT=1800.41	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-egout.opb	SAT f=162 TT=1800.29 T1=560.8	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (exit code) TT=4.235	? (TO) TT=1800.1	? (TO) TT=1802.1	? (MO) TT=25.35	? (TO) TT=1802.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=162 TT=1800.29 T1=560.8	SAT (TO) f=173 TT=1800.28 T1=1609.98	? (TO) TT=1800.25	? (TO) TT=1800.1	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-enigma.opb	OPT f=0 TT=0.148 T1=0.06	OPT f=0 TT=0.613 T1=0.49	OPT f=0 TT=5.593 T1=5.49	OPT f=0 TT=5.549 T1=5.49	OPT f=0 TT=4.957 T1=4.89	OPT f=0 TT=151.06 T1=151.04	OPT f=0 TT=989.457 T1=988.84	? (MO) TT=37.8	OPT f=0 TT=0.148 T1=0.06	OPT f=0 TT=0.589 T1=0.5	OPT f=0 TT=0.577 T1=0.49	OPT f=0 TT=1.661 T1=1.59	? (TO) TT=1800.17	? (TO) TT=1800.25	OPT f=0 TT=1.215 T1=1.19	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet3.opb		? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.24	? (exit code) TT=70.148	? (TO) TT=1800.13	? (TO) TT=1800.27	? (MO) TT=35.03	? (TO) TT=1801.96	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.23	? (TO) TT=1800.24	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet4.opb		? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.22	? (exit code) TT=154.948	? (TO) TT=1800.07	? (TO) TT=1800.27	? (MO) TT=34.79	? (TO) TT=1801.95	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.28	? (TO) TT=1800.25	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-flugpl.opb	OPT f=91 TT=6.462 T1=0	? (TO) TT=1800.15	OPT f=91 TT=250.291 T1=34.27	OPT f=91 TT=87.954 T1=0.7	? (exit code) TT=2.297	OPT f=91 TT=6.462 T1=3.89	? (TO) TT=1800.13	? (MO) TT=38.58	OPT f=91 TT=52.666 T1=0.25	No Cert. TT=1800.04	SAT (TO) f=91 TT=1800.04 T1=3.49	OPT f=91 TT=584.117 T1=0	OPT f=91 TT=15.428 T1=5.25	OPT f=91 TT=47.599 T1=12.94	OPT f=91 TT=270.394 T1=2.24	SAT (TO) f=100 TT=1800.06 T1=536.3	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-gen.opb	SAT f=713 TT=1801.09 T1=161.54	? (TO) TT=1800.13	? (MO) TT=13.929	? (MO) TT=13.572	? (exit code) TT=23.399	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=27.56	? (TO) TT=1802.02	No Cert. TT=1800.08	SAT (TO) f=1372 TT=1800.1 T1=1713.8	? (TO) TT=1800.03	SAT (TO) f=1212 TT=1801.03 T1=8.75	SAT (TO) f=713 TT=1801.09 T1=161.54	SAT (TO) f=766 TT=1801.15 T1=500.12	? (TO) TT=1800.03	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib/normalized-reduced-mps-v2-20-10-khb05250.opb		? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.29	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.41	? (MO) TT=39.984	? (TO) TT=1802.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.2	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc01.opb	OPT f=262288 TT=0.584 T1=0	? (TO) TT=1800.04	OPT f=262288 TT=3.844 T1=0.09	OPT f=262288 TT=3.792 T1=0.09	OPT f=262288 TT=0.584 T1=0.49	OPT f=262288 TT=10.306 T1=5.99	SAT (TO) f=262288 TT=1800.15 T1=1683.47	? (MO) TT=42.81	OPT f=262288 TT=1.434 T1=0.16	OPT f=262288 TT=2.141 T1=0.09	OPT f=262288 TT=2.168 T1=0.09	OPT f=262288 TT=5.874 T1=0	OPT f=262288 TT=12.522 T1=7.13	OPT f=262288 TT=8.817 T1=5.65	OPT f=262288 TT=3.126 T1=1.25	SAT (TO) f=262305 TT=1800.07 T1=20.18	? (TO) TT=1800.03
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc02.opb	OPT f=262571 TT=0.098 T1=0.01	? (TO) TT=1800.07	OPT f=262571 TT=0.776 T1=0.19	OPT f=262571 TT=0.772 T1=0.19	OPT f=262571 TT=0.098 T1=0.04	OPT f=262571 TT=3.672 T1=0.39	OPT f=262571 TT=516.577 T1=294.71	? (TO) TT=1801.97	OPT f=262571 TT=1.902 T1=0.19	OPT f=262571 TT=0.345 T1=0.01	OPT f=262571 TT=0.347 T1=0.03	OPT f=262571 TT=30.82 T1=0.39	OPT f=262571 TT=7.072 T1=5.27	OPT f=262571 TT=5.596 T1=3.59	OPT f=262571 TT=1.719 T1=0.99	SAT (TO) f=262731 TT=1800.05 T1=1.19	SAT (TO) f=262572 TT=1800.04 T1=338.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc03.opb	OPT f=262989 TT=8.414 T1=1.19	? (TO) TT=1800.15	OPT f=262989 TT=32.105 T1=2.49	OPT f=262989 TT=31.814 T1=2.39	OPT f=262989 TT=283.078 T1=283	OPT f=262989 TT=684.11 T1=59.77	SAT (TO) f=263083 TT=1800.24 T1=331.69	? (MO) TT=38.71	OPT f=262989 TT=9.946 T1=1.27	OPT f=262989 TT=9.01 T1=1.19	OPT f=262989 TT=9.129 T1=1.19	OPT f=262989 TT=115.995 T1=1.2	SAT (TO) f=262989 TT=1800.16 T1=22.44	SAT (TO) f=262989 TT=1800.2 T1=11.47	OPT f=262989 TT=8.414 T1=4.65	? (TO) TT=1800.01	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc04.opb		? (TO) TT=1800.28	? TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.1	? (MO) TT=37.789	? (TO) TT=1801.99	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.24	? (TO) TT=1800.35	? (TO) TT=1800.24	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc05.opb	UNSAT TT=0.16	? (TO) TT=1800.09	UNSAT TT=306.235	UNSAT TT=305.428	UNSAT TT=0.16	UNSAT TT=297.22	UNSAT TT=61.807	? (MO) TT=42.31	UNSAT TT=1.995	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.17	UNSAT TT=82.732	UNSAT TT=243.009	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc06.opb		? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (exit code) TT=196.974	? (TO) TT=1800.15	? (TO) TT=1800.27	? (MO) TT=51.919	? (TO) TT=1801.95	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.26	? (TO) TT=1800.32	? (TO) TT=1800.25	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-mod013.opb	OPT f=19 TT=451.723 T1=11.19	? (TO) TT=1800.1	SAT f=22 TT=1800.06 T1=1521.55	SAT (TO) f=22 TT=1800.09 T1=1512.83	? (exit code) TT=2.683	OPT f=19 TT=451.723 T1=11.19	SAT (TO) f=22 TT=1800.92 T1=4.09	SAT (TO) f=19 TT=1801.96 T1=419.28	SAT (TO) f=21 TT=1802.07 T1=1.26	No Cert. TT=1800.1	SAT (TO) f=20 TT=1800.04 T1=829.98	SAT f=20 TT=1782.74 T1=1661.56	SAT (TO) f=20 TT=1800.28 T1=8.59	SAT (TO) f=19 TT=1800.19 T1=1600.93	SAT (TO) f=21 TT=1800.42 T1=834.96	? (TO) TT=1800.05	SAT (TO) f=19 TT=1800.08 T1=676.85
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0282.opb	OPT f=104028 TT=1.194 T1=1.09	OPT f=104028 TT=12.085 T1=11.82	OPT f=104028 TT=1103.31 T1=1102.02	SAT (TO) f=112846 TT=1800.05 T1=410.09	OPT f=104028 TT=1.194 T1=1.09	SAT (TO) f=114257 TT=1800.1 T1=1782.98	SAT (TO) f=121969 TT=1800.08 T1=4.49	? (MO) TT=32.7	OPT f=104028 TT=11.301 T1=11.23	OPT f=104028 TT=31.51 T1=31.49	OPT f=104028 TT=31.593 T1=31.57	SAT f=113007 TT=1782.74 T1=22.57	OPT f=104028 TT=1047.15 T1=1039.24	SAT (TO) f=115883 TT=1800.2 T1=191.48	OPT f=104028 TT=3.776 T1=3.56	SAT (TO) f=123652 TT=1800.03 T1=246.63	SAT (TO) f=111379 TT=1800.1 T1=803.84
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0291.opb	OPT f=7985 TT=0.075 T1=0.03	OPT f=7985 TT=0.695 T1=0.54	OPT f=7985 TT=0.723 T1=0.59	OPT f=7985 TT=0.579 T1=0.39	OPT f=7985 TT=0.152 T1=0.09	OPT f=7985 TT=183.831 T1=183.71	OPT f=7985 TT=5.273 T1=1.19	? (TO) TT=1800.1	? (TO) TT=1800.05	OPT f=7985 TT=0.706 T1=0.69	OPT f=7985 TT=0.707 T1=0.69	OPT f=7985 TT=0.075 T1=0.03	OPT f=7985 TT=15.355 T1=12.32	OPT f=7985 TT=39.304 T1=36.21	OPT f=7985 TT=1.472 T1=1.2	SAT (TO) f=7985 TT=1800.02 T1=807.57	SAT (TO) f=12460 TT=1800.06 T1=198.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p6000.opb	OPT f=-98107 TT=47.867 T1=47.77	? (TO) TT=1800.08	Signal TT=0.423	Signal TT=0.447	OPT f=-98107 TT=47.867 T1=47.77	? (TO) TT=1800.15	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.09	No Cert. TT=1800.04	SAT (TO) f=-15194 TT=1800.09 T1=1800.06	SAT f=-4235 TT=1782.79 T1=1782.7	SAT (TO) f=-37719 TT=1800.45 T1=778.32	SAT (TO) f=-36107 TT=1800.42 T1=211.23	SAT (TO) f=-20554 TT=1800.39 T1=176.28	? (TO) TT=1800.09	SAT (TO) f=-29575 TT=1800.06 T1=1444.72
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-pipex.opb	OPT f=164393 TT=0.119 T1=0.09	OPT f=164393 TT=6.152 T1=3.74	OPT f=164393 TT=6.773 T1=5.78	OPT f=164393 TT=6.873 T1=6.79	OPT f=164393 TT=0.119 T1=0.09	OPT f=164393 TT=176.374 T1=165.62	SAT (TO) f=167296 TT=1800.26 T1=1053.88	SAT (MO) f=180239 TT=37.28 T1=0.01	OPT f=164393 TT=14.114 T1=8.56	OPT f=164393 TT=166.089 T1=67.77	OPT f=164393 TT=165.943 T1=67.77	OPT f=164393 TT=21.163 T1=7.38	OPT f=164393 TT=265.889 T1=151.65	OPT f=164393 TT=813.729 T1=687.2	OPT f=164393 TT=33.355 T1=23.22	SAT (TO) f=164393 TT=1800.02 T1=49.28	SAT (TO) f=164393 TT=1800.04 T1=28.38
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-rgn.opb	SAT f=13258 TT=1800.12 T1=150.25	? (TO) TT=1800.12	? TT=1800.03	? (TO) TT=1800.13	? (exit code) TT=4.703	? (TO) TT=1800.11	SAT (TO) f=13258 TT=1800.12 T1=150.25	? (MO) TT=38.94	SAT (TO) f=14256 TT=1802.08 T1=31.57	No Cert. TT=1800.12	SAT (TO) f=68487 TT=1800.09 T1=378.7	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.21	SAT (TO) f=203618 TT=1800.23 T1=282.74	? (TO) TT=1800.02	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-sample2.opb	OPT f=5 TT=10.242 T1=6.78	? (TO) TT=1800.13	SAT f=7 TT=1800.02 T1=1269.75	SAT (TO) f=7 TT=1800.04 T1=1266.55	? (exit code) TT=0.033	OPT f=5 TT=179.531 T1=179.23	? (TO) TT=1800.21	? (MO) TT=31.57	OPT f=5 TT=10.242 T1=6.78	OPT f=5 TT=913.489 T1=884.66	OPT f=5 TT=951.969 T1=921.56	OPT f=5 TT=1622.01 T1=1569.68	OPT f=5 TT=49.685 T1=9.93	OPT f=5 TT=41.848 T1=8.22	OPT f=5 TT=68.814 T1=64.48	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1al.opb	SAT f=42048 TT=1802.02 T1=2.76	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.15	? (MO) TT=45.52	SAT (TO) f=42048 TT=1802.02 T1=2.76	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.29	? (TO) TT=1800.26	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1cl.opb		? (TO) TT=1800.07	? TT=1800.08	? (TO) TT=1800.16	? (exit code) TT=71.149	? (TO) TT=1800.16	? (TO) TT=1800.17	? (MO) TT=44.17	? (TO) TT=1802.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.23	? (TO) TT=1800.23	? (TO) TT=1800.23	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-vpm1.opb	SAT f=51 TT=1800.09 T1=566.75	? (TO) TT=1800.11	SAT f=51 TT=1800.02 T1=567.15	SAT (TO) f=51 TT=1800.09 T1=566.75	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.39	? (MO) TT=38.09	? (TO) TT=1802.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1802.45	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bal8x12.opb	UNSAT TT=3.898	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	? (exit code) TT=0.08	UNSAT TT=116.232	? (TO) TT=1800.31	? (TO) TT=1801.98	? (TO) TT=1802.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=3.948	UNSAT TT=3.898	? (TO) TT=1800.32	? (TO) TT=1800.02	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bk4x3.opb	OPT f=14 TT=16.29 T1=3.79	SAT (TO) f=16 TT=1800.09 T1=1735.74	OPT f=14 TT=44.675 T1=41.57	OPT f=14 TT=178.86 T1=3.79	? (exit code) TT=0.014	OPT f=14 TT=19.909 T1=18.79	SAT (TO) f=16 TT=1800.37 T1=0	? (MO) TT=32.16	SAT (TO) f=15 TT=1802.04 T1=1129.93	No Cert. TT=1800.05	SAT (TO) f=15 TT=1800.08 T1=123.1	SAT f=16 TT=1782.73 T1=62.97	OPT f=14 TT=16.29 T1=8.13	OPT f=14 TT=74.906 T1=26.61	SAT (TO) f=15 TT=1800.23 T1=19.89	SAT (TO) f=14 TT=1800.03 T1=9.79	SAT (TO) f=14 TT=1800.08 T1=137.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-gr4x6.opb	UNSAT TT=0.018	? (TO) TT=1800.15	? TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.018	UNSAT TT=21.337	? (TO) TT=1800.21	? (TO) TT=1801.99	? (TO) TT=1802.1	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=2.395	UNSAT TT=2.352	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3700.opb	UNSAT TT=10.434	? TT=11.54	? (MO) TT=761.884	? (MO) TT=759.361	UNSAT TT=10.434	? (TO) TT=1800.11	? (MO) TT=1533.18	? (MO) TT=571.573	? (TO) TT=1801.95	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.1	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3701.opb	UNSAT TT=9.384	? TT=11.785	? (MO) TT=702.462	? (MO) TT=694.213	UNSAT TT=9.384	? (TO) TT=1800.16	? (MO) TT=1150.24	? (MO) TT=575.098	? (TO) TT=1801.96	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.31	? (TO) TT=1800.09	? (TO) TT=1800.05
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3702.opb	UNSAT TT=9.181	? TT=11.61	? (MO) TT=650.323	? (MO) TT=645.564	UNSAT TT=9.181	? (TO) TT=1800.16	? (exit code) TT=923.096	? (MO) TT=572.088	? (TO) TT=1802	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.19	? (TO) TT=1800.1	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3703.opb		? TT=11.654	? (MO) TT=782.041	? (MO) TT=777.393	? (exit code) TT=184.339	? (TO) TT=1800.13	? (MO) TT=1112.95	? (MO) TT=572.133	? (TO) TT=1802.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3704.opb	UNSAT TT=8.56	? TT=11.563	? (MO) TT=850.977	? (MO) TT=847.998	UNSAT TT=8.56	? (TO) TT=1800.12	? (MO) TT=1649.9	? (MO) TT=568.133	? (TO) TT=1801.99	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.27	? (TO) TT=1800.08	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3705.opb	UNSAT TT=9.024	? TT=11.723	? (MO) TT=963.544	? (MO) TT=953.865	UNSAT TT=9.024	? (TO) TT=1800.1	? (MO) TT=766.178	? (MO) TT=573.25	? (TO) TT=1802.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3706.opb	UNSAT TT=10.558	? TT=11.726	? (MO) TT=752.119	? (MO) TT=772.962	UNSAT TT=10.558	? (TO) TT=1800.09	? (MO) TT=1408.03	? (MO) TT=575.133	? (TO) TT=1802.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3707.opb		? TT=11.782	? (MO) TT=852.245	? (MO) TT=848.276	? (exit code) TT=493.308	? (TO) TT=1800.11	? (MO) TT=1054.37	? (MO) TT=572.359	? (TO) TT=1802.02	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.2	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3708.opb	UNSAT TT=8.812	? TT=11.61	? (MO) TT=619.689	? (MO) TT=614.034	UNSAT TT=8.812	? (TO) TT=1800.11	? (MO) TT=910.846	? (MO) TT=571.571	? (TO) TT=1802.06	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.23	? (TO) TT=1800.16	? (TO) TT=1800.29	? (TO) TT=1800.09	? (TO) TT=1800.18
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3709.opb	UNSAT TT=8.624	? TT=11.655	? (MO) TT=1065.64	? (MO) TT=1060.91	UNSAT TT=8.624	? (TO) TT=1800.1	? (TO) TT=1802.32	? (MO) TT=572.047	? (TO) TT=1801.95	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370a.opb	UNSAT TT=8.332	? TT=11.701	? (MO) TT=732.799	? (MO) TT=729.315	UNSAT TT=8.332	? (TO) TT=1800.09	? (MO) TT=1456.59	? (MO) TT=564.621	? (TO) TT=1801.96	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370b.opb	UNSAT TT=9.381	? TT=11.657	? (MO) TT=791.26	? (MO) TT=786.896	UNSAT TT=9.381	? (TO) TT=1800.17	? (MO) TT=1345.27	? (MO) TT=569.198	? (TO) TT=1801.99	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370c.opb	UNSAT TT=8.06	? TT=11.527	? (MO) TT=1335.05	? (MO) TT=1316.43	UNSAT TT=8.06	? (TO) TT=1800.13	? (MO) TT=1653.77	? (MO) TT=573.894	? (TO) TT=1801.93	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.22	? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370e.opb	UNSAT TT=8.72	? TT=11.578	? (MO) TT=795.335	? (MO) TT=788.41	UNSAT TT=8.72	? (TO) TT=1800.16	? (MO) TT=1283.26	? (MO) TT=568.224	? (TO) TT=1802	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10a.opb	OPT f=20 TT=8.973 T1=0	? (TO) TT=1800.1	SAT (TO) f=20 TT=1800.06 T1=0.58	SAT (TO) f=20 TT=1800.09 T1=0.59	? (exit code) TT=2.497	OPT f=20 TT=8.973 T1=5.59	SAT (TO) f=20 TT=1800.13 T1=0.09	OPT f=20 TT=25.859 T1=7.45	SAT (TO) f=20 TT=1802.09 T1=0.25	No Cert. TT=1800.06	SAT (TO) f=20 TT=1800.1 T1=0.59	SAT f=20 TT=1782.73 T1=0	SAT (TO) f=20 TT=1800.27 T1=3.53	SAT (TO) f=20 TT=1800.27 T1=4.24	SAT (TO) f=20 TT=1800.53 T1=2.85	SAT (TO) f=20 TT=1800.11 T1=6.99	SAT (TO) f=20 TT=1800.11 T1=423.69
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10b.opb	UNSAT TT=0.059	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.25	UNSAT TT=0.059	UNSAT TT=13.216	? (TO) TT=1802.13	? (TO) TT=1801.99	? (TO) TT=1802.06	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.01	UNSAT TT=13.656	UNSAT TT=13.56	? (TO) TT=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10c.opb	UNSAT TT=0.058	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.15	UNSAT TT=0.058	UNSAT TT=7.021	? (TO) TT=1802.14	? (TO) TT=1801.98	? (TO) TT=1801.94	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.04	UNSAT TT=3.777	UNSAT TT=4.302	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x12.opb	UNSAT TT=0.243	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.25	UNSAT TT=0.243	UNSAT TT=42.454	? (TO) TT=1802.19	? (TO) TT=1801.93	? (TO) TT=1802.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=3.897	UNSAT TT=3.822	? (TO) TT=1800.29	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x26.opb	UNSAT TT=12.977	? (TO) TT=1800.15	? (TO) TT=1800.26	? (TO) TT=1800.28	? (exit code) TT=0.694	? (TO) TT=1800.04	? (TO) TT=1802.14	? (MO) TT=1800.77	? (TO) TT=1802.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=12.977	UNSAT TT=13.434	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x12.opb	UNSAT TT=0.092	? (TO) TT=1800.16	? (TO) TT=1800.27	? (TO) TT=1800.29	UNSAT TT=0.092	UNSAT TT=255.914	? (TO) TT=1800.28	? (MO) TT=1668.55	? (TO) TT=1802.03	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=6.207	UNSAT TT=6.289	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x21.opb	UNSAT TT=0.187	? (TO) TT=1800.14	? (TO) TT=1800.25	? (TO) TT=1800.27	UNSAT TT=0.187	UNSAT TT=559.974	? (TO) TT=1802.19	? (MO) TT=1630.51	? (TO) TT=1802	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	UNSAT TT=9.736	UNSAT TT=9.949	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran13x13.opb	UNSAT TT=0.105	? (TO) TT=1800.11	? (TO) TT=1800.27	? (TO) TT=1800.36	UNSAT TT=0.105	? (TO) TT=1800.03	? (TO) TT=1801.29	? (MO) TT=1602.8	? (TO) TT=1802.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=4.907	UNSAT TT=5.308	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.1
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran14x18.opb	UNSAT TT=13.34	? (TO) TT=1800.1	? (MO) TT=1601.19	? (MO) TT=1593.43	? (exit code) TT=7.24	? (TO) TT=1800.09	? (TO) TT=1802.16	? (MO) TT=1256.45	? (TO) TT=1802.05	? (TO) TT=1800.15	? (TO) TT=1800.19	? (TO) TT=1800.06	UNSAT TT=13.34	UNSAT TT=13.419	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran16x16.opb	SAT f=35 TT=1801.93 T1=1559.7	? (TO) TT=1800.08	SAT (TO) f=36 TT=1800.21 T1=3.68	SAT (TO) f=36 TT=1800.3 T1=3.49	? (TO) TT=1800.03	SAT (TO) f=45 TT=1800.13 T1=1430.59	SAT (TO) f=37 TT=1800.69 T1=2.29	SAT (TO) f=35 TT=1801.93 T1=1559.7	SAT (TO) f=37 TT=1801.94 T1=20.54	No Cert. TT=1800.09	SAT (TO) f=37 TT=1800.06 T1=75.87	SAT f=36 TT=1782.74 T1=167.85	SAT (TO) f=36 TT=1800.43 T1=10.19	SAT (TO) f=36 TT=1800.41 T1=10.19	SAT (TO) f=37 TT=1800.56 T1=4.14	SAT (TO) f=41 TT=1800.03 T1=62.37	SAT (TO) f=49 TT=1800.09 T1=1307.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran17x17.opb	OPT f=35 TT=1012.03 T1=7.79	? (TO) TT=1800.17	SAT (TO) f=35 TT=1800.23 T1=7.27	SAT (TO) f=35 TT=1800.32 T1=7.79	? (TO) TT=1800.1	SAT (TO) f=39 TT=1800.12 T1=949.82	SAT (TO) f=36 TT=1800.85 T1=0.99	OPT f=35 TT=1012.03 T1=150.46	SAT (TO) f=35 TT=1802.01 T1=19.46	No Cert. TT=1800.05	SAT (TO) f=35 TT=1800.13 T1=610.95	SAT f=36 TT=1782.75 T1=0.09	SAT (TO) f=35 TT=1800.52 T1=20.8	SAT (TO) f=35 TT=1800.48 T1=48.65	SAT (TO) f=36 TT=1800.58 T1=4.03	SAT (TO) f=39 TT=1800.1 T1=86.37	SAT (TO) f=62 TT=1800.07 T1=886.67
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran4x64.opb	UNSAT TT=0.187	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=0.187	UNSAT TT=4.259	? (TO) TT=1800.64	? (MO) TT=24	? (TO) TT=1802.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=5.282	UNSAT TT=4.932	? (TO) TT=1800.36	? (TO) TT=1800.08	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran6x43.opb	UNSAT TT=5.974	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.14	? (exit code) TT=1.241	UNSAT TT=17.596	? (TO) TT=1802.14	? (MO) TT=30.02	? (TO) TT=1802.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=5.974	UNSAT TT=6.074	? (TO) TT=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran8x32.opb	UNSAT TT=0.185	? (TO) TT=1800.14	? (TO) TT=1800.23	? (TO) TT=1800.25	UNSAT TT=0.185	UNSAT TT=140.541	? (TO) TT=1802.13	? (TO) TT=1801.97	? (TO) TT=1802	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=6.593	UNSAT TT=6.311	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome11.opb		? (MO) TT=9.995	? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.08	? (MO) TT=1221.61	? (TO) TT=1800.37	? (TO) TT=1802.01	? (TO) TT=1802.01	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.29	? (TO) TT=1800.3	? (TO) TT=1800.26	? (TO) TT=1800.13	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bc1.opb	UNSAT TT=1754.37	? (TO) TT=1800.21	? (TO) TT=1800.13	? (TO) TT=1800.06	UNSAT TT=1754.37	? (TO) TT=1800.13	? (TO) TT=1802.2	? (MO) TT=263.59	? (TO) TT=1802.06	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.28	? (TO) TT=1800.15	? (TO) TT=1801.88	? (TO) TT=1801.87
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst1.opb		? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.26	? (exit code) TT=36.258	? (TO) TT=1800.14	? (TO) TT=1800.15	? (MO) TT=40.39	? (TO) TT=1802.05	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.28	? (TO) TT=1800.11	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst2.opb		? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.22	? (exit code) TT=18.751	? (TO) TT=1800.09	? (TO) TT=1800.19	? (MO) TT=40.46	? (TO) TT=1802.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.28	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.05	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_3.opb		? TT=13.435	? TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.37	? (TO) TT=1800.56	? (MO) TT=189.265	? (TO) TT=1802.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.33	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_4.opb		? TT=13.561	? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.34	? (TO) TT=1800.39	? (MO) TT=190.666	? (TO) TT=1802.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.25	? (TO) TT=1800.22	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_5.opb		? TT=13.796	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.32	? (TO) TT=1800.37	? (MO) TT=190.361	? (TO) TT=1802.06	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.41	? (TO) TT=1800.38	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare1_1.opb	SAT f=10 TT=1800.39 T1=1781.69	? (TO) TT=1800.13	SAT f=115 TT=1800.01 T1=46.88	SAT (TO) f=115 TT=1800.09 T1=46.77	? (exit code) TT=0.54	SAT (TO) f=53 TT=1800.05 T1=462.92	? (TO) TT=1800.36	? (MO) TT=36.42	SAT (TO) f=50 TT=1802.05 T1=1336.81	No Cert. TT=1800.03	SAT (TO) f=25 TT=1800.06 T1=113.55	SAT f=121 TT=1782.74 T1=190.74	SAT (TO) f=48 TT=1800.17 T1=10.77	SAT (TO) f=29 TT=1800.17 T1=1350.73	SAT (TO) f=10 TT=1800.39 T1=1781.69	SAT (TO) f=43 TT=1800.1 T1=1065.79	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare2_1.opb	SAT f=28 TT=1800.1 T1=1111.45	? (TO) TT=1800.12	SAT f=188 TT=1800.01 T1=41.57	SAT (TO) f=188 TT=1800.05 T1=39.35	? (exit code) TT=0.141	SAT (TO) f=179 TT=1800.08 T1=1.09	? (TO) TT=1800.17	? (MO) TT=30.49	SAT (TO) f=221 TT=1802.1 T1=3.23	No Cert. TT=1800.08	SAT (TO) f=42 TT=1800.08 T1=1312.48	SAT f=217 TT=1782.73 T1=0	SAT (TO) f=64 TT=1800.14 T1=42.97	SAT (TO) f=28 TT=1800.1 T1=1111.45	SAT (TO) f=55 TT=1800.31 T1=45.32	SAT (TO) f=59 TT=1800.05 T1=1220.88	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-mkc1.opb	SAT f=-2715 TT=1802.19 T1=6.81	SAT (TO) f=-2626 TT=1800.2 T1=685.74	SAT (TO) f=-43 TT=1800.04 T1=140.45	SAT (TO) f=-43 TT=1800.04 T1=141.32	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.26	? (TO) TT=1802.04	? (TO) TT=1800.1	? (problem) TT=1246.25	? (problem) TT=1218.22	? (MO) TT=753.772	SAT (TO) f=-669 TT=1802.11 T1=31.3	SAT (TO) f=-1329 TT=1802.01 T1=93.92	SAT (TO) f=-2715 TT=1802.19 T1=6.81	? (TO) TT=1800.03	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos11.opb	UNSAT TT=0.671	? (TO) TT=1800.18	UNSAT TT=0.669	UNSAT TT=0.671	? (exit code) TT=217.066	UNSAT TT=1.669	? (TO) TT=1800.37	? (MO) TT=36.82	UNSAT TT=1.657	UNSAT TT=1.76	UNSAT TT=1.765	UNSAT TT=156.037	UNSAT TT=6.965	UNSAT TT=7.723	UNSAT TT=4.23	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos12.opb	UNSAT TT=1.41	? (TO) TT=1800.2	UNSAT TT=1.405	UNSAT TT=1.41	? (exit code) TT=1463.42	UNSAT TT=6.514	? (TO) TT=1800.09	? (MO) TT=40.807	UNSAT TT=8.047	UNSAT TT=11.904	UNSAT TT=11.155	? (TO) TT=1800.1	UNSAT TT=5.535	UNSAT TT=5.741	UNSAT TT=6.498	? (TO) TT=1800.11	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos13.opb	SAT f=-15694 TT=1800.28 T1=702.68	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.26	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT f=-2494 TT=1782.8 T1=1782.72	SAT (TO) f=-4275 TT=1800.36 T1=1628.91	SAT (TO) f=-6574 TT=1800.48 T1=65.9	SAT (TO) f=-15694 TT=1800.28 T1=702.68	? (TO) TT=1802.17	? (TO) TT=1802.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos14.opb	SAT f=87587 TT=1802.01 T1=7.23	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (exit code) TT=15.215	? (TO) TT=1800.1	? (TO) TT=1800.18	? (MO) TT=37.36	SAT (TO) f=87587 TT=1802.01 T1=7.23	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.21	? (TO) TT=1800.29	? (TO) TT=1800.07	? (TO) TT=1800.03
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos15.opb	SAT f=256 TT=1802.01 T1=37.85	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.17	? (MO) TT=37.23	SAT (TO) f=256 TT=1802.01 T1=37.85	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.24	? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos17.opb	UNSAT TT=0.726	? (TO) TT=1800.05	UNSAT TT=11.043	UNSAT TT=10.471	? (TO) TT=1800.04	UNSAT TT=6.874	UNSAT TT=0.726	? (MO) TT=45.27	UNSAT TT=1.449	UNSAT TT=0.862	UNSAT TT=0.809	UNSAT TT=5.794	UNSAT TT=3.324	UNSAT TT=3.891	UNSAT TT=6.152	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos20.opb	SAT f=-55 TT=1800.07 T1=1598.99	? (TO) TT=1800.13	Signal TT=1.217	Signal TT=1.22	? (exit code) TT=1.492	SAT (TO) f=-55 TT=1800.07 T1=1598.99	? (TO) TT=1800.25	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.12	SAT f=-43 TT=1782.74 T1=1782.65	SAT (TO) f=-38 TT=1800.32 T1=752	SAT (TO) f=-47 TT=1800.3 T1=1593.13	SAT (TO) f=-51 TT=1800.36 T1=1698.96	? (TO) TT=1800.09	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos2.opb	SAT f=3 TT=1576.11 T1=287.42	? (TO) TT=1800.14	SAT (TO) f=4 TT=1800.13 T1=293.61	SAT (TO) f=4 TT=1800.18 T1=206.72	? (exit code) TT=5.269	SAT (TO) f=4 TT=1800.05 T1=1730.42	? (MO) TT=1711.93	? (MO) TT=36.434	SAT (TO) f=12292 TT=1802.09 T1=1693.73	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT f=4 TT=1782.77 T1=245.13	SAT (TO) f=4 TT=1800.51 T1=52.78	SAT f=3 TT=1576.11 T1=287.42	SAT (TO) f=3 TT=1800.52 T1=1181.99	? (TO) TT=1800.07	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos3.opb	SAT f=5 TT=1782.79 T1=195.44	? (TO) TT=1800.2	SAT (TO) f=5 TT=1800.11 T1=197.53	SAT (TO) f=5 TT=1800.14 T1=195.44	? (exit code) TT=8.445	SAT (TO) f=169 TT=1800.09 T1=1594.58	? (TO) TT=1800.23	? (MO) TT=38.563	SAT (TO) f=55710 TT=1801.99 T1=1545.46	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT f=5 TT=1782.79 T1=482.55	SAT (TO) f=26220 TT=1800.48 T1=1617.34	SAT (TO) f=5 TT=1800.52 T1=281.75	SAT (TO) f=5 TT=1800.68 T1=404.61	? (TO) TT=1800.12	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos6.opb		? (TO) TT=1800.14	? (TO) TT=1800.21	? (TO) TT=1800.26	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.24	? (MO) TT=32.903	? (TO) TT=1802.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.33	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos7.opb	SAT f=45 TT=1782.76 T1=1001.11	? (TO) TT=1800.15	SAT (TO) f=48 TT=1800.17 T1=23.58	SAT (TO) f=48 TT=1800.19 T1=23.28	? (exit code) TT=13.689	? (TO) TT=1800.06	? (TO) TT=1800.18	? (MO) TT=40.934	SAT (TO) f=92 TT=1802.11 T1=1774.35	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT f=45 TT=1782.76 T1=1001.11	? (TO) TT=1800.22	? (TO) TT=1800.21	SAT (TO) f=89 TT=1800.82 T1=1625.15	? (TO) TT=1800.02	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos9.opb		? (MO) TT=13.32	? (MO) TT=286.797	? (MO) TT=290.726	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.3	? (MO) TT=1154.51	? (TO) TT=1801.92	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.24	? (TO) TT=1800.24	? (TO) TT=1800.31	? (MO) TT=565.374	? (MO) TT=569.029
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-nug08.opb	SAT f=18 TT=1782.75 T1=1.51	SAT (TO) f=18 TT=1800.2 T1=16.42	SAT (TO) f=18 TT=1800.19 T1=15.68	SAT (TO) f=18 TT=1800.21 T1=15.58	? (TO) TT=1800.09	SAT (TO) f=18 TT=1800.12 T1=464.68	? (TO) TT=1800.17	? (MO) TT=44.326	SAT (TO) f=18 TT=1802.03 T1=8.55	No Cert. TT=1800.07	SAT (TO) f=18 TT=1800.07 T1=3.09	SAT f=18 TT=1782.75 T1=1.51	SAT (TO) f=18 TT=1801.89 T1=5.75	SAT (TO) f=18 TT=1801.83 T1=5.87	SAT (TO) f=18 TT=1801.97 T1=5.63	? (TO) TT=1800.07	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-qap10.opb	SAT f=29 TT=1782.78 T1=7.39	SAT (TO) f=29 TT=1800.37 T1=79.82	Wrong Cert. TT=1800.22	SAT (TO) f=29 TT=1800.26 T1=86.87	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.15	? (MO) TT=85.54	SAT (TO) f=29 TT=1801.97 T1=49.26	No Cert. TT=1800.02	SAT (TO) f=29 TT=1800.12 T1=17.89	SAT f=29 TT=1782.78 T1=7.39	SAT (TO) f=29 TT=1804.15 T1=16.87	SAT (TO) f=29 TT=1804.12 T1=15.91	SAT (TO) f=29 TT=1804.11 T1=15.17	? (TO) TT=1800.12	? (TO) TT=1800.07
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-seymour1.opb	SAT f=100037 TT=1800.09 T1=848.34	SAT (TO) f=104536 TT=1800.12 T1=97.27	SAT (TO) f=99995 TT=1800.07 T1=616.06	SAT (TO) f=100037 TT=1800.09 T1=848.34	? (TO) TT=1800.06	SAT (TO) f=228449 TT=1800.19 T1=266.47	SAT (TO) f=112668 TT=1800.35 T1=2.89	? (MO) TT=40.286	SAT (TO) f=115567 TT=1802.05 T1=166.69	No Cert. TT=1800.07	SAT (TO) f=127853 TT=1800.09 T1=15.59	SAT f=116561 TT=1782.77 T1=1.59	SAT (TO) f=107713 TT=1800.64 T1=5.97	SAT (TO) f=107713 TT=1800.68 T1=5.51	SAT (TO) f=107713 TT=1800.88 T1=5.49	SAT (TO) f=175401 TT=1800.28 T1=1189.56	SAT (TO) f=113574 TT=1800.1 T1=1750.72
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath1.opb	OPT f=262226 TT=355.222 T1=355.17	? (TO) TT=1800.29	? (MO) TT=501.021	? (MO) TT=511.462	OPT f=262226 TT=355.222 T1=355.17	Signal TT=57.125	? (TO) TT=1800.43	? (MO) TT=96.141	? (MO) TT=667.8	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.35	? (TO) TT=1800.12	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath2.opb	OPT f=262226 TT=19.817 T1=19.69	? (TO) TT=1800.35	? (MO) TT=543.836	? (MO) TT=528.156	OPT f=262226 TT=19.817 T1=19.69	Signal TT=51.731	? (TO) TT=1801.59	? (MO) TT=94.277	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.21	? (TO) TT=1800.2	? (TO) TT=1800.28	? (TO) TT=1800.13	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath3.opb	OPT f=262226 TT=14.087 T1=13.99	? (TO) TT=1800.28	? (MO) TT=582.412	? (MO) TT=579.632	OPT f=262226 TT=14.087 T1=13.99	Signal TT=46.129	? (TO) TT=1800.2	? (MO) TT=90.567	? (TO) TT=1801.97	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A1C1S1.opb		? TT=8.653	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=70.608	? (TO) TT=1802.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.11	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A2C1S1.opb		? TT=8.883	? (TO) TT=1800.1	? (TO) TT=1800.21	? (exit code) TT=1038.72	? (TO) TT=1800.12	? (TO) TT=1800.11	? (MO) TT=70.385	? (TO) TT=1801.98	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B1C1S1.opb		? TT=8.622	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.12	? (MO) TT=72.051	? (TO) TT=1802.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.22	? (TO) TT=1800.11	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B2C1S1.opb		? TT=8.695	? (TO) TT=1800.1	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=72.045	? (TO) TT=1802.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.22	? (TO) TT=1800.19	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-berlin_5_8_0.opb		? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	? (exit code) TT=8.367	? (TO) TT=1800.15	? (TO) TT=1800.28	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-bg512142.opb		? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.15	? (exit code) TT=169.593	? (TO) TT=1800.12	? (TO) TT=1800.18	? (MO) TT=35.46	? (TO) TT=1801.99	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.25	? (TO) TT=1800.03	? (TO) TT=1800.05
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-biella1.opb	UNSAT TT=2.472	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=2.472	? (TO) TT=1800.14	? (TO) TT=1801.21	? (MO) TT=92.67	? (TO) TT=1802.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.26	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ar98.opb		? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.12	? (exit code) TT=10.784	? (TO) TT=1800.13	? (TO) TT=1800.1	? (MO) TT=30.713	? (TO) TT=1802.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic97.opb		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.2	? (exit code) TT=130.125	? (TO) TT=1800.11	? (TO) TT=1800.1	? (MO) TT=27.525	? (TO) TT=1802.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.23	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic98.opb		? (TO) TT=1800.12	? (MO) TT=677.729	? (MO) TT=676.236	? (exit code) TT=24.69	? (TO) TT=1800.11	? (TO) TT=1800.07	? (MO) TT=31.34	? (TO) TT=1802.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.24	? (TO) TT=1800.06	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ir98.opb	SAT f=263089 TT=1800.18 T1=215.03	? (TO) TT=1800.06	SAT (TO) f=263089 TT=1800.17 T1=215.06	SAT (TO) f=263089 TT=1800.18 T1=215.03	? (exit code) TT=6.041	? (TO) TT=1800.11	? (TO) TT=1800.14	? (MO) TT=24.03	? (TO) TT=1802.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1800.25	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-CMS750_4.opb		? TT=7.979	? TT=1800.08	? (TO) TT=1800.15	? (exit code) TT=874.759	? (MO) TT=835.638	? (TO) TT=1800.24	? (TO) TT=1800.16	? (TO) TT=1802.04	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.72	? (TO) TT=1800.12	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2536-691.opb	SAT f=388 TT=1800.03 T1=1056.41	SAT (TO) f=599 TT=1800.18 T1=2.25	SAT (TO) f=386 TT=1800.04 T1=1237.96	SAT (TO) f=388 TT=1800.03 T1=1056.41	? (TO) TT=1800.04	SAT (TO) f=4052 TT=1800.06 T1=311	SAT (TO) f=627 TT=1800.36 T1=5.09	? (MO) TT=36.72	SAT (TO) f=597 TT=1802.04 T1=38.99	No Cert. TT=1800.13	SAT (TO) f=1803 TT=1800.17 T1=470.08	SAT f=569 TT=1782.76 T1=9.18	SAT (TO) f=583 TT=1800.91 T1=1632.8	SAT (TO) f=583 TT=1801.03 T1=1613.32	SAT (TO) f=585 TT=1801.05 T1=3.44	SAT (TO) f=613 TT=1800.14 T1=1796.49	SAT (TO) f=647 TT=1800.09 T1=1795.34
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2586-950.opb	SAT f=547 TT=1800.06 T1=994.54	SAT (TO) f=783 TT=1800.16 T1=1.73	SAT (TO) f=547 TT=1800.07 T1=949.22	SAT (TO) f=547 TT=1800.06 T1=994.54	? (TO) TT=1800.11	SAT (TO) f=2578 TT=1800.1 T1=203.04	SAT (TO) f=773 TT=1800.39 T1=11.68	? (MO) TT=37.94	SAT (TO) f=761 TT=1801.97 T1=16.45	No Cert. TT=1800.11	SAT (TO) f=2168 TT=1800.2 T1=182.23	SAT f=762 TT=1782.75 T1=164.27	SAT (TO) f=791 TT=1800.73 T1=1069.18	SAT (TO) f=791 TT=1800.81 T1=1063.34	SAT (TO) f=792 TT=1801.66 T1=3.06	SAT (TO) f=584 TT=1800.1 T1=1741.48	SAT (TO) f=629 TT=1800.08 T1=1713.36
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4284-1064.opb	SAT f=909 TT=1801.4 T1=892.75	SAT (TO) f=944 TT=1800.21 T1=3.23	SAT (TO) f=938 TT=1800.08 T1=100.95	SAT (TO) f=938 TT=1800.12 T1=100.83	? (TO) TT=1800.05	SAT (TO) f=3718 TT=1800.13 T1=520.68	SAT (TO) f=972 TT=1800.23 T1=8.19	? (MO) TT=42.486	SAT (TO) f=954 TT=1802.06 T1=1190.09	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT f=925 TT=1782.77 T1=5.29	SAT (TO) f=909 TT=1801.4 T1=892.75	SAT (TO) f=909 TT=1801.46 T1=905.41	SAT (TO) f=910 TT=1801.57 T1=4.38	SAT (TO) f=1021 TT=1800.12 T1=1793.95	SAT (TO) f=1111 TT=1800.06 T1=1794.9
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4872-1529.opb	SAT f=1240 TT=1800.09 T1=1781.62	SAT (TO) f=1322 TT=1800.22 T1=3.69	SAT (TO) f=1321 TT=1800.12 T1=131.1	SAT (TO) f=1321 TT=1800.06 T1=137.95	? (TO) TT=1800.03	SAT (TO) f=3062 TT=1800.13 T1=803.46	SAT (TO) f=1342 TT=1800.35 T1=10.59	? (MO) TT=42.539	SAT (TO) f=1321 TT=1801.99 T1=45.94	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT f=1301 TT=1782.78 T1=2.99	SAT (TO) f=1323 TT=1801.86 T1=1299.74	SAT (TO) f=1323 TT=1801.62 T1=1296.41	SAT (TO) f=1324 TT=1801.61 T1=4.38	SAT (TO) f=1240 TT=1800.09 T1=1781.62	SAT (TO) f=1382 TT=1800.11 T1=1798.94
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1c.opb	UNSAT TT=19.243	? (TO) TT=1800.24	? TT=1800.07	? (TO) TT=1800.08	UNSAT TT=19.243	? (TO) TT=1800.16	? (MO) TT=528.923	? (MO) TT=144.844	? (TO) TT=1802.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.22	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1l.opb	SAT f=997 TT=1782.78 T1=589.78	? (TO) TT=1800.3	? TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.41	? (MO) TT=206.39	SAT (TO) f=7247 TT=1801.94 T1=1792.72	No Cert. TT=1800.09	SAT (TO) f=160649 TT=1800.13 T1=587.05	SAT f=997 TT=1782.78 T1=589.78	SAT (TO) f=29566 TT=1804.13 T1=822.13	SAT (TO) f=29320 TT=1804.16 T1=972.06	? (TO) TT=1800.21	? (TO) TT=1800.11	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dg012142.opb		? (TO) TT=1800.14	? TT=1800.06	? (TO) TT=1800.1	? (exit code) TT=157.419	? (TO) TT=1800.18	? (TO) TT=1800.28	? (MO) TT=40.127	? (TO) TT=1801.97	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.13	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dolom1.opb	UNSAT TT=1.715	? (TO) TT=1800.24	UNSAT TT=390.065	UNSAT TT=385.499	UNSAT TT=1.715	Signal TT=71.341	? (TO) TT=1802.27	? (MO) TT=183.631	UNSAT TT=173.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=9.533	UNSAT TT=9.311	UNSAT TT=182.44	? (TO) TT=1800.03	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1178 TT=1800.08 T1=492.37	? (TO) TT=1800.17	SAT (TO) f=1211 TT=1800.06 T1=947.33	SAT (TO) f=1211 TT=1800.06 T1=945.02	? (exit code) TT=8.22	? (TO) TT=1800.07	? (TO) TT=1800.46	? (MO) TT=39.64	SAT (TO) f=1279 TT=1802.07 T1=16.61	No Cert. TT=1800.07	SAT (TO) f=1178 TT=1800.08 T1=492.37	SAT f=1564 TT=1782.73 T1=630.63	SAT (TO) f=270776 TT=1800.17 T1=8.36	SAT (TO) f=4467 TT=1800.16 T1=4.5	SAT (TO) f=1348 TT=1800.31 T1=211.68	SAT (TO) f=145476 TT=1800.02 T1=1768.91	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-NSR8K.opb	UNSAT TT=5.321	? TT=9.478	UNSAT TT=828.746	UNSAT TT=823.04	UNSAT TT=5.321	Signal TT=69.101	? (TO) TT=1802.03	? (TO) TT=1802.04	? (TO) TT=1802.12	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=108.869	UNSAT TT=21.735	UNSAT TT=18.851	UNSAT TT=387.007	? (TO) TT=1800.11	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-nsrand_ipx.opb	SAT f=294914 TT=1800.19 T1=9.69	? (TO) TT=1800.09	SAT (TO) f=294914 TT=1800.23 T1=9.67	SAT (TO) f=294914 TT=1800.19 T1=9.69	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.23	? (MO) TT=49.77	SAT (TO) f=309253 TT=1802.04 T1=179.19	No Cert. TT=1800.05	SAT (TO) f=524293 TT=1800.03 T1=1726.73	SAT f=393218 TT=1782.75 T1=0.89	SAT (TO) f=524187 TT=1800.25 T1=1713.63	SAT (TO) f=524297 TT=1800.41 T1=1687.89	SAT (TO) f=392732 TT=1800.29 T1=959.72	SAT (TO) f=458271 TT=1800.11 T1=26.58	SAT (TO) f=327672 TT=1800.12 T1=11.59
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-rail507.opb	SAT f=153 TT=1800.17 T1=180.85	SAT (TO) f=179 TT=1800.22 T1=12.86	Wrong Cert. TT=1800.13	SAT (TO) f=153 TT=1800.17 T1=180.85	? (TO) TT=1800.09	Signal TT=6.747	SAT (TO) f=187 TT=1800.4 T1=129.34	? (TO) TT=1802.13	SAT (TO) f=176 TT=1802.02 T1=1644.99	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT f=162 TT=1782.82 T1=378.74	SAT (TO) f=171 TT=1804.09 T1=9.19	SAT (TO) f=171 TT=1804.11 T1=9.3	SAT (TO) f=168 TT=1804.1 T1=34.53	SAT (TO) f=4319 TT=1800.21 T1=1789.48	SAT (TO) f=3343 TT=1800.17 T1=1788.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-railway_8_1_0.opb		? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.11	? (exit code) TT=10.476	? (TO) TT=1800.24	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-roll3000.opb		? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.17	? (exit code) TT=452.177	? (TO) TT=1800.08	? (TO) TT=1800.19	? (MO) TT=40.77	? (TO) TT=1802.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.26	? (TO) TT=1800.27	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.04
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-siena1.opb	UNSAT TT=2.238	? (TO) TT=1800.23	UNSAT TT=261.528	UNSAT TT=260.215	UNSAT TT=2.238	Signal TT=123.564	? (TO) TT=1802.17	? (MO) TT=210.357	UNSAT TT=499.555	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=11.901	UNSAT TT=10.747	UNSAT TT=843.145	? (TO) TT=1800.1	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=1584 TT=1800.81 T1=14.13	? (TO) TT=1800.09	SAT (MO) f=2208 TT=1160.57 T1=516.39	SAT (MO) f=2208 TT=1150.63 T1=512.18	? (TO) TT=1800.11	SAT (TO) f=21907 TT=1800.12 T1=370.89	SAT (TO) f=3418 TT=1801.13 T1=372.59	? (MO) TT=30.875	SAT (TO) f=3079 TT=1802.07 T1=105.03	No Cert. TT=1800.02	SAT (TO) f=49052 TT=1800.03 T1=1798.6	SAT f=2191 TT=1782.81 T1=480.35	SAT (TO) f=1988 TT=1800.91 T1=12.78	SAT (TO) f=1988 TT=1800.83 T1=12.45	SAT (TO) f=1584 TT=1800.81 T1=14.13	SAT (TO) f=12777 TT=1800.23 T1=1795.4	SAT (TO) f=2227 TT=1800.14 T1=1535.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ic.opb	SAT f=657 TT=1800.74 T1=785.08	? (TO) TT=1800.07	SAT (MO) f=744 TT=778.2 T1=215.03	SAT (MO) f=744 TT=772.755 T1=213.54	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT (TO) f=1080 TT=1801.55 T1=1059.93	? (MO) TT=32.979	SAT (TO) f=1001 TT=1802.05 T1=603.94	No Cert. TT=1800.11	SAT (TO) f=48737 TT=1800.02 T1=1796.39	SAT f=833 TT=1782.82 T1=1453.32	SAT (TO) f=657 TT=1800.74 T1=785.08	SAT (TO) f=660 TT=1800.75 T1=90.73	SAT (TO) f=1291 TT=1800.7 T1=12.04	SAT (TO) f=12262 TT=1800.45 T1=1766.33	SAT (TO) f=741 TT=1800.16 T1=1572.58
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ar.opb	SAT f=1290 TT=1800.92 T1=17.67	? (TO) TT=1800.3	SAT (TO) f=1711 TT=1800.32 T1=1586.82	SAT (TO) f=1711 TT=1800.32 T1=1577.68	? (TO) TT=1800.03	? (TO) TT=1800.13	SAT (TO) f=2159 TT=1800.54 T1=842.04	? (MO) TT=33.913	SAT (TO) f=2072 TT=1801.97 T1=43.72	No Cert. TT=1800.02	SAT (TO) f=30396 TT=1800.02 T1=1798.69	SAT f=1752 TT=1782.77 T1=844.21	SAT (TO) f=1912 TT=1800.99 T1=22.12	SAT (TO) f=1921 TT=1800.94 T1=23.48	SAT (TO) f=1290 TT=1800.92 T1=17.67	SAT (TO) f=9574 TT=1800.14 T1=1703.8	SAT (TO) f=1781 TT=1800.14 T1=1757.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ic.opb	SAT f=801 TT=1800.19 T1=1469.14	? (TO) TT=1800.16	SAT (MO) f=837 TT=895.561 T1=843.26	SAT (MO) f=837 TT=890.533 T1=838.64	? (TO) TT=1800.03	SAT (TO) f=20311 TT=1800.15 T1=625.89	? (TO) TT=1802.31	? (MO) TT=31.497	SAT (TO) f=938 TT=1801.99 T1=1646.46	No Cert. TT=1800.08	SAT (TO) f=45144 TT=1800.07 T1=1797.54	SAT f=949 TT=1782.76 T1=1161.46	SAT (TO) f=912 TT=1800.59 T1=23.41	SAT (TO) f=912 TT=1800.7 T1=22.38	SAT (TO) f=924 TT=1800.59 T1=7.3	SAT (TO) f=9871 TT=1800.34 T1=1745.84	SAT (TO) f=801 TT=1800.19 T1=1469.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.21	? (MO) TT=39.18	? (TO) TT=1802.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.25	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-trento1.opb	UNSAT TT=1.596	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=1.596	? (TO) TT=1800.06	? (MO) TT=743.885	? (MO) TT=99.515	? (TO) TT=1802	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=709.684	UNSAT TT=674.592	? (TO) TT=1800.12	? (TO) TT=1800.28	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-UMTS.opb	SAT f=192 TT=1800.05 T1=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.28	? (TO) TT=1802.56	? (TO) TT=1800.12	No Cert. TT=1800.11	SAT (TO) f=192 TT=1800.05 T1=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.19	? (TO) TT=1800.24	? (TO) TT=1800.32	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-usAbbrv.8.25_70.opb		? (TO) TT=1800.34	? (TO) TT=1800.14	? (TO) TT=1800.15	? (exit code) TT=14.419	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.16	? (TO) TT=1800.25	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1497.64 T1=352.48	? TT=7.947	SAT (MO) f=41696 TT=1645.33 T1=210.51	SAT (MO) f=39649 TT=1497.64 T1=352.48	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT (TO) f=46036 TT=1800.6 T1=105.67	? (MO) TT=167.68	SAT (TO) f=41696 TT=1802.05 T1=1522.15	No Cert. TT=1800.12	SAT (TO) f=46036 TT=1800.18 T1=1637.79	SAT f=41696 TT=1783 T1=1532.66	SAT (TO) f=41696 TT=1800.85 T1=1663.63	SAT (TO) f=39649 TT=1800.74 T1=372.67	SAT (TO) f=43866 TT=1800.72 T1=379.36	? (TO) TT=1800.21	? (TO) TT=1800.22
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-maros.opb	OPT f=12 TT=0.008 T1=0	SAT (TO) f=14 TT=1800.12 T1=0.37	OPT f=12 TT=0.009 T1=0	OPT f=12 TT=0.008 T1=0	OPT f=12 TT=0.013 T1=0	OPT f=12 TT=33.304 T1=0.59	SAT (TO) f=13 TT=1800.4 T1=0.79	? (MO) TT=28.44	SAT (TO) f=12 TT=1802.11 T1=1.07	No Cert. TT=1800.1	SAT (TO) f=12 TT=1800.06 T1=1.69	SAT f=14 TT=1782.73 T1=106.16	OPT f=12 TT=5.104 T1=0.33	SAT (TO) f=12 TT=1800.17 T1=0.33	SAT (TO) f=13 TT=1800.33 T1=1	SAT (TO) f=12 TT=1800.04 T1=130.06	SAT (TO) f=12 TT=1800.11 T1=181.44
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-nazareth.opb	OPT f=-174776 TT=0.003 T1=0	OPT f=-174776 TT=0.449 T1=0.35	OPT f=-174776 TT=0.007 T1=0	OPT f=-174776 TT=0.005 T1=0	OPT f=-174776 TT=0.005 T1=0	OPT f=-174776 TT=2.906 T1=2.89	OPT f=-174776 TT=0.004 T1=0	? (TO) TT=1800.18	? (TO) TT=1800.1	OPT f=-174776 TT=0.003 T1=0	OPT f=-174776 TT=0.003 T1=0	OPT f=-174776 TT=0.005 T1=0	OPT f=-174776 TT=0.266 T1=0.21	OPT f=-174776 TT=0.27 T1=0.21	OPT f=-174776 TT=0.265 T1=0.2	OPT f=-174776 TT=0.048 T1=0	OPT f=-174776 TT=0.087 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-testprob.opb	OPT f=262130 TT=0.005 T1=0	OPT f=262130 TT=0.594 T1=0.4	OPT f=262130 TT=0.006 T1=0	OPT f=262130 TT=0.005 T1=0	? (exit code) TT=0.008	OPT f=262130 TT=0.236 T1=0.1	OPT f=262130 TT=887.481 T1=254.63	? (MO) TT=38.25	OPT f=262130 TT=0.257 T1=0.06	OPT f=262130 TT=2.255 T1=0.09	OPT f=262130 TT=2.211 T1=0.09	OPT f=262130 TT=0.154 T1=0	OPT f=262130 TT=0.277 T1=0.21	OPT f=262130 TT=0.27 T1=0.19	OPT f=262130 TT=0.955 T1=0.2	SAT (TO) f=262130 TT=1800.08 T1=105.07	SAT (TO) f=262130 TT=1800.02 T1=82.17

Some statistics...

	absconPseudo 102	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
Number of times the solver is able to give the best known answer	13	63	58	44	21	5	41	27	41	59	69	62	52	4	2
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	14	65	58	46	23	6	44	27	47	62	75	68	55	13	10
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	35	48	5	2	2	16	0	11	29	21	10	12	3	1
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	1	29	17	2	4	1	14	3	12	32	14	4	10	3	1