PB'16 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade

This page displays the results of the different solvers for each benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
minisatp 2012-10-02 git-d91742b (complete)
NaPS 1.02 (complete)
Sat4j PB 2.3.6 Res+CP PB16 (complete)
Sat4j PB 2.3.6 Resolution PB16 (complete)
toysat 2016-05-02 (complete)

Bench name	Best results on this instance	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-25fv47.opb	UNSAT TT=2.236	UNSAT TT=4.47	UNSAT TT=14.381	UNSAT TT=3.102	UNSAT TT=2.236	? (MO) TT=144.189
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-80bau3b.opb	UNSAT TT=3.493	UNSAT TT=3.976	UNSAT TT=4.252	UNSAT TT=5.089	UNSAT TT=3.493	? (MO) TT=346.877
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-adlittle.opb		? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.03	? (MO) TT=191.884
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-afiro.opb	OPT f=-11897496 TT=2.205 T1=1.25	OPT f=-11897496 TT=123.238 T1=123.26	OPT f=-11897496 TT=518.687 T1=518.76	SAT (TO) f=-11730700 TT=1800.02 T1=872.55	OPT f=-11897496 TT=2.205 T1=1.25	? (MO) TT=193.699
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-agg2.opb		? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	? (MO) TT=194.083
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-agg3.opb		? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=166.806
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-agg.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1801.33	? (TO) TT=1800.61	? (MO) TT=164.279
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-bandm.opb	UNSAT TT=0.923	UNSAT TT=0.923	UNSAT TT=6.459	UNSAT TT=1.885	UNSAT TT=1.115	? (MO) TT=160.618
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-beaconfd.opb	UNSAT TT=1.214	UNSAT TT=3.821	UNSAT TT=121.312	UNSAT TT=2.384	UNSAT TT=1.214	? (MO) TT=193
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-blend.opb	SAT f=1295806500506 TT=1800.11 T1=53.94	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT (TO) f=1295806500506 TT=1800.11 T1=53.94	? (TO) TT=1800.79	? (MO) TT=166.417
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-bnl1.opb		? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.73	? (TO) TT=1800.91	? (exit code) TT=186.07
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-bnl2.opb	UNSAT TT=2.605	UNSAT TT=5.237	UNSAT TT=5.189	UNSAT TT=4.283	UNSAT TT=2.605	? (MO) TT=337.841
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-boeing1.opb	SAT f=48382442725 TT=1800.03 T1=105.4	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.18	SAT (TO) f=48382442725 TT=1800.03 T1=105.4	? (MO) TT=255.895
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-boeing2.opb		? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-bore3d.opb	UNSAT TT=0.365	UNSAT TT=0.365	UNSAT TT=0.565	UNSAT TT=1.614	UNSAT TT=0.916	? (MO) TT=370.709
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-brandy.opb	UNSAT TT=0.582	UNSAT TT=0.582	UNSAT TT=2.531	UNSAT TT=1.835	UNSAT TT=0.995	? (MO) TT=188.504
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-capri.opb	UNSAT TT=0.328	UNSAT TT=0.328	UNSAT TT=1.267	UNSAT TT=1.544	UNSAT TT=1.016	? (MO) TT=197.082
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-cycle.opb		? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.65	? (TO) TT=1800.48	? (MO) TT=265.281
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-czprob.opb	SAT f=213520005192337 TT=1800.17 T1=497.86	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=213520005192337 TT=1800.17 T1=497.86	? (TO) TT=1800.08	? (MO) TT=281.671
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-d2q06c.opb	UNSAT TT=4.335	UNSAT TT=9.083	UNSAT TT=9.253	UNSAT TT=5.975	UNSAT TT=4.335	? (MO) TT=148.5
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-d6cube.opb		? (TO) TT=1800.06	Signal TT=57.961	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-degen2.opb		? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.66	? (TO) TT=1800.89	? (TO) TT=1800.04
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-degen3.opb		? (TO) TT=1800.08	? TT=1089.96	? (TO) TT=1800.11	? (TO) TT=1800.55	? (TO) TT=1800.03
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-dfl001.opb		? (MO) TT=1450.13	? (TO) TT=1800.02	? (TO) TT=1800.95	? (TO) TT=1800.06	? (MO) TT=169.663
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-e226.opb	UNSAT TT=0.026	UNSAT TT=0.686	UNSAT TT=0.026	UNSAT TT=1.744	UNSAT TT=1.084	? (MO) TT=154.928
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-etamacro.opb	UNSAT TT=0.372	UNSAT TT=0.372	UNSAT TT=0.393	UNSAT TT=1.735	UNSAT TT=1.093	? (MO) TT=193.005
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fffff800.opb	UNSAT TT=1.544	UNSAT TT=3.125	UNSAT TT=77.002	UNSAT TT=2.484	UNSAT TT=1.544	? (MO) TT=184.592
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit1p.opb		? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.68	? (MO) TT=197.183
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit2d.opb		? (TO) TT=1800.03	Signal TT=217.705	? (TO) TT=1800.6	? (TO) TT=1800.57	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit2p.opb		? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.4	? (TO) TT=1800.84	? (MO) TT=179.496
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-forplan.opb		? (TO) TT=1800.02	? (TO) TT=1800.26	? (TO) TT=1800.14	? (TO) TT=1800.01	? (MO) TT=196.939
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ganges.opb	UNSAT TT=1.475	UNSAT TT=1.475	UNSAT TT=2.922	UNSAT TT=2.403	UNSAT TT=1.674	? (MO) TT=1146.9
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-gfrd-pnc.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800	? (MO) TT=234.779
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-greenbea.opb		? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	? (MO) TT=170.109
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-greenbeb.opb		? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.09	? (MO) TT=177.104
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-grow15.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.07	? (MO) TT=206.383
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-grow22.opb		? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.16	? (TO) TT=1800.08	? (MO) TT=201.386
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-grow7.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=196.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-israel.opb	SAT f=-304132519107 TT=1800.11 T1=912.95	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT (TO) f=-294151729076 TT=1800.12 T1=279.8	SAT (TO) f=-304132519107 TT=1800.11 T1=912.95	? (MO) TT=260.594
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-kb2.opb	SAT f=0 TT=1800.01 T1=0.88	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT (TO) f=0 TT=1800.15 T1=0.88	SAT (TO) f=0 TT=1800.01 T1=408.29	? (MO) TT=172.373
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-lotfi.opb		? (MO) TT=443.444	? (MO) TT=1560.66	? (TO) TT=1800.57	? (TO) TT=1800.07	? (MO) TT=336.069
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-maros.opb		? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.62	? (TO) TT=1800.72	? (MO) TT=187.892
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-maros-r7.opb		? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (MO) TT=189.362
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-modszk1.opb		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.74	? (MO) TT=163.008
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-nesm.opb	UNSAT TT=2.194	UNSAT TT=3.434	UNSAT TT=5.114	UNSAT TT=3.223	UNSAT TT=2.194	? (MO) TT=208.291
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-perold.opb	UNSAT TT=1.642	UNSAT TT=1.642	UNSAT TT=1.655	UNSAT TT=2.284	UNSAT TT=1.784	? (MO) TT=596.223
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-pilot4.opb	UNSAT TT=1.289	UNSAT TT=1.292	UNSAT TT=1.289	UNSAT TT=2.084	UNSAT TT=1.604	? (MO) TT=321.257
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-pilot87.opb	UNSAT TT=3.244	UNSAT TT=5.782	UNSAT TT=5.721	UNSAT TT=4.843	UNSAT TT=3.244	? (MO) TT=355.476
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-pilot.opb	UNSAT TT=1.774	UNSAT TT=2.285	UNSAT TT=2.261	UNSAT TT=2.634	UNSAT TT=1.774	? (MO) TT=185.795
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-pilot.we.opb	UNSAT TT=18.208	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=18.208	? (TO) TT=1800.5	? (MO) TT=317.07
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-recipe.opb	OPT f=-136341504 TT=5.574 T1=3.98	? (MO) TT=738.825	? (TO) TT=1800.02	OPT f=-136341504 TT=5.574 T1=3.98	SAT (TO) f=-136069369 TT=1800.03 T1=369.89	? (MO) TT=194.953
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc105.opb	OPT f=0 TT=1.092 T1=0.75	OPT f=0 TT=1.092 T1=1.08	OPT f=0 TT=1333.35 T1=1333.52	OPT f=0 TT=16.002 T1=0.89	OPT f=0 TT=8.013 T1=0.75	? (exit code) TT=1311.79
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc205.opb	OPT f=0 TT=3.293 T1=0.86	OPT f=0 TT=3.293 T1=3.28	? (TO) TT=1800.02	OPT f=0 TT=18.112 T1=0.96	OPT f=0 TT=8.593 T1=0.86	? (exit code) TT=1276.1
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc50a.opb	OPT f=-60000 TT=4.866 T1=2.75	OPT f=-60000 TT=4.866 T1=4.86	OPT f=-60000 TT=271.767 T1=271.8	OPT f=-60000 TT=9.153 T1=2.75	OPT f=-60000 TT=6.561 T1=4.27	OPT f=-60000 TT=176.196 T1=174.74
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc50b.opb	OPT f=-70000 TT=6.963 T1=3.81	OPT f=-70000 TT=12.521 T1=12.52	OPT f=-70000 TT=915.139 T1=915.25	OPT f=-70000 TT=44.849 T1=5.27	OPT f=-70000 TT=6.963 T1=3.81	OPT f=-70000 TT=1119.79 T1=1119.2
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scagr25.opb	UNSAT TT=0.475	UNSAT TT=0.475	UNSAT TT=1.575	UNSAT TT=1.684	UNSAT TT=1.154	? (MO) TT=196.098
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scagr7.opb	UNSAT TT=0.117	UNSAT TT=0.117	UNSAT TT=1.203	UNSAT TT=1.234	UNSAT TT=0.764	? (MO) TT=194.902
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scfxm1.opb	UNSAT TT=0.869	UNSAT TT=0.869	UNSAT TT=189.486	UNSAT TT=1.974	UNSAT TT=0.955	? (MO) TT=199.899
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scfxm2.opb	UNSAT TT=1.335	UNSAT TT=1.714	UNSAT TT=3.528	UNSAT TT=2.205	UNSAT TT=1.335	? (MO) TT=165.117
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scfxm3.opb	UNSAT TT=1.513	UNSAT TT=2.576	UNSAT TT=4.397	UNSAT TT=2.745	UNSAT TT=1.513	? (MO) TT=163.974
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scorpion.opb		? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.71	? (TO) TT=1800.07	? (MO) TT=192.893
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scrs8.opb		? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.03	? (MO) TT=231.907
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scsd1.opb		? (MO) TT=459.488	? (MO) TT=395.161	? (TO) TT=1800.16	? (TO) TT=1800.07	? (MO) TT=190.743
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scsd6.opb		? (MO) TT=461.09	? (MO) TT=402.995	? (TO) TT=1800.16	? (TO) TT=1800.02	? (MO) TT=170.005
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scsd8.opb		? (MO) TT=378.226	? (MO) TT=396.286	? (TO) TT=1800.8	? (TO) TT=1800.02	? (MO) TT=182.906
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sctap1.opb	SAT f=1225564623 TT=1800.86 T1=1491.29	SAT (TO) f=33736624906 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=3448984838 TT=1800.34 T1=858.01	SAT (TO) f=1225564623 TT=1800.86 T1=1491.29	? (MO) TT=165.924
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sctap2.opb	SAT f=2807518283 TT=1800.1 T1=35.44	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=5605999579 TT=1800.18 T1=15.15	SAT (TO) f=2807518283 TT=1800.1 T1=35.44	? (MO) TT=169.867
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sctap3.opb	SAT f=14414485905 TT=1800.14 T1=318.1	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=14414485905 TT=1800.14 T1=318.1	No Cert. TT=1800.07	? (MO) TT=170.016
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-seba.opb		? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.04	? (MO) TT=195.203
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-share1b.opb	UNSAT TT=0.397	UNSAT TT=0.397	UNSAT TT=1.617	UNSAT TT=1.645	UNSAT TT=0.855	? (MO) TT=182.603
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-share2b.opb	SAT f=-39584070 TT=1800.07 T1=19.5	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT (TO) f=-39584070 TT=1800.07 T1=19.5	? (TO) TT=1800.52	? (MO) TT=206.62
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-shell.opb		? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800	? (MO) TT=358.359
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship04l.opb	UNSAT TT=1.005	UNSAT TT=3.496	UNSAT TT=4.912	UNSAT TT=2.335	UNSAT TT=1.653	UNSAT TT=1.005
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship04s.opb	UNSAT TT=0.495	UNSAT TT=1.52	UNSAT TT=0.495	UNSAT TT=1.065	UNSAT TT=0.934	UNSAT TT=0.706
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship08l.opb	UNSAT TT=1.994	UNSAT TT=6.394	UNSAT TT=7.687	UNSAT TT=3.481	UNSAT TT=2.354	UNSAT TT=1.994
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship08s.opb	UNSAT TT=0.683	UNSAT TT=3.276	UNSAT TT=0.683	UNSAT TT=3.125	UNSAT TT=1.774	UNSAT TT=1.114
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship12l.opb	UNSAT TT=1.913	UNSAT TT=7.062	UNSAT TT=2.916	UNSAT TT=2.213	UNSAT TT=1.913	UNSAT TT=2.602
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship12s.opb	UNSAT TT=1.306	UNSAT TT=3.124	UNSAT TT=1.492	UNSAT TT=2.054	UNSAT TT=1.333	UNSAT TT=1.306
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sierra.opb	UNSAT TT=1.208	UNSAT TT=14.206	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.42	UNSAT TT=1.208
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-stair.opb	UNSAT TT=13.361	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=13.361	UNSAT TT=26.691	? (MO) TT=172.737
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-standata.opb		? (TO) TT=1800.02	? (TO) TT=1800.37	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=444.794
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-standgub.opb		? (TO) TT=1800.04	? (TO) TT=1800.34	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=446.986
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-stocfor1.opb	UNSAT TT=0.103	UNSAT TT=0.103	UNSAT TT=0.12	UNSAT TT=1.404	UNSAT TT=0.724	? (MO) TT=176.654
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-stocfor2.opb	UNSAT TT=1.913	UNSAT TT=2.352	UNSAT TT=2.316	UNSAT TT=3.084	UNSAT TT=1.913	? (MO) TT=198.931
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-tuff.opb		? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.44	? (TO) TT=1800.12	? (MO) TT=157.124
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-vtp.base.opb		? (MO) TT=776.014	? (TO) TT=1800.02	? (TO) TT=1800.69	? (TO) TT=1800.05	? (MO) TT=196.492
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-wood1p.opb		? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (MO) TT=181.392
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-woodw.opb	UNSAT TT=5.532	UNSAT TT=26.079	UNSAT TT=67.007	UNSAT TT=12.113	UNSAT TT=5.532	? (MO) TT=168.59
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-a1c1s1.opb		? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.13
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-arki001.opb	UNSAT TT=2.744	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=2.744	? (TO) TT=1800.06	? (MO) TT=284.488
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-atlanta-ip.opb	SAT f=12001901559546 TT=1800.65 T1=62.77	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=15602490537890 TT=1800.08 T1=10.03	SAT (TO) f=12001901559546 TT=1800.65 T1=62.77	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-dano3mip.opb		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.34
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-danoint.opb		? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/ miplib2003/normalized-mps-v2-20-10-ds.opb	SAT f=510229 TT=1802.32 T1=75.4	SAT (TO) f=696935 TT=1800.4 T1=1800.3	SAT (MO) f=2121867 TT=316.051 T1=315.41	SAT (TO) f=510229 TT=1802.32 T1=75.4	No Cert. TT=1802.82	? (TO) TT=1800.31
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-fiber.opb	SAT f=46355055 TT=1800.16 T1=1800.4	SAT (TO) f=1988425470 TT=1800.03 T1=1800.3	SAT (TO) f=46355055 TT=1800.16 T1=1800.4	SAT (TO) f=64801527 TT=1800.19 T1=18.96	SAT (TO) f=62541951 TT=1800.06 T1=135.52	? (TO) TT=1800.65
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-fixnet6.opb	SAT f=9743222 TT=1800.08 T1=5.72	SAT (TO) f=97165505 TT=1800.1 T1=1800.4	? (TO) TT=1800.07	SAT (TO) f=36078890 TT=1800.19 T1=14.09	SAT (TO) f=9743222 TT=1800.08 T1=5.72	? (TO) TT=1800.46
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-gesa2-o.opb		? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	? (MO) TT=206.276
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-gesa2.opb	SAT f=4538154438494 TT=1800.08 T1=133.61	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT (TO) f=4687399224674 TT=1800.02 T1=3.13	SAT (TO) f=4538154438494 TT=1800.08 T1=133.61	? (MO) TT=166.246
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-glass4.opb	OPT f=1228810444800 TT=6.642 T1=5.29	? (MO) TT=437.358	? (TO) TT=1800.1	SAT (TO) f=1245192525829 TT=1800.87 T1=41.13	OPT f=1228810444800 TT=6.642 T1=5.29	? (MO) TT=211.588
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-harp2.opb	SAT f=-65132348 TT=1800.16 T1=6.32	? (TO) TT=1800.03	SAT (TO) f=-50338467 TT=1800.11 T1=1800.4	SAT (TO) f=-65132348 TT=1800.16 T1=6.32	SAT (TO) f=-52047497 TT=1800.89 T1=0.52	? (MO) TT=247.758
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-liu.opb	SAT f=1440416 TT=1800.08 T1=1800.4	SAT (TO) f=1440416 TT=1800.08 T1=1800.4	? (TO) TT=1800.01	SAT (TO) f=2752511 TT=1800.19 T1=162.24	SAT (TO) f=4980735 TT=1800.05 T1=95.57	? (MO) TT=327.457
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-markshare1.opb	SAT f=14336 TT=1800.06 T1=694.07	SAT (TO) f=45056 TT=1800.02 T1=1800.3	SAT (TO) f=21504 TT=1800.01 T1=1800.3	SAT (TO) f=14336 TT=1800.06 T1=694.07	SAT (TO) f=23552 TT=1800.67 T1=1322	? (TO) TT=1800.03
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-markshare2.opb	SAT f=77824 TT=1800.06 T1=581.6	SAT (TO) f=98304 TT=1800.02 T1=1800.3	SAT (TO) f=104448 TT=1800.11 T1=1800.4	SAT (TO) f=82944 TT=1800.55 T1=411.79	SAT (TO) f=77824 TT=1800.06 T1=581.6	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mas74.opb	SAT f=52428797515 TT=1800.68 T1=338.84	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT (TO) f=52428797515 TT=1800.68 T1=338.84	? (TO) TT=1800.02	? (MO) TT=264.359
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mas76.opb	SAT f=209715197291 TT=1800.03 T1=6.23	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT (TO) f=209715197291 TT=1800.03 T1=6.23	? (TO) TT=1800.04	? (MO) TT=243.977
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-misc07.opb	OPT f=1076618240 TT=108 T1=3.3	SAT (TO) f=1076618240 TT=1800.02 T1=1800.3	SAT (TO) f=1076618240 TT=1800.03 T1=1800.3	OPT f=1076618240 TT=506.648 T1=3.3	OPT f=1076618240 TT=108 T1=23.86	? (exit code) TT=177.729
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mkc.opb	SAT f=-151625 TT=1800.06 T1=1800.3	SAT (TO) f=-151625 TT=1800.06 T1=1800.3	SAT (TO) f=-70125 TT=1800.19 T1=1800.5	SAT (TO) f=-126875 TT=1800.92 T1=0.93	SAT (TO) f=-126750 TT=1800.83 T1=402.57	? (MO) TT=265.261
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mod011.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.17	? (TO) TT=1800.09	? (MO) TT=204.908
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-modglob.opb		? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.03	? (MO) TT=184.435
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-momentum1.opb	UNSAT TT=2.712	UNSAT TT=2.925	UNSAT TT=2.901	UNSAT TT=3.905	UNSAT TT=2.712	? (MO) TT=239.495
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-momentum2.opb	UNSAT TT=1.179	UNSAT TT=23.6	UNSAT TT=1.179	UNSAT TT=13.122	UNSAT TT=10.099	? (exit code) TT=870.51
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-momentum3.opb	SAT f=10752000000 TT=1800.03 T1=112.78	? (TO) TT=1800.02	? (TO) TT=1800.16	SAT (TO) f=10752000000 TT=1800.03 T1=112.78	SAT (TO) f=11370576184 TT=1800.8 T1=34.57	? (MO) TT=256.978
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-msc98-ip.opb	SAT f=2634797100956844820 TT=1800.17 T1=697.23	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT (TO) f=2634797100956844820 TT=1800.17 T1=697.23	SAT (TO) f=2722140601278347731 TT=1800.77 T1=2.83	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-noswot.opb	OPT f=-41 TT=6.392 T1=0.43	OPT f=-41 TT=6.392 T1=6.39	OPT f=-41 TT=100.436 T1=100.44	OPT f=-41 TT=430.568 T1=1.83	OPT f=-41 TT=154.51 T1=0.43	OPT f=-41 TT=985.062 T1=985.39
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-nsrand-ipx.opb	SAT f=1241512960 TT=1800.18 T1=1800.5	SAT (TO) f=1853685760 TT=1800.05 T1=1800.4	SAT (TO) f=1241512960 TT=1800.18 T1=1800.5	SAT (TO) f=1614804990 TT=1800.12 T1=899.64	SAT (TO) f=1346895871 TT=1801.45 T1=863.14	? (MO) TT=188.183
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-pk1.opb	SAT f=57344 TT=1800.02 T1=1800.3	SAT (TO) f=57344 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-pp08aCUTS.opb	SAT f=24854395555 TT=1800.09 T1=1800.4	SAT (TO) f=24854395555 TT=1800.09 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.04	? (MO) TT=142.72
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-pp08a.opb	SAT f=10946196156 TT=1800.1 T1=1800.4	SAT (TO) f=10946196156 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.05	? (MO) TT=145.453
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-qiu.opb	UNSAT TT=0.312	UNSAT TT=1.571	UNSAT TT=154.594	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.312
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-rd-rplusc-21.opb	UNSAT TT=19.62	UNSAT TT=72.545	UNSAT TT=71.751	UNSAT TT=31.86	UNSAT TT=19.62	? (MO) TT=241.851
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-roll3000.opb	SAT f=1095891440 TT=1800.01 T1=1800.3	SAT (TO) f=1095891440 TT=1800.01 T1=1800.3	? (TO) TT=1800.04	? (TO) TT=1800.16	SAT (TO) f=1113587711 TT=1800.08 T1=409.91	? (MO) TT=147.241
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-rout.opb	SAT f=1075039488 TT=1800.1 T1=1800.4	SAT (TO) f=1075039488 TT=1800.1 T1=1800.4	SAT (TO) f=1075496960 TT=1800.09 T1=1800.5	SAT (TO) f=1075130624 TT=1800.1 T1=766.37	SAT (TO) f=1075083776 TT=1800.95 T1=1153.38	? (MO) TT=245.805
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-set1ch.opb	SAT f=359960590 TT=1800.08 T1=1.17	SAT (TO) f=5788941750 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=365047649 TT=1800.04 T1=1.67	SAT (TO) f=359960590 TT=1800.08 T1=1.17	? (MO) TT=279.864
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-sp97ar.opb	SAT f=43815878113 TT=1800 T1=168.92	SAT (TO) f=503555543330 TT=1800.06 T1=1800.3	SAT (TO) f=102428565298 TT=1800.11 T1=1800.4	SAT (TO) f=43815878113 TT=1800 T1=168.92	No Cert. TT=1800.94	? (MO) TT=230.764
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-stp3d.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-swath.opb		? (MO) TT=390.661	? (MO) TT=333.254	? (TO) TT=1800.14	? (TO) TT=1800.01	? (MO) TT=220.988
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-timtab1.opb	UNSAT TT=1.032	UNSAT TT=1.032	UNSAT TT=328.034	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=2.399
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-timtab2.opb	SAT f=180707374499942795 TT=1800.75 T1=0.93	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT (TO) f=191804917299898631 TT=1801.01 T1=1.94	SAT (TO) f=180707374499942795 TT=1800.75 T1=0.93	? (MO) TT=632.868
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.87	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-van.opb	SAT f=24193312742 TT=1800.13 T1=112.14	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT (TO) f=24193312742 TT=1800.13 T1=112.14	SAT (TO) f=25442247019 TT=1800.92 T1=14.49	? (TO) TT=1800.6
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-blend2.opb	SAT f=160502828 TT=1800.07 T1=901.32	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.18	SAT (TO) f=160502828 TT=1800.07 T1=901.32	? (MO) TT=325.872
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-gesa3_o.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.67	? (MO) TT=186.484
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-gesa3.opb	SAT f=4865649697229 TT=1800.05 T1=2.13	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=4865953557383 TT=1800.04 T1=3.72	SAT (TO) f=4865649697229 TT=1800.05 T1=2.13	? (MO) TT=176.594
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-qnet1_o.opb	UNSAT TT=0.859	UNSAT TT=0.859	UNSAT TT=495.553	UNSAT TT=2.445	UNSAT TT=1.205	? (MO) TT=261
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-qnet1.opb	UNSAT TT=0.881	UNSAT TT=0.881	UNSAT TT=496.575	UNSAT TT=2.564	UNSAT TT=1.205	? (MO) TT=252.105
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell3a.opb	SAT f=139474892366875 TT=1800.07 T1=846.23	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT (TO) f=139474892366875 TT=1800.07 T1=846.23	SAT (TO) f=141211004331900 TT=1800 T1=1417.9	? (MO) TT=183.397
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell3b.opb	SAT f=1323375948476250 TT=1800.75 T1=16.85	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1323375948476250 TT=1800.75 T1=16.85	SAT (TO) f=1391388940707500 TT=1800.02 T1=0.5	? (MO) TT=185.208
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell4.opb	SAT f=195203118275530 TT=1800.08 T1=13.29	SAT (TO) f=1809895699004031 TT=1800.03 T1=1800.3	? (TO) TT=1800.02	SAT (TO) f=196895269604964 TT=1800.08 T1=373.99	SAT (TO) f=195203118275530 TT=1800.08 T1=13.29	? (MO) TT=176.677
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell5.opb	SAT f=948234148331060 TT=1800.01 T1=5.86	SAT (TO) f=4378916459574992 TT=1800.02 T1=1800.3	SAT (TO) f=9076326695683005 TT=1800.1 T1=1800.4	SAT (TO) f=952645238310140 TT=1800.07 T1=368.54	SAT (TO) f=948234148331060 TT=1800.01 T1=5.86	? (MO) TT=213.78
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-dcmulti.opb	SAT f=3596062786 TT=1800.1 T1=1800.4	? (TO) TT=1800.03	SAT (TO) f=3596062786 TT=1800.1 T1=1800.4	SAT (TO) f=3660031644 TT=1800.85 T1=60.29	? (TO) TT=1800.08	? (MO) TT=137.889
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-egout.opb	OPT f=471047168 TT=18.611 T1=14.93	OPT f=471047168 TT=244.896 T1=244.91	OPT f=471047168 TT=253.618 T1=253.58	OPT f=471047168 TT=55.726 T1=26.34	OPT f=471047168 TT=18.611 T1=14.93	? (MO) TT=373.646
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-fixnet3.opb	SAT f=208952688 TT=1800.01 T1=19.53	SAT (TO) f=677887696 TT=1800.08 T1=1800.4	? (TO) TT=1800.06	SAT (TO) f=226802612 TT=1800.15 T1=14.12	SAT (TO) f=208952688 TT=1800.01 T1=19.53	? (TO) TT=1800.64
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-fixnet4.opb	SAT f=36559396 TT=1800.11 T1=2.1	SAT (TO) f=150845990 TT=1800.1 T1=1800.4	? (TO) TT=1800.04	SAT (TO) f=36559396 TT=1800.11 T1=2.1	SAT (TO) f=40429688 TT=1800 T1=617.6	? (TO) TT=1800.54
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-flugpl.opb	OPT f=14745600 TT=0.524 T1=0.26	OPT f=14745600 TT=5.147 T1=5.14	OPT f=14745600 TT=28.516 T1=28.51	OPT f=14745600 TT=1.134 T1=3.68	OPT f=14745600 TT=0.524 T1=0.26	OPT f=14745600 TT=441.097 T1=437.99
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-gen.opb	SAT f=62368424818434 TT=1801.05 T1=1.8	? (TO) TT=1800.03	SAT (TO) f=71949883380915 TT=1800.1 T1=1800.4	SAT (TO) f=62665484800045 TT=1800.06 T1=22.77	SAT (TO) f=62368424818434 TT=1801.05 T1=1.8	? (exit code) TT=143.685
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-khb05250.opb	SAT f=201130104438 TT=1800.11 T1=298.01	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT (TO) f=201130104438 TT=1800.11 T1=298.01	SAT (TO) f=312907105424 TT=1800.07 T1=12.5	? (MO) TT=272.364
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc01.opb	OPT f=1074317824 TT=0.393 T1=0.39	OPT f=1074317824 TT=0.393 T1=0.39	OPT f=1074317824 TT=165.17 T1=165.19	OPT f=1074317824 TT=2.233 T1=2.16	OPT f=1074317824 TT=0.845 T1=0.43	? (MO) TT=147.731
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc02.opb	OPT f=1075471360 TT=0.623 T1=0.32	OPT f=1075471360 TT=1.268 T1=1.26	OPT f=1075471360 TT=156.198 T1=156.21	OPT f=1075471360 TT=1.354 T1=2.15	OPT f=1075471360 TT=0.623 T1=0.32	? (MO) TT=173.797
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc03.opb	OPT f=1077181440 TT=2.534 T1=0.96	OPT f=1077181440 TT=10.41 T1=10.41	OPT f=1077181440 TT=707.974 T1=708.11	OPT f=1077181440 TT=7.022 T1=3.7	OPT f=1077181440 TT=2.534 T1=0.96	? (MO) TT=175.851
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc04.opb		? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (MO) TT=182.806
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc05.opb	OPT f=1076796928 TT=48.27 T1=2.2	OPT f=1076796928 TT=48.27 T1=48.27	SAT (TO) f=1076796928 TT=1800.01 T1=1800.3	OPT f=1076796928 TT=298.642 T1=13.4	OPT f=1076796928 TT=111.81 T1=2.2	? (MO) TT=146.841
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc06.opb		? (MO) TT=706.238	? (TO) TT=1800.01	? (TO) TT=1801.45	? (TO) TT=1800.05	? (MO) TT=1392.25
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-mod013.opb	SAT f=32134720 TT=1800.09 T1=971.24	SAT (TO) f=47984050 TT=1800.02 T1=1800.3	SAT (TO) f=37316170 TT=1800.1 T1=1800.4	SAT (TO) f=32248804 TT=1800.09 T1=657.05	SAT (TO) f=32134720 TT=1800.09 T1=971.24	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-rgn.opb	SAT f=680450 TT=1800.01 T1=1800.3	SAT (TO) f=680450 TT=1800.01 T1=1800.3	SAT (TO) f=741568 TT=1800.1 T1=1800.4	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-sample2.opb	OPT f=384000 TT=1.556 T1=0.35	OPT f=384000 TT=4.773 T1=4.82	OPT f=384000 TT=30.849 T1=30.83	OPT f=384000 TT=3.892 T1=2.28	OPT f=384000 TT=1.556 T1=0.35	OPT f=384000 TT=558.247 T1=360.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-set1al.opb	SAT f=264221696 TT=1800.04 T1=418.06	SAT (TO) f=24467753325 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=264221696 TT=1800.04 T1=418.06	SAT (TO) f=394563828 TT=1800.58 T1=1295.76	? (MO) TT=172.694
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-set1cl.opb	SAT f=27659262 TT=1801.16 T1=219.72	SAT (TO) f=8251669264 TT=1800.11 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=27659262 TT=1801.16 T1=219.72	SAT (TO) f=27659264 TT=1800.03 T1=0.77	? (MO) TT=170.877
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-bal8x12.opb	SAT f=89417487 TT=1800.02 T1=1340.56	SAT (TO) f=129514680 TT=1800.03 T1=1800.3	SAT (TO) f=118176232 TT=1800.06 T1=1800.4	SAT (TO) f=101131486 TT=1800.06 T1=558.41	SAT (TO) f=89417487 TT=1800.02 T1=1340.56	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-bk4x3.opb	OPT f=358400 TT=1.234 T1=0.52	OPT f=358400 TT=2.296 T1=2.29	OPT f=358400 TT=14.976 T1=14.97	OPT f=358400 TT=3.632 T1=7.21	OPT f=358400 TT=1.234 T1=0.52	OPT f=358400 TT=26.654 T1=16.01
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-gr4x6.opb	OPT f=20720640 TT=47.99 T1=8.75	OPT f=20720640 TT=435.922 T1=435.99	OPT f=20720640 TT=645.649 T1=645.72	OPT f=20720640 TT=110.206 T1=8.75	OPT f=20720640 TT=47.99 T1=9.95	? (TO) TT=1800.09
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3700.opb	SAT f=2238939201 TT=1800.79 T1=82.84	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT (TO) f=2238939201 TT=1800.79 T1=82.84	No Cert. TT=1800.02	? (MO) TT=148.61
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3701.opb	SAT f=9027581973 TT=1800.19 T1=264.2	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT (TO) f=9027581973 TT=1800.19 T1=264.2	? (TO) TT=1800.08	? (MO) TT=152.61
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3702.opb		? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.54	? (TO) TT=1800.02	? (MO) TT=170.518
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3703.opb		? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	No Cert. TT=1800.09	? (MO) TT=168.104
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3704.opb	SAT f=14059485952 TT=1800.11 T1=19.82	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT (TO) f=39635092687 TT=1800.06 T1=337.76	SAT (TO) f=14059485952 TT=1800.11 T1=19.82	? (MO) TT=206.38
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3705.opb		? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	No Cert. TT=1800.07	? (MO) TT=151.518
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3706.opb		? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.76	? (TO) TT=1800.67	? (MO) TT=217.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3707.opb		? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.95	? (TO) TT=1800.06	? (MO) TT=172.82
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3708.opb	SAT f=6829346271 TT=1800.11 T1=20.51	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.78	SAT (TO) f=6829346271 TT=1800.11 T1=20.51	? (MO) TT=163.898
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3709.opb	SAT f=7426019560 TT=1800.86 T1=195.42	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT (TO) f=7426019560 TT=1800.86 T1=195.42	SAT (TO) f=22023076789 TT=1800.03 T1=7.76	? (MO) TT=147.311
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370a.opb	SAT f=45168146369 TT=1800.09 T1=40.41	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=45168146369 TT=1800.09 T1=40.41	? (MO) TT=174.477
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370b.opb	SAT f=7550768122 TT=1800.81 T1=240	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT (TO) f=7550768122 TT=1800.81 T1=240	? (TO) TT=1800.04	? (MO) TT=170.618
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370c.opb	SAT f=31665295757 TT=1800.75 T1=64.92	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT (TO) f=31665295757 TT=1800.75 T1=64.92	No Cert. TT=1800.01	? (MO) TT=208.925
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370e.opb	SAT f=9488653097 TT=1800.75 T1=484.09	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT (TO) f=9488653097 TT=1800.75 T1=484.09	SAT (TO) f=10682457713 TT=1800.11 T1=5.53	? (MO) TT=185.178
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x10a.opb	SAT f=1751040 TT=1800.12 T1=4.92	SAT (TO) f=6371081 TT=1800.11 T1=1800.4	SAT (TO) f=2896117 TT=1800.1 T1=1800.4	SAT (TO) f=1751040 TT=1800.12 T1=4.92	SAT (TO) f=1817600 TT=1800.92 T1=0.46	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x10b.opb	SAT f=3729408 TT=1800.74 T1=12.91	SAT (TO) f=12043056 TT=1800.09 T1=1800.4	SAT (TO) f=4587520 TT=1800.1 T1=1800.4	SAT (TO) f=3729408 TT=1800.74 T1=12.91	SAT (TO) f=4058112 TT=1800.02 T1=1220.13	? (TO) TT=1800.24
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x10c.opb	SAT f=14235648 TT=1800.1 T1=1800.4	SAT (TO) f=36642183 TT=1800.02 T1=1800.3	SAT (TO) f=14235648 TT=1800.1 T1=1800.4	SAT (TO) f=14885888 TT=1800.06 T1=1.9	SAT (TO) f=14941184 TT=1800.06 T1=0.65	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x12.opb	SAT f=3190784 TT=1800.04 T1=14.44	SAT (TO) f=12335330 TT=1800.08 T1=1800.4	SAT (TO) f=6149632 TT=1800.09 T1=1800.4	SAT (TO) f=3190784 TT=1800.04 T1=14.44	SAT (TO) f=3336192 TT=1800.05 T1=0.46	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x26.opb	SAT f=7368522 TT=1801 T1=13.1	SAT (TO) f=26115102 TT=1800.09 T1=1800.4	? (TO) TT=1800.08	SAT (TO) f=7368522 TT=1801 T1=13.1	SAT (TO) f=8377029 TT=1800.06 T1=401.56	? (TO) TT=1800.01
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran12x12.opb	SAT f=3356672 TT=1801.14 T1=974.57	SAT (TO) f=11235083 TT=1800.02 T1=1800.3	SAT (TO) f=4534295 TT=1800.06 T1=1800.4	SAT (TO) f=3364819 TT=1800.12 T1=530.39	SAT (TO) f=3356672 TT=1801.14 T1=974.57	? (TO) TT=1800.24
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran12x21.opb	SAT f=5928600 TT=1800 T1=1.16	SAT (TO) f=27459536 TT=1800.11 T1=1800.4	SAT (TO) f=42660557 TT=1800.11 T1=1800.4	SAT (TO) f=10399243 TT=1800.18 T1=2.55	SAT (TO) f=5928600 TT=1800 T1=1.16	? (TO) TT=1800.01
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran13x13.opb	SAT f=3535872 TT=1800.11 T1=7.48	SAT (TO) f=21398565 TT=1800.02 T1=1800.3	SAT (TO) f=6450176 TT=1800.02 T1=1800.4	SAT (TO) f=3535872 TT=1800.11 T1=7.48	SAT (TO) f=3538944 TT=1800.06 T1=0.56	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran14x18.opb	SAT f=5179385 TT=1800.03 T1=0.66	SAT (TO) f=27691103 TT=1800.01 T1=1800.3	SAT (TO) f=20763678 TT=1800.08 T1=1800.4	SAT (TO) f=6923632 TT=1800.13 T1=290.32	SAT (TO) f=5179385 TT=1800.03 T1=0.66	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran16x16.opb	SAT f=6150263 TT=1800.15 T1=3.04	SAT (TO) f=27745668 TT=1800.02 T1=1800.3	SAT (TO) f=11140096 TT=1800.12 T1=1800.4	SAT (TO) f=6150263 TT=1800.15 T1=3.04	SAT (TO) f=7103471 TT=1800.8 T1=0.65	? (TO) TT=1800.5
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran17x17.opb	SAT f=2026924 TT=1800.82 T1=5.65	SAT (TO) f=11370769 TT=1800.01 T1=1800.3	SAT (TO) f=17691962 TT=1800.04 T1=1800.4	SAT (TO) f=2026924 TT=1800.82 T1=5.65	SAT (TO) f=2078184 TT=1800.88 T1=144.14	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-ran4x64.opb	SAT f=11342833 TT=1800.9 T1=7.06	SAT (TO) f=33299168 TT=1800.1 T1=1800.4	? (TO) TT=1800.07	SAT (TO) f=11342833 TT=1800.9 T1=7.06	SAT (TO) f=13269674 TT=1800.88 T1=572.34	? (TO) TT=1800.17
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-ran6x43.opb	SAT f=8534594 TT=1801.03 T1=1489.32	SAT (TO) f=29401440 TT=1800.1 T1=1800.4	? (TO) TT=1800.08	SAT (TO) f=8721582 TT=1800.86 T1=4.01	SAT (TO) f=8534594 TT=1801.03 T1=1489.32	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-ran8x32.opb	SAT f=6634496 TT=1800.76 T1=2.03	SAT (TO) f=25818716 TT=1800.08 T1=1800.4	SAT (TO) f=46848304 TT=1800.07 T1=1800.4	SAT (TO) f=6634496 TT=1800.76 T1=2.03	SAT (TO) f=7730166 TT=1800 T1=0.7	? (TO) TT=1800.04
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-mps-v2-20-10-fome11.opb		? (MO) TT=1460.18	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.08	? (MO) TT=174.266
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-mps-v2-20-10-fome12.opb		? (MO) TT=1363.62	? (TO) TT=1800.09	? (TO) TT=1800.89	? (TO) TT=1800.61	? (MO) TT=160.106
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-mps-v2-20-10-fome13.opb		? (MO) TT=1260.09	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=167.496
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-bc1.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.01	? (MO) TT=909.4
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-bienst1.opb	SAT f=425982 TT=1800.69 T1=4.33	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1801.63	SAT (TO) f=425982 TT=1800.69 T1=4.33	? (TO) TT=1800.07
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-bienst2.opb	SAT f=221115 TT=1800.06 T1=1800.4	SAT (TO) f=221115 TT=1800.06 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=67157967 TT=1800.67 T1=503.12	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-dano3_3.opb		? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.69	? (TO) TT=1800.38
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-dano3_4.opb		? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.48
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-dano3_5.opb		? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.04	? (MO) TT=214.045
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-markshare1_1.opb	SAT f=289 TT=1800.03 T1=1683.37	SAT (TO) f=60316 TT=1800.02 T1=1800.3	SAT (TO) f=8201 TT=1800.11 T1=1800.4	SAT (TO) f=2513 TT=1800.19 T1=1027.54	SAT (TO) f=289 TT=1800.03 T1=1683.37	? (TO) TT=1800.02
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-markshare2_1.opb	SAT f=42160 TT=1800.72 T1=1772.65	SAT (TO) f=101636 TT=1800.03 T1=1800.3	SAT (TO) f=197415 TT=1800.1 T1=1800.4	SAT (TO) f=69431 TT=1800.1 T1=236.83	SAT (TO) f=42160 TT=1800.72 T1=1772.65	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-mkc1.opb		? (TO) TT=1800.02	? (MO) TT=407.129	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.55
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos11.opb	OPT f=9216 TT=113.536 T1=57.17	OPT f=9216 TT=194.346 T1=194.36	OPT f=9216 TT=532.807 T1=532.72	OPT f=9216 TT=1051.13 T1=671.15	OPT f=9216 TT=113.536 T1=57.17	? (MO) TT=157.186
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos12.opb	SAT f=26624 TT=1800.71 T1=5.16	SAT (TO) f=34353 TT=1800.12 T1=1800.4	SAT (TO) f=15498240 TT=1800.13 T1=1800.4	SAT (TO) f=26624 TT=1800.71 T1=5.16	SAT (TO) f=37888 TT=1800.01 T1=10.09	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos13.opb	SAT f=-89895551 TT=1800.13 T1=796.85	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT (TO) f=-89895551 TT=1800.13 T1=796.85	? (TO) TT=1800.79	? (MO) TT=223.111
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos14.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos15.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.81	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos17.opb	SAT f=7624084 TT=1800.06 T1=833.51	SAT (TO) f=37541475 TT=1800.07 T1=1800.4	SAT (TO) f=8982745 TT=1800.16 T1=1800.5	SAT (TO) f=7624084 TT=1800.06 T1=833.51	SAT (TO) f=11782665 TT=1800.01 T1=152.9	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos20.opb	OPT f=-468992 TT=1.125 T1=0.68	OPT f=-468992 TT=1.125 T1=1.12	OPT f=-468992 TT=84.59 T1=84.57	OPT f=-468992 TT=5.241 T1=3.53	OPT f=-468992 TT=2.294 T1=0.68	? (MO) TT=176.777
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos2.opb		? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (MO) TT=219.63
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos3.opb		? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.62	? (TO) TT=1800.06	? (MO) TT=253.582
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos6.opb		? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.09
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos7.opb	SAT f=2065813981 TT=1800.76 T1=2.27	SAT (TO) f=37099416576 TT=1800.11 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=2065813981 TT=1800.76 T1=2.27	SAT (TO) f=8143574276 TT=1800.09 T1=2.49	? (MO) TT=253.799
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-nug08.opb	OPT f=107 TT=33.569 T1=1.66	OPT f=107 TT=105.253 T1=105.25	OPT f=107 TT=45.732 T1=45.74	OPT f=107 TT=80.361 T1=3.24	OPT f=107 TT=33.569 T1=1.66	OPT f=107 TT=461.439 T1=87.92
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-qap10.opb	SAT f=170 TT=1800.08 T1=9.9	SAT (TO) f=175 TT=1800.06 T1=1800.4	SAT (TO) f=189 TT=1800.08 T1=1800.4	SAT (TO) f=170 TT=1800.08 T1=9.9	No Cert. TT=1800.04	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-swath1.opb		? (MO) TT=397.662	? (MO) TT=430.681	? (TO) TT=1800.15	? (TO) TT=1800.56	? (MO) TT=235.006
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-swath2.opb		? (MO) TT=373.952	? (MO) TT=430.19	? (TO) TT=1800.05	? (TO) TT=1800.03	? (MO) TT=224.101
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-swath3.opb		? (MO) TT=378.552	? (MO) TT=410.252	? (TO) TT=1800.6	? (TO) TT=1800.63	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-A1C1S1.opb		? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-A2C1S1.opb		? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-B1C1S1.opb		? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1801.02	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-B2C1S1.opb		? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1801.02	? (TO) TT=1800.05
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-berlin_5_8_0.opb	SAT f=63488 TT=1800.03 T1=9.16	SAT (TO) f=63488 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=63488 TT=1800.63 T1=9.16	SAT (TO) f=63488 TT=1800.03 T1=45.65	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-bg512142.opb	SAT f=17475927381996 TT=1800.08 T1=15.73	SAT (TO) f=75259706734831 TT=1800.04 T1=1800.4	? (TO) TT=1800.1	SAT (TO) f=17475927381996 TT=1800.08 T1=15.73	? (TO) TT=1800.07	? (MO) TT=265.383
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-biella1.opb		? (TO) TT=1800.02	? (MO) TT=1624.49	? (TO) TT=1800.09	? (TO) TT=1800.09	? (MO) TT=457.375
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ar98.opb		? (MO) TT=391.45	? (MO) TT=371.935	? (TO) TT=1800.68	? (TO) TT=1800.07	? (MO) TT=257.795
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ic97.opb		? (MO) TT=395.255	? (MO) TT=343.224	? (TO) TT=1800.54	? (TO) TT=1800.59	? (exit code) TT=350.794
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ic98.opb		? (MO) TT=406.157	? (MO) TT=346.204	? (TO) TT=1800.6	? (TO) TT=1800.53	? (MO) TT=499.455
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ir98.opb		? (MO) TT=377.164	? (MO) TT=345.796	? (TO) TT=1800.01	? (TO) TT=1800	? (MO) TT=352.148
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-CMS750_4.opb	OPT f=258048 TT=713.693 T1=498.93	OPT f=258048 TT=713.693 T1=713.68	? (TO) TT=1800.02	SAT (TO) f=258048 TT=1800.85 T1=498.93	No Cert. TT=1800.01	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core2536-691.opb	SAT f=947200000000000 TT=1800.16 T1=119.46	SAT (TO) f=11991040000000000 TT=1800.09 T1=1800.4	SAT (TO) f=1002496000000000 TT=1800.08 T1=1800.4	SAT (TO) f=947200000000000 TT=1800.16 T1=119.46	SAT (TO) f=949248000000000 TT=1800.05 T1=0.71	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core2586-950.opb	SAT f=1266688000000000 TT=1800.63 T1=154.75	SAT (TO) f=7982080000000000 TT=1800.1 T1=1800.4	SAT (TO) f=1354752000000000 TT=1800.08 T1=1800.4	SAT (TO) f=1266688000000000 TT=1800.63 T1=154.75	SAT (TO) f=1268736000000000 TT=1800.08 T1=0.62	? (TO) TT=1800.12
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core4284-1064.opb	SAT f=1435648000000000 TT=1800.49 T1=565.85	SAT (TO) f=12525568000000000 TT=1800.08 T1=1800.4	SAT (TO) f=1482752000000000 TT=1800.05 T1=1800.4	SAT (TO) f=1435648000000000 TT=1800.49 T1=565.85	SAT (TO) f=1437696000000000 TT=1800.04 T1=0.84	? (TO) TT=1800.14
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core4872-1529.opb	SAT f=2012160000000000 TT=1800.09 T1=473.64	SAT (TO) f=17101824000000000 TT=1800.06 T1=1800.4	SAT (TO) f=2091008000000000 TT=1800.05 T1=1800.4	SAT (TO) f=2012160000000000 TT=1800.09 T1=473.64	SAT (TO) f=2014208000000000 TT=1800 T1=0.82	? (TO) TT=1800.12
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dc1c.opb		? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800	? (TO) TT=1800	? (MO) TT=252.264
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dc1l.opb	SAT f=322124420039689472000 TT=1800.74 T1=230.43	? (TO) TT=1800.05	? (TO) TT=1800.45	SAT (TO) f=322124420039689472000 TT=1800.74 T1=230.43	? (TO) TT=1800.04	? (MO) TT=513.807
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dg012142.opb		? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.69	? (TO) TT=1800.01	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dolom1.opb		? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.69	? (TO) TT=1800.01	? (MO) TT=295.789
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-glass4.opb	OPT f=1228810444800 TT=3.974 T1=2.58	? (MO) TT=437.27	? (TO) TT=1800.09	OPT f=1228810444800 TT=7.592 T1=10.58	OPT f=1228810444800 TT=3.974 T1=2.58	? (MO) TT=195.618
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-NSR8K.opb		? (MO) TT=1488.36	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=1013.57
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-nsrand_ipx.opb	SAT f=1209008127 TT=1800.82 T1=796.99	SAT (TO) f=1941635072 TT=1800.1 T1=1800.4	SAT (TO) f=1241512960 TT=1800.06 T1=1800.5	SAT (TO) f=1209008127 TT=1800.82 T1=796.99	SAT (TO) f=2145386496 TT=1800.08 T1=0.92	? (MO) TT=178.598
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-rail507.opb	SAT f=265216000000000 TT=1800.66 T1=84.75	SAT (TO) f=18944000000000000 TT=1800.05 T1=1800.3	Signal TT=3.521	SAT (TO) f=265216000000000 TT=1800.66 T1=84.75	No Cert. TT=1800.09	? (TO) TT=1800.12
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-railway_8_1_0.opb	OPT f=409600 TT=33.57 T1=5.71	OPT f=409600 TT=33.57 T1=33.55	? (TO) TT=1800.02	SAT (TO) f=409600 TT=1800.84 T1=19.4	SAT (TO) f=409600 TT=1800.87 T1=5.71	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-roll3000.opb	SAT f=1095891440 TT=1800.09 T1=1800.4	SAT (TO) f=1095891440 TT=1800.09 T1=1800.4	? (TO) TT=1800.04	SAT (TO) f=1350564864 TT=1800.87 T1=241.74	SAT (TO) f=1140980736 TT=1800.04 T1=240.63	? (MO) TT=147.565
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-siena1.opb		? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.59	? (MO) TT=361.799
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp97ar.opb	SAT f=2739023033 TT=1800.01 T1=304.58	? (TO) TT=1800.01	SAT (TO) f=6430552113 TT=1800.09 T1=1800.4	SAT (TO) f=2739023033 TT=1800.01 T1=304.58	SAT (TO) f=2741090384 TT=1800.04 T1=1.83	? (TO) TT=1800.64
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp97ic.opb	SAT f=3490480071 TT=1800.09 T1=447.25	SAT (TO) f=89849361412 TT=1800.09 T1=1800.4	SAT (TO) f=12411487022 TT=1800.08 T1=1800.4	SAT (TO) f=3490480071 TT=1800.09 T1=447.25	SAT (TO) f=3512823688 TT=1800.07 T1=8.76	? (MO) TT=473.256
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp98ar.opb	SAT f=4210416996 TT=1800.07 T1=2.1	SAT (TO) f=55177007326 TT=1800.02 T1=1800.3	SAT (TO) f=11103918387 TT=1800.09 T1=1800.4	SAT (TO) f=4210416996 TT=1800.17 T1=4.06	SAT (TO) f=4210416996 TT=1800.07 T1=2.1	? (exit code) TT=847.949
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp98ic.opb	SAT f=3897566335 TT=1800.53 T1=786.42	SAT (TO) f=83966118068 TT=1800.02 T1=1800.3	SAT (TO) f=12941992956 TT=1800.07 T1=1800.4	SAT (TO) f=3897566335 TT=1800.53 T1=786.42	SAT (TO) f=3932174754 TT=1800.09 T1=622.43	? (MO) TT=505.51
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.76	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-trento1.opb		? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1801.09	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-UMTS.opb	SAT f=32826205 TT=1800.35 T1=847.46	? (TO) TT=1800.01	SAT (TO) f=47560990 TT=1800.13 T1=1800.4	SAT (TO) f=32826205 TT=1800.35 T1=847.46	SAT (TO) f=37192738 TT=1800.05 T1=472.3	? (TO) TT=1800.05
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-usAbbrv.8.25_70.opb	SAT f=123904 TT=1800.07 T1=273.33	SAT (TO) f=123904 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	SAT (TO) f=123904 TT=1800.92 T1=273.33	SAT (TO) f=124928 TT=1800.71 T1=140.25	? (TO) TT=1800.07
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-van.opb	SAT f=24193312742 TT=1801.07 T1=129.09	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT (TO) f=24193312742 TT=1801.07 T1=129.09	SAT (TO) f=25442247019 TT=1800.94 T1=41.15	? (TO) TT=1800.61
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/ mps/normalized-mps-v2-20-10-maros.opb	OPT f=344750 TT=2.32 T1=3.86	OPT f=344750 TT=3.866 T1=3.86	OPT f=344750 TT=6.203 T1=6.2	OPT f=344750 TT=2.32 T1=79.78	OPT f=344750 TT=7.183 T1=5.3	OPT f=344750 TT=42.421 T1=39.53
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-mps-v2-20-10-nazareth.opb	OPT f=-1073741823 TT=0.107 T1=0.1	OPT f=-1073741823 TT=0.107 T1=0.1	OPT f=-1073741823 TT=1.537 T1=1.53	OPT f=-1073741823 TT=0.185 T1=0.63	OPT f=-1073741823 TT=0.176 T1=0.37	? (MO) TT=172.078
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-mps-v2-20-10-testprob.opb	OPT f=9663726592 TT=0.036 T1=0.03	OPT f=9663726592 TT=0.036 T1=0.03	OPT f=9663726592 TT=0.621 T1=0.62	OPT f=9663726592 TT=0.214 T1=1.14	OPT f=9663726592 TT=0.162 T1=0.13	? (MO) TT=173.305
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114-max.opb	SAT f=-2 TT=1800.01 T1=1800.3	SAT (TO) f=-2 TT=1800.01 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1801.58	? (MO) TT=172.717
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114.opb	OPT f=1 TT=1.214 T1=0.56	OPT f=1 TT=8.941 T1=8.93	? (TO) TT=1800.08	OPT f=1 TT=2.526 T1=1.25	OPT f=1 TT=1.214 T1=0.56	? (MO) TT=175.964
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534-max.opb	SAT f=-2 TT=1800.01 T1=1800.3	SAT (TO) f=-2 TT=1800.01 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.51	? (TO) TT=1800.08	? (MO) TT=170.196
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534.opb	OPT f=1 TT=1.263 T1=0.55	OPT f=1 TT=3.629 T1=3.62	? (TO) TT=1800.08	OPT f=1 TT=2.525 T1=1.25	OPT f=1 TT=1.263 T1=0.55	? (MO) TT=170
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277-max.opb	SAT f=-13 TT=1800.08 T1=1800.4	SAT (TO) f=-13 TT=1800.08 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.63	? (TO) TT=1800.01	? (MO) TT=194.521
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277.opb	OPT f=1 TT=1.304 T1=0.61	OPT f=1 TT=6.229 T1=6.22	? (TO) TT=1800.01	OPT f=1 TT=2.246 T1=1.24	OPT f=1 TT=1.304 T1=0.61	? (MO) TT=194.87
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.65	? (TO) TT=1800.05	? (MO) TT=157.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839.opb	OPT f=1 TT=1.274 T1=0.59	OPT f=1 TT=4.541 T1=4.53	? (TO) TT=1800.06	OPT f=1 TT=2.983 T1=1.37	OPT f=1 TT=1.274 T1=0.59	? (MO) TT=157.383
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.77	? (TO) TT=1800.06	? (MO) TT=157.217
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354.opb	OPT f=1 TT=1.425 T1=0.68	OPT f=1 TT=7.211 T1=7.2	? (TO) TT=1800.01	OPT f=1 TT=2.594 T1=1.37	OPT f=1 TT=1.425 T1=0.68	? (MO) TT=156.294
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522-max.opb	SAT f=-3 TT=1800.07 T1=1800.4	SAT (TO) f=-3 TT=1800.07 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.65	? (TO) TT=1800.05	? (MO) TT=164.399
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522.opb	OPT f=1 TT=1.477 T1=0.68	OPT f=1 TT=10.394 T1=10.38	? (TO) TT=1800.01	OPT f=1 TT=2.754 T1=1.39	OPT f=1 TT=1.477 T1=0.68	? (MO) TT=163.792
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800	? (MO) TT=169.306
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174.opb	OPT f=1 TT=1.483 T1=0.76	OPT f=1 TT=45.878 T1=45.87	? (TO) TT=1800.02	OPT f=1 TT=2.883 T1=1.47	OPT f=1 TT=1.483 T1=0.76	? (MO) TT=183.497
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552-max.opb	SAT f=-127 TT=1800.08 T1=1800.4	SAT (TO) f=-127 TT=1800.08 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.01	? (MO) TT=187.909
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552.opb	OPT f=1 TT=1.494 T1=0.76	OPT f=1 TT=11.254 T1=11.24	? (TO) TT=1800.11	OPT f=1 TT=2.834 T1=1.43	OPT f=1 TT=1.494 T1=0.76	? (MO) TT=191.426
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554-max.opb	SAT f=-2 TT=1800.13 T1=471.22	SAT (TO) f=-1 TT=1800.08 T1=1800.4	? (TO) TT=1800.03	SAT (TO) f=-2 TT=1800.13 T1=471.22	? (TO) TT=1800.89	? (MO) TT=150.005
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554.opb	OPT f=1 TT=1.683 T1=0.84	OPT f=1 TT=16.114 T1=16.1	? (TO) TT=1800.11	OPT f=1 TT=2.995 T1=1.47	OPT f=1 TT=1.683 T1=0.84	? (MO) TT=149.477
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.77	? (TO) TT=1800.75	? (MO) TT=149.338
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197.opb	OPT f=1 TT=1.694 T1=0.87	OPT f=1 TT=38.658 T1=38.64	? (TO) TT=1800.02	OPT f=1 TT=2.793 T1=1.43	OPT f=1 TT=1.694 T1=0.87	? (MO) TT=149.672
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650-max.opb	SAT f=-30 TT=1800.07 T1=1800.4	SAT (TO) f=-30 TT=1800.07 T1=1800.4	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (MO) TT=185.689
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650.opb	OPT f=1 TT=1.873 T1=0.95	OPT f=1 TT=62.717 T1=62.7	? (TO) TT=1800.07	OPT f=1 TT=3.323 T1=1.56	OPT f=1 TT=1.873 T1=0.95	? (MO) TT=186.48
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.58	? (MO) TT=150.014
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249.opb	OPT f=1 TT=1.944 T1=0.96	OPT f=1 TT=26.871 T1=26.85	? (TO) TT=1800.14	OPT f=1 TT=3.214 T1=1.52	OPT f=1 TT=1.944 T1=0.96	? (MO) TT=149.8
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708-max.opb	OPT f=-92 TT=0.149 T1=0.14	OPT f=-92 TT=0.149 T1=0.14	OPT f=-92 TT=0.287 T1=0.28	OPT f=-92 TT=2.363 T1=1.72	OPT f=-92 TT=0.865 T1=0.42	OPT f=-92 TT=3.087 T1=3.01
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708.opb	OPT f=1 TT=0.051 T1=0.05	OPT f=1 TT=0.051 T1=0.05	OPT f=1 TT=0.095 T1=0.09	OPT f=1 TT=0.303 T1=0.71	OPT f=1 TT=0.275 T1=0.19	OPT f=1 TT=2.126 T1=2.1
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543-max.opb	OPT f=-1281 TT=0.079 T1=0.07	OPT f=-1281 TT=0.082 T1=0.08	OPT f=-1281 TT=0.079 T1=0.07	OPT f=-1281 TT=1.544 T1=0.71	OPT f=-1281 TT=0.673 T1=0.33	OPT f=-1281 TT=14.682 T1=14.53
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543.opb	OPT f=1 TT=0.048 T1=0.04	OPT f=1 TT=0.048 T1=0.04	OPT f=1 TT=0.05 T1=0.05	OPT f=1 TT=0.304 T1=0.71	OPT f=1 TT=0.274 T1=0.19	OPT f=1 TT=13.951 T1=13.89
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800	? (TO) TT=1800.02	? (MO) TT=169.963
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880.opb	OPT f=1 TT=2.045 T1=1.08	OPT f=1 TT=36.168 T1=36.14	? (TO) TT=1800.06	OPT f=1 TT=3.622 T1=1.65	OPT f=1 TT=2.045 T1=1.08	? (MO) TT=166.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.79	? (MO) TT=151.631
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390.opb	OPT f=1 TT=1.985 T1=1.1	OPT f=1 TT=29.841 T1=29.82	? (TO) TT=1800.06	OPT f=1 TT=3.638 T1=1.66	OPT f=1 TT=1.985 T1=1.1	? (MO) TT=150.409
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238-max.opb		? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.55	? (TO) TT=1800.02	? (MO) TT=169.952
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238.opb	OPT f=1 TT=2.193 T1=1.22	OPT f=1 TT=106.851 T1=106.83	? (TO) TT=1800.06	OPT f=1 TT=3.733 T1=1.79	OPT f=1 TT=2.193 T1=1.22	? (MO) TT=169.016
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885-max.opb	SAT f=-1237 TT=1800.09 T1=1800.4	SAT (TO) f=-1237 TT=1800.09 T1=1800.4	? (TO) TT=1800.11	SAT (TO) f=-1 TT=1800.09 T1=153.8	? (TO) TT=1801.05	? (MO) TT=150.208
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885.opb	OPT f=1 TT=2.214 T1=1.18	OPT f=1 TT=49.028 T1=49	? (TO) TT=1800.12	OPT f=1 TT=3.742 T1=1.8	OPT f=1 TT=2.214 T1=1.18	? (MO) TT=153.378
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1801.14	? (MO) TT=169.568
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074.opb	OPT f=1 TT=2.554 T1=1.34	OPT f=1 TT=76.445 T1=76.42	? (TO) TT=1800.14	OPT f=1 TT=4.082 T1=1.91	OPT f=1 TT=2.554 T1=1.34	? (MO) TT=169.205
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.86	? (MO) TT=151.751
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794.opb	OPT f=1 TT=2.645 T1=1.44	OPT f=1 TT=58.437 T1=58.41	? (TO) TT=1800.15	OPT f=1 TT=4.121 T1=1.9	OPT f=1 TT=2.645 T1=1.44	? (MO) TT=149.531
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631-max.opb		? (TO) TT=1800.02	? (TO) TT=1800.3	? (TO) TT=1800	? (TO) TT=1800.84	? (MO) TT=158.898
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631.opb	OPT f=1 TT=2.543 T1=1.46	OPT f=1 TT=66.43 T1=66.39	? (TO) TT=1800.17	OPT f=1 TT=4.654 T1=2.05	OPT f=1 TT=2.543 T1=1.46	? (MO) TT=158.714
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.24	? (TO) TT=1800.02	? (TO) TT=1801.06	? (MO) TT=149.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433.opb	OPT f=1 TT=2.663 T1=1.49	OPT f=1 TT=251.969 T1=251.96	? (TO) TT=1800.16	OPT f=1 TT=4.572 T1=2.06	OPT f=1 TT=2.663 T1=1.49	? (MO) TT=159.377
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195-max.opb		? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.55	? (TO) TT=1800.94	? (MO) TT=156.581
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195.opb	OPT f=1 TT=3.394 T1=1.92	OPT f=1 TT=84.636 T1=84.59	? (TO) TT=1800.2	OPT f=1 TT=5.111 T1=2.81	OPT f=1 TT=3.394 T1=1.92	? (MO) TT=156.616
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159-max.opb		? (TO) TT=1800.13	? (TO) TT=1800.22	? (TO) TT=1800.69	? (TO) TT=1800.09	? (MO) TT=158.202
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159.opb	OPT f=1 TT=3.494 T1=1.89	OPT f=1 TT=85.187 T1=85.16	? (TO) TT=1800.33	OPT f=1 TT=5.274 T1=2.83	OPT f=1 TT=3.494 T1=1.89	? (MO) TT=166.336
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690-max.opb		? (TO) TT=1800.12	? (TO) TT=1800.28	? (TO) TT=1800.65	? (TO) TT=1800.78	? (MO) TT=151.03
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690.opb	OPT f=1 TT=3.603 T1=2.3	OPT f=1 TT=307.078 T1=307.06	? (TO) TT=1800.3	OPT f=1 TT=5.032 T1=2.48	OPT f=1 TT=3.603 T1=2.3	? (MO) TT=155.41
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220-max.opb		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.04	? (MO) TT=156.882
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220.opb	OPT f=1 TT=3.614 T1=2.2	OPT f=1 TT=100.661 T1=100.61	? (TO) TT=1800.28	OPT f=1 TT=5.311 T1=2.48	OPT f=1 TT=3.614 T1=2.2	? (MO) TT=157.403
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480-max.opb	SAT f=-104 TT=1800.1 T1=1800.3	SAT (TO) f=-104 TT=1800.1 T1=1800.3	? (TO) TT=1800.32	? (TO) TT=1800	? (TO) TT=1800.05	? (MO) TT=151.574
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480.opb	OPT f=1 TT=3.962 T1=2.53	OPT f=1 TT=135.026 T1=134.98	? (TO) TT=1800.25	OPT f=1 TT=5.563 T1=2.8	OPT f=1 TT=3.962 T1=2.53	? (MO) TT=149.711
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999-max.opb	SAT f=-57 TT=1800.09 T1=1800.4	SAT (TO) f=-57 TT=1800.09 T1=1800.4	? (TO) TT=1800.27	? (TO) TT=1800.18	? (TO) TT=1800.01	? (MO) TT=157.197
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999.opb	OPT f=1 TT=3.944 T1=2.54	OPT f=1 TT=125.531 T1=125.49	? (TO) TT=1800.32	OPT f=1 TT=5.741 T1=2.91	OPT f=1 TT=3.944 T1=2.54	? (MO) TT=157.488
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.39	? (TO) TT=1800.61	? (TO) TT=1800.63	? (MO) TT=154.666
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132.opb	OPT f=1 TT=4.533 T1=2.85	OPT f=1 TT=150.688 T1=150.63	? (TO) TT=1800.36	OPT f=1 TT=6.512 T1=3.43	OPT f=1 TT=4.533 T1=2.85	? (MO) TT=155.228
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403-max.opb		? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1800.01	? (TO) TT=1800.06	? (MO) TT=160.879
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403.opb	OPT f=1 TT=4.664 T1=2.98	OPT f=1 TT=257.582 T1=257.54	? (TO) TT=1800.4	OPT f=1 TT=6.796 T1=3.46	OPT f=1 TT=4.664 T1=2.98	? (MO) TT=160.088
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.34	? (TO) TT=1800.19	? (TO) TT=1800	? (MO) TT=158.115
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478.opb	OPT f=1 TT=4.353 T1=2.69	OPT f=1 TT=287.102 T1=287.09	? (TO) TT=1800.43	OPT f=1 TT=8.123 T1=4.22	OPT f=1 TT=4.353 T1=2.69	? (MO) TT=158.42
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612-max.opb		? (TO) TT=1800.13	? (TO) TT=1800.27	? (TO) TT=1800.16	? (TO) TT=1800.58	? (MO) TT=150.796
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612.opb	OPT f=1 TT=4.393 T1=2.73	OPT f=1 TT=197.742 T1=197.71	? (TO) TT=1800.43	OPT f=1 TT=8.314 T1=4.31	OPT f=1 TT=4.393 T1=2.73	? (MO) TT=151.021
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400-max.opb	SAT f=-25 TT=1800.12 T1=1800.4	SAT (TO) f=-25 TT=1800.12 T1=1800.4	Signal TT=11.584	? (TO) TT=1800.17	? (TO) TT=1800.01	? (MO) TT=194.801
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400.opb	OPT f=1 TT=5.252 T1=3.64	OPT f=1 TT=203.778 T1=203.71	Signal TT=11.676	OPT f=1 TT=6.714 T1=3.92	OPT f=1 TT=5.252 T1=3.64	? (MO) TT=195.346
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490-max.opb		? (TO) TT=1800.02	Signal TT=11.436	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=190.113
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490.opb	OPT f=1 TT=5.092 T1=3.49	OPT f=1 TT=324.758 T1=324.74	Signal TT=11.521	OPT f=1 TT=7.032 T1=4.08	OPT f=1 TT=5.092 T1=3.49	? (MO) TT=186.556
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555-max.opb	OPT f=-18535 TT=924.581 T1=195.16	OPT f=-18535 TT=924.581 T1=924.72	SAT (TO) f=-1 TT=1800.02 T1=1800.3	SAT (TO) f=-18535 TT=1800.14 T1=195.16	OPT f=-18535 TT=1787.67 T1=1762.14	? (MO) TT=173.677
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555.opb	OPT f=1 TT=0.554 T1=0.3	OPT f=1 TT=32.112 T1=32.11	OPT f=1 TT=48.515 T1=48.52	OPT f=1 TT=0.895 T1=0.83	OPT f=1 TT=0.554 T1=0.3	? (MO) TT=172.6
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986-max.opb	OPT f=-1307731 TT=13.482 T1=8.43	OPT f=-1307731 TT=127.186 T1=127.2	OPT f=-1307731 TT=52.95 T1=52.95	OPT f=-1307731 TT=111.069 T1=52.36	OPT f=-1307731 TT=13.482 T1=8.43	? (MO) TT=169.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986.opb	OPT f=1 TT=0.523 T1=0.3	OPT f=1 TT=9.2 T1=9.2	OPT f=1 TT=44.347 T1=44.35	OPT f=1 TT=0.685 T1=0.84	OPT f=1 TT=0.523 T1=0.3	? (MO) TT=169.591
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641-max.opb		? (TO) TT=1800.1	Signal TT=13.046	? (TO) TT=1800.02	? (TO) TT=1800.09	? (MO) TT=205.652
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641.opb	OPT f=1 TT=5.762 T1=4.15	OPT f=1 TT=386.699 T1=386.68	Signal TT=13.056	OPT f=1 TT=8.303 T1=4.51	OPT f=1 TT=5.762 T1=4.15	? (MO) TT=204.199
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006-max.opb		? (TO) TT=1800.08	Signal TT=13.061	? (TO) TT=1800.01	? (TO) TT=1800.71	? (MO) TT=201.959
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006.opb	OPT f=1 TT=5.453 T1=4.14	OPT f=1 TT=370.158 T1=370.15	Signal TT=12.876	OPT f=1 TT=7.944 T1=4.5	OPT f=1 TT=5.453 T1=4.14	? (MO) TT=202.303
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542-max.opb		? (TO) TT=1800.11	Signal TT=14.645	? (TO) TT=1800.13	? (TO) TT=1800.06	? (MO) TT=141.809
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542.opb	OPT f=1 TT=6.754 T1=4.85	OPT f=1 TT=470.429 T1=470.43	Signal TT=14.754	OPT f=1 TT=9.762 T1=5.52	OPT f=1 TT=6.754 T1=4.85	? (MO) TT=141.95
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498-max.opb		? (TO) TT=1800.02	Signal TT=14.74	? (TO) TT=1800.14	? (TO) TT=1800.53	? (MO) TT=145.224
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498.opb	OPT f=1 TT=6.604 T1=4.93	OPT f=1 TT=377.568 T1=377.53	Signal TT=14.544	OPT f=1 TT=9.622 T1=5.49	OPT f=1 TT=6.604 T1=4.93	? (MO) TT=142.513
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129-max.opb		? (TO) TT=1800.07	Signal TT=16.532	? (TO) TT=1800.17	? (TO) TT=1800.65	? (MO) TT=151.512
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129.opb	OPT f=1 TT=5.993 T1=4.34	OPT f=1 TT=441.252 T1=441.17	Signal TT=16.387	OPT f=1 TT=10.982 T1=6.17	OPT f=1 TT=5.993 T1=4.34	? (MO) TT=152.869
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673-max.opb		? (TO) TT=1800.13	Signal TT=16.522	? (TO) TT=1800.12	? (TO) TT=1800.01	? (MO) TT=151.269
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673.opb	OPT f=1 TT=5.822 T1=4.13	OPT f=1 TT=680.6 T1=680.63	Signal TT=16.467	OPT f=1 TT=10.913 T1=6.36	OPT f=1 TT=5.822 T1=4.13	? (MO) TT=148.055
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727-max.opb	SAT f=-9 TT=1800.14 T1=1800.4	SAT (TO) f=-9 TT=1800.14 T1=1800.4	Signal TT=18.516	? (TO) TT=1800.05	? (TO) TT=1800.05	? (MO) TT=148.114
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727.opb	OPT f=1 TT=7.364 T1=5.52	OPT f=1 TT=556.757 T1=556.73	Signal TT=18.888	OPT f=1 TT=12.713 T1=7.12	OPT f=1 TT=7.364 T1=5.52	? (MO) TT=146.495
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136-max.opb		? (TO) TT=1800.07	Signal TT=18.512	? (TO) TT=1800.07	? (TO) TT=1800.02	? (MO) TT=195.86
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136.opb	OPT f=1 TT=7.353 T1=5.49	OPT f=1 TT=434.029 T1=433.93	Signal TT=18.417	OPT f=1 TT=12.851 T1=7.17	OPT f=1 TT=7.353 T1=5.49	? (MO) TT=198.614
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866-max.opb		? (TO) TT=1800.11	Signal TT=20.278	? (TO) TT=1800.68	? (TO) TT=1800.01	? (MO) TT=199.199
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866.opb	OPT f=1 TT=7.694 T1=5.86	OPT f=1 TT=462.924 T1=462.85	Signal TT=20.485	OPT f=1 TT=9.795 T1=5.86	OPT f=1 TT=7.694 T1=6.04	? (MO) TT=197.257
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522-max.opb		? (TO) TT=1800.11	Signal TT=21.566	? (TO) TT=1800.62	? (TO) TT=1800.7	? (MO) TT=203.102
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522.opb	OPT f=1 TT=8.053 T1=6.06	OPT f=1 TT=521.12 T1=521.05	Signal TT=20.566	OPT f=1 TT=10.122 T1=6.06	OPT f=1 TT=8.053 T1=6.2	? (MO) TT=197.972
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155-max.opb	SAT f=-5339 TT=1801.21 T1=1340.54	SAT (TO) f=-95 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	SAT (TO) f=-1 TT=1800.16 T1=169.71	SAT (TO) f=-5339 TT=1801.21 T1=1340.54	? (MO) TT=172.893
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155.opb	OPT f=1 TT=0.864 T1=0.4	OPT f=1 TT=3.838 T1=3.83	? (TO) TT=1800.01	OPT f=1 TT=2.054 T1=1.1	OPT f=1 TT=0.864 T1=0.4	? (MO) TT=172.875
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325-max.opb	SAT f=-735 TT=1800.01 T1=407.81	SAT (TO) f=-735 TT=1800.01 T1=1800.3	? (TO) TT=1800.1	SAT (TO) f=-735 TT=1800.11 T1=407.81	? (TO) TT=1800.98	? (MO) TT=172.684
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325.opb	OPT f=1 TT=0.883 T1=0.4	OPT f=1 TT=3.211 T1=3.2	? (TO) TT=1800.1	OPT f=1 TT=2.064 T1=1.16	OPT f=1 TT=0.883 T1=0.4	? (MO) TT=174.121
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378-max.opb	SAT f=-22 TT=1800.02 T1=1800.3	SAT (TO) f=-22 TT=1800.02 T1=1800.3	SAT (TO) f=-6 TT=1800.1 T1=1800.4	SAT (TO) f=-3 TT=1801 T1=111.72	? (TO) TT=1800.1	? (MO) TT=188.015
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378.opb	OPT f=1 TT=0.944 T1=0.47	OPT f=1 TT=3.75 T1=3.74	OPT f=1 TT=1450.2 T1=1450.42	OPT f=1 TT=2.324 T1=1.21	OPT f=1 TT=0.944 T1=0.47	? (MO) TT=183.789
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415-max.opb	SAT f=-1969 TT=1800.02 T1=1800.3	SAT (TO) f=-1969 TT=1800.02 T1=1800.3	? (TO) TT=1800.1	SAT (TO) f=-1 TT=1800.12 T1=9.68	? (TO) TT=1800.68	? (MO) TT=178.251
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415.opb	OPT f=1 TT=0.934 T1=0.47	OPT f=1 TT=1.657 T1=1.65	? (TO) TT=1800.01	OPT f=1 TT=2.204 T1=1.18	OPT f=1 TT=0.934 T1=0.47	? (MO) TT=178.491
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit1d.opb	SAT f=53066119 TT=1800.06 T1=234.99	? (TO) TT=1800.04	? (TO) TT=1800.13	SAT (TO) f=53066119 TT=1800.06 T1=234.99	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-aflow30a.opb	SAT f=3400 TT=1800.24 T1=957.82	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT (TO) f=3400 TT=1800.24 T1=957.82	No Cert. TT=1801.09	? (TO) TT=1800.08
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-aflow40b.opb	SAT f=5921 TT=1800.26 T1=890.54	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT (TO) f=5921 TT=1800.26 T1=890.54	No Cert. TT=1800.67	? (TO) TT=1800.08
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-air04.opb	SAT f=57953 TT=1800.08 T1=1800.4	SAT (TO) f=57953 TT=1800.08 T1=1800.4	SAT (TO) f=58170 TT=1800.09 T1=1800.4	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-air05.opb	SAT f=33182 TT=1800.1 T1=1800.4	SAT (TO) f=33182 TT=1800.1 T1=1800.4	SAT (TO) f=34119 TT=1800.08 T1=1800.4	SAT (TO) f=37044 TT=1800.66 T1=489	SAT (TO) f=42258 TT=1800.01 T1=1379.98	? (TO) TT=1800.1
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-nw04.opb	SAT f=17498 TT=1800.82 T1=142.73	? (TO) TT=1800.1	SAT (MO) f=20366 TT=598.952 T1=598.6	SAT (TO) f=17498 TT=1800.82 T1=142.73	No Cert. TT=1800.05	? (TO) TT=1800.11
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-t1717.opb	SAT f=200300 TT=379.541 T1=379.06	SAT (TO) f=200300 TT=1800.24 T1=1800.4	SAT f=200300 TT=379.541 T1=379.06	SAT (TO) f=400807 TT=1800.79 T1=4.78	SAT (TO) f=380218 TT=1800.76 T1=2.7	? (TO) TT=1800.12
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-vpm2.opb	SAT f=115 TT=1801.03 T1=96.52	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT (TO) f=115 TT=1801.03 T1=96.52	SAT (TO) f=149 TT=1800.09 T1=649.08	? (TO) TT=1800.03
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-gt2.opb	OPT f=21166 TT=2.983 T1=2.22	SAT (TO) f=24268 TT=1800.06 T1=1800.4	SAT (TO) f=22521 TT=1800.02 T1=1800.3	OPT f=21166 TT=2.983 T1=2.22	SAT (TO) f=21166 TT=1800.09 T1=309.24	? (TO) TT=1800.08
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air01.opb	OPT f=3398 TT=2.404 T1=0.41	SAT (TO) f=3440 TT=1800.1 T1=1800.4	OPT f=3398 TT=35.463 T1=35.36	OPT f=3398 TT=4.833 T1=4.29	OPT f=3398 TT=2.404 T1=0.41	OPT f=3398 TT=137.382 T1=113.01
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air02.opb	OPT f=3905 TT=189.275 T1=181.82	SAT (TO) f=6605 TT=1800.11 T1=1800.4	SAT (TO) f=4960 TT=1800.39 T1=1800.4	SAT (TO) f=4369 TT=1800.52 T1=659.45	OPT f=3905 TT=189.275 T1=181.82	? (TO) TT=1800.06
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air03.opb	SAT f=196690 TT=1800.06 T1=868.29	SAT (TO) f=247463 TT=1800.03 T1=1800.3	SAT (TO) f=225333 TT=1800.32 T1=1800.4	SAT (TO) f=196690 TT=1800.06 T1=868.29	SAT (TO) f=219231 TT=1800.74 T1=1446.1	? (TO) TT=1800.05
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air06.opb	SAT f=52144 TT=1800.15 T1=1800.3	SAT (TO) f=63121 TT=1800.09 T1=1800.4	SAT (TO) f=52144 TT=1800.15 T1=1800.3	SAT (TO) f=67001 TT=1800.14 T1=826.85	SAT (TO) f=66846 TT=1800.05 T1=330.65	? (TO) TT=1800.05
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-enigma.opb	OPT f=0 TT=0.395 T1=0.27	OPT f=0 TT=7.547 T1=7.54	OPT f=0 TT=4.049 T1=4.04	OPT f=0 TT=0.934 T1=0.68	OPT f=0 TT=0.463 T1=0.27	OPT f=0 TT=0.395 T1=0.37
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0282.opb	OPT f=258411 TT=0.949 T1=0.56	OPT f=258411 TT=423.771 T1=423.82	OPT f=258411 TT=18.422 T1=18.38	OPT f=258411 TT=3.897 T1=13.47	OPT f=258411 TT=1.196 T1=0.56	OPT f=258411 TT=0.949 T1=0.71
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0291.opb	OPT f=10447498 TT=0.473 T1=0.26	SAT (TO) f=182289140 TT=1800.02 T1=1800.3	OPT f=10447498 TT=204.036 T1=204.01	OPT f=10447498 TT=1.344 T1=5.7	OPT f=10447498 TT=0.473 T1=0.26	? (TO) TT=1800.77
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p6000.opb	SAT f=-1245798 TT=1800.51 T1=893.14	? (TO) TT=1800.09	? (TO) TT=1800.22	SAT (TO) f=-1245798 TT=1800.51 T1=893.14	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-pipex.opb	OPT f=788263 TT=6.148 T1=7.38	OPT f=788263 TT=109.904 T1=109.91	OPT f=788263 TT=15.844 T1=15.84	OPT f=788263 TT=6.148 T1=7.38	OPT f=788263 TT=9.893 T1=8.3	OPT f=788263 TT=51.482 T1=45.03
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-vpm1.opb	OPT f=20 TT=42.788 T1=42.73	OPT f=20 TT=723.533 T1=723.65	SAT (TO) f=76 TT=1800.09 T1=1800.4	SAT (TO) f=20 TT=1800.62 T1=608.63	SAT (TO) f=20 TT=1800.69 T1=866.11	OPT f=20 TT=42.788 T1=42.73
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos9.opb		? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.34
normalized-PB06/OPT-MEDINT/mps-v2-20-10/ plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-seymour1.opb	SAT f=471083 TT=1800.05 T1=56.44	SAT (TO) f=846906 TT=1800.02 T1=1800.4	SAT (TO) f=561239 TT=1800.07 T1=1800.4	SAT (TO) f=471083 TT=1800.05 T1=56.44	SAT (TO) f=471086 TT=1800.81 T1=1.09	? (TO) TT=1800.11
normalized-PB06/OPT-MEDINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-ds.opb		? (TO) TT=1800.21	Signal TT=618.812	? (TO) TT=1802.15	No Cert. TT=1800.55	? (TO) TT=1800.62
normalized-PB06/OPT-MEDINT/reduced/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome12.opb		Signal TT=1285.65	? (TO) TT=1800.04	? (TO) TT=1800.69	? (TO) TT=1800.63	? (TO) TT=1800.47
normalized-PB06/OPT-MEDINT/reduced/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome13.opb		? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.6
normalized-PB06/OPT-MEDINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ws97-3.opb	SAT f=3033 TT=1800.1 T1=1800.4	SAT (TO) f=4061 TT=1800.11 T1=1800.4	SAT (TO) f=3033 TT=1800.1 T1=1800.4	SAT (TO) f=3052 TT=1800.13 T1=667.31	SAT (TO) f=3075 TT=1800.02 T1=0.41	? (TO) TT=1800.03

Statistics		minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
Number of times the solver is able to give the best known answer		151	79	189	155	26
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		58	13	73	114	8