PB'16 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
cdcl-cuttingplanes DEC 2016-05-01 (complete)
cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)
cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)
minisatp 2012-10-02 git-d91742b (complete)
NaPS 1.02 (complete)
Open-WBO PB16 (complete)
Open-WBO-LSU PB16 (complete)
Sat4j PB 2.3.6 Res+CP PB16 (complete)
Sat4j PB 2.3.6 Resolution PB16 (complete)
toysat 2016-05-02 (complete)

Bench name	Best results on this instance	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/heinz/ normalized-neos808444.opb	SAT TT=0.161 T1=0.15	SAT TT=0.161 T1=0.15	No data	No data	SAT TT=4.713 T1=4.69	SAT TT=3.149 T1=3.13	SAT TT=2.341 T1=2.32	SAT TT=2.294 T1=2.28	SAT TT=4.742 T1=2.01	SAT TT=2.385 T1=1.19	SAT TT=2.109 T1=2.03
/DEC-SMALLINT-LIN/heinz/ normalized-neos-820146.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/heinz/ normalized-neos-820157.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/heinz/ normalized-neos-849702.opb	SAT TT=20.7 T1=19.59	SAT TT=89.21 T1=89.22	No data	No data	SAT TT=222.579 T1=222.61	SAT TT=208.183 T1=208.22	SAT TT=301.22 T1=301.26	SAT TT=298.652 T1=298.69	SAT TT=111.176 T1=53.98	SAT TT=20.7 T1=19.59	SAT TT=238.825 T1=238.8
/DEC-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1096.cudf.paranoid.opb	SAT TT=0 T1=0	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0 T1=0	SAT TT=0.001 T1=0	SAT TT=0.001 T1=0	SAT TT=0.002 T1=0	SAT TT=0.163 T1=0.62	SAT TT=0.154 T1=0.11	SAT TT=0.017 T1=0.01
/DEC-SMALLINT-LIN/lopes/ normalized-05.opb	SAT TT=139.55 T1=138.08	SAT TT=1384.46 T1=1384.67	No data	No data	SAT TT=162.792 T1=162.86	SAT TT=533.941 T1=534.01	SAT TT=433.637 T1=433.69	SAT TT=439.824 T1=439.88	SAT TT=325.006 T1=161.24	SAT TT=139.55 T1=138.08	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/lopes/ normalized-101.opb	UNSAT TT=102.067	UNSAT TT=708.405	No data	No data	UNSAT TT=102.067	UNSAT TT=127.551	UNSAT TT=297.93	UNSAT TT=313.687	UNSAT TT=354.389	UNSAT TT=191.48	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/lopes/ normalized-107.opb	SAT TT=3.034 T1=3.02	SAT TT=15.145 T1=15.14	No data	No data	SAT TT=8.638 T1=8.63	SAT TT=10.034 T1=10.02	SAT TT=3.034 T1=3.02	SAT TT=3.084 T1=3.07	SAT TT=50.216 T1=24.62	SAT TT=47.107 T1=45.8	SAT TT=26.954 T1=26.88
/DEC-SMALLINT-LIN/lopes/ normalized-112.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.13
/DEC-SMALLINT-LIN/lopes/ normalized-116.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/lopes/ normalized-117.opb	SAT TT=1.388 T1=1.38	SAT TT=1.388 T1=1.38	No data	No data	SAT TT=11.434 T1=11.42	SAT TT=13.714 T1=13.7	SAT TT=93.17 T1=93.17	SAT TT=91.931 T1=91.93	SAT TT=89.07 T1=44.07	SAT TT=41.617 T1=39.95	SAT TT=221.05 T1=221.01
/DEC-SMALLINT-LIN/lopes/ normalized-120.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.84	? (TO) TT=1800.51	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/lopes/ normalized-122.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.13
/DEC-SMALLINT-LIN/lopes/ normalized-123.opb	SAT TT=489.747 T1=489.75	? (TO) TT=1800.02	No data	No data	SAT TT=489.747 T1=489.75	SAT TT=651.235 T1=651.38	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.45	? (TO) TT=1800.15
/DEC-SMALLINT-LIN/lopes/ normalized-129.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/lopes/ normalized-130.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/lopes/ normalized-135.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/lopes/ normalized-137.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.75	? (TO) TT=1800.83	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/lopes/ normalized-141.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.16
/DEC-SMALLINT-LIN/lopes/ normalized-146.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/lopes/ normalized-147.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.6	? (TO) TT=1800.18
/DEC-SMALLINT-LIN/lopes/ normalized-153.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800	? (TO) TT=1800.13
/DEC-SMALLINT-LIN/lopes/ normalized-154.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/lopes/ normalized-162.opb	SAT TT=46.685 T1=46.65	SAT TT=113.15 T1=113.15	No data	No data	SAT TT=46.685 T1=46.65	SAT TT=52.252 T1=52.24	SAT TT=357.806 T1=357.83	SAT TT=361.106 T1=361.13	SAT TT=1530.53 T1=761.84	SAT TT=231.93 T1=229.85	? (TO) TT=1800.14
/DEC-SMALLINT-LIN/lopes/ normalized-164.opb	SAT TT=61.306 T1=61.27	SAT TT=709.219 T1=709.31	No data	No data	SAT TT=61.306 T1=61.27	SAT TT=111.515 T1=111.51	SAT TT=1402.77 T1=1403.01	SAT TT=1280.49 T1=1280.71	SAT TT=809.891 T1=403.11	SAT TT=705.485 T1=702.97	SAT TT=1655.46 T1=1655.76
/DEC-SMALLINT-LIN/lopes/ normalized-167.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.22
/DEC-SMALLINT-LIN/lopes/ normalized-170.opb	SAT TT=43.612 T1=43.57	SAT TT=178.456 T1=178.47	No data	No data	SAT TT=43.612 T1=43.57	SAT TT=93.633 T1=93.63	SAT TT=1170.76 T1=1170.95	SAT TT=1385.78 T1=1386.01	SAT TT=906.437 T1=451.39	SAT TT=550.83 T1=548.52	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/lopes/ normalized-172.opb		? (exit code) TT=0.006	No data	No data	? (TO) TT=1800.28	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.57	? (TO) TT=1800	? (TO) TT=1800.71
/DEC-SMALLINT-LIN/lopes/ normalized-173.opb		? (exit code) TT=0.006	No data	No data	? (TO) TT=1800.26	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.68
/DEC-SMALLINT-LIN/lopes/ normalized-175.opb		? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.27	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.74
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/lopes/ normalized-178.opb		? (exit code) TT=0.006	No data	No data	? (TO) TT=1800.34	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.07	? (MO) TT=361.244
/DEC-SMALLINT-LIN/lopes/ normalized-180.opb		? (exit code) TT=0.006	No data	No data	? (TO) TT=1800.42	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.81	? (TO) TT=1800.02	? (TO) TT=1800.64
/DEC-SMALLINT-LIN/lopes/ normalized-181.opb		? (exit code) TT=0.007	No data	No data	? (TO) TT=1800.41	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800	? (MO) TT=390.844
/DEC-SMALLINT-LIN/lopes/ normalized-182.opb		? (exit code) TT=0.006	No data	No data	Signal TT=394.734	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.2	? (TO) TT=1800.01	? (TO) TT=1800	? (MO) TT=298.401
/DEC-SMALLINT-LIN/lopes/ normalized-184.opb		? (exit code) TT=0.006	No data	No data	? (MO) TT=293.272	? (TO) TT=1800.37	? (TO) TT=1800.55	? (TO) TT=1800.48	? (TO) TT=1802	? (TO) TT=1800.07	? (MO) TT=211.55
/DEC-SMALLINT-LIN/lopes/ normalized-185.opb	SAT TT=2.012 T1=2.01	SAT TT=82.33 T1=82.33	No data	No data	SAT TT=6.296 T1=6.29	SAT TT=2.012 T1=2.01	SAT TT=87.879 T1=87.88	SAT TT=89.438 T1=89.45	SAT TT=53.567 T1=25.79	SAT TT=197.95 T1=196.98	SAT TT=768.333 T1=768.38
/DEC-SMALLINT-LIN/lopes/ normalized-188.opb	UNSAT TT=0.462	UNSAT TT=1.642	No data	No data	UNSAT TT=0.561	UNSAT TT=0.462	UNSAT TT=0.9	UNSAT TT=0.897	UNSAT TT=6.926	UNSAT TT=3.195	UNSAT TT=8.087
/DEC-SMALLINT-LIN/lopes/ normalized-20.opb	SAT TT=1021.87 T1=1020.07	? (TO) TT=1800.02	No data	No data	SAT TT=1670.22 T1=1670.54	? (TO) TT=1800.02	SAT TT=1341.64 T1=1341.85	SAT TT=1222.78 T1=1222.97	? (TO) TT=1800.12	SAT TT=1021.87 T1=1020.07	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/lopes/ normalized-21.opb	UNSAT TT=206.582	? (TO) TT=1800.01	No data	No data	UNSAT TT=405.64	UNSAT TT=206.582	UNSAT TT=675.643	UNSAT TT=692.094	? (TO) TT=1800.87	UNSAT TT=1394.59	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/lopes/ normalized-24.opb	SAT TT=274.33 T1=274.35	? (TO) TT=1800.11	No data	No data	SAT TT=274.33 T1=274.35	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=1478.78 T1=1476.39	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/lopes/ normalized-27.opb	SAT TT=223.373 T1=223.45	? (TO) TT=1800.01	No data	No data	SAT TT=223.373 T1=223.45	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.17	SAT TT=1259.24 T1=1257.27	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/lopes/ normalized-31.opb	SAT TT=231.924 T1=232	? (TO) TT=1800.01	No data	No data	SAT TT=231.924 T1=232	SAT TT=1093.26 T1=1093.43	SAT TT=1532.48 T1=1532.73	SAT TT=1416.77 T1=1417	? (TO) TT=1801.05	SAT TT=897.29 T1=895.13	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/lopes/ normalized-37.opb	SAT TT=911.56 T1=909.21	? (TO) TT=1800.02	No data	No data	SAT TT=1030.63 T1=1030.84	? (TO) TT=1800.08	SAT TT=1603.61 T1=1603.86	SAT TT=1485.36 T1=1485.59	? (TO) TT=1800.08	SAT TT=911.56 T1=909.21	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/lopes/ normalized-40.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.2	? (TO) TT=1800.85	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/lopes/ normalized-41.opb	SAT TT=90.246 T1=60.99	SAT TT=99.543 T1=99.55	No data	No data	SAT TT=109.047 T1=109.05	SAT TT=113.757 T1=113.78	SAT TT=90.246 T1=90.26	SAT TT=90.732 T1=90.74	SAT TT=123.755 T1=60.99	SAT TT=114.33 T1=113.15	? (TO) TT=1800.14
/DEC-SMALLINT-LIN/lopes/ normalized-47.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.94	? (TO) TT=1800.48	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/lopes/ normalized-48.opb	SAT TT=210.993 T1=211.08	SAT TT=1524.73 T1=1524.97	No data	No data	SAT TT=210.993 T1=211.08	SAT TT=483.918 T1=484.02	SAT TT=592.635 T1=592.74	SAT TT=589.41 T1=589.51	? (TO) TT=1800.07	SAT TT=907.46 T1=905.73	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/lopes/ normalized-53.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.77	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/lopes/ normalized-60.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/lopes/ normalized-61.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/lopes/ normalized-70.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1801.01	? (TO) TT=1800.06	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/lopes/ normalized-73.opb	UNSAT TT=470.016	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	UNSAT TT=470.016	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/lopes/ normalized-76.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.78	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/lopes/ normalized-89.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/lopes/ normalized-91.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1801.02	? (TO) TT=1800.06	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/lopes/ normalized-99.opb	UNSAT TT=56.785	UNSAT TT=443.464	No data	No data	UNSAT TT=171.651	UNSAT TT=56.785	UNSAT TT=118.287	UNSAT TT=114.197	UNSAT TT=315.287	UNSAT TT=152.93	? (TO) TT=1800.05
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12010_10-sat.opb	SAT TT=0.171 T1=0.16	SAT TT=0.171 T1=0.16	No data	No data	SAT TT=1.438 T1=1.42	SAT TT=2.004 T1=1.99	SAT TT=0.609 T1=0.59	SAT TT=0.611 T1=0.6	SAT TT=5.632 T1=1.94	SAT TT=1.905 T1=0.84	SAT TT=0.789 T1=0.75
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12013_1-unsat.opb	UNSAT TT=0.152	UNSAT TT=0.152	No data	No data	UNSAT TT=0.427	UNSAT TT=0.376	UNSAT TT=0.59	UNSAT TT=0.593	UNSAT TT=2.174	UNSAT TT=0.924	UNSAT TT=1.049
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12015_3-unsat.opb	UNSAT TT=0.111	UNSAT TT=0.111	No data	No data	UNSAT TT=0.301	UNSAT TT=0.269	UNSAT TT=0.526	UNSAT TT=0.532	UNSAT TT=2.144	UNSAT TT=0.884	UNSAT TT=0.785
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1201_5-sat.opb	SAT TT=0.685 T1=0.67	SAT TT=0.685 T1=0.67	No data	No data	SAT TT=1.393 T1=1.38	SAT TT=1.783 T1=1.77	SAT TT=0.735 T1=0.73	SAT TT=0.717 T1=0.7	SAT TT=7.952 T1=2.69	SAT TT=2.64 T1=1.47	SAT TT=1.9 T1=1.82
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12016_4-sat.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12021_4-sat.opb	SAT TT=0.717 T1=0.71	SAT TT=0.717 T1=0.71	No data	No data	SAT TT=1.806 T1=1.79	SAT TT=2.431 T1=2.41	SAT TT=1.528 T1=1.51	SAT TT=1.538 T1=1.53	SAT TT=7.872 T1=3.13	SAT TT=5.914 T1=4.17	SAT TT=3.121 T1=3.01
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12022_9-sat.opb	SAT TT=0.31 T1=0.3	SAT TT=0.31 T1=0.3	No data	No data	SAT TT=1.368 T1=1.35	SAT TT=1.518 T1=1.51	SAT TT=0.421 T1=0.41	SAT TT=0.414 T1=0.4	SAT TT=5.793 T1=1.99	SAT TT=2.064 T1=0.99	SAT TT=1.443 T1=1.39
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12023_3-unsat.opb	UNSAT TT=0.136	UNSAT TT=0.136	No data	No data	UNSAT TT=0.368	UNSAT TT=0.324	UNSAT TT=0.309	UNSAT TT=0.309	UNSAT TT=2.224	UNSAT TT=0.912	UNSAT TT=0.828
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12026_5-unsat.opb	UNSAT TT=64.724	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	UNSAT TT=64.724	UNSAT TT=92.745	UNSAT TT=92.025	UNSAT TT=416.471	UNSAT TT=518.38	UNSAT TT=1388.1
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12027_7-unsat.opb	UNSAT TT=1.908	UNSAT TT=1.908	No data	No data	UNSAT TT=403.478	UNSAT TT=4.303	UNSAT TT=4.155	UNSAT TT=4.142	UNSAT TT=10.751	UNSAT TT=3.59	UNSAT TT=7.623
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12028_8-sat.opb	SAT TT=19.64 T1=18.28	? (TO) TT=1800.1	No data	No data	SAT TT=482.381 T1=482.49	SAT TT=111.471 T1=111.48	SAT TT=169.844 T1=169.86	SAT TT=171.65 T1=171.68	SAT TT=187.505 T1=91.63	SAT TT=19.64 T1=18.28	SAT TT=771.563 T1=771.61
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12032_3-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.79	? (TO) TT=1800.55	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12032_8-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1203_2-sat.opb	SAT TT=0.225 T1=0.22	SAT TT=0.225 T1=0.22	No data	No data	SAT TT=1.062 T1=1.05	SAT TT=1.116 T1=1.11	SAT TT=0.35 T1=0.34	SAT TT=0.35 T1=0.34	SAT TT=4.882 T1=1.8	SAT TT=1.893 T1=0.85	SAT TT=0.977 T1=0.92
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12033_3-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12034_4-sat.opb	SAT TT=0.312 T1=0.3	SAT TT=0.312 T1=0.3	No data	No data	SAT TT=9.682 T1=9.66	SAT TT=3.559 T1=3.54	SAT TT=1.58 T1=1.56	SAT TT=1.556 T1=1.53	SAT TT=7.444 T1=2.61	SAT TT=2.274 T1=1.11	SAT TT=1.268 T1=1.2
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12035_4-sat.opb	SAT TT=0.295 T1=0.29	SAT TT=0.295 T1=0.29	No data	No data	SAT TT=5.698 T1=5.68	SAT TT=3.2 T1=3.18	SAT TT=2.021 T1=2	SAT TT=2.092 T1=2.08	SAT TT=6.465 T1=2.15	SAT TT=2.273 T1=1.16	SAT TT=1.42 T1=1.37
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12036_3-sat.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12036_4-sat.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12037_7-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12038_3-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.75	? (TO) TT=1800.67	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12038_7-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.6	? (TO) TT=1800	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12038_8-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.9	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12039_7-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.86	? (TO) TT=1800.09	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12041_4-unsat.opb	UNSAT TT=0.79	UNSAT TT=1.179	No data	No data	UNSAT TT=1.669	UNSAT TT=2.045	UNSAT TT=0.803	UNSAT TT=0.79	UNSAT TT=8.875	UNSAT TT=2.944	UNSAT TT=5.422
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12045_10-sat.opb	SAT TT=0.266 T1=0.26	SAT TT=0.266 T1=0.26	No data	No data	SAT TT=1.015 T1=1	SAT TT=0.983 T1=0.97	SAT TT=0.417 T1=0.41	SAT TT=0.421 T1=0.41	SAT TT=5.833 T1=2.13	SAT TT=2.084 T1=0.98	SAT TT=1.163 T1=1.09
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12046_2-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.56	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12047_10-unsat.opb	UNSAT TT=224.071	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	UNSAT TT=224.071	UNSAT TT=425.093	UNSAT TT=439.026	? (TO) TT=1800.02	? (TO) TT=1800.68	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12047_6-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1204_7-sat.opb	SAT TT=0.203 T1=0.19	SAT TT=0.203 T1=0.19	No data	No data	SAT TT=0.908 T1=0.9	SAT TT=0.887 T1=0.88	SAT TT=0.345 T1=0.33	SAT TT=0.345 T1=0.34	SAT TT=5.283 T1=1.95	SAT TT=1.874 T1=0.86	SAT TT=0.906 T1=0.87
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12048_4-unsat.opb	UNSAT TT=198.565	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	UNSAT TT=198.565	UNSAT TT=530.338	UNSAT TT=600.584	? (TO) TT=1800.23	? (TO) TT=1800.51	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12049_6-unsat.opb	UNSAT TT=0.187	UNSAT TT=0.187	No data	No data	UNSAT TT=0.517	UNSAT TT=0.488	UNSAT TT=0.542	UNSAT TT=0.531	UNSAT TT=2.254	UNSAT TT=0.974	UNSAT TT=1.276
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1205_1-unsat.opb	UNSAT TT=0.116	UNSAT TT=0.116	No data	No data	UNSAT TT=0.322	UNSAT TT=0.283	UNSAT TT=0.293	UNSAT TT=0.295	UNSAT TT=2.145	UNSAT TT=0.864	UNSAT TT=0.768
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12052_5-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1205_3-unsat.opb	UNSAT TT=0.092	UNSAT TT=0.092	No data	No data	UNSAT TT=0.241	UNSAT TT=0.222	UNSAT TT=0.227	UNSAT TT=0.229	UNSAT TT=1.983	UNSAT TT=0.854	UNSAT TT=0.579
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12056_10-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12058_4-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j12059_3-unsat.opb	UNSAT TT=0.157	UNSAT TT=0.157	No data	No data	UNSAT TT=0.432	UNSAT TT=0.381	UNSAT TT=0.761	UNSAT TT=0.769	UNSAT TT=2.173	UNSAT TT=0.933	UNSAT TT=1.054
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1206_6-sat.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1206_8-unsat.opb	UNSAT TT=44.841	UNSAT TT=1109.46	No data	No data	? (TO) TT=1800.1	UNSAT TT=44.841	UNSAT TT=77.631	UNSAT TT=78.906	UNSAT TT=157.51	UNSAT TT=130.13	UNSAT TT=287.577
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1208_10-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.89	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1208_6-sat.opb	SAT TT=21.401 T1=9.49	SAT TT=336.794 T1=336.84	No data	No data	? (TO) TT=1800.11	SAT TT=1363.58 T1=1363.8	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=21.401 T1=9.49	SAT TT=38.818 T1=37.63	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/ oliveras/j120/ normalized-j1209_4-sat.opb	SAT TT=0.745 T1=0.74	SAT TT=0.745 T1=0.74	No data	No data	SAT TT=64.07 T1=64.06	SAT TT=12.255 T1=12.24	SAT TT=56.152 T1=56.14	SAT TT=56.233 T1=56.23	SAT TT=21.71 T1=9.23	SAT TT=10.762 T1=9.41	SAT TT=215.112 T1=215.06
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3011_9-unsat.opb	UNSAT TT=0.028	UNSAT TT=0.028	No data	No data	UNSAT TT=0.059	UNSAT TT=0.051	UNSAT TT=0.076	UNSAT TT=0.077	UNSAT TT=0.763	UNSAT TT=0.633	UNSAT TT=0.185
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j301_4-unsat.opb	UNSAT TT=0.045	UNSAT TT=0.045	No data	No data	UNSAT TT=0.127	UNSAT TT=0.088	UNSAT TT=0.045	UNSAT TT=0.047	UNSAT TT=2.103	UNSAT TT=0.823	UNSAT TT=0.194
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3017_6-sat.opb	SAT TT=0.048 T1=0.04	SAT TT=0.048 T1=0.04	No data	No data	SAT TT=0.141 T1=0.13	SAT TT=0.099 T1=0.09	SAT TT=0.051 T1=0.05	SAT TT=0.051 T1=0.05	SAT TT=2.254 T1=1.09	SAT TT=0.893 T1=0.45	SAT TT=0.22 T1=0.22
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3020_1-sat.opb	SAT TT=0.044 T1=0.04	SAT TT=0.044 T1=0.04	No data	No data	SAT TT=0.128 T1=0.12	SAT TT=0.087 T1=0.08	SAT TT=0.052 T1=0.05	SAT TT=0.052 T1=0.05	SAT TT=2.154 T1=1.05	SAT TT=0.854 T1=0.45	SAT TT=0.194 T1=0.18
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3024_2-sat.opb	SAT TT=0.046 T1=0.04	SAT TT=0.046 T1=0.04	No data	No data	SAT TT=0.142 T1=0.14	SAT TT=0.096 T1=0.09	SAT TT=0.086 T1=0.08	SAT TT=0.087 T1=0.08	SAT TT=2.245 T1=1.11	SAT TT=0.895 T1=0.45	SAT TT=0.208 T1=0.19
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3024_3-sat.opb	SAT TT=0.052 T1=0.05	SAT TT=0.052 T1=0.05	No data	No data	SAT TT=0.17 T1=0.16	SAT TT=0.112 T1=0.11	SAT TT=0.099 T1=0.09	SAT TT=0.096 T1=0.09	SAT TT=2.345 T1=1.15	SAT TT=0.942 T1=0.48	SAT TT=0.231 T1=0.22
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3024_4-sat.opb	SAT TT=0.044 T1=0.04	SAT TT=0.044 T1=0.04	No data	No data	SAT TT=0.141 T1=0.14	SAT TT=0.106 T1=0.11	SAT TT=0.073 T1=0.07	SAT TT=0.073 T1=0.07	SAT TT=2.163 T1=1.04	SAT TT=0.843 T1=0.45	SAT TT=0.188 T1=0.18
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3024_5-sat.opb	SAT TT=0.041 T1=0.03	SAT TT=0.041 T1=0.03	No data	No data	SAT TT=0.128 T1=0.13	SAT TT=0.091 T1=0.09	SAT TT=0.069 T1=0.07	SAT TT=0.07 T1=0.06	SAT TT=2.073 T1=1.06	SAT TT=0.843 T1=0.44	SAT TT=0.181 T1=0.17
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3025_10-sat.opb	SAT TT=0.054 T1=0.05	SAT TT=0.054 T1=0.05	No data	No data	SAT TT=0.232 T1=0.23	SAT TT=0.499 T1=0.49	SAT TT=0.094 T1=0.09	SAT TT=0.095 T1=0.09	SAT TT=4.084 T1=1.65	SAT TT=1.264 T1=0.59	SAT TT=0.266 T1=0.25
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3025_1-sat.opb	SAT TT=0.199 T1=0.19	SAT TT=0.199 T1=0.19	No data	No data	SAT TT=0.436 T1=0.43	SAT TT=0.904 T1=0.9	SAT TT=0.242 T1=0.27	SAT TT=0.244 T1=0.24	SAT TT=4.952 T1=1.97	SAT TT=1.635 T1=0.74	SAT TT=0.555 T1=0.53
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3025_7-sat.opb	SAT TT=0.099 T1=0.09	SAT TT=0.099 T1=0.09	No data	No data	SAT TT=0.511 T1=0.5	SAT TT=0.933 T1=0.93	SAT TT=0.158 T1=0.15	SAT TT=0.156 T1=0.15	SAT TT=3.713 T1=1.47	SAT TT=1.533 T1=0.72	SAT TT=0.419 T1=0.39
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3027_8-sat.opb	SAT TT=0.053 T1=0.05	SAT TT=0.053 T1=0.05	No data	No data	SAT TT=0.186 T1=0.18	SAT TT=0.149 T1=0.14	SAT TT=0.123 T1=0.12	SAT TT=0.123 T1=0.12	SAT TT=2.397 T1=1.22	SAT TT=0.943 T1=0.49	SAT TT=0.238 T1=0.22
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3029_6-sat.opb	SAT TT=2.345 T1=2.03	SAT TT=2.345 T1=2.34	No data	No data	SAT TT=8.345 T1=8.33	SAT TT=3.368 T1=3.36	SAT TT=3.014 T1=3.01	SAT TT=2.985 T1=2.98	SAT TT=8.122 T1=2.98	SAT TT=3.013 T1=2.03	SAT TT=3.141 T1=3.07
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3029_8-unsat.opb	UNSAT TT=5.773	UNSAT TT=8.32	No data	No data	UNSAT TT=14.698	UNSAT TT=5.773	UNSAT TT=7.246	UNSAT TT=7.226	UNSAT TT=14.582	UNSAT TT=6.444	UNSAT TT=17.934
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3030_6-sat.opb	SAT TT=0.062 T1=0.06	SAT TT=0.062 T1=0.06	No data	No data	SAT TT=0.34 T1=0.33	SAT TT=0.513 T1=0.51	SAT TT=0.204 T1=0.2	SAT TT=0.207 T1=0.2	SAT TT=4.885 T1=1.79	SAT TT=1.443 T1=0.65	SAT TT=0.248 T1=0.23
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3031_7-sat.opb	SAT TT=0.049 T1=0.05	SAT TT=0.049 T1=0.05	No data	No data	SAT TT=0.187 T1=0.18	SAT TT=0.155 T1=0.15	SAT TT=0.161 T1=0.15	SAT TT=0.162 T1=0.16	SAT TT=2.444 T1=1.24	SAT TT=0.955 T1=0.49	SAT TT=0.23 T1=0.5
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3037_5-sat.opb	SAT TT=0.066 T1=0.06	SAT TT=0.066 T1=0.06	No data	No data	SAT TT=0.238 T1=0.23	SAT TT=0.232 T1=0.23	SAT TT=0.096 T1=0.09	SAT TT=0.098 T1=0.09	SAT TT=3.622 T1=1.22	SAT TT=1.205 T1=0.56	SAT TT=0.32 T1=0.3
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3041_4-unsat.opb	UNSAT TT=0.105	UNSAT TT=0.105	No data	No data	UNSAT TT=0.47	UNSAT TT=0.741	UNSAT TT=0.153	UNSAT TT=0.154	UNSAT TT=4.963	UNSAT TT=1.374	UNSAT TT=0.613
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3042_5-unsat.opb	UNSAT TT=0.027	UNSAT TT=0.027	No data	No data	UNSAT TT=0.052	UNSAT TT=0.045	UNSAT TT=0.061	UNSAT TT=0.064	UNSAT TT=0.734	UNSAT TT=0.614	UNSAT TT=0.141
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3043_8-sat.opb	SAT TT=0.05 T1=0.04	SAT TT=0.05 T1=0.04	No data	No data	SAT TT=0.172 T1=0.17	SAT TT=0.126 T1=0.12	SAT TT=0.121 T1=0.11	SAT TT=0.119 T1=0.11	SAT TT=2.424 T1=1.2	SAT TT=0.923 T1=0.47	SAT TT=0.226 T1=0.21
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3046_4-unsat.opb	UNSAT TT=0.06	UNSAT TT=0.06	No data	No data	UNSAT TT=0.221	UNSAT TT=0.238	UNSAT TT=0.148	UNSAT TT=0.147	UNSAT TT=3.053	UNSAT TT=0.993	UNSAT TT=0.245
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j3048_8-sat.opb	SAT TT=0.039 T1=0.03	SAT TT=0.039 T1=0.03	No data	No data	SAT TT=0.11 T1=0.11	SAT TT=0.074 T1=0.07	SAT TT=0.139 T1=0.13	SAT TT=0.14 T1=0.13	SAT TT=2.093 T1=1.05	SAT TT=0.754 T1=0.43	SAT TT=0.16 T1=0.14
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j307_10-sat.opb	SAT TT=0.04 T1=0.03	SAT TT=0.04 T1=0.03	No data	No data	SAT TT=0.143 T1=0.14	SAT TT=0.139 T1=0.13	SAT TT=0.068 T1=0.06	SAT TT=0.068 T1=0.06	SAT TT=2.135 T1=1.06	SAT TT=0.783 T1=0.42	SAT TT=0.17 T1=0.15
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j307_9-unsat.opb	UNSAT TT=0.042	UNSAT TT=0.042	No data	No data	UNSAT TT=0.131	UNSAT TT=0.082	UNSAT TT=0.057	UNSAT TT=0.058	UNSAT TT=2.145	UNSAT TT=0.805	UNSAT TT=0.186
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j308_1-unsat.opb	UNSAT TT=0.021	UNSAT TT=0.021	No data	No data	UNSAT TT=0.038	UNSAT TT=0.032	UNSAT TT=0.041	UNSAT TT=0.042	UNSAT TT=0.603	UNSAT TT=0.555	UNSAT TT=0.109
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j308_6-sat.opb	SAT TT=0.037 T1=0.03	SAT TT=0.037 T1=0.03	No data	No data	SAT TT=0.121 T1=0.11	SAT TT=0.089 T1=0.08	SAT TT=0.067 T1=0.06	SAT TT=0.067 T1=0.06	SAT TT=2.083 T1=1.02	SAT TT=0.774 T1=0.43	SAT TT=0.15 T1=0.14
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j308_6-unsat.opb	UNSAT TT=0.022	UNSAT TT=0.022	No data	No data	UNSAT TT=0.04	UNSAT TT=0.033	UNSAT TT=0.045	UNSAT TT=0.046	UNSAT TT=0.634	UNSAT TT=0.553	UNSAT TT=0.117
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j309_10-unsat.opb	UNSAT TT=0.194	UNSAT TT=0.194	No data	No data	UNSAT TT=0.543	UNSAT TT=0.9	UNSAT TT=0.808	UNSAT TT=0.806	UNSAT TT=5.521	UNSAT TT=1.713	UNSAT TT=1.196
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j309_6-sat.opb	SAT TT=0.072 T1=0.07	SAT TT=0.072 T1=0.07	No data	No data	SAT TT=0.327 T1=0.32	SAT TT=0.57 T1=0.56	SAT TT=0.164 T1=0.16	SAT TT=0.163 T1=0.16	SAT TT=5.003 T1=1.65	SAT TT=1.465 T1=0.74	SAT TT=0.422 T1=0.4
/DEC-SMALLINT-LIN/ oliveras/j30/ normalized-j309_9-sat.opb	SAT TT=0.196 T1=0.19	SAT TT=0.196 T1=0.19	No data	No data	SAT TT=0.561 T1=0.55	SAT TT=0.747 T1=0.74	SAT TT=0.554 T1=0.55	SAT TT=0.549 T1=0.54	SAT TT=5.172 T1=1.73	SAT TT=1.444 T1=0.78	SAT TT=0.376 T1=0.36
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6010_2-unsat.opb	UNSAT TT=0.045	UNSAT TT=0.045	No data	No data	UNSAT TT=0.105	UNSAT TT=0.091	UNSAT TT=0.185	UNSAT TT=0.187	UNSAT TT=1.173	UNSAT TT=0.714	UNSAT TT=0.283
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6010_7-unsat.opb	UNSAT TT=0.049	UNSAT TT=0.049	No data	No data	UNSAT TT=0.127	UNSAT TT=0.1	UNSAT TT=0.184	UNSAT TT=0.187	UNSAT TT=1.205	UNSAT TT=0.734	UNSAT TT=0.302
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6013_2-unsat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.68	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6014_2-sat.opb	SAT TT=0.096 T1=0.09	SAT TT=0.096 T1=0.09	No data	No data	SAT TT=1.209 T1=1.21	SAT TT=1.567 T1=1.56	SAT TT=0.619 T1=0.61	SAT TT=0.617 T1=0.75	SAT TT=5.052 T1=2.02	SAT TT=1.653 T1=0.74	SAT TT=0.402 T1=0.37
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6015_4-sat.opb	SAT TT=0.106 T1=0.1	SAT TT=0.106 T1=0.1	No data	No data	SAT TT=1.125 T1=1.11	SAT TT=1.703 T1=1.69	SAT TT=0.665 T1=0.65	SAT TT=0.666 T1=0.65	SAT TT=3.442 T1=1.52	SAT TT=1.395 T1=0.62	SAT TT=0.456 T1=0.44
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6016_10-unsat.opb	UNSAT TT=0.047	UNSAT TT=0.047	No data	No data	UNSAT TT=0.115	UNSAT TT=0.099	UNSAT TT=0.37	UNSAT TT=0.372	UNSAT TT=1.193	UNSAT TT=0.754	UNSAT TT=0.324
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6018_3-sat.opb	SAT TT=0.103 T1=0.1	SAT TT=0.103 T1=0.1	No data	No data	SAT TT=0.383 T1=0.38	SAT TT=0.277 T1=0.27	SAT TT=0.141 T1=0.13	SAT TT=0.142 T1=0.13	SAT TT=2.896 T1=1.51	SAT TT=1.123 T1=0.57	SAT TT=0.443 T1=0.42
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j601_8-unsat.opb	UNSAT TT=0.094	UNSAT TT=0.094	No data	No data	UNSAT TT=0.301	UNSAT TT=0.21	UNSAT TT=0.114	UNSAT TT=0.118	UNSAT TT=2.665	UNSAT TT=1.003	UNSAT TT=0.38
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6020_9-sat.opb	SAT TT=0.1 T1=0.09	SAT TT=0.1 T1=0.09	No data	No data	SAT TT=0.338 T1=0.33	SAT TT=0.246 T1=0.24	SAT TT=0.147 T1=0.14	SAT TT=0.145 T1=0.14	SAT TT=2.854 T1=1.46	SAT TT=1.124 T1=0.57	SAT TT=0.414 T1=0.39
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6022_1-sat.opb	SAT TT=0.09 T1=0.08	SAT TT=0.09 T1=0.08	No data	No data	SAT TT=0.374 T1=0.37	SAT TT=0.298 T1=0.3	SAT TT=0.202 T1=0.19	SAT TT=0.203 T1=0.2	SAT TT=3.454 T1=1.5	SAT TT=1.303 T1=0.56	SAT TT=0.371 T1=0.34
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6027_4-unsat.opb	UNSAT TT=0.046	UNSAT TT=0.046	No data	No data	UNSAT TT=0.107	UNSAT TT=0.089	UNSAT TT=0.188	UNSAT TT=0.191	UNSAT TT=1.233	UNSAT TT=0.724	UNSAT TT=0.284
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6027_9-unsat.opb	UNSAT TT=0.055	UNSAT TT=0.055	No data	No data	UNSAT TT=0.141	UNSAT TT=0.122	UNSAT TT=0.223	UNSAT TT=0.226	UNSAT TT=1.403	UNSAT TT=0.793	UNSAT TT=0.377
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j602_7-unsat.opb	UNSAT TT=0.068	UNSAT TT=0.068	No data	No data	UNSAT TT=0.208	UNSAT TT=0.142	UNSAT TT=0.088	UNSAT TT=0.09	UNSAT TT=2.423	UNSAT TT=0.874	UNSAT TT=0.275
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6028_7-sat.opb	SAT TT=0.106 T1=0.1	SAT TT=0.106 T1=0.1	No data	No data	SAT TT=0.78 T1=0.77	SAT TT=1.288 T1=1.28	SAT TT=0.605 T1=0.59	SAT TT=0.606 T1=0.59	SAT TT=3.414 T1=1.5	SAT TT=1.375 T1=0.61	SAT TT=0.46 T1=0.44
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6028_9-unsat.opb	UNSAT TT=0.055	UNSAT TT=0.055	No data	No data	UNSAT TT=0.145	UNSAT TT=0.114	UNSAT TT=0.265	UNSAT TT=0.267	UNSAT TT=1.384	UNSAT TT=0.805	UNSAT TT=0.357
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6029_8-unsat.opb	UNSAT TT=1569.11	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	UNSAT TT=1569.11	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.05
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6030_8-sat.opb	SAT TT=0.1 T1=0.09	SAT TT=0.1 T1=0.09	No data	No data	SAT TT=0.661 T1=0.65	SAT TT=0.762 T1=0.75	SAT TT=2.102 T1=2.09	SAT TT=2.147 T1=2.14	SAT TT=4.182 T1=1.5	SAT TT=1.613 T1=0.69	SAT TT=0.413 T1=0.39
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6030_9-unsat.opb	UNSAT TT=0.071	UNSAT TT=0.071	No data	No data	UNSAT TT=0.184	UNSAT TT=0.16	UNSAT TT=0.288	UNSAT TT=0.292	UNSAT TT=1.605	UNSAT TT=0.814	UNSAT TT=0.447
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6032_1-unsat.opb	UNSAT TT=0.052	UNSAT TT=0.052	No data	No data	UNSAT TT=0.129	UNSAT TT=0.114	UNSAT TT=0.438	UNSAT TT=0.44	UNSAT TT=1.364	UNSAT TT=0.763	UNSAT TT=0.329
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j603_2-unsat.opb	UNSAT TT=0.048	UNSAT TT=0.048	No data	No data	UNSAT TT=0.118	UNSAT TT=0.103	UNSAT TT=0.104	UNSAT TT=0.106	UNSAT TT=1.323	UNSAT TT=0.733	UNSAT TT=0.292
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6033_2-unsat.opb	UNSAT TT=0.079	UNSAT TT=0.079	No data	No data	UNSAT TT=0.215	UNSAT TT=0.176	UNSAT TT=0.151	UNSAT TT=0.15	UNSAT TT=1.673	UNSAT TT=0.813	UNSAT TT=0.439
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6035_10-sat.opb	SAT TT=0.099 T1=0.09	SAT TT=0.099 T1=0.09	No data	No data	SAT TT=0.319 T1=0.31	SAT TT=0.223 T1=0.22	SAT TT=0.141 T1=0.14	SAT TT=0.143 T1=0.14	SAT TT=2.834 T1=1.49	SAT TT=1.114 T1=0.56	SAT TT=0.427 T1=0.41
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6040_10-sat.opb	SAT TT=0.104 T1=0.1	SAT TT=0.104 T1=0.1	No data	No data	SAT TT=0.446 T1=0.44	SAT TT=0.525 T1=0.52	SAT TT=0.254 T1=0.25	SAT TT=0.255 T1=0.25	SAT TT=3.253 T1=1.5	SAT TT=1.344 T1=0.6	SAT TT=0.437 T1=0.42
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6040_1-sat.opb	SAT TT=0.121 T1=0.11	SAT TT=0.121 T1=0.11	No data	No data	SAT TT=0.455 T1=0.46	SAT TT=0.381 T1=0.38	SAT TT=0.313 T1=0.3	SAT TT=0.317 T1=0.31	SAT TT=3.383 T1=1.5	SAT TT=1.403 T1=0.64	SAT TT=0.523 T1=0.49
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6040_3-sat.opb	SAT TT=0.1 T1=0.1	SAT TT=0.1 T1=0.1	No data	No data	SAT TT=0.378 T1=0.37	SAT TT=0.319 T1=0.32	SAT TT=0.268 T1=0.26	SAT TT=0.269 T1=0.26	SAT TT=3.255 T1=1.48	SAT TT=1.274 T1=0.57	SAT TT=0.431 T1=0.41
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6041_4-sat.opb	SAT TT=0.305 T1=0.3	SAT TT=0.305 T1=0.3	No data	No data	SAT TT=7.97 T1=7.95	SAT TT=4.553 T1=4.54	SAT TT=2.576 T1=2.56	SAT TT=2.514 T1=2.5	SAT TT=7.559 T1=2.53	SAT TT=2.295 T1=1.21	SAT TT=2.49 T1=2.42
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6042_2-sat.opb	SAT TT=0.108 T1=0.1	SAT TT=0.108 T1=0.1	No data	No data	SAT TT=0.645 T1=0.64	SAT TT=0.786 T1=0.78	SAT TT=0.315 T1=0.31	SAT TT=0.319 T1=0.31	SAT TT=3.492 T1=1.49	SAT TT=1.414 T1=0.61	SAT TT=0.446 T1=0.42
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6043_4-sat.opb	SAT TT=0.109 T1=0.1	SAT TT=0.109 T1=0.1	No data	No data	SAT TT=0.487 T1=0.49	SAT TT=0.42 T1=0.41	SAT TT=0.447 T1=0.44	SAT TT=0.451 T1=0.44	SAT TT=3.584 T1=1.51	SAT TT=1.443 T1=0.64	SAT TT=0.444 T1=0.43
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j6048_4-sat.opb	SAT TT=0.094 T1=0.09	SAT TT=0.094 T1=0.09	No data	No data	SAT TT=0.582 T1=0.57	SAT TT=0.842 T1=0.83	SAT TT=0.59 T1=0.58	SAT TT=0.596 T1=0.59	SAT TT=3.412 T1=1.53	SAT TT=1.334 T1=0.58	SAT TT=0.402 T1=0.37
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j605_10-unsat.opb	UNSAT TT=4.186	UNSAT TT=58.911	No data	No data	UNSAT TT=19.777	UNSAT TT=4.186	UNSAT TT=8.433	UNSAT TT=8.538	UNSAT TT=20.722	UNSAT TT=10.312	UNSAT TT=24.208
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j605_1-unsat.opb	UNSAT TT=2.354	UNSAT TT=5.194	No data	No data	UNSAT TT=7.497	UNSAT TT=2.354	UNSAT TT=3.059	UNSAT TT=3.09	UNSAT TT=11.791	UNSAT TT=4.222	UNSAT TT=9.191
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j605_7-sat.opb	SAT TT=0.877 T1=0.87	SAT TT=9.588 T1=9.58	No data	No data	SAT TT=4.751 T1=4.74	SAT TT=4.09 T1=4.08	SAT TT=0.883 T1=0.87	SAT TT=0.877 T1=0.92	SAT TT=11.954 T1=4.54	SAT TT=7.602 T1=6.53	SAT TT=12.827 T1=12.77
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j606_1-unsat.opb	UNSAT TT=0.043	UNSAT TT=0.043	No data	No data	UNSAT TT=0.1	UNSAT TT=0.085	UNSAT TT=0.119	UNSAT TT=0.117	UNSAT TT=1.164	UNSAT TT=0.724	UNSAT TT=0.282
/DEC-SMALLINT-LIN/ oliveras/j60/ normalized-j607_4-unsat.opb	UNSAT TT=0.044	UNSAT TT=0.044	No data	No data	UNSAT TT=0.106	UNSAT TT=0.09	UNSAT TT=0.143	UNSAT TT=0.143	UNSAT TT=1.136	UNSAT TT=0.704	UNSAT TT=0.288
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9010_10-unsat.opb	UNSAT TT=0.074	UNSAT TT=0.074	No data	No data	UNSAT TT=0.193	UNSAT TT=0.165	UNSAT TT=0.317	UNSAT TT=0.319	UNSAT TT=1.693	UNSAT TT=0.814	UNSAT TT=0.508
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9010_6-unsat.opb	UNSAT TT=0.096	UNSAT TT=0.096	No data	No data	UNSAT TT=0.242	UNSAT TT=0.214	UNSAT TT=0.39	UNSAT TT=0.396	UNSAT TT=1.924	UNSAT TT=0.844	UNSAT TT=0.619
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9010_8-sat.opb	SAT TT=0.181 T1=0.17	SAT TT=0.181 T1=0.17	No data	No data	SAT TT=2.443 T1=2.43	SAT TT=2.486 T1=2.47	SAT TT=1.049 T1=1.04	SAT TT=1.088 T1=1.08	SAT TT=7.703 T1=2.54	SAT TT=2.226 T1=1.1	SAT TT=0.776 T1=0.73
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9012_2-unsat.opb	UNSAT TT=0.072	UNSAT TT=0.072	No data	No data	UNSAT TT=0.183	UNSAT TT=0.164	UNSAT TT=0.637	UNSAT TT=0.643	UNSAT TT=1.614	UNSAT TT=0.825	UNSAT TT=0.448
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9012_5-sat.opb	SAT TT=0.168 T1=0.16	SAT TT=0.168 T1=0.16	No data	No data	SAT TT=1.538 T1=1.53	SAT TT=3.323 T1=3.31	SAT TT=1.364 T1=1.34	SAT TT=1.37 T1=1.35	SAT TT=5.382 T1=2	SAT TT=1.654 T1=0.75	SAT TT=0.85 T1=0.8
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9014_1-unsat.opb	UNSAT TT=0.086	UNSAT TT=0.086	No data	No data	UNSAT TT=0.231	UNSAT TT=0.205	UNSAT TT=0.52	UNSAT TT=0.557	UNSAT TT=1.863	UNSAT TT=0.853	UNSAT TT=0.611
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9015_10-unsat.opb	UNSAT TT=0.076	UNSAT TT=0.076	No data	No data	UNSAT TT=0.2	UNSAT TT=0.177	UNSAT TT=0.542	UNSAT TT=0.546	UNSAT TT=1.713	UNSAT TT=0.814	UNSAT TT=0.559
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9015_7-unsat.opb	UNSAT TT=0.08	UNSAT TT=0.08	No data	No data	UNSAT TT=0.211	UNSAT TT=0.183	UNSAT TT=0.604	UNSAT TT=0.609	UNSAT TT=1.774	UNSAT TT=0.844	UNSAT TT=0.562
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9016_7-sat.opb	SAT TT=0.135 T1=0.13	SAT TT=0.135 T1=0.13	No data	No data	SAT TT=1.251 T1=1.24	SAT TT=3.91 T1=3.89	SAT TT=1.384 T1=1.36	SAT TT=1.392 T1=1.37	SAT TT=3.623 T1=1.58	SAT TT=1.505 T1=0.68	SAT TT=0.593 T1=0.55
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j901_6-sat.opb	SAT TT=0.147 T1=0.14	SAT TT=0.147 T1=0.14	No data	No data	SAT TT=0.638 T1=0.63	SAT TT=0.638 T1=0.63	SAT TT=0.203 T1=0.32	SAT TT=0.203 T1=0.2	SAT TT=3.842 T1=1.49	SAT TT=1.655 T1=0.77	SAT TT=0.683 T1=0.65
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j902_5-sat.opb	SAT TT=0.189 T1=0.18	SAT TT=0.189 T1=0.18	No data	No data	SAT TT=0.799 T1=0.79	SAT TT=0.783 T1=0.77	SAT TT=0.306 T1=0.3	SAT TT=0.31 T1=0.3	SAT TT=5.713 T1=2.02	SAT TT=1.764 T1=0.82	SAT TT=0.915 T1=0.87
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9027_5-sat.opb	SAT TT=0.206 T1=0.2	SAT TT=0.206 T1=0.2	No data	No data	SAT TT=1.74 T1=1.73	SAT TT=2.951 T1=2.93	SAT TT=1.285 T1=1.27	SAT TT=1.289 T1=1.27	SAT TT=5.333 T1=2.04	SAT TT=1.753 T1=0.83	SAT TT=0.902 T1=0.86
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9028_2-unsat.opb	UNSAT TT=0.08	UNSAT TT=0.08	No data	No data	UNSAT TT=0.208	UNSAT TT=0.18	UNSAT TT=0.547	UNSAT TT=0.554	UNSAT TT=1.724	UNSAT TT=0.835	UNSAT TT=0.521
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j903_10-unsat.opb	UNSAT TT=0.065	UNSAT TT=0.065	No data	No data	UNSAT TT=0.16	UNSAT TT=0.136	UNSAT TT=0.155	UNSAT TT=0.157	UNSAT TT=1.604	UNSAT TT=0.826	UNSAT TT=0.419
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9035_1-unsat.opb	UNSAT TT=0.183	UNSAT TT=0.183	No data	No data	UNSAT TT=0.615	UNSAT TT=0.414	UNSAT TT=0.247	UNSAT TT=0.251	UNSAT TT=4.993	UNSAT TT=1.434	UNSAT TT=0.78
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9035_5-sat.opb	SAT TT=0.204 T1=0.2	SAT TT=0.204 T1=0.2	No data	No data	SAT TT=0.738 T1=0.73	SAT TT=0.589 T1=0.58	SAT TT=0.32 T1=0.31	SAT TT=0.321 T1=0.31	SAT TT=4.773 T1=1.86	SAT TT=1.683 T1=0.81	SAT TT=0.885 T1=0.86
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9038_3-unsat.opb	UNSAT TT=0.181	UNSAT TT=0.181	No data	No data	UNSAT TT=0.794	UNSAT TT=0.819	UNSAT TT=0.436	UNSAT TT=0.44	UNSAT TT=5.464	UNSAT TT=1.634	UNSAT TT=0.8
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9039_3-unsat.opb	UNSAT TT=0.094	UNSAT TT=0.094	No data	No data	UNSAT TT=0.24	UNSAT TT=0.209	UNSAT TT=0.304	UNSAT TT=0.308	UNSAT TT=1.904	UNSAT TT=0.844	UNSAT TT=0.556
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9040_1-sat.opb	SAT TT=0.2 T1=0.19	SAT TT=0.2 T1=0.19	No data	No data	SAT TT=1.118 T1=1.11	SAT TT=1.527 T1=1.52	SAT TT=0.575 T1=0.56	SAT TT=0.582 T1=0.57	SAT TT=4.693 T1=1.86	SAT TT=1.664 T1=0.8	SAT TT=0.875 T1=0.84
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9040_1-unsat.opb	UNSAT TT=0.106	UNSAT TT=0.106	No data	No data	UNSAT TT=0.281	UNSAT TT=0.249	UNSAT TT=0.362	UNSAT TT=0.365	UNSAT TT=2.104	UNSAT TT=0.865	UNSAT TT=0.631
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9042_4-sat.opb	SAT TT=0.219 T1=0.21	SAT TT=0.219 T1=0.21	No data	No data	SAT TT=1.686 T1=1.68	SAT TT=2.121 T1=2.11	SAT TT=1.247 T1=1.24	SAT TT=1.239 T1=1.23	SAT TT=5.924 T1=1.99	SAT TT=1.944 T1=0.88	SAT TT=0.916 T1=0.87
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9042_5-sat.opb	SAT TT=0.239 T1=0.23	SAT TT=0.239 T1=0.23	No data	No data	SAT TT=2.06 T1=2.04	SAT TT=2.566 T1=2.55	SAT TT=1.08 T1=1.07	SAT TT=1.074 T1=1.06	SAT TT=5.393 T1=2	SAT TT=1.896 T1=0.87	SAT TT=1.119 T1=1.08
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9043_2-sat.opb	SAT TT=0.196 T1=0.19	SAT TT=0.196 T1=0.19	No data	No data	SAT TT=1.426 T1=1.41	SAT TT=1.811 T1=1.8	SAT TT=0.712 T1=0.7	SAT TT=0.716 T1=0.7	SAT TT=5.713 T1=2.07	SAT TT=1.714 T1=0.79	SAT TT=0.857 T1=0.82
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9045_1-sat.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.53	? (TO) TT=1800	? (TO) TT=1800.05
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9048_1-unsat.opb	UNSAT TT=0.092	UNSAT TT=0.092	No data	No data	UNSAT TT=0.25	UNSAT TT=0.215	UNSAT TT=0.92	UNSAT TT=0.935	UNSAT TT=1.944	UNSAT TT=0.845	UNSAT TT=0.614
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j9048_9-sat.opb	SAT TT=0.195 T1=0.19	SAT TT=0.195 T1=0.19	No data	No data	SAT TT=1.792 T1=1.78	SAT TT=2.871 T1=2.86	SAT TT=1.35 T1=1.33	SAT TT=1.358 T1=1.34	SAT TT=5.493 T1=2.09	SAT TT=1.693 T1=0.79	SAT TT=0.841 T1=0.81
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j905_6-unsat.opb	UNSAT TT=1.3	UNSAT TT=1.3	No data	No data	UNSAT TT=10.793	UNSAT TT=2.168	UNSAT TT=1.551	UNSAT TT=1.57	UNSAT TT=7.382	UNSAT TT=2.764	UNSAT TT=4.296
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j906_2-sat.opb	SAT TT=0.17 T1=0.16	SAT TT=0.17 T1=0.16	No data	No data	SAT TT=1.637 T1=1.62	SAT TT=2.049 T1=2.03	SAT TT=0.503 T1=0.49	SAT TT=0.49 T1=0.48	SAT TT=5.743 T1=1.99	SAT TT=1.783 T1=0.79	SAT TT=0.886 T1=0.78
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j907_8-unsat.opb	UNSAT TT=0.064	UNSAT TT=0.064	No data	No data	UNSAT TT=0.152	UNSAT TT=0.129	UNSAT TT=0.26	UNSAT TT=0.262	UNSAT TT=1.454	UNSAT TT=0.806	UNSAT TT=0.376
/DEC-SMALLINT-LIN/ oliveras/j90/ normalized-j908_8-unsat.opb	UNSAT TT=0.07	UNSAT TT=0.07	No data	No data	UNSAT TT=0.173	UNSAT TT=0.148	UNSAT TT=0.353	UNSAT TT=0.358	UNSAT TT=1.613	UNSAT TT=0.833	UNSAT TT=0.398
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K65.opb	UNSAT TT=1039.78	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	UNSAT TT=1039.78	UNSAT TT=1228.47	UNSAT TT=1251.65	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K66.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.68	? (TO) TT=1800.04	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K67.opb	SAT TT=206.45 T1=206.48	? (TO) TT=1800.02	No data	No data	SAT TT=440.345 T1=440.41	SAT TT=466.055 T1=466.13	SAT TT=214.915 T1=214.95	SAT TT=206.45 T1=206.48	? (TO) TT=1800.17	SAT TT=1326.91 T1=1319.62	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K68.opb	SAT TT=40.639 T1=40.64	? (TO) TT=1800.07	No data	No data	SAT TT=447.577 T1=447.64	SAT TT=481.176 T1=481.24	SAT TT=41.203 T1=41.2	SAT TT=40.639 T1=40.64	SAT TT=766.916 T1=381.01	SAT TT=44.12 T1=43.29	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K69.opb	SAT TT=24.57 T1=23.78	? (TO) TT=1800.02	No data	No data	SAT TT=191.845 T1=191.87	SAT TT=51.023 T1=51.02	SAT TT=108.125 T1=108.14	SAT TT=104.15 T1=104.16	SAT TT=1087.56 T1=662.86	SAT TT=24.57 T1=23.78	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K70.opb	SAT TT=51.804 T1=51.81	? (TO) TT=1800.02	No data	No data	SAT TT=128.978 T1=128.99	SAT TT=79.593 T1=79.6	SAT TT=54.1 T1=54.11	SAT TT=51.804 T1=51.81	SAT TT=399.912 T1=198.09	SAT TT=147.571 T1=146.58	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K71.opb	SAT TT=15.331 T1=14.53	? (TO) TT=1800.02	No data	No data	SAT TT=87.459 T1=87.47	SAT TT=37.757 T1=37.76	SAT TT=29.171 T1=29.17	SAT TT=28.446 T1=28.45	SAT TT=194.576 T1=96.07	SAT TT=15.331 T1=14.53	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K72.opb	SAT TT=2.768 T1=2.76	? (TO) TT=1800.09	No data	No data	SAT TT=37.308 T1=37.31	SAT TT=2.768 T1=2.76	SAT TT=42.197 T1=42.2	SAT TT=41.182 T1=41.19	SAT TT=208.252 T1=103.07	SAT TT=28.842 T1=28.04	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K73.opb	SAT TT=3.642 T1=3.64	? (TO) TT=1800.02	No data	No data	SAT TT=42.239 T1=42.24	SAT TT=3.642 T1=3.64	SAT TT=33.664 T1=33.66	SAT TT=33.083 T1=33.09	SAT TT=153.622 T1=75.62	SAT TT=21.222 T1=20.15	SAT TT=76.494 T1=76.44
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K74.opb	SAT TT=9.083 T1=9.08	SAT TT=9.083 T1=9.08	No data	No data	SAT TT=37.065 T1=37.07	SAT TT=22.562 T1=22.56	SAT TT=23.416 T1=23.42	SAT TT=23.04 T1=23.04	SAT TT=146.132 T1=71.95	SAT TT=28.181 T1=27.41	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K75.opb	SAT TT=7.403 T1=5.42	? (TO) TT=1800.02	No data	No data	SAT TT=9.199 T1=9.2	SAT TT=11.195 T1=11.19	SAT TT=39.224 T1=39.22	SAT TT=37.898 T1=37.9	SAT TT=12.406 T1=5.42	SAT TT=7.403 T1=6.62	SAT TT=172.686 T1=172.65
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K76.opb	SAT TT=0.27 T1=0.26	SAT TT=0.27 T1=0.26	No data	No data	SAT TT=3.843 T1=3.84	SAT TT=10.063 T1=10.06	SAT TT=12.688 T1=12.68	SAT TT=12.588 T1=12.58	SAT TT=86.362 T1=41.61	SAT TT=10.883 T1=10.06	SAT TT=197.97 T1=197.93
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K77.opb	SAT TT=0.345 T1=0.34	SAT TT=270.592 T1=270.63	No data	No data	SAT TT=0.345 T1=0.34	SAT TT=1.058 T1=1.13	SAT TT=2.545 T1=2.55	SAT TT=2.544 T1=2.54	SAT TT=46.497 T1=21.93	SAT TT=2.404 T1=1.65	SAT TT=61.166 T1=61.12
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K78.opb	SAT TT=1.874 T1=1.11	SAT TT=300.318 T1=300.35	No data	No data	SAT TT=13.278 T1=13.28	SAT TT=15.239 T1=15.24	SAT TT=5.436 T1=5.43	SAT TT=5.41 T1=5.49	SAT TT=8.332 T1=3.42	SAT TT=1.874 T1=1.11	SAT TT=87.321 T1=87.27
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K79.opb	SAT TT=2.655 T1=1.81	SAT TT=71.528 T1=71.53	No data	No data	SAT TT=9.013 T1=9.01	SAT TT=5.511 T1=5.5	SAT TT=4.833 T1=4.83	SAT TT=4.877 T1=4.89	SAT TT=11.182 T1=4.9	SAT TT=2.655 T1=1.81	SAT TT=19.874 T1=19.8
/DEC-SMALLINT-LIN/sroussel/ ShortestPathBA/ normalized-BeauxArts_K80.opb	SAT TT=1.229 T1=1.22	SAT TT=4.909 T1=4.9	No data	No data	SAT TT=6.162 T1=6.16	SAT TT=1.229 T1=1.22	SAT TT=6.483 T1=6.48	SAT TT=6.062 T1=6.06	SAT TT=17.28 T1=7.92	SAT TT=5.363 T1=4.57	SAT TT=11.946 T1=11.88
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K125.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.82	? (TO) TT=1800.09	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K126.opb		? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.82	? (TO) TT=1800.58	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K128.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.32	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K129.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1801.05	? (TO) TT=1800.05	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K131.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.75	? (TO) TT=1800.02	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K132.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.87	? (TO) TT=1800.08	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K133.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K138.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.74	? (TO) TT=1800.75	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K139.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.74	? (TO) TT=1800.03	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K140.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K141.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K143.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1801.09	? (TO) TT=1800.07	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K148.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.81	? (TO) TT=1800.03	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K152.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K156.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.83	? (TO) TT=1800.05	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K160.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K163.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.81	? (TO) TT=1800.06	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K164.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K167.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K168.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K175.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.68	? (TO) TT=1800.78	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K176.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.73	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K177.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.53	? (TO) TT=1800.06	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K180.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K181.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.81	? (TO) TT=1800.07	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K183.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.83	? (TO) TT=1800	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K192.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.02	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K196.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.77	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K199.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.74	? (TO) TT=1800	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/ sroussel/ ShortestPathNG/normalized-NG_K200.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.71	? (TO) TT=1800.68	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K100.opb	SAT TT=1709.75 T1=1710.01	? (TO) TT=1800.02	No data	No data	SAT TT=1709.75 T1=1710.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.09	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K101.opb	SAT TT=426.046 T1=426.1	? (TO) TT=1800.03	No data	No data	SAT TT=426.046 T1=426.1	SAT TT=947.26 T1=947.42	SAT TT=870.842 T1=870.97	SAT TT=877.155 T1=877.3	? (TO) TT=1800.76	SAT TT=811.78 T1=806.8	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K102.opb	SAT TT=549.21 T1=549.28	? (TO) TT=1800.02	No data	No data	SAT TT=790.663 T1=790.8	SAT TT=549.21 T1=549.28	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K103.opb	SAT TT=1272.62 T1=637.7	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=1272.62 T1=637.7	? (TO) TT=1800	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K104.opb	SAT TT=701.16 T1=697.17	? (TO) TT=1800.08	No data	No data	SAT TT=734.238 T1=734.36	SAT TT=1428.44 T1=1428.65	SAT TT=1133.1 T1=1133.27	SAT TT=1124.14 T1=1124.35	? (TO) TT=1800.84	SAT TT=701.16 T1=697.17	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K105.opb	SAT TT=538.724 T1=534.84	? (TO) TT=1800.02	No data	No data	SAT TT=680.062 T1=680.18	SAT TT=1687.51 T1=1687.78	SAT TT=1223.73 T1=1223.96	SAT TT=1203.65 T1=1203.83	? (TO) TT=1800.72	SAT TT=538.724 T1=534.84	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K106.opb	SAT TT=115.216 T1=115.22	? (TO) TT=1800.02	No data	No data	SAT TT=115.216 T1=115.22	SAT TT=692.761 T1=692.86	SAT TT=868.936 T1=869.07	SAT TT=896.621 T1=896.75	? (TO) TT=1800.07	SAT TT=1095.64 T1=1090.82	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K107.opb	SAT TT=332.013 T1=332.07	? (TO) TT=1800.02	No data	No data	SAT TT=332.013 T1=332.07	SAT TT=1116.15 T1=1116.31	SAT TT=419.23 T1=419.29	SAT TT=416.143 T1=416.21	SAT TT=1412.9 T1=702.4	SAT TT=727.06 T1=723.03	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K108.opb	SAT TT=251.47 T1=174.66	? (TO) TT=1800.03	No data	No data	SAT TT=526.135 T1=526.23	SAT TT=441.5 T1=441.57	SAT TT=667.298 T1=667.39	SAT TT=652.13 T1=652.22	SAT TT=353.571 T1=174.66	SAT TT=251.47 T1=250.03	? (TO) TT=1800.1
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K109.opb	SAT TT=407.01 T1=404.3	? (TO) TT=1800.02	No data	No data	SAT TT=1683.52 T1=1683.78	SAT TT=1213.87 T1=1214.05	SAT TT=1102.2 T1=1102.35	SAT TT=1080.03 T1=1080.23	? (TO) TT=1800.86	SAT TT=407.01 T1=404.3	? (TO) TT=1800.08
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K80.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.77	? (TO) TT=1800.09	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K81.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.82	? (TO) TT=1800.03	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K82.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.79	? (TO) TT=1800	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K83.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K84.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.85	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K85.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.92	? (TO) TT=1800.79	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K86.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.84	? (TO) TT=1800.08	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K87.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.78	? (TO) TT=1800.01	? (TO) TT=1800.11
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K88.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K89.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K90.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.76	? (TO) TT=1800.06	? (TO) TT=1800.14
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K91.opb	SAT TT=1411.46 T1=1404.26	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1411.46 T1=1404.26	? (TO) TT=1800.02
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K92.opb	SAT TT=1703.34 T1=1703.6	? (TO) TT=1800.02	No data	No data	SAT TT=1703.34 T1=1703.6	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1801.14	? (TO) TT=1800.75	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K93.opb	SAT TT=1776.97 T1=1777.23	? (TO) TT=1800.02	No data	No data	SAT TT=1776.97 T1=1777.23	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.83	? (TO) TT=1800.09	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K94.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.84	? (TO) TT=1800.01	? (TO) TT=1800.07
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K95.opb	SAT TT=762.18 T1=758.23	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=762.18 T1=758.23	? (TO) TT=1800.09
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K96.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K97.opb	SAT TT=1300.57 T1=1300.78	? (TO) TT=1800.03	No data	No data	SAT TT=1300.57 T1=1300.78	? (TO) TT=1800.09	SAT TT=1688.91 T1=1689.18	SAT TT=1704.08 T1=1704.32	? (TO) TT=1800.77	? (TO) TT=1800.53	? (TO) TT=1800.03
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K98.opb	SAT TT=1261.11 T1=1261.33	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1264.42 T1=1264.61	SAT TT=1261.11 T1=1261.33	? (TO) TT=1800.82	? (TO) TT=1800	? (TO) TT=1800.04
/DEC-SMALLINT-LIN/sroussel/ ShortestPathTate/ normalized-TateBritain_K99.opb	SAT TT=1231.91 T1=1232.11	? (TO) TT=1800.02	No data	No data	SAT TT=1231.91 T1=1232.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=1524.86 T1=1517.23	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-25fv47.opb	UNSAT TT=2.236	No data	No data	No data	UNSAT TT=4.47	UNSAT TT=14.381	No data	No data	UNSAT TT=3.102	UNSAT TT=2.236	? (MO) TT=144.189
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-80bau3b.opb	UNSAT TT=3.493	No data	No data	No data	UNSAT TT=3.976	UNSAT TT=4.252	No data	No data	UNSAT TT=5.089	UNSAT TT=3.493	? (MO) TT=346.877
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-adlittle.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.12	No data	No data	? (TO) TT=1800.2	? (TO) TT=1800.03	? (MO) TT=191.884
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-afiro.opb	OPT f=-11897496 TT=2.205 T1=1.25	No data	No data	No data	OPT f=-11897496 TT=123.238 T1=123.26	OPT f=-11897496 TT=518.687 T1=518.76	No data	No data	SAT (TO) f=-11730700 TT=1800.02 T1=872.55	OPT f=-11897496 TT=2.205 T1=1.25	? (MO) TT=193.699
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-agg2.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.04	? (MO) TT=194.083
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-agg3.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=166.806
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-agg.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	? (TO) TT=1801.33	? (TO) TT=1800.61	? (MO) TT=164.279
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-bandm.opb	UNSAT TT=0.923	No data	No data	No data	UNSAT TT=0.923	UNSAT TT=6.459	No data	No data	UNSAT TT=1.885	UNSAT TT=1.115	? (MO) TT=160.618
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-beaconfd.opb	UNSAT TT=1.214	No data	No data	No data	UNSAT TT=3.821	UNSAT TT=121.312	No data	No data	UNSAT TT=2.384	UNSAT TT=1.214	? (MO) TT=193
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-blend.opb	SAT f=1295806500506 TT=1800.11 T1=53.94	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	No data	SAT (TO) f=1295806500506 TT=1800.11 T1=53.94	? (TO) TT=1800.79	? (MO) TT=166.417
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-bnl1.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.73	? (TO) TT=1800.91	? (exit code) TT=186.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-bnl2.opb	UNSAT TT=2.605	No data	No data	No data	UNSAT TT=5.237	UNSAT TT=5.189	No data	No data	UNSAT TT=4.283	UNSAT TT=2.605	? (MO) TT=337.841
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-boeing1.opb	SAT f=48382442725 TT=1800.03 T1=105.4	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.18	SAT (TO) f=48382442725 TT=1800.03 T1=105.4	? (MO) TT=255.895
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-boeing2.opb		No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.06	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-bore3d.opb	UNSAT TT=0.365	No data	No data	No data	UNSAT TT=0.365	UNSAT TT=0.565	No data	No data	UNSAT TT=1.614	UNSAT TT=0.916	? (MO) TT=370.709
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-brandy.opb	UNSAT TT=0.582	No data	No data	No data	UNSAT TT=0.582	UNSAT TT=2.531	No data	No data	UNSAT TT=1.835	UNSAT TT=0.995	? (MO) TT=188.504
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-capri.opb	UNSAT TT=0.328	No data	No data	No data	UNSAT TT=0.328	UNSAT TT=1.267	No data	No data	UNSAT TT=1.544	UNSAT TT=1.016	? (MO) TT=197.082
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-cycle.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.65	? (TO) TT=1800.48	? (MO) TT=265.281
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-czprob.opb	SAT f=213520005192337 TT=1800.17 T1=497.86	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	SAT (TO) f=213520005192337 TT=1800.17 T1=497.86	? (TO) TT=1800.08	? (MO) TT=281.671
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-d2q06c.opb	UNSAT TT=4.335	No data	No data	No data	UNSAT TT=9.083	UNSAT TT=9.253	No data	No data	UNSAT TT=5.975	UNSAT TT=4.335	? (MO) TT=148.5
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-d6cube.opb		No data	No data	No data	? (TO) TT=1800.06	Signal TT=57.961	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-degen2.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800.66	? (TO) TT=1800.89	? (TO) TT=1800.04
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-degen3.opb		No data	No data	No data	? (TO) TT=1800.08	? TT=1089.96	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.55	? (TO) TT=1800.03
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-dfl001.opb		No data	No data	No data	? (MO) TT=1450.13	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.95	? (TO) TT=1800.06	? (MO) TT=169.663
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-e226.opb	UNSAT TT=0.026	No data	No data	No data	UNSAT TT=0.686	UNSAT TT=0.026	No data	No data	UNSAT TT=1.744	UNSAT TT=1.084	? (MO) TT=154.928
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-etamacro.opb	UNSAT TT=0.372	No data	No data	No data	UNSAT TT=0.372	UNSAT TT=0.393	No data	No data	UNSAT TT=1.735	UNSAT TT=1.093	? (MO) TT=193.005
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fffff800.opb	UNSAT TT=1.544	No data	No data	No data	UNSAT TT=3.125	UNSAT TT=77.002	No data	No data	UNSAT TT=2.484	UNSAT TT=1.544	? (MO) TT=184.592
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit1p.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.68	? (MO) TT=197.183
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit2d.opb		No data	No data	No data	? (TO) TT=1800.03	Signal TT=217.705	No data	No data	? (TO) TT=1800.6	? (TO) TT=1800.57	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit2p.opb		No data	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.4	? (TO) TT=1800.84	? (MO) TT=179.496
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-forplan.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.26	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.01	? (MO) TT=196.939
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ganges.opb	UNSAT TT=1.475	No data	No data	No data	UNSAT TT=1.475	UNSAT TT=2.922	No data	No data	UNSAT TT=2.403	UNSAT TT=1.674	? (MO) TT=1146.9
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-gfrd-pnc.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800	? (MO) TT=234.779
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-greenbea.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (MO) TT=170.109
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-greenbeb.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.17	? (TO) TT=1800.09	? (MO) TT=177.104
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-grow15.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.19	? (TO) TT=1800.07	? (MO) TT=206.383
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-grow22.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.08	? (MO) TT=201.386
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-grow7.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=196.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-israel.opb	SAT f=-304132519107 TT=1800.11 T1=912.95	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	No data	No data	SAT (TO) f=-294151729076 TT=1800.12 T1=279.8	SAT (TO) f=-304132519107 TT=1800.11 T1=912.95	? (MO) TT=260.594
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-kb2.opb	SAT f=0 TT=1800.01 T1=0.88	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	No data	SAT (TO) f=0 TT=1800.15 T1=0.88	SAT (TO) f=0 TT=1800.01 T1=408.29	? (MO) TT=172.373
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-lotfi.opb		No data	No data	No data	? (MO) TT=443.444	? (MO) TT=1560.66	No data	No data	? (TO) TT=1800.57	? (TO) TT=1800.07	? (MO) TT=336.069
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-maros.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.62	? (TO) TT=1800.72	? (MO) TT=187.892
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-maros-r7.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.05	? (MO) TT=189.362
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-modszk1.opb		No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.74	? (MO) TT=163.008
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-nesm.opb	UNSAT TT=2.194	No data	No data	No data	UNSAT TT=3.434	UNSAT TT=5.114	No data	No data	UNSAT TT=3.223	UNSAT TT=2.194	? (MO) TT=208.291
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-perold.opb	UNSAT TT=1.642	No data	No data	No data	UNSAT TT=1.642	UNSAT TT=1.655	No data	No data	UNSAT TT=2.284	UNSAT TT=1.784	? (MO) TT=596.223
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-pilot4.opb	UNSAT TT=1.289	No data	No data	No data	UNSAT TT=1.292	UNSAT TT=1.289	No data	No data	UNSAT TT=2.084	UNSAT TT=1.604	? (MO) TT=321.257
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-pilot87.opb	UNSAT TT=3.244	No data	No data	No data	UNSAT TT=5.782	UNSAT TT=5.721	No data	No data	UNSAT TT=4.843	UNSAT TT=3.244	? (MO) TT=355.476
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-pilot.opb	UNSAT TT=1.774	No data	No data	No data	UNSAT TT=2.285	UNSAT TT=2.261	No data	No data	UNSAT TT=2.634	UNSAT TT=1.774	? (MO) TT=185.795
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-pilot.we.opb	UNSAT TT=18.208	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	No data	UNSAT TT=18.208	? (TO) TT=1800.5	? (MO) TT=317.07
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-recipe.opb	OPT f=-136341504 TT=5.574 T1=3.98	No data	No data	No data	? (MO) TT=738.825	? (TO) TT=1800.02	No data	No data	OPT f=-136341504 TT=5.574 T1=3.98	SAT (TO) f=-136069369 TT=1800.03 T1=369.89	? (MO) TT=194.953
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc105.opb	OPT f=0 TT=1.092 T1=0.75	No data	No data	No data	OPT f=0 TT=1.092 T1=1.08	OPT f=0 TT=1333.35 T1=1333.52	No data	No data	OPT f=0 TT=16.002 T1=0.89	OPT f=0 TT=8.013 T1=0.75	? (exit code) TT=1311.79
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc205.opb	OPT f=0 TT=3.293 T1=0.86	No data	No data	No data	OPT f=0 TT=3.293 T1=3.28	? (TO) TT=1800.02	No data	No data	OPT f=0 TT=18.112 T1=0.96	OPT f=0 TT=8.593 T1=0.86	? (exit code) TT=1276.1
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc50a.opb	OPT f=-60000 TT=4.866 T1=2.75	No data	No data	No data	OPT f=-60000 TT=4.866 T1=4.86	OPT f=-60000 TT=271.767 T1=271.8	No data	No data	OPT f=-60000 TT=9.153 T1=2.75	OPT f=-60000 TT=6.561 T1=4.27	OPT f=-60000 TT=176.196 T1=174.74
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-sc50b.opb	OPT f=-70000 TT=6.963 T1=3.81	No data	No data	No data	OPT f=-70000 TT=12.521 T1=12.52	OPT f=-70000 TT=915.139 T1=915.25	No data	No data	OPT f=-70000 TT=44.849 T1=5.27	OPT f=-70000 TT=6.963 T1=3.81	OPT f=-70000 TT=1119.79 T1=1119.2
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scagr25.opb	UNSAT TT=0.475	No data	No data	No data	UNSAT TT=0.475	UNSAT TT=1.575	No data	No data	UNSAT TT=1.684	UNSAT TT=1.154	? (MO) TT=196.098
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scagr7.opb	UNSAT TT=0.117	No data	No data	No data	UNSAT TT=0.117	UNSAT TT=1.203	No data	No data	UNSAT TT=1.234	UNSAT TT=0.764	? (MO) TT=194.902
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scfxm1.opb	UNSAT TT=0.869	No data	No data	No data	UNSAT TT=0.869	UNSAT TT=189.486	No data	No data	UNSAT TT=1.974	UNSAT TT=0.955	? (MO) TT=199.899
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scfxm2.opb	UNSAT TT=1.335	No data	No data	No data	UNSAT TT=1.714	UNSAT TT=3.528	No data	No data	UNSAT TT=2.205	UNSAT TT=1.335	? (MO) TT=165.117
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-scfxm3.opb	UNSAT TT=1.513	No data	No data	No data	UNSAT TT=2.576	UNSAT TT=4.397	No data	No data	UNSAT TT=2.745	UNSAT TT=1.513	? (MO) TT=163.974
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scorpion.opb		No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800	No data	No data	? (TO) TT=1800.71	? (TO) TT=1800.07	? (MO) TT=192.893
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scrs8.opb		No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (MO) TT=231.907
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scsd1.opb		No data	No data	No data	? (MO) TT=459.488	? (MO) TT=395.161	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.07	? (MO) TT=190.743
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scsd6.opb		No data	No data	No data	? (MO) TT=461.09	? (MO) TT=402.995	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.02	? (MO) TT=170.005
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-scsd8.opb		No data	No data	No data	? (MO) TT=378.226	? (MO) TT=396.286	No data	No data	? (TO) TT=1800.8	? (TO) TT=1800.02	? (MO) TT=182.906
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sctap1.opb	SAT f=1225564623 TT=1800.86 T1=1491.29	No data	No data	No data	SAT (TO) f=33736624906 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=3448984838 TT=1800.34 T1=858.01	SAT (TO) f=1225564623 TT=1800.86 T1=1491.29	? (MO) TT=165.924
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sctap2.opb	SAT f=2807518283 TT=1800.1 T1=35.44	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	No data	SAT (TO) f=5605999579 TT=1800.18 T1=15.15	SAT (TO) f=2807518283 TT=1800.1 T1=35.44	? (MO) TT=169.867
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sctap3.opb	SAT f=14414485905 TT=1800.14 T1=318.1	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	No data	No data	SAT (TO) f=14414485905 TT=1800.14 T1=318.1	No Cert. TT=1800.07	? (MO) TT=170.016
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-seba.opb		No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800	? (TO) TT=1800.04	? (MO) TT=195.203
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-share1b.opb	UNSAT TT=0.397	No data	No data	No data	UNSAT TT=0.397	UNSAT TT=1.617	No data	No data	UNSAT TT=1.645	UNSAT TT=0.855	? (MO) TT=182.603
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-share2b.opb	SAT f=-39584070 TT=1800.07 T1=19.5	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	No data	SAT (TO) f=-39584070 TT=1800.07 T1=19.5	? (TO) TT=1800.52	? (MO) TT=206.62
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-shell.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800	? (MO) TT=358.359
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship04l.opb	UNSAT TT=1.005	No data	No data	No data	UNSAT TT=3.496	UNSAT TT=4.912	No data	No data	UNSAT TT=2.335	UNSAT TT=1.653	UNSAT TT=1.005
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship04s.opb	UNSAT TT=0.495	No data	No data	No data	UNSAT TT=1.52	UNSAT TT=0.495	No data	No data	UNSAT TT=1.065	UNSAT TT=0.934	UNSAT TT=0.706
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship08l.opb	UNSAT TT=1.994	No data	No data	No data	UNSAT TT=6.394	UNSAT TT=7.687	No data	No data	UNSAT TT=3.481	UNSAT TT=2.354	UNSAT TT=1.994
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship08s.opb	UNSAT TT=0.683	No data	No data	No data	UNSAT TT=3.276	UNSAT TT=0.683	No data	No data	UNSAT TT=3.125	UNSAT TT=1.774	UNSAT TT=1.114
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship12l.opb	UNSAT TT=1.913	No data	No data	No data	UNSAT TT=7.062	UNSAT TT=2.916	No data	No data	UNSAT TT=2.213	UNSAT TT=1.913	UNSAT TT=2.602
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-ship12s.opb	UNSAT TT=1.306	No data	No data	No data	UNSAT TT=3.124	UNSAT TT=1.492	No data	No data	UNSAT TT=2.054	UNSAT TT=1.333	UNSAT TT=1.306
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-sierra.opb	UNSAT TT=1.208	No data	No data	No data	UNSAT TT=14.206	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.42	UNSAT TT=1.208
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-stair.opb	UNSAT TT=13.361	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	No data	No data	UNSAT TT=13.361	UNSAT TT=26.691	? (MO) TT=172.737
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-standata.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.37	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=444.794
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-standgub.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.34	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=446.986
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-stocfor1.opb	UNSAT TT=0.103	No data	No data	No data	UNSAT TT=0.103	UNSAT TT=0.12	No data	No data	UNSAT TT=1.404	UNSAT TT=0.724	? (MO) TT=176.654
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-stocfor2.opb	UNSAT TT=1.913	No data	No data	No data	UNSAT TT=2.352	UNSAT TT=2.316	No data	No data	UNSAT TT=3.084	UNSAT TT=1.913	? (MO) TT=198.931
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-tuff.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.44	? (TO) TT=1800.12	? (MO) TT=157.124
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-vtp.base.opb		No data	No data	No data	? (MO) TT=776.014	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.69	? (TO) TT=1800.05	? (MO) TT=196.492
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/ data/normalized-mps-v2-20-10-wood1p.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (MO) TT=181.392
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-woodw.opb	UNSAT TT=5.532	No data	No data	No data	UNSAT TT=26.079	UNSAT TT=67.007	No data	No data	UNSAT TT=12.113	UNSAT TT=5.532	? (MO) TT=168.59
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-a1c1s1.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.13
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-arki001.opb	UNSAT TT=2.744	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	No data	UNSAT TT=2.744	? (TO) TT=1800.06	? (MO) TT=284.488
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-atlanta-ip.opb	SAT f=12001901559546 TT=1800.65 T1=62.77	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	No data	SAT (TO) f=15602490537890 TT=1800.08 T1=10.03	SAT (TO) f=12001901559546 TT=1800.65 T1=62.77	? (TO) TT=1800.18
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-dano3mip.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.34
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-danoint.opb		No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/ miplib2003/normalized-mps-v2-20-10-ds.opb	SAT f=510229 TT=1802.32 T1=75.4	No data	No data	No data	SAT (TO) f=696935 TT=1800.4 T1=1800.3	SAT (MO) f=2121867 TT=316.051 T1=315.41	No data	No data	SAT (TO) f=510229 TT=1802.32 T1=75.4	No Cert. TT=1802.82	? (TO) TT=1800.31
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-fiber.opb	SAT f=46355055 TT=1800.16 T1=1800.4	No data	No data	No data	SAT (TO) f=1988425470 TT=1800.03 T1=1800.3	SAT (TO) f=46355055 TT=1800.16 T1=1800.4	No data	No data	SAT (TO) f=64801527 TT=1800.19 T1=18.96	SAT (TO) f=62541951 TT=1800.06 T1=135.52	? (TO) TT=1800.65
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-fixnet6.opb	SAT f=9743222 TT=1800.08 T1=5.72	No data	No data	No data	SAT (TO) f=97165505 TT=1800.1 T1=1800.4	? (TO) TT=1800.07	No data	No data	SAT (TO) f=36078890 TT=1800.19 T1=14.09	SAT (TO) f=9743222 TT=1800.08 T1=5.72	? (TO) TT=1800.46
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-gesa2-o.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	? (MO) TT=206.276
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-gesa2.opb	SAT f=4538154438494 TT=1800.08 T1=133.61	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	No data	No data	SAT (TO) f=4687399224674 TT=1800.02 T1=3.13	SAT (TO) f=4538154438494 TT=1800.08 T1=133.61	? (MO) TT=166.246
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-glass4.opb	OPT f=1228810444800 TT=6.642 T1=5.29	No data	No data	No data	? (MO) TT=437.358	? (TO) TT=1800.1	No data	No data	SAT (TO) f=1245192525829 TT=1800.87 T1=41.13	OPT f=1228810444800 TT=6.642 T1=5.29	? (MO) TT=211.588
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-harp2.opb	SAT f=-65132348 TT=1800.16 T1=6.32	No data	No data	No data	? (TO) TT=1800.03	SAT (TO) f=-50338467 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=-65132348 TT=1800.16 T1=6.32	SAT (TO) f=-52047497 TT=1800.89 T1=0.52	? (MO) TT=247.758
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-liu.opb	SAT f=1440416 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=1440416 TT=1800.08 T1=1800.4	? (TO) TT=1800.01	No data	No data	SAT (TO) f=2752511 TT=1800.19 T1=162.24	SAT (TO) f=4980735 TT=1800.05 T1=95.57	? (MO) TT=327.457
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-markshare1.opb	SAT f=14336 TT=1800.06 T1=694.07	No data	No data	No data	SAT (TO) f=45056 TT=1800.02 T1=1800.3	SAT (TO) f=21504 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=14336 TT=1800.06 T1=694.07	SAT (TO) f=23552 TT=1800.67 T1=1322	? (TO) TT=1800.03
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-markshare2.opb	SAT f=77824 TT=1800.06 T1=581.6	No data	No data	No data	SAT (TO) f=98304 TT=1800.02 T1=1800.3	SAT (TO) f=104448 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=82944 TT=1800.55 T1=411.79	SAT (TO) f=77824 TT=1800.06 T1=581.6	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mas74.opb	SAT f=52428797515 TT=1800.68 T1=338.84	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	No data	No data	SAT (TO) f=52428797515 TT=1800.68 T1=338.84	? (TO) TT=1800.02	? (MO) TT=264.359
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mas76.opb	SAT f=209715197291 TT=1800.03 T1=6.23	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	No data	SAT (TO) f=209715197291 TT=1800.03 T1=6.23	? (TO) TT=1800.04	? (MO) TT=243.977
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-misc07.opb	OPT f=1076618240 TT=108 T1=3.3	No data	No data	No data	SAT (TO) f=1076618240 TT=1800.02 T1=1800.3	SAT (TO) f=1076618240 TT=1800.03 T1=1800.3	No data	No data	OPT f=1076618240 TT=506.648 T1=3.3	OPT f=1076618240 TT=108 T1=23.86	? (exit code) TT=177.729
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mkc.opb	SAT f=-151625 TT=1800.06 T1=1800.3	No data	No data	No data	SAT (TO) f=-151625 TT=1800.06 T1=1800.3	SAT (TO) f=-70125 TT=1800.19 T1=1800.5	No data	No data	SAT (TO) f=-126875 TT=1800.92 T1=0.93	SAT (TO) f=-126750 TT=1800.83 T1=402.57	? (MO) TT=265.261
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mod011.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	? (TO) TT=1801.17	? (TO) TT=1800.09	? (MO) TT=204.908
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-modglob.opb		No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.17	No data	No data	? (TO) TT=1800.17	? (TO) TT=1800.03	? (MO) TT=184.435
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-momentum1.opb	UNSAT TT=2.712	No data	No data	No data	UNSAT TT=2.925	UNSAT TT=2.901	No data	No data	UNSAT TT=3.905	UNSAT TT=2.712	? (MO) TT=239.495
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-momentum2.opb	UNSAT TT=1.179	No data	No data	No data	UNSAT TT=23.6	UNSAT TT=1.179	No data	No data	UNSAT TT=13.122	UNSAT TT=10.099	? (exit code) TT=870.51
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-momentum3.opb	SAT f=10752000000 TT=1800.03 T1=112.78	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.16	No data	No data	SAT (TO) f=10752000000 TT=1800.03 T1=112.78	SAT (TO) f=11370576184 TT=1800.8 T1=34.57	? (MO) TT=256.978
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-msc98-ip.opb	SAT f=2634797100956844820 TT=1800.17 T1=697.23	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	No data	SAT (TO) f=2634797100956844820 TT=1800.17 T1=697.23	SAT (TO) f=2722140601278347731 TT=1800.77 T1=2.83	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-noswot.opb	OPT f=-41 TT=6.392 T1=0.43	No data	No data	No data	OPT f=-41 TT=6.392 T1=6.39	OPT f=-41 TT=100.436 T1=100.44	No data	No data	OPT f=-41 TT=430.568 T1=1.83	OPT f=-41 TT=154.51 T1=0.43	OPT f=-41 TT=985.062 T1=985.39
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-nsrand-ipx.opb	SAT f=1241512960 TT=1800.18 T1=1800.5	No data	No data	No data	SAT (TO) f=1853685760 TT=1800.05 T1=1800.4	SAT (TO) f=1241512960 TT=1800.18 T1=1800.5	No data	No data	SAT (TO) f=1614804990 TT=1800.12 T1=899.64	SAT (TO) f=1346895871 TT=1801.45 T1=863.14	? (MO) TT=188.183
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-pk1.opb	SAT f=57344 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=57344 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-pp08aCUTS.opb	SAT f=24854395555 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=24854395555 TT=1800.09 T1=1800.4	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? (MO) TT=142.72
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-pp08a.opb	SAT f=10946196156 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=10946196156 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.05	? (MO) TT=145.453
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-qiu.opb	UNSAT TT=0.312	No data	No data	No data	UNSAT TT=1.571	UNSAT TT=154.594	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.312
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-rd-rplusc-21.opb	UNSAT TT=19.62	No data	No data	No data	UNSAT TT=72.545	UNSAT TT=71.751	No data	No data	UNSAT TT=31.86	UNSAT TT=19.62	? (MO) TT=241.851
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-roll3000.opb	SAT f=1095891440 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=1095891440 TT=1800.01 T1=1800.3	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.16	SAT (TO) f=1113587711 TT=1800.08 T1=409.91	? (MO) TT=147.241
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-rout.opb	SAT f=1075039488 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=1075039488 TT=1800.1 T1=1800.4	SAT (TO) f=1075496960 TT=1800.09 T1=1800.5	No data	No data	SAT (TO) f=1075130624 TT=1800.1 T1=766.37	SAT (TO) f=1075083776 TT=1800.95 T1=1153.38	? (MO) TT=245.805
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-set1ch.opb	SAT f=359960590 TT=1800.08 T1=1.17	No data	No data	No data	SAT (TO) f=5788941750 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=365047649 TT=1800.04 T1=1.67	SAT (TO) f=359960590 TT=1800.08 T1=1.17	? (MO) TT=279.864
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-sp97ar.opb	SAT f=43815878113 TT=1800 T1=168.92	No data	No data	No data	SAT (TO) f=503555543330 TT=1800.06 T1=1800.3	SAT (TO) f=102428565298 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=43815878113 TT=1800 T1=168.92	No Cert. TT=1800.94	? (MO) TT=230.764
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-stp3d.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-swath.opb		No data	No data	No data	? (MO) TT=390.661	? (MO) TT=333.254	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.01	? (MO) TT=220.988
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-timtab1.opb	UNSAT TT=1.032	No data	No data	No data	UNSAT TT=1.032	UNSAT TT=328.034	No data	No data	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=2.399
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-timtab2.opb	SAT f=180707374499942795 TT=1800.75 T1=0.93	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	No data	SAT (TO) f=191804917299898631 TT=1801.01 T1=1.94	SAT (TO) f=180707374499942795 TT=1800.75 T1=0.93	? (MO) TT=632.868
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-tr12-30.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.87	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-van.opb	SAT f=24193312742 TT=1800.13 T1=112.14	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	No data	SAT (TO) f=24193312742 TT=1800.13 T1=112.14	SAT (TO) f=25442247019 TT=1800.92 T1=14.49	? (TO) TT=1800.6
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-blend2.opb	SAT f=160502828 TT=1800.07 T1=901.32	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.18	SAT (TO) f=160502828 TT=1800.07 T1=901.32	? (MO) TT=325.872
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-gesa3_o.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.67	? (MO) TT=186.484
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-gesa3.opb	SAT f=4865649697229 TT=1800.05 T1=2.13	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	No data	SAT (TO) f=4865953557383 TT=1800.04 T1=3.72	SAT (TO) f=4865649697229 TT=1800.05 T1=2.13	? (MO) TT=176.594
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-qnet1_o.opb	UNSAT TT=0.859	No data	No data	No data	UNSAT TT=0.859	UNSAT TT=495.553	No data	No data	UNSAT TT=2.445	UNSAT TT=1.205	? (MO) TT=261
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-qnet1.opb	UNSAT TT=0.881	No data	No data	No data	UNSAT TT=0.881	UNSAT TT=496.575	No data	No data	UNSAT TT=2.564	UNSAT TT=1.205	? (MO) TT=252.105
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell3a.opb	SAT f=139474892366875 TT=1800.07 T1=846.23	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	No data	No data	SAT (TO) f=139474892366875 TT=1800.07 T1=846.23	SAT (TO) f=141211004331900 TT=1800 T1=1417.9	? (MO) TT=183.397
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell3b.opb	SAT f=1323375948476250 TT=1800.75 T1=16.85	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	SAT (TO) f=1323375948476250 TT=1800.75 T1=16.85	SAT (TO) f=1391388940707500 TT=1800.02 T1=0.5	? (MO) TT=185.208
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell4.opb	SAT f=195203118275530 TT=1800.08 T1=13.29	No data	No data	No data	SAT (TO) f=1809895699004031 TT=1800.03 T1=1800.3	? (TO) TT=1800.02	No data	No data	SAT (TO) f=196895269604964 TT=1800.08 T1=373.99	SAT (TO) f=195203118275530 TT=1800.08 T1=13.29	? (MO) TT=176.677
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bell5.opb	SAT f=948234148331060 TT=1800.01 T1=5.86	No data	No data	No data	SAT (TO) f=4378916459574992 TT=1800.02 T1=1800.3	SAT (TO) f=9076326695683005 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=952645238310140 TT=1800.07 T1=368.54	SAT (TO) f=948234148331060 TT=1800.01 T1=5.86	? (MO) TT=213.78
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-dcmulti.opb	SAT f=3596062786 TT=1800.1 T1=1800.4	No data	No data	No data	? (TO) TT=1800.03	SAT (TO) f=3596062786 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=3660031644 TT=1800.85 T1=60.29	? (TO) TT=1800.08	? (MO) TT=137.889
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-egout.opb	OPT f=471047168 TT=18.611 T1=14.93	No data	No data	No data	OPT f=471047168 TT=244.896 T1=244.91	OPT f=471047168 TT=253.618 T1=253.58	No data	No data	OPT f=471047168 TT=55.726 T1=26.34	OPT f=471047168 TT=18.611 T1=14.93	? (MO) TT=373.646
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-fixnet3.opb	SAT f=208952688 TT=1800.01 T1=19.53	No data	No data	No data	SAT (TO) f=677887696 TT=1800.08 T1=1800.4	? (TO) TT=1800.06	No data	No data	SAT (TO) f=226802612 TT=1800.15 T1=14.12	SAT (TO) f=208952688 TT=1800.01 T1=19.53	? (TO) TT=1800.64
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-fixnet4.opb	SAT f=36559396 TT=1800.11 T1=2.1	No data	No data	No data	SAT (TO) f=150845990 TT=1800.1 T1=1800.4	? (TO) TT=1800.04	No data	No data	SAT (TO) f=36559396 TT=1800.11 T1=2.1	SAT (TO) f=40429688 TT=1800 T1=617.6	? (TO) TT=1800.54
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-flugpl.opb	OPT f=14745600 TT=0.524 T1=0.26	No data	No data	No data	OPT f=14745600 TT=5.147 T1=5.14	OPT f=14745600 TT=28.516 T1=28.51	No data	No data	OPT f=14745600 TT=1.134 T1=3.68	OPT f=14745600 TT=0.524 T1=0.26	OPT f=14745600 TT=441.097 T1=437.99
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-gen.opb	SAT f=62368424818434 TT=1801.05 T1=1.8	No data	No data	No data	? (TO) TT=1800.03	SAT (TO) f=71949883380915 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=62665484800045 TT=1800.06 T1=22.77	SAT (TO) f=62368424818434 TT=1801.05 T1=1.8	? (exit code) TT=143.685
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-khb05250.opb	SAT f=201130104438 TT=1800.11 T1=298.01	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	No data	SAT (TO) f=201130104438 TT=1800.11 T1=298.01	SAT (TO) f=312907105424 TT=1800.07 T1=12.5	? (MO) TT=272.364
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc01.opb	OPT f=1074317824 TT=0.393 T1=0.39	No data	No data	No data	OPT f=1074317824 TT=0.393 T1=0.39	OPT f=1074317824 TT=165.17 T1=165.19	No data	No data	OPT f=1074317824 TT=2.233 T1=2.16	OPT f=1074317824 TT=0.845 T1=0.43	? (MO) TT=147.731
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc02.opb	OPT f=1075471360 TT=0.623 T1=0.32	No data	No data	No data	OPT f=1075471360 TT=1.268 T1=1.26	OPT f=1075471360 TT=156.198 T1=156.21	No data	No data	OPT f=1075471360 TT=1.354 T1=2.15	OPT f=1075471360 TT=0.623 T1=0.32	? (MO) TT=173.797
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc03.opb	OPT f=1077181440 TT=2.534 T1=0.96	No data	No data	No data	OPT f=1077181440 TT=10.41 T1=10.41	OPT f=1077181440 TT=707.974 T1=708.11	No data	No data	OPT f=1077181440 TT=7.022 T1=3.7	OPT f=1077181440 TT=2.534 T1=0.96	? (MO) TT=175.851
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc04.opb		No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (MO) TT=182.806
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc05.opb	OPT f=1076796928 TT=48.27 T1=2.2	No data	No data	No data	OPT f=1076796928 TT=48.27 T1=48.27	SAT (TO) f=1076796928 TT=1800.01 T1=1800.3	No data	No data	OPT f=1076796928 TT=298.642 T1=13.4	OPT f=1076796928 TT=111.81 T1=2.2	? (MO) TT=146.841
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-misc06.opb		No data	No data	No data	? (MO) TT=706.238	? (TO) TT=1800.01	No data	No data	? (TO) TT=1801.45	? (TO) TT=1800.05	? (MO) TT=1392.25
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-mod013.opb	SAT f=32134720 TT=1800.09 T1=971.24	No data	No data	No data	SAT (TO) f=47984050 TT=1800.02 T1=1800.3	SAT (TO) f=37316170 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=32248804 TT=1800.09 T1=657.05	SAT (TO) f=32134720 TT=1800.09 T1=971.24	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-rgn.opb	SAT f=680450 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=680450 TT=1800.01 T1=1800.3	SAT (TO) f=741568 TT=1800.1 T1=1800.4	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-sample2.opb	OPT f=384000 TT=1.556 T1=0.35	No data	No data	No data	OPT f=384000 TT=4.773 T1=4.82	OPT f=384000 TT=30.849 T1=30.83	No data	No data	OPT f=384000 TT=3.892 T1=2.28	OPT f=384000 TT=1.556 T1=0.35	OPT f=384000 TT=558.247 T1=360.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-set1al.opb	SAT f=264221696 TT=1800.04 T1=418.06	No data	No data	No data	SAT (TO) f=24467753325 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=264221696 TT=1800.04 T1=418.06	SAT (TO) f=394563828 TT=1800.58 T1=1295.76	? (MO) TT=172.694
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-set1cl.opb	SAT f=27659262 TT=1801.16 T1=219.72	No data	No data	No data	SAT (TO) f=8251669264 TT=1800.11 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=27659262 TT=1801.16 T1=219.72	SAT (TO) f=27659264 TT=1800.03 T1=0.77	? (MO) TT=170.877
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-bal8x12.opb	SAT f=89417487 TT=1800.02 T1=1340.56	No data	No data	No data	SAT (TO) f=129514680 TT=1800.03 T1=1800.3	SAT (TO) f=118176232 TT=1800.06 T1=1800.4	No data	No data	SAT (TO) f=101131486 TT=1800.06 T1=558.41	SAT (TO) f=89417487 TT=1800.02 T1=1340.56	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-bk4x3.opb	OPT f=358400 TT=1.234 T1=0.52	No data	No data	No data	OPT f=358400 TT=2.296 T1=2.29	OPT f=358400 TT=14.976 T1=14.97	No data	No data	OPT f=358400 TT=3.632 T1=7.21	OPT f=358400 TT=1.234 T1=0.52	OPT f=358400 TT=26.654 T1=16.01
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-gr4x6.opb	OPT f=20720640 TT=47.99 T1=8.75	No data	No data	No data	OPT f=20720640 TT=435.922 T1=435.99	OPT f=20720640 TT=645.649 T1=645.72	No data	No data	OPT f=20720640 TT=110.206 T1=8.75	OPT f=20720640 TT=47.99 T1=9.95	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3700.opb	SAT f=2238939201 TT=1800.79 T1=82.84	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	No data	SAT (TO) f=2238939201 TT=1800.79 T1=82.84	No Cert. TT=1800.02	? (MO) TT=148.61
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3701.opb	SAT f=9027581973 TT=1800.19 T1=264.2	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	No data	No data	SAT (TO) f=9027581973 TT=1800.19 T1=264.2	? (TO) TT=1800.08	? (MO) TT=152.61
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3702.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	No data	No data	? (TO) TT=1800.54	? (TO) TT=1800.02	? (MO) TT=170.518
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3703.opb		No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800.02	No Cert. TT=1800.09	? (MO) TT=168.104
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3704.opb	SAT f=14059485952 TT=1800.11 T1=19.82	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	No data	SAT (TO) f=39635092687 TT=1800.06 T1=337.76	SAT (TO) f=14059485952 TT=1800.11 T1=19.82	? (MO) TT=206.38
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3705.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800.08	No Cert. TT=1800.07	? (MO) TT=151.518
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3706.opb		No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.76	? (TO) TT=1800.67	? (MO) TT=217.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3707.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.95	? (TO) TT=1800.06	? (MO) TT=172.82
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3708.opb	SAT f=6829346271 TT=1800.11 T1=20.51	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.78	SAT (TO) f=6829346271 TT=1800.11 T1=20.51	? (MO) TT=163.898
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n3709.opb	SAT f=7426019560 TT=1800.86 T1=195.42	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	No data	SAT (TO) f=7426019560 TT=1800.86 T1=195.42	SAT (TO) f=22023076789 TT=1800.03 T1=7.76	? (MO) TT=147.311
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370a.opb	SAT f=45168146369 TT=1800.09 T1=40.41	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.02	SAT (TO) f=45168146369 TT=1800.09 T1=40.41	? (MO) TT=174.477
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370b.opb	SAT f=7550768122 TT=1800.81 T1=240	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	No data	SAT (TO) f=7550768122 TT=1800.81 T1=240	? (TO) TT=1800.04	? (MO) TT=170.618
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370c.opb	SAT f=31665295757 TT=1800.75 T1=64.92	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	No data	SAT (TO) f=31665295757 TT=1800.75 T1=64.92	No Cert. TT=1800.01	? (MO) TT=208.925
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-n370e.opb	SAT f=9488653097 TT=1800.75 T1=484.09	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	No data	No data	SAT (TO) f=9488653097 TT=1800.75 T1=484.09	SAT (TO) f=10682457713 TT=1800.11 T1=5.53	? (MO) TT=185.178
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x10a.opb	SAT f=1751040 TT=1800.12 T1=4.92	No data	No data	No data	SAT (TO) f=6371081 TT=1800.11 T1=1800.4	SAT (TO) f=2896117 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=1751040 TT=1800.12 T1=4.92	SAT (TO) f=1817600 TT=1800.92 T1=0.46	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x10b.opb	SAT f=3729408 TT=1800.74 T1=12.91	No data	No data	No data	SAT (TO) f=12043056 TT=1800.09 T1=1800.4	SAT (TO) f=4587520 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=3729408 TT=1800.74 T1=12.91	SAT (TO) f=4058112 TT=1800.02 T1=1220.13	? (TO) TT=1800.24
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x10c.opb	SAT f=14235648 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=36642183 TT=1800.02 T1=1800.3	SAT (TO) f=14235648 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=14885888 TT=1800.06 T1=1.9	SAT (TO) f=14941184 TT=1800.06 T1=0.65	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x12.opb	SAT f=3190784 TT=1800.04 T1=14.44	No data	No data	No data	SAT (TO) f=12335330 TT=1800.08 T1=1800.4	SAT (TO) f=6149632 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=3190784 TT=1800.04 T1=14.44	SAT (TO) f=3336192 TT=1800.05 T1=0.46	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran10x26.opb	SAT f=7368522 TT=1801 T1=13.1	No data	No data	No data	SAT (TO) f=26115102 TT=1800.09 T1=1800.4	? (TO) TT=1800.08	No data	No data	SAT (TO) f=7368522 TT=1801 T1=13.1	SAT (TO) f=8377029 TT=1800.06 T1=401.56	? (TO) TT=1800.01
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran12x12.opb	SAT f=3356672 TT=1801.14 T1=974.57	No data	No data	No data	SAT (TO) f=11235083 TT=1800.02 T1=1800.3	SAT (TO) f=4534295 TT=1800.06 T1=1800.4	No data	No data	SAT (TO) f=3364819 TT=1800.12 T1=530.39	SAT (TO) f=3356672 TT=1801.14 T1=974.57	? (TO) TT=1800.24
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran12x21.opb	SAT f=5928600 TT=1800 T1=1.16	No data	No data	No data	SAT (TO) f=27459536 TT=1800.11 T1=1800.4	SAT (TO) f=42660557 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=10399243 TT=1800.18 T1=2.55	SAT (TO) f=5928600 TT=1800 T1=1.16	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran13x13.opb	SAT f=3535872 TT=1800.11 T1=7.48	No data	No data	No data	SAT (TO) f=21398565 TT=1800.02 T1=1800.3	SAT (TO) f=6450176 TT=1800.02 T1=1800.4	No data	No data	SAT (TO) f=3535872 TT=1800.11 T1=7.48	SAT (TO) f=3538944 TT=1800.06 T1=0.56	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran14x18.opb	SAT f=5179385 TT=1800.03 T1=0.66	No data	No data	No data	SAT (TO) f=27691103 TT=1800.01 T1=1800.3	SAT (TO) f=20763678 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=6923632 TT=1800.13 T1=290.32	SAT (TO) f=5179385 TT=1800.03 T1=0.66	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran16x16.opb	SAT f=6150263 TT=1800.15 T1=3.04	No data	No data	No data	SAT (TO) f=27745668 TT=1800.02 T1=1800.3	SAT (TO) f=11140096 TT=1800.12 T1=1800.4	No data	No data	SAT (TO) f=6150263 TT=1800.15 T1=3.04	SAT (TO) f=7103471 TT=1800.8 T1=0.65	? (TO) TT=1800.5
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/fctp/ normalized-mps-v2-20-10-ran17x17.opb	SAT f=2026924 TT=1800.82 T1=5.65	No data	No data	No data	SAT (TO) f=11370769 TT=1800.01 T1=1800.3	SAT (TO) f=17691962 TT=1800.04 T1=1800.4	No data	No data	SAT (TO) f=2026924 TT=1800.82 T1=5.65	SAT (TO) f=2078184 TT=1800.88 T1=144.14	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-ran4x64.opb	SAT f=11342833 TT=1800.9 T1=7.06	No data	No data	No data	SAT (TO) f=33299168 TT=1800.1 T1=1800.4	? (TO) TT=1800.07	No data	No data	SAT (TO) f=11342833 TT=1800.9 T1=7.06	SAT (TO) f=13269674 TT=1800.88 T1=572.34	? (TO) TT=1800.17
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-ran6x43.opb	SAT f=8534594 TT=1801.03 T1=1489.32	No data	No data	No data	SAT (TO) f=29401440 TT=1800.1 T1=1800.4	? (TO) TT=1800.08	No data	No data	SAT (TO) f=8721582 TT=1800.86 T1=4.01	SAT (TO) f=8534594 TT=1801.03 T1=1489.32	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ fctp/normalized-mps-v2-20-10-ran8x32.opb	SAT f=6634496 TT=1800.76 T1=2.03	No data	No data	No data	SAT (TO) f=25818716 TT=1800.08 T1=1800.4	SAT (TO) f=46848304 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=6634496 TT=1800.76 T1=2.03	SAT (TO) f=7730166 TT=1800 T1=0.7	? (TO) TT=1800.04
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-mps-v2-20-10-fome11.opb		No data	No data	No data	? (MO) TT=1460.18	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.08	? (MO) TT=174.266
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-mps-v2-20-10-fome12.opb		No data	No data	No data	? (MO) TT=1363.62	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.89	? (TO) TT=1800.61	? (MO) TT=160.106
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-mps-v2-20-10-fome13.opb		No data	No data	No data	? (MO) TT=1260.09	? (TO) TT=1800.12	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=167.496
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-bc1.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	? (MO) TT=909.4
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-bienst1.opb	SAT f=425982 TT=1800.69 T1=4.33	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	? (TO) TT=1801.63	SAT (TO) f=425982 TT=1800.69 T1=4.33	? (TO) TT=1800.07
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-bienst2.opb	SAT f=221115 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=221115 TT=1800.06 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=67157967 TT=1800.67 T1=503.12	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-dano3_3.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.69	? (TO) TT=1800.38
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-dano3_4.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.48
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-dano3_5.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.19	? (TO) TT=1800.04	? (MO) TT=214.045
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-markshare1_1.opb	SAT f=289 TT=1800.03 T1=1683.37	No data	No data	No data	SAT (TO) f=60316 TT=1800.02 T1=1800.3	SAT (TO) f=8201 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=2513 TT=1800.19 T1=1027.54	SAT (TO) f=289 TT=1800.03 T1=1683.37	? (TO) TT=1800.02
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-markshare2_1.opb	SAT f=42160 TT=1800.72 T1=1772.65	No data	No data	No data	SAT (TO) f=101636 TT=1800.03 T1=1800.3	SAT (TO) f=197415 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=69431 TT=1800.1 T1=236.83	SAT (TO) f=42160 TT=1800.72 T1=1772.65	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-mkc1.opb		No data	No data	No data	? (TO) TT=1800.02	? (MO) TT=407.129	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.55
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos11.opb	OPT f=9216 TT=113.536 T1=57.17	No data	No data	No data	OPT f=9216 TT=194.346 T1=194.36	OPT f=9216 TT=532.807 T1=532.72	No data	No data	OPT f=9216 TT=1051.13 T1=671.15	OPT f=9216 TT=113.536 T1=57.17	? (MO) TT=157.186
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos12.opb	SAT f=26624 TT=1800.71 T1=5.16	No data	No data	No data	SAT (TO) f=34353 TT=1800.12 T1=1800.4	SAT (TO) f=15498240 TT=1800.13 T1=1800.4	No data	No data	SAT (TO) f=26624 TT=1800.71 T1=5.16	SAT (TO) f=37888 TT=1800.01 T1=10.09	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos13.opb	SAT f=-89895551 TT=1800.13 T1=796.85	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	No data	SAT (TO) f=-89895551 TT=1800.13 T1=796.85	? (TO) TT=1800.79	? (MO) TT=223.111
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos14.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.7	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos15.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.81	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos17.opb	SAT f=7624084 TT=1800.06 T1=833.51	No data	No data	No data	SAT (TO) f=37541475 TT=1800.07 T1=1800.4	SAT (TO) f=8982745 TT=1800.16 T1=1800.5	No data	No data	SAT (TO) f=7624084 TT=1800.06 T1=833.51	SAT (TO) f=11782665 TT=1800.01 T1=152.9	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos20.opb	OPT f=-468992 TT=1.125 T1=0.68	No data	No data	No data	OPT f=-468992 TT=1.125 T1=1.12	OPT f=-468992 TT=84.59 T1=84.57	No data	No data	OPT f=-468992 TT=5.241 T1=3.53	OPT f=-468992 TT=2.294 T1=0.68	? (MO) TT=176.777
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos2.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	? (MO) TT=219.63
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos3.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.62	? (TO) TT=1800.06	? (MO) TT=253.582
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos6.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos7.opb	SAT f=2065813981 TT=1800.76 T1=2.27	No data	No data	No data	SAT (TO) f=37099416576 TT=1800.11 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=2065813981 TT=1800.76 T1=2.27	SAT (TO) f=8143574276 TT=1800.09 T1=2.49	? (MO) TT=253.799
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-nug08.opb	OPT f=107 TT=33.569 T1=1.66	No data	No data	No data	OPT f=107 TT=105.253 T1=105.25	OPT f=107 TT=45.732 T1=45.74	No data	No data	OPT f=107 TT=80.361 T1=3.24	OPT f=107 TT=33.569 T1=1.66	OPT f=107 TT=461.439 T1=87.92
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-qap10.opb	SAT f=170 TT=1800.08 T1=9.9	No data	No data	No data	SAT (TO) f=175 TT=1800.06 T1=1800.4	SAT (TO) f=189 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=170 TT=1800.08 T1=9.9	No Cert. TT=1800.04	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-swath1.opb		No data	No data	No data	? (MO) TT=397.662	? (MO) TT=430.681	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.56	? (MO) TT=235.006
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-swath2.opb		No data	No data	No data	? (MO) TT=373.952	? (MO) TT=430.19	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	? (MO) TT=224.101
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-swath3.opb		No data	No data	No data	? (MO) TT=378.552	? (MO) TT=410.252	No data	No data	? (TO) TT=1800.6	? (TO) TT=1800.63	? (TO) TT=1800.06
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-A1C1S1.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-A2C1S1.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.09
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-B1C1S1.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	No data	? (TO) TT=1801.02	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-B2C1S1.opb		No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800	? (TO) TT=1801.02	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-berlin_5_8_0.opb	SAT f=63488 TT=1800.03 T1=9.16	No data	No data	No data	SAT (TO) f=63488 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=63488 TT=1800.63 T1=9.16	SAT (TO) f=63488 TT=1800.03 T1=45.65	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-bg512142.opb	SAT f=17475927381996 TT=1800.08 T1=15.73	No data	No data	No data	SAT (TO) f=75259706734831 TT=1800.04 T1=1800.4	? (TO) TT=1800.1	No data	No data	SAT (TO) f=17475927381996 TT=1800.08 T1=15.73	? (TO) TT=1800.07	? (MO) TT=265.383
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-biella1.opb		No data	No data	No data	? (TO) TT=1800.02	? (MO) TT=1624.49	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (MO) TT=457.375
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ar98.opb		No data	No data	No data	? (MO) TT=391.45	? (MO) TT=371.935	No data	No data	? (TO) TT=1800.68	? (TO) TT=1800.07	? (MO) TT=257.795
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ic97.opb		No data	No data	No data	? (MO) TT=395.255	? (MO) TT=343.224	No data	No data	? (TO) TT=1800.54	? (TO) TT=1800.59	? (exit code) TT=350.794
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ic98.opb		No data	No data	No data	? (MO) TT=406.157	? (MO) TT=346.204	No data	No data	? (TO) TT=1800.6	? (TO) TT=1800.53	? (MO) TT=499.455
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-blp-ir98.opb		No data	No data	No data	? (MO) TT=377.164	? (MO) TT=345.796	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800	? (MO) TT=352.148
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-CMS750_4.opb	OPT f=258048 TT=713.693 T1=498.93	No data	No data	No data	OPT f=258048 TT=713.693 T1=713.68	? (TO) TT=1800.02	No data	No data	SAT (TO) f=258048 TT=1800.85 T1=498.93	No Cert. TT=1800.01	? (TO) TT=1800.1
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core2536-691.opb	SAT f=947200000000000 TT=1800.16 T1=119.46	No data	No data	No data	SAT (TO) f=11991040000000000 TT=1800.09 T1=1800.4	SAT (TO) f=1002496000000000 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=947200000000000 TT=1800.16 T1=119.46	SAT (TO) f=949248000000000 TT=1800.05 T1=0.71	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core2586-950.opb	SAT f=1266688000000000 TT=1800.63 T1=154.75	No data	No data	No data	SAT (TO) f=7982080000000000 TT=1800.1 T1=1800.4	SAT (TO) f=1354752000000000 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=1266688000000000 TT=1800.63 T1=154.75	SAT (TO) f=1268736000000000 TT=1800.08 T1=0.62	? (TO) TT=1800.12
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core4284-1064.opb	SAT f=1435648000000000 TT=1800.49 T1=565.85	No data	No data	No data	SAT (TO) f=12525568000000000 TT=1800.08 T1=1800.4	SAT (TO) f=1482752000000000 TT=1800.05 T1=1800.4	No data	No data	SAT (TO) f=1435648000000000 TT=1800.49 T1=565.85	SAT (TO) f=1437696000000000 TT=1800.04 T1=0.84	? (TO) TT=1800.14
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-core4872-1529.opb	SAT f=2012160000000000 TT=1800.09 T1=473.64	No data	No data	No data	SAT (TO) f=17101824000000000 TT=1800.06 T1=1800.4	SAT (TO) f=2091008000000000 TT=1800.05 T1=1800.4	No data	No data	SAT (TO) f=2012160000000000 TT=1800.09 T1=473.64	SAT (TO) f=2014208000000000 TT=1800 T1=0.82	? (TO) TT=1800.12
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dc1c.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.16	No data	No data	? (TO) TT=1800	? (TO) TT=1800	? (MO) TT=252.264
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dc1l.opb	SAT f=322124420039689472000 TT=1800.74 T1=230.43	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.45	No data	No data	SAT (TO) f=322124420039689472000 TT=1800.74 T1=230.43	? (TO) TT=1800.04	? (MO) TT=513.807
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dg012142.opb		No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.69	? (TO) TT=1800.01	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-dolom1.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.13	No data	No data	? (TO) TT=1800.69	? (TO) TT=1800.01	? (MO) TT=295.789
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-glass4.opb	OPT f=1228810444800 TT=3.974 T1=2.58	No data	No data	No data	? (MO) TT=437.27	? (TO) TT=1800.09	No data	No data	OPT f=1228810444800 TT=7.592 T1=10.58	OPT f=1228810444800 TT=3.974 T1=2.58	? (MO) TT=195.618
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-NSR8K.opb		No data	No data	No data	? (MO) TT=1488.36	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=1013.57
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-nsrand_ipx.opb	SAT f=1209008127 TT=1800.82 T1=796.99	No data	No data	No data	SAT (TO) f=1941635072 TT=1800.1 T1=1800.4	SAT (TO) f=1241512960 TT=1800.06 T1=1800.5	No data	No data	SAT (TO) f=1209008127 TT=1800.82 T1=796.99	SAT (TO) f=2145386496 TT=1800.08 T1=0.92	? (MO) TT=178.598
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-rail507.opb	SAT f=265216000000000 TT=1800.66 T1=84.75	No data	No data	No data	SAT (TO) f=18944000000000000 TT=1800.05 T1=1800.3	Signal TT=3.521	No data	No data	SAT (TO) f=265216000000000 TT=1800.66 T1=84.75	No Cert. TT=1800.09	? (TO) TT=1800.12
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-railway_8_1_0.opb	OPT f=409600 TT=33.57 T1=5.71	No data	No data	No data	OPT f=409600 TT=33.57 T1=33.55	? (TO) TT=1800.02	No data	No data	SAT (TO) f=409600 TT=1800.84 T1=19.4	SAT (TO) f=409600 TT=1800.87 T1=5.71	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-roll3000.opb	SAT f=1095891440 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=1095891440 TT=1800.09 T1=1800.4	? (TO) TT=1800.04	No data	No data	SAT (TO) f=1350564864 TT=1800.87 T1=241.74	SAT (TO) f=1140980736 TT=1800.04 T1=240.63	? (MO) TT=147.565
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-siena1.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.18	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.59	? (MO) TT=361.799
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp97ar.opb	SAT f=2739023033 TT=1800.01 T1=304.58	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=6430552113 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=2739023033 TT=1800.01 T1=304.58	SAT (TO) f=2741090384 TT=1800.04 T1=1.83	? (TO) TT=1800.64
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp97ic.opb	SAT f=3490480071 TT=1800.09 T1=447.25	No data	No data	No data	SAT (TO) f=89849361412 TT=1800.09 T1=1800.4	SAT (TO) f=12411487022 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=3490480071 TT=1800.09 T1=447.25	SAT (TO) f=3512823688 TT=1800.07 T1=8.76	? (MO) TT=473.256
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp98ar.opb	SAT f=4210416996 TT=1800.07 T1=2.1	No data	No data	No data	SAT (TO) f=55177007326 TT=1800.02 T1=1800.3	SAT (TO) f=11103918387 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=4210416996 TT=1800.17 T1=4.06	SAT (TO) f=4210416996 TT=1800.07 T1=2.1	? (exit code) TT=847.949
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-sp98ic.opb	SAT f=3897566335 TT=1800.53 T1=786.42	No data	No data	No data	SAT (TO) f=83966118068 TT=1800.02 T1=1800.3	SAT (TO) f=12941992956 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=3897566335 TT=1800.53 T1=786.42	SAT (TO) f=3932174754 TT=1800.09 T1=622.43	? (MO) TT=505.51
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-tr12-30.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.76	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-trento1.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.17	? (TO) TT=1801.09	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-UMTS.opb	SAT f=32826205 TT=1800.35 T1=847.46	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=47560990 TT=1800.13 T1=1800.4	No data	No data	SAT (TO) f=32826205 TT=1800.35 T1=847.46	SAT (TO) f=37192738 TT=1800.05 T1=472.3	? (TO) TT=1800.05
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-usAbbrv.8.25_70.opb	SAT f=123904 TT=1800.07 T1=273.33	No data	No data	No data	SAT (TO) f=123904 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	No data	No data	SAT (TO) f=123904 TT=1800.92 T1=273.33	SAT (TO) f=124928 TT=1800.71 T1=140.25	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-mps-v2-20-10-van.opb	SAT f=24193312742 TT=1801.07 T1=129.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	No data	No data	SAT (TO) f=24193312742 TT=1801.07 T1=129.09	SAT (TO) f=25442247019 TT=1800.94 T1=41.15	? (TO) TT=1800.61
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/ mps/normalized-mps-v2-20-10-maros.opb	OPT f=344750 TT=2.32 T1=3.86	No data	No data	No data	OPT f=344750 TT=3.866 T1=3.86	OPT f=344750 TT=6.203 T1=6.2	No data	No data	OPT f=344750 TT=2.32 T1=79.78	OPT f=344750 TT=7.183 T1=5.3	OPT f=344750 TT=42.421 T1=39.53
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-mps-v2-20-10-nazareth.opb	OPT f=-1073741823 TT=0.107 T1=0.1	No data	No data	No data	OPT f=-1073741823 TT=0.107 T1=0.1	OPT f=-1073741823 TT=1.537 T1=1.53	No data	No data	OPT f=-1073741823 TT=0.185 T1=0.63	OPT f=-1073741823 TT=0.176 T1=0.37	? (MO) TT=172.078
normalized-PB06/OPT-BIGINT/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-mps-v2-20-10-testprob.opb	OPT f=9663726592 TT=0.036 T1=0.03	No data	No data	No data	OPT f=9663726592 TT=0.036 T1=0.03	OPT f=9663726592 TT=0.621 T1=0.62	No data	No data	OPT f=9663726592 TT=0.214 T1=1.14	OPT f=9663726592 TT=0.162 T1=0.13	? (MO) TT=173.305
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114-max.opb	SAT f=-2 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-2 TT=1800.01 T1=1800.3	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.09	? (TO) TT=1801.58	? (MO) TT=172.717
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114.opb	OPT f=1 TT=1.214 T1=0.56	No data	No data	No data	OPT f=1 TT=8.941 T1=8.93	? (TO) TT=1800.08	No data	No data	OPT f=1 TT=2.526 T1=1.25	OPT f=1 TT=1.214 T1=0.56	? (MO) TT=175.964
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534-max.opb	SAT f=-2 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-2 TT=1800.01 T1=1800.3	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.51	? (TO) TT=1800.08	? (MO) TT=170.196
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534.opb	OPT f=1 TT=1.263 T1=0.55	No data	No data	No data	OPT f=1 TT=3.629 T1=3.62	? (TO) TT=1800.08	No data	No data	OPT f=1 TT=2.525 T1=1.25	OPT f=1 TT=1.263 T1=0.55	? (MO) TT=170
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277-max.opb	SAT f=-13 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-13 TT=1800.08 T1=1800.4	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.63	? (TO) TT=1800.01	? (MO) TT=194.521
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277.opb	OPT f=1 TT=1.304 T1=0.61	No data	No data	No data	OPT f=1 TT=6.229 T1=6.22	? (TO) TT=1800.01	No data	No data	OPT f=1 TT=2.246 T1=1.24	OPT f=1 TT=1.304 T1=0.61	? (MO) TT=194.87
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839-max.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.65	? (TO) TT=1800.05	? (MO) TT=157.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839.opb	OPT f=1 TT=1.274 T1=0.59	No data	No data	No data	OPT f=1 TT=4.541 T1=4.53	? (TO) TT=1800.06	No data	No data	OPT f=1 TT=2.983 T1=1.37	OPT f=1 TT=1.274 T1=0.59	? (MO) TT=157.383
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354-max.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.77	? (TO) TT=1800.06	? (MO) TT=157.217
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354.opb	OPT f=1 TT=1.425 T1=0.68	No data	No data	No data	OPT f=1 TT=7.211 T1=7.2	? (TO) TT=1800.01	No data	No data	OPT f=1 TT=2.594 T1=1.37	OPT f=1 TT=1.425 T1=0.68	? (MO) TT=156.294
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522-max.opb	SAT f=-3 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-3 TT=1800.07 T1=1800.4	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.65	? (TO) TT=1800.05	? (MO) TT=164.399
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522.opb	OPT f=1 TT=1.477 T1=0.68	No data	No data	No data	OPT f=1 TT=10.394 T1=10.38	? (TO) TT=1800.01	No data	No data	OPT f=1 TT=2.754 T1=1.39	OPT f=1 TT=1.477 T1=0.68	? (MO) TT=163.792
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174-max.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800	? (TO) TT=1800	? (MO) TT=169.306
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174.opb	OPT f=1 TT=1.483 T1=0.76	No data	No data	No data	OPT f=1 TT=45.878 T1=45.87	? (TO) TT=1800.02	No data	No data	OPT f=1 TT=2.883 T1=1.47	OPT f=1 TT=1.483 T1=0.76	? (MO) TT=183.497
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552-max.opb	SAT f=-127 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-127 TT=1800.08 T1=1800.4	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	? (MO) TT=187.909
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552.opb	OPT f=1 TT=1.494 T1=0.76	No data	No data	No data	OPT f=1 TT=11.254 T1=11.24	? (TO) TT=1800.11	No data	No data	OPT f=1 TT=2.834 T1=1.43	OPT f=1 TT=1.494 T1=0.76	? (MO) TT=191.426
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554-max.opb	SAT f=-2 TT=1800.13 T1=471.22	No data	No data	No data	SAT (TO) f=-1 TT=1800.08 T1=1800.4	? (TO) TT=1800.03	No data	No data	SAT (TO) f=-2 TT=1800.13 T1=471.22	? (TO) TT=1800.89	? (MO) TT=150.005
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554.opb	OPT f=1 TT=1.683 T1=0.84	No data	No data	No data	OPT f=1 TT=16.114 T1=16.1	? (TO) TT=1800.11	No data	No data	OPT f=1 TT=2.995 T1=1.47	OPT f=1 TT=1.683 T1=0.84	? (MO) TT=149.477
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197-max.opb		No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.77	? (TO) TT=1800.75	? (MO) TT=149.338
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197.opb	OPT f=1 TT=1.694 T1=0.87	No data	No data	No data	OPT f=1 TT=38.658 T1=38.64	? (TO) TT=1800.02	No data	No data	OPT f=1 TT=2.793 T1=1.43	OPT f=1 TT=1.694 T1=0.87	? (MO) TT=149.672
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650-max.opb	SAT f=-30 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-30 TT=1800.07 T1=1800.4	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (MO) TT=185.689
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650.opb	OPT f=1 TT=1.873 T1=0.95	No data	No data	No data	OPT f=1 TT=62.717 T1=62.7	? (TO) TT=1800.07	No data	No data	OPT f=1 TT=3.323 T1=1.56	OPT f=1 TT=1.873 T1=0.95	? (MO) TT=186.48
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249-max.opb		No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.58	? (MO) TT=150.014
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249.opb	OPT f=1 TT=1.944 T1=0.96	No data	No data	No data	OPT f=1 TT=26.871 T1=26.85	? (TO) TT=1800.14	No data	No data	OPT f=1 TT=3.214 T1=1.52	OPT f=1 TT=1.944 T1=0.96	? (MO) TT=149.8
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708-max.opb	OPT f=-92 TT=0.149 T1=0.14	No data	No data	No data	OPT f=-92 TT=0.149 T1=0.14	OPT f=-92 TT=0.287 T1=0.28	No data	No data	OPT f=-92 TT=2.363 T1=1.72	OPT f=-92 TT=0.865 T1=0.42	OPT f=-92 TT=3.087 T1=3.01
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708.opb	OPT f=1 TT=0.051 T1=0.05	No data	No data	No data	OPT f=1 TT=0.051 T1=0.05	OPT f=1 TT=0.095 T1=0.09	No data	No data	OPT f=1 TT=0.303 T1=0.71	OPT f=1 TT=0.275 T1=0.19	OPT f=1 TT=2.126 T1=2.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543-max.opb	OPT f=-1281 TT=0.079 T1=0.07	No data	No data	No data	OPT f=-1281 TT=0.082 T1=0.08	OPT f=-1281 TT=0.079 T1=0.07	No data	No data	OPT f=-1281 TT=1.544 T1=0.71	OPT f=-1281 TT=0.673 T1=0.33	OPT f=-1281 TT=14.682 T1=14.53
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543.opb	OPT f=1 TT=0.048 T1=0.04	No data	No data	No data	OPT f=1 TT=0.048 T1=0.04	OPT f=1 TT=0.05 T1=0.05	No data	No data	OPT f=1 TT=0.304 T1=0.71	OPT f=1 TT=0.274 T1=0.19	OPT f=1 TT=13.951 T1=13.89
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880-max.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.16	No data	No data	? (TO) TT=1800	? (TO) TT=1800.02	? (MO) TT=169.963
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880.opb	OPT f=1 TT=2.045 T1=1.08	No data	No data	No data	OPT f=1 TT=36.168 T1=36.14	? (TO) TT=1800.06	No data	No data	OPT f=1 TT=3.622 T1=1.65	OPT f=1 TT=2.045 T1=1.08	? (MO) TT=166.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390-max.opb		No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.15	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.79	? (MO) TT=151.631
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390.opb	OPT f=1 TT=1.985 T1=1.1	No data	No data	No data	OPT f=1 TT=29.841 T1=29.82	? (TO) TT=1800.06	No data	No data	OPT f=1 TT=3.638 T1=1.66	OPT f=1 TT=1.985 T1=1.1	? (MO) TT=150.409
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238-max.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.12	No data	No data	? (TO) TT=1800.55	? (TO) TT=1800.02	? (MO) TT=169.952
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238.opb	OPT f=1 TT=2.193 T1=1.22	No data	No data	No data	OPT f=1 TT=106.851 T1=106.83	? (TO) TT=1800.06	No data	No data	OPT f=1 TT=3.733 T1=1.79	OPT f=1 TT=2.193 T1=1.22	? (MO) TT=169.016
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885-max.opb	SAT f=-1237 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-1237 TT=1800.09 T1=1800.4	? (TO) TT=1800.11	No data	No data	SAT (TO) f=-1 TT=1800.09 T1=153.8	? (TO) TT=1801.05	? (MO) TT=150.208
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885.opb	OPT f=1 TT=2.214 T1=1.18	No data	No data	No data	OPT f=1 TT=49.028 T1=49	? (TO) TT=1800.12	No data	No data	OPT f=1 TT=3.742 T1=1.8	OPT f=1 TT=2.214 T1=1.18	? (MO) TT=153.378
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074-max.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.02	? (TO) TT=1801.14	? (MO) TT=169.568
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074.opb	OPT f=1 TT=2.554 T1=1.34	No data	No data	No data	OPT f=1 TT=76.445 T1=76.42	? (TO) TT=1800.14	No data	No data	OPT f=1 TT=4.082 T1=1.91	OPT f=1 TT=2.554 T1=1.34	? (MO) TT=169.205
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794-max.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.86	? (MO) TT=151.751
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794.opb	OPT f=1 TT=2.645 T1=1.44	No data	No data	No data	OPT f=1 TT=58.437 T1=58.41	? (TO) TT=1800.15	No data	No data	OPT f=1 TT=4.121 T1=1.9	OPT f=1 TT=2.645 T1=1.44	? (MO) TT=149.531
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631-max.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.3	No data	No data	? (TO) TT=1800	? (TO) TT=1800.84	? (MO) TT=158.898
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631.opb	OPT f=1 TT=2.543 T1=1.46	No data	No data	No data	OPT f=1 TT=66.43 T1=66.39	? (TO) TT=1800.17	No data	No data	OPT f=1 TT=4.654 T1=2.05	OPT f=1 TT=2.543 T1=1.46	? (MO) TT=158.714
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433-max.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.24	No data	No data	? (TO) TT=1800.02	? (TO) TT=1801.06	? (MO) TT=149.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433.opb	OPT f=1 TT=2.663 T1=1.49	No data	No data	No data	OPT f=1 TT=251.969 T1=251.96	? (TO) TT=1800.16	No data	No data	OPT f=1 TT=4.572 T1=2.06	OPT f=1 TT=2.663 T1=1.49	? (MO) TT=159.377
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195-max.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.23	No data	No data	? (TO) TT=1800.55	? (TO) TT=1800.94	? (MO) TT=156.581
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195.opb	OPT f=1 TT=3.394 T1=1.92	No data	No data	No data	OPT f=1 TT=84.636 T1=84.59	? (TO) TT=1800.2	No data	No data	OPT f=1 TT=5.111 T1=2.81	OPT f=1 TT=3.394 T1=1.92	? (MO) TT=156.616
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159-max.opb		No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.22	No data	No data	? (TO) TT=1800.69	? (TO) TT=1800.09	? (MO) TT=158.202
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159.opb	OPT f=1 TT=3.494 T1=1.89	No data	No data	No data	OPT f=1 TT=85.187 T1=85.16	? (TO) TT=1800.33	No data	No data	OPT f=1 TT=5.274 T1=2.83	OPT f=1 TT=3.494 T1=1.89	? (MO) TT=166.336
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690-max.opb		No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.28	No data	No data	? (TO) TT=1800.65	? (TO) TT=1800.78	? (MO) TT=151.03
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690.opb	OPT f=1 TT=3.603 T1=2.3	No data	No data	No data	OPT f=1 TT=307.078 T1=307.06	? (TO) TT=1800.3	No data	No data	OPT f=1 TT=5.032 T1=2.48	OPT f=1 TT=3.603 T1=2.3	? (MO) TT=155.41
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220-max.opb		No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.17	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.04	? (MO) TT=156.882
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220.opb	OPT f=1 TT=3.614 T1=2.2	No data	No data	No data	OPT f=1 TT=100.661 T1=100.61	? (TO) TT=1800.28	No data	No data	OPT f=1 TT=5.311 T1=2.48	OPT f=1 TT=3.614 T1=2.2	? (MO) TT=157.403
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480-max.opb	SAT f=-104 TT=1800.1 T1=1800.3	No data	No data	No data	SAT (TO) f=-104 TT=1800.1 T1=1800.3	? (TO) TT=1800.32	No data	No data	? (TO) TT=1800	? (TO) TT=1800.05	? (MO) TT=151.574
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480.opb	OPT f=1 TT=3.962 T1=2.53	No data	No data	No data	OPT f=1 TT=135.026 T1=134.98	? (TO) TT=1800.25	No data	No data	OPT f=1 TT=5.563 T1=2.8	OPT f=1 TT=3.962 T1=2.53	? (MO) TT=149.711
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999-max.opb	SAT f=-57 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-57 TT=1800.09 T1=1800.4	? (TO) TT=1800.27	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.01	? (MO) TT=157.197
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999.opb	OPT f=1 TT=3.944 T1=2.54	No data	No data	No data	OPT f=1 TT=125.531 T1=125.49	? (TO) TT=1800.32	No data	No data	OPT f=1 TT=5.741 T1=2.91	OPT f=1 TT=3.944 T1=2.54	? (MO) TT=157.488
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132-max.opb		No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.39	No data	No data	? (TO) TT=1800.61	? (TO) TT=1800.63	? (MO) TT=154.666
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132.opb	OPT f=1 TT=4.533 T1=2.85	No data	No data	No data	OPT f=1 TT=150.688 T1=150.63	? (TO) TT=1800.36	No data	No data	OPT f=1 TT=6.512 T1=3.43	OPT f=1 TT=4.533 T1=2.85	? (MO) TT=155.228
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403-max.opb		No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.25	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.06	? (MO) TT=160.879
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403.opb	OPT f=1 TT=4.664 T1=2.98	No data	No data	No data	OPT f=1 TT=257.582 T1=257.54	? (TO) TT=1800.4	No data	No data	OPT f=1 TT=6.796 T1=3.46	OPT f=1 TT=4.664 T1=2.98	? (MO) TT=160.088
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478-max.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.34	No data	No data	? (TO) TT=1800.19	? (TO) TT=1800	? (MO) TT=158.115
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478.opb	OPT f=1 TT=4.353 T1=2.69	No data	No data	No data	OPT f=1 TT=287.102 T1=287.09	? (TO) TT=1800.43	No data	No data	OPT f=1 TT=8.123 T1=4.22	OPT f=1 TT=4.353 T1=2.69	? (MO) TT=158.42
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612-max.opb		No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.27	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.58	? (MO) TT=150.796
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612.opb	OPT f=1 TT=4.393 T1=2.73	No data	No data	No data	OPT f=1 TT=197.742 T1=197.71	? (TO) TT=1800.43	No data	No data	OPT f=1 TT=8.314 T1=4.31	OPT f=1 TT=4.393 T1=2.73	? (MO) TT=151.021
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400-max.opb	SAT f=-25 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=-25 TT=1800.12 T1=1800.4	Signal TT=11.584	No data	No data	? (TO) TT=1800.17	? (TO) TT=1800.01	? (MO) TT=194.801
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400.opb	OPT f=1 TT=5.252 T1=3.64	No data	No data	No data	OPT f=1 TT=203.778 T1=203.71	Signal TT=11.676	No data	No data	OPT f=1 TT=6.714 T1=3.92	OPT f=1 TT=5.252 T1=3.64	? (MO) TT=195.346
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490-max.opb		No data	No data	No data	? (TO) TT=1800.02	Signal TT=11.436	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=190.113
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490.opb	OPT f=1 TT=5.092 T1=3.49	No data	No data	No data	OPT f=1 TT=324.758 T1=324.74	Signal TT=11.521	No data	No data	OPT f=1 TT=7.032 T1=4.08	OPT f=1 TT=5.092 T1=3.49	? (MO) TT=186.556
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555-max.opb	OPT f=-18535 TT=924.581 T1=195.16	No data	No data	No data	OPT f=-18535 TT=924.581 T1=924.72	SAT (TO) f=-1 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=-18535 TT=1800.14 T1=195.16	OPT f=-18535 TT=1787.67 T1=1762.14	? (MO) TT=173.677
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555.opb	OPT f=1 TT=0.554 T1=0.3	No data	No data	No data	OPT f=1 TT=32.112 T1=32.11	OPT f=1 TT=48.515 T1=48.52	No data	No data	OPT f=1 TT=0.895 T1=0.83	OPT f=1 TT=0.554 T1=0.3	? (MO) TT=172.6
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986-max.opb	OPT f=-1307731 TT=13.482 T1=8.43	No data	No data	No data	OPT f=-1307731 TT=127.186 T1=127.2	OPT f=-1307731 TT=52.95 T1=52.95	No data	No data	OPT f=-1307731 TT=111.069 T1=52.36	OPT f=-1307731 TT=13.482 T1=8.43	? (MO) TT=169.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986.opb	OPT f=1 TT=0.523 T1=0.3	No data	No data	No data	OPT f=1 TT=9.2 T1=9.2	OPT f=1 TT=44.347 T1=44.35	No data	No data	OPT f=1 TT=0.685 T1=0.84	OPT f=1 TT=0.523 T1=0.3	? (MO) TT=169.591
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641-max.opb		No data	No data	No data	? (TO) TT=1800.1	Signal TT=13.046	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (MO) TT=205.652
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641.opb	OPT f=1 TT=5.762 T1=4.15	No data	No data	No data	OPT f=1 TT=386.699 T1=386.68	Signal TT=13.056	No data	No data	OPT f=1 TT=8.303 T1=4.51	OPT f=1 TT=5.762 T1=4.15	? (MO) TT=204.199
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006-max.opb		No data	No data	No data	? (TO) TT=1800.08	Signal TT=13.061	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.71	? (MO) TT=201.959
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006.opb	OPT f=1 TT=5.453 T1=4.14	No data	No data	No data	OPT f=1 TT=370.158 T1=370.15	Signal TT=12.876	No data	No data	OPT f=1 TT=7.944 T1=4.5	OPT f=1 TT=5.453 T1=4.14	? (MO) TT=202.303
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542-max.opb		No data	No data	No data	? (TO) TT=1800.11	Signal TT=14.645	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.06	? (MO) TT=141.809
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542.opb	OPT f=1 TT=6.754 T1=4.85	No data	No data	No data	OPT f=1 TT=470.429 T1=470.43	Signal TT=14.754	No data	No data	OPT f=1 TT=9.762 T1=5.52	OPT f=1 TT=6.754 T1=4.85	? (MO) TT=141.95
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498-max.opb		No data	No data	No data	? (TO) TT=1800.02	Signal TT=14.74	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.53	? (MO) TT=145.224
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498.opb	OPT f=1 TT=6.604 T1=4.93	No data	No data	No data	OPT f=1 TT=377.568 T1=377.53	Signal TT=14.544	No data	No data	OPT f=1 TT=9.622 T1=5.49	OPT f=1 TT=6.604 T1=4.93	? (MO) TT=142.513
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129-max.opb		No data	No data	No data	? (TO) TT=1800.07	Signal TT=16.532	No data	No data	? (TO) TT=1800.17	? (TO) TT=1800.65	? (MO) TT=151.512
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129.opb	OPT f=1 TT=5.993 T1=4.34	No data	No data	No data	OPT f=1 TT=441.252 T1=441.17	Signal TT=16.387	No data	No data	OPT f=1 TT=10.982 T1=6.17	OPT f=1 TT=5.993 T1=4.34	? (MO) TT=152.869
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673-max.opb		No data	No data	No data	? (TO) TT=1800.13	Signal TT=16.522	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.01	? (MO) TT=151.269
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673.opb	OPT f=1 TT=5.822 T1=4.13	No data	No data	No data	OPT f=1 TT=680.6 T1=680.63	Signal TT=16.467	No data	No data	OPT f=1 TT=10.913 T1=6.36	OPT f=1 TT=5.822 T1=4.13	? (MO) TT=148.055
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727-max.opb	SAT f=-9 TT=1800.14 T1=1800.4	No data	No data	No data	SAT (TO) f=-9 TT=1800.14 T1=1800.4	Signal TT=18.516	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	? (MO) TT=148.114
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727.opb	OPT f=1 TT=7.364 T1=5.52	No data	No data	No data	OPT f=1 TT=556.757 T1=556.73	Signal TT=18.888	No data	No data	OPT f=1 TT=12.713 T1=7.12	OPT f=1 TT=7.364 T1=5.52	? (MO) TT=146.495
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136-max.opb		No data	No data	No data	? (TO) TT=1800.07	Signal TT=18.512	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (MO) TT=195.86
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136.opb	OPT f=1 TT=7.353 T1=5.49	No data	No data	No data	OPT f=1 TT=434.029 T1=433.93	Signal TT=18.417	No data	No data	OPT f=1 TT=12.851 T1=7.17	OPT f=1 TT=7.353 T1=5.49	? (MO) TT=198.614
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866-max.opb		No data	No data	No data	? (TO) TT=1800.11	Signal TT=20.278	No data	No data	? (TO) TT=1800.68	? (TO) TT=1800.01	? (MO) TT=199.199
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866.opb	OPT f=1 TT=7.694 T1=5.86	No data	No data	No data	OPT f=1 TT=462.924 T1=462.85	Signal TT=20.485	No data	No data	OPT f=1 TT=9.795 T1=5.86	OPT f=1 TT=7.694 T1=6.04	? (MO) TT=197.257
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522-max.opb		No data	No data	No data	? (TO) TT=1800.11	Signal TT=21.566	No data	No data	? (TO) TT=1800.62	? (TO) TT=1800.7	? (MO) TT=203.102
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522.opb	OPT f=1 TT=8.053 T1=6.06	No data	No data	No data	OPT f=1 TT=521.12 T1=521.05	Signal TT=20.566	No data	No data	OPT f=1 TT=10.122 T1=6.06	OPT f=1 TT=8.053 T1=6.2	? (MO) TT=197.972
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155-max.opb	SAT f=-5339 TT=1801.21 T1=1340.54	No data	No data	No data	SAT (TO) f=-95 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	No data	No data	SAT (TO) f=-1 TT=1800.16 T1=169.71	SAT (TO) f=-5339 TT=1801.21 T1=1340.54	? (MO) TT=172.893
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155.opb	OPT f=1 TT=0.864 T1=0.4	No data	No data	No data	OPT f=1 TT=3.838 T1=3.83	? (TO) TT=1800.01	No data	No data	OPT f=1 TT=2.054 T1=1.1	OPT f=1 TT=0.864 T1=0.4	? (MO) TT=172.875
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325-max.opb	SAT f=-735 TT=1800.01 T1=407.81	No data	No data	No data	SAT (TO) f=-735 TT=1800.01 T1=1800.3	? (TO) TT=1800.1	No data	No data	SAT (TO) f=-735 TT=1800.11 T1=407.81	? (TO) TT=1800.98	? (MO) TT=172.684
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325.opb	OPT f=1 TT=0.883 T1=0.4	No data	No data	No data	OPT f=1 TT=3.211 T1=3.2	? (TO) TT=1800.1	No data	No data	OPT f=1 TT=2.064 T1=1.16	OPT f=1 TT=0.883 T1=0.4	? (MO) TT=174.121
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378-max.opb	SAT f=-22 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-22 TT=1800.02 T1=1800.3	SAT (TO) f=-6 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=-3 TT=1801 T1=111.72	? (TO) TT=1800.1	? (MO) TT=188.015
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378.opb	OPT f=1 TT=0.944 T1=0.47	No data	No data	No data	OPT f=1 TT=3.75 T1=3.74	OPT f=1 TT=1450.2 T1=1450.42	No data	No data	OPT f=1 TT=2.324 T1=1.21	OPT f=1 TT=0.944 T1=0.47	? (MO) TT=183.789
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415-max.opb	SAT f=-1969 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-1969 TT=1800.02 T1=1800.3	? (TO) TT=1800.1	No data	No data	SAT (TO) f=-1 TT=1800.12 T1=9.68	? (TO) TT=1800.68	? (MO) TT=178.251
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415.opb	OPT f=1 TT=0.934 T1=0.47	No data	No data	No data	OPT f=1 TT=1.657 T1=1.65	? (TO) TT=1800.01	No data	No data	OPT f=1 TT=2.204 T1=1.18	OPT f=1 TT=0.934 T1=0.47	? (MO) TT=178.491
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-mps-v2-20-10-fit1d.opb	SAT f=53066119 TT=1800.06 T1=234.99	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.13	No data	No data	SAT (TO) f=53066119 TT=1800.06 T1=234.99	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-aflow30a.opb	SAT f=3400 TT=1800.24 T1=957.82	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.12	No data	No data	SAT (TO) f=3400 TT=1800.24 T1=957.82	No Cert. TT=1801.09	? (TO) TT=1800.08
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-aflow40b.opb	SAT f=5921 TT=1800.26 T1=890.54	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.12	No data	No data	SAT (TO) f=5921 TT=1800.26 T1=890.54	No Cert. TT=1800.67	? (TO) TT=1800.08
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-air04.opb	SAT f=57953 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=57953 TT=1800.08 T1=1800.4	SAT (TO) f=58170 TT=1800.09 T1=1800.4	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-air05.opb	SAT f=33182 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=33182 TT=1800.1 T1=1800.4	SAT (TO) f=34119 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=37044 TT=1800.66 T1=489	SAT (TO) f=42258 TT=1800.01 T1=1379.98	? (TO) TT=1800.1
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-nw04.opb	SAT f=17498 TT=1800.82 T1=142.73	No data	No data	No data	? (TO) TT=1800.1	SAT (MO) f=20366 TT=598.952 T1=598.6	No data	No data	SAT (TO) f=17498 TT=1800.82 T1=142.73	No Cert. TT=1800.05	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-t1717.opb	SAT f=200300 TT=379.541 T1=379.06	No data	No data	No data	SAT (TO) f=200300 TT=1800.24 T1=1800.4	SAT f=200300 TT=379.541 T1=379.06	No data	No data	SAT (TO) f=400807 TT=1800.79 T1=4.78	SAT (TO) f=380218 TT=1800.76 T1=2.7	? (TO) TT=1800.12
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-vpm2.opb	SAT f=115 TT=1801.03 T1=96.52	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	No data	No data	SAT (TO) f=115 TT=1801.03 T1=96.52	SAT (TO) f=149 TT=1800.09 T1=649.08	? (TO) TT=1800.03
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-gt2.opb	OPT f=21166 TT=2.983 T1=2.22	No data	No data	No data	SAT (TO) f=24268 TT=1800.06 T1=1800.4	SAT (TO) f=22521 TT=1800.02 T1=1800.3	No data	No data	OPT f=21166 TT=2.983 T1=2.22	SAT (TO) f=21166 TT=1800.09 T1=309.24	? (TO) TT=1800.08
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air01.opb	OPT f=3398 TT=2.404 T1=0.41	No data	No data	No data	SAT (TO) f=3440 TT=1800.1 T1=1800.4	OPT f=3398 TT=35.463 T1=35.36	No data	No data	OPT f=3398 TT=4.833 T1=4.29	OPT f=3398 TT=2.404 T1=0.41	OPT f=3398 TT=137.382 T1=113.01
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air02.opb	OPT f=3905 TT=189.275 T1=181.82	No data	No data	No data	SAT (TO) f=6605 TT=1800.11 T1=1800.4	SAT (TO) f=4960 TT=1800.39 T1=1800.4	No data	No data	SAT (TO) f=4369 TT=1800.52 T1=659.45	OPT f=3905 TT=189.275 T1=181.82	? (TO) TT=1800.06
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air03.opb	SAT f=196690 TT=1800.06 T1=868.29	No data	No data	No data	SAT (TO) f=247463 TT=1800.03 T1=1800.3	SAT (TO) f=225333 TT=1800.32 T1=1800.4	No data	No data	SAT (TO) f=196690 TT=1800.06 T1=868.29	SAT (TO) f=219231 TT=1800.74 T1=1446.1	? (TO) TT=1800.05
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-air06.opb	SAT f=52144 TT=1800.15 T1=1800.3	No data	No data	No data	SAT (TO) f=63121 TT=1800.09 T1=1800.4	SAT (TO) f=52144 TT=1800.15 T1=1800.3	No data	No data	SAT (TO) f=67001 TT=1800.14 T1=826.85	SAT (TO) f=66846 TT=1800.05 T1=330.65	? (TO) TT=1800.05
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-enigma.opb	OPT f=0 TT=0.395 T1=0.27	No data	No data	No data	OPT f=0 TT=7.547 T1=7.54	OPT f=0 TT=4.049 T1=4.04	No data	No data	OPT f=0 TT=0.934 T1=0.68	OPT f=0 TT=0.463 T1=0.27	OPT f=0 TT=0.395 T1=0.37
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0282.opb	OPT f=258411 TT=0.949 T1=0.56	No data	No data	No data	OPT f=258411 TT=423.771 T1=423.82	OPT f=258411 TT=18.422 T1=18.38	No data	No data	OPT f=258411 TT=3.897 T1=13.47	OPT f=258411 TT=1.196 T1=0.56	OPT f=258411 TT=0.949 T1=0.71
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0291.opb	OPT f=10447498 TT=0.473 T1=0.26	No data	No data	No data	SAT (TO) f=182289140 TT=1800.02 T1=1800.3	OPT f=10447498 TT=204.036 T1=204.01	No data	No data	OPT f=10447498 TT=1.344 T1=5.7	OPT f=10447498 TT=0.473 T1=0.26	? (TO) TT=1800.77
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p6000.opb	SAT f=-1245798 TT=1800.51 T1=893.14	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.22	No data	No data	SAT (TO) f=-1245798 TT=1800.51 T1=893.14	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-pipex.opb	OPT f=788263 TT=6.148 T1=7.38	No data	No data	No data	OPT f=788263 TT=109.904 T1=109.91	OPT f=788263 TT=15.844 T1=15.84	No data	No data	OPT f=788263 TT=6.148 T1=7.38	OPT f=788263 TT=9.893 T1=8.3	OPT f=788263 TT=51.482 T1=45.03
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-vpm1.opb	OPT f=20 TT=42.788 T1=42.73	No data	No data	No data	OPT f=20 TT=723.533 T1=723.65	SAT (TO) f=76 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=20 TT=1800.62 T1=608.63	SAT (TO) f=20 TT=1800.69 T1=866.11	OPT f=20 TT=42.788 T1=42.73
normalized-PB06/OPT-MEDINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos9.opb		No data	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.05	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.34
normalized-PB06/OPT-MEDINT/mps-v2-20-10/ plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-seymour1.opb	SAT f=471083 TT=1800.05 T1=56.44	No data	No data	No data	SAT (TO) f=846906 TT=1800.02 T1=1800.4	SAT (TO) f=561239 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=471083 TT=1800.05 T1=56.44	SAT (TO) f=471086 TT=1800.81 T1=1.09	? (TO) TT=1800.11
normalized-PB06/OPT-MEDINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-ds.opb		No data	No data	No data	? (TO) TT=1800.21	Signal TT=618.812	No data	No data	? (TO) TT=1802.15	No Cert. TT=1800.55	? (TO) TT=1800.62
normalized-PB06/OPT-MEDINT/reduced/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome12.opb		No data	No data	No data	Signal TT=1285.65	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.69	? (TO) TT=1800.63	? (TO) TT=1800.47
normalized-PB06/OPT-MEDINT/reduced/mps-v2-20-10/ plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome13.opb		No data	No data	No data	? (TO) TT=1800.19	? (TO) TT=1800.15	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.6
normalized-PB06/OPT-MEDINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ws97-3.opb	SAT f=3033 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=4061 TT=1800.11 T1=1800.4	SAT (TO) f=3033 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=3052 TT=1800.13 T1=667.31	SAT (TO) f=3075 TT=1800.02 T1=0.41	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-10teams.opb	SAT f=914 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=926 TT=1800.01 T1=1800.3	SAT (TO) f=972 TT=1800.11 T1=1800.4	SAT (TO) f=914 TT=1800.03 T1=1800.3	SAT (TO) f=922 TT=1800.07 T1=1800.4	SAT (TO) f=916 TT=1800.87 T1=47.63	SAT (TO) f=916 TT=1800.09 T1=128.78	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-fast0507.opb	SAT f=251 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=349 TT=1800.12 T1=1800.5	SAT (TO) f=349 TT=1800.1 T1=1800.4	SAT (TO) f=251 TT=1800.09 T1=1800.4	SAT (TO) f=294 TT=1800.06 T1=1800.4	SAT (TO) f=259 TT=1800.05 T1=80.62	SAT (TO) f=259 TT=1800.09 T1=1.37	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-manna81.opb	SAT f=-11615 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT (TO) f=-11615 TT=1800.1 T1=1800.4	SAT (TO) f=-10793 TT=1800.06 T1=1800.4	SAT (TO) f=-9792 TT=1800.08 T1=1800.4	SAT (TO) f=-11306 TT=1800.31 T1=1800.4	SAT (TO) f=-11521 TT=1800.12 T1=69.78	SAT (TO) f=-10910 TT=1800.06 T1=20.82	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mzzv11.opb	OPT f=-10859 TT=217.128 T1=217.11	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=-9909 TT=1800.08 T1=1800.4	OPT f=-10859 TT=217.128 T1=217.11	OPT f=-10859 TT=250.064 T1=250.09	? TT=179.48	SAT (TO) f=-10319 TT=1800.05 T1=136.39	OPT f=-10859 TT=336.933 T1=333.31	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mzzv42z.opb	OPT f=-10270 TT=53.71 T1=53.66	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	OPT f=-10270 TT=456.118 T1=456.2	OPT f=-10270 TT=53.71 T1=53.66	OPT f=-10270 TT=170.322 T1=170.3	? TT=185.58	SAT (TO) f=-10171 TT=1800 T1=177.74	OPT f=-10270 TT=355.05 T1=351.42	OPT f=-10270 TT=65.911 T1=65.84
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-net12.opb	OPT f=214 TT=2.877 T1=2.84	No data	OPT f=214 TT=4.988 T1=4.94	OPT f=214 TT=2.877 T1=2.84	? (TO) TT=1800.05	OPT f=214 TT=954.538 T1=953.92	? (MO) TT=61.054	? (MO) TT=61.599	OPT f=214 TT=17.072 T1=8.32	OPT f=214 TT=7.473 T1=4.58	OPT f=214 TT=40.068 T1=23.42
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-opt1217.opb	SAT f=-16384 TT=1800.75 T1=79.38	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=-12288 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.31 T1=1800.3	? (TO) TT=1800.21	SAT (TO) f=-16384 TT=1800.75 T1=79.38	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-p2756.opb	SAT f=3671 TT=1800.66 T1=156.69	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=151108 TT=1800.05 T1=1800.4	SAT (TO) f=3743 TT=1800.03 T1=1800.4	SAT (TO) f=9372 TT=1800.09 T1=1800.4	? TT=74.482	SAT (TO) f=3671 TT=1800.66 T1=156.69	SAT (TO) f=3719 TT=1800.95 T1=585.32	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-protfold.opb	SAT f=-25 TT=1800.01 T1=1642.99	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-24 TT=1800.1 T1=1800.4	SAT (TO) f=-14 TT=1800.08 T1=1800.4	SAT (TO) f=-14 TT=1800.03 T1=1800.3	SAT (TO) f=-25 TT=1800.01 T1=1800.3	SAT (TO) f=-21 TT=1800.67 T1=463.44	SAT (TO) f=-25 TT=1800.8 T1=1642.99	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-seymour.opb	SAT f=448 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=457 TT=1800.02 T1=1800.3	SAT (TO) f=466 TT=1800.02 T1=1800.3	SAT (TO) f=466 TT=1800.02 T1=1800.3	SAT (TO) f=448 TT=1800.01 T1=1800.3	SAT (TO) f=477 TT=1800.04 T1=230.48	SAT (TO) f=490 TT=1800.06 T1=0.37	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-mitre.opb	SAT f=7680 TT=1800.15 T1=6.29	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT (TO) f=9073 TT=1800.08 T1=1800.4	SAT (TO) f=9331 TT=1800.2 T1=1800.4	? TT=61.417	? TT=62.36	SAT (TO) f=7680 TT=1800.15 T1=6.29	SAT (TO) f=7941 TT=1800.04 T1=1.96	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bm23.opb	OPT f=34 TT=0.171 T1=0.17	No data	OPT f=34 TT=0.294 T1=0.29	OPT f=34 TT=0.171 T1=0.17	OPT f=34 TT=1.184 T1=1.18	OPT f=34 TT=0.486 T1=0.48	OPT f=34 TT=0.527 T1=0.55	OPT f=34 TT=0.773 T1=0.78	OPT f=34 TT=1.305 T1=1.64	OPT f=34 TT=0.644 T1=0.23	OPT f=34 TT=0.986 T1=0.95
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-cracpb1.opb	SAT f=22199 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=30188 TT=1800.1 T1=1800.4	SAT (TO) f=44407 TT=1800.09 T1=1800.4	SAT (TO) f=22199 TT=1800.09 T1=1800.4	? TT=76.441	SAT (TO) f=44331 TT=1800.12 T1=10.79	? (TO) TT=1800.9	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-diamond.opb	UNSAT TT=0	No data	UNSAT TT=0.021	UNSAT TT=0.012	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0	UNSAT TT=0.165	UNSAT TT=0.154	UNSAT TT=0.016
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-l152lav.opb	SAT f=5556 TT=1800.47 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT (TO) f=5614 TT=1800.08 T1=1800.4	SAT (TO) f=5561 TT=1800.01 T1=1800.3	SAT (TO) f=5556 TT=1800.47 T1=1800.3	? (TO) TT=1800.07	? (TO) TT=1800.8	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-lp4l.opb	SAT f=3666 TT=1800.12 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=3666 TT=1800.12 T1=1800.4	SAT (TO) f=4551 TT=1800.09 T1=1800.4	SAT (TO) f=4001 TT=1800.08 T1=1800.4	SAT (TO) f=3899 TT=1800.08 T1=1800.4	SAT (TO) f=3792 TT=1800.77 T1=82.11	SAT (TO) f=3958 TT=1800.01 T1=1314.86	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-lseu.opb	OPT f=1120 TT=34.554 T1=8.14	No data	OPT f=1120 TT=85.011 T1=85.02	OPT f=1120 TT=234.073 T1=234.11	OPT f=1120 TT=37.752 T1=37.75	OPT f=1120 TT=34.554 T1=34.55	OPT f=1120 TT=607.395 T1=607.51	OPT f=1120 TT=275.005 T1=275	OPT f=1120 TT=53.026 T1=10.67	OPT f=1120 TT=49.597 T1=8.14	OPT f=1120 TT=113.609 T1=113.57
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-mod008.opb	OPT f=307 TT=1187.4 T1=0.33	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=321 TT=1800.05 T1=1800.4	SAT (TO) f=409 TT=1800.08 T1=1800.4	? TT=99.756	? TT=98.893	OPT f=307 TT=1187.4 T1=1.2	SAT (TO) f=307 TT=1800.9 T1=0.33	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-mod010.opb	SAT f=7984 TT=1800.16 T1=714.05	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=7984 TT=1800.16 T1=714.05	? (TO) TT=1800.57	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0033.opb	OPT f=3089 TT=0.016 T1=0.01	No data	OPT f=3089 TT=0.048 T1=0.05	OPT f=3089 TT=0.016 T1=0.01	OPT f=3089 TT=0.271 T1=0.27	OPT f=3089 TT=0.207 T1=0.21	OPT f=3089 TT=0.033 T1=0.03	OPT f=3089 TT=0.608 T1=0.6	OPT f=3089 TT=0.723 T1=1.15	OPT f=3089 TT=0.404 T1=0.15	OPT f=3089 TT=0.154 T1=0.15
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0040.opb	OPT f=62027 TT=0.015 T1=0.01	No data	OPT f=62027 TT=0.282 T1=0.28	OPT f=62027 TT=0.075 T1=0.07	OPT f=62027 TT=51.82 T1=51.82	OPT f=62027 TT=1.306 T1=1.3	OPT f=62027 TT=0.015 T1=0.01	? TT=128.93	OPT f=62027 TT=0.815 T1=1.83	OPT f=62027 TT=13.782 T1=0.13	OPT f=62027 TT=19.186 T1=10.37
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0201.opb	OPT f=1523 TT=436.099 T1=0.33	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=1523 TT=544.158 T1=544.24	OPT f=1523 TT=436.099 T1=436.16	OPT f=1523 TT=612.866 T1=612.96	SAT (TO) f=1563 TT=1800.04 T1=1800.4	SAT (TO) f=1523 TT=1800.64 T1=3.72	SAT (TO) f=1523 TT=1800.09 T1=0.33	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0548.opb	SAT f=10087 TT=1800.65 T1=3.22	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=44199 TT=1800.02 T1=1800.3	SAT (TO) f=15217 TT=1800.1 T1=1800.4	SAT (TO) f=59642 TT=1800.07 T1=1800.4	? TT=85.08	SAT (TO) f=10087 TT=1800.65 T1=3.22	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-sentoy.opb	OPT f=-7772 TT=2.588 T1=0.54	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=-7502 TT=1800.01 T1=1800.3	OPT f=-7772 TT=69.279 T1=69.27	? TT=74.237	? TT=74.968	OPT f=-7772 TT=4.562 T1=3.7	OPT f=-7772 TT=2.588 T1=0.54	OPT f=-7772 TT=12.606 T1=7.57
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein15.opb	OPT f=9 TT=0.003 T1=0	No data	OPT f=9 TT=0.023 T1=0.02	OPT f=9 TT=0.013 T1=0.01	OPT f=9 TT=0.004 T1=0	OPT f=9 TT=0.006 T1=0	OPT f=9 TT=0.003 T1=0	OPT f=9 TT=0.003 T1=0	OPT f=9 TT=0.374 T1=0.63	OPT f=9 TT=0.263 T1=0.12	OPT f=9 TT=0.049 T1=0.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein27.opb	OPT f=18 TT=0.046 T1=0.04	No data	OPT f=18 TT=0.329 T1=0.32	OPT f=18 TT=0.285 T1=0.28	OPT f=18 TT=0.165 T1=0.16	OPT f=18 TT=0.139 T1=0.13	OPT f=18 TT=0.046 T1=0.04	OPT f=18 TT=0.14 T1=0.14	OPT f=18 TT=5.502 T1=0.65	OPT f=18 TT=2.134 T1=0.13	OPT f=18 TT=2.517 T1=2.46
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein45.opb	OPT f=30 TT=7.583 T1=1.21	No data	OPT f=30 TT=265.117 T1=265.15	OPT f=30 TT=235.005 T1=235.04	OPT f=30 TT=10.397 T1=10.39	OPT f=30 TT=7.583 T1=7.58	OPT f=30 TT=35.292 T1=35.29	OPT f=30 TT=9.199 T1=9.2	OPT f=30 TT=1723.22 T1=2.18	OPT f=30 TT=582.647 T1=1.21	OPT f=30 TT=420.124 T1=420.13
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein9.opb	OPT f=5 TT=0 T1=0	No data	OPT f=5 TT=0.021 T1=0.02	OPT f=5 TT=0.012 T1=0.01	OPT f=5 TT=0.001 T1=0	OPT f=5 TT=0.001 T1=0	OPT f=5 TT=0 T1=0	OPT f=5 TT=0.001 T1=0	OPT f=5 TT=0.163 T1=0.62	OPT f=5 TT=0.164 T1=0.11	OPT f=5 TT=0.02 T1=0.01
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos10.opb	OPT f=-1135 TT=4.334 T1=2.36	No data	OPT f=-1135 TT=18.457 T1=18.44	OPT f=-1135 TT=13.896 T1=13.89	OPT f=-1135 TT=79.025 T1=79.01	OPT f=-1135 TT=28.36 T1=28.32	OPT f=-1135 TT=92.54 T1=92.53	OPT f=-1135 TT=80.941 T1=80.78	OPT f=-1135 TT=104.858 T1=109.88	OPT f=-1135 TT=4.334 T1=2.36	OPT f=-1135 TT=19.078 T1=19.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos16.opb	SAT f=114 TT=1800.01 T1=40.32	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=114 TT=1800.02 T1=1800.3	SAT (TO) f=114 TT=1800.02 T1=1800.3	SAT (TO) f=122 TT=1800.01 T1=1800.3	? (TO) TT=1800.02	SAT (TO) f=114 TT=1800.18 T1=40.32	SAT (TO) f=114 TT=1800.01 T1=370.93	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos18.opb	OPT f=16 TT=0.043 T1=0.04	No data	OPT f=16 TT=0.182 T1=0.18	OPT f=16 TT=0.131 T1=0.13	OPT f=16 TT=0.115 T1=0.11	OPT f=16 TT=0.106 T1=0.1	OPT f=16 TT=0.043 T1=0.04	OPT f=16 TT=0.047 T1=0.04	OPT f=16 TT=3.59 T1=4.46	OPT f=16 TT=1.507 T1=0.51	OPT f=16 TT=0.617 T1=0.24
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos19.opb		No data	? (exit code) TT=1.354	? (exit code) TT=0.006	? (TO) TT=1800.31	? (TO) TT=1800.13	? TT=38.082	? TT=38.136	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos1.opb	OPT f=19 TT=3.841 T1=3.83	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	OPT f=19 TT=3.841 T1=3.83	OPT f=19 TT=8.465 T1=8.46	OPT f=19 TT=5.774 T1=5.77	OPT f=19 TT=6.279 T1=6.27	SAT (TO) f=22 TT=1800.8 T1=117.48	SAT (TO) f=22 TT=1800.81 T1=1122.57	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos5.opb	OPT f=15360 TT=465.143 T1=465.21	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=15488 TT=1800.02 T1=1800.3	OPT f=15360 TT=465.143 T1=465.21	SAT (TO) f=16409 TT=1800.03 T1=1800.4	SAT (TO) f=16288 TT=1800.04 T1=1800.4	SAT (TO) f=16430 TT=1800.66 T1=707.18	SAT (TO) f=19713 TT=1800.02 T1=1062.77	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos8.opb	OPT f=-3719 TT=0.899 T1=0.89	No data	OPT f=-3719 TT=0.899 T1=0.89	OPT f=-3719 TT=3.575 T1=3.56	OPT f=-3719 TT=120.375 T1=120.36	OPT f=-3719 TT=27.438 T1=27.39	OPT f=-3719 TT=31.353 T1=31.32	OPT f=-3719 TT=49.49 T1=49.28	OPT f=-3719 TT=6.751 T1=10.13	OPT f=-3719 TT=3.255 T1=1.82	OPT f=-3719 TT=14.989 T1=13.61
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-25fv47.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.27	? TT=143.055	? TT=147.209	? (TO) TT=1800.83	? (TO) TT=1800.65	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-80bau3b.opb	UNSAT TT=0.511	No data	UNSAT TT=0.572	UNSAT TT=0.511	UNSAT TT=3.268	UNSAT TT=3.513	? (MO) TT=64.354	? TT=60.395	UNSAT TT=4.393	UNSAT TT=3.176	UNSAT TT=20.375
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-adlittle.opb	SAT f=12 TT=1800.79 T1=153.44	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=95 TT=1800.08 T1=1800.4	? TT=142.792	? TT=137.031	SAT (TO) f=12 TT=1800.79 T1=153.44	? (TO) TT=1800.84	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-afiro.opb	OPT f=-66 TT=6.932 T1=6.92	No data	OPT f=-66 TT=6.932 T1=6.92	OPT f=-66 TT=1141.65 T1=1141.82	SAT (TO) f=-48 TT=1800.02 T1=1800.3	OPT f=-66 TT=46.055 T1=46.06	? TT=158.976	? TT=150.227	OPT f=-66 TT=1609.84 T1=140.29	SAT (TO) f=-62 TT=1800.05 T1=1178.3	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg2.opb	SAT f=16917 TT=1800.19 T1=233.91	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.14	? TT=152.984	? TT=147.859	SAT (TO) f=16917 TT=1800.19 T1=233.91	SAT (TO) f=22499 TT=1800.04 T1=46.44	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg3.opb	SAT f=975 TT=1800.05 T1=1.17	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=142.914	? TT=154.201	SAT (TO) f=49318 TT=1800.81 T1=25.23	SAT (TO) f=975 TT=1800.05 T1=1.17	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg.opb	SAT f=-5638 TT=1800.02 T1=9.07	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=128.962	? TT=127.287	SAT (TO) f=-5638 TT=1800.02 T1=9.07	SAT (TO) f=751 TT=1800.07 T1=1.43	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bandm.opb	UNSAT TT=0.103	No data	UNSAT TT=0.167	UNSAT TT=0.103	UNSAT TT=6.7	UNSAT TT=80.18	? TT=153.988	? TT=162.486	UNSAT TT=3.544	UNSAT TT=1.415	UNSAT TT=1.156
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-beaconfd.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.13	? TT=138.23	? TT=140.01	? (TO) TT=1800.18	? (TO) TT=1800	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-blend.opb	OPT f=-24 TT=68.247 T1=68.25	No data	OPT f=-24 TT=235.139 T1=235.16	OPT f=-24 TT=68.247 T1=68.25	? (TO) TT=1800.06	SAT (TO) f=-19 TT=1800.09 T1=1800.4	? TT=145.648	? TT=139.537	OPT f=-24 TT=562.188 T1=258.32	? (TO) TT=1800	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl1.opb	UNSAT TT=1.223	No data	UNSAT TT=1.248	UNSAT TT=1.223	UNSAT TT=10.852	UNSAT TT=107.417	? TT=166.262	? TT=156.853	UNSAT TT=2.754	UNSAT TT=2.155	UNSAT TT=3.419
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl2.opb	UNSAT TT=2.586	No data	UNSAT TT=2.677	UNSAT TT=2.586	UNSAT TT=67.176	? (TO) TT=1800.41	? TT=139.526	? TT=139.523	UNSAT TT=85.38	UNSAT TT=3.903	UNSAT TT=33.725
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing1.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	? TT=129.306	? TT=128.373	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing2.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=138.725	? TT=137.201	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bore3d.opb	UNSAT TT=0.036	No data	UNSAT TT=0.05	UNSAT TT=0.036	UNSAT TT=0.329	UNSAT TT=0.543	? TT=131.177	? TT=132.967	UNSAT TT=1.613	UNSAT TT=0.988	UNSAT TT=0.486
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-brandy.opb	UNSAT TT=0.222	No data	UNSAT TT=0.248	UNSAT TT=0.222	? (TO) TT=1800.09	UNSAT TT=279.797	? TT=83.682	? TT=84.986	UNSAT TT=2.335	? (TO) TT=1800.03	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-capri.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=129.676	? TT=130.533	? (TO) TT=1800.05	? (TO) TT=1800.59	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-cycle.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.32	? (MO) TT=106.555	? (MO) TT=107.558	? (TO) TT=1800.03	? (TO) TT=1800.59	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-czprob.opb	UNSAT TT=2.403	No data	UNSAT TT=3.316	UNSAT TT=3.318	UNSAT TT=51.113	UNSAT TT=193.705	? TT=178.757	? TT=177.271	UNSAT TT=3.395	UNSAT TT=2.403	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d2q06c.opb	UNSAT TT=52.644	No data	UNSAT TT=52.644	UNSAT TT=54.733	? (TO) TT=1800.02	? (TO) TT=1800.14	? TT=131.639	? TT=133.21	? (TO) TT=1800.84	? (TO) TT=1800.02	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d6cube.opb	UNSAT TT=4.31	No data	UNSAT TT=4.93	UNSAT TT=4.31	? (TO) TT=1800.02	Signal TT=319.173	? TT=114.477	? TT=112.789	UNSAT TT=12.261	UNSAT TT=15.551	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen2.opb	UNSAT TT=0.391	No data	UNSAT TT=0.483	UNSAT TT=0.391	? (TO) TT=1800.1	UNSAT TT=91.733	? TT=96.698	? TT=97.186	UNSAT TT=54.905	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen3.opb	UNSAT TT=1154.83	No data	UNSAT TT=1154.83	UNSAT TT=1277.7	? (TO) TT=1800.04	? (TO) TT=1800.34	? TT=99.512	? TT=98.082	? (TO) TT=1800.06	? (TO) TT=1800.55	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-dfl001.opb		No data	? (exit code) TT=0.537	? (exit code) TT=0.006	? (TO) TT=1800.17	? (TO) TT=1800.07	? TT=122.023	? TT=123.465	? (TO) TT=1800.72	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-e226.opb	UNSAT TT=0.145	No data	UNSAT TT=0.195	UNSAT TT=0.145	UNSAT TT=7.66	UNSAT TT=102.175	? TT=163.856	? TT=164.165	UNSAT TT=3.984	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-etamacro.opb	SAT f=9 TT=1800.64 T1=51.11	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT (TO) f=136 TT=1800.08 T1=1800.4	? TT=138.964	? TT=137.962	SAT (TO) f=9 TT=1800.64 T1=51.11	SAT (TO) f=32 TT=1800.05 T1=19.26	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fffff800.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=98.572	? TT=98.294	? (TO) TT=1800.67	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1d.opb		No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.21	? TT=96.786	? TT=97.488	? (TO) TT=1800	? (TO) TT=1801.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1p.opb	OPT f=0 TT=1.079 T1=1.06	No data	OPT f=0 TT=4.013 T1=3.99	OPT f=0 TT=1.079 T1=1.06	? (TO) TT=1800.03	? (MO) TT=1568.85	? TT=67.975	? TT=68.271	OPT f=0 TT=4.543 T1=2.51	OPT f=0 TT=2.643 T1=1.42	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2d.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	Signal TT=215.112	? (MO) TT=70.013	? (MO) TT=70.295	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2p.opb	SAT f=208 TT=1800.36 T1=41.32	No data	? (exit code) TT=0.732	? (exit code) TT=0.006	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=69.141	? TT=69.49	SAT (TO) f=1782 TT=1800.92 T1=56.41	SAT (TO) f=208 TT=1800.36 T1=41.32	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-forplan.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? TT=78.305	? TT=80.221	? (TO) TT=1800.9	? (TO) TT=1800.91	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ganges.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=61.795	? TT=62.596	? (TO) TT=1800.03	? (TO) TT=1800.65	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-gfrd-pnc.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? TT=140.022	? TT=143.276	? (TO) TT=1800.02	? (TO) TT=1800.64	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbea.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=223.064	? TT=229.849	? (TO) TT=1800.89	? (TO) TT=1800.04	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbeb.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.16	? TT=318.776	? TT=318.522	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow15.opb		No data	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=76.754	? TT=77.472	? (TO) TT=1800.9	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow22.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=74.315	? TT=75.326	? (TO) TT=1800.84	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow7.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.2	? TT=76.18	? TT=75.879	? (TO) TT=1800.79	? (TO) TT=1801.24	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-israel.opb	OPT f=-41 TT=321.257 T1=321.3	No data	OPT f=-41 TT=1571.14 T1=1571.35	OPT f=-41 TT=321.257 T1=321.3	? (TO) TT=1800.03	SAT (TO) f=14 TT=1800.09 T1=1800.5	? TT=157.71	? TT=154.596	OPT f=-41 TT=1643.33 T1=806.1	? (TO) TT=1800.01	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-kb2.opb	OPT f=-293850 TT=0.117 T1=0.12	No data	OPT f=-293850 TT=0.145 T1=0.14	OPT f=-293850 TT=0.117 T1=0.12	OPT f=-293850 TT=98.238 T1=98.25	OPT f=-293850 TT=51.118 T1=51.11	? TT=149.131	? TT=154.173	OPT f=-293850 TT=6.295 T1=4.91	SAT (TO) f=-136357 TT=1800.05 T1=1.79	OPT f=-293850 TT=190.322 T1=190.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-lotfi.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=163.188	? TT=159.427	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2	? TT=130.08	? TT=128.204	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros-r7.opb		No data	? (exit code) TT=0.929	? (exit code) TT=0.005	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=144.815	? TT=149.352	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-modszk1.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.26	? TT=134.075	? TT=135.312	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-nesm.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.43	? TT=64.202	? TT=64.186	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-perold.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	? (MO) TT=108.104	? (MO) TT=107.988	? (TO) TT=1800.67	? (TO) TT=1800.71	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot4.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=112.48	? TT=112.261	? (TO) TT=1800.65	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot87.opb	UNSAT TT=0.627	No data	UNSAT TT=0.904	UNSAT TT=0.627	UNSAT TT=4.741	UNSAT TT=4.754	? (MO) TT=113.162	? (MO) TT=116.526	UNSAT TT=4.242	UNSAT TT=2.724	UNSAT TT=11.516
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.opb	UNSAT TT=0.248	No data	UNSAT TT=0.482	UNSAT TT=0.248	UNSAT TT=5.396	UNSAT TT=6.038	? TT=136.342	? TT=134.66	UNSAT TT=4.773	UNSAT TT=2.963	UNSAT TT=7.872
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.we.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=106.127	? TT=104.569	? (TO) TT=1800.8	? (TO) TT=1800.69	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-recipe.opb	SAT f=-122041 TT=1800.33 T1=842.8	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=201.047	? TT=204.697	SAT (TO) f=-122041 TT=1800.33 T1=842.8	SAT (TO) f=-121839 TT=1800.71 T1=0.96	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc105.opb	SAT f=-14 TT=1800.23 T1=869.91	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT (TO) f=0 TT=1800.07 T1=1800.4	? TT=125.11	? TT=124.592	SAT (TO) f=-14 TT=1800.23 T1=869.91	SAT (TO) f=-3 TT=1800.01 T1=908.73	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc205.opb	SAT f=0 TT=1800.08 T1=0.97	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (MO) TT=123.862	? TT=124.592	SAT (TO) f=0 TT=1800.16 T1=0.97	SAT (TO) f=0 TT=1800.08 T1=1273.47	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50a.opb	SAT f=-35 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-6 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.02 T1=1800.3	? TT=123.345	? TT=123.767	SAT (TO) f=-29 TT=1800.52 T1=838.01	SAT (TO) f=-21 TT=1800.06 T1=435.04	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50b.opb	OPT f=-45 TT=242.948 T1=242.98	No data	OPT f=-45 TT=242.948 T1=242.98	OPT f=-45 TT=895.616 T1=895.75	SAT (TO) f=-17 TT=1800.02 T1=1800.3	SAT (TO) f=-27 TT=1800.1 T1=1800.4	? TT=123.294	? TT=123.786	SAT (TO) f=-35 TT=1800.72 T1=450.24	SAT (TO) f=-23 TT=1800.58 T1=1586.45	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr25.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=123.764	? TT=123.135	? (TO) TT=1800.69	? (TO) TT=1800.63	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr7.opb	SAT f=527 TT=1800.65 T1=106.48	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=124.275	? TT=123.361	SAT (TO) f=527 TT=1800.65 T1=106.48	SAT (TO) f=552 TT=1800.01 T1=70.72	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm1.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=155.571	? TT=156.397	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm2.opb		No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=142.148	? TT=144.376	? (TO) TT=1800.79	? (TO) TT=1800.01	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm3.opb		No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=137.614	? TT=138.281	? (TO) TT=1800.14	? (TO) TT=1800.58	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scorpion.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=137.105	? TT=129.592	? (TO) TT=1800.13	? (TO) TT=1800.58	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scrs8.opb	UNSAT TT=0.166	No data	UNSAT TT=0.227	UNSAT TT=0.166	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=261.209	? TT=259.487	UNSAT TT=4.322	UNSAT TT=44.477	UNSAT TT=33.895
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd1.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=96.98	? TT=97.645	? (TO) TT=1800.77	? (TO) TT=1800.81	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd6.opb		No data	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=100.503	? TT=99.177	? (TO) TT=1800.74	? (TO) TT=1800.03	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd8.opb		No data	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=118.744	? TT=120.584	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.23
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap1.opb	SAT f=297 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT (TO) f=297 TT=1800.08 T1=1800.4	? TT=143.087	? TT=137.184	SAT (TO) f=846 TT=1800.04 T1=4.57	No Cert. TT=1800.06	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap2.opb	SAT f=653 TT=1800.04 T1=44.05	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=816 TT=1800.37 T1=1800.4	? TT=135.63	? TT=136.451	SAT (TO) f=653 TT=1800.04 T1=44.05	No Cert. TT=1801.26	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap3.opb	SAT f=838 TT=1800.79 T1=5.22	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=2093 TT=1800.44 T1=1800.5	? TT=141.92	? TT=141.946	SAT (TO) f=838 TT=1800.79 T1=5.22	No Cert. TT=1800.04	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-seba.opb	UNSAT TT=0.151	No data	UNSAT TT=0.22	UNSAT TT=0.151	UNSAT TT=4.717	UNSAT TT=219.266	? (MO) TT=115.517	? (MO) TT=111.087	UNSAT TT=2.573	UNSAT TT=11.451	UNSAT TT=61.898
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share1b.opb	UNSAT TT=26.507	No data	UNSAT TT=26.507	UNSAT TT=26.983	? (TO) TT=1800.03	UNSAT TT=318.86	? TT=179.033	? TT=187.413	UNSAT TT=182.196	? (TO) TT=1800.02	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share2b.opb	OPT f=-52 TT=0.52 T1=0.51	No data	OPT f=-52 TT=0.683 T1=0.68	OPT f=-52 TT=0.52 T1=0.51	? (TO) TT=1800.03	OPT f=-52 TT=180.735 T1=180.74	? TT=107.464	? TT=107.128	OPT f=-52 TT=4.474 T1=4.01	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-shell.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.18	? (MO) TT=110.808	? (MO) TT=111.087	? (TO) TT=1800.86	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04l.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=103.421	? TT=100.502	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04s.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=86.07	? TT=88.71	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08l.opb		No data	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.22	? TT=105.927	? TT=107.347	? (TO) TT=1800.79	? (TO) TT=1800.01	? (TO) TT=1800.13
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08s.opb		No data	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=92.338	? TT=89.041	? (TO) TT=1800.72	? (TO) TT=1800.63	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12l.opb		No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.32	? TT=86.13	? TT=86.514	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12s.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.51	? TT=99.914	? TT=100.242	? (TO) TT=1800.71	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sierra.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.19	? TT=70.453	? TT=72.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stair.opb	UNSAT TT=2.102	No data	UNSAT TT=2.102	UNSAT TT=2.163	? (TO) TT=1800.07	UNSAT TT=1198.35	? TT=133.672	? TT=132.598	UNSAT TT=140.923	UNSAT TT=1650.43	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standata.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=154.456	? TT=151.969	? (TO) TT=1800.63	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standgub.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=75.756	? TT=75.69	? (TO) TT=1800.18	? (TO) TT=1800.77	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor1.opb	SAT f=-40 TT=1800.02 T1=206.02	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT (TO) f=4399 TT=1800.07 T1=1800.4	? TT=135.475	? TT=137.552	SAT (TO) f=-40 TT=1800.02 T1=206.02	? (TO) TT=1800.54	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor2.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.23	? TT=137.3	? TT=136.97	? (TO) TT=1800.72	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-tuff.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=143.599	? TT=144.997	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-vtp.base.opb	UNSAT TT=5.814	No data	UNSAT TT=13.496	UNSAT TT=13.744	UNSAT TT=108.669	UNSAT TT=59.054	? TT=134.935	? TT=138.653	UNSAT TT=5.814	? (TO) TT=1800.04	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-wood1p.opb	UNSAT TT=193.848	No data	UNSAT TT=198.437	UNSAT TT=193.848	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=72.903	? TT=76.732	? (TO) TT=1800.92	UNSAT TT=1284.91	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-woodw.opb		No data	? (exit code) TT=0.518	? (exit code) TT=0.006	? (TO) TT=1800.05	? (TO) TT=1800.17	? TT=84.58	? TT=85.71	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-a1c1s1.opb	UNSAT TT=1.45	No data	UNSAT TT=1.592	UNSAT TT=1.45	? (TO) TT=1800.09	UNSAT TT=745.75	? TT=117.609	? TT=116.819	UNSAT TT=8.175	UNSAT TT=3.893	UNSAT TT=214.709
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow30a.opb	SAT f=3405 TT=1800.36 T1=847.63	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=107.26	? TT=107.537	SAT (TO) f=3405 TT=1800.36 T1=847.63	No Cert. TT=1800.99	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow40b.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.17	? (MO) TT=65.343	? (MO) TT=63.659	? (TO) TT=1800.11	? (TO) TT=1800.71	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air04.opb	SAT f=5967 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=5967 TT=1800.09 T1=1800.4	SAT (TO) f=5991 TT=1800.06 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.79	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air05.opb	SAT f=4098 TT=1800.12 T1=1800.4	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=4482 TT=1800.12 T1=1800.4	SAT (TO) f=4609 TT=1800.08 T1=1800.4	SAT (TO) f=4098 TT=1800.12 T1=1800.4	? TT=69.455	SAT (TO) f=5293 TT=1800.48 T1=721.7	SAT (TO) f=5852 TT=1800.67 T1=2.85	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-arki001.opb	UNSAT TT=2.515	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=100.018	? TT=92.396	UNSAT TT=2.515	? (TO) TT=1800.01	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-atlanta-ip.opb	UNSAT TT=0.651	No data	UNSAT TT=0.942	UNSAT TT=0.651	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=85.139	? (MO) TT=83.942	UNSAT TT=8.252	UNSAT TT=5.014	UNSAT TT=46.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-dano3mip.opb		No data	? (exit code) TT=0.911	? (exit code) TT=0.006	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=148.843	? TT=139.689	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-danoint.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=142.231	? TT=137.849	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-fiber.opb	OPT f=4372 TT=1413.34 T1=1413.32	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=195272 TT=1800.09 T1=1800.4	OPT f=4372 TT=1413.34 T1=1413.32	? TT=152.988	? TT=150.847	SAT (TO) f=8209 TT=1800.14 T1=1.81	SAT (TO) f=7552 TT=1800.01 T1=0.46	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-fixnet6.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=100.805	? (MO) TT=103.289	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-gesa2-o.opb	SAT f=756 TT=1800.06 T1=34.03	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=1018 TT=1800.08 T1=1800.4	SAT (TO) f=1004 TT=1800.05 T1=1800.4	? TT=141.856	? TT=136.556	SAT (TO) f=786 TT=1800.04 T1=12.11	SAT (TO) f=756 TT=1800.06 T1=34.03	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-gesa2.opb	SAT f=738 TT=1800.04 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=1615 TT=1800.05 T1=1800.4	SAT (TO) f=738 TT=1800.04 T1=1800.4	? TT=143.756	? TT=145.155	SAT (TO) f=777 TT=1800.07 T1=2.95	No Cert. TT=1801.22	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1212 TT=1800.92 T1=492.7	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=5736 TT=1800.06 T1=1800.4	SAT (TO) f=1273 TT=1800.06 T1=1800.4	? TT=144.688	? TT=144.858	SAT (TO) f=1212 TT=1800.92 T1=492.7	No Cert. TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-harp2.opb	SAT f=-8127 TT=1800.71 T1=1.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=-7377 TT=1800.02 T1=1800.3	SAT (TO) f=-5841 TT=1800.08 T1=1800.4	? TT=123.805	? TT=120.743	SAT (TO) f=-8127 TT=1800.71 T1=1.3	SAT (TO) f=-7153 TT=1800.09 T1=6.37	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-liu.opb	SAT f=688 TT=1800.61 T1=1375.81	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=137.095	? TT=138.771	SAT (TO) f=768 TT=1800.22 T1=882.69	SAT (TO) f=688 TT=1800.61 T1=1375.81	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare1.opb	SAT f=9 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.02 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	? TT=158.595	? TT=166.508	SAT (TO) f=41 TT=1800.3 T1=871.14	SAT (TO) f=44 TT=1800.06 T1=1605.69	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare2.opb	SAT f=9 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	? TT=149	? TT=146.176	SAT (TO) f=29 TT=1800.85 T1=282.1	SAT (TO) f=68 TT=1800.02 T1=0.37	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas74.opb	OPT f=1 TT=0.014 T1=0.01	No data	OPT f=1 TT=0.025 T1=0.02	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.093 T1=0.09	OPT f=1 TT=0.051 T1=0.05	? (MO) TT=239.926	? (MO) TT=239.32	OPT f=1 TT=0.365 T1=0.75	OPT f=1 TT=0.344 T1=0.19	OPT f=1 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas76.opb	OPT f=1 TT=0.014 T1=0.01	No data	OPT f=1 TT=0.025 T1=0.02	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.097 T1=0.09	OPT f=1 TT=0.043 T1=0.04	? (MO) TT=238.243	? (MO) TT=230.73	OPT f=1 TT=0.352 T1=0.71	OPT f=1 TT=0.325 T1=0.22	OPT f=1 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-misc07.opb	OPT f=262858 TT=140.83 T1=17.91	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=262859 TT=1800.02 T1=1800.3	OPT f=262858 TT=784.752 T1=784.86	? TT=130.498	? TT=135.985	OPT f=262858 TT=686.832 T1=44.38	OPT f=262858 TT=140.83 T1=17.91	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-mkc.opb	SAT f=-3323 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=-3323 TT=1800.1 T1=1800.4	SAT (TO) f=4426 TT=1800.03 T1=1800.4	? TT=91.242	? TT=92.336	SAT (TO) f=-3137 TT=1800.18 T1=572.22	SAT (TO) f=-3121 TT=1800.03 T1=0.56	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mod011.opb		No data	? (exit code) TT=0.385	? (exit code) TT=0.007	? (TO) TT=1800.03	? (TO) TT=1800.48	? TT=66.209	? TT=66.829	? (TO) TT=1800.78	? (TO) TT=1800.68	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-modglob.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=155.43	? TT=154.355	? (TO) TT=1800.85	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum1.opb	UNSAT TT=0.426	No data	UNSAT TT=0.458	UNSAT TT=0.426	UNSAT TT=2.363	UNSAT TT=2.343	? (MO) TT=416.496	? (MO) TT=385.918	UNSAT TT=4.344	UNSAT TT=2.456	UNSAT TT=4.722
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum2.opb	UNSAT TT=1.573	No data	UNSAT TT=1.913	UNSAT TT=1.573	UNSAT TT=17.015	UNSAT TT=16.979	? (MO) TT=199.839	? (MO) TT=200.91	UNSAT TT=11.662	UNSAT TT=7.033	UNSAT TT=802.808
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum3.opb	SAT f=407422 TT=1800.19 T1=158.45	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=85.413	? (MO) TT=86.557	SAT (TO) f=407422 TT=1800.19 T1=158.45	SAT (TO) f=408052 TT=1800.06 T1=190.01	? (TO) TT=1800.42
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-msc98-ip.opb	UNSAT TT=1373.53	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=78.814	? TT=79.051	UNSAT TT=1373.53	? (TO) TT=1800.58	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-noswot.opb	OPT f=-7 TT=0.024 T1=0.02	No data	OPT f=-7 TT=0.038 T1=0.03	OPT f=-7 TT=0.024 T1=0.02	OPT f=-7 TT=7.142 T1=7.13	OPT f=-7 TT=3.188 T1=3.18	? TT=144.21	? TT=144.393	OPT f=-7 TT=1.324 T1=0.79	SAT (TO) f=-7 TT=1800.58 T1=0.33	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-nsrand-ipx.opb	SAT f=295446 TT=1800.82 T1=701.63	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=520663 TT=1800.1 T1=1800.5	SAT (TO) f=497871 TT=1800.04 T1=1800.7	? TT=81.19	? TT=80.391	SAT (TO) f=295446 TT=1800.82 T1=701.63	SAT (TO) f=524296 TT=1800.05 T1=0.95	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-nw04.opb	SAT f=73 TT=1800.04 T1=1800.3	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT f=96 TT=236.13 T1=235.6	SAT (TO) f=142 TT=1800.05 T1=1800.3	SAT (TO) f=73 TT=1800.04 T1=1800.3	SAT (TO) f=86 TT=1800.19 T1=800.61	No Cert. TT=1800.06	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pk1.opb	SAT f=21 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.02 T1=1800.3	SAT (TO) f=33 TT=1800.09 T1=1800.4	? TT=131.466	? TT=133.149	? (TO) TT=1800.64	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pp08aCUTS.opb	SAT f=8084 TT=1800.24 T1=880.08	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=138.508	? (MO) TT=137.953	SAT (TO) f=8084 TT=1800.24 T1=880.08	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-pp08a.opb		No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=130.01	? TT=129.132	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-qiu.opb		No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=208.163	? TT=206.102	? (TO) TT=1800.57	? (TO) TT=1800.66	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-rd-rplusc-21.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=126.996	? TT=128.184	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.33
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=450588 TT=1800.03 T1=1657.34	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=77.272	? TT=78.156	SAT (TO) f=507933 TT=1800.53 T1=845.8	SAT (TO) f=450588 TT=1800.03 T1=1657.34	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-rout.opb	SAT f=262441 TT=1800.7 T1=195.94	No data	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=262484 TT=1800.01 T1=1800.3	SAT (TO) f=262548 TT=1800.08 T1=1800.4	? TT=115.573	? TT=122.411	SAT (TO) f=262441 TT=1800.7 T1=195.94	SAT (TO) f=262475 TT=1800.09 T1=252.53	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-set1ch.opb	SAT f=1755 TT=1800.02 T1=68.81	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=7008 TT=1800.04 T1=1800.4	? TT=138.194	? TT=138.121	SAT (TO) f=5458 TT=1800.09 T1=9.16	SAT (TO) f=1755 TT=1800.02 T1=68.81	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=52 TT=1800.04 T1=9.22	No data	? (exit code) TT=2.433	? (exit code) TT=0.006	SAT (TO) f=57 TT=1800.15 T1=1800.4	SAT (TO) f=57 TT=1800.16 T1=1800.4	? TT=77.366	? TT=77.799	SAT (TO) f=52 TT=1800.04 T1=9.22	No Cert. TT=1800.79	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-stp3d.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.73	? (TO) TT=1800.09	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-swath.opb	SAT f=262299 TT=1800.63 T1=371.28	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=72.197	? TT=73.22	SAT (TO) f=262299 TT=1800.63 T1=371.28	SAT (TO) f=266262 TT=1800.08 T1=853.37	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-t1717.opb	SAT f=660 TT=113.085 T1=112.5	No data	? (TO) TT=1800.04	? (TO) TT=1801.29	SAT (TO) f=660 TT=1800.04 T1=1800.4	SAT (MO) f=660 TT=113.085 T1=112.5	SAT (TO) f=664 TT=1800.09 T1=1800.4	SAT (TO) f=664 TT=1800.1 T1=1800.4	SAT (TO) f=1170 TT=1800 T1=13.36	No Cert. TT=1800.09	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab1.opb	SAT f=162257 TT=1800.11 T1=1.88	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=142.282	? TT=137.577	SAT (TO) f=162257 TT=1800.11 T1=1.88	SAT (TO) f=181135 TT=1800.04 T1=0.6	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab2.opb	SAT f=202233 TT=1800.12 T1=1.95	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=128.999	? (MO) TT=130.078	SAT (TO) f=202233 TT=1800.12 T1=1.95	SAT (TO) f=212655 TT=1800.04 T1=1.22	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-tr12-30.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.06	? TT=137.926	? TT=138.459	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1800.96 T1=45.5	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=134.452	? TT=159.149	SAT (TO) f=39649 TT=1800.96 T1=45.5	SAT (TO) f=41696 TT=1801 T1=12.94	? (TO) TT=1800.24
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-vpm2.opb	SAT f=66 TT=1800.61 T1=1756.25	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=133.083	? TT=130.007	SAT (TO) f=157 TT=1800.85 T1=2.32	SAT (TO) f=66 TT=1800.61 T1=1756.25	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-blend2.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.79	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-gesa3_o.opb	SAT f=673 TT=1800.58 T1=97.77	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=862 TT=1800.04 T1=1800.4	SAT (TO) f=936 TT=1800.05 T1=1800.4	? TT=155.665	? TT=152.38	SAT (TO) f=724 TT=1800.1 T1=7.61	SAT (TO) f=673 TT=1800.58 T1=97.77	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gesa3.opb	SAT f=238 TT=1800.12 T1=1800.5	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1462 TT=1800.03 T1=1800.4	SAT (TO) f=238 TT=1800.12 T1=1800.5	? TT=124.353	? TT=122.085	SAT (TO) f=548 TT=1800.19 T1=6.35	SAT (TO) f=548 TT=1800.03 T1=3.15	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gt2.opb	OPT f=3591 TT=3.122 T1=2.22	No data	? (TO) TT=1800.02	OPT f=3591 TT=1024 T1=1024.16	SAT (TO) f=9457 TT=1800.02 T1=1800.3	SAT (TO) f=4818 TT=1800.09 T1=1800.4	SAT (TO) f=5521 TT=1800.28 T1=1800.4	? TT=110.703	OPT f=3591 TT=3.122 T1=2.22	SAT (TO) f=3591 TT=1800.03 T1=647.87	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-qnet1_o.opb	SAT f=209 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=1815 TT=1800.1 T1=1800.4	SAT (TO) f=209 TT=1800.07 T1=1800.4	? TT=156.075	? TT=151.649	SAT (TO) f=359 TT=1800.1 T1=1.9	SAT (TO) f=355 TT=1800.65 T1=0.62	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-qnet1.opb	SAT f=316 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=1836 TT=1800.08 T1=1800.4	SAT (TO) f=316 TT=1800.08 T1=1800.4	? TT=153.983	? TT=154.123	SAT (TO) f=426 TT=1800.06 T1=0.84	SAT (TO) f=426 TT=1800.09 T1=0.55	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air01.opb	OPT f=1496 TT=1.234 T1=0.52	No data	OPT f=1496 TT=18.549 T1=18.54	OPT f=1496 TT=2.876 T1=2.87	OPT f=1496 TT=1591.61 T1=1591.91	OPT f=1496 TT=41.585 T1=41.48	OPT f=1496 TT=1.234 T1=1.23	OPT f=1496 TT=32.099 T1=31.92	OPT f=1496 TT=5.05 T1=4.78	OPT f=1496 TT=2.142 T1=0.52	OPT f=1496 TT=91.451 T1=91.4
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air02.opb	OPT f=313 TT=209.34 T1=200.17	No data	OPT f=313 TT=912.239 T1=912.41	OPT f=313 TT=1687.85 T1=1688.11	SAT (TO) f=399 TT=1800.04 T1=1800.4	SAT (TO) f=521 TT=1800.18 T1=1800.4	SAT (TO) f=313 TT=1800.04 T1=1800.3	? TT=71.605	SAT (TO) f=340 TT=1800.19 T1=743.65	OPT f=313 TT=209.34 T1=200.17	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air03.opb	SAT f=7962 TT=1800.09 T1=555.93	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=8372 TT=1800.15 T1=1800.4	SAT (TO) f=8804 TT=1800.16 T1=1800.4	SAT (TO) f=25111 TT=1800.03 T1=1800.3	? TT=73.106	SAT (TO) f=7962 TT=1800.09 T1=555.93	No Cert. TT=1800.09	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air06.opb	SAT f=6016 TT=1800.14 T1=1800.4	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT (TO) f=7479 TT=1800.07 T1=1800.4	SAT (TO) f=6016 TT=1800.14 T1=1800.4	SAT (TO) f=7206 TT=1800.02 T1=1800.3	? TT=165.421	SAT (TO) f=7565 TT=1800.18 T1=677.55	SAT (TO) f=7491 TT=1800.05 T1=1144.59	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3a.opb	SAT f=720 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=17938 TT=1800.08 T1=1800.4	SAT (TO) f=720 TT=1800.08 T1=1800.4	? TT=130.573	? TT=133.674	SAT (TO) f=815 TT=1800 T1=11.88	SAT (TO) f=1814 TT=1800.01 T1=374.47	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3b.opb	SAT f=989 TT=1800.18 T1=185.88	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=27699 TT=1800.1 T1=1800.4	SAT (TO) f=998 TT=1800.07 T1=1800.4	? TT=124.932	? TT=129.182	SAT (TO) f=989 TT=1800.18 T1=185.88	SAT (TO) f=1864 TT=1800.09 T1=769.03	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell4.opb	SAT f=1381 TT=1800.45 T1=738.6	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=16765 TT=1800.1 T1=1800.4	SAT (TO) f=1546 TT=1800.09 T1=1800.4	? TT=125.252	? TT=126.184	SAT (TO) f=1381 TT=1800.45 T1=738.6	SAT (TO) f=1664 TT=1800 T1=1739.9	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell5.opb	SAT f=788 TT=1800.64 T1=41.78	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2943 TT=1800.09 T1=1800.4	SAT (TO) f=1021 TT=1800.09 T1=1800.4	? TT=120.245	? TT=122.767	SAT (TO) f=956 TT=1800.68 T1=58.31	SAT (TO) f=788 TT=1800.64 T1=41.78	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-dcmulti.opb	SAT f=922 TT=1800.13 T1=265.41	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=122.252	? TT=124.523	SAT (TO) f=922 TT=1800.13 T1=265.41	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-egout.opb	SAT f=117 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=182 TT=1800.02 T1=1800.3	SAT (TO) f=117 TT=1800.1 T1=1800.4	? (MO) TT=448.769	? (MO) TT=469.296	SAT (TO) f=125 TT=1800 T1=548.51	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-enigma.opb	OPT f=0 TT=0.127 T1=0.12	No data	OPT f=0 TT=0.312 T1=0.31	OPT f=0 TT=0.454 T1=0.45	OPT f=0 TT=61.967 T1=61.97	OPT f=0 TT=2.002 T1=2	? TT=142.042	? TT=136.871	OPT f=0 TT=0.984 T1=0.65	OPT f=0 TT=0.505 T1=0.25	OPT f=0 TT=0.127 T1=0.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet3.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (MO) TT=102.24	? (MO) TT=102.781	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet4.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (MO) TT=104.229	? (MO) TT=104.065	? (TO) TT=1800.71	? (TO) TT=1801.15	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-flugpl.opb	OPT f=91 TT=0.131 T1=0.13	No data	OPT f=91 TT=0.131 T1=0.13	OPT f=91 TT=0.167 T1=0.16	OPT f=91 TT=1.813 T1=1.81	OPT f=91 TT=1.465 T1=1.46	? TT=140.968	? TT=140.325	OPT f=91 TT=4.483 T1=6.69	OPT f=91 TT=629.4 T1=527.63	OPT f=91 TT=408.705 T1=68.84
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-gen.opb	SAT f=551 TT=1800.01 T1=3.65	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=1433 TT=1800.09 T1=1800.4	SAT (TO) f=784 TT=1800.06 T1=1800.4	? TT=135.253	? TT=134.549	SAT (TO) f=551 TT=1800.01 T1=3.65	? (TO) TT=1800.76	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib/normalized-reduced-mps-v2-20-10-khb05250.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.91	? (TO) TT=1800.06	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc01.opb	OPT f=262288 TT=0.241 T1=0.24	No data	OPT f=262288 TT=0.28 T1=0.28	OPT f=262288 TT=0.241 T1=0.24	OPT f=262288 TT=3.192 T1=3.19	OPT f=262288 TT=5.211 T1=5.21	OPT f=262288 TT=1262.79 T1=1262.89	OPT f=262288 TT=185.679 T1=185.49	OPT f=262288 TT=3.984 T1=2.66	OPT f=262288 TT=1.984 T1=0.77	OPT f=262288 TT=7.698 T1=7.48
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc02.opb	OPT f=262571 TT=0.041 T1=0.04	No data	OPT f=262571 TT=0.055 T1=0.05	OPT f=262571 TT=0.041 T1=0.04	OPT f=262571 TT=1.141 T1=1.14	OPT f=262571 TT=4.246 T1=4.24	OPT f=262571 TT=388.744 T1=388.39	OPT f=262571 TT=178.565 T1=178.04	OPT f=262571 TT=2.885 T1=2.15	OPT f=262571 TT=1.204 T1=0.37	OPT f=262571 TT=2.197 T1=1.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc03.opb	OPT f=262989 TT=4.492 T1=1.92	No data	OPT f=262989 TT=7.418 T1=7.41	OPT f=262989 TT=6.997 T1=7	OPT f=262989 TT=86.474 T1=86.49	OPT f=262989 TT=24.645 T1=24.64	? TT=127.651	? TT=125.476	OPT f=262989 TT=10.701 T1=7.21	OPT f=262989 TT=4.492 T1=1.92	OPT f=262989 TT=27.686 T1=20.53
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc04.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=110.494	? TT=106.196	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc05.opb	UNSAT TT=0.028	No data	UNSAT TT=0.043	UNSAT TT=0.028	UNSAT TT=0.727	UNSAT TT=39.408	? TT=114.376	? TT=115.811	UNSAT TT=18.191	UNSAT TT=5.673	UNSAT TT=129.436
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc06.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? TT=136.412	? TT=143.031	? (TO) TT=1800.68	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-mod013.opb	OPT f=19 TT=5.998 T1=5.99	No data	? (TO) TT=1800.02	OPT f=19 TT=214.627 T1=214.66	OPT f=19 TT=43.357 T1=43.36	OPT f=19 TT=5.998 T1=5.99	? TT=148.679	? TT=153.705	SAT (TO) f=19 TT=1800.08 T1=66.81	SAT (TO) f=21 TT=1800.9 T1=114.43	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0282.opb	OPT f=104028 TT=0.799 T1=0.49	No data	OPT f=104028 TT=4.239 T1=4.24	OPT f=104028 TT=6.389 T1=6.41	OPT f=104028 TT=704.545 T1=704.65	OPT f=104028 TT=19.928 T1=19.89	OPT f=104028 TT=1297.66 T1=1297.92	? TT=90.841	OPT f=104028 TT=3.014 T1=11.23	OPT f=104028 TT=1.104 T1=0.49	OPT f=104028 TT=0.799 T1=0.53
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0291.opb	OPT f=7985 TT=0.102 T1=0.1	No data	OPT f=7985 TT=0.11 T1=0.11	OPT f=7985 TT=0.102 T1=0.1	OPT f=7985 TT=27.377 T1=27.36	OPT f=7985 TT=8.976 T1=8.96	OPT f=7985 TT=2.44 T1=2.43	? TT=123.666	OPT f=7985 TT=1.145 T1=5.7	OPT f=7985 TT=0.483 T1=0.24	OPT f=7985 TT=0.275 T1=0.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p6000.opb	SAT f=-73511 TT=1800.71 T1=173.76	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=70.097	? TT=70.262	SAT (TO) f=-73511 TT=1800.71 T1=173.76	? (TO) TT=1800.06	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-pipex.opb	OPT f=164393 TT=0.25 T1=0.25	No data	OPT f=164393 TT=1.022 T1=1.02	OPT f=164393 TT=0.25 T1=0.25	OPT f=164393 TT=64.922 T1=64.92	OPT f=164393 TT=8.156 T1=8.15	OPT f=164393 TT=75.223 T1=75.23	? TT=129.307	OPT f=164393 TT=6.274 T1=7.66	OPT f=164393 TT=9.372 T1=6.79	OPT f=164393 TT=61.876 T1=49.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-rgn.opb	SAT f=90984 TT=1800.86 T1=31.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=129.445	? TT=134.755	SAT (TO) f=90984 TT=1800.86 T1=31.3	SAT (TO) f=102879 TT=1800.72 T1=759.85	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-sample2.opb	OPT f=5 TT=0.114 T1=0.11	No data	OPT f=5 TT=0.114 T1=0.11	OPT f=5 TT=0.431 T1=0.42	OPT f=5 TT=9.156 T1=9.15	OPT f=5 TT=1.263 T1=1.25	? TT=189.335	? TT=191.118	OPT f=5 TT=18.42 T1=10.76	OPT f=5 TT=155.34 T1=153.28	OPT f=5 TT=6.852 T1=6.79
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1al.opb	SAT f=9004 TT=1800.83 T1=57.38	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT (TO) f=10699 TT=1800.06 T1=1800.4	? TT=83.169	? TT=82.992	SAT (TO) f=9004 TT=1800.83 T1=57.38	? (TO) TT=1800.62	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1cl.opb	SAT f=2649 TT=1800.04 T1=289.94	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT (TO) f=12465 TT=1800.07 T1=1800.4	? TT=81.43	? TT=82.82	SAT (TO) f=2649 TT=1800.04 T1=289.94	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-vpm1.opb	OPT f=20 TT=67.765 T1=67.71	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.629	? TT=153.479	? (TO) TT=1800.74	? (TO) TT=1800.68	OPT f=20 TT=67.765 T1=67.71
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bal8x12.opb	UNSAT TT=0.032	No data	UNSAT TT=0.047	UNSAT TT=0.032	UNSAT TT=41.496	UNSAT TT=23.977	? TT=142.034	? TT=140.991	UNSAT TT=3.033	? (TO) TT=1800.08	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bk4x3.opb	OPT f=14 TT=0.181 T1=0.18	No data	OPT f=14 TT=0.181 T1=0.18	OPT f=14 TT=0.193 T1=0.19	OPT f=14 TT=5.112 T1=5.11	OPT f=14 TT=1.077 T1=1.07	OPT f=14 TT=151.634 T1=151.35	OPT f=14 TT=259.434 T1=259.13	OPT f=14 TT=552.569 T1=14.2	SAT (TO) f=15 TT=1800.06 T1=19.29	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-gr4x6.opb	UNSAT TT=0.016	No data	UNSAT TT=0.027	UNSAT TT=0.016	UNSAT TT=7.499	UNSAT TT=0.569	? TT=148.972	? TT=159.598	UNSAT TT=1.154	? (TO) TT=1800	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3700.opb		No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=141.138	? TT=142.973	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3701.opb		No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? TT=141.57	? TT=148.229	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3702.opb		No data	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=141.251	? TT=143.537	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3703.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=138.241	? TT=140.204	? (TO) TT=1800.98	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3704.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=140.591	? TT=147.996	? (TO) TT=1800.72	? (TO) TT=1800.79	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3705.opb		No data	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=141.298	? TT=144.219	? (TO) TT=1800.02	? (TO) TT=1800.62	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3706.opb		No data	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=141.792	? TT=145.338	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3707.opb		No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=139.199	? TT=144.035	? (TO) TT=1802.21	? (TO) TT=1800.61	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3708.opb		No data	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=140.82	? TT=144.369	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3709.opb		No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=141.111	? TT=143.915	? (TO) TT=1800.14	? (TO) TT=1800.75	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370a.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=140.965	? TT=144.116	? (TO) TT=1800.17	? (TO) TT=1800.65	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370b.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=141.729	? TT=145.616	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370c.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=140.697	? TT=145.309	? (TO) TT=1800.77	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370e.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=147.291	? TT=143.748	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10a.opb	OPT f=20 TT=0.261 T1=0.26	No data	OPT f=20 TT=1.044 T1=1.04	OPT f=20 TT=0.261 T1=0.26	OPT f=20 TT=2.346 T1=2.34	OPT f=20 TT=1.563 T1=1.55	? TT=160.558	? TT=160.033	SAT (TO) f=20 TT=1800.91 T1=0.85	SAT (TO) f=20 TT=1800.03 T1=0.35	OPT f=20 TT=0.307 T1=0.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10b.opb	UNSAT TT=0.023	No data	UNSAT TT=0.036	UNSAT TT=0.023	UNSAT TT=5.907	UNSAT TT=14.24	? TT=162.964	? TT=161.446	UNSAT TT=1.974	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10c.opb	UNSAT TT=0.026	No data	UNSAT TT=0.04	UNSAT TT=0.026	UNSAT TT=5.394	UNSAT TT=9.901	? TT=163.407	? TT=158.649	UNSAT TT=3.033	? (TO) TT=1800.7	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x12.opb	UNSAT TT=0.03	No data	UNSAT TT=0.046	UNSAT TT=0.03	UNSAT TT=19.302	UNSAT TT=20.594	? TT=139.484	? TT=140.85	UNSAT TT=5.613	? (TO) TT=1800.13	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x26.opb	UNSAT TT=0.064	No data	UNSAT TT=0.088	UNSAT TT=0.064	UNSAT TT=38.406	UNSAT TT=43.132	? TT=132.604	? TT=133.335	UNSAT TT=4.703	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x12.opb	UNSAT TT=0.034	No data	UNSAT TT=0.051	UNSAT TT=0.034	UNSAT TT=643.936	UNSAT TT=386.504	? TT=134.085	? TT=139.905	UNSAT TT=5.234	? (TO) TT=1800.09	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x21.opb	UNSAT TT=0.062	No data	UNSAT TT=0.083	UNSAT TT=0.062	UNSAT TT=34.867	UNSAT TT=201.639	? TT=154.623	? TT=149.867	UNSAT TT=4.361	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran13x13.opb	UNSAT TT=0.04	No data	UNSAT TT=0.058	UNSAT TT=0.04	UNSAT TT=1203.33	? (TO) TT=1800.11	? TT=147.873	? TT=154.964	UNSAT TT=6.493	? (TO) TT=1800.66	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran14x18.opb	UNSAT TT=0.064	No data	UNSAT TT=0.085	UNSAT TT=0.064	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=155.32	? TT=153.895	UNSAT TT=8.543	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran16x16.opb	OPT f=35 TT=4.984 T1=4.91	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=35 TT=1800.02 T1=1800.3	OPT f=35 TT=6.705 T1=6.69	? TT=153.376	? TT=165.753	SAT (TO) f=37 TT=1800.84 T1=1.57	SAT (TO) f=37 TT=1800.03 T1=0.61	OPT f=35 TT=4.984 T1=4.91
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran17x17.opb	OPT f=35 TT=5.327 T1=5.25	No data	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=35 TT=1800.02 T1=1800.3	OPT f=35 TT=8.624 T1=8.59	? TT=132.755	? TT=140.775	SAT (TO) f=36 TT=1800.01 T1=87.13	SAT (TO) f=38 TT=1800.06 T1=0.7	OPT f=35 TT=5.327 T1=5.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran4x64.opb	UNSAT TT=0.065	No data	UNSAT TT=0.09	UNSAT TT=0.065	UNSAT TT=1.603	UNSAT TT=0.737	? TT=148.465	? TT=147.092	UNSAT TT=3.703	? (TO) TT=1800.87	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran6x43.opb	UNSAT TT=0.071	No data	UNSAT TT=0.093	UNSAT TT=0.071	UNSAT TT=1.608	UNSAT TT=1.144	? TT=128.651	? TT=132.049	UNSAT TT=3.443	? (TO) TT=1800.92	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran8x32.opb	UNSAT TT=0.074	No data	UNSAT TT=0.098	UNSAT TT=0.074	UNSAT TT=3.451	UNSAT TT=4.119	? TT=145.285	? TT=143.78	UNSAT TT=4.103	? (TO) TT=1800.08	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome11.opb		No data	? (exit code) TT=1.074	? (exit code) TT=0.006	? (TO) TT=1800.27	? (TO) TT=1800.1	? TT=125.571	? TT=126.811	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bc1.opb	UNSAT TT=183.597	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? (MO) TT=101.459	? (MO) TT=102.63	UNSAT TT=363.81	UNSAT TT=183.597	UNSAT TT=447.611
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst1.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=129.726	? TT=125.807	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst2.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=132.63	? TT=135.853	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_3.opb		No data	? (exit code) TT=0.941	? (exit code) TT=0.005	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=112.769	? TT=111.572	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_4.opb		No data	? (exit code) TT=0.945	? (exit code) TT=0.005	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=111.52	? TT=110.412	? (TO) TT=1800.7	? (TO) TT=1800.66	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_5.opb		No data	? (exit code) TT=0.938	? (exit code) TT=0.006	? (TO) TT=1800.02	? (TO) TT=1800.14	? TT=111.393	? TT=111.334	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare1_1.opb	OPT f=0 TT=37.742 T1=37.74	No data	OPT f=0 TT=37.742 T1=37.74	OPT f=0 TT=230.281 T1=230.31	SAT (TO) f=24 TT=1800.02 T1=1800.3	SAT (TO) f=7 TT=1800.01 T1=1800.3	? TT=142.284	? TT=152.27	SAT (TO) f=24 TT=1800.74 T1=1.69	SAT (TO) f=21 TT=1800 T1=1494.93	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare2_1.opb	OPT f=0 TT=55.86 T1=55.86	No data	OPT f=0 TT=55.86 T1=55.86	OPT f=0 TT=420.676 T1=420.75	SAT (TO) f=46 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.02 T1=1800.3	? TT=145.625	? TT=141.762	SAT (TO) f=42 TT=1800.08 T1=875.93	SAT (TO) f=51 TT=1800.03 T1=448.37	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-mkc1.opb	SAT f=-2552 TT=1800.67 T1=1	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT (TO) f=1595 TT=1800.28 T1=1800.4	? TT=85.573	? TT=86.437	SAT (TO) f=-2552 TT=1800.67 T1=2.08	SAT (TO) f=-2552 TT=1802.19 T1=1	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos11.opb	UNSAT TT=0.071	No data	UNSAT TT=0.113	UNSAT TT=0.071	UNSAT TT=0.889	UNSAT TT=20.323	? (MO) TT=146.399	? (MO) TT=148.107	UNSAT TT=3.035	UNSAT TT=1.784	UNSAT TT=1.177
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos12.opb	UNSAT TT=0.24	No data	UNSAT TT=0.373	UNSAT TT=0.24	UNSAT TT=3.612	UNSAT TT=53.351	? TT=145.47	? TT=147.52	UNSAT TT=3.594	UNSAT TT=2.432	UNSAT TT=3.803
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos13.opb	SAT f=-18596 TT=1800.04 T1=167.25	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? TT=121.817	? TT=120.651	SAT (TO) f=-18596 TT=1800.04 T1=167.25	? (TO) TT=1800.89	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos14.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=139.976	? TT=140.374	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos15.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=139.115	? TT=140.65	? (TO) TT=1800.73	? (TO) TT=1800.76	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos17.opb	UNSAT TT=0.073	No data	UNSAT TT=0.112	UNSAT TT=0.073	UNSAT TT=2.863	UNSAT TT=18.24	? TT=137.351	? TT=134.863	UNSAT TT=2.086	UNSAT TT=1.273	UNSAT TT=0.522
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos20.opb	OPT f=-71 TT=53.063 T1=53.07	No data	OPT f=-71 TT=124.471 T1=124.48	OPT f=-71 TT=53.063 T1=53.07	SAT (TO) f=-63 TT=1800.02 T1=1800.3	SAT (TO) f=-68 TT=1800.06 T1=1800.4	? (MO) TT=106.068	? (MO) TT=106.575	SAT (TO) f=-60 TT=1801.03 T1=109.06	SAT (TO) f=-56 TT=1800.08 T1=30.37	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos2.opb	OPT f=3 TT=3.94 T1=3.93	No data	OPT f=3 TT=4.462 T1=4.45	OPT f=3 TT=3.94 T1=3.93	OPT f=3 TT=81.522 T1=81.51	OPT f=3 TT=254.119 T1=254.14	? TT=72.848	? TT=73.663	SAT (TO) f=3 TT=1800.01 T1=31.22	SAT (TO) f=3 TT=1800.04 T1=76.95	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos3.opb	OPT f=2 TT=6.906 T1=6.89	No data	OPT f=2 TT=10.612 T1=10.6	OPT f=2 TT=6.906 T1=6.89	OPT f=2 TT=168.813 T1=168.84	OPT f=2 TT=372.008 T1=371.94	? TT=72.798	? TT=73.412	OPT f=2 TT=195.234 T1=96.84	OPT f=2 TT=555.922 T1=552.51	OPT f=2 TT=312.332 T1=310.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos6.opb	OPT f=0 TT=82.16 T1=82.11	No data	OPT f=0 TT=82.16 T1=82.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=131.055	? TT=131.755	? (TO) TT=1800.12	? (TO) TT=1800.75	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos7.opb	SAT f=43 TT=1800.03 T1=1.74	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=101 TT=1800.07 T1=1800.4	SAT (TO) f=132 TT=1800.08 T1=1800.4	? TT=111.993	? TT=111.635	SAT (TO) f=48 TT=1800.96 T1=1.72	SAT (TO) f=43 TT=1800.03 T1=1.74	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos9.opb		No data	? (exit code) TT=1.647	? (exit code) TT=0.006	? (TO) TT=1800.21	? (TO) TT=1800.29	? TT=38.888	? TT=38.594	? (TO) TT=1800.73	? (TO) TT=1800.62	? (TO) TT=1800.38
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-nug08.opb	OPT f=18 TT=6.155 T1=0.96	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=18 TT=1800.04 T1=1800.4	OPT f=18 TT=446.427 T1=446.4	? TT=141.871	? TT=143.133	SAT (TO) f=18 TT=1800.74 T1=1.5	SAT (TO) f=18 TT=1800.08 T1=0.96	OPT f=18 TT=6.155 T1=3.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-qap10.opb	SAT f=29 TT=1800.06 T1=2.02	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=29 TT=1800.08 T1=1800.4	SAT (TO) f=29 TT=1800.12 T1=1800.4	? TT=142.808	? TT=144.062	SAT (TO) f=29 TT=1800.92 T1=2.88	SAT (TO) f=29 TT=1800.06 T1=2.02	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-seymour1.opb	SAT f=106974 TT=1800.16 T1=287.52	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=192220 TT=1800.05 T1=1800.4	SAT (TO) f=126479 TT=1800.17 T1=1800.4	? (MO) TT=79.923	? (MO) TT=80.134	SAT (TO) f=106974 TT=1800.16 T1=287.52	SAT (TO) f=107713 TT=1800.42 T1=1.04	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath1.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? TT=1352.1	? TT=75.546	? TT=71.64	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath2.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1301.36	? TT=71.78	? TT=71.864	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath3.opb		No data	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1265.05	? TT=72.448	? TT=72.338	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A1C1S1.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? TT=143.685	? TT=143.465	? (TO) TT=1800.76	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A2C1S1.opb	UNSAT TT=875.798	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=875.798	? TT=142.198	? TT=142.154	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B1C1S1.opb	UNSAT TT=275.589	No data	UNSAT TT=1188.27	UNSAT TT=1225.1	? (TO) TT=1800.08	UNSAT TT=275.589	? TT=152.686	? TT=149.697	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B2C1S1.opb	UNSAT TT=275.909	No data	UNSAT TT=943.417	UNSAT TT=973.663	? (TO) TT=1800.1	UNSAT TT=275.909	? TT=152.153	? TT=150.262	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-berlin_5_8_0.opb	OPT f=2 TT=87.959 T1=87.94	No data	OPT f=2 TT=87.959 T1=87.94	OPT f=2 TT=197.613 T1=197.63	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=93.973	? TT=96.533	SAT (TO) f=40 TT=1800.27 T1=810.53	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-bg512142.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=136.692	? TT=141.355	? (TO) TT=1801.05	? (TO) TT=1800.61	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-biella1.opb	UNSAT TT=0.456	No data	UNSAT TT=0.545	UNSAT TT=0.456	? (TO) TT=1800.08	UNSAT TT=1676.99	? TT=117.297	? TT=116.68	UNSAT TT=212.822	? (TO) TT=1801.1	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ar98.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.34	? TT=142.493	? TT=146.345	? (TO) TT=1800.11	? (TO) TT=1800.57	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic97.opb	SAT f=264293 TT=1800.06 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=264293 TT=1800.06 T1=1800.3	? (TO) TT=1800.14	? TT=190.767	? TT=190.103	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic98.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.26	? TT=160.666	? TT=158.889	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ir98.opb	SAT f=264086 TT=1800.14 T1=291.92	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=141.356	? TT=138.579	SAT (TO) f=264086 TT=1800.14 T1=291.92	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-CMS750_4.opb		No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.29	? (TO) TT=1800.01	? (MO) TT=95.244	? (MO) TT=96.023	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2536-691.opb	SAT f=534 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT (TO) f=5863 TT=1800.08 T1=1800.4	SAT (TO) f=635 TT=1800.06 T1=1800.4	SAT (TO) f=651 TT=1800.1 T1=1800.4	SAT (TO) f=534 TT=1800.08 T1=1800.4	SAT (TO) f=581 TT=1800.63 T1=161.2	SAT (TO) f=584 TT=1800.01 T1=1.53	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2586-950.opb	SAT f=786 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=3923 TT=1800.06 T1=1800.4	SAT (TO) f=947 TT=1800.12 T1=1800.5	SAT (TO) f=910 TT=1800.01 T1=1800.3	SAT (TO) f=786 TT=1800.09 T1=1800.4	SAT (TO) f=790 TT=1800.6 T1=112.06	SAT (TO) f=792 TT=1800.06 T1=0.59	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4284-1064.opb	SAT f=899 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT (TO) f=6152 TT=1800.1 T1=1800.4	SAT (TO) f=1082 TT=1800.07 T1=1800.4	SAT (TO) f=1043 TT=1800.1 T1=1800.4	SAT (TO) f=899 TT=1800.1 T1=1800.4	SAT (TO) f=908 TT=1800.72 T1=123.65	SAT (TO) f=909 TT=1800.72 T1=1.18	? (TO) TT=1800.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4872-1529.opb	SAT f=1320 TT=1800.43 T1=602.56	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=8401 TT=1800.09 T1=1800.4	SAT (TO) f=1541 TT=1800.11 T1=1800.4	SAT (TO) f=1506 TT=1800.12 T1=1800.4	SAT (TO) f=1506 TT=1800.08 T1=1800.4	SAT (TO) f=1320 TT=1800.43 T1=602.56	SAT (TO) f=1323 TT=1800.1 T1=1.52	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1c.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=137.975	? TT=137.613	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1l.opb	SAT f=26800 TT=1800.96 T1=284.8	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.4	? TT=115.655	? TT=116.54	SAT (TO) f=26800 TT=1800.96 T1=284.8	? (TO) TT=1800.02	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dg012142.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=139.496	? TT=131.08	? (TO) TT=1800.8	? (TO) TT=1800.07	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dolom1.opb	UNSAT TT=0.374	No data	UNSAT TT=0.533	UNSAT TT=0.374	UNSAT TT=645.074	UNSAT TT=517.258	? TT=123.7	? TT=124.407	UNSAT TT=5.483	UNSAT TT=45.766	UNSAT TT=158.727
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1100 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=8246 TT=1800.06 T1=1800.4	SAT (TO) f=1100 TT=1800.05 T1=1800.4	? TT=141.887	? TT=139.038	SAT (TO) f=1365 TT=1800.77 T1=579.45	SAT (TO) f=1289 TT=1800.02 T1=494.81	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-NSR8K.opb	UNSAT TT=1.185	No data	UNSAT TT=1.529	UNSAT TT=1.185	? (TO) TT=1800.03	Signal TT=740.926	? (MO) TT=135.913	? (MO) TT=137.629	UNSAT TT=12.212	UNSAT TT=31.297	UNSAT TT=134.964
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-nsrand_ipx.opb	SAT f=393877 TT=1800.56 T1=878.37	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=499109 TT=1800.09 T1=1800.4	SAT (TO) f=505240 TT=1800.06 T1=1800.5	? TT=81.066	? TT=82.105	SAT (TO) f=393877 TT=1800.56 T1=878.37	No Cert. TT=1801.15	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-rail507.opb	SAT f=167 TT=1800.75 T1=212.7	No data	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	Signal TT=3.426	SAT (TO) f=200 TT=1800.11 T1=1800.4	SAT (TO) f=200 TT=1800.14 T1=1800.4	SAT (TO) f=167 TT=1800.75 T1=212.7	No Cert. TT=1800	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-railway_8_1_0.opb	OPT f=147 TT=33.618 T1=33.59	No data	OPT f=147 TT=33.618 T1=33.59	OPT f=147 TT=48.591 T1=48.59	? (TO) TT=1800.04	? (TO) TT=1800.11	? TT=93.897	? TT=96.352	? (TO) TT=1800.92	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=261403 TT=1800.01 T1=210.38	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=80.227	? TT=78.308	SAT (TO) f=262172 TT=1800.16 T1=219.74	SAT (TO) f=261403 TT=1800.01 T1=210.38	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-siena1.opb	UNSAT TT=0.411	No data	UNSAT TT=0.612	UNSAT TT=0.411	UNSAT TT=709.349	UNSAT TT=985.152	? TT=115.946	? TT=115.878	UNSAT TT=5.584	UNSAT TT=20.641	UNSAT TT=97.141
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=1588 TT=1800.15 T1=2.13	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=17543 TT=1800.14 T1=1800.5	SAT (TO) f=3600 TT=1800.14 T1=1800.3	? TT=67.416	? TT=67.633	SAT (TO) f=1588 TT=1800.15 T1=2.13	SAT (TO) f=1602 TT=1800.07 T1=1.37	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ic.opb	SAT f=639 TT=1800.12 T1=1.99	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=15473 TT=1800.08 T1=1800.5	SAT (TO) f=1017 TT=1800.1 T1=1800.4	? TT=69.894	? TT=70.475	SAT (TO) f=639 TT=1800.12 T1=1.99	SAT (TO) f=640 TT=1800.92 T1=1.28	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ar.opb	SAT f=1144 TT=1800.01 T1=2.11	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=14268 TT=1800.05 T1=1800.4	SAT (TO) f=1810 TT=1800.17 T1=1800.4	? TT=69.509	? TT=69.654	SAT (TO) f=1144 TT=1800.01 T1=2.11	SAT (TO) f=1147 TT=1800.01 T1=1.69	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ic.opb	SAT f=712 TT=1800.45 T1=588.98	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=14674 TT=1800.13 T1=1800.5	SAT (TO) f=1071 TT=1800.16 T1=1800.4	? TT=72.698	? TT=72.512	SAT (TO) f=712 TT=1800.45 T1=588.98	SAT (TO) f=715 TT=1800.05 T1=793.36	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-tr12-30.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=124.584	? TT=125.444	? (TO) TT=1800.9	? (TO) TT=1800.58	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-trento1.opb	UNSAT TT=0.753	No data	UNSAT TT=0.848	UNSAT TT=0.753	? (TO) TT=1800.09	? (TO) TT=1800.13	? (MO) TT=78.59	? TT=127.549	UNSAT TT=409.141	? (TO) TT=1800.47	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-UMTS.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=128.598	? TT=127.109	? (TO) TT=1802.09	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-usAbbrv.8.25_70.opb	OPT f=-5 TT=179.208 T1=179.22	No data	OPT f=-5 TT=192.087 T1=192.08	OPT f=-5 TT=179.208 T1=179.22	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=93.906	? TT=99.028	? (TO) TT=1800.77	? (TO) TT=1800.65	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1800.24 T1=847.98	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=133.147	? TT=127.957	SAT (TO) f=39649 TT=1800.24 T1=847.98	SAT (TO) f=41696 TT=1800.08 T1=52.53	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-maros.opb	OPT f=12 TT=0.014 T1=0.01	No data	OPT f=12 TT=0.022 T1=0.02	OPT f=12 TT=0.014 T1=0.01	OPT f=12 TT=29.509 T1=29.51	OPT f=12 TT=1.272 T1=1.27	OPT f=12 TT=46.27 T1=46.26	OPT f=12 TT=53.905 T1=53.89	OPT f=12 TT=0.324 T1=1.64	SAT (TO) f=14 TT=1800.69 T1=0.14	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-nazareth.opb	OPT f=-174776 TT=0.012 T1=0.01	No data	OPT f=-174776 TT=0.023 T1=0.02	OPT f=-174776 TT=0.012 T1=0.01	OPT f=-174776 TT=0.822 T1=0.82	OPT f=-174776 TT=5.01 T1=5.01	OPT f=-174776 TT=9.487 T1=9.44	OPT f=-174776 TT=13.203 T1=13.13	OPT f=-174776 TT=0.174 T1=0.63	OPT f=-174776 TT=0.165 T1=0.12	OPT f=-174776 TT=0.085 T1=0.08
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-testprob.opb	OPT f=262130 TT=0.014 T1=0.01	No data	OPT f=262130 TT=0.025 T1=0.02	OPT f=262130 TT=0.014 T1=0.01	OPT f=262130 TT=0.122 T1=0.12	OPT f=262130 TT=4.3 T1=4.3	OPT f=262130 TT=22.833 T1=22.79	OPT f=262130 TT=37.33 T1=37.28	OPT f=262130 TT=0.184 T1=0.63	OPT f=262130 TT=0.514 T1=0.12	OPT f=262130 TT=3.391 T1=3.29
normalized-PB06/OPT-SMALLINT/reduced/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-reduced-ws97-3.opb	SAT f=809 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=4658 TT=1800.09 T1=1800.4	SAT (TO) f=809 TT=1800.1 T1=1800.4	SAT (TO) f=903 TT=1800.01 T1=1800.3	SAT (TO) f=8058 TT=1800.08 T1=1800.4	SAT (TO) f=837 TT=1800.06 T1=641.35	SAT (TO) f=854 TT=1800.02 T1=0.43	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-5xp1.b.opb	OPT f=12 TT=0.149 T1=0.14	No data	OPT f=12 TT=40.333 T1=40.33	OPT f=12 TT=19.976 T1=19.97	OPT f=12 TT=141.478 T1=141.5	OPT f=12 TT=36.998 T1=37	OPT f=12 TT=0.149 T1=0.14	OPT f=12 TT=5.108 T1=5.1	SAT (TO) f=12 TT=1800.1 T1=31.93	SAT (TO) f=16 TT=1800.67 T1=12.07	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-9sym.b.opb	OPT f=5 TT=0.028 T1=0.03	No data	OPT f=5 TT=0.067 T1=0.06	OPT f=5 TT=0.055 T1=0.05	OPT f=5 TT=0.462 T1=0.46	OPT f=5 TT=0.238 T1=0.23	OPT f=5 TT=0.028 T1=0.03	OPT f=5 TT=0.076 T1=0.07	OPT f=5 TT=4.075 T1=2.34	OPT f=5 TT=9.413 T1=5.79	OPT f=5 TT=2.787 T1=2.53
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-alu4.b.opb	SAT f=50 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=50 TT=1800.02 T1=1800.3	SAT (TO) f=68 TT=1800.11 T1=1800.4	SAT (TO) f=68 TT=1800.02 T1=1800.3	SAT (TO) f=51 TT=1800.02 T1=1800.3	SAT (TO) f=57 TT=1800.08 T1=371.23	SAT (TO) f=59 TT=1800.01 T1=1029.03	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-apex4.a.opb	OPT f=776 TT=0.368 T1=0.36	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT (TO) f=843 TT=1800.02 T1=1800.3	SAT (TO) f=843 TT=1800.11 T1=1800.4	OPT f=776 TT=0.368 T1=0.36	SAT (TO) f=808 TT=1800.02 T1=1800.3	SAT (TO) f=828 TT=1800.02 T1=633.01	SAT (TO) f=844 TT=1800.07 T1=0.58	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-bench1.pi.opb	SAT f=156 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=173 TT=1800.05 T1=1800.4	SAT (TO) f=173 TT=1800.01 T1=1800.3	SAT (TO) f=173 TT=1800.01 T1=1800.3	SAT (TO) f=156 TT=1800.02 T1=1800.3	SAT (TO) f=169 TT=1800.54 T1=157.41	SAT (TO) f=172 TT=1800.04 T1=233.95	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-clip.b.opb	OPT f=15 TT=0.056 T1=0.05	No data	OPT f=15 TT=3.702 T1=3.7	OPT f=15 TT=17.058 T1=17.06	OPT f=15 TT=0.999 T1=0.99	OPT f=15 TT=0.876 T1=0.87	OPT f=15 TT=0.056 T1=0.05	OPT f=15 TT=0.391 T1=0.39	OPT f=15 TT=33.806 T1=6.84	SAT (TO) f=16 TT=1800.64 T1=319.29	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-count.b.opb	OPT f=24 TT=0.05 T1=0.05	No data	OPT f=24 TT=31.16 T1=31.16	OPT f=24 TT=222.968 T1=223	OPT f=24 TT=257.637 T1=257.67	OPT f=24 TT=63.102 T1=63.11	OPT f=24 TT=0.05 T1=0.05	OPT f=24 TT=9.527 T1=9.52	SAT (TO) f=24 TT=1800.89 T1=64.45	SAT (TO) f=26 TT=1800.03 T1=1498.87	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-e64.b.opb	OPT f=47 TT=0.238 T1=0.23	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT (TO) f=50 TT=1800.01 T1=1800.3	SAT (TO) f=53 TT=1800.02 T1=1800.3	OPT f=47 TT=0.238 T1=0.23	SAT (TO) f=48 TT=1800.02 T1=1800.3	SAT (TO) f=64 TT=1800.78 T1=29.32	SAT (TO) f=79 TT=1800.01 T1=344.39	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-ex5.pi.opb	SAT f=69 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=83 TT=1800.09 T1=1800.4	SAT (TO) f=73 TT=1800.02 T1=1800.3	SAT (TO) f=84 TT=1800.06 T1=1800.4	SAT (TO) f=69 TT=1800.02 T1=1800.3	SAT (TO) f=80 TT=1800.17 T1=135.22	SAT (TO) f=83 TT=1800.04 T1=0.39	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-exam.pi.opb	SAT f=85 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=89 TT=1800.08 T1=1800.4	SAT (TO) f=89 TT=1800.01 T1=1800.3	SAT (TO) f=89 TT=1800.03 T1=1800.3	SAT (TO) f=85 TT=1800.03 T1=1800.3	SAT (TO) f=86 TT=1800.18 T1=152.42	SAT (TO) f=88 TT=1800.01 T1=0.5	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-f51m.b.opb	OPT f=18 TT=0.075 T1=0.07	No data	OPT f=18 TT=4.416 T1=4.41	OPT f=18 TT=5.712 T1=5.71	OPT f=18 TT=308.058 T1=308.1	OPT f=18 TT=88.517 T1=88.53	OPT f=18 TT=0.075 T1=0.07	OPT f=18 TT=22.756 T1=22.76	OPT f=18 TT=689.6 T1=10.34	SAT (TO) f=20 TT=1800.79 T1=323.73	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-jac3.opb	OPT f=15 TT=1.122 T1=1.12	No data	OPT f=15 TT=31.512 T1=31.5	OPT f=15 TT=3.219 T1=3.21	SAT (TO) f=15 TT=1800.07 T1=1800.4	SAT (TO) f=16 TT=1800.1 T1=1800.4	OPT f=15 TT=1.122 T1=1.12	SAT (TO) f=15 TT=1800.1 T1=1800.4	OPT f=15 TT=106.558 T1=25.89	SAT (TO) f=18 TT=1800.54 T1=1374.52	OPT f=15 TT=519.248 T1=519.38
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-max1024.pi.opb	SAT f=276 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.11	SAT (TO) f=281 TT=1800.11 T1=1800.4	SAT (TO) f=301 TT=1800.02 T1=1800.3	SAT (TO) f=301 TT=1800.02 T1=1800.3	SAT (TO) f=276 TT=1800.05 T1=1800.4	SAT (TO) f=294 TT=1800.77 T1=519.85	SAT (TO) f=300 TT=1800.67 T1=12.18	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-prom2.pi.opb	SAT f=290 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=436 TT=1800.1 T1=1800.4	SAT (TO) f=436 TT=1800.01 T1=1800.3	SAT (TO) f=436 TT=1800.02 T1=1800.3	SAT (TO) f=290 TT=1800.02 T1=1800.3	SAT (TO) f=429 TT=1800.45 T1=512.95	SAT (TO) f=436 TT=1800.04 T1=0.34	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-rot.b.opb	SAT f=122 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=122 TT=1800.09 T1=1800.4	SAT (TO) f=163 TT=1800.02 T1=1800.3	SAT (TO) f=163 TT=1800.11 T1=1800.4	SAT (TO) f=123 TT=1800.03 T1=1800.3	SAT (TO) f=150 TT=1800.52 T1=380.84	SAT (TO) f=159 TT=1800.67 T1=15.06	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-sao2.b.opb	OPT f=25 TT=0.028 T1=0.02	No data	OPT f=25 TT=260.502 T1=260.53	OPT f=25 TT=1.129 T1=1.13	SAT (TO) f=26 TT=1800.02 T1=1800.3	SAT (TO) f=26 TT=1800.02 T1=1800.3	OPT f=25 TT=0.028 T1=0.02	OPT f=25 TT=475.397 T1=475.46	OPT f=25 TT=372.987 T1=154.84	SAT (TO) f=29 TT=1800.09 T1=211.46	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-test4.pi.opb	SAT f=175 TT=1800.02 T1=33.6	No data	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT (TO) f=180 TT=1800.07 T1=1800.4	SAT (TO) f=180 TT=1800.11 T1=1800.4	SAT (TO) f=180 TT=1800.09 T1=1800.4	SAT (TO) f=180 TT=1800.02 T1=1800.3	SAT (TO) f=175 TT=1800.02 T1=33.6	SAT (TO) f=178 TT=1800.06 T1=894.43	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-1.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.017 T1=0.02	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.264 T1=0.66	OPT f=100 TT=0.222 T1=0.17	OPT f=100 TT=0.066 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-2.opb	OPT f=100 TT=0.002 T1=0	No data	OPT f=100 TT=0.023 T1=0.02	OPT f=100 TT=0.014 T1=0.01	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.01 T1=0.01	OPT f=100 TT=0.002 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.284 T1=0.66	OPT f=100 TT=0.225 T1=0.17	OPT f=100 TT=0.026 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-3.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.025 T1=0.02	OPT f=100 TT=0.014 T1=0.01	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.018 T1=0.01	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.345 T1=0.66	OPT f=100 TT=0.273 T1=0.19	OPT f=100 TT=0.037 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-4.opb	OPT f=100 TT=0.004 T1=0	No data	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.274 T1=0.66	OPT f=100 TT=0.224 T1=0.16	OPT f=100 TT=0.024 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-1.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.014 T1=0.02	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.012 T1=0.01	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.372 T1=0.67	OPT f=100 TT=0.274 T1=0.19	OPT f=100 TT=0.039 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-2.opb	OPT f=100 TT=0.004 T1=0	No data	OPT f=100 TT=0.026 T1=0.02	OPT f=100 TT=0.016 T1=0.02	OPT f=100 TT=0.014 T1=0.01	OPT f=100 TT=0.013 T1=0.01	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.344 T1=0.67	OPT f=100 TT=0.285 T1=0.19	OPT f=100 TT=0.03 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-3.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.026 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.023 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.424 T1=0.67	OPT f=100 TT=0.263 T1=0.17	OPT f=100 TT=0.023 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-4.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.026 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.025 T1=0.02	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.434 T1=0.67	OPT f=100 TT=0.263 T1=0.17	OPT f=100 TT=0.028 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-1.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.008 T1=0	OPT f=100 TT=0.043 T1=0.04	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.693 T1=0.69	OPT f=100 TT=0.463 T1=0.22	OPT f=100 TT=0.046 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-2.opb	OPT f=100 TT=0.003 T1=0	No data	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.017 T1=0.01	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.025 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.006 T1=0.01	OPT f=100 TT=0.594 T1=0.68	OPT f=100 TT=0.393 T1=0.23	OPT f=100 TT=0.099 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-3.opb	OPT f=100 TT=0.004 T1=0	No data	OPT f=100 TT=0.029 T1=0.03	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.04 T1=0.03	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.583 T1=0.68	OPT f=100 TT=0.394 T1=0.2	OPT f=100 TT=0.088 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-4.opb	OPT f=100 TT=0.005 T1=0	No data	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.016 T1=0.01	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.584 T1=0.68	OPT f=100 TT=0.315 T1=0.2	OPT f=100 TT=0.053 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-1.opb	OPT f=100 TT=0.005 T1=0	No data	OPT f=100 TT=0.03 T1=0.02	OPT f=100 TT=0.016 T1=0.01	OPT f=100 TT=0.03 T1=0.03	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.394 T1=0.71	OPT f=100 TT=0.334 T1=0.21	OPT f=100 TT=0.054 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-2.opb	OPT f=100 TT=0.005 T1=0	No data	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.03 T1=0.02	OPT f=100 TT=0.01 T1=0.01	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.435 T1=0.71	OPT f=100 TT=0.324 T1=0.2	OPT f=100 TT=0.077 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-3.opb	OPT f=100 TT=0.005 T1=0	No data	OPT f=100 TT=0.032 T1=0.03	OPT f=100 TT=0.017 T1=0.01	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.043 T1=0.04	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.354 T1=0.71	OPT f=100 TT=0.344 T1=0.21	OPT f=100 TT=0.079 T1=0.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-4.opb	OPT f=100 TT=0.004 T1=0	No data	OPT f=100 TT=0.029 T1=0.03	OPT f=100 TT=0.016 T1=0.01	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.041 T1=0.04	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.343 T1=0.71	OPT f=100 TT=0.294 T1=0.19	OPT f=100 TT=0.137 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-1.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.026 T1=0.02	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.008 T1=0	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.494 T1=0.69	OPT f=200 TT=0.354 T1=0.21	OPT f=200 TT=0.047 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-2.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.028 T1=0.02	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.047 T1=0.04	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.011 T1=0.01	OPT f=200 TT=0.493 T1=0.7	OPT f=200 TT=0.363 T1=0.23	OPT f=200 TT=0.039 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-3.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.031 T1=0.03	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.009 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.515 T1=0.7	OPT f=200 TT=0.383 T1=0.22	OPT f=200 TT=0.063 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-4.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.028 T1=0.02	OPT f=200 TT=0.016 T1=0.01	OPT f=200 TT=0.047 T1=0.04	OPT f=200 TT=0.011 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.484 T1=0.71	OPT f=200 TT=0.335 T1=0.21	OPT f=200 TT=0.036 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-1.opb	OPT f=200 TT=0.007 T1=0	No data	OPT f=200 TT=0.034 T1=0.03	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.053 T1=0.05	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.613 T1=0.7	OPT f=200 TT=0.435 T1=0.25	OPT f=200 TT=0.056 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-2.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.028 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.053 T1=0.05	OPT f=200 TT=0.077 T1=0.08	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.784 T1=0.7	OPT f=200 TT=0.594 T1=0.32	OPT f=200 TT=0.138 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-3.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.034 T1=0.03	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.016 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.535 T1=0.71	OPT f=200 TT=0.385 T1=0.22	OPT f=200 TT=0.061 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-4.opb	OPT f=200 TT=0.006 T1=0	No data	OPT f=200 TT=0.03 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.056 T1=0.05	OPT f=200 TT=0.049 T1=0.04	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.585 T1=0.73	OPT f=200 TT=0.474 T1=0.25	OPT f=200 TT=0.063 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-1.opb	OPT f=200 TT=0.007 T1=0	No data	OPT f=200 TT=0.035 T1=0.04	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.063 T1=0.06	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.675 T1=0.72	OPT f=200 TT=0.435 T1=0.25	OPT f=200 TT=0.052 T1=0.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-2.opb	OPT f=200 TT=0.008 T1=0	No data	OPT f=200 TT=0.03 T1=0.03	OPT f=200 TT=0.02 T1=0.01	OPT f=200 TT=0.062 T1=0.06	OPT f=200 TT=0.093 T1=0.09	OPT f=200 TT=0.008 T1=0	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.694 T1=0.72	OPT f=200 TT=0.495 T1=0.27	OPT f=200 TT=0.073 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-3.opb	OPT f=200 TT=0.007 T1=0.01	No data	OPT f=200 TT=0.035 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.056 T1=0.05	OPT f=200 TT=0.054 T1=0.05	OPT f=200 TT=0.007 T1=0.01	OPT f=200 TT=0.013 T1=0.01	OPT f=200 TT=0.545 T1=0.73	OPT f=200 TT=0.614 T1=0.31	OPT f=200 TT=0.101 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-4.opb	OPT f=200 TT=0.007 T1=0	No data	OPT f=200 TT=0.033 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.074 T1=0.07	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.534 T1=0.73	OPT f=200 TT=0.384 T1=0.23	OPT f=200 TT=0.081 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-1.opb	OPT f=200 TT=0.009 T1=0	No data	OPT f=200 TT=0.051 T1=0.05	OPT f=200 TT=0.032 T1=0.03	OPT f=200 TT=0.079 T1=0.07	OPT f=200 TT=0.062 T1=0.06	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.984 T1=0.76	OPT f=200 TT=0.573 T1=0.3	OPT f=200 TT=0.071 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-2.opb	OPT f=200 TT=0.012 T1=0.01	No data	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.024 T1=0.02	OPT f=200 TT=0.074 T1=0.07	OPT f=200 TT=0.022 T1=0.02	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.019 T1=0.01	OPT f=200 TT=1.023 T1=0.77	OPT f=200 TT=0.715 T1=0.32	OPT f=200 TT=0.129 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-3.opb	OPT f=200 TT=0.013 T1=0.01	No data	OPT f=200 TT=0.042 T1=0.04	OPT f=200 TT=0.025 T1=0.02	OPT f=200 TT=0.073 T1=0.07	OPT f=200 TT=0.07 T1=0.07	OPT f=200 TT=0.013 T1=0.01	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=1.004 T1=0.76	OPT f=200 TT=0.646 T1=0.33	OPT f=200 TT=0.146 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-4.opb	OPT f=200 TT=0.01 T1=0.01	No data	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.031 T1=0.03	OPT f=200 TT=0.024 T1=0.02	OPT f=200 TT=0.022 T1=0.02	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.015 T1=0.02	OPT f=200 TT=0.935 T1=0.76	OPT f=200 TT=0.653 T1=0.34	OPT f=200 TT=0.129 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-1.opb	OPT f=50 TT=0.001 T1=0	No data	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.185 T1=0.64	OPT f=50 TT=0.184 T1=0.14	OPT f=50 TT=0.021 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-2.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.01 T1=0	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.193 T1=0.64	OPT f=50 TT=0.183 T1=0.13	OPT f=50 TT=0.022 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-3.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.194 T1=0.64	OPT f=50 TT=0.184 T1=0.14	OPT f=50 TT=0.019 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-4.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.027 T1=0.02	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.184 T1=0.64	OPT f=50 TT=0.183 T1=0.14	OPT f=50 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-1.opb	OPT f=50 TT=0.001 T1=0	No data	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.233 T1=0.64	OPT f=50 TT=0.193 T1=0.16	OPT f=50 TT=0.025 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-2.opb	OPT f=50 TT=0.001 T1=0	No data	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.01 T1=0	OPT f=50 TT=0.011 T1=0.01	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.233 T1=0.65	OPT f=50 TT=0.215 T1=0.16	OPT f=50 TT=0.024 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-3.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.244 T1=0.64	OPT f=50 TT=0.205 T1=0.15	OPT f=50 TT=0.023 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-4.opb	OPT f=50 TT=0.003 T1=0	No data	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.005 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.004 T1=0	OPT f=50 TT=0.204 T1=0.64	OPT f=50 TT=0.183 T1=0.14	OPT f=50 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-1.opb	OPT f=50 TT=0.003 T1=0	No data	OPT f=50 TT=0.025 T1=0.02	OPT f=50 TT=0.015 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.01 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.314 T1=0.66	OPT f=50 TT=0.223 T1=0.15	OPT f=50 TT=0.028 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-2.opb	OPT f=50 TT=0.003 T1=0	No data	OPT f=50 TT=0.025 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.015 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.284 T1=0.66	OPT f=50 TT=0.203 T1=0.16	OPT f=50 TT=0.04 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-3.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.011 T1=0.01	OPT f=50 TT=0.004 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.286 T1=0.68	OPT f=50 TT=0.224 T1=0.15	OPT f=50 TT=0.049 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-4.opb	OPT f=50 TT=0.003 T1=0	No data	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.011 T1=0.01	OPT f=50 TT=0.015 T1=0.02	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.283 T1=0.66	OPT f=50 TT=0.225 T1=0.16	OPT f=50 TT=0.058 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-1.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.244 T1=0.67	OPT f=50 TT=0.244 T1=0.17	OPT f=50 TT=0.063 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-2.opb	OPT f=50 TT=0.003 T1=0	No data	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.02 T1=0.02	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.233 T1=0.68	OPT f=50 TT=0.233 T1=0.16	OPT f=50 TT=0.027 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-3.opb	OPT f=50 TT=0.002 T1=0	No data	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.017 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0.01	OPT f=50 TT=0.234 T1=0.67	OPT f=50 TT=0.223 T1=0.17	OPT f=50 TT=0.03 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-4.opb	OPT f=50 TT=0.003 T1=0	No data	OPT f=50 TT=0.025 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.017 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.004 T1=0	OPT f=50 TT=0.243 T1=0.72	OPT f=50 TT=0.233 T1=0.17	OPT f=50 TT=0.045 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf0432-007.opb	UNSAT TT=0.03	No data	UNSAT TT=0.085	UNSAT TT=0.062	UNSAT TT=0.071	UNSAT TT=0.067	UNSAT TT=0.03	UNSAT TT=0.03	UNSAT TT=1.384	UNSAT TT=0.905	UNSAT TT=0.293
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf1355-075.opb	UNSAT TT=0.039	No data	UNSAT TT=0.082	UNSAT TT=0.048	UNSAT TT=0.115	UNSAT TT=0.113	UNSAT TT=0.041	UNSAT TT=0.039	UNSAT TT=2.773	UNSAT TT=0.913	UNSAT TT=0.271
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf1355-638.opb	UNSAT TT=0.04	No data	UNSAT TT=0.081	UNSAT TT=0.047	UNSAT TT=0.115	UNSAT TT=0.112	UNSAT TT=0.04	UNSAT TT=0.041	UNSAT TT=2.523	UNSAT TT=0.823	UNSAT TT=0.288
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf2670-001.opb	UNSAT TT=0.021	No data	UNSAT TT=0.059	UNSAT TT=0.031	UNSAT TT=0.06	UNSAT TT=0.059	UNSAT TT=0.021	UNSAT TT=0.021	UNSAT TT=1.204	UNSAT TT=0.664	UNSAT TT=0.127
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-f1000.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.49	? (TO) TT=1800.71	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-f2000.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.5	? (TO) TT=1800.55	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-f600.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.16	? (TO) TT=1800.82	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g125.17.opb		No data	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.25	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g125.18.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.8	? (TO) TT=1800.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g250.15.opb	SAT f=3750 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT (TO) f=3750 TT=1800.05 T1=1800.4	SAT (TO) f=3750 TT=1800.02 T1=1800.3	SAT (TO) f=3750 TT=1800.06 T1=1800.4	? (TO) TT=1800.67	No Cert. TT=1800.01	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g250.29.opb		No data	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.8	? (TO) TT=1800.65	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-hanoi4.opb	OPT f=718 TT=0.122 T1=0.12	No data	OPT f=718 TT=0.246 T1=0.24	OPT f=718 TT=0.122 T1=0.12	OPT f=718 TT=0.397 T1=0.39	OPT f=718 TT=0.586 T1=0.57	OPT f=718 TT=2.029 T1=2.02	OPT f=718 TT=0.215 T1=0.21	OPT f=718 TT=4.153 T1=1.39	OPT f=718 TT=1.834 T1=0.43	OPT f=718 TT=9.478 T1=1.19
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-hanoi5.opb	OPT f=1931 TT=0.915 T1=0.91	No data	OPT f=1931 TT=2.188 T1=2.18	OPT f=1931 TT=1.815 T1=1.81	OPT f=1931 TT=2.353 T1=2.35	OPT f=1931 TT=3.038 T1=3.01	OPT f=1931 TT=1.081 T1=1.08	OPT f=1931 TT=0.915 T1=0.91	OPT f=1931 TT=9.403 T1=3.53	OPT f=1931 TT=5.862 T1=4.17	OPT f=1931 TT=226.482 T1=97.24
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16a1.opb	SAT f=1123 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=1430 TT=1800.02 T1=1800.3	SAT (TO) f=1485 TT=1800.09 T1=1800.4	SAT (TO) f=1551 TT=1800.01 T1=1800.3	SAT (TO) f=1123 TT=1800.02 T1=1800.3	SAT (TO) f=1385 TT=1800.13 T1=234.25	SAT (TO) f=1527 TT=1800.08 T1=0.63	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16a2.opb	SAT f=1164 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT (TO) f=1259 TT=1800.11 T1=1800.4	SAT (TO) f=1588 TT=1800.02 T1=1800.3	SAT (TO) f=1601 TT=1800.02 T1=1800.3	SAT (TO) f=1164 TT=1800.03 T1=1800.3	SAT (TO) f=1398 TT=1800.17 T1=892.56	SAT (TO) f=1548 TT=1800.05 T1=116.1	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16b1.opb	SAT f=1379 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT (TO) f=1541 TT=1800.02 T1=1800.3	SAT (TO) f=1727 TT=1800.01 T1=1800.3	SAT (TO) f=1727 TT=1800.02 T1=1800.3	SAT (TO) f=1379 TT=1800.09 T1=1800.4	SAT (TO) f=1596 TT=1800.1 T1=750.74	SAT (TO) f=1661 TT=1800.07 T1=167.63	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16b2.opb	OPT f=1031 TT=1.64 T1=1.57	No data	OPT f=1031 TT=6.457 T1=6.45	OPT f=1031 TT=23.93 T1=23.93	SAT (TO) f=1031 TT=1800.11 T1=1800.4	OPT f=1031 TT=3.921 T1=3.9	OPT f=1031 TT=102.08 T1=102.09	OPT f=1031 TT=1.64 T1=1.64	OPT f=1031 TT=26.732 T1=1.57	SAT (TO) f=1033 TT=1800.02 T1=0.68	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16c1.opb	SAT f=1226 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT (TO) f=1412 TT=1800.01 T1=1800.3	SAT (TO) f=1478 TT=1800.01 T1=1800.3	SAT (TO) f=1568 TT=1800.11 T1=1800.4	SAT (TO) f=1226 TT=1800.02 T1=1800.3	SAT (TO) f=1335 TT=1800 T1=1.58	SAT (TO) f=1424 TT=1800.71 T1=0.55	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16c2.opb	OPT f=861 TT=1.379 T1=1.38	No data	OPT f=861 TT=3.81 T1=3.8	OPT f=861 TT=46.271 T1=46.27	OPT f=861 TT=1.391 T1=1.38	OPT f=861 TT=2.911 T1=2.89	OPT f=861 TT=35.535 T1=35.53	OPT f=861 TT=1.379 T1=1.38	OPT f=861 TT=14.282 T1=3.53	SAT (TO) f=867 TT=1800.01 T1=0.84	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16d1.opb	SAT f=890 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	SAT (TO) f=1084 TT=1800.1 T1=1800.4	SAT (TO) f=1230 TT=1800.01 T1=1800.3	SAT (TO) f=1229 TT=1800.02 T1=1800.3	SAT (TO) f=890 TT=1800.03 T1=1800.3	SAT (TO) f=1090 TT=1800.02 T1=2.57	SAT (TO) f=1097 TT=1800.05 T1=0.65	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16d2.opb	OPT f=785 TT=1.075 T1=1.07	No data	OPT f=785 TT=4.705 T1=4.7	OPT f=785 TT=24.544 T1=24.54	OPT f=785 TT=2.238 T1=2.23	OPT f=785 TT=2.852 T1=2.84	OPT f=785 TT=625.999 T1=626.09	OPT f=785 TT=1.075 T1=1.07	OPT f=785 TT=64.654 T1=9.54	SAT (TO) f=802 TT=1800.04 T1=424.88	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16e1.opb	SAT f=1102 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT (TO) f=1135 TT=1800.02 T1=1800.3	SAT (TO) f=1244 TT=1800.09 T1=1800.4	SAT (TO) f=1234 TT=1800.03 T1=1800.3	SAT (TO) f=1102 TT=1800.02 T1=1800.3	SAT (TO) f=1162 TT=1800.19 T1=864.6	SAT (TO) f=1201 TT=1800.05 T1=20.75	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16e2.opb	OPT f=520 TT=0.34 T1=0.34	No data	OPT f=520 TT=1.622 T1=1.62	OPT f=520 TT=0.899 T1=0.89	OPT f=520 TT=0.715 T1=0.71	OPT f=520 TT=1.94 T1=1.92	OPT f=520 TT=10.251 T1=10.25	OPT f=520 TT=0.34 T1=0.34	OPT f=520 TT=6.074 T1=2.44	OPT f=520 TT=7.312 T1=0.49	OPT f=520 TT=5.493 T1=5.45
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32a1.opb	OPT f=444 TT=0.323 T1=0.32	No data	OPT f=444 TT=1.542 T1=1.53	OPT f=444 TT=1.7 T1=1.69	OPT f=444 TT=1.172 T1=1.16	OPT f=444 TT=1.163 T1=1.15	OPT f=444 TT=9.917 T1=9.91	OPT f=444 TT=0.323 T1=0.32	OPT f=444 TT=6.392 T1=1.43	OPT f=444 TT=8.023 T1=0.42	OPT f=444 TT=4.13 T1=3.99
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b1.opb	OPT f=191 TT=6.206 T1=6.2	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	OPT f=191 TT=7.765 T1=7.76	OPT f=191 TT=6.206 T1=6.2	OPT f=191 TT=35.059 T1=35.06	OPT f=191 TT=6.385 T1=6.38	SAT (TO) f=191 TT=1800.75 T1=16.34	SAT (TO) f=196 TT=1800.02 T1=0.68	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b2.opb	OPT f=244 TT=1.146 T1=0.67	No data	OPT f=244 TT=21.674 T1=21.67	OPT f=244 TT=4.608 T1=4.6	OPT f=244 TT=1.884 T1=1.88	OPT f=244 TT=2.768 T1=2.76	OPT f=244 TT=4.55 T1=4.55	OPT f=244 TT=1.146 T1=1.14	OPT f=244 TT=4.783 T1=8.35	OPT f=244 TT=2.525 T1=0.67	OPT f=244 TT=8.418 T1=3.13
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b3.opb	OPT f=331 TT=2.776 T1=1.56	No data	OPT f=331 TT=48.399 T1=48.4	OPT f=331 TT=19.26 T1=19.26	OPT f=331 TT=6.548 T1=6.54	OPT f=331 TT=10.614 T1=10.6	OPT f=331 TT=10.632 T1=10.63	OPT f=331 TT=2.776 T1=2.78	OPT f=331 TT=19.08 T1=6.91	OPT f=331 TT=8.483 T1=1.56	OPT f=331 TT=25.839 T1=19.9
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b4.opb	OPT f=376 TT=0.299 T1=0.3	No data	OPT f=376 TT=10.07 T1=10.06	OPT f=376 TT=1.451 T1=1.44	OPT f=376 TT=1.276 T1=1.27	OPT f=376 TT=1.395 T1=1.39	OPT f=376 TT=2.662 T1=2.66	OPT f=376 TT=0.299 T1=0.3	OPT f=376 TT=3.363 T1=1.41	OPT f=376 TT=1.525 T1=0.4	OPT f=376 TT=4.82 T1=4.76
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c1.opb	OPT f=167 TT=2.738 T1=2.73	No data	? (TO) TT=1800.01	OPT f=167 TT=1580.02 T1=1580.26	OPT f=167 TT=3.679 T1=3.67	OPT f=167 TT=3.656 T1=3.65	OPT f=167 TT=2.738 T1=2.73	OPT f=167 TT=3.395 T1=3.39	SAT (TO) f=168 TT=1800.1 T1=671.85	SAT (TO) f=188 TT=1800.85 T1=3.95	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c2.opb	OPT f=207 TT=30.023 T1=30.02	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	OPT f=207 TT=95.483 T1=95.51	OPT f=207 TT=38.96 T1=38.96	OPT f=207 TT=56.749 T1=56.75	OPT f=207 TT=30.023 T1=30.02	SAT (TO) f=207 TT=1800.07 T1=251.28	SAT (TO) f=215 TT=1800.05 T1=8.77	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c3.opb	OPT f=261 TT=15.686 T1=8.25	No data	OPT f=261 TT=449.796 T1=449.85	OPT f=261 TT=141.498 T1=141.51	OPT f=261 TT=20.825 T1=20.82	OPT f=261 TT=38.439 T1=38.43	OPT f=261 TT=57.62 T1=57.62	OPT f=261 TT=15.686 T1=15.69	OPT f=261 TT=46.555 T1=14.38	OPT f=261 TT=22.29 T1=8.25	OPT f=261 TT=476.361 T1=476.37
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c4.opb	OPT f=736 TT=0.648 T1=0.57	No data	OPT f=736 TT=10.829 T1=10.82	OPT f=736 TT=9.371 T1=9.37	OPT f=736 TT=2.364 T1=2.35	OPT f=736 TT=3.624 T1=3.6	OPT f=736 TT=16.806 T1=16.8	OPT f=736 TT=0.648 T1=0.64	OPT f=736 TT=8.572 T1=1.61	SAT (TO) f=736 TT=1800.01 T1=0.57	OPT f=736 TT=14.175 T1=10.19
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32d1.opb	SAT f=285 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=285 TT=1800.02 T1=1800.3	SAT (TO) f=290 TT=1800.02 T1=1800.3	SAT (TO) f=328 TT=1800.03 T1=1800.3	SAT (TO) f=285 TT=1800.02 T1=1800.3	SAT (TO) f=287 TT=1800.9 T1=490.77	SAT (TO) f=294 TT=1800.01 T1=14.01	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32d2.opb	OPT f=372 TT=526.275 T1=5.99	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=372 TT=1800.02 T1=1800.3	SAT (TO) f=372 TT=1800.02 T1=1800.3	SAT (TO) f=404 TT=1800.02 T1=1800.3	OPT f=372 TT=526.275 T1=526.36	SAT (TO) f=372 TT=1800.17 T1=15.93	SAT (TO) f=372 TT=1800.1 T1=5.99	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32d3.opb	OPT f=802 TT=5.541 T1=5.54	No data	OPT f=802 TT=1216.7 T1=1216.9	OPT f=802 TT=238.053 T1=238.09	OPT f=802 TT=46.307 T1=46.32	OPT f=802 TT=13.775 T1=13.76	SAT (TO) f=824 TT=1800.02 T1=1800.3	OPT f=802 TT=5.541 T1=5.54	SAT (TO) f=802 TT=1800.07 T1=20.1	SAT (TO) f=802 TT=1800.04 T1=6.07	OPT f=802 TT=273.675 T1=263.93
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e1.opb	OPT f=162 TT=4.96 T1=4.95	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=162 TT=4.96 T1=4.95	OPT f=162 TT=5.332 T1=5.33	OPT f=162 TT=7.235 T1=7.23	OPT f=162 TT=8.749 T1=8.75	SAT (TO) f=165 TT=1800.12 T1=318.51	SAT (TO) f=163 TT=1800.8 T1=1217.17	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e2.opb	OPT f=235 TT=34.744 T1=2.89	No data	? (TO) TT=1800.02	OPT f=235 TT=601.618 T1=601.72	OPT f=235 TT=58.447 T1=58.46	OPT f=235 TT=65.295 T1=65.3	OPT f=235 TT=63.851 T1=63.85	OPT f=235 TT=34.744 T1=34.74	SAT (TO) f=235 TT=1800.85 T1=5.39	SAT (TO) f=235 TT=1800.02 T1=2.89	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e3.opb	OPT f=310 TT=2.53 T1=2.53	No data	OPT f=310 TT=28.368 T1=28.37	OPT f=310 TT=16.813 T1=16.82	OPT f=310 TT=4.878 T1=4.87	OPT f=310 TT=9.85 T1=9.84	OPT f=310 TT=9.502 T1=9.5	OPT f=310 TT=2.53 T1=2.53	OPT f=310 TT=119.566 T1=11.91	OPT f=310 TT=37.887 T1=6.53	OPT f=310 TT=348.231 T1=85.74
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e4.opb	OPT f=364 TT=4.289 T1=4.29	No data	OPT f=364 TT=166.04 T1=166.05	OPT f=364 TT=25.88 T1=25.88	OPT f=364 TT=8.414 T1=8.41	OPT f=364 TT=19.609 T1=19.6	OPT f=364 TT=12.063 T1=12.06	OPT f=364 TT=4.289 T1=4.29	OPT f=364 TT=1300.73 T1=21.95	OPT f=364 TT=461.19 T1=61.03	OPT f=364 TT=652.962 T1=30.59
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e5.opb	OPT f=503 TT=11.776 T1=4.89	No data	OPT f=503 TT=839.979 T1=840.11	OPT f=503 TT=165.926 T1=165.94	OPT f=503 TT=16.159 T1=16.15	OPT f=503 TT=31.719 T1=31.72	OPT f=503 TT=56.661 T1=56.66	OPT f=503 TT=11.776 T1=11.77	OPT f=503 TT=82.043 T1=14.09	OPT f=503 TT=29.279 T1=4.89	OPT f=503 TT=143.25 T1=5.29
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a1.opb	OPT f=54 TT=0.053 T1=0.05	No data	OPT f=54 TT=0.097 T1=0.09	OPT f=54 TT=0.061 T1=0.06	OPT f=54 TT=0.086 T1=0.08	OPT f=54 TT=0.144 T1=0.14	OPT f=54 TT=0.053 T1=0.05	OPT f=54 TT=0.125 T1=0.12	OPT f=54 TT=2.913 T1=5.18	OPT f=54 TT=0.894 T1=0.25	OPT f=54 TT=1.886 T1=1.85
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a2.opb	OPT f=139 TT=1207.3 T1=1207.49	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=139 TT=1800.02 T1=1800.3	SAT (TO) f=155 TT=1800.02 T1=1800.3	OPT f=139 TT=1207.3 T1=1207.49	SAT (TO) f=139 TT=1800.02 T1=1800.3	SAT (TO) f=143 TT=1800.77 T1=3.21	SAT (TO) f=149 TT=1800.68 T1=163.4	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a3.opb	SAT f=191 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=191 TT=1800.02 T1=1800.3	SAT (TO) f=193 TT=1800.02 T1=1800.3	SAT (TO) f=229 TT=1800.02 T1=1800.3	SAT (TO) f=191 TT=1800.02 T1=1800.3	SAT (TO) f=194 TT=1800.59 T1=2.28	SAT (TO) f=217 TT=1800.07 T1=0.25	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a4.opb	SAT f=283 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=283 TT=1800.02 T1=1800.3	SAT (TO) f=283 TT=1800.02 T1=1800.3	SAT (TO) f=367 TT=1800.02 T1=1800.3	SAT (TO) f=283 TT=1800.02 T1=1800.3	SAT (TO) f=335 TT=1800.1 T1=7.33	SAT (TO) f=313 TT=1800.79 T1=0.31	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b1.opb	OPT f=191 TT=78.476 T1=78.48	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=191 TT=1800.1 T1=1800.4	SAT (TO) f=194 TT=1800.02 T1=1800.3	OPT f=191 TT=78.476 T1=78.48	OPT f=191 TT=392.55 T1=392.61	SAT (TO) f=221 TT=1800.73 T1=0.82	SAT (TO) f=221 TT=1800.08 T1=0.28	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b2.opb	SAT f=379 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=379 TT=1800.02 T1=1800.3	SAT (TO) f=381 TT=1800.08 T1=1800.4	SAT (TO) f=430 TT=1800.02 T1=1800.3	SAT (TO) f=379 TT=1800.02 T1=1800.3	SAT (TO) f=411 TT=1800.73 T1=2.37	SAT (TO) f=413 TT=1800.06 T1=0.32	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b3.opb	SAT f=507 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=507 TT=1800.1 T1=1800.4	SAT (TO) f=508 TT=1800.01 T1=1800.3	SAT (TO) f=594 TT=1800.02 T1=1800.3	SAT (TO) f=507 TT=1800.02 T1=1800.3	SAT (TO) f=551 TT=1800.05 T1=1.89	SAT (TO) f=559 TT=1800.77 T1=0.37	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b4.opb	SAT f=654 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=716 TT=1800.02 T1=1800.3	SAT (TO) f=656 TT=1800.08 T1=1800.4	SAT (TO) f=926 TT=1800.02 T1=1800.3	SAT (TO) f=654 TT=1800.02 T1=1800.3	SAT (TO) f=718 TT=1800.63 T1=0.91	SAT (TO) f=718 TT=1800.01 T1=0.38	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8c1.opb	SAT f=302 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=302 TT=1800.02 T1=1800.3	SAT (TO) f=315 TT=1800.01 T1=1800.3	SAT (TO) f=315 TT=1800.02 T1=1800.3	SAT (TO) f=302 TT=1800.02 T1=1800.3	SAT (TO) f=315 TT=1800.16 T1=0.84	SAT (TO) f=315 TT=1800.83 T1=0.34	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8c2.opb	SAT f=525 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=525 TT=1800.11 T1=1800.4	SAT (TO) f=591 TT=1800.09 T1=1800.4	SAT (TO) f=916 TT=1800.01 T1=1800.3	SAT (TO) f=525 TT=1800.02 T1=1800.3	SAT (TO) f=574 TT=1800.02 T1=1.4	SAT (TO) f=574 TT=1800.03 T1=0.42	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8d1.opb	SAT f=343 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=343 TT=1800.02 T1=1800.3	SAT (TO) f=345 TT=1800.1 T1=1800.4	SAT (TO) f=390 TT=1800.02 T1=1800.3	SAT (TO) f=343 TT=1800.01 T1=1800.3	SAT (TO) f=374 TT=1800.14 T1=2.33	SAT (TO) f=374 TT=1800.06 T1=0.36	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8d2.opb	SAT f=540 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=540 TT=1800.01 T1=1800.3	SAT (TO) f=548 TT=1800.1 T1=1800.4	SAT (TO) f=674 TT=1800.02 T1=1800.3	SAT (TO) f=540 TT=1800.02 T1=1800.3	SAT (TO) f=581 TT=1800.67 T1=0.91	SAT (TO) f=581 TT=1800.87 T1=0.38	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8e1.opb	SAT f=343 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=343 TT=1800.01 T1=1800.3	SAT (TO) f=367 TT=1800.02 T1=1800.3	SAT (TO) f=434 TT=1800.1 T1=1800.4	SAT (TO) f=343 TT=1800.02 T1=1800.3	SAT (TO) f=420 TT=1800.71 T1=0.82	SAT (TO) f=420 TT=1800.09 T1=0.31	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8e2.opb	SAT f=494 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=494 TT=1800.1 T1=1800.4	SAT (TO) f=506 TT=1800.01 T1=1800.3	SAT (TO) f=808 TT=1800.01 T1=1800.3	SAT (TO) f=494 TT=1800.02 T1=1800.3	SAT (TO) f=521 TT=1800.73 T1=1.93	SAT (TO) f=521 TT=1800.07 T1=0.47	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh12.opb	OPT f=94 TT=0.007 T1=0	No data	OPT f=94 TT=0.032 T1=0.03	OPT f=94 TT=0.019 T1=0.02	OPT f=94 TT=0.054 T1=0.05	OPT f=94 TT=0.045 T1=0.04	OPT f=94 TT=0.007 T1=0	OPT f=94 TT=0.01 T1=0.01	OPT f=94 TT=0.505 T1=1.76	OPT f=94 TT=0.404 T1=0.24	OPT f=94 TT=0.142 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh17.opb	OPT f=95 TT=0.019 T1=0.01	No data	OPT f=95 TT=0.041 T1=0.04	OPT f=95 TT=0.02 T1=0.02	OPT f=95 TT=0.083 T1=0.08	OPT f=95 TT=0.09 T1=0.09	OPT f=95 TT=0.025 T1=0.02	OPT f=95 TT=0.019 T1=0.01	OPT f=95 TT=0.794 T1=2.75	OPT f=95 TT=0.623 T1=0.32	OPT f=95 TT=0.188 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh1.opb	OPT f=92 TT=0.052 T1=0.05	No data	OPT f=92 TT=0.123 T1=0.12	OPT f=92 TT=0.052 T1=0.05	OPT f=92 TT=0.131 T1=0.13	OPT f=92 TT=0.211 T1=0.21	OPT f=92 TT=0.247 T1=0.24	OPT f=92 TT=0.063 T1=0.06	OPT f=92 TT=1.235 T1=3.76	OPT f=92 TT=0.916 T1=0.38	OPT f=92 TT=0.417 T1=0.39
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh201.opb	OPT f=84 TT=11.188 T1=11.19	No data	OPT f=84 TT=91.689 T1=91.7	OPT f=84 TT=16.179 T1=16.18	OPT f=84 TT=26.24 T1=26.24	OPT f=84 TT=11.188 T1=11.19	OPT f=84 TT=51.659 T1=51.66	OPT f=84 TT=11.303 T1=11.3	OPT f=84 TT=21.75 T1=12.26	OPT f=84 TT=14.571 T1=12.02	OPT f=84 TT=102.341 T1=85.23
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh204.opb	OPT f=93 TT=0.024 T1=0.02	No data	OPT f=93 TT=0.061 T1=0.06	OPT f=93 TT=0.035 T1=0.03	OPT f=93 TT=0.066 T1=0.06	OPT f=93 TT=0.127 T1=0.12	OPT f=93 TT=0.087 T1=0.08	OPT f=93 TT=0.024 T1=0.02	OPT f=93 TT=1.156 T1=1.75	OPT f=93 TT=0.727 T1=0.35	OPT f=93 TT=0.231 T1=0.21
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh205.opb	OPT f=94 TT=0.014 T1=0.01	No data	OPT f=94 TT=0.038 T1=0.03	OPT f=94 TT=0.023 T1=0.02	OPT f=94 TT=0.041 T1=0.06	OPT f=94 TT=0.088 T1=0.08	OPT f=94 TT=0.014 T1=0.01	OPT f=94 TT=0.016 T1=0.01	OPT f=94 TT=0.744 T1=3.75	OPT f=94 TT=0.574 T1=0.27	OPT f=94 TT=0.158 T1=0.15
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh207.opb	OPT f=95 TT=0.015 T1=0.01	No data	OPT f=95 TT=0.042 T1=0.04	OPT f=95 TT=0.021 T1=0.02	OPT f=95 TT=0.041 T1=0.04	OPT f=95 TT=0.051 T1=0.05	OPT f=95 TT=0.017 T1=0.02	OPT f=95 TT=0.015 T1=0.01	OPT f=95 TT=0.903 T1=1.26	OPT f=95 TT=0.524 T1=0.28	OPT f=95 TT=0.132 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh209.opb	OPT f=93 TT=0.026 T1=0.02	No data	OPT f=93 TT=0.049 T1=0.04	OPT f=93 TT=0.026 T1=0.02	OPT f=93 TT=0.091 T1=0.09	OPT f=93 TT=0.129 T1=0.12	OPT f=93 TT=0.047 T1=0.04	OPT f=93 TT=0.04 T1=0.04	OPT f=93 TT=0.994 T1=3.3	OPT f=93 TT=0.794 T1=0.29	OPT f=93 TT=0.201 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh210.opb	OPT f=88 TT=0.044 T1=0.04	No data	OPT f=88 TT=0.146 T1=0.14	OPT f=88 TT=0.044 T1=0.04	OPT f=88 TT=0.302 T1=0.3	OPT f=88 TT=0.389 T1=0.38	OPT f=88 TT=0.337 T1=0.33	OPT f=88 TT=0.216 T1=0.21	OPT f=88 TT=2.134 T1=4.76	OPT f=88 TT=0.913 T1=0.41	OPT f=88 TT=1.458 T1=0.34
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh212.opb	OPT f=97 TT=0.013 T1=0.01	No data	OPT f=97 TT=0.045 T1=0.04	OPT f=97 TT=0.024 T1=0.02	OPT f=97 TT=0.058 T1=0.05	OPT f=97 TT=0.069 T1=0.06	OPT f=97 TT=0.015 T1=0.01	OPT f=97 TT=0.013 T1=0.01	OPT f=97 TT=0.887 T1=2.26	OPT f=97 TT=0.645 T1=0.3	OPT f=97 TT=0.195 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh213.opb	OPT f=92 TT=0.012 T1=0.01	No data	OPT f=92 TT=0.037 T1=0.03	OPT f=92 TT=0.022 T1=0.02	OPT f=92 TT=0.077 T1=0.07	OPT f=92 TT=0.092 T1=0.09	OPT f=92 TT=0.012 T1=0.01	OPT f=92 TT=0.021 T1=0.02	OPT f=92 TT=0.724 T1=3.25	OPT f=92 TT=0.584 T1=0.28	OPT f=92 TT=0.214 T1=0.17
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh217.opb	OPT f=89 TT=0.352 T1=0.35	No data	OPT f=89 TT=0.6 T1=0.6	OPT f=89 TT=0.37 T1=0.36	OPT f=89 TT=0.352 T1=0.35	OPT f=89 TT=0.594 T1=0.59	OPT f=89 TT=1.799 T1=1.79	OPT f=89 TT=0.447 T1=0.44	OPT f=89 TT=2.284 T1=4.76	OPT f=89 TT=1.165 T1=0.57	OPT f=89 TT=2.066 T1=1.43
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh218.opb	OPT f=90 TT=0.033 T1=0.03	No data	OPT f=90 TT=0.053 T1=0.05	OPT f=90 TT=0.035 T1=0.03	OPT f=90 TT=0.115 T1=0.11	OPT f=90 TT=0.084 T1=0.08	OPT f=90 TT=0.034 T1=0.03	OPT f=90 TT=0.033 T1=0.03	OPT f=90 TT=0.834 T1=4.26	OPT f=90 TT=0.654 T1=0.33	OPT f=90 TT=0.266 T1=0.25
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh220.opb	OPT f=94 TT=0.026 T1=0.02	No data	OPT f=94 TT=0.059 T1=0.05	OPT f=94 TT=0.031 T1=0.03	OPT f=94 TT=0.099 T1=0.09	OPT f=94 TT=0.098 T1=0.09	OPT f=94 TT=0.1 T1=0.1	OPT f=94 TT=0.026 T1=0.02	OPT f=94 TT=1.074 T1=2.76	OPT f=94 TT=0.706 T1=0.34	OPT f=94 TT=0.324 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh301.opb	OPT f=95 TT=0.009 T1=0.01	No data	OPT f=95 TT=0.041 T1=0.04	OPT f=95 TT=0.024 T1=0.02	OPT f=95 TT=0.044 T1=0.04	OPT f=95 TT=0.081 T1=0.08	OPT f=95 TT=0.009 T1=0.01	OPT f=95 TT=0.016 T1=0.01	OPT f=95 TT=0.893 T1=2.28	OPT f=95 TT=0.664 T1=0.32	OPT f=95 TT=0.201 T1=0.28
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh7.opb	OPT f=89 TT=0.017 T1=0.01	No data	OPT f=89 TT=0.04 T1=0.04	OPT f=89 TT=0.024 T1=0.02	OPT f=89 TT=0.171 T1=0.17	OPT f=89 TT=0.081 T1=0.08	OPT f=89 TT=0.017 T1=0.01	OPT f=89 TT=0.04 T1=0.04	OPT f=89 TT=1.033 T1=2.25	OPT f=89 TT=0.683 T1=0.34	OPT f=89 TT=0.238 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-1-c.opb	OPT f=317 TT=0.088 T1=0.08	No data	OPT f=317 TT=1.858 T1=1.85	OPT f=317 TT=0.586 T1=0.58	OPT f=317 TT=0.461 T1=0.46	OPT f=317 TT=1.203 T1=1.2	OPT f=317 TT=0.088 T1=0.08	OPT f=317 TT=0.452 T1=0.45	OPT f=317 TT=3.223 T1=1.28	OPT f=317 TT=1.994 T1=0.83	OPT f=317 TT=2.756 T1=2.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-1.opb	OPT f=1015 TT=0.252 T1=0.25	No data	OPT f=1015 TT=2.448 T1=2.44	OPT f=1015 TT=1.004 T1=1	OPT f=1015 TT=2.06 T1=2.05	OPT f=1015 TT=2.165 T1=2.15	OPT f=1015 TT=0.252 T1=0.25	OPT f=1015 TT=0.484 T1=0.48	OPT f=1015 TT=4.812 T1=0.84	OPT f=1015 TT=2.335 T1=0.47	OPT f=1015 TT=5.933 T1=2.41
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-2-c.opb	OPT f=349 TT=0.058 T1=0.05	No data	OPT f=349 TT=2.057 T1=2.05	OPT f=349 TT=0.853 T1=0.85	OPT f=349 TT=0.751 T1=0.75	OPT f=349 TT=0.848 T1=0.84	OPT f=349 TT=0.058 T1=0.05	OPT f=349 TT=0.574 T1=0.57	OPT f=349 TT=4.314 T1=0.79	OPT f=349 TT=2.137 T1=0.58	OPT f=349 TT=2.373 T1=1.49
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-2.opb	OPT f=1015 TT=0.48 T1=0.48	No data	OPT f=1015 TT=2.392 T1=2.38	OPT f=1015 TT=1.214 T1=1.21	OPT f=1015 TT=3.387 T1=3.38	OPT f=1015 TT=2.658 T1=2.64	OPT f=1015 TT=0.48 T1=0.48	OPT f=1015 TT=0.547 T1=0.54	OPT f=1015 TT=5.042 T1=1.85	OPT f=1015 TT=2.696 T1=1.09	OPT f=1015 TT=19.204 T1=2.98
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-3-c.opb	OPT f=334 TT=0.289 T1=0.29	No data	OPT f=334 TT=1.237 T1=1.23	OPT f=334 TT=0.727 T1=0.72	OPT f=334 TT=0.65 T1=0.64	OPT f=334 TT=0.749 T1=0.74	OPT f=334 TT=0.289 T1=0.29	OPT f=334 TT=0.413 T1=0.41	OPT f=334 TT=4.162 T1=0.78	OPT f=334 TT=1.994 T1=1.05	OPT f=334 TT=2.971 T1=2.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-3.opb	OPT f=1015 TT=0.157 T1=0.15	No data	OPT f=1015 TT=1.9 T1=1.89	OPT f=1015 TT=1.015 T1=1.01	OPT f=1015 TT=1.901 T1=1.89	OPT f=1015 TT=2.827 T1=2.82	OPT f=1015 TT=0.157 T1=0.15	OPT f=1015 TT=0.676 T1=0.67	OPT f=1015 TT=4.86 T1=0.86	OPT f=1015 TT=2.956 T1=0.76	OPT f=1015 TT=6.708 T1=2.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-4-c.opb	OPT f=324 TT=0.03 T1=0.03	No data	OPT f=324 TT=0.67 T1=0.67	OPT f=324 TT=0.294 T1=0.29	OPT f=324 TT=0.235 T1=0.23	OPT f=324 TT=0.443 T1=0.43	OPT f=324 TT=0.03 T1=0.03	OPT f=324 TT=0.211 T1=0.21	OPT f=324 TT=2.603 T1=0.77	OPT f=324 TT=1.234 T1=0.46	OPT f=324 TT=0.639 T1=0.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-4.opb	OPT f=1015 TT=0.088 T1=0.08	No data	OPT f=1015 TT=1.375 T1=1.37	OPT f=1015 TT=0.63 T1=0.62	OPT f=1015 TT=1.442 T1=1.43	OPT f=1015 TT=1.636 T1=1.63	OPT f=1015 TT=0.088 T1=0.08	OPT f=1015 TT=0.356 T1=0.5	OPT f=1015 TT=3.183 T1=1.35	OPT f=1015 TT=1.484 T1=0.81	OPT f=1015 TT=4.988 T1=1.53
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-5-c.opb	OPT f=341 TT=0.165 T1=0.16	No data	OPT f=341 TT=3.703 T1=3.7	OPT f=341 TT=0.508 T1=0.5	OPT f=341 TT=0.554 T1=0.55	OPT f=341 TT=1.019 T1=1.01	OPT f=341 TT=0.165 T1=0.16	OPT f=341 TT=0.256 T1=0.25	OPT f=341 TT=3.253 T1=0.77	OPT f=341 TT=1.535 T1=0.93	OPT f=341 TT=1.426 T1=0.66
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-5.opb	OPT f=1015 TT=0.064 T1=0.06	No data	OPT f=1015 TT=2.283 T1=2.27	OPT f=1015 TT=0.937 T1=0.93	OPT f=1015 TT=0.731 T1=0.72	OPT f=1015 TT=1.839 T1=1.83	OPT f=1015 TT=0.064 T1=0.06	OPT f=1015 TT=0.512 T1=0.51	OPT f=1015 TT=4.125 T1=0.87	OPT f=1015 TT=1.943 T1=1.28	OPT f=1015 TT=6.104 T1=1.27
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-1-c.opb	OPT f=1315 TT=875.815 T1=875.95	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=1315 TT=875.815 T1=875.95	SAT (TO) f=1315 TT=1800.03 T1=1800.3	? (TO) TT=1801.1	? (TO) TT=1800.03	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-1.opb		No data	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-2-c.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.31	? (TO) TT=1800.41	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-2.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.91	? (TO) TT=1800.03	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-3-c.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.54	? (TO) TT=1800.62	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-3.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-4-c.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.81	? (TO) TT=1800.05	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-4.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-5-c.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.19	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-5.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-1-c.opb	OPT f=64 TT=0.002 T1=0	No data	OPT f=64 TT=0.027 T1=0.02	OPT f=64 TT=0.013 T1=0.01	OPT f=64 TT=0.014 T1=0.01	OPT f=64 TT=0.02 T1=0.02	OPT f=64 TT=0.002 T1=0	OPT f=64 TT=0.003 T1=0	OPT f=64 TT=0.325 T1=0.67	OPT f=64 TT=0.244 T1=0.17	OPT f=64 TT=0.083 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-1.opb	OPT f=350 TT=0.012 T1=0.01	No data	OPT f=350 TT=0.036 T1=0.03	OPT f=350 TT=0.019 T1=0.01	OPT f=350 TT=0.054 T1=0.05	OPT f=350 TT=0.068 T1=0.07	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.022 T1=0.02	OPT f=350 TT=0.653 T1=0.79	OPT f=350 TT=0.444 T1=0.25	OPT f=350 TT=0.062 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-2-c.opb	OPT f=68 TT=0.003 T1=0	No data	OPT f=68 TT=0.025 T1=0.02	OPT f=68 TT=0.013 T1=0.01	OPT f=68 TT=0.013 T1=0.01	OPT f=68 TT=0.032 T1=0.03	OPT f=68 TT=0.003 T1=0	OPT f=68 TT=0.003 T1=0	OPT f=68 TT=0.385 T1=0.7	OPT f=68 TT=0.263 T1=0.16	OPT f=68 TT=0.098 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-2.opb	OPT f=350 TT=0.012 T1=0.01	No data	OPT f=350 TT=0.032 T1=0.03	OPT f=350 TT=0.019 T1=0.02	OPT f=350 TT=0.055 T1=0.05	OPT f=350 TT=0.068 T1=0.06	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.025 T1=0.02	OPT f=350 TT=0.695 T1=0.78	OPT f=350 TT=0.484 T1=0.25	OPT f=350 TT=0.065 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-3-c.opb	OPT f=75 TT=0.003 T1=0	No data	OPT f=75 TT=0.03 T1=0.03	OPT f=75 TT=0.015 T1=0.01	OPT f=75 TT=0.02 T1=0.01	OPT f=75 TT=0.019 T1=0.01	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.004 T1=0	OPT f=75 TT=0.365 T1=0.68	OPT f=75 TT=0.264 T1=0.18	OPT f=75 TT=0.114 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-3.opb	OPT f=350 TT=0.013 T1=0.01	No data	OPT f=350 TT=0.034 T1=0.03	OPT f=350 TT=0.02 T1=0.02	OPT f=350 TT=0.054 T1=0.05	OPT f=350 TT=0.058 T1=0.06	OPT f=350 TT=0.013 T1=0.01	OPT f=350 TT=0.022 T1=0.02	OPT f=350 TT=0.664 T1=0.78	OPT f=350 TT=0.483 T1=0.25	OPT f=350 TT=0.063 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-4-c.opb	OPT f=67 TT=0.003 T1=0	No data	OPT f=67 TT=0.028 T1=0.03	OPT f=67 TT=0.013 T1=0.01	OPT f=67 TT=0.015 T1=0.01	OPT f=67 TT=0.014 T1=0.01	OPT f=67 TT=0.003 T1=0	OPT f=67 TT=0.005 T1=0	OPT f=67 TT=0.324 T1=0.69	OPT f=67 TT=0.243 T1=0.16	OPT f=67 TT=0.091 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-4.opb	OPT f=350 TT=0.012 T1=0.01	No data	OPT f=350 TT=0.034 T1=0.03	OPT f=350 TT=0.019 T1=0.01	OPT f=350 TT=0.059 T1=0.05	OPT f=350 TT=0.077 T1=0.07	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.023 T1=0.02	OPT f=350 TT=0.594 T1=0.76	OPT f=350 TT=0.415 T1=0.25	OPT f=350 TT=0.438 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-5-c.opb	OPT f=75 TT=0.003 T1=0	No data	OPT f=75 TT=0.024 T1=0.02	OPT f=75 TT=0.014 T1=0.01	OPT f=75 TT=0.02 T1=0.01	OPT f=75 TT=0.027 T1=0.02	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.354 T1=0.67	OPT f=75 TT=0.263 T1=0.17	OPT f=75 TT=0.105 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-5.opb	OPT f=350 TT=0.012 T1=0.01	No data	OPT f=350 TT=0.035 T1=0.03	OPT f=350 TT=0.019 T1=0.01	OPT f=350 TT=0.021 T1=0.02	OPT f=350 TT=0.056 T1=0.05	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.021 T1=0.02	OPT f=350 TT=0.664 T1=0.78	OPT f=350 TT=0.446 T1=0.26	OPT f=350 TT=0.442 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa0432-003.opb	UNSAT TT=0.008	No data	UNSAT TT=0.033	UNSAT TT=0.02	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=0.008	UNSAT TT=0.009	UNSAT TT=0.646	UNSAT TT=0.495	UNSAT TT=0.065
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa2670-130.opb	UNSAT TT=0.023	No data	UNSAT TT=0.063	UNSAT TT=0.036	UNSAT TT=0.06	UNSAT TT=0.059	UNSAT TT=0.023	UNSAT TT=0.023	UNSAT TT=1.474	UNSAT TT=0.833	UNSAT TT=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa2670-141.opb	UNSAT TT=0.02	No data	UNSAT TT=0.057	UNSAT TT=0.038	UNSAT TT=0.044	UNSAT TT=0.045	UNSAT TT=0.02	UNSAT TT=0.02	UNSAT TT=1.014	UNSAT TT=0.835	UNSAT TT=0.192
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa6288-047.opb	UNSAT TT=0.165	No data	UNSAT TT=0.183	UNSAT TT=0.165	UNSAT TT=0.533	UNSAT TT=0.485	UNSAT TT=0.188	UNSAT TT=0.189	UNSAT TT=2.664	UNSAT TT=1.184	UNSAT TT=0.963
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-038.opb	OPT f=1448 TT=0.159 T1=0.15	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=1448 TT=1800.01 T1=1800.3	OPT f=1448 TT=7.194 T1=7.15	OPT f=1448 TT=0.159 T1=0.15	OPT f=1448 TT=1.96 T1=1.95	SAT (TO) f=1448 TT=1800.69 T1=0.88	SAT (TO) f=1448 TT=1800.97 T1=0.47	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-158.opb	OPT f=1327 TT=0.086 T1=0.08	No data	? (TO) TT=1800.14	? (TO) TT=1800.03	SAT (TO) f=1327 TT=1800.02 T1=1800.3	OPT f=1327 TT=4.832 T1=4.8	OPT f=1327 TT=0.086 T1=0.08	OPT f=1327 TT=1.115 T1=1.11	SAT (TO) f=1327 TT=1800.08 T1=0.85	SAT (TO) f=1327 TT=1800.08 T1=0.35	OPT f=1327 TT=6.693 T1=6.69
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-159.opb	OPT f=1327 TT=0.083 T1=0.08	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT (TO) f=1327 TT=1800.03 T1=1800.3	OPT f=1327 TT=4.729 T1=4.7	OPT f=1327 TT=0.083 T1=0.08	OPT f=1327 TT=1.152 T1=1.15	SAT (TO) f=1327 TT=1800.01 T1=0.87	SAT (TO) f=1327 TT=1800.7 T1=0.34	OPT f=1327 TT=6.884 T1=6.87
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-160.opb	OPT f=1359 TT=0.091 T1=0.09	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT (TO) f=1359 TT=1800.11 T1=1800.4	OPT f=1359 TT=4.631 T1=4.6	OPT f=1359 TT=0.091 T1=0.09	OPT f=1359 TT=1.308 T1=1.38	SAT (TO) f=1359 TT=1800.07 T1=1.39	SAT (TO) f=1359 TT=1800.09 T1=0.41	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-1pb.opb	OPT f=36 TT=0.011 T1=0.01	No data	OPT f=36 TT=0.031 T1=0.03	OPT f=36 TT=0.016 T1=0.01	OPT f=36 TT=0.062 T1=0.06	OPT f=36 TT=0.121 T1=0.12	OPT f=36 TT=0.011 T1=0.01	OPT f=36 TT=0.02 T1=0.02	OPT f=36 TT=1.115 T1=0.7	OPT f=36 TT=0.503 T1=0.24	OPT f=36 TT=0.134 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-2pb.opb	OPT f=36 TT=0.008 T1=0	No data	OPT f=36 TT=0.036 T1=0.03	OPT f=36 TT=0.018 T1=0.01	OPT f=36 TT=0.099 T1=0.09	OPT f=36 TT=0.139 T1=0.14	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.014 T1=0.01	OPT f=36 TT=0.874 T1=0.72	OPT f=36 TT=0.603 T1=0.3	OPT f=36 TT=0.136 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-3pb.opb	OPT f=36 TT=0.008 T1=0	No data	OPT f=36 TT=0.036 T1=0.03	OPT f=36 TT=0.018 T1=0.01	OPT f=36 TT=0.1 T1=0.1	OPT f=36 TT=0.124 T1=0.13	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.023 T1=0.02	OPT f=36 TT=1.153 T1=0.71	OPT f=36 TT=0.586 T1=0.29	OPT f=36 TT=0.108 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-4pb.opb	OPT f=36 TT=0.01 T1=0	No data	OPT f=36 TT=0.044 T1=0.04	OPT f=36 TT=0.022 T1=0.02	OPT f=36 TT=0.082 T1=0.08	OPT f=36 TT=0.142 T1=0.14	OPT f=36 TT=0.01 T1=0	OPT f=36 TT=0.018 T1=0.01	OPT f=36 TT=1.194 T1=0.72	OPT f=36 TT=0.615 T1=0.24	OPT f=36 TT=0.102 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-5pb.opb	OPT f=34 TT=0.008 T1=0	No data	OPT f=34 TT=0.041 T1=0.04	OPT f=34 TT=0.032 T1=0.03	OPT f=34 TT=0.083 T1=0.08	OPT f=34 TT=0.158 T1=0.15	OPT f=34 TT=0.008 T1=0	OPT f=34 TT=0.015 T1=0.01	OPT f=34 TT=1.723 T1=1.23	OPT f=34 TT=0.673 T1=0.19	OPT f=34 TT=0.151 T1=0.14
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-10pb.opb	OPT f=70 TT=0.104 T1=0.1	No data	OPT f=70 TT=0.375 T1=0.37	OPT f=70 TT=0.104 T1=0.1	OPT f=70 TT=1.041 T1=1.04	OPT f=70 TT=1.007 T1=1	OPT f=70 TT=0.21 T1=0.21	OPT f=70 TT=0.295 T1=0.29	OPT f=70 TT=4.872 T1=1.33	OPT f=70 TT=1.584 T1=0.66	OPT f=70 TT=1.62 T1=1.56
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-1pb.opb	OPT f=62 TT=0.038 T1=0.03	No data	OPT f=62 TT=15.602 T1=15.6	OPT f=62 TT=7.934 T1=7.93	OPT f=62 TT=3.467 T1=3.46	OPT f=62 TT=2.051 T1=2.04	OPT f=62 TT=0.038 T1=0.03	OPT f=62 TT=0.266 T1=0.26	OPT f=62 TT=188.007 T1=5.84	OPT f=62 TT=536.192 T1=7.92	OPT f=62 TT=7.436 T1=7.38
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-2pb.opb	OPT f=64 TT=0.397 T1=0.39	No data	OPT f=64 TT=6.932 T1=6.93	OPT f=64 TT=1.935 T1=1.93	OPT f=64 TT=11.348 T1=11.34	OPT f=64 TT=3.075 T1=3.07	OPT f=64 TT=0.397 T1=0.39	OPT f=64 TT=1.428 T1=1.42	OPT f=64 TT=227.618 T1=6.83	OPT f=64 TT=82.73 T1=9.66	OPT f=64 TT=1.677 T1=1.62
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-3pb.opb	OPT f=62 TT=0.299 T1=0.29	No data	OPT f=62 TT=13.44 T1=13.44	OPT f=62 TT=8.496 T1=8.5	OPT f=62 TT=4.467 T1=4.46	OPT f=62 TT=2.576 T1=2.57	OPT f=62 TT=0.299 T1=0.29	OPT f=62 TT=0.593 T1=0.59	OPT f=62 TT=155.529 T1=31.31	OPT f=62 TT=84.78 T1=51.64	OPT f=62 TT=21.491 T1=21.39
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-4pb.opb	OPT f=60 TT=0.184 T1=0.18	No data	OPT f=60 TT=12.047 T1=12.04	OPT f=60 TT=15.762 T1=15.76	OPT f=60 TT=9.712 T1=9.7	OPT f=60 TT=2.403 T1=2.43	OPT f=60 TT=0.184 T1=0.18	OPT f=60 TT=0.342 T1=0.34	OPT f=60 TT=951.36 T1=22.82	OPT f=60 TT=405.95 T1=101.34	OPT f=60 TT=8.299 T1=8.24
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-5pb.opb	OPT f=60 TT=0.376 T1=0.37	No data	OPT f=60 TT=10.853 T1=10.85	OPT f=60 TT=19.979 T1=19.98	OPT f=60 TT=6.431 T1=6.43	OPT f=60 TT=0.922 T1=0.91	OPT f=60 TT=0.376 T1=0.37	OPT f=60 TT=0.775 T1=0.77	OPT f=60 TT=258.277 T1=29.87	OPT f=60 TT=116.56 T1=46.04	OPT f=60 TT=11.049 T1=10.99
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-6pb.opb	OPT f=66 TT=0.229 T1=0.22	No data	OPT f=66 TT=4.668 T1=4.66	OPT f=66 TT=1.747 T1=1.74	OPT f=66 TT=4.547 T1=4.54	OPT f=66 TT=2.534 T1=2.53	OPT f=66 TT=0.229 T1=0.22	OPT f=66 TT=0.699 T1=0.82	OPT f=66 TT=47.936 T1=2.8	OPT f=66 TT=11.573 T1=1.66	OPT f=66 TT=61.889 T1=1.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-7pb.opb	OPT f=64 TT=0.405 T1=0.4	No data	OPT f=64 TT=1.779 T1=1.77	OPT f=64 TT=1.871 T1=1.87	OPT f=64 TT=3.663 T1=3.66	OPT f=64 TT=0.924 T1=0.92	OPT f=64 TT=0.405 T1=0.4	OPT f=64 TT=0.845 T1=0.84	OPT f=64 TT=21.091 T1=3.81	OPT f=64 TT=7.793 T1=2.31	OPT f=64 TT=26.579 T1=26.52
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-8pb.opb	OPT f=36 TT=0.021 T1=0.02	No data	OPT f=36 TT=6.463 T1=6.46	OPT f=36 TT=1.937 T1=1.93	OPT f=36 TT=4.712 T1=4.71	OPT f=36 TT=0.341 T1=0.34	OPT f=36 TT=0.021 T1=0.02	OPT f=36 TT=0.134 T1=0.13	OPT f=36 TT=50.916 T1=10.31	OPT f=36 TT=107.82 T1=2.34	OPT f=36 TT=0.234 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-9pb.opb	OPT f=68 TT=0.193 T1=0.19	No data	OPT f=68 TT=2.122 T1=2.12	OPT f=68 TT=1.524 T1=1.52	OPT f=68 TT=14.856 T1=14.85	OPT f=68 TT=1.913 T1=1.9	OPT f=68 TT=0.193 T1=0.19	OPT f=68 TT=0.401 T1=0.4	OPT f=68 TT=10.371 T1=1.32	OPT f=68 TT=4.592 T1=2.1	OPT f=68 TT=130.572 T1=1.21
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-9symml.opb	SAT f=4693 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=4899 TT=1800.03 T1=1800.4	SAT (TO) f=6227 TT=1800.01 T1=1800.3	SAT (TO) f=4693 TT=1800.01 T1=1800.3	SAT (TO) f=5202 TT=1800.19 T1=1800.4	SAT (TO) f=5498 TT=1800.69 T1=37.87	SAT (TO) f=5962 TT=1800.56 T1=1.56	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-b1.opb	OPT f=128 TT=0.001 T1=0	No data	OPT f=128 TT=0.023 T1=0.02	OPT f=128 TT=0.013 T1=0.01	OPT f=128 TT=0.003 T1=0	OPT f=128 TT=0.029 T1=0.02	OPT f=128 TT=0.002 T1=0	OPT f=128 TT=0.001 T1=0	OPT f=128 TT=0.183 T1=1.8	OPT f=128 TT=0.174 T1=0.14	OPT f=128 TT=0.022 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-C17.opb	OPT f=260 TT=0 T1=0	No data	OPT f=260 TT=0.022 T1=0.02	OPT f=260 TT=0.015 T1=0.01	OPT f=260 TT=0.001 T1=0	OPT f=260 TT=0.008 T1=0.01	OPT f=260 TT=0 T1=0	OPT f=260 TT=0.001 T1=0	OPT f=260 TT=0.174 T1=1.13	OPT f=260 TT=0.175 T1=0.14	OPT f=260 TT=0.022 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-C432.opb	SAT f=4834 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=5635 TT=1800.03 T1=1800.4	SAT (TO) f=7143 TT=1800.1 T1=1800.4	SAT (TO) f=4834 TT=1800.02 T1=1800.3	SAT (TO) f=5552 TT=1800.46 T1=1800.4	SAT (TO) f=6156 TT=1800.14 T1=125.58	SAT (TO) f=6879 TT=1800.02 T1=1181.17	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-c8.opb	OPT f=1194 TT=11.714 T1=11.71	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1302 TT=1800.08 T1=1800.4	SAT (TO) f=1737 TT=1800.02 T1=1800.3	OPT f=1194 TT=11.714 T1=11.71	SAT (TO) f=1221 TT=1800.07 T1=1800.4	SAT (TO) f=1482 TT=1800.16 T1=296.34	SAT (TO) f=1557 TT=1800.75 T1=1163.63	OPT f=1194 TT=178.038 T1=80.91
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-cc.opb	OPT f=1567 TT=0.005 T1=0	No data	OPT f=1567 TT=1.487 T1=1.48	OPT f=1567 TT=3.514 T1=3.51	SAT (TO) f=1588 TT=1800.02 T1=1800.3	SAT (TO) f=1585 TT=1800.02 T1=1800.3	OPT f=1567 TT=0.005 T1=0	SAT (TO) f=1597 TT=1800.1 T1=1800.4	SAT (TO) f=1603 TT=1800.04 T1=26.23	SAT (TO) f=1653 TT=1800.69 T1=9.08	OPT f=1567 TT=8.867 T1=3.27
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-cm42a.opb	OPT f=694 TT=0.068 T1=0.06	No data	OPT f=694 TT=13.552 T1=13.55	OPT f=694 TT=7.441 T1=7.44	OPT f=694 TT=89.508 T1=89.52	OPT f=694 TT=32.095 T1=32.09	OPT f=694 TT=0.068 T1=0.06	OPT f=694 TT=54.005 T1=54.01	SAT (TO) f=694 TT=1800.93 T1=224.73	SAT (TO) f=801 TT=1800.08 T1=1556.84	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-cmb.opb	OPT f=1053 TT=0.406 T1=0.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1187 TT=1800.1 T1=1800.4	SAT (TO) f=1524 TT=1800.02 T1=1800.3	OPT f=1053 TT=0.406 T1=0.4	SAT (TO) f=1101 TT=1800.1 T1=1800.4	SAT (TO) f=1398 TT=1800.53 T1=110.32	SAT (TO) f=1429 TT=1800.66 T1=1215.5	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-mux.opb	OPT f=872 TT=8.669 T1=8.67	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1218 TT=1800.01 T1=1800.3	SAT (TO) f=872 TT=1800.02 T1=1800.3	OPT f=872 TT=8.669 T1=8.67	SAT (TO) f=986 TT=1800.08 T1=1800.4	SAT (TO) f=1232 TT=1800.26 T1=897.9	SAT (TO) f=1473 TT=1800.67 T1=0.39	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/synthesis-ptl-cmos-circuits/ normalized-my_adder.opb	OPT f=4561 TT=0.065 T1=0.06	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=5209 TT=1800.02 T1=1800.4	SAT (TO) f=6071 TT=1800.02 T1=1800.3	OPT f=4561 TT=0.065 T1=0.06	SAT (TO) f=5301 TT=1800.15 T1=1800.4	SAT (TO) f=5246 TT=1800.09 T1=546.42	SAT (TO) f=6092 TT=1800.05 T1=0.28	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ttp/ normalized-circ10_3.opb	SAT f=342 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=342 TT=1800.07 T1=1800.4	SAT (TO) f=402 TT=1800.09 T1=1800.4	SAT (TO) f=374 TT=1800.07 T1=1800.4	SAT (TO) f=348 TT=1800.06 T1=1800.4	SAT (TO) f=354 TT=1800.1 T1=3.08	SAT (TO) f=378 TT=1800.02 T1=1.56	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-circ4_3.opb	OPT f=20 TT=0.027 T1=0.02	No data	OPT f=20 TT=0.05 T1=0.04	OPT f=20 TT=0.027 T1=0.02	OPT f=20 TT=0.083 T1=0.08	OPT f=20 TT=0.104 T1=0.1	OPT f=20 TT=0.115 T1=0.11	OPT f=20 TT=0.096 T1=0.09	OPT f=20 TT=1.974 T1=0.74	OPT f=20 TT=0.855 T1=0.24	OPT f=20 TT=0.967 T1=0.21
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-circ6_3.opb	SAT f=64 TT=1800.07 T1=9.37	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=66 TT=1800.02 T1=1800.3	SAT (TO) f=90 TT=1800.02 T1=1800.3	SAT (TO) f=70 TT=1800.02 T1=1800.3	SAT (TO) f=66 TT=1800.02 T1=1800.3	SAT (TO) f=68 TT=1800.14 T1=72.46	SAT (TO) f=64 TT=1800.07 T1=9.37	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-circ8_3.opb	SAT f=154 TT=1800.09 T1=63.43	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=162 TT=1800.11 T1=1800.4	SAT (TO) f=214 TT=1800.11 T1=1800.4	SAT (TO) f=182 TT=1800.09 T1=1800.4	SAT (TO) f=170 TT=1800.1 T1=1800.4	SAT (TO) f=180 TT=1800.19 T1=4.71	SAT (TO) f=154 TT=1800.09 T1=63.43	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ttp/ normalized-data10_3.opb	SAT f=78108 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=80122 TT=1800.08 T1=1800.4	SAT (TO) f=91022 TT=1800.08 T1=1800.4	SAT (TO) f=78108 TT=1800.09 T1=1800.4	? TT=103.468	SAT (TO) f=81570 TT=1800.86 T1=3.59	SAT (TO) f=81962 TT=1800.03 T1=3.97	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-data4_3.opb	OPT f=8276 TT=0.148 T1=0.15	No data	OPT f=8276 TT=0.432 T1=0.43	OPT f=8276 TT=0.148 T1=0.15	OPT f=8276 TT=0.874 T1=0.87	OPT f=8276 TT=0.98 T1=0.97	OPT f=8276 TT=0.252 T1=0.25	OPT f=8276 TT=0.364 T1=0.36	OPT f=8276 TT=3.145 T1=2.23	OPT f=8276 TT=0.935 T1=0.34	OPT f=8276 TT=5.258 T1=1.67
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-data6_3.opb	SAT f=24853 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=24853 TT=1800.02 T1=1800.3	SAT (TO) f=34145 TT=1800.02 T1=1800.3	SAT (TO) f=25115 TT=1800.02 T1=1800.3	? TT=90.037	SAT (TO) f=25186 TT=1800.01 T1=36.97	SAT (TO) f=25108 TT=1800.65 T1=1.1	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-data8_3.opb	SAT f=42718 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=47019 TT=1800.01 T1=1800.3	SAT (TO) f=57240 TT=1800.09 T1=1800.4	SAT (TO) f=42718 TT=1800.01 T1=1800.3	? TT=84.93	SAT (TO) f=46875 TT=1800 T1=24.76	SAT (TO) f=50012 TT=1800.71 T1=1.06	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/submitted-PB05/ sorensson/garden/normalized-g100x100.opb	SAT f=2932 TT=1800.71 T1=73.78	No data	? (TO) TT=1800.16	? (TO) TT=1800.02	SAT (TO) f=3334 TT=1800.09 T1=1800.4	SAT (TO) f=3334 TT=1800.08 T1=1800.4	SAT (TO) f=3334 TT=1800.02 T1=1800.3	SAT (TO) f=3334 TT=1800.08 T1=1800.4	SAT (TO) f=2932 TT=1800.71 T1=73.78	SAT (TO) f=3334 TT=1800.05 T1=0.58	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g15x15.opb	OPT f=53 TT=24.648 T1=24.65	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=54 TT=1800.01 T1=1800.3	OPT f=53 TT=450.06 T1=450.12	OPT f=53 TT=24.648 T1=24.65	OPT f=53 TT=70.189 T1=70.2	SAT (TO) f=63 TT=1803.88 T1=69.72	SAT (TO) f=71 TT=1800.03 T1=1441.6	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g2x2.opb	OPT f=2 TT=0 T1=0	No data	OPT f=2 TT=0.021 T1=0.02	OPT f=2 TT=0.012 T1=0.01	OPT f=2 TT=0.001 T1=0	OPT f=2 TT=0.001 T1=0	OPT f=2 TT=0.002 T1=0	OPT f=2 TT=0 T1=0	OPT f=2 TT=0.163 T1=0.62	OPT f=2 TT=0.154 T1=0.12	OPT f=2 TT=0.018 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g4x4.opb	OPT f=4 TT=0.001 T1=0	No data	OPT f=4 TT=0.022 T1=0.02	OPT f=4 TT=0.013 T1=0.01	OPT f=4 TT=0.002 T1=0	OPT f=4 TT=0.002 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.174 T1=1.63	OPT f=4 TT=0.173 T1=0.14	OPT f=4 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g7x7.opb	OPT f=12 TT=0.002 T1=0	No data	OPT f=12 TT=0.035 T1=0.03	OPT f=12 TT=0.023 T1=0.02	OPT f=12 TT=0.022 T1=0.02	OPT f=12 TT=0.023 T1=0.02	OPT f=12 TT=0.002 T1=0	OPT f=12 TT=0.012 T1=0.01	OPT f=12 TT=3.423 T1=3.14	OPT f=12 TT=39.53 T1=16.78	OPT f=12 TT=1.596 T1=1.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g9x3.opb	OPT f=7 TT=0.001 T1=0	No data	OPT f=7 TT=0.023 T1=0.02	OPT f=7 TT=0.014 T1=0.01	OPT f=7 TT=0.008 T1=0	OPT f=7 TT=0.006 T1=0	OPT f=7 TT=0.001 T1=0	OPT f=7 TT=0.002 T1=0	OPT f=7 TT=0.184 T1=1.64	OPT f=7 TT=0.533 T1=0.18	OPT f=7 TT=0.023 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g9x9.opb	OPT f=20 TT=0.009 T1=0.01	No data	OPT f=20 TT=1.176 T1=1.17	OPT f=20 TT=5.585 T1=5.58	OPT f=20 TT=0.308 T1=0.3	OPT f=20 TT=0.23 T1=0.23	OPT f=20 TT=0.009 T1=0.01	OPT f=20 TT=0.143 T1=0.14	SAT (TO) f=20 TT=1800.02 T1=514.77	SAT (TO) f=23 TT=1800.08 T1=37.94	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_10.opb.PB06.opb	SAT f=212 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=215 TT=1800.1 T1=1800.4	SAT (TO) f=238 TT=1800.02 T1=1800.3	SAT (TO) f=469 TT=1800.02 T1=1800.3	SAT (TO) f=212 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.7 T1=331.37	SAT (TO) f=222 TT=1800.02 T1=726.44	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_11.opb.PB06.opb	SAT f=210 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=217 TT=1800.02 T1=1800.3	SAT (TO) f=230 TT=1800.02 T1=1800.3	SAT (TO) f=472 TT=1800.02 T1=1800.3	SAT (TO) f=210 TT=1800.02 T1=1800.3	SAT (TO) f=220 TT=1800.46 T1=244.35	SAT (TO) f=223 TT=1800.78 T1=78.74	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_12.opb.PB06.opb	SAT f=205 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=207 TT=1800.02 T1=1800.3	SAT (TO) f=224 TT=1800.08 T1=1800.4	SAT (TO) f=464 TT=1800.02 T1=1800.3	SAT (TO) f=205 TT=1800.1 T1=1800.4	SAT (TO) f=212 TT=1800.04 T1=83.25	SAT (TO) f=215 TT=1800.66 T1=184.07	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_13.opb.PB06.opb	SAT f=214 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=220 TT=1800.02 T1=1800.3	SAT (TO) f=238 TT=1800.02 T1=1800.3	SAT (TO) f=475 TT=1800.02 T1=1800.3	SAT (TO) f=214 TT=1800.02 T1=1800.3	SAT (TO) f=216 TT=1800.54 T1=372.48	SAT (TO) f=216 TT=1800.09 T1=300.17	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_14.opb.PB06.opb	SAT f=207 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=218 TT=1800.03 T1=1800.3	SAT (TO) f=227 TT=1800.01 T1=1800.3	SAT (TO) f=467 TT=1800.02 T1=1800.3	SAT (TO) f=207 TT=1800.02 T1=1800.3	SAT (TO) f=218 TT=1800.05 T1=468.96	SAT (TO) f=220 TT=1800.69 T1=102.26	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_15.opb.PB06.opb	SAT f=213 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=219 TT=1800.02 T1=1800.3	SAT (TO) f=237 TT=1800.02 T1=1800.3	SAT (TO) f=472 TT=1800.01 T1=1800.3	SAT (TO) f=213 TT=1800.02 T1=1800.3	SAT (TO) f=218 TT=1800.04 T1=142.94	SAT (TO) f=228 TT=1800.06 T1=592.22	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_16.opb.PB06.opb	SAT f=213 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=219 TT=1800.1 T1=1800.4	SAT (TO) f=231 TT=1800.02 T1=1800.3	SAT (TO) f=475 TT=1800.02 T1=1800.3	SAT (TO) f=213 TT=1800.01 T1=1800.3	SAT (TO) f=219 TT=1800.06 T1=450.46	SAT (TO) f=226 TT=1800.78 T1=8.49	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_17.opb.PB06.opb	SAT f=219 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=224 TT=1800.02 T1=1800.3	SAT (TO) f=249 TT=1800.02 T1=1800.3	SAT (TO) f=480 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.03 T1=1800.3	SAT (TO) f=227 TT=1800.55 T1=774.59	SAT (TO) f=231 TT=1800.73 T1=925.36	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_18.opb.PB06.opb	SAT f=212 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=217 TT=1800.01 T1=1800.3	SAT (TO) f=234 TT=1800.11 T1=1800.4	SAT (TO) f=469 TT=1800.01 T1=1800.3	SAT (TO) f=212 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.04 T1=575.89	SAT (TO) f=222 TT=1800.07 T1=4.06	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_19.opb.PB06.opb	SAT f=204 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT (TO) f=211 TT=1800.01 T1=1800.3	SAT (TO) f=222 TT=1800.02 T1=1800.3	SAT (TO) f=466 TT=1800.02 T1=1800.3	SAT (TO) f=204 TT=1800.02 T1=1800.3	SAT (TO) f=212 TT=1800.7 T1=401.71	SAT (TO) f=220 TT=1800.02 T1=1181.25	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_20.opb.PB06.opb	SAT f=211 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=212 TT=1800.02 T1=1800.3	SAT (TO) f=222 TT=1800.02 T1=1800.3	SAT (TO) f=472 TT=1800.01 T1=1800.3	SAT (TO) f=211 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.48 T1=597.67	SAT (TO) f=223 TT=1800.09 T1=0.46	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_21.opb.PB06.opb	SAT f=213 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=217 TT=1800.02 T1=1800.3	SAT (TO) f=226 TT=1800.1 T1=1800.4	SAT (TO) f=477 TT=1800.01 T1=1800.3	SAT (TO) f=213 TT=1800.02 T1=1800.3	SAT (TO) f=220 TT=1800.49 T1=702.75	SAT (TO) f=229 TT=1800.02 T1=164.21	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_22.opb.PB06.opb	SAT f=211 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=213 TT=1800.02 T1=1800.3	SAT (TO) f=232 TT=1800.01 T1=1800.3	SAT (TO) f=469 TT=1800.02 T1=1800.3	SAT (TO) f=211 TT=1800.02 T1=1800.3	SAT (TO) f=216 TT=1800.04 T1=16.31	SAT (TO) f=216 TT=1800.73 T1=31.86	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_23.opb.PB06.opb	SAT f=218 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT (TO) f=223 TT=1800.1 T1=1800.4	SAT (TO) f=247 TT=1800.02 T1=1800.3	SAT (TO) f=478 TT=1800.02 T1=1800.3	SAT (TO) f=218 TT=1800.02 T1=1800.3	SAT (TO) f=222 TT=1800.03 T1=73.41	SAT (TO) f=229 TT=1800.6 T1=4.22	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_24.opb.PB06.opb	SAT f=216 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=223 TT=1800.1 T1=1800.4	SAT (TO) f=238 TT=1800.1 T1=1800.4	SAT (TO) f=474 TT=1800.02 T1=1800.3	SAT (TO) f=216 TT=1800.09 T1=1800.4	SAT (TO) f=219 TT=1800.04 T1=27.79	SAT (TO) f=219 TT=1800.73 T1=523.43	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_0.opb.PB06.opb	SAT f=1160 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=1200 TT=1800.01 T1=1800.4	SAT (TO) f=1200 TT=1800.02 T1=1800.3	SAT (TO) f=1200 TT=1800.02 T1=1800.3	SAT (TO) f=1160 TT=1800.03 T1=1800.3	SAT (TO) f=1174 TT=1800.04 T1=541.7	SAT (TO) f=1198 TT=1800.06 T1=0.47	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_11.opb.PB06.opb	SAT f=1135 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1175 TT=1800.04 T1=1800.4	SAT (TO) f=1175 TT=1800.03 T1=1800.3	SAT (TO) f=1175 TT=1800.02 T1=1800.3	SAT (TO) f=1135 TT=1800.02 T1=1800.3	SAT (TO) f=1152 TT=1800.02 T1=411.98	SAT (TO) f=1171 TT=1800.73 T1=1286.14	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_12.opb.PB06.opb	SAT f=1145 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=1181 TT=1800.08 T1=1800.4	SAT (TO) f=1181 TT=1800.01 T1=1800.3	SAT (TO) f=1181 TT=1800.02 T1=1800.3	SAT (TO) f=1145 TT=1800.03 T1=1800.3	SAT (TO) f=1164 TT=1800.73 T1=259.34	SAT (TO) f=1180 TT=1800.05 T1=168.59	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_18.opb.PB06.opb	SAT f=1143 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT (TO) f=1198 TT=1800.06 T1=1800.4	SAT (TO) f=1198 TT=1800.1 T1=1800.4	SAT (TO) f=1198 TT=1800.03 T1=1800.3	SAT (TO) f=1143 TT=1800.02 T1=1800.3	SAT (TO) f=1171 TT=1800.36 T1=742.74	SAT (TO) f=1193 TT=1800.64 T1=1221.74	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_1.opb.PB06.opb	SAT f=1152 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT (TO) f=1189 TT=1800.06 T1=1800.4	SAT (TO) f=1189 TT=1800.02 T1=1800.3	SAT (TO) f=1189 TT=1800.02 T1=1800.3	SAT (TO) f=1152 TT=1800.03 T1=1800.3	SAT (TO) f=1159 TT=1800.04 T1=641.88	SAT (TO) f=1188 TT=1801.2 T1=0.4	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_21.opb.PB06.opb	SAT f=1138 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=1171 TT=1800.09 T1=1800.4	SAT (TO) f=1209 TT=1800.01 T1=1800.3	SAT (TO) f=1209 TT=1800.02 T1=1800.3	SAT (TO) f=1138 TT=1800.01 T1=1800.3	SAT (TO) f=1151 TT=1800.14 T1=701.43	SAT (TO) f=1206 TT=1800 T1=4.11	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_2.opb.PB06.opb	SAT f=1146 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1200 TT=1800.04 T1=1800.4	SAT (TO) f=1200 TT=1800.01 T1=1800.3	SAT (TO) f=1200 TT=1800.02 T1=1800.3	SAT (TO) f=1146 TT=1800.02 T1=1800.3	SAT (TO) f=1169 TT=1800.38 T1=860.77	SAT (TO) f=1199 TT=1800.02 T1=0.79	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_33.opb.PB06.opb	SAT f=1151 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1190 TT=1800.02 T1=1800.4	SAT (TO) f=1190 TT=1800.02 T1=1800.3	SAT (TO) f=1190 TT=1800.02 T1=1800.3	SAT (TO) f=1151 TT=1800.02 T1=1800.3	SAT (TO) f=1166 TT=1800.39 T1=896.31	SAT (TO) f=1187 TT=1800.64 T1=10.62	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_34.opb.PB06.opb	SAT f=1141 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=1170 TT=1800.03 T1=1800.4	SAT (TO) f=1181 TT=1800.11 T1=1800.4	SAT (TO) f=1181 TT=1800.02 T1=1800.3	SAT (TO) f=1141 TT=1800.02 T1=1800.3	SAT (TO) f=1157 TT=1800.3 T1=897.12	SAT (TO) f=1180 TT=1800.02 T1=0.43	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_36.opb.PB06.opb	SAT f=1147 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=1187 TT=1800.08 T1=1800.4	SAT (TO) f=1204 TT=1800.01 T1=1800.3	SAT (TO) f=1204 TT=1800.02 T1=1800.3	SAT (TO) f=1147 TT=1800.02 T1=1800.3	SAT (TO) f=1175 TT=1800.17 T1=895.7	SAT (TO) f=1204 TT=1800.05 T1=0.33	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_43.opb.PB06.opb	SAT f=1150 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT (TO) f=1187 TT=1800.07 T1=1800.4	SAT (TO) f=1199 TT=1800.02 T1=1800.3	SAT (TO) f=1199 TT=1800.02 T1=1800.3	SAT (TO) f=1150 TT=1800.11 T1=1800.4	SAT (TO) f=1163 TT=1800.03 T1=731.03	SAT (TO) f=1198 TT=1800.63 T1=76.71	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_5.opb.PB06.opb	SAT f=1147 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=1167 TT=1800.07 T1=1800.4	SAT (TO) f=1167 TT=1800.01 T1=1800.3	SAT (TO) f=1167 TT=1800.02 T1=1800.3	SAT (TO) f=1147 TT=1800.02 T1=1800.3	SAT (TO) f=1159 TT=1800.52 T1=388.96	SAT (TO) f=1164 TT=1800.01 T1=7.53	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_6.opb.PB06.opb	SAT f=1148 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT (TO) f=1211 TT=1800.07 T1=1800.4	SAT (TO) f=1211 TT=1800.11 T1=1800.4	SAT (TO) f=1211 TT=1800.02 T1=1800.3	SAT (TO) f=1148 TT=1800.02 T1=1800.3	SAT (TO) f=1171 TT=1800.15 T1=537.08	SAT (TO) f=1209 TT=1800.8 T1=24.37	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_7.opb.PB06.opb	SAT f=1147 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT (TO) f=1194 TT=1800.08 T1=1800.4	SAT (TO) f=1194 TT=1800.01 T1=1800.3	SAT (TO) f=1194 TT=1800.02 T1=1800.3	SAT (TO) f=1147 TT=1800.02 T1=1800.3	SAT (TO) f=1168 TT=1800.58 T1=522.55	SAT (TO) f=1194 TT=1800 T1=0.35	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_8.opb.PB06.opb	SAT f=1156 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT (TO) f=1168 TT=1800.09 T1=1800.4	SAT (TO) f=1203 TT=1800.1 T1=1800.4	SAT (TO) f=1203 TT=1800.02 T1=1800.3	SAT (TO) f=1156 TT=1800.02 T1=1800.3	SAT (TO) f=1174 TT=1800.36 T1=764.46	SAT (TO) f=1201 TT=1800.75 T1=0.79	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_0.opb.PB06.opb	SAT f=335 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=6152 TT=1800.07 T1=1800.4	SAT (TO) f=3981 TT=1800.15 T1=1800.4	SAT (TO) f=335 TT=1800.1 T1=1800.4	? TT=69.238	SAT (TO) f=873 TT=1800.18 T1=217.28	SAT (TO) f=600 TT=1801.37 T1=3.29	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_10.opb.PB06.opb	SAT f=366 TT=1800.13 T1=1800.5	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=6059 TT=1800.13 T1=1800.4	SAT (TO) f=3554 TT=1800.16 T1=1800.3	SAT (TO) f=366 TT=1800.13 T1=1800.5	? TT=69.553	SAT (TO) f=828 TT=1800.08 T1=14.28	SAT (TO) f=1258 TT=1800.04 T1=4.22	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_11.opb.PB06.opb	SAT f=378 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=5918 TT=1800.06 T1=1800.4	SAT (TO) f=4386 TT=1800.13 T1=1800.4	SAT (TO) f=378 TT=1800.06 T1=1800.4	? TT=69.328	SAT (TO) f=658 TT=1800.05 T1=4.35	SAT (TO) f=835 TT=1800.05 T1=3.11	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_12.opb.PB06.opb	SAT f=381 TT=1800.13 T1=1800.4	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=5448 TT=1800.08 T1=1800.4	SAT (TO) f=3947 TT=1800.11 T1=1800.3	SAT (TO) f=381 TT=1800.13 T1=1800.4	? TT=70.218	SAT (TO) f=822 TT=1800.06 T1=45.69	SAT (TO) f=757 TT=1800.72 T1=3.32	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_13.opb.PB06.opb	SAT f=319 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=5966 TT=1800.05 T1=1800.4	SAT (TO) f=3650 TT=1800.12 T1=1800.4	SAT (TO) f=319 TT=1800.08 T1=1800.4	? TT=69.505	SAT (TO) f=1319 TT=1800.87 T1=4.66	SAT (TO) f=825 TT=1800.05 T1=2.98	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_14.opb.PB06.opb	SAT f=332 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=5987 TT=1800.06 T1=1800.4	SAT (TO) f=4833 TT=1800.07 T1=1800.4	SAT (TO) f=332 TT=1800.09 T1=1800.4	? TT=68.864	SAT (TO) f=883 TT=1800.06 T1=8.8	SAT (TO) f=794 TT=1800 T1=99.63	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_1.opb.PB06.opb	SAT f=294 TT=1800.14 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=6073 TT=1800.16 T1=1800.4	SAT (TO) f=4096 TT=1800.06 T1=1800.4	SAT (TO) f=294 TT=1800.14 T1=1800.4	? TT=68.886	SAT (TO) f=858 TT=1800.08 T1=4.75	SAT (TO) f=809 TT=1800.55 T1=12.57	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_2.opb.PB06.opb	SAT f=416 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=5976 TT=1800.12 T1=1800.4	SAT (TO) f=4225 TT=1800.07 T1=1800.4	SAT (TO) f=416 TT=1800.11 T1=1800.4	? TT=68.987	SAT (TO) f=675 TT=1800.03 T1=14.27	SAT (TO) f=1017 TT=1800.04 T1=37.66	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_3.opb.PB06.opb	SAT f=312 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=6255 TT=1800.05 T1=1800.4	SAT (TO) f=4117 TT=1800.12 T1=1800.4	SAT (TO) f=312 TT=1800.03 T1=1800.3	? TT=69.112	SAT (TO) f=770 TT=1800.8 T1=6.33	SAT (TO) f=495 TT=1800.07 T1=3.35	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_4.opb.PB06.opb	SAT f=323 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=6061 TT=1800.04 T1=1800.4	SAT (TO) f=3693 TT=1800.12 T1=1800.3	SAT (TO) f=323 TT=1800.07 T1=1800.4	? TT=68.754	SAT (TO) f=1147 TT=1800.05 T1=6.56	SAT (TO) f=949 TT=1800.62 T1=296.9	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_5.opb.PB06.opb	SAT f=343 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=6209 TT=1800.12 T1=1800.6	SAT (TO) f=3342 TT=1800.12 T1=1800.3	SAT (TO) f=343 TT=1800.02 T1=1800.3	? TT=69.214	SAT (TO) f=776 TT=1800.82 T1=4.17	SAT (TO) f=851 TT=1800.02 T1=84.72	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_6.opb.PB06.opb	SAT f=375 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=6018 TT=1800.09 T1=1800.4	SAT (TO) f=3879 TT=1800.11 T1=1800.4	SAT (TO) f=375 TT=1800.03 T1=1800.3	? TT=69.57	SAT (TO) f=736 TT=1800.11 T1=4.73	SAT (TO) f=618 TT=1800.8 T1=4.03	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_7.opb.PB06.opb	SAT f=296 TT=1800.08 T1=1800.3	No data	? (TO) TT=1800.16	? (TO) TT=1800.03	SAT (TO) f=5729 TT=1800.07 T1=1800.4	SAT (TO) f=4298 TT=1800.1 T1=1800.4	SAT (TO) f=296 TT=1800.08 T1=1800.3	? TT=68.791	SAT (TO) f=922 TT=1800.18 T1=7.07	SAT (TO) f=594 TT=1800.58 T1=3.29	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_8.opb.PB06.opb	SAT f=304 TT=1800.03 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=5718 TT=1800.15 T1=1800.5	SAT (TO) f=3716 TT=1800.17 T1=1800.3	SAT (TO) f=304 TT=1800.03 T1=1800.4	? TT=69.202	SAT (TO) f=977 TT=1800.73 T1=36.86	SAT (TO) f=660 TT=1800.08 T1=3.28	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_9.opb.PB06.opb	SAT f=336 TT=1800.16 T1=1800.4	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=6059 TT=1800.24 T1=1800.4	SAT (TO) f=3751 TT=1800.1 T1=1800.4	SAT (TO) f=336 TT=1800.16 T1=1800.4	? TT=73.79	SAT (TO) f=750 TT=1800.18 T1=5.32	SAT (TO) f=1031 TT=1800.67 T1=4.2	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_10.opb	OPT f=55 TT=467.8 T1=366.23	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=60 TT=1800.09 T1=1800.4	SAT (TO) f=67 TT=1800.06 T1=1800.4	SAT (TO) f=99 TT=1800.11 T1=1800.4	SAT (TO) f=60 TT=1800.07 T1=1800.4	OPT f=55 TT=1267.25 T1=404.18	OPT f=55 TT=467.8 T1=366.23	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_11.opb	SAT f=72 TT=1800.68 T1=858.78	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=89 TT=1800.08 T1=1800.4	SAT (TO) f=100 TT=1800.09 T1=1800.4	SAT (TO) f=182 TT=1800.07 T1=1800.3	SAT (TO) f=84 TT=1800.1 T1=1800.5	SAT (TO) f=76 TT=1800.01 T1=104.64	SAT (TO) f=72 TT=1800.68 T1=858.78	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_12.opb	SAT f=99 TT=1800.03 T1=234.34	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=105 TT=1800.06 T1=1800.4	SAT (TO) f=124 TT=1800.09 T1=1800.4	SAT (TO) f=134 TT=1800.01 T1=1800.4	SAT (TO) f=115 TT=1800.09 T1=1800.5	SAT (TO) f=99 TT=1800.18 T1=234.34	SAT (TO) f=99 TT=1800.03 T1=1756.9	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_13.opb	SAT f=125 TT=1800.59 T1=1387.22	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT (TO) f=195 TT=1800.06 T1=1800.4	SAT (TO) f=149 TT=1800.06 T1=1800.5	SAT (TO) f=126 TT=1800.81 T1=868.95	SAT (TO) f=125 TT=1800.59 T1=1387.22	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_14.opb	SAT f=154 TT=1800.03 T1=1379.22	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT (TO) f=216 TT=1800.04 T1=1800.5	SAT (TO) f=216 TT=1800.09 T1=1800.5	SAT (TO) f=178 TT=1800.12 T1=366.57	SAT (TO) f=154 TT=1800.03 T1=1379.22	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_15.opb	SAT f=197 TT=1800.06 T1=743.74	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=224 TT=1800.14 T1=1800.5	SAT (TO) f=224 TT=1800.14 T1=1800.5	SAT (TO) f=198 TT=1800.12 T1=291.07	SAT (TO) f=197 TT=1800.06 T1=743.74	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_16.opb	SAT f=235 TT=1800.01 T1=469.97	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1801.06	SAT (TO) f=235 TT=1800.01 T1=469.97	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_17.opb	SAT f=282 TT=1800.73 T1=918.82	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.37	? (TO) TT=1800.53	? (TO) TT=1800.89	SAT (TO) f=282 TT=1800.73 T1=918.82	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_18.opb	SAT f=322 TT=1800.92 T1=1480.65	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.24	? (MO) TT=61.906	? (MO) TT=61.698	? (TO) TT=1800.06	SAT (TO) f=322 TT=1800.92 T1=1480.65	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_19.opb	SAT f=360 TT=1800.67 T1=1280.32	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.45	? (MO) TT=61.205	? (MO) TT=61.002	? (TO) TT=1800.03	SAT (TO) f=360 TT=1800.67 T1=1280.32	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_20.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=675.673	? TT=52.533	? TT=55.768	? (TO) TT=1800.09	? (TO) TT=1800.64	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_4.opb	OPT f=6 TT=0.007 T1=0	No data	OPT f=6 TT=0.021 T1=0.02	OPT f=6 TT=0.013 T1=0.01	OPT f=6 TT=0.019 T1=0.01	OPT f=6 TT=0.071 T1=0.07	OPT f=6 TT=0.007 T1=0	OPT f=6 TT=0.008 T1=0	OPT f=6 TT=0.183 T1=0.65	OPT f=6 TT=0.195 T1=0.16	OPT f=6 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_5.opb	OPT f=11 TT=0.014 T1=0.01	No data	OPT f=11 TT=0.025 T1=0.02	OPT f=11 TT=0.014 T1=0.01	OPT f=11 TT=0.085 T1=0.09	OPT f=11 TT=0.308 T1=0.3	OPT f=11 TT=0.039 T1=0.04	OPT f=11 TT=0.047 T1=0.04	OPT f=11 TT=0.603 T1=0.68	OPT f=11 TT=0.264 T1=0.19	OPT f=11 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_6.opb	OPT f=17 TT=0.032 T1=0.03	No data	OPT f=17 TT=0.051 T1=0.05	OPT f=17 TT=0.032 T1=0.03	OPT f=17 TT=0.285 T1=0.28	OPT f=17 TT=1.368 T1=1.36	OPT f=17 TT=0.321 T1=0.32	OPT f=17 TT=0.288 T1=0.28	OPT f=17 TT=1.704 T1=1.74	OPT f=17 TT=0.584 T1=0.3	OPT f=17 TT=0.144 T1=0.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_7.opb	OPT f=25 TT=0.436 T1=0.43	No data	OPT f=25 TT=0.436 T1=0.43	OPT f=25 TT=0.447 T1=0.44	OPT f=25 TT=2.748 T1=2.74	OPT f=25 TT=7.242 T1=7.23	OPT f=25 TT=6.501 T1=6.49	OPT f=25 TT=6.321 T1=6.32	OPT f=25 TT=3.205 T1=4.31	OPT f=25 TT=1.064 T1=0.64	OPT f=25 TT=2.383 T1=1.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_8.opb	OPT f=34 TT=6.205 T1=5.23	No data	OPT f=34 TT=16.09 T1=16.09	OPT f=34 TT=11.392 T1=11.39	OPT f=34 TT=13.338 T1=13.33	OPT f=34 TT=186.245 T1=186.25	OPT f=34 TT=143.192 T1=143.23	OPT f=34 TT=88.946 T1=88.95	OPT f=34 TT=14.472 T1=5.39	OPT f=34 TT=6.205 T1=5.23	OPT f=34 TT=25.233 T1=16.55
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_9.opb	OPT f=44 TT=58.5 T1=54.52	No data	OPT f=44 TT=365.834 T1=365.89	OPT f=44 TT=424.123 T1=424.18	OPT f=44 TT=371.011 T1=371.06	OPT f=44 TT=1138.78 T1=1138.98	SAT (TO) f=96 TT=1800.07 T1=1800.4	OPT f=44 TT=1590.16 T1=1590.39	OPT f=44 TT=128.016 T1=54.52	OPT f=44 TT=58.5 T1=55.75	OPT f=44 TT=544.013 T1=544.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_10.opb	OPT f=55 TT=355.42 T1=127.27	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=60 TT=1800.11 T1=1800.4	SAT (TO) f=73 TT=1800.05 T1=1800.4	SAT (TO) f=96 TT=1800.06 T1=1800.4	? (TO) TT=1800.11	OPT f=55 TT=1794.48 T1=826.29	OPT f=55 TT=355.42 T1=127.27	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_11.opb	SAT f=74 TT=1800.09 T1=1597.89	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=90 TT=1800.07 T1=1800.4	SAT (TO) f=81 TT=1800.09 T1=1800.4	SAT (TO) f=127 TT=1800.1 T1=1800.5	? (TO) TT=1800.04	SAT (TO) f=76 TT=1800.86 T1=732.53	SAT (TO) f=74 TT=1800.09 T1=1597.89	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_12.opb	SAT f=99 TT=1800.66 T1=1565.38	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=108 TT=1800.08 T1=1800.4	SAT (TO) f=160 TT=1800.09 T1=1800.4	SAT (TO) f=157 TT=1800.09 T1=1800.5	? (TO) TT=1800.05	SAT (TO) f=101 TT=1800.92 T1=391.41	SAT (TO) f=99 TT=1800.66 T1=1565.38	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_13.opb	SAT f=122 TT=1800.17 T1=752.6	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT (TO) f=164 TT=1800.09 T1=1800.5	? (TO) TT=1800.09	SAT (TO) f=122 TT=1800.17 T1=752.6	SAT (TO) f=128 TT=1800.02 T1=1307.72	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_14.opb	SAT f=151 TT=1800.8 T1=748.49	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT (TO) f=242 TT=1800.13 T1=1800.3	? (TO) TT=1800.12	SAT (TO) f=151 TT=1800.8 T1=748.49	SAT (TO) f=157 TT=1800.69 T1=1551.83	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_15.opb	SAT f=181 TT=1800.02 T1=1370.59	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT (TO) f=224 TT=1800.16 T1=1800.5	? (TO) TT=1800.18	SAT (TO) f=201 TT=1800.17 T1=796.93	SAT (TO) f=181 TT=1800.02 T1=1370.59	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_16.opb	SAT f=233 TT=1800.06 T1=1318.24	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=245 TT=1800.07 T1=1800.4	? (TO) TT=1800.23	? (TO) TT=1800.25	? (TO) TT=1800.26	SAT (TO) f=279 TT=1800.16 T1=249.78	SAT (TO) f=233 TT=1800.06 T1=1318.24	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_17.opb	SAT f=281 TT=1800.59 T1=444.48	No data	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.23	? (MO) TT=63.218	? (MO) TT=62.719	SAT (TO) f=286 TT=1800.02 T1=785.85	SAT (TO) f=281 TT=1800.59 T1=444.48	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_18.opb	SAT f=319 TT=1800.06 T1=597.83	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.34	? (MO) TT=48.114	? (MO) TT=60.009	SAT (TO) f=319 TT=1800.06 T1=597.83	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_19.opb	SAT f=359 TT=1800.07 T1=362.03	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.55	? (MO) TT=60.288	? (MO) TT=61.114	SAT (TO) f=359 TT=1800.07 T1=362.03	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_20.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=691.732	? TT=52.528	? TT=52.831	? (TO) TT=1800.03	? (TO) TT=1800.68	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_4.opb	OPT f=6 TT=0.01 T1=0.01	No data	OPT f=6 TT=0.023 T1=0.02	OPT f=6 TT=0.013 T1=0.01	OPT f=6 TT=0.021 T1=0.02	OPT f=6 TT=0.145 T1=0.14	OPT f=6 TT=0.01 T1=0.01	OPT f=6 TT=0.038 T1=0.03	OPT f=6 TT=0.283 T1=1.15	OPT f=6 TT=0.223 T1=0.17	OPT f=6 TT=0.025 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_5.opb	OPT f=11 TT=0.017 T1=0.02	No data	OPT f=11 TT=0.027 T1=0.02	OPT f=11 TT=0.017 T1=0.02	OPT f=11 TT=0.088 T1=0.08	OPT f=11 TT=0.339 T1=0.33	OPT f=11 TT=0.069 T1=0.07	OPT f=11 TT=0.204 T1=0.2	OPT f=11 TT=0.648 T1=1.69	OPT f=11 TT=0.335 T1=0.2	OPT f=11 TT=0.046 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_6.opb	OPT f=17 TT=0.055 T1=0.05	No data	OPT f=17 TT=0.08 T1=0.07	OPT f=17 TT=0.055 T1=0.05	OPT f=17 TT=0.539 T1=0.53	OPT f=17 TT=1.727 T1=1.72	OPT f=17 TT=0.75 T1=0.74	OPT f=17 TT=1.511 T1=1.51	OPT f=17 TT=2.654 T1=1.76	OPT f=17 TT=0.654 T1=0.32	OPT f=17 TT=0.285 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_7.opb	OPT f=25 TT=0.532 T1=0.53	No data	OPT f=25 TT=0.923 T1=0.92	OPT f=25 TT=0.532 T1=0.53	OPT f=25 TT=3.955 T1=4.05	OPT f=25 TT=11.05 T1=11.04	OPT f=25 TT=13.247 T1=13.25	OPT f=25 TT=16.155 T1=16.15	OPT f=25 TT=4.203 T1=2.31	OPT f=25 TT=1.404 T1=0.84	OPT f=25 TT=2.93 T1=2.87
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_8.opb	OPT f=34 TT=7.254 T1=3.49	No data	OPT f=34 TT=26.795 T1=26.79	OPT f=34 TT=12.294 T1=12.29	OPT f=34 TT=14.806 T1=14.8	OPT f=34 TT=405.621 T1=405.71	OPT f=34 TT=238.428 T1=238.45	OPT f=34 TT=271.932 T1=271.96	OPT f=34 TT=13.131 T1=3.49	OPT f=34 TT=7.254 T1=3.99	OPT f=34 TT=40.858 T1=40.8
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_9.opb	OPT f=44 TT=54.85 T1=31.05	No data	OPT f=44 TT=842.485 T1=842.61	OPT f=44 TT=412.526 T1=412.59	OPT f=44 TT=575.428 T1=575.5	SAT (TO) f=44 TT=1800.09 T1=1800.4	SAT (TO) f=80 TT=1800.07 T1=1800.4	? (TO) TT=1800.07	OPT f=44 TT=113.168 T1=34.05	OPT f=44 TT=54.85 T1=31.05	OPT f=44 TT=738.875 T1=654.67
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.02.opb	OPT f=44 TT=4.98 T1=4.97	No data	OPT f=44 TT=15.029 T1=15.01	OPT f=44 TT=9.158 T1=9.15	OPT f=44 TT=10.012 T1=10	OPT f=44 TT=9.072 T1=9.06	OPT f=44 TT=4.98 T1=4.97	OPT f=44 TT=6.055 T1=6.05	OPT f=44 TT=1329.97 T1=610.86	SAT (TO) f=60 TT=1800.09 T1=9.51	OPT f=44 TT=25.063 T1=24.96
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.07.opb	OPT f=37 TT=4.742 T1=4.73	No data	OPT f=37 TT=9.717 T1=9.7	OPT f=37 TT=11.804 T1=11.79	OPT f=37 TT=8.829 T1=8.81	OPT f=37 TT=9.128 T1=9.12	OPT f=37 TT=4.742 T1=4.73	OPT f=37 TT=5.483 T1=5.47	OPT f=37 TT=639.627 T1=25.97	SAT (TO) f=37 TT=1800.09 T1=18.32	OPT f=37 TT=21.136 T1=21.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.10.opb	OPT f=49 TT=7.151 T1=7.13	No data	OPT f=49 TT=64.39 T1=64.38	OPT f=49 TT=14.17 T1=14.16	OPT f=49 TT=14.069 T1=14.05	OPT f=49 TT=13.667 T1=13.66	OPT f=49 TT=7.151 T1=7.13	OPT f=49 TT=8.632 T1=8.65	SAT (TO) f=50 TT=1800.03 T1=608.83	SAT (TO) f=60 TT=1800.04 T1=43.93	OPT f=49 TT=31.241 T1=28.8
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.11.opb	OPT f=38 TT=5.721 T1=5.71	No data	OPT f=38 TT=363.146 T1=363.19	OPT f=38 TT=147.681 T1=147.7	OPT f=38 TT=12.368 T1=12.36	OPT f=38 TT=9.172 T1=9.17	OPT f=38 TT=5.721 T1=5.71	OPT f=38 TT=8.085 T1=8.07	SAT (TO) f=40 TT=1800.12 T1=748.16	SAT (TO) f=41 TT=1800.76 T1=192.71	OPT f=38 TT=35.261 T1=35.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.12.opb	OPT f=41 TT=5.853 T1=5.84	No data	OPT f=41 TT=11.428 T1=11.42	OPT f=41 TT=8.846 T1=8.84	OPT f=41 TT=10.484 T1=10.47	OPT f=41 TT=10.514 T1=10.51	OPT f=41 TT=5.853 T1=5.84	OPT f=41 TT=6.471 T1=6.45	OPT f=41 TT=93.449 T1=53.55	SAT (TO) f=41 TT=1800.01 T1=1155.54	OPT f=41 TT=21.473 T1=21.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.14.opb	OPT f=42 TT=5.513 T1=5.5	No data	OPT f=42 TT=17.003 T1=16.99	OPT f=42 TT=19.583 T1=19.57	OPT f=42 TT=11.77 T1=11.76	OPT f=42 TT=10.068 T1=10.06	OPT f=42 TT=5.513 T1=5.5	OPT f=42 TT=6.553 T1=6.54	SAT (TO) f=43 TT=1800.73 T1=584.04	SAT (TO) f=51 TT=1800 T1=850.21	OPT f=42 TT=20.74 T1=20.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-unif-100_100.00.opb	OPT f=34 TT=2.634 T1=2.63	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=34 TT=7.613 T1=7.61	OPT f=34 TT=6.363 T1=6.36	OPT f=34 TT=2.634 T1=2.63	OPT f=34 TT=2.71 T1=2.7	SAT (TO) f=35 TT=1800.06 T1=344.89	SAT (TO) f=37 TT=1800.04 T1=6.27	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-unif-100_100.08.opb	OPT f=34 TT=2.81 T1=2.8	No data	OPT f=34 TT=79.231 T1=79.25	OPT f=34 TT=12.58 T1=12.57	OPT f=34 TT=5.175 T1=5.17	OPT f=34 TT=4.412 T1=4.41	OPT f=34 TT=2.81 T1=2.8	OPT f=34 TT=2.911 T1=2.9	SAT (TO) f=35 TT=1800.99 T1=205.83	SAT (TO) f=34 TT=1800.06 T1=999.87	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-addm4.r.opb	OPT f=165 TT=0.05 T1=0.05	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=181 TT=1800.01 T1=1800.3	SAT (TO) f=199 TT=1800.11 T1=1800.4	OPT f=165 TT=0.05 T1=0.05	SAT (TO) f=176 TT=1800.02 T1=1800.3	SAT (TO) f=181 TT=1800.64 T1=314.48	SAT (TO) f=196 TT=1800.03 T1=0.36	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-alu2.b.opb	SAT f=62 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=62 TT=1800.02 T1=1800.3	SAT (TO) f=89 TT=1800.11 T1=1800.4	SAT (TO) f=89 TT=1800.02 T1=1800.3	SAT (TO) f=63 TT=1800.02 T1=1800.3	SAT (TO) f=72 TT=1800.1 T1=786.91	SAT (TO) f=76 TT=1800 T1=1622.09	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-apex6.b.opb	SAT f=151 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=173 TT=1800.01 T1=1800.3	SAT (TO) f=183 TT=1800.01 T1=1800.3	SAT (TO) f=181 TT=1800.1 T1=1800.4	SAT (TO) f=151 TT=1800.03 T1=1800.3	SAT (TO) f=174 TT=1800.08 T1=700.78	SAT (TO) f=181 TT=1800 T1=111.28	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-apex7.b.opb	SAT f=39 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=39 TT=1800.02 T1=1800.3	SAT (TO) f=53 TT=1800.02 T1=1800.3	SAT (TO) f=53 TT=1800.08 T1=1800.4	SAT (TO) f=39 TT=1800.02 T1=1800.3	SAT (TO) f=42 TT=1800.18 T1=263.73	SAT (TO) f=47 TT=1800.59 T1=987.93	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-bbara.r.opb	OPT f=7 TT=0.001 T1=0	No data	OPT f=7 TT=0.022 T1=0.02	OPT f=7 TT=0.014 T1=0.01	OPT f=7 TT=0.004 T1=0	OPT f=7 TT=0.006 T1=0	OPT f=7 TT=0.001 T1=0	OPT f=7 TT=0.002 T1=0	OPT f=7 TT=0.194 T1=0.64	OPT f=7 TT=0.393 T1=0.14	OPT f=7 TT=0.028 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-bench1.r.opb	SAT f=158 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=181 TT=1800.02 T1=1800.3	SAT (TO) f=181 TT=1800.09 T1=1800.4	SAT (TO) f=181 TT=1800.01 T1=1800.3	SAT (TO) f=158 TT=1800.09 T1=1800.4	SAT (TO) f=175 TT=1801.18 T1=538.33	SAT (TO) f=180 TT=1800.02 T1=0.45	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-bw.b.opb	SAT f=34 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=36 TT=1800.1 T1=1800.4	SAT (TO) f=39 TT=1800.1 T1=1800.4	SAT (TO) f=44 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.03 T1=1800.3	SAT (TO) f=37 TT=1800.17 T1=507.5	SAT (TO) f=39 TT=1800 T1=0.74	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C499.a.opb	OPT f=64 TT=0.348 T1=0.34	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=73 TT=1800.02 T1=1800.3	SAT (TO) f=90 TT=1800.01 T1=1800.3	OPT f=64 TT=0.348 T1=0.34	SAT (TO) f=69 TT=1800.03 T1=1800.3	SAT (TO) f=77 TT=1800.2 T1=629.26	SAT (TO) f=83 TT=1800.73 T1=0.47	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C499.b.opb	SAT f=57 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=82 TT=1800.08 T1=1800.4	SAT (TO) f=92 TT=1800.07 T1=1800.4	SAT (TO) f=86 TT=1800.04 T1=1800.4	SAT (TO) f=57 TT=1800.02 T1=1800.3	SAT (TO) f=78 TT=1800.09 T1=604.98	SAT (TO) f=84 TT=1800.05 T1=1.87	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C880.a.opb	OPT f=87 TT=0.006 T1=0	No data	OPT f=87 TT=0.232 T1=0.23	OPT f=87 TT=0.761 T1=0.76	OPT f=87 TT=10.277 T1=10.27	OPT f=87 TT=15.074 T1=15.07	OPT f=87 TT=0.006 T1=0	OPT f=87 TT=0.75 T1=0.75	OPT f=87 TT=23.721 T1=6.75	SAT (TO) f=90 TT=1800.02 T1=288.89	OPT f=87 TT=0.162 T1=0.15
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C880.b.opb	OPT f=63 TT=0.109 T1=0.11	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT (TO) f=63 TT=1800.02 T1=1800.3	SAT (TO) f=65 TT=1800.01 T1=1800.3	OPT f=63 TT=0.109 T1=0.11	SAT (TO) f=64 TT=1800.02 T1=1800.3	SAT (TO) f=75 TT=1800.15 T1=688.01	SAT (TO) f=85 TT=1800.04 T1=1.19	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-des.a.opb	OPT f=942 TT=0.739 T1=0.73	No data	? (TO) TT=1800.1	? (TO) TT=1800.14	SAT (TO) f=1033 TT=1800.02 T1=1800.3	SAT (TO) f=1037 TT=1800.1 T1=1800.4	OPT f=942 TT=0.739 T1=0.73	SAT (TO) f=1033 TT=1800.02 T1=1800.3	SAT (TO) f=1012 TT=1800.06 T1=23.78	SAT (TO) f=1013 TT=1800.09 T1=0.7	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-dk512x.r.opb	OPT f=6 TT=0.005 T1=0	No data	OPT f=6 TT=0.027 T1=0.02	OPT f=6 TT=0.016 T1=0.01	OPT f=6 TT=0.023 T1=0.02	OPT f=6 TT=0.024 T1=0.02	OPT f=6 TT=0.005 T1=0	OPT f=6 TT=0.011 T1=0.01	OPT f=6 TT=1.545 T1=1.19	OPT f=6 TT=1.824 T1=0.27	OPT f=6 TT=1.283 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-duke2.b.opb	SAT f=74 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=74 TT=1800.11 T1=1800.4	SAT (TO) f=102 TT=1800.09 T1=1800.4	SAT (TO) f=102 TT=1800.03 T1=1800.3	SAT (TO) f=76 TT=1800.01 T1=1800.3	SAT (TO) f=92 TT=1800.32 T1=846.38	No Cert. TT=1800.04	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex1010.pi.opb	SAT f=441 TT=1800.5 T1=448.36	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=444 TT=1800.05 T1=1800.4	SAT (TO) f=444 TT=1800.1 T1=1800.4	SAT (TO) f=444 TT=1800.02 T1=1800.3	SAT (TO) f=444 TT=1800.1 T1=1800.4	SAT (TO) f=441 TT=1800.5 T1=448.36	SAT (TO) f=444 TT=1800 T1=0.64	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex4inp.r.opb	OPT f=5 TT=0.017 T1=0.01	No data	OPT f=5 TT=0.05 T1=0.05	OPT f=5 TT=0.026 T1=0.02	OPT f=5 TT=0.358 T1=0.35	OPT f=5 TT=0.38 T1=0.38	OPT f=5 TT=0.017 T1=0.01	OPT f=5 TT=0.253 T1=0.25	OPT f=5 TT=3.912 T1=2.28	OPT f=5 TT=226.269 T1=1.08	OPT f=5 TT=1065.55 T1=0.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex5inp.r.opb	OPT f=4 TT=0.002 T1=0	No data	OPT f=4 TT=0.022 T1=0.02	OPT f=4 TT=0.013 T1=0.01	OPT f=4 TT=0.012 T1=0.01	OPT f=4 TT=0.007 T1=0	OPT f=4 TT=0.002 T1=0	OPT f=4 TT=0.004 T1=0	OPT f=4 TT=0.234 T1=1.14	OPT f=4 TT=0.434 T1=0.15	OPT f=4 TT=0.025 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-ex5.r.opb	SAT f=45 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT (TO) f=61 TT=1800.03 T1=1800.3	SAT (TO) f=61 TT=1800.08 T1=1800.4	SAT (TO) f=61 TT=1800.02 T1=1800.3	SAT (TO) f=45 TT=1800.05 T1=1800.4	SAT (TO) f=52 TT=1800.46 T1=693.88	SAT (TO) f=58 TT=1800.53 T1=127.38	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex6inp.r.opb	OPT f=4 TT=0.013 T1=0.01	No data	OPT f=4 TT=0.024 T1=0.02	OPT f=4 TT=0.013 T1=0.01	OPT f=4 TT=0.063 T1=0.06	OPT f=4 TT=0.044 T1=0.04	OPT f=4 TT=0.018 T1=0.02	OPT f=4 TT=0.037 T1=0.03	OPT f=4 TT=0.503 T1=1.18	OPT f=4 TT=0.864 T1=0.17	OPT f=4 TT=1.773 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-exps.r.opb	OPT f=76 TT=0.019 T1=0.01	No data	OPT f=76 TT=137.106 T1=137.11	OPT f=76 TT=498.885 T1=498.97	SAT (TO) f=77 TT=1800.02 T1=1800.3	SAT (TO) f=84 TT=1800.11 T1=1800.4	OPT f=76 TT=0.019 T1=0.01	OPT f=76 TT=561.755 T1=561.84	SAT (TO) f=82 TT=1800.19 T1=476.24	SAT (TO) f=96 TT=1800.05 T1=0.32	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-fout.r.opb	OPT f=38 TT=0.232 T1=0.23	No data	OPT f=38 TT=836.131 T1=836.26	OPT f=38 TT=569.726 T1=569.81	SAT (TO) f=39 TT=1800.02 T1=1800.3	SAT (TO) f=43 TT=1800.02 T1=1800.3	OPT f=38 TT=0.232 T1=0.23	SAT (TO) f=38 TT=1800.1 T1=1800.4	SAT (TO) f=40 TT=1800.74 T1=112.9	SAT (TO) f=50 TT=1800.63 T1=0.21	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-lin.rom.r.opb	OPT f=120 TT=0.633 T1=0.63	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=130 TT=1800.02 T1=1800.3	SAT (TO) f=177 TT=1800.02 T1=1800.3	OPT f=120 TT=0.633 T1=0.63	SAT (TO) f=122 TT=1800.02 T1=1800.3	SAT (TO) f=165 TT=1800.19 T1=185.61	SAT (TO) f=177 TT=1800.07 T1=0.28	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_10_10.r.opb	SAT f=13 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=13 TT=1800.02 T1=1800.3	SAT (TO) f=18 TT=1800.02 T1=1800.3	SAT (TO) f=18 TT=1800.02 T1=1800.3	SAT (TO) f=13 TT=1800.1 T1=1800.4	SAT (TO) f=15 TT=1800.13 T1=2.17	SAT (TO) f=15 TT=1800.08 T1=0.35	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_10_15.r.opb	OPT f=10 TT=500.006 T1=500.08	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=10 TT=1196.56 T1=1196.74	OPT f=10 TT=1016.36 T1=1016.52	OPT f=10 TT=500.006 T1=500.08	OPT f=10 TT=847.016 T1=847.14	SAT (TO) f=11 TT=1800.89 T1=197.25	SAT (TO) f=12 TT=1800.09 T1=0.37	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_10_30.r.opb	OPT f=8 TT=7.184 T1=7.18	No data	OPT f=8 TT=7.184 T1=7.18	OPT f=8 TT=43.557 T1=43.56	OPT f=8 TT=147.958 T1=147.98	OPT f=8 TT=26.151 T1=26.15	OPT f=8 TT=20.662 T1=20.66	OPT f=8 TT=23.021 T1=23.02	SAT (TO) f=8 TT=1800.75 T1=347.3	SAT (TO) f=9 TT=1800.06 T1=173.93	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_30_30.r.opb	OPT f=5 TT=7.187 T1=7.18	No data	OPT f=5 TT=22.605 T1=22.6	OPT f=5 TT=7.187 T1=7.18	OPT f=5 TT=54.222 T1=54.22	OPT f=5 TT=60.647 T1=60.66	OPT f=5 TT=74.625 T1=74.63	OPT f=5 TT=25.91 T1=25.91	OPT f=5 TT=1119.67 T1=468.18	OPT f=5 TT=593.284 T1=509.87	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_50_50.r.opb	OPT f=4 TT=0.396 T1=0.34	No data	OPT f=4 TT=0.433 T1=0.43	OPT f=4 TT=0.396 T1=0.39	OPT f=4 TT=1.663 T1=1.66	OPT f=4 TT=4.104 T1=4.1	OPT f=4 TT=2.189 T1=2.19	OPT f=4 TT=1.698 T1=1.69	OPT f=4 TT=17.91 T1=1.75	OPT f=4 TT=7.212 T1=0.34	OPT f=4 TT=22.652 T1=2.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_70_70.r.opb	OPT f=3 TT=0.032 T1=0.03	No data	OPT f=3 TT=0.045 T1=0.04	OPT f=3 TT=0.032 T1=0.03	OPT f=3 TT=0.13 T1=0.13	OPT f=3 TT=0.217 T1=0.21	OPT f=3 TT=0.116 T1=0.11	OPT f=3 TT=0.115 T1=0.11	OPT f=3 TT=2.354 T1=0.77	OPT f=3 TT=0.934 T1=0.25	OPT f=3 TT=2.57 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_90_90.r.opb	OPT f=2 TT=0.012 T1=0.01	No data	OPT f=2 TT=0.033 T1=0.03	OPT f=2 TT=0.02 T1=0.02	OPT f=2 TT=0.058 T1=0.05	OPT f=2 TT=0.055 T1=0.05	OPT f=2 TT=0.012 T1=0.01	OPT f=2 TT=0.012 T1=0.01	OPT f=2 TT=0.783 T1=0.78	OPT f=2 TT=0.573 T1=0.25	OPT f=2 TT=0.08 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_10.r.opb	SAT f=25 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=25 TT=1800.02 T1=1800.3	SAT (TO) f=33 TT=1800.02 T1=1800.3	SAT (TO) f=33 TT=1800.02 T1=1800.3	SAT (TO) f=25 TT=1800.02 T1=1800.3	SAT (TO) f=26 TT=1800.02 T1=26.21	SAT (TO) f=30 TT=1800.61 T1=3.25	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_14.r.opb	SAT f=23 TT=1800.02 T1=117.29	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=23 TT=1800.02 T1=1800.3	SAT (TO) f=32 TT=1800.02 T1=1800.3	SAT (TO) f=32 TT=1800.02 T1=1800.3	SAT (TO) f=23 TT=1800.09 T1=1800.4	SAT (TO) f=23 TT=1800.09 T1=117.29	SAT (TO) f=29 TT=1800.05 T1=2.74	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_15.r.opb	SAT f=22 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=23 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=22 TT=1800.01 T1=1800.3	SAT (TO) f=23 TT=1800.24 T1=886.44	SAT (TO) f=31 TT=1800.61 T1=900.89	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_20.r.opb	SAT f=19 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=20 TT=1800.01 T1=1800.3	SAT (TO) f=32 TT=1800.01 T1=1800.3	SAT (TO) f=32 TT=1800.02 T1=1800.3	SAT (TO) f=19 TT=1800.02 T1=1800.3	SAT (TO) f=22 TT=1800 T1=113.76	SAT (TO) f=25 TT=1800.02 T1=634.19	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_10_10.r.opb	OPT f=8 TT=1.075 T1=0.35	No data	OPT f=8 TT=1.075 T1=1.07	OPT f=8 TT=1.842 T1=1.84	OPT f=8 TT=3.963 T1=3.96	OPT f=8 TT=3.849 T1=3.85	OPT f=8 TT=2.012 T1=2.01	OPT f=8 TT=1.184 T1=1.18	OPT f=8 TT=434.826 T1=1.17	OPT f=8 TT=192.55 T1=0.35	OPT f=8 TT=165.43 T1=165.39
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_20_20.r.opb	OPT f=5 TT=0.129 T1=0.12	No data	OPT f=5 TT=0.146 T1=0.14	OPT f=5 TT=0.129 T1=0.12	OPT f=5 TT=0.611 T1=0.61	OPT f=5 TT=0.939 T1=0.93	OPT f=5 TT=0.462 T1=0.46	OPT f=5 TT=0.364 T1=0.36	OPT f=5 TT=11.562 T1=1.7	OPT f=5 TT=4.901 T1=0.22	OPT f=5 TT=5.984 T1=0.91
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_30_30.r.opb	OPT f=3 TT=0.013 T1=0.01	No data	OPT f=3 TT=0.028 T1=0.02	OPT f=3 TT=0.019 T1=0.02	OPT f=3 TT=0.027 T1=0.02	OPT f=3 TT=0.03 T1=0.03	OPT f=3 TT=0.013 T1=0.01	OPT f=3 TT=0.034 T1=0.03	OPT f=3 TT=1.114 T1=1.21	OPT f=3 TT=0.614 T1=0.23	OPT f=3 TT=0.215 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_40_40.r.opb	OPT f=2 TT=0.006 T1=0	No data	OPT f=2 TT=0.026 T1=0.02	OPT f=2 TT=0.016 T1=0.01	OPT f=2 TT=0.023 T1=0.02	OPT f=2 TT=0.026 T1=0.02	OPT f=2 TT=0.006 T1=0	OPT f=2 TT=0.006 T1=0	OPT f=2 TT=0.483 T1=1.23	OPT f=2 TT=0.373 T1=0.22	OPT f=2 TT=0.067 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m200_500_10_10.r.opb	SAT f=51 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=57 TT=1800.01 T1=1800.3	SAT (TO) f=60 TT=1800.02 T1=1800.3	SAT (TO) f=60 TT=1800.02 T1=1800.3	SAT (TO) f=51 TT=1800.08 T1=1800.4	SAT (TO) f=54 TT=1800.14 T1=5.76	SAT (TO) f=56 TT=1800.01 T1=11.97	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-m4.r.opb	OPT f=90 TT=0.327 T1=0.32	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=98 TT=1800.02 T1=1800.3	SAT (TO) f=116 TT=1800.03 T1=1800.3	OPT f=90 TT=0.327 T1=0.32	SAT (TO) f=93 TT=1800.02 T1=1800.3	SAT (TO) f=103 TT=1800.16 T1=547.47	SAT (TO) f=115 TT=1800.71 T1=0.34	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_10_10.r.opb	OPT f=8 TT=0.267 T1=0.26	No data	OPT f=8 TT=2.894 T1=2.89	OPT f=8 TT=0.844 T1=0.84	OPT f=8 TT=15.562 T1=15.56	OPT f=8 TT=0.98 T1=0.98	OPT f=8 TT=0.267 T1=0.26	OPT f=8 TT=0.96 T1=0.96	SAT (TO) f=9 TT=1800.95 T1=2.65	SAT (TO) f=9 TT=1800.5 T1=0.17	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_10_15.r.opb	OPT f=8 TT=1.076 T1=1.07	No data	OPT f=8 TT=1.076 T1=1.07	OPT f=8 TT=8.042 T1=8.04	OPT f=8 TT=7.484 T1=7.48	OPT f=8 TT=11.157 T1=11.15	OPT f=8 TT=3.117 T1=3.11	OPT f=8 TT=7.029 T1=7.02	SAT (TO) f=8 TT=1800.08 T1=6.68	SAT (TO) f=8 TT=1800.03 T1=236.28	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_30_30.r.opb	OPT f=4 TT=0.219 T1=0.21	No data	OPT f=4 TT=0.219 T1=0.21	OPT f=4 TT=0.957 T1=0.95	OPT f=4 TT=4.753 T1=4.75	OPT f=4 TT=2.757 T1=2.75	OPT f=4 TT=1.346 T1=1.34	OPT f=4 TT=0.407 T1=0.4	OPT f=4 TT=85.219 T1=39.71	OPT f=4 TT=6.342 T1=3.91	OPT f=4 TT=11.981 T1=11.93
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_50_50.r.opb	OPT f=3 TT=0.019 T1=0.02	No data	OPT f=3 TT=0.029 T1=0.03	OPT f=3 TT=0.019 T1=0.02	OPT f=3 TT=0.065 T1=0.06	OPT f=3 TT=0.115 T1=0.12	OPT f=3 TT=0.047 T1=0.04	OPT f=3 TT=0.052 T1=0.05	OPT f=3 TT=1.814 T1=1.21	OPT f=3 TT=0.703 T1=0.23	OPT f=3 TT=1.773 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_70_70.r.opb	OPT f=2 TT=0.005 T1=0	No data	OPT f=2 TT=0.027 T1=0.02	OPT f=2 TT=0.015 T1=0.01	OPT f=2 TT=0.035 T1=0.03	OPT f=2 TT=0.035 T1=0.03	OPT f=2 TT=0.007 T1=0	OPT f=2 TT=0.005 T1=0	OPT f=2 TT=0.634 T1=1.72	OPT f=2 TT=0.534 T1=0.22	OPT f=2 TT=0.063 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_90_90.r.opb	OPT f=2 TT=0.007 T1=0	No data	OPT f=2 TT=0.027 T1=0.02	OPT f=2 TT=0.016 T1=0.01	OPT f=2 TT=0.029 T1=0.03	OPT f=2 TT=0.033 T1=0.03	OPT f=2 TT=0.008 T1=0	OPT f=2 TT=0.007 T1=0.01	OPT f=2 TT=0.634 T1=0.73	OPT f=2 TT=0.485 T1=0.21	OPT f=2 TT=0.066 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-maincont.r.opb	OPT f=7 TT=0.003 T1=0	No data	OPT f=7 TT=0.029 T1=0.02	OPT f=7 TT=0.018 T1=0.01	OPT f=7 TT=0.041 T1=0.04	OPT f=7 TT=0.03 T1=0.03	OPT f=7 TT=0.003 T1=0	OPT f=7 TT=0.013 T1=0.01	OPT f=7 TT=0.904 T1=1.69	OPT f=7 TT=20.971 T1=0.34	OPT f=7 TT=0.062 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-max1024.r.opb	SAT f=275 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=280 TT=1800.09 T1=1800.4	SAT (TO) f=303 TT=1800.02 T1=1800.3	SAT (TO) f=303 TT=1800.02 T1=1800.3	SAT (TO) f=275 TT=1800.02 T1=1800.3	SAT (TO) f=284 TT=1800.54 T1=580.01	SAT (TO) f=303 TT=1800.08 T1=0.28	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-max512.r.opb	OPT f=113 TT=0.03 T1=0.02	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=120 TT=1800.01 T1=1800.3	SAT (TO) f=139 TT=1800.01 T1=1800.3	OPT f=113 TT=0.03 T1=0.02	SAT (TO) f=120 TT=1800.02 T1=1800.3	SAT (TO) f=122 TT=1800.09 T1=438.32	SAT (TO) f=139 TT=1800.03 T1=0.22	OPT f=113 TT=0.657 T1=0.34
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-mlp4.r.opb	OPT f=109 TT=0.033 T1=0.03	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=116 TT=1800.01 T1=1800.3	SAT (TO) f=136 TT=1800.02 T1=1800.3	OPT f=109 TT=0.033 T1=0.03	SAT (TO) f=113 TT=1800.02 T1=1800.3	SAT (TO) f=117 TT=1800.09 T1=662.02	SAT (TO) f=133 TT=1800.06 T1=0.28	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-opus.r.opb	OPT f=5 TT=0.003 T1=0	No data	OPT f=5 TT=0.026 T1=0.02	OPT f=5 TT=0.016 T1=0.01	OPT f=5 TT=0.03 T1=0.03	OPT f=5 TT=0.014 T1=0.01	OPT f=5 TT=0.003 T1=0	OPT f=5 TT=0.004 T1=0	OPT f=5 TT=0.294 T1=1.17	OPT f=5 TT=0.564 T1=0.16	OPT f=5 TT=0.122 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-pdc.r.opb	OPT f=94 TT=17.288 T1=17.28	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT (TO) f=150 TT=1800.07 T1=1800.4	SAT (TO) f=150 TT=1800.08 T1=1800.4	OPT f=94 TT=17.288 T1=17.28	SAT (TO) f=109 TT=1800.01 T1=1800.3	SAT (TO) f=148 TT=1800.1 T1=145.59	SAT (TO) f=150 TT=1800.09 T1=1.06	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-prom2.r.opb	SAT f=323 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=439 TT=1800.01 T1=1800.3	SAT (TO) f=439 TT=1800.01 T1=1800.3	SAT (TO) f=439 TT=1800.02 T1=1800.3	SAT (TO) f=323 TT=1800.02 T1=1800.3	SAT (TO) f=429 TT=1800.37 T1=805.99	SAT (TO) f=439 TT=1800.9 T1=0.35	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-rd73.b.opb	OPT f=4 TT=0.015 T1=0.01	No data	OPT f=4 TT=0.053 T1=0.05	OPT f=4 TT=0.032 T1=0.03	OPT f=4 TT=0.216 T1=0.21	OPT f=4 TT=0.107 T1=0.1	OPT f=4 TT=0.015 T1=0.01	OPT f=4 TT=0.025 T1=0.02	OPT f=4 TT=2.634 T1=1.81	OPT f=4 TT=3.003 T1=1.56	OPT f=4 TT=0.115 T1=0.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-rd84.b.opb	OPT f=5 TT=0.488 T1=0.48	No data	OPT f=5 TT=0.87 T1=0.86	OPT f=5 TT=3.256 T1=3.25	OPT f=5 TT=11.304 T1=11.3	OPT f=5 TT=3.317 T1=3.31	OPT f=5 TT=0.63 T1=0.63	OPT f=5 TT=0.488 T1=0.48	OPT f=5 TT=198.314 T1=52.7	SAT (TO) f=6 TT=1800.66 T1=291.05	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ricks.r.opb	OPT f=5 TT=0.047 T1=0.04	No data	OPT f=5 TT=0.047 T1=0.04	OPT f=5 TT=0.096 T1=0.09	OPT f=5 TT=12.006 T1=12.01	OPT f=5 TT=0.379 T1=0.37	OPT f=5 TT=0.086 T1=0.08	OPT f=5 TT=0.241 T1=0.24	OPT f=5 TT=1.524 T1=1.81	OPT f=5 TT=9.325 T1=0.41	OPT f=5 TT=1.765 T1=1.7
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-saucier.r.opb	OPT f=6 TT=661.163 T1=224.97	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=6 TT=1800.05 T1=1800.4	SAT (TO) f=7 TT=1800.13 T1=1800.4	OPT f=6 TT=897.593 T1=897.73	SAT (TO) f=7 TT=1800.13 T1=1800.4	OPT f=6 TT=661.163 T1=224.97	SAT (TO) f=8 TT=1800.82 T1=746.17	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-test1.r.opb	SAT f=132 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=149 TT=1800.11 T1=1800.4	SAT (TO) f=149 TT=1800.09 T1=1800.4	SAT (TO) f=149 TT=1800.02 T1=1800.3	SAT (TO) f=132 TT=1800.02 T1=1800.3	SAT (TO) f=137 TT=1800.18 T1=810.6	SAT (TO) f=148 TT=1800.05 T1=0.41	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_1.opb	UNSAT TT=79.101	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1272.56	UNSAT TT=456.303	UNSAT TT=976.129	UNSAT TT=983.647	UNSAT TT=435.658	UNSAT TT=200.913	UNSAT TT=79.101
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_2.opb	UNSAT TT=34.984	No data	UNSAT TT=937.655	UNSAT TT=980.377	? (TO) TT=1800.02	UNSAT TT=161.705	UNSAT TT=1134.87	UNSAT TT=1070.38	UNSAT TT=160.86	UNSAT TT=97.41	UNSAT TT=34.984
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_3.opb	UNSAT TT=165.369	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1297.3	UNSAT TT=1059.51	? (TO) TT=1800.11	? (TO) TT=1800.01	UNSAT TT=1081.47	UNSAT TT=593.54	UNSAT TT=165.369
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_4.opb	UNSAT TT=52.193	No data	UNSAT TT=1435.44	UNSAT TT=1419.11	UNSAT TT=1002.59	UNSAT TT=144.924	UNSAT TT=748.17	UNSAT TT=743.737	UNSAT TT=183.645	UNSAT TT=115.365	UNSAT TT=52.193
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_1.opb	OPT f=0 TT=1078.99 T1=1079.15	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=0 TT=1078.99 T1=1079.15	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.63	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_2.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_3.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.95	? (TO) TT=1800.01	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_4.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1801.06	? (TO) TT=1800.75	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_1.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.96	? (TO) TT=1800.04	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_2.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_3.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_4.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.82	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_1.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.72	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_2.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.81	? (TO) TT=1800.52	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_3.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.46	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_4.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_1.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_2.opb		No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1801.13	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_3.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.77	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_4.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.63	? (TO) TT=1800.72	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_1.opb	OPT f=2 TT=342.91 T1=59.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT (TO) f=2 TT=1800.02 T1=1800.3	OPT f=2 TT=673.137 T1=673.24	SAT (TO) f=11 TT=1800.06 T1=1800.4	SAT (TO) f=3 TT=1800.08 T1=1800.4	OPT f=2 TT=342.91 T1=59.3	SAT (TO) f=2 TT=1800.52 T1=749.06	OPT f=2 TT=438.618 T1=438.62
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_2.opb	OPT f=1 TT=141.034 T1=16.21	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1 TT=1800.02 T1=1800.3	OPT f=1 TT=222.822 T1=222.85	SAT (TO) f=5 TT=1800.12 T1=1800.4	SAT (TO) f=3 TT=1800.09 T1=1800.4	OPT f=1 TT=153.191 T1=16.21	OPT f=1 TT=453.195 T1=452.16	OPT f=1 TT=141.034 T1=140.99
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_3.opb	OPT f=2 TT=827.696 T1=35.79	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=3 TT=1800.02 T1=1800.3	OPT f=2 TT=917.476 T1=917.62	SAT (TO) f=14 TT=1800.07 T1=1800.4	SAT (TO) f=3 TT=1800.09 T1=1800.4	OPT f=2 TT=1067.02 T1=35.79	SAT (TO) f=121 TT=1800.03 T1=302.09	OPT f=2 TT=827.696 T1=532.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_4.opb	OPT f=1 TT=201.333 T1=101.97	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=1 TT=1763.95 T1=1764.22	OPT f=1 TT=213.668 T1=213.69	SAT (TO) f=4 TT=1800.1 T1=1800.4	OPT f=1 TT=1794.77 T1=1795.07	OPT f=1 TT=201.333 T1=101.97	OPT f=1 TT=344.42 T1=343.75	OPT f=1 TT=235.706 T1=235.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_1.opb	SAT f=3 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=9 TT=1800.02 T1=1800.3	SAT (TO) f=3 TT=1800.09 T1=1800.4	SAT (TO) f=27 TT=1800.06 T1=1800.4	SAT (TO) f=22 TT=1800.07 T1=1800.4	SAT (TO) f=19 TT=1800.69 T1=45.94	SAT (TO) f=16 TT=1800.65 T1=327.41	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_2.opb	SAT f=5 TT=1800.01 T1=488.09	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=9 TT=1800.02 T1=1800.3	SAT (TO) f=5 TT=1800.01 T1=1800.3	SAT (TO) f=40 TT=1800.1 T1=1800.4	SAT (TO) f=18 TT=1800.04 T1=1800.3	SAT (TO) f=5 TT=1800.01 T1=488.09	SAT (TO) f=57 TT=1800.01 T1=356.55	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_3.opb	SAT f=2 TT=1800.02 T1=337.05	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=13 TT=1800.01 T1=1800.3	SAT (TO) f=2 TT=1800.02 T1=1800.3	SAT (TO) f=19 TT=1800.08 T1=1800.4	SAT (TO) f=15 TT=1800.05 T1=1800.4	SAT (TO) f=2 TT=1800.08 T1=337.05	SAT (TO) f=5 TT=1800.69 T1=74.14	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_4.opb	SAT f=2 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=10 TT=1800.02 T1=1800.3	SAT (TO) f=2 TT=1800.02 T1=1800.3	SAT (TO) f=69 TT=1800.05 T1=1800.4	SAT (TO) f=12 TT=1800.05 T1=1800.4	SAT (TO) f=8 TT=1800.06 T1=27.38	SAT (TO) f=16 TT=1800.09 T1=298.11	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_1.opb	SAT f=9 TT=1800.01 T1=1695.91	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT (TO) f=35 TT=1800.01 T1=1800.3	SAT (TO) f=11 TT=1800.1 T1=1800.4	SAT (TO) f=201 TT=1800.04 T1=1800.4	SAT (TO) f=153 TT=1800.06 T1=1800.4	SAT (TO) f=14 TT=1800.43 T1=906.59	SAT (TO) f=9 TT=1800.01 T1=1695.91	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_2.opb	SAT f=2 TT=1800.71 T1=284.79	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=48 TT=1800.02 T1=1800.3	SAT (TO) f=14 TT=1800.02 T1=1800.3	SAT (TO) f=105 TT=1800.09 T1=1800.5	SAT (TO) f=128 TT=1800.04 T1=1800.4	SAT (TO) f=10 TT=1800.16 T1=859.87	SAT (TO) f=2 TT=1800.71 T1=284.79	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_3.opb	SAT f=10 TT=1800.72 T1=424.64	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=46 TT=1800.02 T1=1800.3	SAT (TO) f=19 TT=1800.02 T1=1800.3	SAT (TO) f=201 TT=1800.02 T1=1800.4	SAT (TO) f=206 TT=1800.01 T1=1800.4	SAT (TO) f=10 TT=1800.72 T1=424.64	SAT (TO) f=11 TT=1800.7 T1=539.39	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_4.opb	SAT f=11 TT=1800.63 T1=585.12	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=12 TT=1800.1 T1=1800.4	SAT (TO) f=94 TT=1800.04 T1=1800.4	SAT (TO) f=136 TT=1800.05 T1=1800.4	SAT (TO) f=11 TT=1800.63 T1=585.12	SAT (TO) f=15 TT=1800.57 T1=1010.21	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_1.opb	SAT f=25 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=116 TT=1800.02 T1=1800.3	SAT (TO) f=25 TT=1800.02 T1=1800.3	SAT (TO) f=400 TT=1800.03 T1=1800.4	SAT (TO) f=426 TT=1800.08 T1=1800.4	SAT (TO) f=37 TT=1800.17 T1=856.22	SAT (TO) f=44 TT=1800.03 T1=1720.83	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_2.opb	SAT f=30 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=118 TT=1800.01 T1=1800.3	SAT (TO) f=30 TT=1800.1 T1=1800.4	SAT (TO) f=439 TT=1800.05 T1=1800.4	SAT (TO) f=559 TT=1800.14 T1=1800.5	SAT (TO) f=50 TT=1800.51 T1=396.09	SAT (TO) f=52 TT=1800.61 T1=1399.13	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_3.opb	SAT f=29 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT (TO) f=127 TT=1800.02 T1=1800.3	SAT (TO) f=29 TT=1800.02 T1=1800.3	SAT (TO) f=274 TT=1800.04 T1=1800.4	SAT (TO) f=543 TT=1800.1 T1=1800.5	SAT (TO) f=56 TT=1800.52 T1=190.57	SAT (TO) f=52 TT=1800 T1=1726.88	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_4.opb	SAT f=23 TT=1800.02 T1=1742.33	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=126 TT=1800.02 T1=1800.3	SAT (TO) f=28 TT=1800.01 T1=1800.3	SAT (TO) f=443 TT=1800.1 T1=1800.5	SAT (TO) f=529 TT=1800.18 T1=1800.4	SAT (TO) f=52 TT=1800.02 T1=750.41	SAT (TO) f=23 TT=1800.02 T1=1742.33	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_1.opb	SAT f=52 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=208 TT=1800.02 T1=1800.3	SAT (TO) f=52 TT=1800.06 T1=1800.4	SAT (TO) f=1169 TT=1800.11 T1=1800.4	SAT (TO) f=987 TT=1800.03 T1=1800.4	SAT (TO) f=100 TT=1800.15 T1=815.34	SAT (TO) f=158 TT=1800.04 T1=519.52	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_2.opb	SAT f=67 TT=1800.04 T1=1718.03	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=186 TT=1800.02 T1=1800.3	SAT (TO) f=80 TT=1800.02 T1=1800.3	SAT (TO) f=1104 TT=1800.12 T1=1800.5	SAT (TO) f=790 TT=1800.06 T1=1800.5	SAT (TO) f=97 TT=1800.02 T1=457.58	SAT (TO) f=67 TT=1800.04 T1=1718.03	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_3.opb	SAT f=60 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=141 TT=1800.02 T1=1800.3	SAT (TO) f=60 TT=1800.1 T1=1800.4	SAT (TO) f=1382 TT=1800.12 T1=1800.5	SAT (TO) f=544 TT=1800.13 T1=1800.5	SAT (TO) f=245 TT=1800.08 T1=939.43	SAT (TO) f=307 TT=1800.09 T1=1305.76	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_4.opb	SAT f=77 TT=1800.04 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=218 TT=1800.02 T1=1800.3	SAT (TO) f=77 TT=1800.04 T1=1800.4	SAT (TO) f=445 TT=1800.04 T1=1800.4	SAT (TO) f=950 TT=1800.11 T1=1800.5	SAT (TO) f=129 TT=1800.22 T1=912.64	SAT (TO) f=145 TT=1800.02 T1=545.12	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=223.opb	OPT f=101 TT=0.019 T1=0.02	No data	OPT f=101 TT=0.216 T1=0.21	OPT f=101 TT=0.086 T1=0.08	OPT f=101 TT=0.019 T1=0.02	OPT f=101 TT=0.023 T1=0.02	OPT f=101 TT=6.171 T1=6.16	OPT f=101 TT=23.938 T1=23.93	OPT f=101 TT=0.724 T1=0.67	OPT f=101 TT=0.354 T1=0.18	OPT f=101 TT=0.285 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=379.opb	OPT f=101 TT=0.017 T1=0.01	No data	OPT f=101 TT=0.174 T1=0.17	OPT f=101 TT=0.134 T1=0.13	OPT f=101 TT=0.019 T1=0.01	OPT f=101 TT=0.017 T1=0.01	OPT f=101 TT=2.907 T1=2.89	OPT f=101 TT=17.16 T1=17.15	OPT f=101 TT=0.625 T1=0.67	OPT f=101 TT=0.334 T1=0.2	OPT f=101 TT=0.469 T1=0.43
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=409.opb	OPT f=101 TT=0.02 T1=0.01	No data	OPT f=101 TT=0.248 T1=0.24	OPT f=101 TT=0.224 T1=0.22	OPT f=101 TT=0.02 T1=0.01	OPT f=101 TT=0.03 T1=0.03	OPT f=101 TT=5.615 T1=5.6	OPT f=101 TT=21.187 T1=21.18	OPT f=101 TT=0.493 T1=0.66	OPT f=101 TT=0.314 T1=0.19	OPT f=101 TT=0.455 T1=0.41
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=457.opb	OPT f=101 TT=0.02 T1=0.02	No data	OPT f=101 TT=0.108 T1=0.1	OPT f=101 TT=0.349 T1=0.34	OPT f=101 TT=0.022 T1=0.02	OPT f=101 TT=0.02 T1=0.02	OPT f=101 TT=4.036 T1=4.03	OPT f=101 TT=19.115 T1=19.11	OPT f=101 TT=0.425 T1=0.66	OPT f=101 TT=0.294 T1=0.18	OPT f=101 TT=0.459 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=107-Q=373.opb	OPT f=107 TT=0.021 T1=0.02	No data	OPT f=107 TT=0.305 T1=0.3	OPT f=107 TT=0.261 T1=0.26	OPT f=107 TT=0.023 T1=0.02	OPT f=107 TT=0.021 T1=0.02	OPT f=107 TT=4.64 T1=4.63	OPT f=107 TT=19.075 T1=19.07	OPT f=107 TT=0.573 T1=0.66	OPT f=107 TT=0.344 T1=0.21	OPT f=107 TT=0.446 T1=0.4
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=107-Q=503.opb	OPT f=107 TT=0.018 T1=0.01	No data	OPT f=107 TT=0.078 T1=0.07	OPT f=107 TT=0.055 T1=0.05	OPT f=107 TT=0.019 T1=0.01	OPT f=107 TT=0.018 T1=0.01	OPT f=107 TT=2.715 T1=2.7	OPT f=107 TT=16.592 T1=16.58	OPT f=107 TT=0.273 T1=0.67	OPT f=107 TT=0.204 T1=0.14	OPT f=107 TT=0.578 T1=0.54
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=109-Q=373.opb	OPT f=109 TT=0.02 T1=0.02	No data	OPT f=109 TT=0.351 T1=0.35	OPT f=109 TT=0.312 T1=0.31	OPT f=109 TT=0.02 T1=0.02	OPT f=109 TT=0.023 T1=0.02	OPT f=109 TT=4.566 T1=4.55	OPT f=109 TT=19.801 T1=19.8	OPT f=109 TT=0.564 T1=0.66	OPT f=109 TT=0.324 T1=0.18	OPT f=109 TT=0.428 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=109-Q=419.opb	OPT f=109 TT=0.019 T1=0.02	No data	OPT f=109 TT=0.089 T1=0.08	OPT f=109 TT=0.056 T1=0.05	OPT f=109 TT=0.022 T1=0.02	OPT f=109 TT=0.019 T1=0.02	OPT f=109 TT=5.101 T1=5.09	OPT f=109 TT=19.643 T1=19.64	OPT f=109 TT=0.483 T1=0.67	OPT f=109 TT=0.295 T1=0.16	OPT f=109 TT=0.501 T1=0.46
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=233.opb	OPT f=113 TT=0.019 T1=0.01	No data	OPT f=113 TT=0.199 T1=0.19	OPT f=113 TT=0.077 T1=0.07	OPT f=113 TT=0.019 T1=0.01	OPT f=113 TT=0.028 T1=0.02	OPT f=113 TT=4.639 T1=4.62	OPT f=113 TT=18.194 T1=18.19	OPT f=113 TT=0.705 T1=0.66	OPT f=113 TT=0.354 T1=0.18	OPT f=113 TT=0.318 T1=0.29
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=331.opb	OPT f=113 TT=0.02 T1=0.01	No data	OPT f=113 TT=0.157 T1=0.15	OPT f=113 TT=0.238 T1=0.23	OPT f=113 TT=0.02 T1=0.01	OPT f=113 TT=0.029 T1=0.02	OPT f=113 TT=5.349 T1=5.33	OPT f=113 TT=19.303 T1=19.3	OPT f=113 TT=0.544 T1=0.66	OPT f=113 TT=0.323 T1=0.19	OPT f=113 TT=0.405 T1=0.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=479.opb	OPT f=113 TT=0.02 T1=0.01	No data	OPT f=113 TT=0.04 T1=0.04	OPT f=113 TT=0.024 T1=0.02	OPT f=113 TT=0.02 T1=0.01	OPT f=113 TT=0.023 T1=0.02	OPT f=113 TT=3.554 T1=3.54	OPT f=113 TT=17.145 T1=17.15	OPT f=113 TT=0.444 T1=0.66	OPT f=113 TT=0.265 T1=0.17	OPT f=113 TT=0.643 T1=0.6
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=521.opb	UNSAT TT=0.023	No data	UNSAT TT=0.276	UNSAT TT=0.272	UNSAT TT=0.023	UNSAT TT=0.027	UNSAT TT=3.641	UNSAT TT=15.797	UNSAT TT=0.935	UNSAT TT=0.472	UNSAT TT=0.636
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=11-Q=283.opb	OPT f=11 TT=0.013 T1=0.01	No data	OPT f=11 TT=0.043 T1=0.04	OPT f=11 TT=0.031 T1=0.03	OPT f=11 TT=0.017 T1=0.01	OPT f=11 TT=0.013 T1=0.01	OPT f=11 TT=2.274 T1=2.26	OPT f=11 TT=15.949 T1=15.94	OPT f=11 TT=0.404 T1=0.66	OPT f=11 TT=0.224 T1=0.16	OPT f=11 TT=0.104 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=11-Q=53.opb	OPT f=11 TT=0.01 T1=0.01	No data	OPT f=11 TT=0.04 T1=0.04	OPT f=11 TT=0.032 T1=0.03	OPT f=11 TT=0.012 T1=0.01	OPT f=11 TT=0.01 T1=0.01	OPT f=11 TT=1.968 T1=1.95	OPT f=11 TT=14.829 T1=14.82	OPT f=11 TT=0.315 T1=0.67	OPT f=11 TT=0.243 T1=0.16	OPT f=11 TT=0.061 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=137.opb	OPT f=127 TT=0.022 T1=0.02	No data	OPT f=127 TT=0.817 T1=0.81	OPT f=127 TT=0.323 T1=0.32	OPT f=127 TT=0.022 T1=0.02	OPT f=127 TT=0.038 T1=0.03	OPT f=127 TT=5.253 T1=5.24	OPT f=127 TT=24.882 T1=24.87	OPT f=127 TT=0.655 T1=0.66	OPT f=127 TT=0.364 T1=0.18	OPT f=127 TT=0.24 T1=0.22
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=149.opb	OPT f=127 TT=0.021 T1=0.02	No data	OPT f=127 TT=0.651 T1=0.65	OPT f=127 TT=0.153 T1=0.15	OPT f=127 TT=0.021 T1=0.02	OPT f=127 TT=0.022 T1=0.02	OPT f=127 TT=4.051 T1=4.03	OPT f=127 TT=21.804 T1=21.8	OPT f=127 TT=0.696 T1=0.66	OPT f=127 TT=0.384 T1=0.19	OPT f=127 TT=0.241 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=211.opb	OPT f=127 TT=0.023 T1=0.02	No data	OPT f=127 TT=0.184 T1=0.18	OPT f=127 TT=0.289 T1=0.28	OPT f=127 TT=0.023 T1=0.02	OPT f=127 TT=0.024 T1=0.02	OPT f=127 TT=3.163 T1=3.15	OPT f=127 TT=20.7 T1=20.69	OPT f=127 TT=0.644 T1=0.66	OPT f=127 TT=0.373 T1=0.19	OPT f=127 TT=0.289 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=359.opb	OPT f=127 TT=0.019 T1=0.02	No data	OPT f=127 TT=0.183 T1=0.18	OPT f=127 TT=0.154 T1=0.15	OPT f=127 TT=0.021 T1=0.02	OPT f=127 TT=0.019 T1=0.02	OPT f=127 TT=4.845 T1=4.83	OPT f=127 TT=20.394 T1=20.38	OPT f=127 TT=0.574 T1=0.66	OPT f=127 TT=0.304 T1=0.16	OPT f=127 TT=0.46 T1=0.43
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=389.opb	OPT f=127 TT=0.023 T1=0.02	No data	OPT f=127 TT=0.41 T1=0.41	OPT f=127 TT=0.396 T1=0.39	OPT f=127 TT=0.023 T1=0.02	OPT f=127 TT=0.029 T1=0.03	OPT f=127 TT=2.242 T1=2.23	OPT f=127 TT=17.846 T1=17.84	OPT f=127 TT=0.455 T1=0.66	OPT f=127 TT=0.274 T1=0.17	OPT f=127 TT=0.641 T1=0.59
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=487.opb	OPT f=127 TT=0.017 T1=0.01	No data	OPT f=127 TT=0.125 T1=0.12	OPT f=127 TT=0.117 T1=0.11	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.017 T1=0.01	OPT f=127 TT=3.081 T1=3.07	OPT f=127 TT=16.401 T1=16.39	OPT f=127 TT=0.304 T1=0.66	OPT f=127 TT=0.224 T1=0.15	OPT f=127 TT=0.62 T1=0.58
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=491.opb	OPT f=127 TT=0.02 T1=0.01	No data	OPT f=127 TT=0.236 T1=0.23	OPT f=127 TT=0.22 T1=0.22	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.028 T1=0.02	OPT f=127 TT=3.351 T1=3.34	OPT f=127 TT=15.688 T1=15.68	OPT f=127 TT=0.235 T1=0.66	OPT f=127 TT=0.224 T1=0.15	OPT f=127 TT=0.675 T1=0.63
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=499.opb	OPT f=127 TT=0.015 T1=0.01	No data	OPT f=127 TT=0.298 T1=0.29	OPT f=127 TT=0.303 T1=0.3	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.015 T1=0.01	OPT f=127 TT=3.221 T1=3.21	OPT f=127 TT=16.715 T1=16.71	OPT f=127 TT=0.234 T1=0.66	OPT f=127 TT=0.224 T1=0.15	OPT f=127 TT=0.64 T1=0.59
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=137.opb	OPT f=131 TT=0.021 T1=0.02	No data	OPT f=131 TT=0.22 T1=0.22	OPT f=131 TT=0.143 T1=0.14	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.022 T1=0.02	OPT f=131 TT=5.506 T1=5.49	OPT f=131 TT=19.451 T1=19.44	OPT f=131 TT=7.163 T1=1.16	OPT f=131 TT=0.444 T1=0.23	OPT f=131 TT=0.252 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=157.opb	OPT f=131 TT=0.021 T1=0.02	No data	OPT f=131 TT=0.26 T1=0.25	OPT f=131 TT=0.14 T1=0.14	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.028 T1=0.02	OPT f=131 TT=4.419 T1=4.4	OPT f=131 TT=17.556 T1=17.55	OPT f=131 TT=0.916 T1=0.66	OPT f=131 TT=0.454 T1=0.23	OPT f=131 TT=0.261 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=163.opb	OPT f=131 TT=0.023 T1=0.02	No data	OPT f=131 TT=0.586 T1=0.58	OPT f=131 TT=0.465 T1=0.46	OPT f=131 TT=0.023 T1=0.02	OPT f=131 TT=0.024 T1=0.02	OPT f=131 TT=4.609 T1=4.6	OPT f=131 TT=19.108 T1=19.1	OPT f=131 TT=14.302 T1=1.16	OPT f=131 TT=0.454 T1=0.24	OPT f=131 TT=0.271 T1=0.25
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=277.opb	OPT f=131 TT=0.021 T1=0.02	No data	OPT f=131 TT=0.834 T1=0.83	OPT f=131 TT=0.844 T1=0.84	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.027 T1=0.02	OPT f=131 TT=4.017 T1=4	OPT f=131 TT=17.449 T1=17.44	OPT f=131 TT=2.803 T1=0.66	OPT f=131 TT=0.444 T1=0.23	OPT f=131 TT=0.397 T1=0.34
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=139-Q=191.opb	OPT f=139 TT=0.021 T1=0.02	No data	OPT f=139 TT=0.655 T1=0.65	OPT f=139 TT=0.306 T1=0.3	OPT f=139 TT=0.021 T1=0.02	OPT f=139 TT=0.022 T1=0.02	OPT f=139 TT=4.805 T1=4.81	OPT f=139 TT=18.988 T1=18.98	OPT f=139 TT=9.093 T1=6.22	OPT f=139 TT=0.433 T1=0.23	OPT f=139 TT=0.298 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=13-Q=179.opb	OPT f=13 TT=0.014 T1=0.01	No data	OPT f=13 TT=0.044 T1=0.04	OPT f=13 TT=0.026 T1=0.03	OPT f=13 TT=0.016 T1=0.01	OPT f=13 TT=0.014 T1=0.01	OPT f=13 TT=3.75 T1=3.73	OPT f=13 TT=17.968 T1=17.96	OPT f=13 TT=0.412 T1=0.66	OPT f=13 TT=0.234 T1=0.16	OPT f=13 TT=0.06 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=163.opb	OPT f=149 TT=0.021 T1=0.02	No data	OPT f=149 TT=0.161 T1=0.16	OPT f=149 TT=0.12 T1=0.12	OPT f=149 TT=0.021 T1=0.02	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=5.703 T1=5.69	OPT f=149 TT=19.664 T1=19.66	OPT f=149 TT=0.874 T1=1.16	OPT f=149 TT=0.414 T1=0.22	OPT f=149 TT=0.323 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=167.opb	OPT f=149 TT=0.022 T1=0.02	No data	OPT f=149 TT=0.675 T1=0.67	OPT f=149 TT=0.33 T1=0.33	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.029 T1=0.03	OPT f=149 TT=5.57 T1=5.55	OPT f=149 TT=17.536 T1=17.53	OPT f=149 TT=0.965 T1=1.16	OPT f=149 TT=0.445 T1=0.22	OPT f=149 TT=0.319 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=251.opb	OPT f=149 TT=0.02 T1=0.02	No data	OPT f=149 TT=0.141 T1=0.14	OPT f=149 TT=0.078 T1=0.07	OPT f=149 TT=0.02 T1=0.02	OPT f=149 TT=0.03 T1=0.03	OPT f=149 TT=5.399 T1=5.38	OPT f=149 TT=19.034 T1=19.02	OPT f=149 TT=0.643 T1=1.16	OPT f=149 TT=0.364 T1=0.2	OPT f=149 TT=0.418 T1=0.35
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=271.opb	OPT f=149 TT=0.021 T1=0.02	No data	OPT f=149 TT=0.543 T1=0.54	OPT f=149 TT=0.473 T1=0.47	OPT f=149 TT=0.021 T1=0.02	OPT f=149 TT=0.028 T1=0.02	OPT f=149 TT=6.574 T1=6.56	OPT f=149 TT=22.364 T1=22.36	OPT f=149 TT=0.824 T1=0.66	OPT f=149 TT=0.434 T1=0.22	OPT f=149 TT=0.466 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=293.opb	OPT f=149 TT=0.024 T1=0.02	No data	OPT f=149 TT=0.373 T1=0.37	OPT f=149 TT=0.388 T1=0.38	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=5.319 T1=5.3	OPT f=149 TT=20.113 T1=20.11	OPT f=149 TT=0.854 T1=0.67	OPT f=149 TT=0.414 T1=0.21	OPT f=149 TT=0.438 T1=0.37
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=397.opb	OPT f=149 TT=0.019 T1=0.01	No data	OPT f=149 TT=0.274 T1=0.27	OPT f=149 TT=0.113 T1=0.11	OPT f=149 TT=0.019 T1=0.01	OPT f=149 TT=0.025 T1=0.02	OPT f=149 TT=5.58 T1=5.56	OPT f=149 TT=20.099 T1=20.09	OPT f=149 TT=0.756 T1=0.66	OPT f=149 TT=0.345 T1=0.18	OPT f=149 TT=0.591 T1=0.53
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=409.opb	OPT f=149 TT=0.022 T1=0.02	No data	OPT f=149 TT=0.365 T1=0.36	OPT f=149 TT=0.423 T1=0.42	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.025 T1=0.02	OPT f=149 TT=4.424 T1=4.41	OPT f=149 TT=19.277 T1=19.27	OPT f=149 TT=1.584 T1=0.66	OPT f=149 TT=0.394 T1=0.21	OPT f=149 TT=0.63 T1=0.58
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=487.opb	OPT f=149 TT=0.02 T1=0.02	No data	OPT f=149 TT=0.238 T1=0.23	OPT f=149 TT=0.189 T1=0.19	OPT f=149 TT=0.02 T1=0.02	OPT f=149 TT=2.537 T1=2.53	OPT f=149 TT=2.086 T1=2.07	OPT f=149 TT=15.58 T1=15.57	OPT f=149 TT=0.554 T1=0.66	OPT f=149 TT=0.264 T1=0.17	OPT f=149 TT=0.845 T1=0.79
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=509.opb	OPT f=149 TT=0.022 T1=0.02	No data	OPT f=149 TT=0.149 T1=0.15	OPT f=149 TT=0.211 T1=0.21	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=2.536 T1=2.53	OPT f=149 TT=3.192 T1=3.18	OPT f=149 TT=16.364 T1=16.36	OPT f=149 TT=0.266 T1=0.66	OPT f=149 TT=0.204 T1=0.15	OPT f=149 TT=0.763 T1=0.72
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=151-Q=167.opb	OPT f=151 TT=0.023 T1=0.02	No data	OPT f=151 TT=0.117 T1=0.11	OPT f=151 TT=0.079 T1=0.07	OPT f=151 TT=0.023 T1=0.02	OPT f=151 TT=0.026 T1=0.02	OPT f=151 TT=6.807 T1=6.8	OPT f=151 TT=19.519 T1=19.51	OPT f=151 TT=0.814 T1=1.16	OPT f=151 TT=0.424 T1=0.22	OPT f=151 TT=0.3 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=157-Q=163.opb	OPT f=157 TT=0.021 T1=0.02	No data	OPT f=157 TT=1.359 T1=1.35	OPT f=157 TT=0.356 T1=0.35	OPT f=157 TT=0.021 T1=0.02	OPT f=157 TT=0.025 T1=0.02	OPT f=157 TT=6.081 T1=6.07	OPT f=157 TT=19.275 T1=19.28	OPT f=157 TT=0.893 T1=0.66	OPT f=157 TT=0.402 T1=0.21	OPT f=157 TT=0.323 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=157-Q=181.opb	OPT f=157 TT=0.022 T1=0.02	No data	OPT f=157 TT=0.368 T1=0.36	OPT f=157 TT=0.117 T1=0.11	OPT f=157 TT=0.022 T1=0.02	OPT f=157 TT=0.03 T1=0.03	OPT f=157 TT=5.246 T1=5.23	OPT f=157 TT=16.926 T1=16.92	OPT f=157 TT=0.784 T1=1.16	OPT f=157 TT=0.414 T1=0.21	OPT f=157 TT=0.324 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=157-Q=373.opb	OPT f=157 TT=0.02 T1=0.01	No data	OPT f=157 TT=0.64 T1=0.64	OPT f=157 TT=0.582 T1=0.58	OPT f=157 TT=0.02 T1=0.01	OPT f=157 TT=0.025 T1=0.02	OPT f=157 TT=4.418 T1=4.4	OPT f=157 TT=18.762 T1=18.77	OPT f=157 TT=0.624 T1=0.66	OPT f=157 TT=0.375 T1=0.22	OPT f=157 TT=0.569 T1=0.53
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=167-Q=173.opb	OPT f=167 TT=0.02 T1=0.02	No data	OPT f=167 TT=0.172 T1=0.17	OPT f=167 TT=0.09 T1=0.09	OPT f=167 TT=0.02 T1=0.02	OPT f=167 TT=0.027 T1=0.02	OPT f=167 TT=5 T1=4.99	OPT f=167 TT=17.406 T1=17.4	OPT f=167 TT=6.813 T1=1.17	OPT f=167 TT=0.444 T1=0.22	OPT f=167 TT=0.358 T1=0.39
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=167-Q=179.opb	OPT f=167 TT=0.023 T1=0.02	No data	OPT f=167 TT=0.252 T1=0.25	OPT f=167 TT=0.181 T1=0.18	OPT f=167 TT=0.023 T1=0.02	OPT f=167 TT=0.026 T1=0.02	OPT f=167 TT=5.569 T1=5.56	OPT f=167 TT=18.137 T1=18.13	OPT f=167 TT=0.746 T1=0.67	OPT f=167 TT=0.454 T1=0.23	OPT f=167 TT=0.344 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=167-Q=347.opb	OPT f=167 TT=0.022 T1=0.02	No data	OPT f=167 TT=0.63 T1=0.63	OPT f=167 TT=0.24 T1=0.24	OPT f=167 TT=0.022 T1=0.02	OPT f=167 TT=0.025 T1=0.02	OPT f=167 TT=4.845 T1=4.83	OPT f=167 TT=19.582 T1=19.57	OPT f=167 TT=0.734 T1=0.66	OPT f=167 TT=0.353 T1=0.18	OPT f=167 TT=0.619 T1=0.56
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=173-Q=173.opb	OPT f=173 TT=0.021 T1=0.02	No data	OPT f=173 TT=0.196 T1=0.19	OPT f=173 TT=0.185 T1=0.18	OPT f=173 TT=0.021 T1=0.02	OPT f=173 TT=0.028 T1=0.02	OPT f=173 TT=5.467 T1=5.45	OPT f=173 TT=18.077 T1=18.07	OPT f=173 TT=0.804 T1=0.66	OPT f=173 TT=0.464 T1=0.24	OPT f=173 TT=0.338 T1=0.29
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=173-Q=191.opb	OPT f=173 TT=0.022 T1=0.02	No data	OPT f=173 TT=0.452 T1=0.45	OPT f=173 TT=0.392 T1=0.39	OPT f=173 TT=0.022 T1=0.02	OPT f=173 TT=0.028 T1=0.02	OPT f=173 TT=4.537 T1=4.52	OPT f=173 TT=20.218 T1=20.21	OPT f=173 TT=0.734 T1=0.66	OPT f=173 TT=0.444 T1=0.21	OPT f=173 TT=0.422 T1=0.39
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=173-Q=211.opb	OPT f=173 TT=0.026 T1=0.02	No data	OPT f=173 TT=0.677 T1=0.67	OPT f=173 TT=0.238 T1=0.23	OPT f=173 TT=0.026 T1=0.02	OPT f=173 TT=0.028 T1=0.02	OPT f=173 TT=5.377 T1=5.37	OPT f=173 TT=18.415 T1=18.41	OPT f=173 TT=0.815 T1=1.17	OPT f=173 TT=0.415 T1=0.22	OPT f=173 TT=0.461 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=179-Q=509.opb	OPT f=179 TT=0.02 T1=0.01	No data	OPT f=179 TT=0.067 T1=0.06	OPT f=179 TT=0.046 T1=0.04	OPT f=179 TT=0.02 T1=0.01	OPT f=179 TT=2.541 T1=2.53	OPT f=179 TT=3.823 T1=3.81	OPT f=179 TT=17.004 T1=16.99	OPT f=179 TT=0.244 T1=0.67	OPT f=179 TT=0.194 T1=0.14	OPT f=179 TT=1.04 T1=0.98
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=17-Q=347.opb	OPT f=17 TT=0.013 T1=0.01	No data	OPT f=17 TT=0.134 T1=0.13	OPT f=17 TT=0.093 T1=0.09	OPT f=17 TT=0.017 T1=0.01	OPT f=17 TT=0.013 T1=0.01	OPT f=17 TT=2.264 T1=2.25	OPT f=17 TT=16.819 T1=16.81	OPT f=17 TT=0.624 T1=0.66	OPT f=17 TT=0.244 T1=0.16	OPT f=17 TT=0.112 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=17-Q=457.opb	OPT f=17 TT=0.015 T1=0.01	No data	OPT f=17 TT=0.077 T1=0.07	OPT f=17 TT=0.099 T1=0.1	OPT f=17 TT=0.015 T1=0.01	OPT f=17 TT=0.018 T1=0.01	OPT f=17 TT=2.239 T1=2.22	OPT f=17 TT=17.277 T1=17.27	OPT f=17 TT=0.215 T1=0.66	OPT f=17 TT=0.194 T1=0.14	OPT f=17 TT=0.117 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=17-Q=487.opb	OPT f=17 TT=0.016 T1=0.01	No data	OPT f=17 TT=0.211 T1=0.21	OPT f=17 TT=0.179 T1=0.17	OPT f=17 TT=0.016 T1=0.01	OPT f=17 TT=0.018 T1=0.01	OPT f=17 TT=3.666 T1=3.65	OPT f=17 TT=17.441 T1=17.43	OPT f=17 TT=0.223 T1=0.66	OPT f=17 TT=0.195 T1=0.14	OPT f=17 TT=0.099 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=251.opb	OPT f=191 TT=0.023 T1=0.02	No data	OPT f=191 TT=0.4 T1=0.39	OPT f=191 TT=0.135 T1=0.13	OPT f=191 TT=0.023 T1=0.02	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=3.336 T1=3.32	OPT f=191 TT=20.776 T1=20.77	OPT f=191 TT=0.884 T1=0.67	OPT f=191 TT=0.445 T1=0.23	OPT f=191 TT=0.506 T1=0.44
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=389.opb	OPT f=191 TT=0.024 T1=0.02	No data	OPT f=191 TT=0.146 T1=0.14	OPT f=191 TT=0.065 T1=0.06	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=2.536 T1=2.53	OPT f=191 TT=4.635 T1=4.62	OPT f=191 TT=18.254 T1=18.24	OPT f=191 TT=0.605 T1=0.67	OPT f=191 TT=0.304 T1=0.16	OPT f=191 TT=0.905 T1=0.84
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=449.opb	OPT f=191 TT=0.024 T1=0.02	No data	OPT f=191 TT=0.072 T1=0.07	OPT f=191 TT=0.05 T1=0.05	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=2.539 T1=2.54	OPT f=191 TT=3.434 T1=3.42	OPT f=191 TT=17.014 T1=17.01	OPT f=191 TT=0.434 T1=0.66	OPT f=191 TT=0.232 T1=0.15	OPT f=191 TT=0.985 T1=0.92
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=509.opb	OPT f=191 TT=0.021 T1=0.02	No data	OPT f=191 TT=0.579 T1=0.57	OPT f=191 TT=0.57 T1=0.57	OPT f=191 TT=0.021 T1=0.02	OPT f=191 TT=2.535 T1=2.53	OPT f=191 TT=4.071 T1=4.06	OPT f=191 TT=16.792 T1=16.78	OPT f=191 TT=0.214 T1=0.66	OPT f=191 TT=0.195 T1=0.14	OPT f=191 TT=1.103 T1=1.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=197-Q=479.opb	OPT f=197 TT=0.019 T1=0.01	No data	OPT f=197 TT=0.136 T1=0.13	OPT f=197 TT=0.346 T1=0.34	OPT f=197 TT=0.019 T1=0.01	OPT f=197 TT=2.535 T1=2.53	OPT f=197 TT=5.181 T1=5.17	OPT f=197 TT=18.528 T1=18.52	OPT f=197 TT=0.383 T1=0.66	OPT f=197 TT=0.355 T1=0.2	OPT f=197 TT=1.1 T1=1.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=211-Q=347.opb	OPT f=211 TT=0.028 T1=0.03	No data	OPT f=211 TT=0.139 T1=0.13	OPT f=211 TT=0.078 T1=0.07	OPT f=211 TT=0.028 T1=0.03	OPT f=211 TT=2.541 T1=2.54	OPT f=211 TT=6.237 T1=6.22	OPT f=211 TT=18.968 T1=18.96	OPT f=211 TT=0.784 T1=0.66	OPT f=211 TT=0.393 T1=0.19	OPT f=211 TT=0.716 T1=0.67
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=211-Q=479.opb	OPT f=211 TT=0.022 T1=0.02	No data	OPT f=211 TT=0.151 T1=0.15	OPT f=211 TT=0.149 T1=0.15	OPT f=211 TT=0.022 T1=0.02	OPT f=211 TT=2.546 T1=2.54	OPT f=211 TT=2.706 T1=2.69	OPT f=211 TT=15.331 T1=15.32	OPT f=211 TT=0.855 T1=0.67	OPT f=211 TT=0.254 T1=0.16	OPT f=211 TT=1.074 T1=1.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=263.opb	OPT f=223 TT=0.024 T1=0.02	No data	OPT f=223 TT=0.73 T1=0.73	OPT f=223 TT=0.644 T1=0.64	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=0.029 T1=0.02	OPT f=223 TT=4.771 T1=4.76	OPT f=223 TT=18.784 T1=18.78	OPT f=223 TT=0.644 T1=0.66	OPT f=223 TT=0.414 T1=0.19	OPT f=223 TT=0.59 T1=0.55
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=307.opb	OPT f=223 TT=0.022 T1=0.02	No data	OPT f=223 TT=0.2 T1=0.2	OPT f=223 TT=0.191 T1=0.19	OPT f=223 TT=0.022 T1=0.02	OPT f=223 TT=2.537 T1=2.53	OPT f=223 TT=5.121 T1=5.11	OPT f=223 TT=17.854 T1=17.84	OPT f=223 TT=0.664 T1=0.66	OPT f=223 TT=0.394 T1=0.23	OPT f=223 TT=0.707 T1=0.73
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=347.opb	OPT f=223 TT=0.023 T1=0.02	No data	OPT f=223 TT=0.491 T1=0.48	OPT f=223 TT=0.489 T1=0.48	OPT f=223 TT=0.023 T1=0.02	OPT f=223 TT=2.536 T1=2.53	OPT f=223 TT=6.351 T1=6.34	OPT f=223 TT=18.483 T1=18.48	OPT f=223 TT=0.794 T1=0.66	OPT f=223 TT=0.384 T1=0.2	OPT f=223 TT=0.82 T1=0.76
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=379.opb	OPT f=223 TT=0.024 T1=0.02	No data	OPT f=223 TT=0.455 T1=0.45	OPT f=223 TT=0.271 T1=0.27	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=2.549 T1=2.54	OPT f=223 TT=5.091 T1=5.14	OPT f=223 TT=19.209 T1=19.2	OPT f=223 TT=0.713 T1=0.67	OPT f=223 TT=0.384 T1=0.21	OPT f=223 TT=0.903 T1=0.84
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=383.opb	OPT f=223 TT=0.027 T1=0.02	No data	OPT f=223 TT=0.519 T1=0.52	OPT f=223 TT=0.305 T1=0.3	OPT f=223 TT=0.027 T1=0.02	OPT f=223 TT=2.541 T1=2.54	OPT f=223 TT=4.732 T1=4.72	OPT f=223 TT=17.756 T1=17.75	OPT f=223 TT=1.746 T1=0.67	OPT f=223 TT=0.354 T1=0.18	OPT f=223 TT=0.832 T1=0.77
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=421.opb	OPT f=223 TT=0.023 T1=0.02	No data	OPT f=223 TT=0.175 T1=0.17	OPT f=223 TT=0.175 T1=0.17	OPT f=223 TT=0.023 T1=0.02	OPT f=223 TT=2.539 T1=2.53	OPT f=223 TT=4.14 T1=4.12	OPT f=223 TT=16.282 T1=16.28	OPT f=223 TT=0.545 T1=0.66	OPT f=223 TT=0.354 T1=0.19	OPT f=223 TT=1.069 T1=1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=431.opb	OPT f=223 TT=0.022 T1=0.02	No data	OPT f=223 TT=0.133 T1=0.13	OPT f=223 TT=0.144 T1=0.14	OPT f=223 TT=0.022 T1=0.02	OPT f=223 TT=2.541 T1=2.54	OPT f=223 TT=6.524 T1=6.51	OPT f=223 TT=19.64 T1=19.63	OPT f=223 TT=0.605 T1=0.66	OPT f=223 TT=0.354 T1=0.2	OPT f=223 TT=0.921 T1=0.86
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=499.opb	OPT f=223 TT=0.024 T1=0.02	No data	OPT f=223 TT=0.238 T1=0.23	OPT f=223 TT=0.35 T1=0.35	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=2.539 T1=2.53	OPT f=223 TT=2.535 T1=2.52	OPT f=223 TT=15.833 T1=15.82	OPT f=223 TT=0.283 T1=0.66	OPT f=223 TT=0.224 T1=0.15	OPT f=223 TT=1.14 T1=1.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=227-Q=383.opb	OPT f=227 TT=0.022 T1=0.02	No data	OPT f=227 TT=0.182 T1=0.18	OPT f=227 TT=0.065 T1=0.06	OPT f=227 TT=0.022 T1=0.02	OPT f=227 TT=2.537 T1=2.53	OPT f=227 TT=5.022 T1=5.03	OPT f=227 TT=19.061 T1=19.05	OPT f=227 TT=0.643 T1=0.66	OPT f=227 TT=0.365 T1=0.2	OPT f=227 TT=0.912 T1=0.83
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=229-Q=239.opb	OPT f=229 TT=0.021 T1=0.02	No data	OPT f=229 TT=0.219 T1=0.22	OPT f=229 TT=0.176 T1=0.17	OPT f=229 TT=0.023 T1=0.02	OPT f=229 TT=0.021 T1=0.02	OPT f=229 TT=5.011 T1=5	OPT f=229 TT=22.418 T1=22.41	OPT f=229 TT=0.725 T1=1.16	OPT f=229 TT=0.426 T1=0.19	OPT f=229 TT=0.681 T1=0.65
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=229-Q=307.opb	OPT f=229 TT=0.022 T1=0.02	No data	OPT f=229 TT=0.375 T1=0.37	OPT f=229 TT=0.448 T1=0.44	OPT f=229 TT=0.022 T1=0.02	OPT f=229 TT=2.539 T1=2.53	OPT f=229 TT=6.3 T1=6.29	OPT f=229 TT=19.802 T1=19.79	OPT f=229 TT=0.784 T1=0.66	OPT f=229 TT=0.405 T1=0.2	OPT f=229 TT=0.832 T1=0.77
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=233-Q=347.opb	OPT f=233 TT=0.02 T1=0.01	No data	OPT f=233 TT=0.901 T1=0.9	OPT f=233 TT=0.918 T1=0.91	OPT f=233 TT=0.02 T1=0.01	OPT f=233 TT=2.535 T1=2.53	OPT f=233 TT=5.68 T1=5.66	OPT f=233 TT=18.299 T1=18.3	OPT f=233 TT=0.753 T1=0.66	OPT f=233 TT=0.394 T1=0.21	OPT f=233 TT=0.945 T1=0.87
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=239-Q=373.opb	OPT f=239 TT=0.025 T1=0.02	No data	OPT f=239 TT=0.22 T1=0.22	OPT f=239 TT=0.116 T1=0.11	OPT f=239 TT=0.025 T1=0.02	OPT f=239 TT=2.541 T1=2.54	OPT f=239 TT=4.713 T1=4.8	OPT f=239 TT=18.567 T1=18.56	OPT f=239 TT=0.623 T1=0.66	OPT f=239 TT=0.374 T1=0.21	OPT f=239 TT=1.062 T1=1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=239-Q=487.opb	OPT f=239 TT=0.023 T1=0.02	No data	OPT f=239 TT=0.061 T1=0.06	OPT f=239 TT=0.064 T1=0.06	OPT f=239 TT=0.023 T1=0.02	OPT f=239 TT=2.54 T1=2.53	OPT f=239 TT=3.512 T1=3.5	OPT f=239 TT=15.964 T1=15.96	OPT f=239 TT=0.614 T1=0.66	OPT f=239 TT=0.235 T1=0.16	OPT f=239 TT=1.142 T1=1.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=23-Q=293.opb	OPT f=23 TT=0.019 T1=0.01	No data	OPT f=23 TT=0.056 T1=0.05	OPT f=23 TT=0.109 T1=0.11	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=2.513 T1=2.5	OPT f=23 TT=17.429 T1=17.42	OPT f=23 TT=0.354 T1=0.66	OPT f=23 TT=0.255 T1=0.16	OPT f=23 TT=0.155 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=23-Q=379.opb	OPT f=23 TT=0.014 T1=0.01	No data	OPT f=23 TT=0.045 T1=0.04	OPT f=23 TT=0.135 T1=0.14	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=0.014 T1=0.01	OPT f=23 TT=2.766 T1=2.75	OPT f=23 TT=19.53 T1=19.52	OPT f=23 TT=0.293 T1=0.68	OPT f=23 TT=0.225 T1=0.15	OPT f=23 TT=0.154 T1=0.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=23-Q=521.opb	UNSAT TT=0.02	No data	UNSAT TT=0.316	UNSAT TT=0.309	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=4.104	UNSAT TT=18.625	UNSAT TT=0.884	UNSAT TT=0.474	UNSAT TT=0.212
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=277.opb	OPT f=251 TT=0.027 T1=0.03	No data	OPT f=251 TT=0.228 T1=0.22	OPT f=251 TT=0.192 T1=0.19	OPT f=251 TT=0.027 T1=0.03	OPT f=251 TT=2.535 T1=2.53	OPT f=251 TT=6.23 T1=6.22	OPT f=251 TT=22.834 T1=22.82	OPT f=251 TT=0.704 T1=0.66	OPT f=251 TT=0.394 T1=0.19	OPT f=251 TT=0.807 T1=0.73
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=307.opb	OPT f=251 TT=0.023 T1=0.02	No data	OPT f=251 TT=0.437 T1=0.43	OPT f=251 TT=0.303 T1=0.3	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=2.534 T1=2.53	OPT f=251 TT=6.55 T1=6.54	OPT f=251 TT=18.66 T1=18.65	OPT f=251 TT=0.733 T1=0.66	OPT f=251 TT=0.414 T1=0.22	OPT f=251 TT=0.76 T1=0.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=331.opb	OPT f=251 TT=0.024 T1=0.02	No data	OPT f=251 TT=0.486 T1=0.48	OPT f=251 TT=0.196 T1=0.19	OPT f=251 TT=0.024 T1=0.02	OPT f=251 TT=2.537 T1=2.53	OPT f=251 TT=5.4 T1=5.5	OPT f=251 TT=18.411 T1=18.4	OPT f=251 TT=0.733 T1=0.66	OPT f=251 TT=0.384 T1=0.2	OPT f=251 TT=0.862 T1=0.78
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=379.opb	OPT f=251 TT=0.023 T1=0.02	No data	OPT f=251 TT=0.366 T1=0.36	OPT f=251 TT=0.278 T1=0.27	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=2.539 T1=2.53	OPT f=251 TT=6.76 T1=6.74	OPT f=251 TT=20.196 T1=20.19	OPT f=251 TT=0.643 T1=0.66	OPT f=251 TT=0.344 T1=0.18	OPT f=251 TT=0.962 T1=0.9
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=419.opb	OPT f=251 TT=0.023 T1=0.02	No data	OPT f=251 TT=0.103 T1=0.1	OPT f=251 TT=0.041 T1=0.04	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=2.538 T1=2.53	OPT f=251 TT=4.238 T1=4.22	OPT f=251 TT=18.269 T1=18.26	OPT f=251 TT=0.543 T1=0.66	OPT f=251 TT=0.333 T1=0.19	OPT f=251 TT=1.053 T1=0.98
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=257-Q=331.opb	OPT f=257 TT=0.021 T1=0.02	No data	OPT f=257 TT=0.881 T1=0.88	OPT f=257 TT=0.525 T1=0.52	OPT f=257 TT=0.021 T1=0.02	OPT f=257 TT=2.537 T1=2.53	OPT f=257 TT=5.327 T1=5.31	OPT f=257 TT=19.274 T1=19.27	OPT f=257 TT=2.603 T1=0.66	OPT f=257 TT=0.395 T1=0.21	OPT f=257 TT=1.008 T1=0.9
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=257-Q=449.opb	OPT f=257 TT=0.019 T1=0.01	No data	OPT f=257 TT=0.065 T1=0.06	OPT f=257 TT=0.106 T1=0.1	OPT f=257 TT=0.019 T1=0.01	OPT f=257 TT=2.54 T1=2.54	OPT f=257 TT=3.289 T1=3.27	OPT f=257 TT=17.148 T1=17.14	OPT f=257 TT=0.554 T1=1.16	OPT f=257 TT=0.345 T1=0.19	OPT f=257 TT=1.081 T1=1.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=257-Q=503.opb	OPT f=257 TT=0.019 T1=0.01	No data	OPT f=257 TT=0.169 T1=0.17	OPT f=257 TT=0.022 T1=0.02	OPT f=257 TT=0.019 T1=0.01	OPT f=257 TT=2.534 T1=2.53	OPT f=257 TT=2.855 T1=2.84	OPT f=257 TT=16.714 T1=16.7	OPT f=257 TT=0.694 T1=1.16	OPT f=257 TT=0.314 T1=0.18	OPT f=257 TT=1.295 T1=1.34
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=263-Q=307.opb	OPT f=263 TT=0.022 T1=0.02	No data	OPT f=263 TT=0.257 T1=0.25	OPT f=263 TT=0.285 T1=0.28	OPT f=263 TT=0.022 T1=0.02	OPT f=263 TT=2.54 T1=2.54	OPT f=263 TT=6.582 T1=6.57	OPT f=263 TT=20.319 T1=20.31	OPT f=263 TT=2.694 T1=0.66	OPT f=263 TT=0.485 T1=0.25	OPT f=263 TT=0.834 T1=0.74
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=263-Q=367.opb	OPT f=263 TT=0.02 T1=0.02	No data	OPT f=263 TT=0.238 T1=0.23	OPT f=263 TT=0.253 T1=0.25	OPT f=263 TT=0.02 T1=0.02	OPT f=263 TT=2.537 T1=2.53	OPT f=263 TT=6.841 T1=6.83	OPT f=263 TT=22.29 T1=22.28	OPT f=263 TT=0.835 T1=0.67	OPT f=263 TT=0.453 T1=0.23	OPT f=263 TT=0.954 T1=0.86
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=269-Q=359.opb	OPT f=269 TT=0.02 T1=0.02	No data	OPT f=269 TT=0.512 T1=0.51	OPT f=269 TT=0.252 T1=0.25	OPT f=269 TT=0.02 T1=0.02	OPT f=269 TT=2.538 T1=2.53	OPT f=269 TT=4.553 T1=4.54	OPT f=269 TT=18.095 T1=18.09	OPT f=269 TT=1.715 T1=1.16	OPT f=269 TT=0.445 T1=0.23	OPT f=269 TT=1.088 T1=1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=269-Q=431.opb	OPT f=269 TT=0.019 T1=0.01	No data	OPT f=269 TT=0.462 T1=0.46	OPT f=269 TT=0.567 T1=0.56	OPT f=269 TT=0.019 T1=0.01	OPT f=269 TT=2.535 T1=2.53	OPT f=269 TT=3.995 T1=3.98	OPT f=269 TT=17.915 T1=17.92	OPT f=269 TT=0.647 T1=1.16	OPT f=269 TT=0.405 T1=0.21	OPT f=269 TT=1.237 T1=1.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=269-Q=433.opb	OPT f=269 TT=0.022 T1=0.02	No data	OPT f=269 TT=0.354 T1=0.35	OPT f=269 TT=0.102 T1=0.1	OPT f=269 TT=0.022 T1=0.02	OPT f=269 TT=2.531 T1=2.53	OPT f=269 TT=3.725 T1=3.71	OPT f=269 TT=18.769 T1=18.76	OPT f=269 TT=0.765 T1=0.67	OPT f=269 TT=0.334 T1=0.19	OPT f=269 TT=1.139 T1=1.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=281-Q=331.opb	OPT f=281 TT=0.02 T1=0.02	No data	OPT f=281 TT=0.45 T1=0.45	OPT f=281 TT=0.322 T1=0.32	OPT f=281 TT=0.02 T1=0.02	OPT f=281 TT=2.538 T1=2.53	OPT f=281 TT=5.259 T1=5.24	OPT f=281 TT=19.077 T1=19.08	OPT f=281 TT=0.784 T1=0.66	OPT f=281 TT=0.395 T1=0.22	OPT f=281 TT=1.08 T1=0.99
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=281-Q=499.opb	OPT f=281 TT=0.018 T1=0.02	No data	OPT f=281 TT=0.07 T1=0.07	OPT f=281 TT=0.066 T1=0.06	OPT f=281 TT=0.018 T1=0.02	OPT f=281 TT=2.535 T1=2.53	OPT f=281 TT=1.798 T1=1.78	OPT f=281 TT=14.255 T1=14.25	OPT f=281 TT=0.435 T1=0.67	OPT f=281 TT=0.224 T1=0.15	OPT f=281 TT=1.283 T1=1.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=283-Q=293.opb	OPT f=283 TT=0.024 T1=0.02	No data	OPT f=283 TT=0.733 T1=0.73	OPT f=283 TT=0.466 T1=0.46	OPT f=283 TT=0.024 T1=0.02	OPT f=283 TT=2.55 T1=2.55	OPT f=283 TT=5.079 T1=5.06	OPT f=283 TT=18.28 T1=18.27	OPT f=283 TT=3.215 T1=1.16	OPT f=283 TT=0.464 T1=0.24	OPT f=283 TT=0.98 T1=0.88
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=293-Q=307.opb	OPT f=293 TT=0.021 T1=0.02	No data	OPT f=293 TT=0.416 T1=0.41	OPT f=293 TT=0.231 T1=0.23	OPT f=293 TT=0.021 T1=0.02	OPT f=293 TT=2.553 T1=2.55	OPT f=293 TT=5.693 T1=5.68	OPT f=293 TT=19.666 T1=19.66	OPT f=293 TT=0.825 T1=1.16	OPT f=293 TT=0.404 T1=0.21	OPT f=293 TT=1.043 T1=0.99
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=163.opb	OPT f=29 TT=0.016 T1=0.01	No data	OPT f=29 TT=0.115 T1=0.11	OPT f=29 TT=0.054 T1=0.05	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.016 T1=0.02	OPT f=29 TT=2.661 T1=2.65	OPT f=29 TT=18.585 T1=18.58	OPT f=29 TT=0.414 T1=0.66	OPT f=29 TT=0.274 T1=0.16	OPT f=29 TT=0.086 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=277.opb	OPT f=29 TT=0.017 T1=0.01	No data	OPT f=29 TT=0.158 T1=0.15	OPT f=29 TT=0.079 T1=0.07	OPT f=29 TT=0.02 T1=0.01	OPT f=29 TT=0.017 T1=0.01	OPT f=29 TT=2.421 T1=2.41	OPT f=29 TT=17.31 T1=17.31	OPT f=29 TT=0.434 T1=0.66	OPT f=29 TT=0.294 T1=0.17	OPT f=29 TT=0.133 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=331.opb	OPT f=29 TT=0.019 T1=0.01	No data	OPT f=29 TT=0.217 T1=0.21	OPT f=29 TT=0.189 T1=0.2	OPT f=29 TT=0.019 T1=0.01	OPT f=29 TT=0.019 T1=0.02	OPT f=29 TT=4.2 T1=4.19	OPT f=29 TT=18.503 T1=18.5	OPT f=29 TT=0.434 T1=0.66	OPT f=29 TT=0.254 T1=0.16	OPT f=29 TT=0.156 T1=0.14
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=409.opb	OPT f=29 TT=0.017 T1=0.01	No data	OPT f=29 TT=0.069 T1=0.07	OPT f=29 TT=0.052 T1=0.05	OPT f=29 TT=0.017 T1=0.01	OPT f=29 TT=0.018 T1=0.02	OPT f=29 TT=2.448 T1=2.43	OPT f=29 TT=16.626 T1=16.62	OPT f=29 TT=0.545 T1=0.66	OPT f=29 TT=0.222 T1=0.16	OPT f=29 TT=0.127 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=479.opb	OPT f=29 TT=0.016 T1=0.01	No data	OPT f=29 TT=0.169 T1=0.16	OPT f=29 TT=0.141 T1=0.14	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.019 T1=0.02	OPT f=29 TT=3.037 T1=3.02	OPT f=29 TT=17.996 T1=18	OPT f=29 TT=0.254 T1=0.67	OPT f=29 TT=0.194 T1=0.15	OPT f=29 TT=0.202 T1=0.19
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=521.opb	UNSAT TT=0.02	No data	UNSAT TT=0.227	UNSAT TT=0.219	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=3.469	UNSAT TT=17.611	UNSAT TT=0.875	UNSAT TT=0.444	UNSAT TT=0.219
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=71.opb	OPT f=29 TT=0.014 T1=0.01	No data	OPT f=29 TT=0.125 T1=0.12	OPT f=29 TT=0.101 T1=0.1	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.014 T1=0.01	OPT f=29 TT=3.052 T1=3.03	OPT f=29 TT=17.781 T1=17.77	OPT f=29 TT=0.534 T1=0.66	OPT f=29 TT=0.274 T1=0.16	OPT f=29 TT=0.065 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=307.opb	OPT f=307 TT=0.022 T1=0.02	No data	OPT f=307 TT=0.099 T1=0.09	OPT f=307 TT=0.077 T1=0.07	OPT f=307 TT=0.022 T1=0.02	OPT f=307 TT=2.544 T1=2.54	OPT f=307 TT=5.813 T1=5.8	OPT f=307 TT=22.498 T1=22.49	OPT f=307 TT=0.865 T1=0.66	OPT f=307 TT=0.494 T1=0.25	OPT f=307 TT=0.949 T1=0.85
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=317.opb	OPT f=307 TT=0.021 T1=0.02	No data	OPT f=307 TT=0.957 T1=0.95	OPT f=307 TT=0.717 T1=0.71	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.547 T1=2.54	OPT f=307 TT=4.78 T1=4.77	OPT f=307 TT=17.403 T1=17.39	OPT f=307 TT=0.904 T1=0.68	OPT f=307 TT=0.474 T1=0.24	OPT f=307 TT=1.102 T1=1.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=331.opb	OPT f=307 TT=0.021 T1=0.02	No data	OPT f=307 TT=0.22 T1=0.21	OPT f=307 TT=0.076 T1=0.07	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.539 T1=2.53	OPT f=307 TT=4.128 T1=4.11	OPT f=307 TT=16.358 T1=16.35	OPT f=307 TT=0.684 T1=0.66	OPT f=307 TT=0.404 T1=0.21	OPT f=307 TT=0.999 T1=0.9
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=347.opb	OPT f=307 TT=0.026 T1=0.02	No data	OPT f=307 TT=0.828 T1=0.82	OPT f=307 TT=0.81 T1=0.81	OPT f=307 TT=0.026 T1=0.02	OPT f=307 TT=2.536 T1=2.53	OPT f=307 TT=4.017 T1=4	OPT f=307 TT=17.7 T1=17.69	OPT f=307 TT=0.905 T1=1.19	OPT f=307 TT=0.434 T1=0.23	OPT f=307 TT=1.034 T1=0.94
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=367.opb	OPT f=307 TT=0.021 T1=0.02	No data	OPT f=307 TT=0.838 T1=0.84	OPT f=307 TT=0.252 T1=0.25	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.539 T1=2.53	OPT f=307 TT=3.907 T1=3.89	OPT f=307 TT=19.846 T1=19.84	OPT f=307 TT=0.784 T1=1.16	OPT f=307 TT=0.456 T1=0.23	OPT f=307 TT=1.155 T1=1.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=431.opb	OPT f=307 TT=0.023 T1=0.02	No data	OPT f=307 TT=0.167 T1=0.16	OPT f=307 TT=0.163 T1=0.16	OPT f=307 TT=0.023 T1=0.02	OPT f=307 TT=2.548 T1=2.54	OPT f=307 TT=2.248 T1=2.23	OPT f=307 TT=15.76 T1=15.76	OPT f=307 TT=1.384 T1=0.66	OPT f=307 TT=0.305 T1=0.18	OPT f=307 TT=1.221 T1=1.16
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=449.opb	OPT f=307 TT=0.021 T1=0.02	No data	OPT f=307 TT=0.4 T1=0.4	OPT f=307 TT=0.276 T1=0.27	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.536 T1=2.53	OPT f=307 TT=2.306 T1=2.29	OPT f=307 TT=16.299 T1=16.29	OPT f=307 TT=0.544 T1=0.66	OPT f=307 TT=0.292 T1=0.17	OPT f=307 TT=1.303 T1=1.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=313-Q=503.opb	OPT f=313 TT=0.019 T1=0.01	No data	OPT f=313 TT=0.153 T1=0.15	OPT f=313 TT=0.116 T1=0.11	OPT f=313 TT=0.019 T1=0.01	OPT f=313 TT=2.541 T1=2.53	OPT f=313 TT=1.94 T1=1.93	OPT f=313 TT=14.968 T1=14.96	OPT f=313 TT=0.393 T1=0.66	OPT f=313 TT=0.224 T1=0.16	OPT f=313 TT=1.268 T1=1.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=317-Q=389.opb	OPT f=317 TT=0.021 T1=0.02	No data	OPT f=317 TT=0.399 T1=0.39	OPT f=317 TT=0.213 T1=0.21	OPT f=317 TT=0.021 T1=0.02	OPT f=317 TT=2.539 T1=2.53	OPT f=317 TT=3.161 T1=3.15	OPT f=317 TT=18.172 T1=18.16	OPT f=317 TT=0.743 T1=1.16	OPT f=317 TT=0.374 T1=0.21	OPT f=317 TT=1.156 T1=1.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=31-Q=439.opb	OPT f=31 TT=0.022 T1=0.02	No data	OPT f=31 TT=0.122 T1=0.12	OPT f=31 TT=0.099 T1=0.09	OPT f=31 TT=0.022 T1=0.02	OPT f=31 TT=0.024 T1=0.02	OPT f=31 TT=4.175 T1=4.16	OPT f=31 TT=17.966 T1=17.96	OPT f=31 TT=0.315 T1=0.66	OPT f=31 TT=0.225 T1=0.15	OPT f=31 TT=0.136 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=331.opb	OPT f=331 TT=0.023 T1=0.02	No data	OPT f=331 TT=0.366 T1=0.36	OPT f=331 TT=0.159 T1=0.15	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=2.542 T1=2.54	OPT f=331 TT=4.345 T1=4.33	OPT f=331 TT=19.956 T1=19.95	OPT f=331 TT=0.844 T1=0.66	OPT f=331 TT=0.404 T1=0.21	OPT f=331 TT=1.106 T1=1.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=347.opb	OPT f=331 TT=0.023 T1=0.02	No data	OPT f=331 TT=0.729 T1=0.73	OPT f=331 TT=0.64 T1=0.63	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=2.54 T1=2.53	OPT f=331 TT=4.268 T1=4.25	OPT f=331 TT=19.869 T1=19.87	OPT f=331 TT=0.825 T1=1.16	OPT f=331 TT=0.453 T1=0.21	OPT f=331 TT=1.119 T1=1.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=359.opb	OPT f=331 TT=0.022 T1=0.02	No data	OPT f=331 TT=0.42 T1=0.41	OPT f=331 TT=0.305 T1=0.3	OPT f=331 TT=0.022 T1=0.02	OPT f=331 TT=2.539 T1=2.53	OPT f=331 TT=2.839 T1=2.82	OPT f=331 TT=16.253 T1=16.24	OPT f=331 TT=0.763 T1=1.17	OPT f=331 TT=0.444 T1=0.22	OPT f=331 TT=1.179 T1=1.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=379.opb	OPT f=331 TT=0.023 T1=0.02	No data	OPT f=331 TT=0.171 T1=0.17	OPT f=331 TT=0.136 T1=0.13	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=2.538 T1=2.53	OPT f=331 TT=3.356 T1=3.34	OPT f=331 TT=15.759 T1=15.75	OPT f=331 TT=0.744 T1=1.16	OPT f=331 TT=0.474 T1=0.24	OPT f=331 TT=1.191 T1=1.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=389.opb	OPT f=331 TT=0.022 T1=0.02	No data	OPT f=331 TT=0.4 T1=0.4	OPT f=331 TT=0.354 T1=0.35	OPT f=331 TT=0.022 T1=0.02	OPT f=331 TT=2.536 T1=2.53	OPT f=331 TT=4.598 T1=4.58	OPT f=331 TT=19.442 T1=19.43	OPT f=331 TT=1.775 T1=1.17	OPT f=331 TT=0.473 T1=0.24	OPT f=331 TT=1.331 T1=1.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=479.opb	OPT f=331 TT=0.021 T1=0.02	No data	OPT f=331 TT=0.067 T1=0.06	OPT f=331 TT=0.031 T1=0.03	OPT f=331 TT=0.021 T1=0.02	OPT f=331 TT=2.533 T1=2.53	OPT f=331 TT=2.085 T1=2.07	OPT f=331 TT=14.639 T1=14.63	OPT f=331 TT=0.604 T1=0.66	OPT f=331 TT=0.324 T1=0.18	OPT f=331 TT=1.197 T1=1.13
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=379.opb	OPT f=347 TT=0.022 T1=0.02	No data	OPT f=347 TT=0.126 T1=0.12	OPT f=347 TT=0.06 T1=0.06	OPT f=347 TT=0.022 T1=0.02	OPT f=347 TT=2.542 T1=2.54	OPT f=347 TT=2.564 T1=2.55	OPT f=347 TT=16.577 T1=16.57	OPT f=347 TT=1.863 T1=0.67	OPT f=347 TT=0.354 T1=0.21	OPT f=347 TT=1.222 T1=1.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=419.opb	OPT f=347 TT=0.023 T1=0.02	No data	OPT f=347 TT=0.187 T1=0.18	OPT f=347 TT=0.154 T1=0.15	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=2.543 T1=2.54	OPT f=347 TT=3.073 T1=3.06	OPT f=347 TT=16.15 T1=16.14	OPT f=347 TT=0.633 T1=0.66	OPT f=347 TT=0.344 T1=0.2	OPT f=347 TT=1.175 T1=1.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=421.opb	OPT f=347 TT=0.023 T1=0.02	No data	OPT f=347 TT=0.077 T1=0.07	OPT f=347 TT=0.053 T1=0.05	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=2.539 T1=2.53	OPT f=347 TT=2.482 T1=2.47	OPT f=347 TT=15.881 T1=15.87	OPT f=347 TT=0.715 T1=0.66	OPT f=347 TT=0.334 T1=0.19	OPT f=347 TT=1.299 T1=1.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=431.opb	OPT f=347 TT=0.023 T1=0.02	No data	OPT f=347 TT=0.181 T1=0.18	OPT f=347 TT=0.132 T1=0.13	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=2.538 T1=2.54	OPT f=347 TT=2.415 T1=2.4	OPT f=347 TT=15.81 T1=15.8	OPT f=347 TT=0.583 T1=0.66	OPT f=347 TT=0.344 T1=0.19	OPT f=347 TT=1.214 T1=1.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=439.opb	OPT f=347 TT=0.02 T1=0.01	No data	OPT f=347 TT=0.283 T1=0.28	OPT f=347 TT=0.243 T1=0.24	OPT f=347 TT=0.02 T1=0.01	OPT f=347 TT=2.537 T1=2.53	OPT f=347 TT=2.236 T1=2.22	OPT f=347 TT=15.604 T1=15.59	OPT f=347 TT=0.564 T1=0.66	OPT f=347 TT=0.335 T1=0.18	OPT f=347 TT=1.213 T1=1.15
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=487.opb	OPT f=347 TT=0.022 T1=0.02	No data	OPT f=347 TT=0.071 T1=0.07	OPT f=347 TT=0.04 T1=0.04	OPT f=347 TT=0.022 T1=0.02	OPT f=347 TT=2.534 T1=2.53	OPT f=347 TT=2.321 T1=2.31	OPT f=347 TT=15.778 T1=15.77	OPT f=347 TT=0.764 T1=0.66	OPT f=347 TT=0.235 T1=0.16	OPT f=347 TT=0.969 T1=1.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=353-Q=479.opb	OPT f=353 TT=0.018 T1=0.01	No data	OPT f=353 TT=0.054 T1=0.05	OPT f=353 TT=0.026 T1=0.02	OPT f=353 TT=0.018 T1=0.01	OPT f=353 TT=2.536 T1=2.53	OPT f=353 TT=2.431 T1=2.42	OPT f=353 TT=15.515 T1=15.5	OPT f=353 TT=0.494 T1=0.66	OPT f=353 TT=0.274 T1=0.17	OPT f=353 TT=1.064 T1=1.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=359-Q=379.opb	OPT f=359 TT=0.023 T1=0.02	No data	OPT f=359 TT=0.267 T1=0.26	OPT f=359 TT=0.179 T1=0.18	OPT f=359 TT=0.023 T1=0.02	OPT f=359 TT=2.541 T1=2.54	OPT f=359 TT=2.829 T1=2.81	OPT f=359 TT=16.803 T1=16.8	OPT f=359 TT=0.694 T1=1.16	OPT f=359 TT=0.375 T1=0.21	OPT f=359 TT=1.232 T1=1.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=367-Q=389.opb	OPT f=367 TT=0.022 T1=0.02	No data	OPT f=367 TT=0.241 T1=0.24	OPT f=367 TT=0.105 T1=0.1	OPT f=367 TT=0.022 T1=0.02	OPT f=367 TT=2.54 T1=2.53	OPT f=367 TT=2.613 T1=2.6	OPT f=367 TT=15.796 T1=15.78	OPT f=367 TT=0.664 T1=0.66	OPT f=367 TT=0.382 T1=0.21	OPT f=367 TT=1.317 T1=1.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=379-Q=397.opb	OPT f=379 TT=0.022 T1=0.02	No data	OPT f=379 TT=0.199 T1=0.19	OPT f=379 TT=0.107 T1=0.1	OPT f=379 TT=0.022 T1=0.02	OPT f=379 TT=2.536 T1=2.53	OPT f=379 TT=2.623 T1=2.61	OPT f=379 TT=16.666 T1=16.65	OPT f=379 TT=0.615 T1=0.67	OPT f=379 TT=0.354 T1=0.18	OPT f=379 TT=1.295 T1=1.22
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=379-Q=431.opb	OPT f=379 TT=0.022 T1=0.02	No data	OPT f=379 TT=0.316 T1=0.31	OPT f=379 TT=0.163 T1=0.16	OPT f=379 TT=0.022 T1=0.02	OPT f=379 TT=2.551 T1=2.55	OPT f=379 TT=3.408 T1=3.39	OPT f=379 TT=17.177 T1=17.16	OPT f=379 TT=0.634 T1=0.66	OPT f=379 TT=0.325 T1=0.2	OPT f=379 TT=1.204 T1=1.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=379-Q=521.opb	UNSAT TT=0.017	No data	UNSAT TT=0.089	UNSAT TT=0.083	UNSAT TT=0.019	UNSAT TT=0.017	UNSAT TT=2.031	UNSAT TT=10.976	UNSAT TT=0.764	UNSAT TT=0.374	UNSAT TT=0.714
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=37-Q=107.opb	OPT f=37 TT=0.015 T1=0.01	No data	OPT f=37 TT=0.074 T1=0.07	OPT f=37 TT=0.042 T1=0.04	OPT f=37 TT=0.016 T1=0.01	OPT f=37 TT=0.015 T1=0.01	OPT f=37 TT=3.002 T1=2.99	OPT f=37 TT=16.75 T1=16.74	OPT f=37 TT=0.524 T1=0.66	OPT f=37 TT=0.274 T1=0.17	OPT f=37 TT=0.1 T1=0.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=37-Q=443.opb	OPT f=37 TT=0.015 T1=0.01	No data	OPT f=37 TT=0.33 T1=0.33	OPT f=37 TT=0.105 T1=0.1	OPT f=37 TT=0.019 T1=0.01	OPT f=37 TT=0.015 T1=0.01	OPT f=37 TT=5.125 T1=5.11	OPT f=37 TT=19.827 T1=19.82	OPT f=37 TT=0.314 T1=0.66	OPT f=37 TT=0.224 T1=0.15	OPT f=37 TT=0.248 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=383-Q=509.opb	OPT f=383 TT=0.019 T1=0.01	No data	OPT f=383 TT=0.076 T1=0.07	OPT f=383 TT=0.078 T1=0.07	OPT f=383 TT=0.019 T1=0.01	OPT f=383 TT=2.53 T1=2.52	OPT f=383 TT=2.232 T1=2.22	OPT f=383 TT=15.583 T1=15.57	OPT f=383 TT=0.215 T1=0.66	OPT f=383 TT=0.193 T1=0.15	OPT f=383 TT=0.708 T1=0.66
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=383-Q=521.opb	UNSAT TT=0.019	No data	UNSAT TT=0.128	UNSAT TT=0.127	UNSAT TT=0.019	UNSAT TT=0.021	UNSAT TT=2.177	UNSAT TT=10.934	UNSAT TT=0.824	UNSAT TT=0.375	UNSAT TT=0.715
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=389-Q=433.opb	OPT f=389 TT=0.021 T1=0.02	No data	OPT f=389 TT=0.165 T1=0.16	OPT f=389 TT=0.102 T1=0.1	OPT f=389 TT=0.021 T1=0.02	OPT f=389 TT=2.542 T1=2.54	OPT f=389 TT=2.627 T1=2.61	OPT f=389 TT=15.065 T1=15.05	OPT f=389 TT=0.694 T1=1.17	OPT f=389 TT=0.354 T1=0.19	OPT f=389 TT=0.987 T1=0.91
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=397-Q=449.opb	OPT f=397 TT=0.019 T1=0.01	No data	OPT f=397 TT=0.111 T1=0.11	OPT f=397 TT=0.103 T1=0.1	OPT f=397 TT=0.019 T1=0.01	OPT f=397 TT=2.536 T1=2.53	OPT f=397 TT=2.296 T1=2.28	OPT f=397 TT=14.75 T1=14.74	OPT f=397 TT=1.833 T1=1.16	OPT f=397 TT=0.334 T1=0.19	OPT f=397 TT=0.975 T1=0.91
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=397-Q=521.opb	UNSAT TT=0.017	No data	UNSAT TT=0.124	UNSAT TT=0.119	UNSAT TT=0.018	UNSAT TT=0.017	UNSAT TT=1.893	UNSAT TT=10.739	UNSAT TT=0.653	UNSAT TT=0.353	UNSAT TT=0.647
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=409-Q=499.opb	OPT f=409 TT=0.016 T1=0.01	No data	OPT f=409 TT=0.044 T1=0.04	OPT f=409 TT=0.027 T1=0.02	OPT f=409 TT=0.019 T1=0.01	OPT f=409 TT=0.016 T1=0.01	OPT f=409 TT=1.942 T1=1.93	OPT f=409 TT=14.948 T1=14.94	OPT f=409 TT=0.345 T1=0.66	OPT f=409 TT=0.233 T1=0.16	OPT f=409 TT=0.711 T1=0.66
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=409-Q=509.opb	OPT f=409 TT=0.016 T1=0.01	No data	OPT f=409 TT=0.056 T1=0.05	OPT f=409 TT=0.022 T1=0.02	OPT f=409 TT=0.017 T1=0.01	OPT f=409 TT=0.016 T1=0.01	OPT f=409 TT=1.778 T1=1.76	OPT f=409 TT=14.729 T1=14.72	OPT f=409 TT=0.256 T1=0.66	OPT f=409 TT=0.204 T1=0.15	OPT f=409 TT=0.616 T1=0.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=41-Q=347.opb	OPT f=41 TT=0.019 T1=0.01	No data	OPT f=41 TT=0.24 T1=0.24	OPT f=41 TT=0.232 T1=0.23	OPT f=41 TT=0.019 T1=0.01	OPT f=41 TT=0.021 T1=0.02	OPT f=41 TT=3.194 T1=3.18	OPT f=41 TT=18.845 T1=18.84	OPT f=41 TT=0.554 T1=0.66	OPT f=41 TT=0.294 T1=0.17	OPT f=41 TT=0.234 T1=0.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=421-Q=449.opb	OPT f=421 TT=0.02 T1=0.01	No data	OPT f=421 TT=0.092 T1=0.09	OPT f=421 TT=0.077 T1=0.07	OPT f=421 TT=0.02 T1=0.01	OPT f=421 TT=2.54 T1=2.54	OPT f=421 TT=2.526 T1=2.51	OPT f=421 TT=14.999 T1=14.99	OPT f=421 TT=0.803 T1=1.17	OPT f=421 TT=0.436 T1=0.23	OPT f=421 TT=0.734 T1=0.66
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=421-Q=487.opb	OPT f=421 TT=0.017 T1=0.01	No data	OPT f=421 TT=0.104 T1=0.1	OPT f=421 TT=0.065 T1=0.06	OPT f=421 TT=0.02 T1=0.02	OPT f=421 TT=0.017 T1=0.01	OPT f=421 TT=1.787 T1=1.77	OPT f=421 TT=14.284 T1=14.28	OPT f=421 TT=1.504 T1=0.66	OPT f=421 TT=0.295 T1=0.18	OPT f=421 TT=0.695 T1=0.65
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=431-Q=503.opb	OPT f=431 TT=0.017 T1=0.01	No data	OPT f=431 TT=0.059 T1=0.06	OPT f=431 TT=0.046 T1=0.04	OPT f=431 TT=0.02 T1=0.01	OPT f=431 TT=0.017 T1=0.01	OPT f=431 TT=1.74 T1=1.72	OPT f=431 TT=14.348 T1=14.34	OPT f=431 TT=0.494 T1=0.66	OPT f=431 TT=0.225 T1=0.15	OPT f=431 TT=0.438 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=439-Q=509.opb	OPT f=439 TT=0.018 T1=0.01	No data	OPT f=439 TT=0.086 T1=0.08	OPT f=439 TT=0.062 T1=0.06	OPT f=439 TT=0.019 T1=0.01	OPT f=439 TT=0.018 T1=0.01	OPT f=439 TT=1.818 T1=1.8	OPT f=439 TT=14.218 T1=14.21	OPT f=439 TT=0.244 T1=0.66	OPT f=439 TT=0.194 T1=0.15	OPT f=439 TT=0.4 T1=0.37
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=43-Q=227.opb	OPT f=43 TT=0.02 T1=0.02	No data	OPT f=43 TT=0.164 T1=0.16	OPT f=43 TT=0.059 T1=0.06	OPT f=43 TT=0.02 T1=0.02	OPT f=43 TT=0.021 T1=0.02	OPT f=43 TT=3.174 T1=3.16	OPT f=43 TT=17.543 T1=17.54	OPT f=43 TT=0.594 T1=0.66	OPT f=43 TT=0.334 T1=0.18	OPT f=43 TT=0.159 T1=0.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=443-Q=487.opb	OPT f=443 TT=0.018 T1=0.01	No data	OPT f=443 TT=0.044 T1=0.04	OPT f=443 TT=0.032 T1=0.03	OPT f=443 TT=0.018 T1=0.01	OPT f=443 TT=0.018 T1=0.01	OPT f=443 TT=1.801 T1=1.78	OPT f=443 TT=14.211 T1=14.2	OPT f=443 TT=0.413 T1=0.66	OPT f=443 TT=0.242 T1=0.17	OPT f=443 TT=0.457 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=449-Q=479.opb	OPT f=449 TT=0.018 T1=0.01	No data	OPT f=449 TT=0.084 T1=0.08	OPT f=449 TT=0.077 T1=0.07	OPT f=449 TT=0.018 T1=0.01	OPT f=449 TT=0.018 T1=0.01	OPT f=449 TT=1.81 T1=1.79	OPT f=449 TT=14.863 T1=14.85	OPT f=449 TT=1.664 T1=1.16	OPT f=449 TT=0.305 T1=0.18	OPT f=449 TT=0.513 T1=0.48
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=197.opb	OPT f=47 TT=0.019 T1=0.01	No data	OPT f=47 TT=0.116 T1=0.11	OPT f=47 TT=0.106 T1=0.1	OPT f=47 TT=0.021 T1=0.02	OPT f=47 TT=0.019 T1=0.01	OPT f=47 TT=5.664 T1=5.65	OPT f=47 TT=19.372 T1=19.36	OPT f=47 TT=0.535 T1=0.66	OPT f=47 TT=0.323 T1=0.19	OPT f=47 TT=0.15 T1=0.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=421.opb	OPT f=47 TT=0.021 T1=0.02	No data	OPT f=47 TT=0.214 T1=0.21	OPT f=47 TT=0.192 T1=0.19	OPT f=47 TT=0.021 T1=0.02	OPT f=47 TT=0.027 T1=0.02	OPT f=47 TT=2.987 T1=2.97	OPT f=47 TT=17.698 T1=17.69	OPT f=47 TT=0.463 T1=0.66	OPT f=47 TT=0.274 T1=0.17	OPT f=47 TT=0.258 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=487.opb	OPT f=47 TT=0.02 T1=0.02	No data	OPT f=47 TT=0.059 T1=0.06	OPT f=47 TT=0.202 T1=0.2	OPT f=47 TT=0.02 T1=0.02	OPT f=47 TT=0.025 T1=0.02	OPT f=47 TT=3.276 T1=3.26	OPT f=47 TT=17.285 T1=17.28	OPT f=47 TT=0.345 T1=0.66	OPT f=47 TT=0.233 T1=0.17	OPT f=47 TT=0.261 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=71.opb	OPT f=47 TT=0.018 T1=0.01	No data	OPT f=47 TT=0.095 T1=0.09	OPT f=47 TT=0.063 T1=0.06	OPT f=47 TT=0.018 T1=0.01	OPT f=47 TT=0.019 T1=0.01	OPT f=47 TT=3.044 T1=3.03	OPT f=47 TT=17.557 T1=17.55	OPT f=47 TT=0.585 T1=1.02	OPT f=47 TT=0.324 T1=0.19	OPT f=47 TT=0.081 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=487-Q=499.opb	OPT f=487 TT=0.016 T1=0.01	No data	OPT f=487 TT=0.041 T1=0.04	OPT f=487 TT=0.024 T1=0.02	OPT f=487 TT=0.018 T1=0.01	OPT f=487 TT=0.016 T1=0.01	OPT f=487 TT=1.676 T1=1.66	OPT f=487 TT=14.5 T1=14.49	OPT f=487 TT=0.394 T1=1.16	OPT f=487 TT=0.245 T1=0.16	OPT f=487 TT=0.185 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=487-Q=503.opb	OPT f=487 TT=0.016 T1=0.01	No data	OPT f=487 TT=0.035 T1=0.03	OPT f=487 TT=0.024 T1=0.02	OPT f=487 TT=0.019 T1=0.01	OPT f=487 TT=0.016 T1=0.01	OPT f=487 TT=1.653 T1=1.64	OPT f=487 TT=14.271 T1=14.26	OPT f=487 TT=0.303 T1=0.66	OPT f=487 TT=0.224 T1=0.15	OPT f=487 TT=0.146 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=127.opb	OPT f=53 TT=0.017 T1=0.01	No data	OPT f=53 TT=0.148 T1=0.14	OPT f=53 TT=0.108 T1=0.1	OPT f=53 TT=0.017 T1=0.01	OPT f=53 TT=0.02 T1=0.02	OPT f=53 TT=3.265 T1=3.25	OPT f=53 TT=17.3 T1=17.29	OPT f=53 TT=2.683 T1=0.68	OPT f=53 TT=0.304 T1=0.17	OPT f=53 TT=0.145 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=151.opb	OPT f=53 TT=0.017 T1=0.01	No data	OPT f=53 TT=0.081 T1=0.08	OPT f=53 TT=0.065 T1=0.06	OPT f=53 TT=0.018 T1=0.01	OPT f=53 TT=0.017 T1=0.01	OPT f=53 TT=3.278 T1=3.26	OPT f=53 TT=18.019 T1=18.01	OPT f=53 TT=0.535 T1=0.66	OPT f=53 TT=0.324 T1=0.18	OPT f=53 TT=0.153 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=191.opb	OPT f=53 TT=0.018 T1=0.01	No data	OPT f=53 TT=0.16 T1=0.15	OPT f=53 TT=0.118 T1=0.11	OPT f=53 TT=0.018 T1=0.01	OPT f=53 TT=0.019 T1=0.01	OPT f=53 TT=4.959 T1=4.94	OPT f=53 TT=20.169 T1=20.16	OPT f=53 TT=2.124 T1=0.66	OPT f=53 TT=0.305 T1=0.18	OPT f=53 TT=0.155 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=97.opb	OPT f=53 TT=0.02 T1=0.02	No data	OPT f=53 TT=0.193 T1=0.19	OPT f=53 TT=0.067 T1=0.06	OPT f=53 TT=0.02 T1=0.02	OPT f=53 TT=0.024 T1=0.02	OPT f=53 TT=3.096 T1=3.08	OPT f=53 TT=17.309 T1=17.3	OPT f=53 TT=0.585 T1=0.66	OPT f=53 TT=0.334 T1=0.19	OPT f=53 TT=0.093 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=131.opb	OPT f=59 TT=0.019 T1=0.02	No data	OPT f=59 TT=0.144 T1=0.14	OPT f=59 TT=0.114 T1=0.11	OPT f=59 TT=0.02 T1=0.02	OPT f=59 TT=0.019 T1=0.02	OPT f=59 TT=3.096 T1=3.08	OPT f=59 TT=17.466 T1=17.46	OPT f=59 TT=0.615 T1=0.66	OPT f=59 TT=0.324 T1=0.19	OPT f=59 TT=0.121 T1=0.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=307.opb	OPT f=59 TT=0.023 T1=0.02	No data	OPT f=59 TT=0.102 T1=0.1	OPT f=59 TT=0.078 T1=0.07	OPT f=59 TT=0.023 T1=0.02	OPT f=59 TT=0.024 T1=0.02	OPT f=59 TT=3.885 T1=3.87	OPT f=59 TT=19.45 T1=19.44	OPT f=59 TT=0.495 T1=0.66	OPT f=59 TT=0.275 T1=0.17	OPT f=59 TT=0.193 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=337.opb	OPT f=59 TT=0.021 T1=0.02	No data	OPT f=59 TT=0.337 T1=0.33	OPT f=59 TT=0.267 T1=0.26	OPT f=59 TT=0.026 T1=0.02	OPT f=59 TT=0.021 T1=0.02	OPT f=59 TT=3.619 T1=3.61	OPT f=59 TT=17.6 T1=17.59	OPT f=59 TT=2.054 T1=0.66	OPT f=59 TT=0.324 T1=0.19	OPT f=59 TT=0.267 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=419.opb	OPT f=59 TT=0.022 T1=0.02	No data	OPT f=59 TT=0.049 T1=0.04	OPT f=59 TT=0.031 T1=0.03	OPT f=59 TT=0.022 T1=0.02	OPT f=59 TT=0.025 T1=0.02	OPT f=59 TT=2.804 T1=2.79	OPT f=59 TT=16.642 T1=16.63	OPT f=59 TT=0.384 T1=0.67	OPT f=59 TT=0.244 T1=0.16	OPT f=59 TT=0.272 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=431.opb	OPT f=59 TT=0.022 T1=0.02	No data	OPT f=59 TT=0.048 T1=0.04	OPT f=59 TT=0.026 T1=0.02	OPT f=59 TT=0.022 T1=0.02	OPT f=59 TT=0.027 T1=0.02	OPT f=59 TT=3.392 T1=3.38	OPT f=59 TT=18.48 T1=18.47	OPT f=59 TT=1.214 T1=0.66	OPT f=59 TT=0.234 T1=0.16	OPT f=59 TT=0.262 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=5-Q=317.opb	OPT f=5 TT=0.013 T1=0.01	No data	OPT f=5 TT=0.098 T1=0.09	OPT f=5 TT=0.079 T1=0.07	OPT f=5 TT=0.013 T1=0.01	OPT f=5 TT=0.013 T1=0.01	OPT f=5 TT=2.064 T1=2.05	OPT f=5 TT=15.816 T1=15.81	OPT f=5 TT=0.224 T1=0.66	OPT f=5 TT=0.204 T1=0.15	OPT f=5 TT=0.078 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=61-Q=163.opb	OPT f=61 TT=0.018 T1=0.01	No data	OPT f=61 TT=0.09 T1=0.09	OPT f=61 TT=0.052 T1=0.05	OPT f=61 TT=0.019 T1=0.01	OPT f=61 TT=0.018 T1=0.01	OPT f=61 TT=4.009 T1=3.99	OPT f=61 TT=21.09 T1=21.08	OPT f=61 TT=0.575 T1=0.66	OPT f=61 TT=0.324 T1=0.18	OPT f=61 TT=0.178 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=61-Q=307.opb	OPT f=61 TT=0.019 T1=0.01	No data	OPT f=61 TT=0.54 T1=0.54	OPT f=61 TT=0.471 T1=0.47	OPT f=61 TT=0.019 T1=0.01	OPT f=61 TT=0.022 T1=0.02	OPT f=61 TT=3.934 T1=3.92	OPT f=61 TT=18.814 T1=18.81	OPT f=61 TT=0.504 T1=0.66	OPT f=61 TT=0.274 T1=0.17	OPT f=61 TT=0.21 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=61-Q=419.opb	OPT f=61 TT=0.02 T1=0.02	No data	OPT f=61 TT=0.165 T1=0.16	OPT f=61 TT=0.172 T1=0.17	OPT f=61 TT=0.02 T1=0.02	OPT f=61 TT=0.028 T1=0.02	OPT f=61 TT=3.407 T1=3.39	OPT f=61 TT=17.45 T1=17.44	OPT f=61 TT=0.494 T1=0.66	OPT f=61 TT=0.262 T1=0.17	OPT f=61 TT=0.306 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=67-Q=191.opb	OPT f=67 TT=0.017 T1=0.01	No data	OPT f=67 TT=0.136 T1=0.13	OPT f=67 TT=0.111 T1=0.11	OPT f=67 TT=0.02 T1=0.02	OPT f=67 TT=0.017 T1=0.01	OPT f=67 TT=5.083 T1=5.07	OPT f=67 TT=20.314 T1=20.31	OPT f=67 TT=0.644 T1=0.66	OPT f=67 TT=0.354 T1=0.2	OPT f=67 TT=0.159 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=67-Q=223.opb	OPT f=67 TT=0.017 T1=0.01	No data	OPT f=67 TT=0.193 T1=0.19	OPT f=67 TT=0.095 T1=0.09	OPT f=67 TT=0.022 T1=0.02	OPT f=67 TT=0.017 T1=0.01	OPT f=67 TT=5.315 T1=5.3	OPT f=67 TT=20.32 T1=20.32	OPT f=67 TT=2.858 T1=0.67	OPT f=67 TT=0.314 T1=0.19	OPT f=67 TT=0.206 T1=0.18
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=71-Q=409.opb	OPT f=71 TT=0.018 T1=0.01	No data	OPT f=71 TT=0.112 T1=0.11	OPT f=71 TT=0.185 T1=0.18	OPT f=71 TT=0.022 T1=0.02	OPT f=71 TT=0.018 T1=0.01	OPT f=71 TT=3.056 T1=3.04	OPT f=71 TT=17.048 T1=17.04	OPT f=71 TT=0.604 T1=0.66	OPT f=71 TT=0.324 T1=0.19	OPT f=71 TT=0.359 T1=0.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=71-Q=461.opb	OPT f=71 TT=0.018 T1=0.01	No data	OPT f=71 TT=0.257 T1=0.25	OPT f=71 TT=0.344 T1=0.34	OPT f=71 TT=0.021 T1=0.02	OPT f=71 TT=0.018 T1=0.01	OPT f=71 TT=4.344 T1=4.33	OPT f=71 TT=17.671 T1=17.67	OPT f=71 TT=0.414 T1=0.67	OPT f=71 TT=0.224 T1=0.15	OPT f=71 TT=0.343 T1=0.31
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=71-Q=491.opb	OPT f=71 TT=0.024 T1=0.02	No data	OPT f=71 TT=0.385 T1=0.38	OPT f=71 TT=0.35 T1=0.35	OPT f=71 TT=0.024 T1=0.02	OPT f=71 TT=0.027 T1=0.02	OPT f=71 TT=3.281 T1=3.27	OPT f=71 TT=18.063 T1=18.05	OPT f=71 TT=0.354 T1=0.66	OPT f=71 TT=0.213 T1=0.14	OPT f=71 TT=0.324 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=73-Q=449.opb	OPT f=73 TT=0.02 T1=0.02	No data	OPT f=73 TT=0.152 T1=0.15	OPT f=73 TT=0.152 T1=0.15	OPT f=73 TT=0.02 T1=0.08	OPT f=73 TT=0.021 T1=0.02	OPT f=73 TT=4.736 T1=4.72	OPT f=73 TT=18.765 T1=18.76	OPT f=73 TT=0.523 T1=0.66	OPT f=73 TT=0.242 T1=0.16	OPT f=73 TT=0.286 T1=0.26
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=137.opb	OPT f=79 TT=0.02 T1=0.02	No data	OPT f=79 TT=0.685 T1=0.68	OPT f=79 TT=0.377 T1=0.37	OPT f=79 TT=0.02 T1=0.02	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=3.979 T1=3.96	OPT f=79 TT=19.088 T1=19.08	OPT f=79 TT=0.774 T1=0.66	OPT f=79 TT=0.333 T1=0.19	OPT f=79 TT=0.16 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=173.opb	OPT f=79 TT=0.019 T1=0.02	No data	OPT f=79 TT=0.194 T1=0.19	OPT f=79 TT=0.16 T1=0.16	OPT f=79 TT=0.021 T1=0.02	OPT f=79 TT=0.019 T1=0.02	OPT f=79 TT=5.725 T1=5.71	OPT f=79 TT=20.407 T1=20.4	OPT f=79 TT=7.423 T1=0.67	OPT f=79 TT=0.354 T1=0.2	OPT f=79 TT=0.208 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=257.opb	OPT f=79 TT=0.02 T1=0.02	No data	OPT f=79 TT=0.213 T1=0.21	OPT f=79 TT=0.172 T1=0.17	OPT f=79 TT=0.02 T1=0.02	OPT f=79 TT=0.022 T1=0.02	OPT f=79 TT=4.648 T1=4.63	OPT f=79 TT=19.627 T1=19.62	OPT f=79 TT=0.766 T1=0.66	OPT f=79 TT=0.374 T1=0.2	OPT f=79 TT=0.27 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=331.opb	OPT f=79 TT=0.023 T1=0.02	No data	OPT f=79 TT=0.16 T1=0.16	OPT f=79 TT=0.148 T1=0.14	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=5.177 T1=5.16	OPT f=79 TT=20.474 T1=20.46	OPT f=79 TT=2.605 T1=0.66	OPT f=79 TT=0.354 T1=0.2	OPT f=79 TT=0.273 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=7-Q=179.opb	OPT f=7 TT=0.013 T1=0.01	No data	OPT f=7 TT=0.053 T1=0.05	OPT f=7 TT=0.036 T1=0.03	OPT f=7 TT=0.014 T1=0.01	OPT f=7 TT=0.013 T1=0.01	OPT f=7 TT=2.162 T1=2.15	OPT f=7 TT=16.08 T1=16.07	OPT f=7 TT=0.302 T1=0.66	OPT f=7 TT=0.224 T1=0.15	OPT f=7 TT=0.052 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=7-Q=223.opb	OPT f=7 TT=0.012 T1=0.01	No data	OPT f=7 TT=0.052 T1=0.05	OPT f=7 TT=0.022 T1=0.02	OPT f=7 TT=0.013 T1=0.01	OPT f=7 TT=0.012 T1=0.01	OPT f=7 TT=2.412 T1=2.4	OPT f=7 TT=16.343 T1=16.33	OPT f=7 TT=0.404 T1=0.66	OPT f=7 TT=0.214 T1=0.15	OPT f=7 TT=0.059 T1=0.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=7-Q=31.opb	OPT f=1 TT=0.008 T1=0	No data	OPT f=1 TT=0.033 T1=0.03	OPT f=1 TT=0.019 T1=0.01	OPT f=1 TT=0.008 T1=0	OPT f=1 TT=0.047 T1=0.04	OPT f=1 TT=1.559 T1=1.55	OPT f=1 TT=13.827 T1=13.82	OPT f=1 TT=0.214 T1=0.66	OPT f=1 TT=0.205 T1=0.14	OPT f=1 TT=0.026 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=197.opb	OPT f=83 TT=0.019 T1=0.01	No data	OPT f=83 TT=0.303 T1=0.3	OPT f=83 TT=0.199 T1=0.2	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.026 T1=0.02	OPT f=83 TT=3.651 T1=3.63	OPT f=83 TT=17.2 T1=17.19	OPT f=83 TT=0.625 T1=0.67	OPT f=83 TT=0.353 T1=0.2	OPT f=83 TT=0.235 T1=0.2
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=271.opb	OPT f=83 TT=0.018 T1=0.01	No data	OPT f=83 TT=0.135 T1=0.13	OPT f=83 TT=0.137 T1=0.13	OPT f=83 TT=0.023 T1=0.02	OPT f=83 TT=0.018 T1=0.01	OPT f=83 TT=4.694 T1=4.68	OPT f=83 TT=18.101 T1=18.1	OPT f=83 TT=0.793 T1=0.66	OPT f=83 TT=0.313 T1=0.18	OPT f=83 TT=0.263 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=367.opb	OPT f=83 TT=0.021 T1=0.02	No data	OPT f=83 TT=0.236 T1=0.23	OPT f=83 TT=0.241 T1=0.24	OPT f=83 TT=0.024 T1=0.02	OPT f=83 TT=0.021 T1=0.02	OPT f=83 TT=3.386 T1=3.37	OPT f=83 TT=17.641 T1=17.64	OPT f=83 TT=0.613 T1=0.66	OPT f=83 TT=0.323 T1=0.18	OPT f=83 TT=0.348 T1=0.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=449.opb	OPT f=83 TT=0.019 T1=0.01	No data	OPT f=83 TT=0.05 T1=0.05	OPT f=83 TT=0.034 T1=0.03	OPT f=83 TT=0.022 T1=0.02	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=4.111 T1=4.1	OPT f=83 TT=18.056 T1=18.05	OPT f=83 TT=0.483 T1=0.66	OPT f=83 TT=0.264 T1=0.16	OPT f=83 TT=0.403 T1=0.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=89.opb	OPT f=83 TT=0.019 T1=0.01	No data	OPT f=83 TT=0.17 T1=0.17	OPT f=83 TT=0.088 T1=0.08	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.021 T1=0.02	OPT f=83 TT=3.865 T1=3.85	OPT f=83 TT=18.082 T1=18.07	OPT f=83 TT=0.684 T1=0.66	OPT f=83 TT=0.373 T1=0.2	OPT f=83 TT=0.149 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=211.opb	OPT f=89 TT=0.02 T1=0.01	No data	OPT f=89 TT=0.178 T1=0.17	OPT f=89 TT=0.128 T1=0.13	OPT f=89 TT=0.02 T1=0.01	OPT f=89 TT=0.023 T1=0.02	OPT f=89 TT=3.887 T1=3.88	OPT f=89 TT=18.358 T1=18.35	OPT f=89 TT=0.724 T1=0.66	OPT f=89 TT=0.365 T1=0.19	OPT f=89 TT=0.269 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=263.opb	OPT f=89 TT=0.02 T1=0.02	No data	OPT f=89 TT=0.176 T1=0.17	OPT f=89 TT=0.105 T1=0.1	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=4.777 T1=4.76	OPT f=89 TT=19.201 T1=19.19	OPT f=89 TT=0.784 T1=0.66	OPT f=89 TT=0.384 T1=0.2	OPT f=89 TT=0.25 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=293.opb	OPT f=89 TT=0.02 T1=0.02	No data	OPT f=89 TT=0.13 T1=0.13	OPT f=89 TT=0.067 T1=0.06	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.023 T1=0.02	OPT f=89 TT=5.191 T1=5.18	OPT f=89 TT=20.358 T1=20.35	OPT f=89 TT=0.774 T1=0.67	OPT f=89 TT=0.335 T1=0.18	OPT f=89 TT=0.305 T1=0.28
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=317.opb	OPT f=89 TT=0.021 T1=0.02	No data	OPT f=89 TT=0.226 T1=0.22	OPT f=89 TT=0.156 T1=0.15	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=0.027 T1=0.02	OPT f=89 TT=3.477 T1=3.46	OPT f=89 TT=17.867 T1=17.86	OPT f=89 TT=2.005 T1=0.67	OPT f=89 TT=0.333 T1=0.18	OPT f=89 TT=0.307 T1=0.27
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=347.opb	OPT f=89 TT=0.021 T1=0.02	No data	OPT f=89 TT=0.166 T1=0.16	OPT f=89 TT=0.158 T1=0.15	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=0.027 T1=0.02	OPT f=89 TT=4.106 T1=4.09	OPT f=89 TT=18.992 T1=18.99	OPT f=89 TT=0.514 T1=0.67	OPT f=89 TT=0.344 T1=0.2	OPT f=89 TT=0.382 T1=0.35
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=431.opb	OPT f=89 TT=0.02 T1=0.02	No data	OPT f=89 TT=0.682 T1=0.68	OPT f=89 TT=0.651 T1=0.65	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=2.851 T1=2.84	OPT f=89 TT=17.059 T1=17.06	OPT f=89 TT=1.165 T1=0.68	OPT f=89 TT=0.264 T1=0.17	OPT f=89 TT=0.436 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=487.opb	OPT f=89 TT=0.02 T1=0.02	No data	OPT f=89 TT=0.186 T1=0.18	OPT f=89 TT=0.167 T1=0.16	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=3.664 T1=3.65	OPT f=89 TT=18.968 T1=18.97	OPT f=89 TT=0.495 T1=0.66	OPT f=89 TT=0.235 T1=0.16	OPT f=89 TT=0.464 T1=0.43
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=331.opb	OPT f=97 TT=0.019 T1=0.01	No data	OPT f=97 TT=0.539 T1=0.53	OPT f=97 TT=0.253 T1=0.25	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.02 T1=0.02	OPT f=97 TT=4.304 T1=4.29	OPT f=97 TT=20.579 T1=20.58	OPT f=97 TT=0.506 T1=0.66	OPT f=97 TT=0.342 T1=0.18	OPT f=97 TT=0.358 T1=0.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=457.opb	OPT f=97 TT=0.019 T1=0.01	No data	OPT f=97 TT=0.141 T1=0.14	OPT f=97 TT=0.1 T1=0.1	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.022 T1=0.02	OPT f=97 TT=2.964 T1=2.95	OPT f=97 TT=16.789 T1=16.78	OPT f=97 TT=0.794 T1=0.67	OPT f=97 TT=0.314 T1=0.19	OPT f=97 TT=0.452 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=479.opb	OPT f=97 TT=0.02 T1=0.01	No data	OPT f=97 TT=0.291 T1=0.29	OPT f=97 TT=0.241 T1=0.24	OPT f=97 TT=0.02 T1=0.01	OPT f=97 TT=0.024 T1=0.02	OPT f=97 TT=6.507 T1=6.49	OPT f=97 TT=20.794 T1=20.79	OPT f=97 TT=0.664 T1=0.66	OPT f=97 TT=0.264 T1=0.17	OPT f=97 TT=0.561 T1=0.52
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=509.opb	OPT f=97 TT=0.019 T1=0.01	No data	OPT f=97 TT=0.189 T1=0.18	OPT f=97 TT=0.155 T1=0.15	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.019 T1=0.02	OPT f=97 TT=1.834 T1=1.82	OPT f=97 TT=17.203 T1=17.2	OPT f=97 TT=0.225 T1=0.66	OPT f=97 TT=0.195 T1=0.14	OPT f=97 TT=0.557 T1=0.52
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-1.opb	OPT f=-30 TT=4.997 T1=4.99	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	OPT f=-30 TT=101.672 T1=101.68	OPT f=-30 TT=4.997 T1=4.99	SAT (TO) f=-22 TT=1800.02 T1=1800.3	OPT f=-30 TT=6.431 T1=6.43	SAT (TO) f=-25 TT=1801.08 T1=639.7	SAT (TO) f=-24 TT=1800.07 T1=0.95	OPT f=-30 TT=19.686 T1=19.62
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-2.opb	OPT f=-30 TT=4.238 T1=4.23	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	OPT f=-30 TT=69.512 T1=69.52	OPT f=-30 TT=4.238 T1=4.23	SAT (TO) f=-19 TT=1800.02 T1=1800.3	OPT f=-30 TT=8.61 T1=8.61	SAT (TO) f=-25 TT=1800.06 T1=426.5	SAT (TO) f=-23 TT=1800.78 T1=0.45	OPT f=-30 TT=45.879 T1=45.82
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-3.opb	OPT f=-30 TT=3.913 T1=4.02	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	OPT f=-30 TT=103.703 T1=103.72	OPT f=-30 TT=12.006 T1=12	SAT (TO) f=-23 TT=1800.02 T1=1800.3	OPT f=-30 TT=3.913 T1=4.02	SAT (TO) f=-25 TT=1800.65 T1=17.14	SAT (TO) f=-24 TT=1800.67 T1=0.53	OPT f=-30 TT=16.267 T1=16.2
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-4.opb	OPT f=-30 TT=7.216 T1=7.21	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	OPT f=-30 TT=82.882 T1=82.9	OPT f=-30 TT=13.487 T1=13.49	SAT (TO) f=-21 TT=1800.02 T1=1800.3	OPT f=-30 TT=7.216 T1=7.21	SAT (TO) f=-25 TT=1800.15 T1=418.63	SAT (TO) f=-23 TT=1800.81 T1=0.62	OPT f=-30 TT=17.235 T1=17.18
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-5.opb	OPT f=-30 TT=2.036 T1=2.03	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	OPT f=-30 TT=74.456 T1=74.47	OPT f=-30 TT=2.036 T1=2.03	SAT (TO) f=-21 TT=1800.02 T1=1800.3	OPT f=-30 TT=3.654 T1=3.65	SAT (TO) f=-25 TT=1800.19 T1=4.12	SAT (TO) f=-24 TT=1800.06 T1=1	OPT f=-30 TT=10.025 T1=9.96
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-1.opb	OPT f=-35 TT=29.507 T1=29.5	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=-35 TT=1800.02 T1=1800.3	OPT f=-35 TT=29.507 T1=29.5	SAT (TO) f=-26 TT=1800.02 T1=1800.3	OPT f=-35 TT=38.138 T1=38.14	SAT (TO) f=-28 TT=1800.16 T1=1.74	SAT (TO) f=-28 TT=1800.83 T1=0.6	OPT f=-35 TT=41.902 T1=41.84
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-2.opb	OPT f=-35 TT=65.593 T1=65.6	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT (TO) f=-34 TT=1800.01 T1=1800.3	OPT f=-35 TT=87.072 T1=87.09	SAT (TO) f=-23 TT=1800.01 T1=1800.3	OPT f=-35 TT=65.593 T1=65.6	SAT (TO) f=-28 TT=1800.16 T1=296.14	SAT (TO) f=-26 TT=1800.08 T1=0.81	OPT f=-35 TT=141.238 T1=141.2
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-3.opb	OPT f=-35 TT=6.397 T1=6.39	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	OPT f=-35 TT=814.887 T1=815.02	OPT f=-35 TT=60.821 T1=60.83	SAT (TO) f=-27 TT=1800.02 T1=1800.3	OPT f=-35 TT=6.397 T1=6.39	SAT (TO) f=-29 TT=1800.68 T1=656.97	SAT (TO) f=-26 TT=1800.94 T1=0.56	OPT f=-35 TT=167.669 T1=167.63
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-4.opb	OPT f=-35 TT=32.806 T1=32.81	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	OPT f=-35 TT=566.819 T1=566.92	OPT f=-35 TT=37.139 T1=37.14	SAT (TO) f=-25 TT=1800.02 T1=1800.3	OPT f=-35 TT=32.806 T1=32.81	SAT (TO) f=-29 TT=1800.09 T1=471.49	SAT (TO) f=-26 TT=1800.06 T1=0.86	OPT f=-35 TT=64.19 T1=64.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-5.opb	OPT f=-35 TT=71.831 T1=71.84	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	OPT f=-35 TT=417.668 T1=417.72	OPT f=-35 TT=174.414 T1=174.43	SAT (TO) f=-24 TT=1800.02 T1=1800.3	OPT f=-35 TT=71.831 T1=71.84	SAT (TO) f=-29 TT=1800.07 T1=535.84	SAT (TO) f=-27 TT=1800.74 T1=0.6	OPT f=-35 TT=356.421 T1=356.41
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-1.opb	OPT f=-40 TT=35.491 T1=35.49	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	OPT f=-40 TT=737.936 T1=738.05	OPT f=-40 TT=140.816 T1=140.84	SAT (TO) f=-30 TT=1800.02 T1=1800.3	OPT f=-40 TT=35.491 T1=35.49	SAT (TO) f=-33 TT=1800.15 T1=8.35	SAT (TO) f=-32 TT=1800.76 T1=0.58	OPT f=-40 TT=129.996 T1=129.95
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-2.opb	OPT f=-40 TT=82.352 T1=82.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	OPT f=-40 TT=1697.66 T1=1697.92	OPT f=-40 TT=168.623 T1=168.65	SAT (TO) f=-27 TT=1800.02 T1=1800.3	OPT f=-40 TT=96.091 T1=96.1	SAT (TO) f=-33 TT=1800.5 T1=254.44	SAT (TO) f=-29 TT=1800.01 T1=0.68	OPT f=-40 TT=82.352 T1=82.3
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-3.opb	OPT f=-40 TT=884.979 T1=885.11	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-38 TT=1800.01 T1=1800.3	SAT (TO) f=-39 TT=1800.11 T1=1800.4	SAT (TO) f=-29 TT=1800.02 T1=1800.3	OPT f=-40 TT=884.979 T1=885.11	SAT (TO) f=-31 TT=1800.87 T1=8.39	SAT (TO) f=-28 TT=1800.02 T1=0.67	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-4.opb	OPT f=-40 TT=35.503 T1=35.45	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT (TO) f=-40 TT=1800.01 T1=1800.3	SAT (TO) f=-40 TT=1800.01 T1=1800.3	SAT (TO) f=-27 TT=1800.02 T1=1800.3	OPT f=-40 TT=151.443 T1=151.46	SAT (TO) f=-32 TT=1800.06 T1=9.87	SAT (TO) f=-30 TT=1800.72 T1=0.7	OPT f=-40 TT=35.503 T1=35.45
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-5.opb	OPT f=-40 TT=39.736 T1=39.74	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=-39 TT=1800.1 T1=1800.4	SAT (TO) f=-39 TT=1800.1 T1=1800.4	SAT (TO) f=-28 TT=1800.02 T1=1800.3	OPT f=-40 TT=39.736 T1=39.74	SAT (TO) f=-32 TT=1800.53 T1=3.34	SAT (TO) f=-30 TT=1800.53 T1=0.61	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-1.opb	SAT f=-44 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=-42 TT=1800.02 T1=1800.3	SAT (TO) f=-44 TT=1800.02 T1=1800.3	SAT (TO) f=-33 TT=1800.02 T1=1800.3	SAT (TO) f=-43 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.14 T1=36.34	SAT (TO) f=-33 TT=1800.46 T1=0.57	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-2.opb	OPT f=-45 TT=1389.77 T1=1389.98	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-42 TT=1800.11 T1=1800.4	OPT f=-45 TT=1389.77 T1=1389.98	SAT (TO) f=-31 TT=1800.01 T1=1800.3	SAT (TO) f=-44 TT=1800.02 T1=1800.3	SAT (TO) f=-36 TT=1800.02 T1=62.39	SAT (TO) f=-33 TT=1800.08 T1=0.89	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-3.opb	SAT f=-44 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=-43 TT=1800.01 T1=1800.3	SAT (TO) f=-44 TT=1800.11 T1=1800.4	SAT (TO) f=-32 TT=1800.02 T1=1800.3	SAT (TO) f=-44 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.66 T1=6.42	SAT (TO) f=-33 TT=1800.65 T1=3.62	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-4.opb	OPT f=-45 TT=474.372 T1=474.44	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-43 TT=1800.1 T1=1800.4	SAT (TO) f=-44 TT=1800.08 T1=1800.4	SAT (TO) f=-31 TT=1800.02 T1=1800.3	OPT f=-45 TT=474.372 T1=474.44	SAT (TO) f=-36 TT=1800.07 T1=60.92	SAT (TO) f=-35 TT=1800.6 T1=0.62	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-5.opb	OPT f=-45 TT=454.793 T1=454.86	No data	? (TO) TT=1800.12	? (TO) TT=1800.11	SAT (TO) f=-42 TT=1800.01 T1=1800.3	SAT (TO) f=-36 TT=1800.1 T1=1800.4	SAT (TO) f=-33 TT=1800.02 T1=1800.3	OPT f=-45 TT=454.793 T1=454.86	SAT (TO) f=-36 TT=1800.01 T1=106.04	SAT (TO) f=-31 TT=1800.48 T1=0.68	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-1.opb	SAT f=-49 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT (TO) f=-47 TT=1800.09 T1=1800.4	SAT (TO) f=-48 TT=1800.1 T1=1800.4	SAT (TO) f=-31 TT=1800.02 T1=1800.3	SAT (TO) f=-49 TT=1800.02 T1=1800.3	SAT (TO) f=-40 TT=1800.6 T1=267.63	SAT (TO) f=-36 TT=1800.05 T1=0.97	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-2.opb	SAT f=-48 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=-47 TT=1800.09 T1=1800.4	SAT (TO) f=-46 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.02 T1=1800.3	SAT (TO) f=-48 TT=1800.03 T1=1800.3	SAT (TO) f=-38 TT=1800.11 T1=39.89	SAT (TO) f=-35 TT=1800.07 T1=0.86	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-3.opb	SAT f=-47 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=-46 TT=1800.03 T1=1800.4	SAT (TO) f=-47 TT=1800.1 T1=1800.4	SAT (TO) f=-35 TT=1800.01 T1=1800.3	SAT (TO) f=-47 TT=1800.02 T1=1800.3	SAT (TO) f=-39 TT=1800.67 T1=531.31	SAT (TO) f=-36 TT=1800.88 T1=0.82	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-4.opb	SAT f=-48 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT (TO) f=-47 TT=1800.08 T1=1800.5	SAT (TO) f=-48 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.01 T1=1800.3	SAT (TO) f=-48 TT=1800.02 T1=1800.3	SAT (TO) f=-39 TT=1800.04 T1=325.98	SAT (TO) f=-37 TT=1800.04 T1=0.78	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-5.opb	SAT f=-48 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-47 TT=1800.09 T1=1800.4	SAT (TO) f=-48 TT=1800.01 T1=1800.3	SAT (TO) f=-37 TT=1800.02 T1=1800.3	SAT (TO) f=-48 TT=1800.02 T1=1800.3	SAT (TO) f=-39 TT=1800.89 T1=136.14	SAT (TO) f=-36 TT=1800.57 T1=0.78	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-1.opb	SAT f=-50 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=-49 TT=1800.09 T1=1800.4	SAT (TO) f=-48 TT=1800.09 T1=1800.4	SAT (TO) f=-36 TT=1800.02 T1=1800.3	SAT (TO) f=-50 TT=1800.02 T1=1800.3	SAT (TO) f=-41 TT=1800.1 T1=15.55	SAT (TO) f=-40 TT=1800.03 T1=0.98	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-2.opb	SAT f=-50 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-50 TT=1800.07 T1=1800.4	SAT (TO) f=-48 TT=1800.1 T1=1800.4	SAT (TO) f=-36 TT=1800.02 T1=1800.3	SAT (TO) f=-50 TT=1800.02 T1=1800.3	SAT (TO) f=-42 TT=1800.53 T1=540.32	SAT (TO) f=-40 TT=1800.01 T1=0.82	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-3.opb	SAT f=-51 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=-50 TT=1800.09 T1=1800.4	SAT (TO) f=-48 TT=1800.03 T1=1800.4	SAT (TO) f=-36 TT=1800.02 T1=1800.3	SAT (TO) f=-51 TT=1800.02 T1=1800.3	SAT (TO) f=-41 TT=1800.12 T1=289.3	SAT (TO) f=-39 TT=1800.09 T1=0.76	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-4.opb	SAT f=-51 TT=1800 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-49 TT=1800.08 T1=1800.4	SAT (TO) f=-48 TT=1800.02 T1=1800.3	SAT (TO) f=-36 TT=1800.02 T1=1800.3	SAT (TO) f=-51 TT=1800 T1=1800.3	SAT (TO) f=-42 TT=1800.13 T1=25.19	SAT (TO) f=-39 TT=1800.67 T1=0.89	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-5.opb	SAT f=-50 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=-50 TT=1800.08 T1=1800.4	SAT (TO) f=-48 TT=1800.07 T1=1800.4	SAT (TO) f=-37 TT=1800.03 T1=1800.3	SAT (TO) f=-50 TT=1800.02 T1=1800.3	SAT (TO) f=-41 TT=1800.93 T1=43.65	SAT (TO) f=-36 TT=1800.01 T1=0.85	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-1.opb	SAT f=-53 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=-50 TT=1800.06 T1=1800.4	SAT (TO) f=-52 TT=1800.09 T1=1800.4	SAT (TO) f=-38 TT=1800.02 T1=1800.3	SAT (TO) f=-53 TT=1800.02 T1=1800.3	SAT (TO) f=-44 TT=1800.19 T1=282.71	SAT (TO) f=-42 TT=1800.03 T1=0.79	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-2.opb	SAT f=-53 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=-52 TT=1800.07 T1=1800.4	SAT (TO) f=-52 TT=1800.05 T1=1800.4	SAT (TO) f=-40 TT=1800.02 T1=1800.3	SAT (TO) f=-53 TT=1800.02 T1=1800.3	SAT (TO) f=-43 TT=1800.07 T1=216.6	SAT (TO) f=-39 TT=1800.08 T1=0.8	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-3.opb	SAT f=-53 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=-50 TT=1800.07 T1=1800.4	SAT (TO) f=-52 TT=1800.09 T1=1800.4	SAT (TO) f=-41 TT=1800.02 T1=1800.3	SAT (TO) f=-53 TT=1800.01 T1=1800.3	SAT (TO) f=-43 TT=1800.23 T1=17.38	SAT (TO) f=-41 TT=1800.78 T1=1.1	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-4.opb	SAT f=-53 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-51 TT=1800.06 T1=1800.4	SAT (TO) f=-52 TT=1800.09 T1=1800.4	SAT (TO) f=-39 TT=1800.03 T1=1800.3	SAT (TO) f=-53 TT=1800.01 T1=1800.3	SAT (TO) f=-44 TT=1800.08 T1=127.17	SAT (TO) f=-40 TT=1800.72 T1=0.92	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-5.opb	SAT f=-53 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT (TO) f=-50 TT=1800.08 T1=1800.4	SAT (TO) f=-52 TT=1800.02 T1=1800.3	SAT (TO) f=-38 TT=1800.02 T1=1800.3	SAT (TO) f=-53 TT=1800.02 T1=1800.3	SAT (TO) f=-43 TT=1800.82 T1=12.17	SAT (TO) f=-41 TT=1800.08 T1=0.97	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-1.opb	SAT f=-55 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=-52 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-41 TT=1800.03 T1=1800.3	SAT (TO) f=-55 TT=1800.02 T1=1800.3	SAT (TO) f=-45 TT=1800.06 T1=65.46	SAT (TO) f=-41 TT=1800.03 T1=0.86	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-2.opb	SAT f=-55 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-53 TT=1800.04 T1=1800.4	SAT (TO) f=0 TT=1800.03 T1=1800.4	SAT (TO) f=-40 TT=1800.02 T1=1800.3	SAT (TO) f=-55 TT=1800.02 T1=1800.3	SAT (TO) f=-46 TT=1800.56 T1=621.19	SAT (TO) f=-41 TT=1800.59 T1=0.93	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-3.opb	SAT f=-55 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=-52 TT=1800.07 T1=1800.5	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-39 TT=1800.03 T1=1800.3	SAT (TO) f=-55 TT=1800.02 T1=1800.3	SAT (TO) f=-45 TT=1800.66 T1=367.32	SAT (TO) f=-43 TT=1800.8 T1=0.89	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-4.opb	SAT f=-55 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=-52 TT=1800.04 T1=1800.4	SAT (TO) f=0 TT=1800.09 T1=1800.4	SAT (TO) f=-41 TT=1800.03 T1=1800.3	SAT (TO) f=-55 TT=1800.03 T1=1800.3	SAT (TO) f=-46 TT=1800.85 T1=77.74	SAT (TO) f=-41 TT=1800.09 T1=0.9	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-5.opb	SAT f=-56 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=-53 TT=1800.06 T1=1800.5	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-37 TT=1800.02 T1=1800.3	SAT (TO) f=-56 TT=1800.02 T1=1800.3	SAT (TO) f=-46 TT=1800.13 T1=77.89	SAT (TO) f=-42 TT=1800.01 T1=0.89	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ss97-2.opb	SAT f=939 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=12910 TT=1800.07 T1=1800.4	SAT (TO) f=939 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1415 TT=1800.12 T1=3.14	SAT (TO) f=2622 TT=1800.99 T1=15.8	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ss97-4.opb	OPT f=813 TT=8.147 T1=8.12	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	OPT f=813 TT=72.865 T1=72.86	OPT f=813 TT=8.147 T1=8.12	OPT f=813 TT=24.91 T1=24.91	OPT f=813 TT=302.427 T1=302.47	SAT (TO) f=814 TT=1800.18 T1=643.98	SAT (TO) f=834 TT=1800.05 T1=0.46	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ss97-6.opb	OPT f=304 TT=0.011 T1=0.01	No data	OPT f=304 TT=0.036 T1=0.03	OPT f=304 TT=0.236 T1=0.23	OPT f=304 TT=0.462 T1=0.46	OPT f=304 TT=0.237 T1=0.23	OPT f=304 TT=0.011 T1=0.01	OPT f=304 TT=0.067 T1=0.06	OPT f=304 TT=1.004 T1=1.17	SAT (TO) f=305 TT=1800.61 T1=0.18	OPT f=304 TT=0.549 T1=0.47
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ws97-5.opb	OPT f=2642 TT=24.6 T1=11.28	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2642 TT=1800.02 T1=1800.3	OPT f=2642 TT=763.001 T1=763.12	SAT (TO) f=10229 TT=1800.02 T1=1800.3	SAT (TO) f=2642 TT=1800.09 T1=1800.4	OPT f=2642 TT=24.6 T1=11.28	SAT (TO) f=2652 TT=1800.02 T1=151.75	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:10:4.5:0.5:100.opb	SAT f=6 TT=1800.02 T1=264.96	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=6 TT=1800.03 T1=1800.3	SAT (TO) f=29 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=6 TT=1800.02 T1=1800.3	SAT (TO) f=6 TT=1800.62 T1=264.96	SAT (TO) f=12 TT=1800.03 T1=0.2	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:10:4.5:0.95:100.opb	SAT f=2 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2 TT=1800.02 T1=1800.3	SAT (TO) f=25 TT=1800.02 T1=1800.3	SAT (TO) f=16 TT=1800.01 T1=1800.3	SAT (TO) f=4 TT=1800.02 T1=1800.3	SAT (TO) f=3 TT=1800.08 T1=1.74	SAT (TO) f=5 TT=1800.74 T1=0.23	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:10:4.5:0.95:98.opb	SAT f=5 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=5 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.01 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	SAT (TO) f=6 TT=1800.01 T1=1800.3	SAT (TO) f=6 TT=1800.74 T1=1.73	SAT (TO) f=8 TT=1800.03 T1=0.2	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:20:4.5:0.5:100.opb	SAT f=11 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=11 TT=1800.02 T1=1800.3	SAT (TO) f=47 TT=1800.02 T1=1800.3	SAT (TO) f=331 TT=1800.02 T1=1800.3	SAT (TO) f=20 TT=1800.01 T1=1800.3	SAT (TO) f=16 TT=1800.09 T1=11.28	SAT (TO) f=19 TT=1800.84 T1=0.25	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:20:4.5:0.95:100.opb	SAT f=13 TT=1800.03 T1=3.31	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=87 TT=1800.02 T1=1800.3	SAT (TO) f=60 TT=1800.01 T1=1800.3	SAT (TO) f=305 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.01 T1=1800.3	SAT (TO) f=13 TT=1800.03 T1=3.31	SAT (TO) f=17 TT=1800 T1=0.26	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:20:4.5:0.95:98.opb	SAT f=21 TT=1800.01 T1=7.8	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=84 TT=1800.01 T1=1800.3	SAT (TO) f=75 TT=1800.02 T1=1800.3	SAT (TO) f=296 TT=1800.02 T1=1800.3	SAT (TO) f=38 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.01 T1=7.8	SAT (TO) f=25 TT=1800.04 T1=0.26	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:30:4.5:0.5:100.opb	SAT f=51 TT=1800.84 T1=0.46	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=837 TT=1800.12 T1=1800.4	SAT (TO) f=456 TT=1800.06 T1=1800.4	SAT (TO) f=1673 TT=1800.02 T1=1800.3	SAT (TO) f=262 TT=1800.07 T1=1800.4	SAT (TO) f=51 TT=1801.44 T1=0.92	SAT (TO) f=51 TT=1800.84 T1=0.46	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:30:4.5:0.95:100.opb	SAT f=69 TT=1800.06 T1=0.43	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=895 TT=1800.07 T1=1800.4	SAT (TO) f=317 TT=1800.08 T1=1800.4	SAT (TO) f=1469 TT=1800.02 T1=1800.3	SAT (TO) f=370 TT=1800.05 T1=1800.4	SAT (TO) f=69 TT=1800.68 T1=0.93	SAT (TO) f=69 TT=1800.06 T1=0.43	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:30:4.5:0.95:98.opb	SAT f=87 TT=1800.05 T1=8.49	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=830 TT=1800.02 T1=1800.3	SAT (TO) f=404 TT=1800.09 T1=1800.4	SAT (TO) f=1435 TT=1800.02 T1=1800.3	SAT (TO) f=351 TT=1800.07 T1=1800.4	SAT (TO) f=87 TT=1800.05 T1=8.49	SAT (TO) f=88 TT=1800.09 T1=0.43	? (TO) TT=1800.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:70:4.5:0.5:100.opb	SAT f=143 TT=1800.15 T1=354.54	No data	? (TO) TT=1800.14	? (TO) TT=1800.04	SAT (TO) f=2274 TT=1800.09 T1=1800.4	SAT (TO) f=1058 TT=1800.04 T1=1800.4	SAT (TO) f=3750 TT=1800.02 T1=1800.3	? TT=78.268	SAT (TO) f=143 TT=1800.15 T1=354.54	SAT (TO) f=146 TT=1800.93 T1=0.63	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:70:4.5:0.95:100.opb	SAT f=135 TT=1800.06 T1=0.63	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1846 TT=1800.08 T1=1800.4	SAT (TO) f=895 TT=1800.06 T1=1800.4	SAT (TO) f=3171 TT=1800.02 T1=1800.3	? TT=79.859	SAT (TO) f=135 TT=1800.06 T1=1.22	SAT (TO) f=135 TT=1800.7 T1=0.63	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:70:4.5:0.95:98.opb	SAT f=203 TT=1800.7 T1=0.62	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=2304 TT=1800.09 T1=1800.4	SAT (TO) f=1329 TT=1800.07 T1=1800.4	SAT (TO) f=3379 TT=1800.1 T1=1800.4	? TT=79.398	SAT (TO) f=203 TT=1800.7 T1=1.23	SAT (TO) f=203 TT=1800.72 T1=0.62	? (TO) TT=1800.01
normalized-PB06/SATUNSAT-BIGINT/ submitted-PB06/manquiho/ Aardal_1/normalized-cuww4.opb	SAT TT=6.644 T1=6.63	No data	No data	No data	SAT TT=6.644 T1=6.63	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.14
normalized-PB06/SATUNSAT-BIGINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob10.opb	SAT TT=17.669 T1=8.16	No data	No data	No data	SAT TT=1246.32 T1=1246.51	SAT TT=204.299 T1=204.32	No data	No data	SAT TT=17.669 T1=8.16	? (TO) TT=1800.08	SAT TT=88.073 T1=87.95
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-cuww1.opb	SAT TT=0.154 T1=0.12	No data	No data	No data	SAT TT=4.149 T1=4.14	? (TO) TT=1800.03	No data	No data	SAT TT=0.163 T1=0.64	SAT TT=0.154 T1=0.12	? (exit code) TT=750.187
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-cuww2.opb	SAT TT=10.799 T1=10.79	No data	No data	No data	SAT TT=10.799 T1=10.79	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800	? (MO) TT=1464.16
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-cuww3.opb	SAT TT=0.696 T1=0.45	No data	No data	No data	SAT TT=7.307 T1=7.3	? (TO) TT=1800.02	No data	No data	SAT TT=2.094 T1=0.64	SAT TT=0.696 T1=0.45	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-cuww5.opb	SAT TT=16.237 T1=16.21	No data	No data	No data	SAT TT=16.237 T1=16.21	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.78	? (TO) TT=1800.07	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob1.opb	SAT TT=36.379 T1=36.38	No data	No data	No data	SAT TT=620.357 T1=620.44	SAT TT=36.379 T1=36.38	No data	No data	SAT TT=415.2 T1=205.73	SAT TT=234.179 T1=233.66	? (TO) TT=1800.15
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob2.opb	SAT TT=23.6 T1=23.28	No data	No data	No data	SAT TT=653.927 T1=654	? (TO) TT=1800.02	No data	No data	SAT TT=69.323 T1=33.23	SAT TT=23.6 T1=23.28	? (TO) TT=1800.14
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob3.opb	UNSAT TT=2.148	No data	No data	No data	UNSAT TT=2.148	? (TO) TT=1800.02	No data	No data	? (TO) TT=1801.11	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob4.opb	SAT TT=63.45 T1=63.18	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	No data	No data	SAT TT=167.499 T1=82.31	SAT TT=63.45 T1=63.18	? (TO) TT=1800.14
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob5.opb	SAT TT=660.511 T1=660.1	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.11	No data	No data	? (TO) TT=1801.1	? (TO) TT=1800.02	SAT TT=660.511 T1=660.1
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob6.opb	SAT TT=405.55 T1=405.18	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	SAT TT=829.43 T1=412.38	SAT TT=405.55 T1=405.18	? (TO) TT=1800.17
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob7.opb	SAT TT=50.85 T1=50.49	No data	No data	No data	SAT TT=657.809 T1=657.87	? (TO) TT=1800.01	No data	No data	SAT TT=132.985 T1=65.17	SAT TT=50.85 T1=50.49	? (TO) TT=1800.19
normalized-PB06/SATUNSAT-MEDINT/ submitted-PB06/manquiho/ Aardal_1/normalized-prob8.opb	SAT TT=238.61 T1=238.26	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	No data	No data	SAT TT=603.563 T1=299.74	SAT TT=238.61 T1=238.26	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-cuww1.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=0.683 T1=0.68	SAT TT=1.042 T1=1.04	SAT TT=143.167 T1=142.72	SAT TT=143.52 T1=143.05	SAT TT=0.494 T1=0.65	SAT TT=0.296 T1=0.55	SAT TT=0.018 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-cuww2.opb	SAT TT=0.096 T1=0.09	SAT TT=0.096 T1=0.09	No data	No data	SAT TT=0.575 T1=0.57	SAT TT=1.837 T1=1.83	SAT TT=189.488 T1=188.97	SAT TT=190.626 T1=190.13	SAT TT=0.789 T1=0.96	SAT TT=0.413 T1=0.21	SAT TT=1.091 T1=1.06
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-cuww3.opb	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.586 T1=0.58	SAT TT=0.841 T1=0.84	SAT TT=123.127 T1=122.58	SAT TT=122.067 T1=121.5	SAT TT=1.503 T1=0.66	SAT TT=0.477 T1=0.64	SAT TT=0.018 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-cuww4.opb	SAT TT=0.014 T1=0.01	SAT TT=0.014 T1=0.01	No data	No data	SAT TT=0.915 T1=0.91	SAT TT=1.006 T1=1	? TT=135.925	? TT=135.765	SAT TT=0.336 T1=0.92	SAT TT=0.239 T1=0.57	SAT TT=0.033 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-cuww5.opb	SAT TT=0.01 T1=0.01	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0.636 T1=0.63	SAT TT=1.038 T1=1.03	? TT=118.733	? TT=119.886	SAT TT=0.504 T1=0.64	SAT TT=0.263 T1=0.16	SAT TT=35.06 T1=35.01
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob10.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=1.305 T1=1.3	SAT TT=1.387 T1=1.38	? TT=95.436	? TT=95.007	SAT TT=0.224 T1=0.64	SAT TT=0.175 T1=0.14	SAT TT=0.024 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob1.opb	SAT TT=0.016 T1=0.01	SAT TT=0.016 T1=0.01	No data	No data	SAT TT=0.883 T1=0.88	SAT TT=1.003 T1=1	? TT=115.345	? TT=107.481	SAT TT=0.234 T1=0.64	SAT TT=0.184 T1=0.14	SAT TT=0.031 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob2.opb	SAT TT=0.025 T1=0.02	SAT TT=0.056 T1=0.05	No data	No data	SAT TT=1.126 T1=1.12	SAT TT=0.551 T1=0.55	? TT=98.648	? TT=101.316	SAT TT=0.265 T1=0.96	SAT TT=0.184 T1=0.15	SAT TT=0.025 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob3.opb	SAT TT=0.025 T1=0.02	SAT TT=0.043 T1=0.04	No data	No data	SAT TT=1.679 T1=1.67	SAT TT=0.599 T1=0.59	? TT=122.692	? TT=120.794	SAT TT=0.414 T1=0.66	SAT TT=0.265 T1=0.59	SAT TT=0.025 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob4.opb	SAT TT=0.018 T1=0.01	SAT TT=0.018 T1=0.01	No data	No data	SAT TT=1.213 T1=1.21	SAT TT=0.947 T1=0.94	? TT=102.572	? TT=102.019	SAT TT=0.304 T1=0.64	SAT TT=0.192 T1=0.15	SAT TT=0.034 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob5.opb	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=1.075 T1=1.07	SAT TT=0.975 T1=0.97	? TT=102.267	? TT=102.372	SAT TT=0.195 T1=0.64	SAT TT=0.163 T1=0.14	SAT TT=0.026 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob6.opb	SAT TT=0.02 T1=0.02	SAT TT=0.02 T1=0.02	No data	No data	SAT TT=1.315 T1=1.31	SAT TT=1.062 T1=1.05	? TT=96.4	? TT=96.399	SAT TT=0.284 T1=0.67	SAT TT=0.194 T1=0.14	SAT TT=0.036 T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob7.opb	SAT TT=0.015 T1=0.01	SAT TT=0.015 T1=0.01	No data	No data	SAT TT=1.199 T1=1.19	SAT TT=1.31 T1=1.3	? TT=100.117	? TT=97.464	SAT TT=0.314 T1=0.64	SAT TT=0.236 T1=0.52	SAT TT=0.02 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ reduced/submitted-PB06/manquiho/ Aardal_1/normalized-reduced-prob8.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=1.615 T1=1.61	SAT TT=1.123 T1=1.12	? TT=98.679	? TT=99.231	SAT TT=0.254 T1=0.92	SAT TT=0.212 T1=0.56	SAT TT=0.03 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_11_pb.cnf.cr.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=4.987	UNSAT TT=0.535	UNSAT TT=1.121	UNSAT TT=1.119	UNSAT TT=0.293	UNSAT TT=86.215	UNSAT TT=505.555
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_15_pb.cnf.cr.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=3.527	UNSAT TT=0.486	UNSAT TT=1.143	UNSAT TT=1.145	UNSAT TT=0.224	UNSAT TT=101.469	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl10_20_pb.cnf.cr.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	UNSAT TT=6.86	UNSAT TT=0.591	UNSAT TT=0.897	UNSAT TT=0.904	UNSAT TT=0.264	UNSAT TT=758.719	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_16_pb.cnf.cr.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.01	UNSAT TT=1523.41	UNSAT TT=691.089	UNSAT TT=689.081	UNSAT TT=0.374	? (TO) TT=1800.01	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_20_pb.cnf.cr.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=522.197	UNSAT TT=415.873	UNSAT TT=417.81	UNSAT TT=0.283	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=551.04	UNSAT TT=332.548	UNSAT TT=331.712	UNSAT TT=0.374	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_21_pb.cnf.cr.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.566	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_25_pb.cnf.cr.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.416	? (TO) TT=1800.66	? (TO) TT=1800.11
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl20_30_pb.cnf.cr.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.443	? (TO) TT=1800.04	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_31_pb.cnf.cr.opb	UNSAT TT=0.016	UNSAT TT=0.016	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=1.035	? (TO) TT=1800.62	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_35_pb.cnf.cr.opb	UNSAT TT=0.017	UNSAT TT=0.017	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.623	? (TO) TT=1800.92	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl30_40_pb.cnf.cr.opb	UNSAT TT=0.018	UNSAT TT=0.018	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=0.635	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_36_pb.cnf.cr.opb	UNSAT TT=0.018	UNSAT TT=0.018	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=1.504	? (TO) TT=1800.94	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_40_pb.cnf.cr.opb	UNSAT TT=0.021	UNSAT TT=0.021	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.824	? (TO) TT=1800.84	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl35_45_pb.cnf.cr.opb	UNSAT TT=0.021	UNSAT TT=0.021	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.883	? (TO) TT=1800.04	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_41_pb.cnf.cr.opb	UNSAT TT=0.021	UNSAT TT=0.021	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=1.563	? (TO) TT=1800.03	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_45_pb.cnf.cr.opb	UNSAT TT=0.023	UNSAT TT=0.023	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=0.963	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl40_50_pb.cnf.cr.opb	UNSAT TT=0.025	UNSAT TT=0.025	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.994	? (TO) TT=1800.72	? (TO) TT=1800.01
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_51_pb.cnf.cr.opb	UNSAT TT=0.029	UNSAT TT=0.029	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1.973	? (TO) TT=1800.03	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_55_pb.cnf.cr.opb	UNSAT TT=0.032	UNSAT TT=0.032	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=1.123	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/ aloul/FPGA_SAT05/normalized-chnl50_60_pb.cnf.cr.opb	UNSAT TT=0.034	UNSAT TT=0.034	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=1.164	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_10_sat_pb.cnf.cr.opb	SAT TT=0.007 T1=0	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0.99 T1=0.98	SAT TT=0.017 T1=0.01	SAT TT=0.007 T1=0	SAT TT=0.007 T1=0	SAT TT=0.564 T1=0.67	SAT TT=0.404 T1=0.24	SAT TT=0.054 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_8_sat_pb.cnf.cr.opb	SAT TT=0.006 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.008 T1=0	SAT TT=0.011 T1=0.01	SAT TT=0.006 T1=0	SAT TT=0.006 T1=0	SAT TT=0.883 T1=0.68	SAT TT=0.423 T1=0.23	SAT TT=0.032 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga10_9_sat_pb.cnf.cr.opb	SAT TT=0.007 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.021 T1=0.02	SAT TT=0.013 T1=0.01	SAT TT=0.007 T1=0	SAT TT=0.008 T1=0	SAT TT=0.895 T1=0.65	SAT TT=0.413 T1=0.22	SAT TT=0.028 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_10_sat_pb.cnf.cr.opb	SAT TT=0.009 T1=0.01	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0.011 T1=0.01	SAT TT=0.014 T1=0.01	SAT TT=0.009 T1=0.01	SAT TT=0.009 T1=0.01	SAT TT=0.683 T1=0.66	SAT TT=0.434 T1=0.25	SAT TT=0.034 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_11_sat_pb.cnf.cr.opb	SAT TT=0.007 T1=0	SAT TT=0.013 T1=0.01	No data	No data	SAT TT=0.027 T1=0.02	SAT TT=0.013 T1=0.01	SAT TT=0.009 T1=0	SAT TT=0.007 T1=0.01	SAT TT=0.943 T1=0.67	SAT TT=0.432 T1=0.25	SAT TT=0.035 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga11_9_sat_pb.cnf.cr.opb	SAT TT=0.006 T1=0	SAT TT=0.013 T1=0.01	No data	No data	SAT TT=0.009 T1=0	SAT TT=0.026 T1=0.02	SAT TT=0.006 T1=0	SAT TT=0.006 T1=0	SAT TT=1.255 T1=0.67	SAT TT=0.423 T1=0.24	SAT TT=0.038 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_10_sat_pb.cnf.cr.opb	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.014 T1=0.01	SAT TT=0.016 T1=0.01	SAT TT=0.021 T1=0.02	SAT TT=0.02 T1=0.02	SAT TT=1.176 T1=0.67	SAT TT=0.484 T1=0.27	SAT TT=0.043 T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_11_sat_pb.cnf.cr.opb	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.011 T1=0.01	SAT TT=0.019 T1=0.02	SAT TT=0.012 T1=0.01	SAT TT=0.011 T1=0.01	SAT TT=1.286 T1=0.68	SAT TT=0.534 T1=0.3	SAT TT=0.097 T1=0.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga12_12_sat_pb.cnf.cr.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=0.18 T1=0.17	SAT TT=0.031 T1=0.03	SAT TT=0.024 T1=0.02	SAT TT=0.027 T1=0.02	SAT TT=1.434 T1=0.68	SAT TT=0.483 T1=0.28	SAT TT=0.065 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_11_sat_pb.cnf.cr.opb	SAT TT=0.007 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.012 T1=0.01	SAT TT=0.016 T1=0.01	SAT TT=0.007 T1=0	SAT TT=0.007 T1=0	SAT TT=1.192 T1=0.68	SAT TT=0.506 T1=0.27	SAT TT=0.036 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_12_sat_pb.cnf.cr.opb	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.016 T1=0.01	SAT TT=0.02 T1=0.02	SAT TT=0.028 T1=0.02	SAT TT=0.028 T1=0.03	SAT TT=0.925 T1=0.69	SAT TT=0.524 T1=0.27	SAT TT=0.124 T1=0.12
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga13_13_sat_pb.cnf.cr.opb	SAT TT=0.011 T1=0.01	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.026 T1=0.02	SAT TT=0.021 T1=0.02	SAT TT=0.024 T1=0.02	SAT TT=0.024 T1=0.02	SAT TT=1.445 T1=0.83	SAT TT=0.495 T1=0.28	SAT TT=0.046 T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_12_sat_pb.cnf.cr.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=0.016 T1=0.01	SAT TT=0.025 T1=0.02	SAT TT=0.021 T1=0.02	SAT TT=0.02 T1=0.02	SAT TT=1.443 T1=0.68	SAT TT=0.543 T1=0.31	SAT TT=0.076 T1=0.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_13_sat_pb.cnf.cr.opb	SAT TT=0.005 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.02 T1=0.02	SAT TT=0.05 T1=0.05	SAT TT=0.005 T1=0.01	SAT TT=0.006 T1=0	SAT TT=1.543 T1=0.69	SAT TT=0.543 T1=0.33	SAT TT=0.083 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga14_14_sat_pb.cnf.cr.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=0.017 T1=0.02	SAT TT=0.025 T1=0.02	SAT TT=0.012 T1=0.02	SAT TT=0.012 T1=0.01	SAT TT=1.065 T1=0.71	SAT TT=0.495 T1=0.27	SAT TT=0.086 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_13_sat_pb.cnf.cr.opb	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=0.02 T1=0.01	SAT TT=0.024 T1=0.02	SAT TT=0.012 T1=0.01	SAT TT=0.012 T1=0.01	SAT TT=1.526 T1=0.7	SAT TT=0.603 T1=0.36	SAT TT=0.128 T1=0.12
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_14_sat_pb.cnf.cr.opb	SAT TT=0.014 T1=0.01	SAT TT=0.014 T1=0.01	No data	No data	SAT TT=0.016 T1=0.01	SAT TT=0.022 T1=0.02	SAT TT=0.024 T1=0.02	SAT TT=0.024 T1=0.02	SAT TT=1.344 T1=0.72	SAT TT=0.583 T1=0.33	SAT TT=0.111 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga15_15_sat_pb.cnf.cr.opb	SAT TT=0.013 T1=0.01	SAT TT=0.013 T1=0.01	No data	No data	SAT TT=0.018 T1=0.01	SAT TT=0.024 T1=0.02	SAT TT=0.017 T1=0.01	SAT TT=0.017 T1=0.01	SAT TT=1.553 T1=0.7	SAT TT=0.604 T1=0.34	SAT TT=0.096 T1=0.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_18_sat_pb.cnf.cr.opb	SAT TT=0.015 T1=0.01	SAT TT=0.015 T1=0.01	No data	No data	SAT TT=0.029 T1=0.02	SAT TT=0.041 T1=0.04	SAT TT=0.037 T1=0.03	SAT TT=0.036 T1=0.03	SAT TT=1.764 T1=0.73	SAT TT=0.664 T1=0.38	SAT TT=0.147 T1=0.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_19_sat_pb.cnf.cr.opb	SAT TT=0.015 T1=0.01	SAT TT=0.015 T1=0.01	No data	No data	SAT TT=0.033 T1=0.03	SAT TT=0.041 T1=0.04	SAT TT=0.043 T1=0.04	SAT TT=0.042 T1=0.04	SAT TT=1.784 T1=0.75	SAT TT=0.823 T1=0.75	SAT TT=0.142 T1=0.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga20_20_sat_pb.cnf.cr.opb	SAT TT=0.014 T1=0.01	SAT TT=0.014 T1=0.01	No data	No data	SAT TT=0.035 T1=0.03	SAT TT=0.045 T1=0.04	SAT TT=0.588 T1=0.68	SAT TT=0.589 T1=0.59	SAT TT=1.753 T1=0.75	SAT TT=0.704 T1=0.38	SAT TT=0.242 T1=0.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_23_sat_pb.cnf.cr.opb	SAT TT=0.018 T1=0.01	SAT TT=0.018 T1=0.01	No data	No data	SAT TT=0.07 T1=0.06	SAT TT=0.062 T1=0.06	SAT TT=0.127 T1=0.12	SAT TT=0.128 T1=0.12	SAT TT=3.623 T1=1.27	SAT TT=0.973 T1=0.63	SAT TT=0.302 T1=0.28
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_24_sat_pb.cnf.cr.opb	SAT TT=0.018 T1=0.01	SAT TT=0.018 T1=0.01	No data	No data	SAT TT=0.07 T1=0.06	SAT TT=0.071 T1=0.07	SAT TT=0.294 T1=0.29	SAT TT=0.3 T1=0.3	SAT TT=3.433 T1=1.28	SAT TT=1.055 T1=0.66	SAT TT=0.427 T1=0.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga25_25_sat_pb.cnf.cr.opb	SAT TT=0.018 T1=0.01	SAT TT=0.018 T1=0.01	No data	No data	SAT TT=0.079 T1=0.07	SAT TT=0.08 T1=0.08	SAT TT=0.054 T1=0.05	SAT TT=0.055 T1=0.05	SAT TT=3.742 T1=1.28	SAT TT=1.174 T1=0.69	SAT TT=0.74 T1=0.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_28_sat_pb.cnf.cr.opb	SAT TT=0.024 T1=0.02	SAT TT=0.024 T1=0.02	No data	No data	SAT TT=0.101 T1=0.1	SAT TT=0.119 T1=0.11	SAT TT=0.985 T1=0.98	SAT TT=0.989 T1=0.99	SAT TT=2.873 T1=1.31	SAT TT=1.123 T1=0.61	SAT TT=0.646 T1=0.6
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_29_sat_pb.cnf.cr.opb	SAT TT=0.023 T1=0.02	SAT TT=0.023 T1=0.02	No data	No data	SAT TT=0.101 T1=0.1	SAT TT=0.105 T1=0.1	SAT TT=0.223 T1=0.22	SAT TT=0.224 T1=0.22	SAT TT=2.563 T1=0.8	SAT TT=1.073 T1=0.61	SAT TT=0.637 T1=0.59
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga30_30_sat_pb.cnf.cr.opb	SAT TT=0.023 T1=0.02	SAT TT=0.023 T1=0.02	No data	No data	SAT TT=0.104 T1=0.1	SAT TT=0.141 T1=0.14	SAT TT=0.522 T1=0.52	SAT TT=0.495 T1=0.49	SAT TT=2.995 T1=1.32	SAT TT=1.133 T1=0.66	SAT TT=0.71 T1=0.65
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_33_sat_pb.cnf.cr.opb	SAT TT=0.032 T1=0.03	SAT TT=0.032 T1=0.03	No data	No data	SAT TT=0.162 T1=0.16	SAT TT=0.202 T1=0.2	SAT TT=1.135 T1=1.13	SAT TT=1.136 T1=1.13	SAT TT=3.203 T1=1.34	SAT TT=1.153 T1=0.56	SAT TT=0.949 T1=0.88
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_34_sat_pb.cnf.cr.opb	SAT TT=0.033 T1=0.03	SAT TT=0.033 T1=0.03	No data	No data	SAT TT=0.213 T1=0.21	SAT TT=0.188 T1=0.18	SAT TT=1.85 T1=1.85	SAT TT=1.817 T1=1.81	SAT TT=7.105 T1=2.86	SAT TT=1.154 T1=0.57	SAT TT=2.07 T1=2.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga35_35_sat_pb.cnf.cr.opb	SAT TT=0.03 T1=0.03	SAT TT=0.03 T1=0.03	No data	No data	SAT TT=0.202 T1=0.2	SAT TT=0.199 T1=0.2	SAT TT=1.842 T1=1.84	SAT TT=1.828 T1=1.82	SAT TT=6.002 T1=2.36	SAT TT=1.143 T1=0.56	SAT TT=1.09 T1=1.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_38_sat_pb.cnf.cr.opb	SAT TT=0.042 T1=0.04	SAT TT=0.042 T1=0.04	No data	No data	SAT TT=0.425 T1=0.42	SAT TT=0.226 T1=0.22	SAT TT=0.572 T1=0.57	SAT TT=0.573 T1=0.57	SAT TT=7.334 T1=2.88	SAT TT=1.655 T1=1	SAT TT=6.158 T1=6.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_39_sat_pb.cnf.cr.opb	SAT TT=0.039 T1=0.03	SAT TT=0.039 T1=0.03	No data	No data	SAT TT=0.288 T1=0.28	SAT TT=0.23 T1=0.23	SAT TT=2.09 T1=2.09	SAT TT=2.169 T1=2.16	SAT TT=7.464 T1=3.4	SAT TT=1.913 T1=1.18	SAT TT=0.984 T1=0.92
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga40_40_sat_pb.cnf.cr.opb	SAT TT=0.04 T1=0.03	SAT TT=0.04 T1=0.03	No data	No data	SAT TT=0.235 T1=0.23	SAT TT=0.241 T1=0.24	SAT TT=5.177 T1=5.17	SAT TT=5.232 T1=5.23	SAT TT=5.882 T1=2.37	SAT TT=1.513 T1=0.88	SAT TT=8.668 T1=8.6
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_43_sat_pb.cnf.cr.opb	SAT TT=0.053 T1=0.05	SAT TT=0.053 T1=0.05	No data	No data	SAT TT=0.384 T1=0.38	SAT TT=0.306 T1=0.3	SAT TT=11.305 T1=11.3	SAT TT=11.246 T1=11.24	SAT TT=8.833 T1=3.47	SAT TT=4.322 T1=3.51	SAT TT=3.14 T1=3.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_44_sat_pb.cnf.cr.opb	SAT TT=0.054 T1=0.05	SAT TT=0.054 T1=0.05	No data	No data	SAT TT=0.374 T1=0.37	SAT TT=0.345 T1=0.34	SAT TT=4.576 T1=4.57	SAT TT=4.533 T1=4.53	SAT TT=7.901 T1=3.42	SAT TT=1.863 T1=1.11	SAT TT=1.079 T1=1.35
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB05/aloul/FPGA_SAT05/ normalized-fpga45_45_sat_pb.cnf.cr.opb	SAT TT=0.05 T1=0.05	SAT TT=0.05 T1=0.05	No data	No data	SAT TT=0.414 T1=0.41	SAT TT=0.326 T1=0.32	SAT TT=19.136 T1=19.14	SAT TT=19.192 T1=19.19	SAT TT=8.922 T1=3.92	SAT TT=2.975 T1=2.21	SAT TT=4.924 T1=4.86
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_1.opb.PB06.opb	SAT TT=1.298 T1=1.29	SAT TT=1.298 T1=1.29	No data	No data	SAT TT=32.15 T1=32.12	SAT TT=20.884 T1=20.88	SAT TT=5.237 T1=5.2	SAT TT=5.335 T1=5.29	SAT TT=6.235 T1=2.97	SAT TT=3.204 T1=2.15	SAT TT=8.723 T1=8.65
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_2.opb.PB06.opb	SAT TT=1.288 T1=1.28	SAT TT=1.288 T1=1.28	No data	No data	SAT TT=12.05 T1=12.02	SAT TT=22.789 T1=22.77	SAT TT=5.436 T1=5.39	SAT TT=5.29 T1=5.25	SAT TT=5.784 T1=2.96	SAT TT=3.173 T1=2.11	SAT TT=8.158 T1=8.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_3.opb.PB06.opb	SAT TT=1.359 T1=1.35	SAT TT=1.359 T1=1.35	No data	No data	SAT TT=12.893 T1=12.86	SAT TT=20.128 T1=20.11	SAT TT=5.336 T1=5.29	SAT TT=5.392 T1=5.35	SAT TT=5.853 T1=2.99	SAT TT=3.262 T1=2.15	SAT TT=8.127 T1=8.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_8.opb.PB06.opb	SAT TT=1.303 T1=1.3	SAT TT=1.303 T1=1.3	No data	No data	SAT TT=12.254 T1=12.22	SAT TT=18.327 T1=18.31	SAT TT=5.239 T1=5.2	SAT TT=5.391 T1=5.35	SAT TT=5.622 T1=3	SAT TT=3.405 T1=2.22	SAT TT=8.341 T1=8.28
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_9.opb.PB06.opb	SAT TT=1.295 T1=1.29	SAT TT=1.295 T1=1.29	No data	No data	SAT TT=18.999 T1=18.98	SAT TT=18.498 T1=18.48	SAT TT=5.464 T1=5.42	SAT TT=5.498 T1=5.45	SAT TT=6.043 T1=2.96	SAT TT=3.331 T1=2.17	SAT TT=8.134 T1=8.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_0.opb.PB06.opb	SAT TT=3.858 T1=3.85	SAT TT=3.858 T1=3.85	No data	No data	SAT TT=38.774 T1=38.72	SAT TT=48.265 T1=48.26	SAT TT=15.902 T1=15.77	SAT TT=16.021 T1=15.89	SAT TT=10.431 T1=6.7	SAT TT=6.784 T1=5.04	SAT TT=28.957 T1=28.83
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_2.opb.PB06.opb	SAT TT=3.843 T1=3.83	SAT TT=3.843 T1=3.83	No data	No data	SAT TT=41.577 T1=41.52	SAT TT=49.406 T1=49.4	SAT TT=15.918 T1=15.79	SAT TT=16.006 T1=15.87	SAT TT=10.652 T1=6.84	SAT TT=7.003 T1=5.16	SAT TT=28.835 T1=28.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_5.opb.PB06.opb	SAT TT=3.853 T1=3.84	SAT TT=3.853 T1=3.84	No data	No data	SAT TT=40.303 T1=40.25	SAT TT=51.523 T1=51.52	SAT TT=25.022 T1=24.89	SAT TT=25.219 T1=25.09	SAT TT=10.452 T1=6.71	SAT TT=6.992 T1=5.28	SAT TT=27.622 T1=27.5
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_6.opb.PB06.opb	SAT TT=3.838 T1=3.84	SAT TT=3.838 T1=3.84	No data	No data	SAT TT=358.88 T1=358.9	SAT TT=49.931 T1=49.92	SAT TT=16.663 T1=16.53	SAT TT=16.825 T1=16.7	SAT TT=10.902 T1=6.73	SAT TT=6.893 T1=5.16	SAT TT=28.265 T1=28.16
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_9.opb.PB06.opb	SAT TT=3.848 T1=3.85	SAT TT=3.848 T1=3.85	No data	No data	SAT TT=90.398 T1=90.36	SAT TT=48.322 T1=48.31	SAT TT=21.775 T1=21.66	SAT TT=22.279 T1=22.17	SAT TT=11.242 T1=6.99	SAT TT=6.874 T1=5.13	SAT TT=27.541 T1=27.41
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_1.opb.PB06.opb	SAT TT=10.088 T1=10.08	SAT TT=10.088 T1=10.08	No data	No data	SAT TT=122.815 T1=122.69	SAT TT=191.102 T1=191.11	SAT TT=71.554 T1=71.28	SAT TT=71.954 T1=71.68	SAT TT=23.48 T1=16.21	SAT TT=14.421 T1=11.35	SAT TT=76.326 T1=75.99
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_3.opb.PB06.opb	SAT TT=9.886 T1=9.89	SAT TT=9.886 T1=9.89	No data	No data	SAT TT=120.58 T1=120.49	SAT TT=213.993 T1=214	SAT TT=71.733 T1=71.4	SAT TT=72.919 T1=72.58	SAT TT=23.021 T1=16.23	SAT TT=14.54 T1=11.43	SAT TT=79.856 T1=79.52
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_5.opb.PB06.opb	SAT TT=9.843 T1=9.83	SAT TT=9.843 T1=9.83	No data	No data	SAT TT=635.732 T1=635.74	SAT TT=185.585 T1=185.58	SAT TT=68.104 T1=67.76	SAT TT=68.915 T1=68.57	SAT TT=23.66 T1=16.82	SAT TT=14.231 T1=11.32	SAT TT=73.049 T1=72.72
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_6.opb.PB06.opb	SAT TT=9.866 T1=9.87	SAT TT=9.866 T1=9.87	No data	No data	SAT TT=511.404 T1=511.38	SAT TT=207.637 T1=207.64	SAT TT=42.76 T1=42.43	SAT TT=43.469 T1=43.19	SAT TT=23.96 T1=16.32	SAT TT=14.532 T1=11.5	SAT TT=73.041 T1=72.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_9.opb.PB06.opb	SAT TT=9.838 T1=9.83	SAT TT=9.838 T1=9.83	No data	No data	SAT TT=130.495 T1=130.37	SAT TT=187.409 T1=187.41	SAT TT=73.898 T1=73.57	SAT TT=75.684 T1=75.36	SAT TT=23.301 T1=16.21	SAT TT=14.472 T1=11.34	SAT TT=72.639 T1=72.3
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/vdw/ normalized-vdw_k3_l5_n550.opb	SAT TT=543.743 T1=543.85	? (TO) TT=1800.01	No data	No data	SAT TT=543.743 T1=543.85	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1801.04	? (TO) TT=1801.17	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/vdw/ normalized-vdw_k3_l6_n1500.opb	SAT TT=3.935 T1=3.93	SAT TT=3.935 T1=3.93	No data	No data	SAT TT=56.938 T1=56.89	SAT TT=64.535 T1=64.53	SAT TT=4.356 T1=4.94	SAT TT=4.413 T1=4.4	SAT TT=8.824 T1=7.16	SAT TT=7.294 T1=5.98	SAT TT=29.877 T1=29.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/vdw/ normalized-vdw_k4_l4_n360.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.7	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/vdw/ normalized-vdw_k5_l4_n750.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.73	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/liu/vdw/ normalized-vdw_k6_l3_n170.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.64	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900544463.opb	SAT TT=0.031 T1=0.03	SAT TT=4.535 T1=4.53	No data	No data	SAT TT=3.802 T1=3.8	SAT TT=0.148 T1=0.14	SAT TT=0.031 T1=0.03	SAT TT=0.032 T1=0.03	SAT TT=1.912 T1=0.82	SAT TT=2.705 T1=1.85	SAT TT=7.381 T1=7.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900544484.opb	UNSAT TT=1.687	UNSAT TT=1.687	No data	No data	UNSAT TT=2.258	UNSAT TT=4.445	UNSAT TT=5.642	UNSAT TT=5.664	UNSAT TT=10.083	UNSAT TT=4.882	UNSAT TT=10.121
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900545610.opb	UNSAT TT=4.713	UNSAT TT=13.259	No data	No data	UNSAT TT=6.296	UNSAT TT=17.52	UNSAT TT=17.793	UNSAT TT=17.863	UNSAT TT=8.942	UNSAT TT=4.713	UNSAT TT=12.649
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900546076.opb	UNSAT TT=0.72	UNSAT TT=1.486	No data	No data	UNSAT TT=0.761	UNSAT TT=0.72	UNSAT TT=1.18	UNSAT TT=1.188	UNSAT TT=6.584	UNSAT TT=2.044	UNSAT TT=2.567
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900546417.opb	UNSAT TT=1.472	UNSAT TT=1.472	No data	No data	UNSAT TT=11.941	UNSAT TT=2.636	UNSAT TT=15.999	UNSAT TT=16.032	UNSAT TT=7.974	UNSAT TT=4.801	UNSAT TT=9.851
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547334.opb	SAT TT=0.3 T1=0.29	SAT TT=1.353 T1=1.35	No data	No data	SAT TT=1.681 T1=1.68	SAT TT=0.3 T1=0.29	SAT TT=0.36 T1=0.36	SAT TT=0.36 T1=0.36	SAT TT=8.773 T1=2.88	SAT TT=0.993 T1=0.54	SAT TT=24.623 T1=24.57
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547353.opb	SAT TT=0.07 T1=0.07	SAT TT=0.472 T1=0.47	No data	No data	SAT TT=3.963 T1=3.96	SAT TT=0.127 T1=0.12	SAT TT=0.072 T1=0.07	SAT TT=0.07 T1=0.07	SAT TT=3.708 T1=1.73	SAT TT=1.825 T1=1.14	SAT TT=3.777 T1=3.72
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547389.opb	UNSAT TT=3.379	UNSAT TT=3.379	No data	No data	UNSAT TT=7.095	UNSAT TT=22.765	UNSAT TT=30.856	UNSAT TT=31.455	UNSAT TT=5.464	UNSAT TT=14.311	UNSAT TT=7.536
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547416.opb	SAT TT=0.118 T1=0.11	SAT TT=0.55 T1=0.54	No data	No data	SAT TT=4.259 T1=4.25	SAT TT=0.858 T1=0.85	SAT TT=0.118 T1=0.11	SAT TT=0.118 T1=0.11	SAT TT=1.753 T1=0.82	SAT TT=19.1 T1=17.79	SAT TT=9.754 T1=9.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547427.opb	SAT TT=0.094 T1=0.09	SAT TT=0.094 T1=0.09	No data	No data	SAT TT=3.563 T1=3.56	SAT TT=0.141 T1=0.14	SAT TT=0.16 T1=0.16	SAT TT=0.16 T1=0.16	SAT TT=1.147 T1=0.89	SAT TT=3.002 T1=1.83	SAT TT=6.498 T1=6.43
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547461.opb	SAT TT=0.186 T1=0.18	SAT TT=2.471 T1=2.47	No data	No data	SAT TT=2.129 T1=2.12	SAT TT=0.769 T1=0.76	SAT TT=0.186 T1=0.18	SAT TT=0.188 T1=0.18	SAT TT=2.274 T1=0.84	SAT TT=2.633 T1=1.65	SAT TT=5.669 T1=5.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900548667.opb	UNSAT TT=12.496	UNSAT TT=12.496	No data	No data	UNSAT TT=56.361	UNSAT TT=74.016	UNSAT TT=71.029	UNSAT TT=71.024	UNSAT TT=25.72	UNSAT TT=38.208	UNSAT TT=134.99
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900549974.opb	SAT TT=0.401 T1=0.4	SAT TT=2.124 T1=2.12	No data	No data	SAT TT=13.135 T1=13.13	SAT TT=0.401 T1=0.4	SAT TT=0.558 T1=0.55	SAT TT=0.559 T1=0.55	SAT TT=9.384 T1=3.34	SAT TT=23.378 T1=21.93	SAT TT=25.375 T1=25.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900550006.opb	UNSAT TT=4.775	UNSAT TT=4.775	No data	No data	UNSAT TT=33.329	UNSAT TT=36.32	UNSAT TT=39.524	UNSAT TT=40.143	UNSAT TT=8.532	UNSAT TT=7.282	UNSAT TT=23.349
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900550720.opb	UNSAT TT=1.375	UNSAT TT=1.375	No data	No data	UNSAT TT=10.782	UNSAT TT=27.125	UNSAT TT=27.703	UNSAT TT=27.879	UNSAT TT=10.473	UNSAT TT=17.641	UNSAT TT=21.694
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900551347.opb	UNSAT TT=2.102	UNSAT TT=8.029	No data	No data	UNSAT TT=2.102	UNSAT TT=2.498	UNSAT TT=3.671	UNSAT TT=3.645	UNSAT TT=6.403	UNSAT TT=5.773	UNSAT TT=3.25
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900551864.opb	UNSAT TT=1.16	UNSAT TT=1.16	No data	No data	UNSAT TT=7.621	UNSAT TT=1.281	UNSAT TT=4.705	UNSAT TT=4.744	UNSAT TT=5.883	UNSAT TT=3.994	UNSAT TT=4.38
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552288.opb	UNSAT TT=2.096	UNSAT TT=16.696	No data	No data	UNSAT TT=2.096	UNSAT TT=20.153	UNSAT TT=10.129	UNSAT TT=10.049	UNSAT TT=5.65	UNSAT TT=4.655	UNSAT TT=6.25
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552311.opb	SAT TT=0.076 T1=0.07	SAT TT=1.197 T1=1.19	No data	No data	SAT TT=2.03 T1=2.02	SAT TT=0.076 T1=0.07	SAT TT=0.186 T1=0.18	SAT TT=0.185 T1=0.18	SAT TT=5.54 T1=1.83	SAT TT=0.873 T1=0.43	SAT TT=1.782 T1=1.72
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552423.opb	UNSAT TT=0.196	UNSAT TT=2.616	No data	No data	UNSAT TT=0.302	UNSAT TT=0.196	UNSAT TT=0.291	UNSAT TT=0.293	UNSAT TT=3.713	UNSAT TT=1.504	UNSAT TT=1.632
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552735.opb	UNSAT TT=1.564	UNSAT TT=248.231	No data	No data	UNSAT TT=5.214	UNSAT TT=3.9	UNSAT TT=1.564	UNSAT TT=1.574	UNSAT TT=6.803	UNSAT TT=5.073	UNSAT TT=5.434
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553606.opb	SAT TT=0.069 T1=0.06	SAT TT=1.419 T1=1.41	No data	No data	SAT TT=0.666 T1=0.66	SAT TT=0.069 T1=0.06	SAT TT=0.91 T1=0.91	SAT TT=0.913 T1=0.91	SAT TT=1.564 T1=0.83	SAT TT=0.785 T1=0.39	SAT TT=2.223 T1=2.17
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553644.opb	SAT TT=0.024 T1=0.02	SAT TT=0.09 T1=0.09	No data	No data	SAT TT=1.603 T1=1.6	SAT TT=0.114 T1=0.11	SAT TT=0.025 T1=0.02	SAT TT=0.024 T1=0.02	SAT TT=3.685 T1=1.69	SAT TT=3.462 T1=2.15	SAT TT=0.242 T1=0.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553647.opb	UNSAT TT=3.454	UNSAT TT=3.454	No data	No data	UNSAT TT=7.568	UNSAT TT=17.561	UNSAT TT=13.092	UNSAT TT=13.097	UNSAT TT=9.093	UNSAT TT=10.902	UNSAT TT=8.867
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553812.opb	UNSAT TT=1.104	UNSAT TT=1.104	No data	No data	UNSAT TT=1.735	UNSAT TT=3.284	UNSAT TT=2.394	UNSAT TT=2.416	UNSAT TT=5.963	UNSAT TT=3.373	UNSAT TT=4.649
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554067.opb	SAT TT=0.146 T1=0.14	SAT TT=0.146 T1=0.14	No data	No data	SAT TT=6.404 T1=6.4	SAT TT=0.455 T1=0.45	SAT TT=0.156 T1=0.15	SAT TT=0.155 T1=0.15	SAT TT=2.094 T1=0.83	SAT TT=2.355 T1=1.64	SAT TT=5.535 T1=5.77
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554072.opb	UNSAT TT=3.233	UNSAT TT=7.277	No data	No data	UNSAT TT=4.461	UNSAT TT=4.067	UNSAT TT=6.173	UNSAT TT=6.206	UNSAT TT=6.203	UNSAT TT=3.233	UNSAT TT=4.155
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554154.opb	SAT TT=0.076 T1=0.08	SAT TT=0.076 T1=0.08	No data	No data	SAT TT=3.563 T1=3.56	SAT TT=0.947 T1=0.94	SAT TT=0.137 T1=0.13	SAT TT=0.138 T1=0.13	SAT TT=7.832 T1=2.83	SAT TT=2.104 T1=1.49	SAT TT=20.486 T1=20.43
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554373.opb	SAT TT=0.028 T1=0.02	SAT TT=0.738 T1=0.73	No data	No data	SAT TT=9.805 T1=9.81	SAT TT=0.28 T1=0.28	SAT TT=0.029 T1=0.02	SAT TT=0.028 T1=0.03	SAT TT=5.384 T1=1.84	SAT TT=4.953 T1=3.55	SAT TT=5.421 T1=5.36
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554375.opb	SAT TT=0.142 T1=0.14	SAT TT=0.446 T1=0.44	No data	No data	SAT TT=1.877 T1=1.87	SAT TT=0.528 T1=0.52	SAT TT=0.142 T1=0.14	SAT TT=0.153 T1=0.15	SAT TT=1.734 T1=0.84	SAT TT=2.535 T1=1.45	SAT TT=6.016 T1=5.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554389.opb	SAT TT=0.078 T1=0.08	SAT TT=0.078 T1=0.08	No data	No data	SAT TT=1.247 T1=1.25	SAT TT=0.205 T1=0.2	SAT TT=0.088 T1=0.08	SAT TT=0.09 T1=0.09	SAT TT=5.725 T1=1.9	SAT TT=1.444 T1=0.9	SAT TT=3.105 T1=3.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554420.opb	UNSAT TT=2.376	UNSAT TT=17.742	No data	No data	UNSAT TT=6.36	UNSAT TT=2.376	UNSAT TT=4.703	UNSAT TT=4.716	UNSAT TT=5.292	UNSAT TT=4.143	UNSAT TT=5.733
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900556231.opb	UNSAT TT=3.465	UNSAT TT=4.156	No data	No data	UNSAT TT=4.334	UNSAT TT=4.359	UNSAT TT=15.689	UNSAT TT=15.75	UNSAT TT=5.892	UNSAT TT=3.465	UNSAT TT=16.212
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557362.opb	UNSAT TT=0.86	UNSAT TT=2.493	No data	No data	UNSAT TT=0.975	UNSAT TT=1.676	UNSAT TT=0.862	UNSAT TT=0.86	UNSAT TT=5.272	UNSAT TT=3.732	UNSAT TT=2.293
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557413.opb	SAT TT=0.185 T1=0.18	SAT TT=0.837 T1=0.83	No data	No data	SAT TT=4.181 T1=4.26	SAT TT=0.321 T1=0.32	SAT TT=0.185 T1=0.18	SAT TT=0.199 T1=0.2	SAT TT=4.104 T1=1.35	SAT TT=5.923 T1=4.88	SAT TT=2.758 T1=2.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557568.opb	SAT TT=0.019 T1=0.01	SAT TT=0.262 T1=0.26	No data	No data	SAT TT=2.582 T1=2.58	SAT TT=0.125 T1=0.12	SAT TT=0.019 T1=0.01	SAT TT=0.02 T1=0.02	SAT TT=3.822 T1=1.35	SAT TT=3.304 T1=2.84	SAT TT=7.54 T1=7.48
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557574.opb	UNSAT TT=0.732	UNSAT TT=25.73	No data	No data	UNSAT TT=3.959	UNSAT TT=0.732	UNSAT TT=1.914	UNSAT TT=1.917	UNSAT TT=6.894	UNSAT TT=2.193	UNSAT TT=3.244
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557957.opb	UNSAT TT=1.124	UNSAT TT=1.276	No data	No data	UNSAT TT=1.124	UNSAT TT=4.768	UNSAT TT=2.774	UNSAT TT=2.79	UNSAT TT=6.173	UNSAT TT=4.312	UNSAT TT=10.048
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900558106.opb	UNSAT TT=0.424	UNSAT TT=0.465	No data	No data	UNSAT TT=3.287	UNSAT TT=0.589	UNSAT TT=0.424	UNSAT TT=0.452	UNSAT TT=3.852	UNSAT TT=1.514	UNSAT TT=1.581
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900558739.opb	UNSAT TT=2.78	UNSAT TT=2.78	No data	No data	UNSAT TT=13.563	UNSAT TT=22.947	UNSAT TT=15.916	UNSAT TT=15.949	UNSAT TT=10.272	UNSAT TT=8.403	UNSAT TT=11.454
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559365.opb	SAT TT=0.015 T1=0.01	SAT TT=0.641 T1=0.64	No data	No data	SAT TT=0.237 T1=0.23	SAT TT=0.928 T1=0.92	SAT TT=0.016 T1=0.01	SAT TT=0.015 T1=0.01	SAT TT=5.56 T1=1.83	SAT TT=6.035 T1=4.68	SAT TT=0.793 T1=0.76
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559416.opb	SAT TT=0.133 T1=0.13	SAT TT=2.51 T1=2.51	No data	No data	SAT TT=11.38 T1=11.38	SAT TT=0.133 T1=0.13	SAT TT=1.506 T1=1.5	SAT TT=1.513 T1=1.51	SAT TT=5.243 T1=1.84	SAT TT=6.983 T1=5.72	SAT TT=3.991 T1=3.94
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559641.opb	SAT TT=0.014 T1=0.01	SAT TT=1.768 T1=1.76	No data	No data	SAT TT=2.219 T1=2.21	SAT TT=0.417 T1=0.41	SAT TT=0.014 T1=0.01	SAT TT=0.014 T1=0.01	SAT TT=6.692 T1=2.34	SAT TT=1.143 T1=0.65	SAT TT=5.794 T1=5.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559676.opb	UNSAT TT=3.036	UNSAT TT=3.036	No data	No data	UNSAT TT=27.189	UNSAT TT=49.232	UNSAT TT=37.29	UNSAT TT=37.424	UNSAT TT=14.303	UNSAT TT=20.41	UNSAT TT=23.727
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561288.opb	UNSAT TT=2.835	UNSAT TT=2.835	No data	No data	UNSAT TT=52.052	UNSAT TT=70.087	UNSAT TT=73.553	UNSAT TT=75.452	UNSAT TT=29.42	UNSAT TT=23.7	UNSAT TT=64.206
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561384.opb	SAT TT=0.017 T1=0.01	SAT TT=0.544 T1=0.54	No data	No data	SAT TT=5.891 T1=5.94	SAT TT=0.093 T1=0.09	SAT TT=0.017 T1=0.01	SAT TT=0.017 T1=0.01	SAT TT=7.923 T1=2.85	SAT TT=2.333 T1=1.53	SAT TT=0.268 T1=0.25
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561389.opb	SAT TT=0.407 T1=0.4	SAT TT=1.528 T1=1.53	No data	No data	SAT TT=2.057 T1=2.05	SAT TT=0.407 T1=0.4	SAT TT=0.656 T1=0.65	SAT TT=0.656 T1=0.65	SAT TT=7.014 T1=2.34	SAT TT=3.623 T1=2.27	SAT TT=2.541 T1=2.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900562192.opb	UNSAT TT=5.973	UNSAT TT=47.192	No data	No data	UNSAT TT=6.72	UNSAT TT=7.267	UNSAT TT=8.387	UNSAT TT=8.354	UNSAT TT=5.973	UNSAT TT=9.513	UNSAT TT=9.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900563250.opb	UNSAT TT=7.82	UNSAT TT=10.315	No data	No data	UNSAT TT=78.923	UNSAT TT=32.013	UNSAT TT=21.48	UNSAT TT=21.854	UNSAT TT=19.631	UNSAT TT=7.82	UNSAT TT=40.703
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900563801.opb	UNSAT TT=1.194	UNSAT TT=2.976	No data	No data	UNSAT TT=1.194	UNSAT TT=1.22	UNSAT TT=1.634	UNSAT TT=1.63	UNSAT TT=5.992	UNSAT TT=1.934	UNSAT TT=2.505
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564281.opb	UNSAT TT=1.139	UNSAT TT=1.139	No data	No data	UNSAT TT=10.717	UNSAT TT=1.333	UNSAT TT=2.634	UNSAT TT=2.635	UNSAT TT=5.994	UNSAT TT=3.893	UNSAT TT=2.567
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564822.opb	SAT TT=0.042 T1=0.04	SAT TT=0.127 T1=0.12	No data	No data	SAT TT=0.504 T1=0.5	SAT TT=0.142 T1=0.14	SAT TT=0.042 T1=0.04	SAT TT=0.042 T1=0.04	SAT TT=1.433 T1=0.82	SAT TT=1.808 T1=1.38	SAT TT=3.517 T1=3.47
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564824.opb	UNSAT TT=0.169	UNSAT TT=1.173	No data	No data	UNSAT TT=3.103	UNSAT TT=0.312	UNSAT TT=0.169	UNSAT TT=0.174	UNSAT TT=3.692	UNSAT TT=1.444	UNSAT TT=2.399
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900565527.opb	SAT TT=0.086 T1=0.08	SAT TT=1.477 T1=1.47	No data	No data	SAT TT=2.192 T1=2.19	SAT TT=0.264 T1=0.26	SAT TT=0.086 T1=0.08	SAT TT=0.088 T1=0.08	SAT TT=8.103 T1=2.89	SAT TT=1.254 T1=0.74	SAT TT=0.315 T1=0.3
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900565534.opb	UNSAT TT=3.984	UNSAT TT=3.984	No data	No data	UNSAT TT=12.377	UNSAT TT=15.936	UNSAT TT=9.787	UNSAT TT=10.456	UNSAT TT=8.472	UNSAT TT=7.053	UNSAT TT=10.745
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566151.opb	SAT TT=0.102 T1=0.1	SAT TT=0.102 T1=0.1	No data	No data	SAT TT=2.966 T1=3.02	SAT TT=0.604 T1=0.61	SAT TT=0.11 T1=0.11	SAT TT=0.12 T1=0.12	SAT TT=1.984 T1=0.82	SAT TT=1.754 T1=1.16	SAT TT=0.112 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566157.opb	UNSAT TT=3.693	UNSAT TT=52.958	No data	No data	UNSAT TT=9.001	UNSAT TT=7.208	UNSAT TT=8.512	UNSAT TT=8.507	UNSAT TT=10.442	UNSAT TT=3.693	UNSAT TT=9.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566263.opb	SAT TT=0.091 T1=0.09	SAT TT=0.548 T1=0.54	No data	No data	SAT TT=2.858 T1=2.85	SAT TT=0.091 T1=0.09	SAT TT=0.599 T1=0.59	SAT TT=0.602 T1=0.6	SAT TT=1.605 T1=0.84	SAT TT=0.755 T1=0.38	SAT TT=8.697 T1=8.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566270.opb	SAT TT=0.301 T1=0.3	SAT TT=1.923 T1=1.92	No data	No data	SAT TT=7.777 T1=7.77	SAT TT=0.329 T1=0.32	SAT TT=0.301 T1=0.3	SAT TT=0.302 T1=0.3	SAT TT=2.285 T1=0.86	SAT TT=4.832 T1=4.31	SAT TT=3.531 T1=3.47
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567003.opb	SAT TT=0.069 T1=0.06	SAT TT=4.791 T1=4.79	No data	No data	SAT TT=2.622 T1=2.62	SAT TT=0.622 T1=0.62	SAT TT=0.069 T1=0.06	SAT TT=0.069 T1=0.06	SAT TT=4.673 T1=1.82	SAT TT=3.924 T1=2.59	SAT TT=6.003 T1=5.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567024.opb	UNSAT TT=0.203	UNSAT TT=64.551	No data	No data	UNSAT TT=1.441	UNSAT TT=0.203	UNSAT TT=1.413	UNSAT TT=1.362	UNSAT TT=4.242	UNSAT TT=2.133	UNSAT TT=2.793
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567135.opb	UNSAT TT=0.73	UNSAT TT=40.324	No data	No data	UNSAT TT=8.041	UNSAT TT=0.73	UNSAT TT=7.742	UNSAT TT=7.657	UNSAT TT=5.443	UNSAT TT=3.422	UNSAT TT=5.493
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567939.opb	SAT TT=0.108 T1=0.1	SAT TT=2.64 T1=2.64	No data	No data	SAT TT=1.536 T1=1.53	SAT TT=0.64 T1=0.64	SAT TT=0.108 T1=0.1	SAT TT=0.109 T1=0.1	SAT TT=11.053 T1=4.43	SAT TT=1.054 T1=0.58	SAT TT=2.04 T1=2.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567985.opb	UNSAT TT=8.564	UNSAT TT=21.832	No data	No data	UNSAT TT=22.423	UNSAT TT=45.813	UNSAT TT=62.876	UNSAT TT=61.045	UNSAT TT=17.309	UNSAT TT=8.564	UNSAT TT=42.169
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568186.opb	UNSAT TT=0.754	UNSAT TT=0.754	No data	No data	UNSAT TT=6.006	UNSAT TT=3.021	UNSAT TT=3.965	UNSAT TT=3.977	UNSAT TT=5.653	UNSAT TT=2.874	UNSAT TT=3.646
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568706.opb	UNSAT TT=1.166	UNSAT TT=2.552	No data	No data	UNSAT TT=1.166	UNSAT TT=4.096	UNSAT TT=3.717	UNSAT TT=3.769	UNSAT TT=5.263	UNSAT TT=3.024	UNSAT TT=3.449
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568952.opb	SAT TT=0.343 T1=0.34	SAT TT=23.045 T1=23.04	No data	No data	SAT TT=7.041 T1=7.04	SAT TT=0.343 T1=0.34	SAT TT=0.662 T1=0.66	SAT TT=0.661 T1=0.66	SAT TT=5.205 T1=1.83	SAT TT=3.603 T1=2.9	SAT TT=3.872 T1=3.88
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900569834.opb	UNSAT TT=2.57	UNSAT TT=78.651	No data	No data	UNSAT TT=2.57	UNSAT TT=7.318	UNSAT TT=5.739	UNSAT TT=5.766	UNSAT TT=5.793	UNSAT TT=3.023	UNSAT TT=2.789
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900570242.opb	UNSAT TT=0.293	UNSAT TT=45.698	No data	No data	UNSAT TT=3.487	UNSAT TT=0.293	UNSAT TT=1.995	UNSAT TT=1.994	UNSAT TT=4.082	UNSAT TT=2.144	UNSAT TT=2.562
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571131.opb	SAT TT=0.053 T1=0.05	SAT TT=0.066 T1=0.06	No data	No data	SAT TT=2.276 T1=2.27	SAT TT=0.227 T1=0.22	SAT TT=0.055 T1=0.05	SAT TT=0.053 T1=0.05	SAT TT=5.064 T1=1.85	SAT TT=1.953 T1=1.29	SAT TT=0.847 T1=0.84
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571132.opb	UNSAT TT=2.605	UNSAT TT=2.605	No data	No data	UNSAT TT=11.817	UNSAT TT=13.103	UNSAT TT=18.062	UNSAT TT=18.34	UNSAT TT=14.942	UNSAT TT=6.773	UNSAT TT=14.236
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571761.opb	UNSAT TT=1.746	UNSAT TT=1.746	No data	No data	UNSAT TT=13.674	UNSAT TT=18.558	UNSAT TT=15.08	UNSAT TT=15.091	UNSAT TT=8.482	UNSAT TT=4.953	UNSAT TT=16.214
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900573137.opb	UNSAT TT=5.658	UNSAT TT=41.41	No data	No data	UNSAT TT=10.303	UNSAT TT=17.654	UNSAT TT=25.349	UNSAT TT=25.469	UNSAT TT=8.292	UNSAT TT=6.142	UNSAT TT=5.658
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900573901.opb	UNSAT TT=5.172	UNSAT TT=5.172	No data	No data	UNSAT TT=10.353	UNSAT TT=19.84	UNSAT TT=22.966	UNSAT TT=23.576	UNSAT TT=9.452	UNSAT TT=9.813	UNSAT TT=13.134
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574864.opb	UNSAT TT=3.452	UNSAT TT=9.451	No data	No data	UNSAT TT=8.021	UNSAT TT=6.52	UNSAT TT=9.952	UNSAT TT=9.974	UNSAT TT=8.633	UNSAT TT=3.452	UNSAT TT=15.535
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574948.opb	SAT TT=0.048 T1=0.04	SAT TT=1.296 T1=1.29	No data	No data	SAT TT=2.062 T1=2.11	SAT TT=0.116 T1=0.11	SAT TT=0.048 T1=0.04	SAT TT=0.048 T1=0.05	SAT TT=5.363 T1=1.84	SAT TT=0.977 T1=0.49	SAT TT=3.264 T1=3.21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574974.opb	SAT TT=0.1 T1=0.09	SAT TT=0.415 T1=0.41	No data	No data	SAT TT=1.464 T1=1.46	SAT TT=0.1 T1=0.09	SAT TT=0.106 T1=0.1	SAT TT=0.107 T1=0.1	SAT TT=2.313 T1=0.84	SAT TT=1.674 T1=1.03	SAT TT=1.363 T1=1.31
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900575442.opb	UNSAT TT=2.393	UNSAT TT=2.492	No data	No data	UNSAT TT=8.376	UNSAT TT=5.483	UNSAT TT=5.914	UNSAT TT=5.909	UNSAT TT=5.07	UNSAT TT=2.393	UNSAT TT=3.634
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576151.opb	UNSAT TT=3.992	UNSAT TT=8.619	No data	No data	UNSAT TT=6.08	UNSAT TT=30.071	UNSAT TT=26.795	UNSAT TT=27.145	UNSAT TT=9.271	UNSAT TT=3.992	UNSAT TT=12.772
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576360.opb	UNSAT TT=1.113	UNSAT TT=1.113	No data	No data	UNSAT TT=4.177	UNSAT TT=12.81	UNSAT TT=13.487	UNSAT TT=13.443	UNSAT TT=7.553	UNSAT TT=3.064	UNSAT TT=9.613
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576918.opb	SAT TT=0.037 T1=0.03	SAT TT=0.052 T1=0.05	No data	No data	SAT TT=2.602 T1=2.6	SAT TT=0.078 T1=0.07	SAT TT=0.037 T1=0.03	SAT TT=0.037 T1=0.03	SAT TT=6.983 T1=2.34	SAT TT=2.074 T1=1.26	SAT TT=7.416 T1=7.35
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576927.opb	UNSAT TT=10.098	UNSAT TT=18.12	No data	No data	UNSAT TT=10.098	UNSAT TT=40.225	UNSAT TT=31.444	UNSAT TT=32.037	UNSAT TT=17.531	UNSAT TT=14.221	UNSAT TT=46.846
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900577000.opb	SAT TT=0.057 T1=0.05	SAT TT=0.057 T1=0.05	No data	No data	SAT TT=4.936 T1=4.93	SAT TT=0.272 T1=0.27	SAT TT=0.096 T1=0.09	SAT TT=0.099 T1=0.09	SAT TT=5.282 T1=1.83	SAT TT=0.864 T1=0.43	SAT TT=2.593 T1=2.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900577940.opb	UNSAT TT=3.591	UNSAT TT=3.591	No data	No data	UNSAT TT=20.841	UNSAT TT=36.099	UNSAT TT=33.622	UNSAT TT=34.116	UNSAT TT=14.232	UNSAT TT=9.153	UNSAT TT=42.817
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900579996.opb	UNSAT TT=2.599	UNSAT TT=3.356	No data	No data	UNSAT TT=4.769	UNSAT TT=2.599	UNSAT TT=23.77	UNSAT TT=23.818	UNSAT TT=9.193	UNSAT TT=19.533	UNSAT TT=18.725
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900581320.opb	UNSAT TT=4.334	UNSAT TT=5.58	No data	No data	UNSAT TT=17.771	UNSAT TT=34.07	UNSAT TT=21.556	UNSAT TT=22.417	UNSAT TT=9.213	UNSAT TT=4.334	UNSAT TT=12.394
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900581321.opb	SAT TT=0.016 T1=0.01	SAT TT=0.186 T1=0.18	No data	No data	SAT TT=0.486 T1=0.48	SAT TT=0.19 T1=0.19	SAT TT=0.016 T1=0.01	SAT TT=0.016 T1=0.01	SAT TT=1.273 T1=0.82	SAT TT=1.584 T1=0.97	SAT TT=8.396 T1=8.34
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900582300.opb	UNSAT TT=8.364	UNSAT TT=179.666	No data	No data	UNSAT TT=38.28	UNSAT TT=36.396	UNSAT TT=30.674	UNSAT TT=31.472	UNSAT TT=11.683	UNSAT TT=8.364	UNSAT TT=50.215
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900582376.opb	SAT TT=0.175 T1=0.17	SAT TT=2.669 T1=2.67	No data	No data	SAT TT=1.925 T1=1.92	SAT TT=0.309 T1=0.31	SAT TT=0.175 T1=0.17	SAT TT=0.177 T1=0.17	SAT TT=5.674 T1=1.84	SAT TT=2.733 T1=1.73	SAT TT=1.773 T1=1.72
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900583053.opb	UNSAT TT=2.884	UNSAT TT=2.884	No data	No data	UNSAT TT=10.669	UNSAT TT=45.284	UNSAT TT=34.837	UNSAT TT=35.282	UNSAT TT=10.633	UNSAT TT=16.503	UNSAT TT=23.967
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900584106.opb	UNSAT TT=0.849	UNSAT TT=30.954	No data	No data	UNSAT TT=6.459	UNSAT TT=1.976	UNSAT TT=0.849	UNSAT TT=0.856	UNSAT TT=4.503	UNSAT TT=1.813	UNSAT TT=2.636
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900584219.opb	UNSAT TT=0.486	UNSAT TT=6.37	No data	No data	UNSAT TT=3.624	UNSAT TT=0.486	UNSAT TT=5.445	UNSAT TT=5.438	UNSAT TT=5.743	UNSAT TT=2.214	UNSAT TT=4.272
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900667195.opb	UNSAT TT=9.363	UNSAT TT=18.77	No data	No data	UNSAT TT=36.013	UNSAT TT=39.095	UNSAT TT=37.188	UNSAT TT=38.933	UNSAT TT=14.713	UNSAT TT=9.363	UNSAT TT=42.949
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669299.opb	SAT TT=0.035 T1=0.03	SAT TT=0.851 T1=0.85	No data	No data	SAT TT=0.262 T1=0.26	SAT TT=0.123 T1=0.12	SAT TT=0.035 T1=0.03	SAT TT=0.035 T1=0.03	SAT TT=2.023 T1=0.82	SAT TT=1.964 T1=1.17	SAT TT=0.116 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669309.opb	SAT TT=1 T1=1	SAT TT=3.335 T1=3.33	No data	No data	SAT TT=12.205 T1=12.2	SAT TT=1 T1=1	SAT TT=2.151 T1=2.15	SAT TT=2.175 T1=2.17	SAT TT=6.383 T1=2.35	SAT TT=1.923 T1=1.25	SAT TT=14.422 T1=14.36
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669797.opb	UNSAT TT=2.144	UNSAT TT=72.103	No data	No data	UNSAT TT=6.524	UNSAT TT=2.144	UNSAT TT=15.474	UNSAT TT=15.496	UNSAT TT=7.414	UNSAT TT=5.273	UNSAT TT=11.161
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670167.opb	UNSAT TT=0.723	UNSAT TT=3.78	No data	No data	UNSAT TT=0.723	UNSAT TT=9.011	UNSAT TT=3.288	UNSAT TT=3.298	UNSAT TT=13.072	UNSAT TT=3.194	UNSAT TT=4.557
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670234.opb	UNSAT TT=3.883	UNSAT TT=3.883	No data	No data	UNSAT TT=38.021	UNSAT TT=56.25	UNSAT TT=49.858	UNSAT TT=49.803	UNSAT TT=17.061	UNSAT TT=26.17	UNSAT TT=28.744
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670675.opb	UNSAT TT=0.84	UNSAT TT=3.168	No data	No data	UNSAT TT=1.039	UNSAT TT=0.84	UNSAT TT=2.498	UNSAT TT=2.509	UNSAT TT=3.943	UNSAT TT=1.993	UNSAT TT=2.424
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670756.opb	SAT TT=0.085 T1=0.08	SAT TT=0.107 T1=0.1	No data	No data	SAT TT=12.547 T1=12.54	SAT TT=0.085 T1=0.08	SAT TT=0.133 T1=0.13	SAT TT=0.144 T1=0.14	SAT TT=5.932 T1=2.34	SAT TT=2.586 T1=1.51	SAT TT=3.759 T1=3.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966483.opb	UNSAT TT=0.706	UNSAT TT=0.706	No data	No data	UNSAT TT=44.873	UNSAT TT=0.895	UNSAT TT=0.966	UNSAT TT=0.982	UNSAT TT=5.343	UNSAT TT=2.364	UNSAT TT=2.318
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966688.opb	UNSAT TT=1.735	UNSAT TT=4.351	No data	No data	UNSAT TT=39.955	UNSAT TT=1.735	UNSAT TT=2.043	UNSAT TT=2.045	UNSAT TT=7.613	UNSAT TT=2.395	UNSAT TT=3.508
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967142.opb	UNSAT TT=5.084	UNSAT TT=61.34	No data	No data	UNSAT TT=135.137	UNSAT TT=5.234	UNSAT TT=6.674	UNSAT TT=6.838	UNSAT TT=10.662	UNSAT TT=5.084	UNSAT TT=7.203
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967327.opb	SAT TT=0.669 T1=0.66	SAT TT=7.938 T1=7.93	No data	No data	SAT TT=52.589 T1=52.59	SAT TT=1.042 T1=1.04	SAT TT=0.669 T1=0.66	SAT TT=0.709 T1=0.71	SAT TT=6.003 T1=2.18	SAT TT=1.353 T1=0.72	SAT TT=0.711 T1=0.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967523.opb	UNSAT TT=3.574	UNSAT TT=15.822	No data	No data	UNSAT TT=163.416	UNSAT TT=4.446	UNSAT TT=5.374	UNSAT TT=5.322	UNSAT TT=8.164	UNSAT TT=3.574	UNSAT TT=5.259
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967729.opb	UNSAT TT=1.044	UNSAT TT=1.554	No data	No data	UNSAT TT=161.114	UNSAT TT=1.044	UNSAT TT=1.464	UNSAT TT=1.463	UNSAT TT=6.08	UNSAT TT=2.413	UNSAT TT=2.599
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968094.opb	UNSAT TT=2.192	UNSAT TT=8.392	No data	No data	UNSAT TT=123.897	UNSAT TT=2.192	UNSAT TT=3.419	UNSAT TT=3.414	UNSAT TT=6.754	UNSAT TT=3.054	UNSAT TT=3.825
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968431.opb	SAT TT=0.455 T1=0.45	SAT TT=3.334 T1=3.33	No data	No data	SAT TT=5.741 T1=5.74	SAT TT=0.482 T1=0.59	SAT TT=0.455 T1=0.45	SAT TT=0.457 T1=0.45	SAT TT=3.013 T1=1.19	SAT TT=1.475 T1=0.78	SAT TT=1.042 T1=1.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968561.opb	UNSAT TT=3.313	UNSAT TT=14.208	No data	No data	UNSAT TT=115.956	UNSAT TT=4.203	UNSAT TT=5.031	UNSAT TT=5.007	UNSAT TT=8.581	UNSAT TT=3.313	UNSAT TT=5.721
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968898.opb	UNSAT TT=2.567	UNSAT TT=6.473	No data	No data	UNSAT TT=104.673	UNSAT TT=3.648	UNSAT TT=4.12	UNSAT TT=4.116	UNSAT TT=6.803	UNSAT TT=2.567	UNSAT TT=4.283
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969170.opb	UNSAT TT=2.15	UNSAT TT=5.75	No data	No data	UNSAT TT=203.876	UNSAT TT=2.355	UNSAT TT=2.15	UNSAT TT=2.151	UNSAT TT=6.222	UNSAT TT=2.545	UNSAT TT=3.736
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969577.opb	UNSAT TT=1.115	UNSAT TT=1.115	No data	No data	UNSAT TT=136.659	UNSAT TT=1.731	UNSAT TT=3.33	UNSAT TT=3.322	UNSAT TT=6.902	UNSAT TT=2.415	UNSAT TT=3.584
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969860.opb	UNSAT TT=3.713	UNSAT TT=12.444	No data	No data	UNSAT TT=133.682	UNSAT TT=4.367	UNSAT TT=4.885	UNSAT TT=4.941	UNSAT TT=8.984	UNSAT TT=3.713	UNSAT TT=5.37
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969933.opb	SAT TT=0.193 T1=0.19	SAT TT=0.598 T1=0.6	No data	No data	SAT TT=5.236 T1=5.23	SAT TT=0.193 T1=0.19	SAT TT=1.082 T1=1.08	SAT TT=1.167 T1=1.16	SAT TT=5.532 T1=1.68	SAT TT=0.864 T1=0.51	SAT TT=0.687 T1=0.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970170.opb	SAT TT=1.141 T1=1.14	SAT TT=6.701 T1=6.7	No data	No data	SAT TT=59.775 T1=59.78	SAT TT=1.141 T1=1.14	SAT TT=8.415 T1=8.41	SAT TT=8.464 T1=8.46	SAT TT=9.393 T1=3.68	SAT TT=2.854 T1=2.25	SAT TT=7.05 T1=6.99
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970277.opb	SAT TT=0.29 T1=0.29	SAT TT=0.676 T1=0.67	No data	No data	SAT TT=7.495 T1=7.49	SAT TT=0.29 T1=0.29	SAT TT=2.969 T1=2.96	SAT TT=2.954 T1=2.95	SAT TT=5.424 T1=1.72	SAT TT=1.43 T1=1.15	SAT TT=4.433 T1=4.37
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970444.opb	UNSAT TT=1.679	UNSAT TT=3.724	No data	No data	UNSAT TT=109.428	UNSAT TT=1.679	UNSAT TT=1.873	UNSAT TT=1.923	UNSAT TT=6.404	UNSAT TT=2.994	UNSAT TT=3.035
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970631.opb	UNSAT TT=1.947	UNSAT TT=2.891	No data	No data	UNSAT TT=116.908	UNSAT TT=1.947	UNSAT TT=2.215	UNSAT TT=2.206	UNSAT TT=6.704	UNSAT TT=2.614	UNSAT TT=3.48
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971097.opb	SAT TT=2.255 T1=1.18	SAT TT=17.625 T1=17.62	No data	No data	SAT TT=23.493 T1=23.49	SAT TT=4.095 T1=4.09	SAT TT=4.178 T1=4.18	SAT TT=4.261 T1=4.26	SAT TT=4.033 T1=1.18	SAT TT=2.255 T1=1.68	SAT TT=2.642 T1=2.58
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971363.opb	UNSAT TT=2.259	UNSAT TT=7.305	No data	No data	UNSAT TT=94.293	UNSAT TT=2.259	UNSAT TT=3.786	UNSAT TT=3.785	UNSAT TT=6.003	UNSAT TT=2.565	UNSAT TT=3.718
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971697.opb	UNSAT TT=2.293	UNSAT TT=4.417	No data	No data	UNSAT TT=99.955	UNSAT TT=2.293	UNSAT TT=2.651	UNSAT TT=2.646	UNSAT TT=6.703	UNSAT TT=3.193	UNSAT TT=3.687
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971766.opb	SAT TT=0.434 T1=0.43	SAT TT=0.451 T1=0.45	No data	No data	SAT TT=0.821 T1=0.82	SAT TT=0.434 T1=0.43	SAT TT=2.65 T1=2.65	SAT TT=2.65 T1=2.65	SAT TT=1.783 T1=0.68	SAT TT=1.154 T1=0.61	SAT TT=4.476 T1=4.41
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972154.opb	UNSAT TT=2.973	UNSAT TT=3.871	No data	No data	UNSAT TT=124.734	UNSAT TT=2.973	UNSAT TT=3.718	UNSAT TT=3.711	UNSAT TT=8.612	UNSAT TT=4.314	UNSAT TT=4.895
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972763.opb	UNSAT TT=2.086	UNSAT TT=4.494	No data	No data	UNSAT TT=152.692	UNSAT TT=2.086	UNSAT TT=3.587	UNSAT TT=3.573	UNSAT TT=6.773	UNSAT TT=2.393	UNSAT TT=5.256
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972958.opb	SAT TT=0.406 T1=0.4	SAT TT=0.406 T1=0.4	No data	No data	SAT TT=4.534 T1=4.53	SAT TT=0.662 T1=0.74	SAT TT=1.974 T1=2.06	SAT TT=1.965 T1=1.96	SAT TT=4.854 T1=1.7	SAT TT=1.813 T1=1.29	SAT TT=4.29 T1=4.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973163.opb	UNSAT TT=3.684	UNSAT TT=7.534	No data	No data	UNSAT TT=122.855	UNSAT TT=3.684	UNSAT TT=5.22	UNSAT TT=5.202	UNSAT TT=9.233	UNSAT TT=3.854	UNSAT TT=5.28
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973364.opb	UNSAT TT=1.559	UNSAT TT=4.535	No data	No data	UNSAT TT=285.612	UNSAT TT=1.559	UNSAT TT=2.284	UNSAT TT=2.272	UNSAT TT=5.474	UNSAT TT=2.604	UNSAT TT=3.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973478.opb	SAT TT=0.664 T1=0.38	SAT TT=0.886 T1=0.88	No data	No data	SAT TT=129.011 T1=129.02	SAT TT=1.111 T1=1.14	SAT TT=1.948 T1=1.94	SAT TT=1.945 T1=1.94	SAT TT=4.562 T1=1.7	SAT TT=0.664 T1=0.38	SAT TT=4.028 T1=3.96
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973670.opb	UNSAT TT=3.014	UNSAT TT=3.033	No data	No data	UNSAT TT=160.014	UNSAT TT=3.278	UNSAT TT=3.796	UNSAT TT=3.8	UNSAT TT=7.572	UNSAT TT=3.014	UNSAT TT=4.535
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973863.opb	SAT TT=2.377 T1=1.7	SAT TT=2.777 T1=2.77	No data	No data	SAT TT=55.199 T1=55.2	SAT TT=2.819 T1=2.93	SAT TT=5.096 T1=5.09	SAT TT=5.139 T1=5.14	SAT TT=4.204 T1=1.7	SAT TT=4.033 T1=3.39	SAT TT=2.377 T1=2.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974180.opb	UNSAT TT=2.895	UNSAT TT=9.865	No data	No data	UNSAT TT=121.626	UNSAT TT=3.501	UNSAT TT=4.615	UNSAT TT=4.591	UNSAT TT=6.574	UNSAT TT=2.895	UNSAT TT=5.331
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974372.opb	UNSAT TT=0.884	UNSAT TT=0.884	No data	No data	UNSAT TT=106.664	UNSAT TT=1.545	UNSAT TT=2.122	UNSAT TT=2.115	UNSAT TT=5.55	UNSAT TT=1.964	UNSAT TT=3.52
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974553.opb	SAT TT=0.306 T1=0.3	SAT TT=4.45 T1=4.45	No data	No data	SAT TT=11.201 T1=11.2	SAT TT=0.306 T1=0.3	SAT TT=2.123 T1=2.27	SAT TT=2.121 T1=2.12	SAT TT=3.342 T1=1.19	SAT TT=0.764 T1=0.45	SAT TT=2.149 T1=2.27
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975607.opb	UNSAT TT=1.319	UNSAT TT=1.549	No data	No data	UNSAT TT=85.941	UNSAT TT=1.404	UNSAT TT=1.319	UNSAT TT=1.377	UNSAT TT=5.533	UNSAT TT=2.225	UNSAT TT=2.81
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975678.opb	SAT TT=1.326 T1=1.32	SAT TT=15.868 T1=15.87	No data	No data	SAT TT=15.211 T1=15.21	SAT TT=3.561 T1=3.56	SAT TT=1.326 T1=1.32	SAT TT=1.33 T1=1.33	SAT TT=7.423 T1=2.68	SAT TT=2.934 T1=2.35	SAT TT=2.623 T1=2.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975832.opb	SAT TT=0.092 T1=0.09	SAT TT=1.867 T1=1.86	No data	No data	SAT TT=18.113 T1=18.11	SAT TT=0.858 T1=0.85	SAT TT=0.092 T1=0.09	SAT TT=0.092 T1=0.09	SAT TT=3.733 T1=1.19	SAT TT=2.223 T1=1.53	SAT TT=2.683 T1=2.62
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975965.opb	UNSAT TT=4.763	UNSAT TT=21.267	No data	No data	UNSAT TT=209.479	UNSAT TT=6.409	UNSAT TT=6.931	UNSAT TT=6.934	UNSAT TT=8.732	UNSAT TT=4.763	UNSAT TT=6.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976157.opb	UNSAT TT=1.095	UNSAT TT=1.095	No data	No data	UNSAT TT=44.694	UNSAT TT=1.386	UNSAT TT=1.923	UNSAT TT=1.921	UNSAT TT=6.864	UNSAT TT=2.163	UNSAT TT=2.778
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976730.opb	UNSAT TT=3.963	UNSAT TT=12.297	No data	No data	UNSAT TT=150.548	UNSAT TT=5.524	UNSAT TT=5.775	UNSAT TT=6.094	UNSAT TT=9.024	UNSAT TT=3.963	UNSAT TT=5.924
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976735.opb	SAT TT=0.202 T1=0.2	SAT TT=0.415 T1=0.41	No data	No data	SAT TT=12.903 T1=12.91	SAT TT=0.315 T1=0.32	SAT TT=0.203 T1=0.2	SAT TT=0.202 T1=0.2	SAT TT=3.244 T1=1.19	SAT TT=1.114 T1=0.64	SAT TT=3.672 T1=3.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976935.opb	UNSAT TT=2.154	UNSAT TT=4.247	No data	No data	UNSAT TT=42.235	UNSAT TT=2.154	UNSAT TT=2.724	UNSAT TT=2.725	UNSAT TT=7.153	UNSAT TT=2.865	UNSAT TT=3.344
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977266.opb	SAT TT=0.429 T1=0.42	SAT TT=0.429 T1=0.42	No data	No data	SAT TT=14.54 T1=14.54	SAT TT=2.035 T1=2.03	SAT TT=0.512 T1=0.51	SAT TT=0.537 T1=0.54	SAT TT=5.704 T1=1.69	SAT TT=2.244 T1=1.58	SAT TT=2.101 T1=2.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977273.opb	UNSAT TT=2.713	UNSAT TT=6.431	No data	No data	UNSAT TT=109.296	UNSAT TT=2.742	UNSAT TT=2.865	UNSAT TT=2.863	UNSAT TT=6.243	UNSAT TT=2.713	UNSAT TT=4.178
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977464.opb	SAT TT=0.884 T1=0.49	SAT TT=4.591 T1=4.59	No data	No data	SAT TT=53.745 T1=53.75	SAT TT=2.37 T1=2.36	SAT TT=6.718 T1=6.71	SAT TT=6.717 T1=6.71	SAT TT=6.414 T1=2.19	SAT TT=0.884 T1=0.49	SAT TT=4.02 T1=3.96
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977780.opb	UNSAT TT=1.692	UNSAT TT=1.986	No data	No data	UNSAT TT=111.996	UNSAT TT=1.692	UNSAT TT=1.728	UNSAT TT=1.734	UNSAT TT=5.13	UNSAT TT=2.204	UNSAT TT=2.992
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978113.opb	UNSAT TT=3.884	UNSAT TT=30.162	No data	No data	UNSAT TT=134.729	UNSAT TT=4.573	UNSAT TT=5.5	UNSAT TT=5.481	UNSAT TT=8.762	UNSAT TT=3.884	UNSAT TT=5.293
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978334.opb	UNSAT TT=2.715	UNSAT TT=8.041	No data	No data	UNSAT TT=136.201	UNSAT TT=2.715	UNSAT TT=3.409	UNSAT TT=3.39	UNSAT TT=6.414	UNSAT TT=3.603	UNSAT TT=5.15
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212272.opb	UNSAT TT=2.794	UNSAT TT=10.648	No data	No data	UNSAT TT=188.175	UNSAT TT=2.794	UNSAT TT=4.754	UNSAT TT=4.74	UNSAT TT=8.033	UNSAT TT=3.094	UNSAT TT=5.134
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212476.opb	UNSAT TT=3.983	UNSAT TT=21.89	No data	No data	UNSAT TT=118.804	UNSAT TT=5.082	UNSAT TT=6.886	UNSAT TT=7.185	UNSAT TT=8.9	UNSAT TT=3.983	UNSAT TT=5.821
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212923.opb	UNSAT TT=2.041	UNSAT TT=4.875	No data	No data	UNSAT TT=146.548	UNSAT TT=2.041	UNSAT TT=3.517	UNSAT TT=3.506	UNSAT TT=5.753	UNSAT TT=2.784	UNSAT TT=3.403
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213670.opb	UNSAT TT=2.479	UNSAT TT=4.435	No data	No data	UNSAT TT=143.907	UNSAT TT=2.611	UNSAT TT=2.487	UNSAT TT=2.479	UNSAT TT=7.233	UNSAT TT=2.503	UNSAT TT=3.241
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213868.opb	UNSAT TT=2.69	UNSAT TT=2.792	No data	No data	UNSAT TT=129.714	UNSAT TT=2.69	UNSAT TT=3.176	UNSAT TT=3.168	UNSAT TT=6.693	UNSAT TT=3.074	UNSAT TT=3.471
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216188.opb	SAT TT=0.367 T1=0.36	SAT TT=2.087 T1=2.08	No data	No data	SAT TT=21.913 T1=21.91	SAT TT=1.074 T1=1.07	SAT TT=0.367 T1=0.47	SAT TT=0.367 T1=0.36	SAT TT=3.822 T1=1.18	SAT TT=1.545 T1=1.09	SAT TT=4.79 T1=4.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216411.opb	UNSAT TT=2.864	UNSAT TT=6.803	No data	No data	UNSAT TT=125.667	UNSAT TT=2.92	UNSAT TT=2.871	UNSAT TT=2.864	UNSAT TT=7.993	UNSAT TT=3.363	UNSAT TT=5.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216823.opb	UNSAT TT=1.579	UNSAT TT=1.579	No data	No data	UNSAT TT=187.156	UNSAT TT=2.781	UNSAT TT=2.646	UNSAT TT=2.655	UNSAT TT=6.002	UNSAT TT=2.404	UNSAT TT=3.668
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216864.opb	SAT TT=0.024 T1=0.02	SAT TT=0.308 T1=0.3	No data	No data	SAT TT=48.342 T1=48.34	SAT TT=2.243 T1=2.24	SAT TT=0.024 T1=0.02	SAT TT=0.026 T1=0.02	SAT TT=1.463 T1=0.68	SAT TT=0.593 T1=0.32	SAT TT=1.445 T1=1.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217374.opb	SAT TT=0.083 T1=0.08	SAT TT=1.751 T1=1.75	No data	No data	SAT TT=0.174 T1=0.17	SAT TT=0.35 T1=0.34	SAT TT=0.083 T1=0.08	SAT TT=0.084 T1=0.08	SAT TT=4.703 T1=1.71	SAT TT=1.024 T1=0.54	SAT TT=0.744 T1=0.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217380.opb	SAT TT=1.175 T1=0.7	SAT TT=2.213 T1=2.21	No data	No data	SAT TT=5.218 T1=5.22	SAT TT=1.175 T1=1.17	SAT TT=1.777 T1=1.77	SAT TT=1.81 T1=1.81	SAT TT=4.83 T1=1.7	SAT TT=1.194 T1=0.7	SAT TT=2.082 T1=2.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217392.opb	UNSAT TT=1.862	UNSAT TT=1.862	No data	No data	UNSAT TT=84.678	UNSAT TT=2.117	UNSAT TT=2.031	UNSAT TT=2.027	UNSAT TT=6.413	UNSAT TT=2.924	UNSAT TT=3.544
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217555.opb	UNSAT TT=2.364	UNSAT TT=10.377	No data	No data	UNSAT TT=140.979	UNSAT TT=2.364	UNSAT TT=3.478	UNSAT TT=3.472	UNSAT TT=8.473	UNSAT TT=3.444	UNSAT TT=3.92
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218024.opb	UNSAT TT=0.824	UNSAT TT=0.824	No data	No data	UNSAT TT=94.47	UNSAT TT=2.47	UNSAT TT=3.113	UNSAT TT=3.107	UNSAT TT=8.803	UNSAT TT=3.812	UNSAT TT=4.686
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218308.opb	UNSAT TT=5.703	UNSAT TT=20.324	No data	No data	UNSAT TT=125.4	UNSAT TT=6.105	UNSAT TT=8.749	UNSAT TT=8.724	UNSAT TT=10.762	UNSAT TT=5.703	UNSAT TT=6.337
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218757.opb	UNSAT TT=1.491	UNSAT TT=1.491	No data	No data	UNSAT TT=141.244	UNSAT TT=2.414	UNSAT TT=4.128	UNSAT TT=4.118	UNSAT TT=7.492	UNSAT TT=3.453	UNSAT TT=4.675
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218955.opb	UNSAT TT=1.815	UNSAT TT=4.114	No data	No data	UNSAT TT=285.972	UNSAT TT=1.815	UNSAT TT=2.667	UNSAT TT=2.659	UNSAT TT=6.343	UNSAT TT=2.424	UNSAT TT=3.215
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219348.opb	UNSAT TT=2.432	UNSAT TT=11.01	No data	No data	UNSAT TT=115.401	UNSAT TT=2.432	UNSAT TT=2.649	UNSAT TT=2.658	UNSAT TT=6.382	UNSAT TT=2.654	UNSAT TT=3.534
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219399.opb	SAT TT=0.106 T1=0.1	SAT TT=0.755 T1=0.75	No data	No data	SAT TT=2.214 T1=2.21	SAT TT=0.106 T1=0.1	SAT TT=0.59 T1=0.59	SAT TT=0.591 T1=0.59	SAT TT=5.683 T1=1.7	SAT TT=1.254 T1=0.79	SAT TT=2.469 T1=2.41
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219799.opb	UNSAT TT=2.048	UNSAT TT=4.717	No data	No data	UNSAT TT=179.116	UNSAT TT=2.048	UNSAT TT=2.31	UNSAT TT=2.3	UNSAT TT=6.544	UNSAT TT=2.464	UNSAT TT=3.937
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220019.opb	UNSAT TT=2.394	UNSAT TT=4.39	No data	No data	UNSAT TT=140.922	UNSAT TT=2.394	UNSAT TT=2.606	UNSAT TT=2.633	UNSAT TT=6.726	UNSAT TT=3.523	UNSAT TT=3.643
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220546.opb	UNSAT TT=2.203	UNSAT TT=4.892	No data	No data	UNSAT TT=109.666	UNSAT TT=2.203	UNSAT TT=3.691	UNSAT TT=3.688	UNSAT TT=6.772	UNSAT TT=3.314	UNSAT TT=5.222
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220767.opb	UNSAT TT=3.786	UNSAT TT=8.001	No data	No data	UNSAT TT=113.203	UNSAT TT=3.786	UNSAT TT=4.227	UNSAT TT=4.218	UNSAT TT=7.673	UNSAT TT=3.802	UNSAT TT=5.443
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221203.opb	UNSAT TT=2.626	UNSAT TT=4.209	No data	No data	UNSAT TT=73.853	UNSAT TT=2.626	UNSAT TT=3.283	UNSAT TT=3.265	UNSAT TT=6.384	UNSAT TT=2.824	UNSAT TT=4.053
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221624.opb	UNSAT TT=2.569	UNSAT TT=6.538	No data	No data	UNSAT TT=117.453	UNSAT TT=2.569	UNSAT TT=3.464	UNSAT TT=3.474	UNSAT TT=7.813	UNSAT TT=2.953	UNSAT TT=4.074
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221953.opb	SAT TT=0.853 T1=0.5	SAT TT=4.202 T1=4.2	No data	No data	SAT TT=28.216 T1=28.22	SAT TT=1.417 T1=1.41	SAT TT=2.738 T1=2.73	SAT TT=2.759 T1=2.76	SAT TT=4.374 T1=1.25	SAT TT=0.853 T1=0.5	SAT TT=4.076 T1=4.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222080.opb	SAT TT=1.067 T1=1.06	SAT TT=1.997 T1=1.99	No data	No data	SAT TT=115.78 T1=115.8	SAT TT=2.144 T1=2.25	SAT TT=1.067 T1=1.06	SAT TT=1.067 T1=1.06	SAT TT=5.302 T1=1.69	SAT TT=2.824 T1=2.21	SAT TT=2.457 T1=2.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222248.opb	SAT TT=0.55 T1=0.55	SAT TT=0.989 T1=0.98	No data	No data	SAT TT=8.129 T1=8.12	SAT TT=0.55 T1=0.55	SAT TT=1.489 T1=1.48	SAT TT=1.512 T1=1.61	SAT TT=2.495 T1=1.19	SAT TT=2.114 T1=1.14	SAT TT=0.989 T1=0.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222257.opb	UNSAT TT=2.584	UNSAT TT=6.288	No data	No data	UNSAT TT=115.109	UNSAT TT=2.682	UNSAT TT=2.586	UNSAT TT=2.584	UNSAT TT=6.474	UNSAT TT=2.654	UNSAT TT=3.996
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222539.opb	UNSAT TT=2.524	UNSAT TT=3.188	No data	No data	UNSAT TT=116.096	UNSAT TT=3.194	UNSAT TT=3.326	UNSAT TT=3.325	UNSAT TT=4.432	UNSAT TT=2.524	UNSAT TT=4.313
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223004.opb	UNSAT TT=3.493	UNSAT TT=13.881	No data	No data	UNSAT TT=145.096	UNSAT TT=4.078	UNSAT TT=5.166	UNSAT TT=5.195	UNSAT TT=7.303	UNSAT TT=3.493	UNSAT TT=4.845
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223220.opb	UNSAT TT=2.838	UNSAT TT=3.038	No data	No data	UNSAT TT=294.572	UNSAT TT=2.838	UNSAT TT=3.891	UNSAT TT=3.898	UNSAT TT=8.532	UNSAT TT=3.103	UNSAT TT=5.162
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223416.opb	SAT TT=0.631 T1=0.63	SAT TT=0.631 T1=0.63	No data	No data	SAT TT=29.955 T1=29.96	SAT TT=1.521 T1=1.52	SAT TT=1.96 T1=1.96	SAT TT=1.959 T1=1.96	SAT TT=4.62 T1=1.69	SAT TT=1.924 T1=1.28	SAT TT=1.946 T1=1.89
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223596.opb	SAT TT=1.186 T1=1.18	SAT TT=2.595 T1=2.59	No data	No data	SAT TT=21.035 T1=21.03	SAT TT=3.296 T1=3.29	SAT TT=1.186 T1=1.18	SAT TT=1.194 T1=1.19	SAT TT=4.564 T1=1.68	SAT TT=3.015 T1=2.42	SAT TT=5.825 T1=5.76
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223689.opb	SAT TT=0.052 T1=0.05	SAT TT=3.943 T1=3.94	No data	No data	SAT TT=8.74 T1=8.74	SAT TT=1.049 T1=1.04	SAT TT=0.052 T1=0.05	SAT TT=0.052 T1=0.05	SAT TT=3.054 T1=1.18	SAT TT=1.474 T1=0.97	SAT TT=1.243 T1=1.2
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223696.opb	SAT TT=1.614 T1=0.99	SAT TT=1.663 T1=1.66	No data	No data	SAT TT=11.299 T1=11.3	SAT TT=2.66 T1=2.66	SAT TT=1.883 T1=1.88	SAT TT=1.891 T1=1.89	SAT TT=7.263 T1=2.23	SAT TT=1.614 T1=0.99	SAT TT=4.788 T1=4.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224059.opb	UNSAT TT=1.088	UNSAT TT=2.964	No data	No data	UNSAT TT=66.192	UNSAT TT=1.088	UNSAT TT=1.691	UNSAT TT=1.685	UNSAT TT=4.984	UNSAT TT=1.938	UNSAT TT=2.791
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224255.opb	UNSAT TT=2.683	UNSAT TT=6.244	No data	No data	UNSAT TT=153.507	UNSAT TT=2.796	UNSAT TT=4.186	UNSAT TT=4.171	UNSAT TT=7.022	UNSAT TT=2.683	UNSAT TT=3.757
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224451.opb	UNSAT TT=1.935	UNSAT TT=6.39	No data	No data	UNSAT TT=84.2	UNSAT TT=1.935	UNSAT TT=3.386	UNSAT TT=3.38	UNSAT TT=6.672	UNSAT TT=2.854	UNSAT TT=3.631
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224522.opb	SAT TT=0.124 T1=0.12	SAT TT=0.124 T1=0.12	No data	No data	SAT TT=117.897 T1=117.91	SAT TT=1.056 T1=1.05	SAT TT=0.146 T1=0.14	SAT TT=0.145 T1=0.14	SAT TT=4.512 T1=1.68	SAT TT=1.305 T1=0.65	SAT TT=1.678 T1=1.62
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224929.opb	UNSAT TT=2.019	UNSAT TT=4.154	No data	No data	UNSAT TT=96.151	UNSAT TT=2.019	UNSAT TT=3.446	UNSAT TT=3.465	UNSAT TT=6.812	UNSAT TT=3.003	UNSAT TT=3.193
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225122.opb	UNSAT TT=1.498	UNSAT TT=2.602	No data	No data	UNSAT TT=141.997	UNSAT TT=1.498	UNSAT TT=1.821	UNSAT TT=1.936	UNSAT TT=6.393	UNSAT TT=2.625	UNSAT TT=3.157
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225605.opb	UNSAT TT=2.29	UNSAT TT=10.052	No data	No data	UNSAT TT=126.353	UNSAT TT=2.29	UNSAT TT=2.937	UNSAT TT=2.93	UNSAT TT=6.063	UNSAT TT=2.815	UNSAT TT=3.801
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226062.opb	UNSAT TT=2.016	UNSAT TT=4.512	No data	No data	UNSAT TT=112.551	UNSAT TT=2.016	UNSAT TT=2.861	UNSAT TT=2.862	UNSAT TT=5.754	UNSAT TT=2.564	UNSAT TT=3.196
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226241.opb	SAT TT=0.11 T1=0.11	SAT TT=6.324 T1=6.32	No data	No data	SAT TT=14.749 T1=14.75	SAT TT=3.082 T1=3.08	SAT TT=0.11 T1=0.11	SAT TT=0.122 T1=0.12	SAT TT=6.882 T1=2.25	SAT TT=2.485 T1=1.87	SAT TT=0.985 T1=0.95
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226284.opb	SAT TT=0.774 T1=0.74	SAT TT=1.884 T1=1.88	No data	No data	SAT TT=8.791 T1=8.79	SAT TT=2.228 T1=2.22	SAT TT=2.138 T1=2.13	SAT TT=2.134 T1=2.13	SAT TT=6.393 T1=2.2	SAT TT=1.633 T1=0.96	SAT TT=0.774 T1=0.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226368.opb	UNSAT TT=1.315	UNSAT TT=1.688	No data	No data	UNSAT TT=115.26	UNSAT TT=1.315	UNSAT TT=2.421	UNSAT TT=2.426	UNSAT TT=5.494	UNSAT TT=2.036	UNSAT TT=3.208
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226680.opb	UNSAT TT=2.423	UNSAT TT=5.865	No data	No data	UNSAT TT=133.972	UNSAT TT=2.425	UNSAT TT=3.207	UNSAT TT=3.199	UNSAT TT=6.253	UNSAT TT=2.423	UNSAT TT=3.366
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227012.opb	UNSAT TT=2.519	UNSAT TT=5.496	No data	No data	UNSAT TT=108.754	UNSAT TT=2.519	UNSAT TT=2.927	UNSAT TT=2.907	UNSAT TT=6.84	UNSAT TT=3.215	UNSAT TT=3.646
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227326.opb	UNSAT TT=1.021	UNSAT TT=1.021	No data	No data	UNSAT TT=125.752	UNSAT TT=1.132	UNSAT TT=1.335	UNSAT TT=1.37	UNSAT TT=5.05	UNSAT TT=2.28	UNSAT TT=2.988
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227418.opb	SAT TT=0.288 T1=0.29	SAT TT=0.966 T1=0.96	No data	No data	SAT TT=23.271 T1=23.27	SAT TT=2.292 T1=2.29	SAT TT=0.292 T1=0.29	SAT TT=0.288 T1=0.29	SAT TT=3.552 T1=1.19	SAT TT=1.214 T1=0.76	SAT TT=1.415 T1=1.48
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227861.opb	UNSAT TT=1.781	UNSAT TT=1.781	No data	No data	UNSAT TT=152.487	UNSAT TT=2.548	UNSAT TT=2.794	UNSAT TT=2.794	UNSAT TT=6.804	UNSAT TT=2.834	UNSAT TT=3.707
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111228076.opb	UNSAT TT=3.344	UNSAT TT=7.38	No data	No data	UNSAT TT=152.585	UNSAT TT=4.011	UNSAT TT=5.569	UNSAT TT=5.55	UNSAT TT=7.657	UNSAT TT=3.344	UNSAT TT=5.379
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14bt.opb	SAT TT=0.362 T1=0.36	SAT TT=444.48 T1=444.54	No data	No data	SAT TT=67.364 T1=67.37	SAT TT=47.558 T1=47.56	SAT TT=0.362 T1=0.36	SAT TT=0.365 T1=0.36	SAT TT=26.254 T1=12.6	SAT TT=695.025 T1=693.63	SAT TT=412.131 T1=412.16
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14ls.opb	SAT TT=1.616 T1=1.61	? (TO) TT=1800.02	No data	No data	SAT TT=4.589 T1=4.58	SAT TT=6.373 T1=6.37	SAT TT=1.616 T1=1.61	SAT TT=1.632 T1=1.63	SAT TT=769.847 T1=382.86	? (TO) TT=1800.07	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17bt.opb	SAT TT=14.713 T1=14.71	? (TO) TT=1800.02	No data	No data	SAT TT=21.702 T1=21.7	SAT TT=16.997 T1=16.99	SAT TT=14.713 T1=14.71	SAT TT=14.734 T1=14.73	? (TO) TT=1800.82	SAT TT=1007.96 T1=1005.41	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17ls.opb	SAT TT=7.485 T1=7.48	? (TO) TT=1800.01	No data	No data	SAT TT=10.702 T1=10.7	SAT TT=57.229 T1=57.23	SAT TT=7.54 T1=7.54	SAT TT=7.485 T1=7.48	SAT TT=461.705 T1=229.22	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21bt.opb	SAT TT=246.703 T1=246.74	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=246.703 T1=246.74	SAT TT=260.797 T1=260.83	? (TO) TT=1800.17	? (TO) TT=1800.65	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21ls.opb	SAT TT=43.185 T1=43.19	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=43.185 T1=43.19	SAT TT=43.675 T1=43.68	? (TO) TT=1800.14	? (TO) TT=1800.83	? (TO) TT=1800.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24bt.opb	SAT TT=110.139 T1=110.16	? (TO) TT=1800.02	No data	No data	SAT TT=368.04 T1=368.09	? (TO) TT=1800.02	SAT TT=110.139 T1=110.16	SAT TT=113.575 T1=113.59	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24ls.opb	SAT TT=33.55 T1=33.55	? (TO) TT=1800.02	No data	No data	SAT TT=108.657 T1=108.67	SAT TT=33.55 T1=33.55	SAT TT=114.001 T1=114.01	SAT TT=112.701 T1=112.71	? (TO) TT=1800.74	? (TO) TT=1800.09	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9bt.opb	SAT TT=0.019 T1=0.01	SAT TT=0.019 T1=0.01	No data	No data	SAT TT=0.091 T1=0.09	SAT TT=0.07 T1=0.07	SAT TT=0.189 T1=0.18	SAT TT=0.189 T1=0.18	SAT TT=6.867 T1=3	SAT TT=1.63 T1=1.3	SAT TT=4.606 T1=4.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9ls.opb	SAT TT=0.106 T1=0.1	SAT TT=0.893 T1=0.89	No data	No data	SAT TT=0.147 T1=0.14	SAT TT=0.667 T1=0.66	SAT TT=0.106 T1=0.1	SAT TT=0.106 T1=0.1	SAT TT=5.274 T1=1.71	SAT TT=0.806 T1=0.71	SAT TT=4.208 T1=4.15
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12bt.opb	SAT TT=0.223 T1=0.22	SAT TT=16.838 T1=16.84	No data	No data	SAT TT=0.223 T1=0.22	SAT TT=12.511 T1=12.51	SAT TT=2.414 T1=2.41	SAT TT=2.421 T1=2.42	SAT TT=16.97 T1=7.29	SAT TT=7.323 T1=6.71	SAT TT=80.146 T1=80.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12ls.opb	SAT TT=0.296 T1=0.29	SAT TT=193.308 T1=193.34	No data	No data	SAT TT=0.296 T1=0.29	SAT TT=1.103 T1=1.1	SAT TT=0.424 T1=0.42	SAT TT=0.421 T1=0.42	SAT TT=70.714 T1=34.24	SAT TT=420.741 T1=419.68	SAT TT=788.332 T1=788.42
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/ robin/normalized-robin10.opb	SAT TT=0.569 T1=0.56	SAT TT=1.632 T1=1.63	No data	No data	SAT TT=0.569 T1=0.56	SAT TT=0.648 T1=0.64	SAT TT=10.008 T1=10	SAT TT=10.024 T1=10.02	SAT TT=4.643 T1=1.88	SAT TT=1.324 T1=0.64	SAT TT=1.03 T1=1.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/ robin/normalized-robin12.opb	SAT TT=4.827 T1=4.1	SAT TT=30.964 T1=30.96	No data	No data	SAT TT=29.503 T1=29.5	SAT TT=34.874 T1=34.87	SAT TT=141.231 T1=141.25	SAT TT=135.854 T1=135.87	SAT TT=56.752 T1=29.26	SAT TT=4.827 T1=4.1	SAT TT=12.4 T1=12.38
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/ robin/normalized-robin14.opb	SAT TT=671.634 T1=671.87	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.76	SAT TT=1789.45 T1=1764.04	SAT TT=671.634 T1=671.87
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/ robin/normalized-robin16.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.72	? (TO) TT=1800.18
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/ robin/normalized-robin18.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.76	? (TO) TT=1800.2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/ robin/normalized-robin8.opb	SAT TT=0.065 T1=0.06	SAT TT=0.065 T1=0.06	No data	No data	SAT TT=0.126 T1=0.12	SAT TT=0.164 T1=0.16	SAT TT=0.229 T1=0.23	SAT TT=0.23 T1=0.23	SAT TT=1.754 T1=0.78	SAT TT=0.726 T1=0.63	SAT TT=0.068 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-101-100.opb	UNSAT TT=0.119	UNSAT TT=0.119	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=17.24	? (TO) TT=1800.76	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-105-100.opb	UNSAT TT=0.128	UNSAT TT=0.128	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=1.713	? (TO) TT=1800.09	? (TO) TT=1800.15
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-11-10.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=13.773	UNSAT TT=0.335	UNSAT TT=0.649	UNSAT TT=0.643	UNSAT TT=0.244	UNSAT TT=205.07	UNSAT TT=645.293
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-15-10.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=3.276	UNSAT TT=0.56	UNSAT TT=1.105	UNSAT TT=1.112	UNSAT TT=0.175	UNSAT TT=412.641	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-21-20.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.444	? (TO) TT=1800	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-25-20.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	UNSAT TT=0.324	? (TO) TT=1800.73	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-31-30.opb	UNSAT TT=0.015	UNSAT TT=0.015	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.954	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-35-30.opb	UNSAT TT=0.016	UNSAT TT=0.016	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.514	? (TO) TT=1800.84	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-41-40.opb	UNSAT TT=0.02	UNSAT TT=0.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.376	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-45-40.opb	UNSAT TT=0.02	UNSAT TT=0.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.683	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-51-50.opb	UNSAT TT=0.027	UNSAT TT=0.027	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.883	? (TO) TT=1800.04	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-55-50.opb	UNSAT TT=0.028	UNSAT TT=0.028	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=1.165	? (TO) TT=1800.76	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-61-60.opb	UNSAT TT=0.037	UNSAT TT=0.037	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=2.665	? (TO) TT=1800.65	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-65-60.opb	UNSAT TT=0.038	UNSAT TT=0.038	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.214	? (TO) TT=1800.08	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-71-70.opb	UNSAT TT=0.05	UNSAT TT=0.05	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1802.29	UNSAT TT=4.222	? (TO) TT=1800.03	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-75-70.opb	UNSAT TT=0.053	UNSAT TT=0.053	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.03	UNSAT TT=1.415	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-81-80.opb	UNSAT TT=0.067	UNSAT TT=0.067	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=7.202	? (TO) TT=1800.79	? (TO) TT=1800.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-85-80.opb	UNSAT TT=0.084	UNSAT TT=0.084	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	UNSAT TT=1.523	? (TO) TT=1800	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-91-90.opb	UNSAT TT=0.09	UNSAT TT=0.09	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.12	UNSAT TT=11.172	? (TO) TT=1800.09	? (TO) TT=1800.12
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-cardinality-95-90.opb	UNSAT TT=0.097	UNSAT TT=0.097	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.74	UNSAT TT=1.663	? (TO) TT=1800.96	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-22s.smv.opb	UNSAT TT=0.088	UNSAT TT=0.088	No data	No data	UNSAT TT=0.529	UNSAT TT=7.772	UNSAT TT=2.306	UNSAT TT=2.311	UNSAT TT=2.084	UNSAT TT=1.203	UNSAT TT=0.986
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-25s.smv.opb	UNSAT TT=0.069	UNSAT TT=0.069	No data	No data	UNSAT TT=0.426	UNSAT TT=5.827	UNSAT TT=2.249	UNSAT TT=2.248	UNSAT TT=1.994	UNSAT TT=1.044	UNSAT TT=0.481
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-37s.smv.opb	UNSAT TT=0.029	UNSAT TT=0.029	No data	No data	UNSAT TT=0.067	UNSAT TT=0.242	UNSAT TT=0.041	UNSAT TT=0.041	UNSAT TT=1.023	UNSAT TT=0.764	UNSAT TT=0.199
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-43s.smv.opb	UNSAT TT=0.129	UNSAT TT=0.129	No data	No data	UNSAT TT=0.291	UNSAT TT=3.93	UNSAT TT=1.716	UNSAT TT=1.706	UNSAT TT=3.203	UNSAT TT=1.296	UNSAT TT=1.115
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-44s.smv.opb	UNSAT TT=0.016	UNSAT TT=0.016	No data	No data	UNSAT TT=0.037	UNSAT TT=0.401	UNSAT TT=0.057	UNSAT TT=0.059	UNSAT TT=1.044	UNSAT TT=0.564	UNSAT TT=0.09
normalized-PB06/SATUNSAT-SMALLINT/ web/ uclid_pb_benchmarks/normalized-46s.smv.opb	UNSAT TT=0.04	UNSAT TT=0.04	No data	No data	UNSAT TT=0.122	UNSAT TT=1.179	UNSAT TT=0.191	UNSAT TT=0.191	UNSAT TT=1.744	UNSAT TT=0.935	UNSAT TT=0.318
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-2.ucl.opb	UNSAT TT=0.009	UNSAT TT=0.01	No data	No data	UNSAT TT=0.009	UNSAT TT=0.158	UNSAT TT=0.083	UNSAT TT=0.084	UNSAT TT=1.114	UNSAT TT=0.443	UNSAT TT=0.058
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-3.ucl.opb	UNSAT TT=0.003	UNSAT TT=0.01	No data	No data	UNSAT TT=0.009	UNSAT TT=0.003	UNSAT TT=0.012	UNSAT TT=0.014	UNSAT TT=0.275	UNSAT TT=0.253	UNSAT TT=0.023
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-4.ucl.opb	UNSAT TT=0.003	UNSAT TT=0.011	No data	No data	UNSAT TT=0.007	UNSAT TT=0.003	UNSAT TT=0.033	UNSAT TT=0.035	UNSAT TT=0.264	UNSAT TT=0.235	UNSAT TT=0.02
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-6.ucl.opb	UNSAT TT=0.015	UNSAT TT=0.015	No data	No data	UNSAT TT=0.043	UNSAT TT=1.173	UNSAT TT=0.387	UNSAT TT=0.389	UNSAT TT=0.875	UNSAT TT=0.685	UNSAT TT=0.11
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-7.ucl.opb	UNSAT TT=0.035	UNSAT TT=0.035	No data	No data	UNSAT TT=0.302	UNSAT TT=48.71	UNSAT TT=9.768	UNSAT TT=9.83	UNSAT TT=1.164	UNSAT TT=0.794	UNSAT TT=0.18
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-floppy1-8.ucl.opb	UNSAT TT=0.04	UNSAT TT=0.04	No data	No data	UNSAT TT=0.179	UNSAT TT=0.208	UNSAT TT=12.153	UNSAT TT=12.302	UNSAT TT=1.374	UNSAT TT=0.923	UNSAT TT=0.217
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan2.ucl.opb	UNSAT TT=0.031	UNSAT TT=0.031	No data	No data	UNSAT TT=0.179	UNSAT TT=8.422	UNSAT TT=1.157	UNSAT TT=1.16	UNSAT TT=1.295	UNSAT TT=1.224	UNSAT TT=0.216
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-blast-tlan3.ucl.opb	UNSAT TT=0.164	UNSAT TT=0.164	No data	No data	UNSAT TT=1.219	UNSAT TT=0.515	UNSAT TT=6.67	UNSAT TT=6.722	UNSAT TT=2.954	UNSAT TT=1.803	UNSAT TT=1.152
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl.opb	UNSAT TT=53.252	? (TO) TT=1800.03	No data	No data	UNSAT TT=53.252	UNSAT TT=225.322	UNSAT TT=222.064	UNSAT TT=207.56	? (TO) TT=1800.01	UNSAT TT=812.361	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl.opb	UNSAT TT=5.698	UNSAT TT=6.882	No data	No data	UNSAT TT=5.698	UNSAT TT=50.062	UNSAT TT=15.846	UNSAT TT=15.848	UNSAT TT=55.506	UNSAT TT=38.149	UNSAT TT=132.829
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Icl2arity.ucl.opb	UNSAT TT=0.835	UNSAT TT=0.835	No data	No data	UNSAT TT=1.574	UNSAT TT=11.461	UNSAT TT=2.307	UNSAT TT=2.291	UNSAT TT=7.553	UNSAT TT=2.794	UNSAT TT=14.455
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih1arity.ucl.opb	UNSAT TT=55.624	? (TO) TT=1800.01	No data	No data	UNSAT TT=55.624	UNSAT TT=376.761	UNSAT TT=403.441	UNSAT TT=392.94	? (TO) TT=1800.11	UNSAT TT=923.7	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ih2arity.ucl.opb	SAT TT=0.923 T1=0.9	SAT TT=0.923 T1=0.9	No data	No data	SAT TT=4.799 T1=4.76	SAT TT=95.685 T1=95.6	SAT TT=5.735 T1=5.66	SAT TT=5.732 T1=5.65	SAT TT=7.083 T1=3.4	SAT TT=3.832 T1=2.59	SAT TT=8.571 T1=8.44
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv10.ucl.opb	UNSAT TT=0.104	UNSAT TT=0.104	No data	No data	UNSAT TT=0.418	UNSAT TT=0.425	UNSAT TT=0.11	UNSAT TT=0.11	UNSAT TT=2.713	UNSAT TT=1.133	UNSAT TT=0.663
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv12.ucl.opb	UNSAT TT=1.61	UNSAT TT=25.798	No data	No data	UNSAT TT=1.719	UNSAT TT=1.61	UNSAT TT=2.206	UNSAT TT=2.191	UNSAT TT=26.101	UNSAT TT=10.591	UNSAT TT=61.824
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv14.ucl.opb	UNSAT TT=99.91	? (TO) TT=1800.02	No data	No data	UNSAT TT=122.439	UNSAT TT=99.91	UNSAT TT=143.793	UNSAT TT=141.303	? (TO) TT=1800.84	UNSAT TT=1604.29	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-cache.inv8.ucl.opb	UNSAT TT=0.029	UNSAT TT=0.033	No data	No data	UNSAT TT=0.084	UNSAT TT=0.077	UNSAT TT=0.029	UNSAT TT=0.029	UNSAT TT=1.555	UNSAT TT=0.645	UNSAT TT=0.133
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl.opb	UNSAT TT=0.29	UNSAT TT=0.291	No data	No data	UNSAT TT=0.461	UNSAT TT=1.531	UNSAT TT=0.29	UNSAT TT=0.291	UNSAT TT=4.312	UNSAT TT=1.937	UNSAT TT=2.251
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem.ucl.opb	UNSAT TT=0.276	UNSAT TT=0.276	No data	No data	UNSAT TT=0.543	UNSAT TT=1.566	UNSAT TT=0.444	UNSAT TT=0.441	UNSAT TT=3.462	UNSAT TT=1.684	UNSAT TT=2.678
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-dlx1c.ucl.opb	UNSAT TT=0.14	UNSAT TT=0.14	No data	No data	UNSAT TT=0.373	UNSAT TT=1.363	UNSAT TT=0.262	UNSAT TT=0.263	UNSAT TT=2.714	UNSAT TT=1.494	UNSAT TT=0.949
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf10.ucl.opb	UNSAT TT=3.067	UNSAT TT=3.067	No data	No data	UNSAT TT=3.413	UNSAT TT=14.798	UNSAT TT=3.292	UNSAT TT=3.305	UNSAT TT=11.702	UNSAT TT=4.693	UNSAT TT=23.679
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf6.ucl.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.185	UNSAT TT=0.172	UNSAT TT=0.017
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf7.ucl.opb	UNSAT TT=0.024	UNSAT TT=0.024	No data	No data	UNSAT TT=0.072	UNSAT TT=0.206	UNSAT TT=0.029	UNSAT TT=0.034	UNSAT TT=0.994	UNSAT TT=0.613	UNSAT TT=0.119
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf8.ucl.opb	UNSAT TT=0.088	UNSAT TT=0.088	No data	No data	UNSAT TT=0.344	UNSAT TT=1.457	UNSAT TT=0.18	UNSAT TT=0.182	UNSAT TT=2.234	UNSAT TT=1.175	UNSAT TT=0.538
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-elf.rf9.ucl.opb	UNSAT TT=0.447	UNSAT TT=0.447	No data	No data	UNSAT TT=1.198	UNSAT TT=5.6	UNSAT TT=0.64	UNSAT TT=0.646	UNSAT TT=3.632	UNSAT TT=2.055	UNSAT TT=3.278
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.2.accl.ucl.opb	UNSAT TT=0.291	UNSAT TT=0.77	No data	No data	UNSAT TT=0.291	UNSAT TT=1.27	UNSAT TT=1.189	UNSAT TT=1.186	UNSAT TT=7.29	UNSAT TT=2.454	UNSAT TT=6.455
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.3.accl.ucl.opb	UNSAT TT=0.865	UNSAT TT=3.52	No data	No data	UNSAT TT=0.865	UNSAT TT=3.383	UNSAT TT=3.921	UNSAT TT=3.988	UNSAT TT=11.761	UNSAT TT=4.402	UNSAT TT=20.333
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.4.accl.ucl.opb	UNSAT TT=0.103	UNSAT TT=0.103	No data	No data	UNSAT TT=0.268	UNSAT TT=2.285	UNSAT TT=0.359	UNSAT TT=0.36	UNSAT TT=3.504	UNSAT TT=1.634	UNSAT TT=0.565
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.6.accl.ucl.opb	UNSAT TT=477.303	? (TO) TT=1800.1	No data	No data	UNSAT TT=489.47	UNSAT TT=477.303	UNSAT TT=923.75	UNSAT TT=959.686	? (TO) TT=1800.05	UNSAT TT=583.905	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.8.accl.ucl.opb	UNSAT TT=61.157	? (TO) TT=1800.02	No data	No data	UNSAT TT=61.157	UNSAT TT=122.528	UNSAT TT=216.423	UNSAT TT=190.479	UNSAT TT=463.753	UNSAT TT=193.13	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/web/ uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.RobRegValid_bar.ucl.opb	UNSAT TT=6.301	UNSAT TT=179.854	No data	No data	UNSAT TT=6.301	UNSAT TT=169.183	UNSAT TT=45.136	UNSAT TT=45.39	UNSAT TT=77.371	UNSAT TT=22.162	UNSAT TT=131.046
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl.opb	UNSAT TT=40.521	? (TO) TT=1800.02	No data	No data	UNSAT TT=40.521	UNSAT TT=1449.56	UNSAT TT=472.589	UNSAT TT=495.587	UNSAT TT=786.752	UNSAT TT=354.14	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl.opb	UNSAT TT=34.559	? (TO) TT=1800.02	No data	No data	UNSAT TT=34.559	? (TO) TT=1800.05	UNSAT TT=305.186	UNSAT TT=344.729	UNSAT TT=607.091	UNSAT TT=294.009	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LsqHdStrong.ucl.opb	UNSAT TT=62.995	? (TO) TT=1800.11	No data	No data	UNSAT TT=62.995	? (TO) TT=1800.06	UNSAT TT=1321.3	UNSAT TT=1298.24	? (TO) TT=1800.18	? (TO) TT=1800.77	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf10.ucl.opb	UNSAT TT=2.392	UNSAT TT=10.574	No data	No data	UNSAT TT=2.392	UNSAT TT=4.463	UNSAT TT=5.828	UNSAT TT=5.917	UNSAT TT=31.559	UNSAT TT=16.241	UNSAT TT=348.415
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf6.ucl.opb	UNSAT TT=0.034	UNSAT TT=0.034	No data	No data	UNSAT TT=0.096	UNSAT TT=0.107	UNSAT TT=0.035	UNSAT TT=0.035	UNSAT TT=1.483	UNSAT TT=0.834	UNSAT TT=0.245
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf7.ucl.opb	UNSAT TT=0.096	UNSAT TT=0.096	No data	No data	UNSAT TT=0.203	UNSAT TT=0.661	UNSAT TT=0.103	UNSAT TT=0.106	UNSAT TT=3.943	UNSAT TT=1.164	UNSAT TT=0.954
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf8.ucl.opb	UNSAT TT=0.232	UNSAT TT=0.334	No data	No data	UNSAT TT=0.39	UNSAT TT=1.019	UNSAT TT=0.233	UNSAT TT=0.232	UNSAT TT=4.004	UNSAT TT=1.704	UNSAT TT=3.458
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.rf9.ucl.opb	UNSAT TT=0.762	UNSAT TT=1.42	No data	No data	UNSAT TT=0.762	UNSAT TT=1.687	UNSAT TT=0.951	UNSAT TT=0.962	UNSAT TT=13.552	UNSAT TT=4.892	UNSAT TT=23.041
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag10.ucl.opb	UNSAT TT=0.504	UNSAT TT=0.663	No data	No data	UNSAT TT=0.894	UNSAT TT=1.874	UNSAT TT=0.504	UNSAT TT=0.504	UNSAT TT=21.661	UNSAT TT=6.303	UNSAT TT=45.578
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag12.ucl.opb	UNSAT TT=1.582	UNSAT TT=4.577	No data	No data	UNSAT TT=3.571	UNSAT TT=3.159	UNSAT TT=1.643	UNSAT TT=1.582	UNSAT TT=103.977	UNSAT TT=62.41	UNSAT TT=183.174
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag14.ucl.opb	UNSAT TT=4.165	UNSAT TT=12.741	No data	No data	UNSAT TT=22.036	UNSAT TT=8.87	UNSAT TT=4.165	UNSAT TT=4.215	UNSAT TT=425.25	UNSAT TT=110.41	UNSAT TT=489.829
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.tag8.ucl.opb	UNSAT TT=0.205	UNSAT TT=0.567	No data	No data	UNSAT TT=0.205	UNSAT TT=0.678	UNSAT TT=0.346	UNSAT TT=0.372	UNSAT TT=6.705	UNSAT TT=2.423	UNSAT TT=4.307
normalized-PB06/SATUNSAT-SMALLINT/ web/uclid_pb_benchmarks/ normalized-ooo.unbounded.all.ucl.opb	UNSAT TT=31.401	? (TO) TT=1800.02	No data	No data	UNSAT TT=31.401	UNSAT TT=845.324	UNSAT TT=160.95	UNSAT TT=160.755	UNSAT TT=622.92	UNSAT TT=214.432	UNSAT TT=1675.13
normalized-PB06/SATUNSAT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ ppp-problems/normalized-ppp:1-11,19,21.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.86	? (TO) TT=1800.62	? (TO) TT=1800.14
normalized-PB06/SATUNSAT-SMALLINT/web/www.ps.uni-sb.de/ ~walser/benchmarks/ppp-problems/normalized-ppp:1-12,16.opb	SAT TT=0.285 T1=0.28	SAT TT=7.277 T1=7.27	No data	No data	SAT TT=0.772 T1=0.76	SAT TT=0.862 T1=0.86	SAT TT=0.285 T1=0.28	SAT TT=0.285 T1=0.28	SAT TT=3.224 T1=1.16	SAT TT=1.544 T1=0.72	SAT TT=2.27 T1=2.21
normalized-PB06/SATUNSAT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ ppp-problems/normalized-ppp:1-13.opb	SAT TT=2.363 T1=1.33	? (TO) TT=1800.1	No data	No data	SAT TT=15.221 T1=15.21	SAT TT=291.59 T1=291.62	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=6.003 T1=2.14	SAT TT=2.363 T1=1.33	SAT TT=4.303 T1=4.24
normalized-PB06/SATUNSAT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ ppp-problems/normalized-ppp:1,3-13,19.opb	SAT TT=2.105 T1=1.11	? (TO) TT=1800.01	No data	No data	SAT TT=12.279 T1=12.27	SAT TT=36.32 T1=36.32	SAT TT=181.861 T1=181.88	SAT TT=182.664 T1=182.68	SAT TT=4.043 T1=1.64	SAT TT=2.105 T1=1.11	SAT TT=3.595 T1=3.54
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/SATUNSAT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ ppp-problems/normalized-ppp:1-9,16-19.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ ppp-problems/normalized-ppp:3-13,25,26.opb	SAT TT=5.472 T1=4.14	? (TO) TT=1800.02	No data	No data	SAT TT=34.377 T1=34.39	SAT TT=533.582 T1=533.65	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=9.754 T1=4.14	SAT TT=5.472 T1=4.4	SAT TT=44.097 T1=44.04
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir03_trarea_ac.opb	SAT f=25559 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=28536 TT=1800.1 T1=1800.4	SAT (TO) f=25559 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=25891 TT=1800.24 T1=896.37	SAT (TO) f=26944 TT=1800.44 T1=1795.36	? (TO) TT=1800.04
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir04_trarea_ac.opb	SAT f=44391 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=44391 TT=1800.01 T1=1800.3	SAT (TO) f=44391 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=48034 TT=1800.13 T1=172.41	SAT (TO) f=54315 TT=1800.01 T1=1560.11	? (TO) TT=1800.05
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir05_trarea_ac.opb	SAT f=49818 TT=1800.03 T1=187.1	No data	No data	No data	SAT (TO) f=52178 TT=1800.11 T1=1800.4	SAT (TO) f=52178 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=49818 TT=1800.03 T1=187.1	SAT (TO) f=52176 TT=1800 T1=0.57	? (TO) TT=1800.05
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir06_trarea_ac.opb	SAT f=37056 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=37056 TT=1800.08 T1=1800.4	SAT (TO) f=37056 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=41798 TT=1800.1 T1=668.55	SAT (TO) f=46416 TT=1800.63 T1=1.22	? (TO) TT=1800.05
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir07_trarea_ac.opb	SAT f=59533 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=60948 TT=1800.08 T1=1800.4	SAT (TO) f=59533 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=61582 TT=1800.33 T1=859.9	SAT (TO) f=68835 TT=1800.06 T1=0.56	? (TO) TT=1800.02
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir08_trarea_ac.opb	SAT f=88571 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=88571 TT=1800.12 T1=1800.4	SAT (TO) f=88571 TT=1800.3 T1=1800.4	No data	No data	SAT (TO) f=93924 TT=1800.47 T1=618.37	SAT (TO) f=93328 TT=1800.51 T1=32.09	? (TO) TT=1800.1
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir09_trarea_ac.opb	SAT f=61123 TT=1800.75 T1=87.04	No data	No data	No data	SAT (TO) f=69675 TT=1800.09 T1=1800.4	SAT (TO) f=71212 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=61123 TT=1800.75 T1=87.04	SAT (TO) f=63681 TT=1800.02 T1=0.61	? (TO) TT=1800.04
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/ aksoy/trarea_ac/normalized-fir10_trarea_ac.opb	SAT f=91798 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=91798 TT=1800.08 T1=1800.4	SAT (TO) f=91890 TT=1800.23 T1=1800.3	No data	No data	SAT (TO) f=101676 TT=1800.47 T1=454.32	SAT (TO) f=105498 TT=1800.67 T1=1.14	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir03_trarea_ac.opb	OPT f=11452 TT=0.665 T1=0.66	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=13630 TT=1800.02 T1=1800.3	OPT f=11452 TT=1061.19 T1=1061.26	OPT f=11452 TT=0.665 T1=0.66	? TT=71.386	SAT (TO) f=12444 TT=1800.04 T1=1007.28	SAT (TO) f=12581 TT=1800.03 T1=1681.6	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir04_trarea_ac.opb	OPT f=12940 TT=0.214 T1=0.21	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT (TO) f=13939 TT=1800.02 T1=1800.3	SAT (TO) f=13939 TT=1800.08 T1=1800.4	OPT f=12940 TT=0.214 T1=0.21	? TT=84.151	SAT (TO) f=13426 TT=1800.18 T1=388.41	SAT (TO) f=16802 TT=1800.41 T1=1114.59	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir05_trarea_ac.opb	OPT f=23670 TT=0.122 T1=0.12	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=26086 TT=1800.11 T1=1800.4	SAT (TO) f=26086 TT=1800.09 T1=1800.4	OPT f=23670 TT=0.122 T1=0.12	? TT=83.265	SAT (TO) f=24702 TT=1800.78 T1=142.93	SAT (TO) f=26087 TT=1800.51 T1=0.58	OPT f=23670 TT=1252.03 T1=1065.68
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir06_trarea_ac.opb	OPT f=4812 TT=8.859 T1=8.84	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=5330 TT=1800.1 T1=1800.4	SAT (TO) f=5330 TT=1800.04 T1=1800.4	OPT f=4812 TT=8.859 T1=8.84	? TT=64.347	SAT (TO) f=5670 TT=1800.17 T1=457.67	SAT (TO) f=6679 TT=1800.04 T1=0.97	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir07_trarea_ac.opb	OPT f=15079 TT=83.745 T1=83.76	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=18319 TT=1800.02 T1=1800.3	SAT (TO) f=17893 TT=1800.09 T1=1800.4	OPT f=15079 TT=83.745 T1=83.76	? TT=90.271	SAT (TO) f=18612 TT=1800.04 T1=291.21	SAT (TO) f=20692 TT=1800.64 T1=0.55	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir08_trarea_ac.opb	SAT f=1772 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=2225 TT=1800.15 T1=1800.4	SAT (TO) f=2225 TT=1800.08 T1=1800.4	SAT (TO) f=1772 TT=1800.06 T1=1800.4	SAT (TO) f=2178 TT=1800.06 T1=1800.4	SAT (TO) f=2323 TT=1800.05 T1=219.47	SAT (TO) f=2356 TT=1800.59 T1=1.13	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir09_trarea_ac.opb	SAT f=8820 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT (TO) f=12052 TT=1800.1 T1=1800.4	SAT (TO) f=12318 TT=1800.06 T1=1800.4	SAT (TO) f=8820 TT=1800.02 T1=1800.3	? TT=75.518	SAT (TO) f=10467 TT=1800.08 T1=505.42	SAT (TO) f=11017 TT=1800.03 T1=0.6	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-LIN/reduced/ submittedPB07/aksoy/trarea_ac/ normalized-reduced-fir10_trarea_ac.opb	SAT f=1691 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=2051 TT=1800.12 T1=1800.4	SAT (TO) f=2053 TT=1800.08 T1=1800.4	SAT (TO) f=1691 TT=1800.09 T1=1800.4	SAT (TO) f=2156 TT=1800.06 T1=1800.4	SAT (TO) f=2209 TT=1800.37 T1=701.21	SAT (TO) f=2300 TT=1800.82 T1=1.18	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir01_area_delay.opb	OPT f=5 TT=0.002 T1=0	No data	OPT f=5 TT=0.026 T1=0.02	OPT f=5 TT=0.013 T1=0.01	OPT f=5 TT=0.01 T1=0	OPT f=5 TT=0.007 T1=0	OPT f=5 TT=0.002 T1=0	OPT f=5 TT=0.003 T1=0	OPT f=5 TT=0.544 T1=0.65	OPT f=5 TT=0.433 T1=0.15	OPT f=5 TT=0.026 T1=0.02
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir02_area_delay.opb	OPT f=8 TT=0.008 T1=0	No data	OPT f=8 TT=0.109 T1=0.1	OPT f=8 TT=0.145 T1=0.14	OPT f=8 TT=0.255 T1=0.25	OPT f=8 TT=0.103 T1=0.1	OPT f=8 TT=0.008 T1=0	OPT f=8 TT=0.024 T1=0.02	OPT f=8 TT=10.461 T1=3.3	OPT f=8 TT=5.142 T1=1.18	OPT f=8 TT=0.125 T1=0.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir03_area_delay.opb	OPT f=10 TT=0.058 T1=0.05	No data	OPT f=10 TT=0.906 T1=0.89	OPT f=10 TT=2.168 T1=2.16	OPT f=10 TT=15.55 T1=15.54	OPT f=10 TT=5.098 T1=5.09	OPT f=10 TT=0.058 T1=0.05	OPT f=10 TT=1.528 T1=1.53	OPT f=10 TT=1297.09 T1=113.89	SAT (TO) f=12 TT=1800.03 T1=1186.2	OPT f=10 TT=1727.36 T1=1727.85
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir04_area_delay.opb	OPT f=12 TT=0.011 T1=0.01	No data	OPT f=12 TT=3.764 T1=3.76	OPT f=12 TT=77.893 T1=77.9	OPT f=12 TT=0.403 T1=0.4	OPT f=12 TT=0.174 T1=0.17	OPT f=12 TT=0.011 T1=0.01	OPT f=12 TT=0.098 T1=0.1	SAT (TO) f=12 TT=1800.75 T1=7.81	SAT (TO) f=13 TT=1800.59 T1=131.55	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir05_area_delay.opb	OPT f=14 TT=0.065 T1=0.06	No data	OPT f=14 TT=581.017 T1=581.11	? (TO) TT=1800.03	OPT f=14 TT=181.91 T1=181.93	OPT f=14 TT=180.207 T1=180.22	OPT f=14 TT=0.065 T1=0.06	OPT f=14 TT=28.359 T1=28.36	SAT (TO) f=14 TT=1800.64 T1=317.74	SAT (TO) f=15 TT=1800.01 T1=1374.29	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir06_area_delay.opb	OPT f=15 TT=0.081 T1=0.08	No data	OPT f=15 TT=273.629 T1=273.64	OPT f=15 TT=1495.26 T1=1495.48	SAT (TO) f=15 TT=1800.02 T1=1800.3	OPT f=15 TT=75.39 T1=75.39	OPT f=15 TT=0.081 T1=0.08	OPT f=15 TT=19.21 T1=19.21	SAT (TO) f=16 TT=1800.56 T1=559.92	SAT (TO) f=19 TT=1800.55 T1=0.57	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir07_area_delay.opb	OPT f=16 TT=1.194 T1=1.19	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=20 TT=1800.07 T1=1800.4	SAT (TO) f=16 TT=1800.1 T1=1800.4	OPT f=16 TT=1.194 T1=1.19	SAT (TO) f=16 TT=1800.03 T1=1800.3	SAT (TO) f=21 TT=1800.37 T1=591.13	No Cert. TT=1800.04	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir08_area_delay.opb	OPT f=23 TT=28.684 T1=28.65	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=34 TT=1800.09 T1=1800.4	SAT (TO) f=35 TT=1800.1 T1=1800.4	OPT f=23 TT=28.684 T1=28.65	SAT (TO) f=29 TT=1800.11 T1=1800.4	SAT (TO) f=43 TT=1800.73 T1=5.01	No Cert. TT=1800.06	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir09_area_delay.opb	OPT f=17 TT=0.791 T1=0.78	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=23 TT=1800.07 T1=1800.4	SAT (TO) f=23 TT=1800.1 T1=1800.4	OPT f=17 TT=0.791 T1=0.78	SAT (TO) f=17 TT=1800.01 T1=1800.3	SAT (TO) f=22 TT=1800.59 T1=182.86	SAT (TO) f=24 TT=1800.03 T1=0.91	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_delay/ normalized-fir10_area_delay.opb	OPT f=27 TT=2.688 T1=2.67	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=36 TT=1800.09 T1=1800.4	SAT (TO) f=36 TT=1800.06 T1=1800.3	OPT f=27 TT=2.688 T1=2.67	SAT (TO) f=31 TT=1800.03 T1=1800.3	SAT (TO) f=42 TT=1800.57 T1=649.6	No Cert. TT=1800.05	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir01_area_opers.opb	OPT f=10 TT=0.002 T1=0	No data	OPT f=10 TT=0.025 T1=0.02	OPT f=10 TT=0.014 T1=0.01	OPT f=10 TT=0.017 T1=0.01	OPT f=10 TT=0.019 T1=0.01	OPT f=10 TT=0.002 T1=0	OPT f=10 TT=0.002 T1=0	OPT f=10 TT=1.906 T1=1.68	OPT f=10 TT=1.053 T1=0.32	OPT f=10 TT=0.036 T1=0.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir02_area_opers.opb	OPT f=18 TT=0.014 T1=0.01	No data	OPT f=18 TT=8.772 T1=8.76	OPT f=18 TT=0.176 T1=0.17	OPT f=18 TT=0.348 T1=0.34	OPT f=18 TT=0.223 T1=0.22	OPT f=18 TT=0.014 T1=0.01	OPT f=18 TT=0.024 T1=0.02	SAT (TO) f=18 TT=1800.64 T1=27.34	SAT (TO) f=20 TT=1800.07 T1=600.75	OPT f=18 TT=0.172 T1=0.15
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir03_area_opers.opb	OPT f=17 TT=0.109 T1=0.1	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=17 TT=36.187 T1=36.18	OPT f=17 TT=2.179 T1=2.16	OPT f=17 TT=0.109 T1=0.1	OPT f=17 TT=0.255 T1=0.25	SAT (TO) f=19 TT=1800.63 T1=110.61	SAT (TO) f=25 TT=1800.09 T1=0.68	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir04_area_opers.opb	OPT f=29 TT=0.016 T1=0.01	No data	OPT f=29 TT=284.668 T1=284.71	OPT f=29 TT=0.074 T1=0.07	OPT f=29 TT=0.443 T1=0.44	OPT f=29 TT=0.314 T1=0.31	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.037 T1=0.03	SAT (TO) f=29 TT=1800.56 T1=401.2	SAT (TO) f=35 TT=1800.02 T1=643.83	OPT f=29 TT=195.654 T1=195.62
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir05_area_opers.opb	OPT f=35 TT=0.07 T1=0.06	No data	OPT f=35 TT=1.319 T1=1.3	OPT f=35 TT=45.151 T1=45.15	SAT (TO) f=35 TT=1800.01 T1=1800.3	OPT f=35 TT=1.783 T1=1.77	OPT f=35 TT=0.07 T1=0.06	OPT f=35 TT=0.16 T1=0.15	SAT (TO) f=36 TT=1800.52 T1=758.99	SAT (TO) f=41 TT=1800 T1=1594.03	OPT f=35 TT=0.855 T1=0.83
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir06_area_opers.opb	OPT f=23 TT=0.139 T1=0.13	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=25 TT=1800.09 T1=1800.4	OPT f=23 TT=6.039 T1=6.01	OPT f=23 TT=0.139 T1=0.13	OPT f=23 TT=1.05 T1=1.04	SAT (TO) f=25 TT=1800.33 T1=885.32	SAT (TO) f=36 TT=1800.08 T1=617.75	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir07_area_opers.opb	OPT f=32 TT=0.261 T1=0.25	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT (TO) f=33 TT=1800.09 T1=1800.4	OPT f=32 TT=19.838 T1=19.77	OPT f=32 TT=0.261 T1=0.25	OPT f=32 TT=1.508 T1=1.5	SAT (TO) f=39 TT=1800.45 T1=698.08	SAT (TO) f=52 TT=1800.05 T1=0.99	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir08_area_opers.opb	OPT f=48 TT=45.575 T1=45.51	No data	Signal TT=688.771	? (TO) TT=1800.04	SAT (TO) f=54 TT=1800.05 T1=1800.3	SAT (TO) f=54 TT=1800.17 T1=1800.4	OPT f=48 TT=45.575 T1=45.51	OPT f=48 TT=899.769 T1=899.87	SAT (TO) f=80 TT=1801.03 T1=680.51	No Cert. TT=1800.32	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir09_area_opers.opb	OPT f=34 TT=0.91 T1=0.9	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT (TO) f=43 TT=1800.09 T1=1800.5	OPT f=34 TT=120.788 T1=120.76	OPT f=34 TT=0.91 T1=0.9	OPT f=34 TT=13.728 T1=13.72	SAT (TO) f=55 TT=1801.48 T1=414.32	SAT (TO) f=57 TT=1800.06 T1=33.15	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_opers/ normalized-fir10_area_opers.opb	OPT f=51 TT=3.09 T1=3.06	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=55 TT=1800.11 T1=1800.4	SAT (TO) f=51 TT=1800.1 T1=1800.4	OPT f=51 TT=3.09 T1=3.06	OPT f=51 TT=128.696 T1=128.69	SAT (TO) f=85 TT=1800.72 T1=713.4	No Cert. TT=1800.73	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir02_area_partials.opb	OPT f=19 TT=0.001 T1=0	No data	OPT f=19 TT=0.023 T1=0.02	OPT f=19 TT=0.013 T1=0.01	OPT f=19 TT=0.003 T1=0	OPT f=19 TT=0.004 T1=0	OPT f=19 TT=0.001 T1=0	OPT f=19 TT=0.002 T1=0	OPT f=19 TT=0.205 T1=0.65	OPT f=19 TT=0.213 T1=0.17	OPT f=19 TT=0.033 T1=0.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir03_area_partials.opb	OPT f=18 TT=0.019 T1=0.01	No data	OPT f=18 TT=0.076 T1=0.07	OPT f=18 TT=0.031 T1=0.03	OPT f=18 TT=0.096 T1=0.09	OPT f=18 TT=0.1 T1=0.1	OPT f=18 TT=0.019 T1=0.01	OPT f=18 TT=0.023 T1=0.02	OPT f=18 TT=2.323 T1=1.35	OPT f=18 TT=1.024 T1=0.46	OPT f=18 TT=0.319 T1=0.3
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir04_area_partials.opb	OPT f=30 TT=0.001 T1=0	No data	OPT f=30 TT=0.021 T1=0.02	OPT f=30 TT=0.013 T1=0.01	OPT f=30 TT=0.001 T1=0	OPT f=30 TT=0.001 T1=0	OPT f=30 TT=0.002 T1=0	OPT f=30 TT=0.001 T1=0	OPT f=30 TT=0.174 T1=0.63	OPT f=30 TT=0.173 T1=0.13	OPT f=30 TT=0.036 T1=0.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir05_area_partials.opb	OPT f=36 TT=0.007 T1=0	No data	OPT f=36 TT=0.033 T1=0.03	OPT f=36 TT=0.019 T1=0.01	OPT f=36 TT=0.023 T1=0.02	OPT f=36 TT=0.027 T1=0.02	OPT f=36 TT=0.007 T1=0	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.604 T1=1.26	OPT f=36 TT=0.445 T1=0.28	OPT f=36 TT=0.155 T1=0.14
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir06_area_partials.opb	OPT f=24 TT=0.013 T1=0.01	No data	OPT f=24 TT=0.038 T1=0.03	OPT f=24 TT=0.021 T1=0.02	OPT f=24 TT=0.046 T1=0.04	OPT f=24 TT=0.058 T1=0.05	OPT f=24 TT=0.013 T1=0.01	OPT f=24 TT=0.017 T1=0.01	OPT f=24 TT=2.083 T1=1.27	OPT f=24 TT=1.264 T1=0.72	OPT f=24 TT=2.191 T1=2.14
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir07_area_partials.opb	OPT f=33 TT=0.003 T1=0	No data	OPT f=33 TT=0.026 T1=0.02	OPT f=33 TT=0.017 T1=0.01	OPT f=33 TT=0.02 T1=0.01	OPT f=33 TT=0.013 T1=0.01	OPT f=33 TT=0.003 T1=0	OPT f=33 TT=0.004 T1=0	OPT f=33 TT=0.594 T1=2.19	OPT f=33 TT=0.373 T1=0.2	OPT f=33 TT=0.125 T1=0.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir08_area_partials.opb	OPT f=49 TT=1.417 T1=1.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	OPT f=49 TT=22.96 T1=22.94	OPT f=49 TT=9.914 T1=9.95	OPT f=49 TT=1.417 T1=1.4	OPT f=49 TT=3.578 T1=3.56	SAT (TO) f=49 TT=1800.65 T1=361	SAT (TO) f=52 TT=1800.08 T1=13.34	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir09_area_partials.opb	OPT f=35 TT=0.129 T1=0.12	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	OPT f=35 TT=1.53 T1=1.52	OPT f=35 TT=0.64 T1=0.63	OPT f=35 TT=0.129 T1=0.12	OPT f=35 TT=0.313 T1=0.31	OPT f=35 TT=38.378 T1=18.15	OPT f=35 TT=16.551 T1=11.33	OPT f=35 TT=358.014 T1=277.26
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/area_partials/ normalized-fir10_area_partials.opb	OPT f=52 TT=0.131 T1=0.13	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	OPT f=52 TT=1.939 T1=1.95	OPT f=52 TT=1.41 T1=1.4	OPT f=52 TT=0.131 T1=0.13	OPT f=52 TT=1.205 T1=1.2	OPT f=52 TT=1747.81 T1=9.4	OPT f=52 TT=885.44 T1=147.79	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_10.opb	SAT f=24 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=24 TT=1800.09 T1=1800.4	SAT (TO) f=25 TT=1800.05 T1=1800.4	SAT (TO) f=31 TT=1800.07 T1=1800.6	SAT (TO) f=24 TT=1800.12 T1=1800.4	SAT (TO) f=27 TT=1800.69 T1=216.53	SAT (TO) f=29 TT=1800.59 T1=1.42	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_1.opb	OPT f=23 TT=816.709 T1=816.83	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=24 TT=1800.05 T1=1800.4	SAT (TO) f=23 TT=1800.02 T1=1800.3	OPT f=23 TT=816.709 T1=816.83	OPT f=23 TT=1504.67 T1=1504.9	SAT (TO) f=27 TT=1800.87 T1=2.1	SAT (TO) f=27 TT=1800.06 T1=0.85	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_2.opb	OPT f=19 TT=101.732 T1=101.74	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=19 TT=1670.17 T1=1670.43	OPT f=19 TT=546.751 T1=546.83	OPT f=19 TT=115.129 T1=115.14	OPT f=19 TT=101.732 T1=101.74	SAT (TO) f=23 TT=1800.62 T1=172.13	SAT (TO) f=26 TT=1800.08 T1=0.57	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_3.opb	OPT f=21 TT=73.168 T1=73.17	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	OPT f=21 TT=1486.31 T1=1486.53	OPT f=21 TT=222.179 T1=222.21	OPT f=21 TT=73.168 T1=73.17	OPT f=21 TT=89.561 T1=89.57	SAT (TO) f=24 TT=1800.41 T1=731.04	SAT (TO) f=26 TT=1800.05 T1=0.49	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_4.opb	SAT f=24 TT=1800.13 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=31 TT=1800.05 T1=1800.4	SAT (TO) f=35 TT=1800.11 T1=1800.4	SAT (TO) f=31 TT=1800.12 T1=1800.4	SAT (TO) f=24 TT=1800.13 T1=1800.4	SAT (TO) f=28 TT=1800.78 T1=94.54	SAT (TO) f=33 TT=1800.01 T1=2.24	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_5.opb	OPT f=20 TT=4.768 T1=4.76	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=20 TT=525.753 T1=525.83	OPT f=20 TT=66.038 T1=66.04	OPT f=20 TT=4.768 T1=4.76	OPT f=20 TT=21.544 T1=21.54	SAT (TO) f=23 TT=1800.74 T1=331.51	SAT (TO) f=26 TT=1800.59 T1=0.54	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_6.opb	OPT f=20 TT=20.007 T1=20	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	OPT f=20 TT=279.584 T1=279.63	OPT f=20 TT=89.062 T1=89.06	OPT f=20 TT=20.007 T1=20	OPT f=20 TT=31.826 T1=31.83	SAT (TO) f=22 TT=1800.7 T1=196.01	SAT (TO) f=27 TT=1800.63 T1=0.53	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_7.opb	OPT f=21 TT=109.001 T1=109.01	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.09 T1=1800.4	OPT f=21 TT=512.209 T1=512.27	OPT f=21 TT=155.03 T1=155.05	OPT f=21 TT=109.001 T1=109.01	SAT (TO) f=24 TT=1800.87 T1=1.36	SAT (TO) f=24 TT=1800.07 T1=0.65	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_8.opb	OPT f=18 TT=4.243 T1=4.32	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	OPT f=18 TT=106.515 T1=106.53	OPT f=18 TT=42.697 T1=42.7	OPT f=18 TT=12.232 T1=12.23	OPT f=18 TT=4.243 T1=4.32	SAT (TO) f=22 TT=1800.88 T1=35.12	SAT (TO) f=24 TT=1800.05 T1=0.56	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/decomp/ normalized-matrix_5x3_9.opb	OPT f=21 TT=223.698 T1=223.73	No data	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=22 TT=1800.08 T1=1800.4	SAT (TO) f=25 TT=1800.11 T1=1800.4	OPT f=21 TT=235.481 T1=235.51	OPT f=21 TT=223.698 T1=223.73	SAT (TO) f=26 TT=1802.25 T1=13.34	SAT (TO) f=28 TT=1800.07 T1=0.67	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/trarea_ac/ normalized-fir01_trarea_ac.opb	OPT f=13949 TT=0.01 T1=0.01	No data	OPT f=13949 TT=0.955 T1=0.95	OPT f=13949 TT=0.557 T1=0.55	OPT f=13949 TT=30.461 T1=30.46	OPT f=13949 TT=2.46 T1=2.44	OPT f=13949 TT=0.01 T1=0.01	? TT=66.337	OPT f=13949 TT=4.064 T1=2.7	OPT f=13949 TT=1.943 T1=0.2	OPT f=13949 TT=0.716 T1=0.54
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/aksoy/trarea_ac/ normalized-fir02_trarea_ac.opb	OPT f=24890 TT=0.086 T1=0.08	No data	OPT f=24890 TT=245.968 T1=246	OPT f=24890 TT=64.702 T1=64.71	SAT (TO) f=26876 TT=1800.02 T1=1800.3	SAT (TO) f=24986 TT=1800.1 T1=1800.4	OPT f=24890 TT=0.086 T1=0.08	? TT=72.211	SAT (TO) f=24890 TT=1800.65 T1=8.27	SAT (TO) f=27723 TT=1800.05 T1=1227.78	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_001_area_delay.opb	OPT f=28 TT=0.926 T1=0.92	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=34 TT=1800.02 T1=1800.3	OPT f=28 TT=76.608 T1=76.59	OPT f=28 TT=0.926 T1=0.92	OPT f=28 TT=4.046 T1=4.04	SAT (TO) f=36 TT=1800.74 T1=174.11	SAT (TO) f=39 TT=1800 T1=1.16	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_002_area_delay.opb	OPT f=24 TT=0.099 T1=0.1	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=27 TT=1800.02 T1=1800.3	OPT f=24 TT=8.817 T1=8.8	OPT f=24 TT=0.099 T1=0.1	OPT f=24 TT=0.907 T1=0.9	SAT (TO) f=28 TT=1800.46 T1=821.93	SAT (TO) f=35 TT=1800.03 T1=0.99	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_003_area_delay.opb	OPT f=26 TT=0.123 T1=0.12	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=28 TT=1800.02 T1=1800.3	OPT f=26 TT=6.108 T1=6.09	OPT f=26 TT=0.123 T1=0.12	OPT f=26 TT=1.502 T1=1.5	SAT (TO) f=31 TT=1800.13 T1=354.22	SAT (TO) f=39 TT=1800.01 T1=0.85	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_004_area_delay.opb	OPT f=27 TT=0.248 T1=0.24	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=30 TT=1800.02 T1=1800.3	OPT f=27 TT=3.942 T1=3.93	OPT f=27 TT=0.248 T1=0.24	OPT f=27 TT=0.965 T1=0.96	SAT (TO) f=29 TT=1800.1 T1=614.64	SAT (TO) f=37 TT=1800.03 T1=1.51	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_005_area_delay.opb	OPT f=26 TT=0.708 T1=0.7	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=33 TT=1800.08 T1=1800.5	OPT f=26 TT=61.416 T1=61.38	OPT f=26 TT=0.708 T1=0.7	OPT f=26 TT=2.616 T1=2.61	SAT (TO) f=37 TT=1800.61 T1=402.63	No Cert. TT=1800.02	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_006_area_delay.opb	OPT f=22 TT=0.047 T1=0.04	No data	? (TO) TT=1800.08	OPT f=22 TT=9.705 T1=9.7	OPT f=22 TT=3.788 T1=3.78	OPT f=22 TT=1.21 T1=1.2	OPT f=22 TT=0.047 T1=0.04	OPT f=22 TT=0.268 T1=0.26	SAT (TO) f=23 TT=1800.1 T1=259.11	SAT (TO) f=28 TT=1800.48 T1=58.46	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_007_area_delay.opb	OPT f=26 TT=0.459 T1=0.45	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=33 TT=1800.02 T1=1800.3	OPT f=26 TT=39.127 T1=39.1	OPT f=26 TT=0.459 T1=0.45	OPT f=26 TT=3.706 T1=3.7	SAT (TO) f=33 TT=1800.57 T1=503.13	SAT (TO) f=35 TT=1800.07 T1=0.77	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_008_area_delay.opb	OPT f=25 TT=0.249 T1=0.24	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	OPT f=25 TT=16.343 T1=16.34	OPT f=25 TT=4.997 T1=4.99	OPT f=25 TT=0.249 T1=0.24	OPT f=25 TT=0.917 T1=0.91	SAT (TO) f=28 TT=1800.55 T1=478.14	SAT (TO) f=38 TT=1800.08 T1=0.59	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_009_area_delay.opb	OPT f=24 TT=0.08 T1=0.08	No data	? (TO) TT=1800.03	OPT f=24 TT=514.53 T1=514.6	SAT (TO) f=25 TT=1800.07 T1=1800.4	OPT f=24 TT=1.737 T1=1.72	OPT f=24 TT=0.08 T1=0.08	OPT f=24 TT=0.242 T1=0.24	SAT (TO) f=27 TT=1800.15 T1=798.75	SAT (TO) f=35 TT=1800.54 T1=1790.28	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_010_area_delay.opb	OPT f=26 TT=4.162 T1=4.16	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=31 TT=1800.09 T1=1800.4	OPT f=26 TT=63.713 T1=63.73	OPT f=26 TT=4.162 T1=4.16	OPT f=26 TT=10.355 T1=10.35	SAT (TO) f=35 TT=1800.15 T1=253.65	SAT (TO) f=40 TT=1800.66 T1=0.76	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_011_area_delay.opb	OPT f=26 TT=0.205 T1=0.2	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=31 TT=1800.11 T1=1800.4	OPT f=26 TT=14.27 T1=14.24	OPT f=26 TT=0.205 T1=0.2	OPT f=26 TT=1.076 T1=1.07	SAT (TO) f=34 TT=1800.24 T1=877.99	SAT (TO) f=40 TT=1800.05 T1=351.92	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_012_area_delay.opb	OPT f=27 TT=0.707 T1=0.7	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=34 TT=1800.09 T1=1800.4	OPT f=27 TT=28.087 T1=28.06	OPT f=27 TT=0.707 T1=0.7	OPT f=27 TT=7.605 T1=7.6	SAT (TO) f=42 TT=1800.45 T1=218.01	SAT (TO) f=45 TT=1800.01 T1=32.97	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_013_area_delay.opb	OPT f=22 TT=0.985 T1=0.98	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=25 TT=1800.1 T1=1800.5	OPT f=22 TT=18.289 T1=18.23	OPT f=22 TT=0.985 T1=0.98	OPT f=22 TT=2.527 T1=2.52	SAT (TO) f=30 TT=1800.47 T1=754.7	No Cert. TT=1800.03	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_014_area_delay.opb	OPT f=27 TT=1.229 T1=1.23	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=29 TT=1800.02 T1=1800.3	OPT f=27 TT=20.654 T1=20.64	OPT f=27 TT=1.229 T1=1.23	OPT f=27 TT=2.179 T1=2.17	SAT (TO) f=32 TT=1800.43 T1=662.08	SAT (TO) f=42 TT=1800.06 T1=0.52	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_015_area_delay.opb	OPT f=25 TT=0.162 T1=0.16	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=26 TT=1800.02 T1=1800.3	OPT f=25 TT=7.734 T1=7.72	OPT f=25 TT=0.162 T1=0.16	OPT f=25 TT=1.232 T1=1.23	SAT (TO) f=29 TT=1800.07 T1=713.19	SAT (TO) f=38 TT=1800.01 T1=0.63	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_016_area_delay.opb	OPT f=25 TT=0.299 T1=0.29	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=26 TT=1800.02 T1=1800.3	OPT f=25 TT=7.229 T1=7.21	OPT f=25 TT=0.299 T1=0.29	OPT f=25 TT=1.358 T1=1.35	SAT (TO) f=28 TT=1800.15 T1=825.89	SAT (TO) f=35 TT=1800.04 T1=0.81	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_017_area_delay.opb	OPT f=25 TT=1.532 T1=1.52	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=31 TT=1800.01 T1=1800.3	OPT f=25 TT=23.366 T1=23.35	OPT f=25 TT=1.532 T1=1.52	OPT f=25 TT=7.065 T1=7.06	SAT (TO) f=30 TT=1800.68 T1=393.81	SAT (TO) f=35 TT=1800.76 T1=7.02	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_018_area_delay.opb	OPT f=25 TT=0.07 T1=0.07	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=25 TT=7.654 T1=7.65	OPT f=25 TT=1.992 T1=1.98	OPT f=25 TT=0.07 T1=0.07	OPT f=25 TT=0.356 T1=0.35	SAT (TO) f=27 TT=1800.53 T1=481.95	SAT (TO) f=33 TT=1800.02 T1=0.66	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_019_area_delay.opb	OPT f=24 TT=0.167 T1=0.16	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=26 TT=1800.01 T1=1800.3	OPT f=24 TT=11.014 T1=11	OPT f=24 TT=0.167 T1=0.16	OPT f=24 TT=1.533 T1=1.54	SAT (TO) f=27 TT=1800.52 T1=684.98	SAT (TO) f=37 TT=1800.06 T1=0.63	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_020_area_delay.opb	OPT f=23 TT=0.072 T1=0.07	No data	? (TO) TT=1800.15	? (TO) TT=1800.02	OPT f=23 TT=9.297 T1=9.29	OPT f=23 TT=1.647 T1=1.64	OPT f=23 TT=0.072 T1=0.07	OPT f=23 TT=0.286 T1=0.28	SAT (TO) f=24 TT=1800.49 T1=235.28	SAT (TO) f=33 TT=1800.09 T1=0.54	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_021_area_delay.opb	OPT f=24 TT=0.138 T1=0.13	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=26 TT=1800.11 T1=1800.4	OPT f=24 TT=6.258 T1=6.24	OPT f=24 TT=0.138 T1=0.13	OPT f=24 TT=1.119 T1=1.11	SAT (TO) f=26 TT=1800.03 T1=794.48	SAT (TO) f=34 TT=1800.07 T1=0.6	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_022_area_delay.opb	OPT f=26 TT=0.19 T1=0.19	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=29 TT=1800.02 T1=1800.3	OPT f=26 TT=7.912 T1=7.89	OPT f=26 TT=0.19 T1=0.19	OPT f=26 TT=1.383 T1=1.38	SAT (TO) f=31 TT=1800.49 T1=524.98	SAT (TO) f=36 TT=1800.06 T1=16.27	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_023_area_delay.opb	OPT f=22 TT=3.577 T1=3.57	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=25 TT=1800.1 T1=1800.4	OPT f=22 TT=26.857 T1=26.8	OPT f=22 TT=3.577 T1=3.57	OPT f=22 TT=5.915 T1=5.91	SAT (TO) f=32 TT=1800.13 T1=847.9	SAT (TO) f=35 TT=1800.78 T1=1.45	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_024_area_delay.opb	OPT f=24 TT=0.166 T1=0.16	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=24 TT=13.816 T1=13.81	OPT f=24 TT=4.313 T1=4.3	OPT f=24 TT=0.166 T1=0.16	OPT f=24 TT=1.291 T1=1.29	SAT (TO) f=27 TT=1800.19 T1=519.72	SAT (TO) f=32 TT=1800.02 T1=0.49	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_025_area_delay.opb	OPT f=25 TT=0.605 T1=0.6	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=29 TT=1800.03 T1=1800.5	OPT f=25 TT=20.025 T1=19.99	OPT f=25 TT=0.605 T1=0.6	OPT f=25 TT=2.781 T1=2.78	SAT (TO) f=35 TT=1800.61 T1=555.62	SAT (TO) f=44 TT=1800.77 T1=1.07	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_026_area_delay.opb	OPT f=28 TT=1.949 T1=1.95	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=33 TT=1800.1 T1=1800.4	OPT f=28 TT=56.411 T1=56.39	OPT f=28 TT=1.949 T1=1.95	OPT f=28 TT=10.519 T1=10.52	SAT (TO) f=35 TT=1800.59 T1=197.76	SAT (TO) f=38 TT=1800.75 T1=0.67	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_027_area_delay.opb	OPT f=25 TT=0.156 T1=0.15	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=26 TT=1800.02 T1=1800.3	OPT f=25 TT=7.811 T1=7.8	OPT f=25 TT=0.156 T1=0.15	OPT f=25 TT=1.234 T1=1.23	SAT (TO) f=28 TT=1800.63 T1=580.74	SAT (TO) f=33 TT=1800.57 T1=11.04	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_028_area_delay.opb	OPT f=23 TT=0.712 T1=0.7	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=29 TT=1800.1 T1=1800.4	OPT f=23 TT=9.228 T1=9.17	OPT f=23 TT=0.712 T1=0.7	OPT f=23 TT=1.173 T1=1.16	SAT (TO) f=32 TT=1800.11 T1=492.88	SAT (TO) f=33 TT=1800.72 T1=1.25	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_029_area_delay.opb	OPT f=24 TT=0.543 T1=0.53	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=27 TT=1800.09 T1=1800.4	OPT f=24 TT=23.48 T1=23.43	OPT f=24 TT=0.543 T1=0.53	OPT f=24 TT=1.703 T1=1.7	SAT (TO) f=36 TT=1800.5 T1=504.96	SAT (TO) f=39 TT=1800.67 T1=1.4	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/manquinho/areaDelay/ normalized-f20c10b_030_area_delay.opb	OPT f=25 TT=0.127 T1=0.12	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=25 TT=1800.02 T1=1800.3	OPT f=25 TT=2.734 T1=2.72	OPT f=25 TT=0.127 T1=0.12	OPT f=25 TT=0.625 T1=0.62	SAT (TO) f=28 TT=1800.63 T1=626.24	SAT (TO) f=35 TT=1800.74 T1=2.56	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/poldner/PB/ testset/normalized-10_20.opb	OPT f=8034 TT=0.659 T1=0.26	No data	OPT f=8034 TT=2.793 T1=2.79	OPT f=8034 TT=0.659 T1=0.65	OPT f=8034 TT=274.711 T1=274.74	OPT f=8034 TT=42.366 T1=42.35	OPT f=8034 TT=119.353 T1=119.53	? TT=72.991	OPT f=8034 TT=8.012 T1=2.69	OPT f=8034 TT=4.623 T1=0.26	OPT f=8034 TT=98.819 T1=26.42
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/poldner/PB/ testset/normalized-11_22.opb	OPT f=8908 TT=3.323 T1=4.19	No data	OPT f=8908 TT=13.309 T1=13.31	OPT f=8908 TT=10.258 T1=10.26	SAT (TO) f=9471 TT=1800.02 T1=1800.3	OPT f=8908 TT=927.946 T1=928.09	SAT (TO) f=9514 TT=1800.02 T1=1800.3	? TT=67.532	OPT f=8908 TT=3.323 T1=4.19	OPT f=8908 TT=811.44 T1=807.72	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/poldner/PB/ testset/normalized-5_10.opb	OPT f=3951 TT=0.002 T1=0	No data	OPT f=3951 TT=0.029 T1=0.03	OPT f=3951 TT=0.016 T1=0.01	OPT f=3951 TT=0.768 T1=0.76	OPT f=3951 TT=0.483 T1=0.48	OPT f=3951 TT=0.002 T1=0	OPT f=3951 TT=8.832 T1=8.77	OPT f=3951 TT=0.503 T1=0.65	OPT f=3951 TT=0.273 T1=0.14	OPT f=3951 TT=0.169 T1=0.12
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/poldner/PB/ testset/normalized-6_12.opb	OPT f=5867 TT=0.008 T1=0	No data	OPT f=5867 TT=0.055 T1=0.05	OPT f=5867 TT=0.021 T1=0.02	OPT f=5867 TT=0.576 T1=0.57	OPT f=5867 TT=0.835 T1=0.83	OPT f=5867 TT=0.008 T1=0	OPT f=5867 TT=31.781 T1=31.63	OPT f=5867 TT=0.704 T1=1.64	OPT f=5867 TT=0.455 T1=0.15	OPT f=5867 TT=0.343 T1=0.23
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/poldner/PB/ testset/normalized-7_14.opb	OPT f=5148 TT=0.008 T1=0	No data	OPT f=5148 TT=0.208 T1=0.2	OPT f=5148 TT=0.616 T1=0.61	OPT f=5148 TT=16.934 T1=16.93	OPT f=5148 TT=6.155 T1=6.14	OPT f=5148 TT=0.008 T1=0	OPT f=5148 TT=260.108 T1=260.02	OPT f=5148 TT=1.085 T1=0.64	OPT f=5148 TT=2.233 T1=0.14	OPT f=5148 TT=23.43 T1=22.73
normalized-PB07/OPT-SMALLINT-LIN/ submittedPB07/poldner/PB/ testset/normalized-8_16.opb	OPT f=5852 TT=0.058 T1=0.05	No data	OPT f=5852 TT=4.157 T1=4.15	OPT f=5852 TT=2.105 T1=2.1	SAT (TO) f=5852 TT=1800.1 T1=1800.4	OPT f=5852 TT=1508.8 T1=1509.03	OPT f=5852 TT=0.058 T1=0.05	SAT (TO) f=5869 TT=1800.15 T1=1800.5	OPT f=5852 TT=4.803 T1=1.67	OPT f=5852 TT=1076.82 T1=0.51	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_25_1.opb	SAT f=-117 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-117 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-84 TT=1800.5 T1=472.53	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_25_2.opb	SAT f=-123 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-123 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-85 TT=1800.47 T1=764.77	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_25_3.opb	SAT f=-121 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-121 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-86 TT=1800.06 T1=542.04	? (TO) TT=1800.09	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_25_4.opb	SAT f=-122 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-122 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-78 TT=1800 T1=250.64	? (TO) TT=1800.03	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_25_5.opb	SAT f=-121 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-121 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-80 TT=1800.07 T1=104.7	? (TO) TT=1800.07	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_60_1.opb	SAT f=-65 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-65 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-48 TT=1800.05 T1=330.71	SAT (TO) f=-42 TT=1800.03 T1=314.76	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_60_2.opb	SAT f=-65 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-65 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-52 TT=1800.71 T1=62.8	SAT (TO) f=-41 TT=1800.05 T1=112.84	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_60_3.opb	SAT f=-65 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=-65 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=-43 TT=1800.07 T1=566.83	SAT (TO) f=-43 TT=1800.04 T1=1295.61	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_60_4.opb	SAT f=-65 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-65 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-45 TT=1800.61 T1=689.52	SAT (TO) f=-41 TT=1800.03 T1=118.47	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_1000_60_5.opb	SAT f=-66 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-66 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-47 TT=1800.12 T1=126.42	SAT (TO) f=-40 TT=1800.75 T1=1115.64	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_10_1.opb	SAT f=-25 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-25 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-23 TT=1800.02 T1=109.34	SAT (TO) f=-20 TT=1800.04 T1=103.11	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_10_2.opb	SAT f=-25 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-25 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-23 TT=1800.69 T1=173.41	SAT (TO) f=-20 TT=1800.07 T1=1649.94	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_10_3.opb	SAT f=-25 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-25 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-24 TT=1800.08 T1=355.74	SAT (TO) f=-20 TT=1800.09 T1=0.5	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_10_4.opb	SAT f=-25 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-25 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-24 TT=1800.03 T1=422.88	SAT (TO) f=-21 TT=1800.83 T1=818.75	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_10_5.opb	SAT f=-26 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-26 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-24 TT=1800.16 T1=748.32	SAT (TO) f=-21 TT=1800 T1=1257.33	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_25_1.opb	SAT f=-14 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-14 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.16 T1=122.5	SAT (TO) f=-13 TT=1800.07 T1=213.49	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_25_2.opb	SAT f=-13 TT=1800.02 T1=345.5	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.04 T1=345.5	SAT (TO) f=-13 TT=1800.75 T1=1445.71	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_25_3.opb	SAT f=-14 TT=1800.92 T1=84.17	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-14 TT=1800.92 T1=84.17	SAT (TO) f=-13 TT=1800.8 T1=595.93	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_25_4.opb	SAT f=-14 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-14 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=74.04	SAT (TO) f=-13 TT=1800.79 T1=525.18	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_100_25_5.opb	SAT f=-13 TT=1800.01 T1=112.04	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.8 T1=112.04	SAT (TO) f=-13 TT=1800.01 T1=520.35	? (TO) TT=1800.15
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_10_4_1.opb	OPT f=-3 TT=0.009 T1=0	No data	No data	No data	OPT f=-3 TT=0.009 T1=0	No data	No data	No data	OPT f=-3 TT=0.663 T1=1.14	OPT f=-3 TT=0.303 T1=0.15	OPT f=-3 TT=0.042 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_10_4_2.opb	OPT f=-3 TT=0.009 T1=0	No data	No data	No data	OPT f=-3 TT=0.009 T1=0	No data	No data	No data	OPT f=-3 TT=0.683 T1=1.14	OPT f=-3 TT=0.344 T1=0.15	OPT f=-3 TT=0.043 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_10_4_3.opb	OPT f=-3 TT=0.009 T1=0	No data	No data	No data	OPT f=-3 TT=0.009 T1=0	No data	No data	No data	OPT f=-3 TT=0.654 T1=1.14	OPT f=-3 TT=0.334 T1=0.14	OPT f=-3 TT=0.038 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_10_4_4.opb	OPT f=-4 TT=0.009 T1=0	No data	No data	No data	OPT f=-4 TT=0.009 T1=0	No data	No data	No data	OPT f=-4 TT=0.454 T1=1.64	OPT f=-4 TT=0.266 T1=0.16	OPT f=-4 TT=0.043 T1=0.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/bsg/ normalized-bsg_10_4_5.opb	OPT f=-4 TT=0.009 T1=0	No data	No data	No data	OPT f=-4 TT=0.009 T1=0	No data	No data	No data	OPT f=-4 TT=0.543 T1=1.15	OPT f=-4 TT=0.303 T1=0.17	OPT f=-4 TT=0.041 T1=0.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_10_1.opb	SAT f=-47 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-47 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-43 TT=1800.08 T1=384.86	SAT (TO) f=-34 TT=1800.04 T1=0.81	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_10_2.opb	SAT f=-48 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-48 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-42 TT=1800.5 T1=706.35	SAT (TO) f=-36 TT=1800.75 T1=0.9	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_10_3.opb	SAT f=-47 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-47 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-43 TT=1800.19 T1=201.1	SAT (TO) f=-36 TT=1800.03 T1=2.37	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_10_4.opb	SAT f=-47 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-47 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-42 TT=1800.05 T1=628.01	SAT (TO) f=-33 TT=1800.77 T1=76.02	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_10_5.opb	SAT f=-47 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-47 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-43 TT=1800.13 T1=635.05	SAT (TO) f=-34 TT=1800.76 T1=1.37	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_25_1.opb	SAT f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-24 TT=1800.1 T1=47.23	SAT (TO) f=-19 TT=1800.02 T1=1.61	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_25_2.opb	SAT f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-23 TT=1800.77 T1=53.28	SAT (TO) f=-16 TT=1800.03 T1=1.32	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_25_3.opb	SAT f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-22 TT=1800.04 T1=19.71	SAT (TO) f=-18 TT=1800.57 T1=1.94	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_25_4.opb	SAT f=-28 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-28 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-24 TT=1800.08 T1=217.09	SAT (TO) f=-18 TT=1800.7 T1=2.07	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_200_25_5.opb	SAT f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-28 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-23 TT=1800.8 T1=181.64	SAT (TO) f=-17 TT=1800.8 T1=1.46	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_10_1.opb	SAT f=-113 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-113 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-99 TT=1800.06 T1=341.82	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_10_2.opb	SAT f=-113 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-113 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-99 TT=1800.4 T1=726.26	SAT (TO) f=-72 TT=1800.59 T1=90.22	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_10_3.opb	SAT f=-112 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-112 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-98 TT=1800.54 T1=696.09	SAT (TO) f=-72 TT=1800.08 T1=153.96	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_10_4.opb	SAT f=-112 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-112 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-99 TT=1800.11 T1=804.19	SAT (TO) f=-73 TT=1800.03 T1=92.26	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_10_5.opb	SAT f=-113 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-113 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-98 TT=1800.11 T1=863.36	SAT (TO) f=-76 TT=1800.62 T1=103.24	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_25_1.opb	SAT f=-67 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-67 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-54 TT=1800 T1=353.79	SAT (TO) f=-38 TT=1800.06 T1=12.55	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_25_2.opb	SAT f=-67 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-67 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-54 TT=1800.17 T1=724.05	SAT (TO) f=-38 TT=1800.68 T1=128.43	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_25_3.opb	SAT f=-65 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-65 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-52 TT=1800.24 T1=859.44	SAT (TO) f=-38 TT=1800.73 T1=1679.56	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_25_4.opb	SAT f=-67 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-67 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-52 TT=1800.45 T1=684.86	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_25_5.opb	SAT f=-65 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-65 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-52 TT=1800.02 T1=513.39	SAT (TO) f=-42 TT=1800.02 T1=459.68	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_60_1.opb	SAT f=-36 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-36 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-30 TT=1800.02 T1=643.04	SAT (TO) f=-23 TT=1800 T1=17.44	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_60_2.opb	SAT f=-36 TT=1800.03 T1=1800.4	No data	No data	No data	SAT (TO) f=-36 TT=1800.03 T1=1800.4	No data	No data	No data	SAT (TO) f=-29 TT=1800.14 T1=302.49	SAT (TO) f=-23 TT=1800.02 T1=10.29	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_60_3.opb	SAT f=-36 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-36 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-30 TT=1800.08 T1=754.34	SAT (TO) f=-21 TT=1800.73 T1=43.23	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_60_4.opb	SAT f=-35 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-35 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-29 TT=1800.02 T1=532.99	SAT (TO) f=-21 TT=1800.06 T1=34.53	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_500_60_5.opb	SAT f=-35 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-35 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-29 TT=1800.5 T1=350.25	SAT (TO) f=-20 TT=1800.8 T1=14.12	? (TO) TT=1800.14
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_10_1.opb	SAT f=-14 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-14 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.98 T1=148.32	SAT (TO) f=-13 TT=1800.02 T1=818.02	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_10_2.opb	SAT f=-13 TT=1800.02 T1=89.28	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.13 T1=89.28	SAT (TO) f=-12 TT=1800.03 T1=35.25	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_10_3.opb	SAT f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-12 TT=1800.16 T1=6.26	SAT (TO) f=-12 TT=1800.9 T1=9.08	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_10_4.opb	SAT f=-13 TT=1800.02 T1=7.26	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.06 T1=7.26	SAT (TO) f=-12 TT=1800.07 T1=61.85	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_10_5.opb	SAT f=-13 TT=1800.02 T1=9.27	No data	No data	No data	SAT (TO) f=-13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-13 TT=1800.14 T1=9.27	SAT (TO) f=-12 TT=1800.08 T1=90.48	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_25_1.opb	OPT f=-6 TT=491.539 T1=1.4	No data	No data	No data	OPT f=-6 TT=533.009 T1=533.1	No data	No data	No data	OPT f=-6 TT=922.104 T1=1.84	OPT f=-6 TT=491.539 T1=1.4	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_25_2.opb	OPT f=-7 TT=406.881 T1=14.84	No data	No data	No data	OPT f=-7 TT=529.558 T1=529.64	No data	No data	No data	OPT f=-7 TT=811.361 T1=14.84	OPT f=-7 TT=406.881 T1=16.68	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_25_3.opb	OPT f=-7 TT=335.262 T1=6.84	No data	No data	No data	OPT f=-7 TT=335.262 T1=335.31	No data	No data	No data	OPT f=-7 TT=824.388 T1=6.84	OPT f=-7 TT=398.06 T1=12.81	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_25_4.opb	OPT f=-7 TT=480.73 T1=7.88	No data	No data	No data	OPT f=-7 TT=661.314 T1=661.41	No data	No data	No data	OPT f=-7 TT=875.561 T1=7.88	OPT f=-7 TT=480.73 T1=18.28	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ bsg/normalized-bsg_50_25_5.opb	OPT f=-6 TT=767.29 T1=1.69	No data	No data	No data	OPT f=-6 TT=940.457 T1=940.6	No data	No data	No data	OPT f=-6 TT=1289.4 T1=2.85	OPT f=-6 TT=767.29 T1=1.69	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_25_1.opb	SAT f=80 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=80 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=83 TT=1800.58 T1=560.79	SAT (TO) f=88 TT=1800.09 T1=61.76	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_25_2.opb	SAT f=80 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=80 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=85 TT=1800.62 T1=51.44	SAT (TO) f=89 TT=1800.77 T1=1.5	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_25_3.opb	SAT f=84 TT=1800.13 T1=796.43	No data	No data	No data	SAT (TO) f=84 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=84 TT=1800.42 T1=796.43	SAT (TO) f=90 TT=1800.77 T1=3.53	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_25_4.opb	SAT f=82 TT=1800.13 T1=1800.5	No data	No data	No data	SAT (TO) f=82 TT=1800.13 T1=1800.5	No data	No data	No data	SAT (TO) f=87 TT=1800.73 T1=117.52	SAT (TO) f=90 TT=1800.06 T1=1.15	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_25_5.opb	SAT f=78 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=78 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=85 TT=1800.51 T1=454.02	SAT (TO) f=89 TT=1800.78 T1=1.22	? (TO) TT=1800.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_60_1.opb	SAT f=42 TT=1800.06 T1=1800.5	No data	No data	No data	SAT (TO) f=42 TT=1800.06 T1=1800.5	No data	No data	No data	SAT (TO) f=43 TT=1800.12 T1=616.88	SAT (TO) f=47 TT=1800 T1=1.36	? (TO) TT=1800.14
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_60_2.opb	SAT f=43 TT=1800 T1=744.35	No data	No data	No data	SAT (TO) f=43 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=43 TT=1800 T1=744.35	SAT (TO) f=46 TT=1800.06 T1=1.67	? (TO) TT=1800.12
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_60_3.opb	SAT f=42 TT=1800.15 T1=1800.5	No data	No data	No data	SAT (TO) f=42 TT=1800.15 T1=1800.5	No data	No data	No data	SAT (TO) f=43 TT=1800.75 T1=10.76	SAT (TO) f=48 TT=1800.01 T1=126.22	? (TO) TT=1800.19
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_60_4.opb	SAT f=42 TT=1800.1 T1=1800.5	No data	No data	No data	SAT (TO) f=42 TT=1800.1 T1=1800.5	No data	No data	No data	SAT (TO) f=43 TT=1800.33 T1=668.76	SAT (TO) f=48 TT=1800.05 T1=1.34	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_1000_60_5.opb	SAT f=41 TT=1800.07 T1=1800.5	No data	No data	No data	SAT (TO) f=41 TT=1800.07 T1=1800.5	No data	No data	No data	SAT (TO) f=42 TT=1800.06 T1=198.73	SAT (TO) f=44 TT=1800.66 T1=1.48	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_10_1.opb	SAT f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.08 T1=46.81	SAT (TO) f=13 TT=1800.93 T1=287.86	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_10_2.opb	SAT f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.12 T1=665.92	SAT (TO) f=12 TT=1800.03 T1=598.81	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_10_3.opb	SAT f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.18 T1=252.87	SAT (TO) f=12 TT=1800.93 T1=25.92	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_10_4.opb	SAT f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=11 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.74 T1=20.36	SAT (TO) f=12 TT=1800.01 T1=66.4	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_10_5.opb	SAT f=11 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=11 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.05 T1=52.32	SAT (TO) f=12 TT=1800.64 T1=1462.3	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_25_1.opb	OPT f=5 TT=15.805 T1=15.81	No data	No data	No data	OPT f=5 TT=15.805 T1=15.81	No data	No data	No data	OPT f=5 TT=1390.18 T1=56.47	OPT f=5 TT=684.409 T1=168.65	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_25_2.opb	OPT f=5 TT=11.968 T1=11.96	No data	No data	No data	OPT f=5 TT=11.968 T1=11.96	No data	No data	No data	SAT (TO) f=6 TT=1800.87 T1=1.39	OPT f=5 TT=793.69 T1=255.88	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_25_3.opb	OPT f=5 TT=14.511 T1=14.51	No data	No data	No data	OPT f=5 TT=14.511 T1=14.51	No data	No data	No data	OPT f=5 TT=1287.99 T1=15.44	OPT f=5 TT=651.09 T1=95.78	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_25_4.opb	OPT f=5 TT=13.062 T1=13.06	No data	No data	No data	OPT f=5 TT=13.062 T1=13.06	No data	No data	No data	OPT f=5 TT=1111.59 T1=39.17	SAT (TO) f=6 TT=1800.08 T1=0.75	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_100_25_5.opb	OPT f=5 TT=38.594 T1=14.4	No data	No data	No data	OPT f=5 TT=38.594 T1=38.6	No data	No data	No data	OPT f=5 TT=1320.69 T1=14.4	SAT (TO) f=6 TT=1800.08 T1=0.56	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_10_4_1.opb	OPT f=2 TT=0.004 T1=0	No data	No data	No data	OPT f=2 TT=0.004 T1=0	No data	No data	No data	OPT f=2 TT=0.185 T1=1.14	OPT f=2 TT=0.174 T1=0.14	OPT f=2 TT=0.019 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_10_4_2.opb	OPT f=2 TT=0.004 T1=0	No data	No data	No data	OPT f=2 TT=0.004 T1=0	No data	No data	No data	OPT f=2 TT=0.173 T1=1.14	OPT f=2 TT=0.173 T1=0.13	OPT f=2 TT=0.02 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_10_4_3.opb	OPT f=2 TT=0.004 T1=0	No data	No data	No data	OPT f=2 TT=0.004 T1=0	No data	No data	No data	OPT f=2 TT=0.193 T1=1.16	OPT f=2 TT=0.173 T1=0.12	OPT f=2 TT=0.019 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_10_4_4.opb	OPT f=2 TT=0.003 T1=0	No data	No data	No data	OPT f=2 TT=0.003 T1=0	No data	No data	No data	OPT f=2 TT=0.185 T1=1.14	OPT f=2 TT=0.174 T1=0.15	OPT f=2 TT=0.021 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mds/ normalized-mds_10_4_5.opb	OPT f=2 TT=0.003 T1=0	No data	No data	No data	OPT f=2 TT=0.003 T1=0	No data	No data	No data	OPT f=2 TT=0.173 T1=1.13	OPT f=2 TT=0.174 T1=0.14	OPT f=2 TT=0.02 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_10_1.opb	SAT f=26 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=26 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=28 TT=1800.11 T1=2.89	SAT (TO) f=29 TT=1800.04 T1=57.91	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_10_2.opb	SAT f=27 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=27 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=28 TT=1800 T1=4.38	SAT (TO) f=29 TT=1800.08 T1=24.15	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_10_3.opb	SAT f=26 TT=1800.02 T1=66.69	No data	No data	No data	SAT (TO) f=26 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=27 TT=1800.06 T1=1.89	SAT (TO) f=26 TT=1800.63 T1=66.69	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_10_4.opb	SAT f=26 TT=1800.02 T1=22.43	No data	No data	No data	SAT (TO) f=26 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=26 TT=1800.65 T1=22.43	SAT (TO) f=29 TT=1800.06 T1=0.5	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_10_5.opb	SAT f=25 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=25 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=27 TT=1800.08 T1=3.37	SAT (TO) f=28 TT=1800.08 T1=0.73	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_25_1.opb	SAT f=12 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=14 TT=1800.1 T1=2.07	SAT (TO) f=14 TT=1800.03 T1=1.35	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_25_2.opb	SAT f=12 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=13 TT=1800.59 T1=133.72	SAT (TO) f=13 TT=1800.08 T1=322.04	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_25_3.opb	SAT f=13 TT=1800.02 T1=143.62	No data	No data	No data	SAT (TO) f=13 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=13 TT=1800.76 T1=182.73	SAT (TO) f=13 TT=1800.08 T1=143.62	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_25_4.opb	SAT f=12 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=13 TT=1800.83 T1=127.36	SAT (TO) f=13 TT=1800.63 T1=356.98	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_200_25_5.opb	SAT f=12 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=12 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=14 TT=1800.62 T1=34.12	SAT (TO) f=14 TT=1800.07 T1=171.16	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_10_1.opb	SAT f=67 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=67 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=73 TT=1800.68 T1=145.82	SAT (TO) f=75 TT=1800.74 T1=1263.56	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_10_2.opb	SAT f=71 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=71 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=76 TT=1800.04 T1=389.27	SAT (TO) f=82 TT=1800.04 T1=0.95	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_10_3.opb	SAT f=70 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=70 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=76 TT=1800.01 T1=807.37	SAT (TO) f=81 TT=1800.04 T1=1723.76	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_10_4.opb	SAT f=71 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=71 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=76 TT=1800.16 T1=5.62	SAT (TO) f=78 TT=1800.05 T1=1.19	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_10_5.opb	SAT f=72 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=72 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=77 TT=1800.03 T1=66.68	SAT (TO) f=86 TT=1800.04 T1=0.95	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_25_1.opb	SAT f=38 TT=1800.03 T1=1800.4	No data	No data	No data	SAT (TO) f=38 TT=1800.03 T1=1800.4	No data	No data	No data	SAT (TO) f=40 TT=1800.6 T1=86.76	SAT (TO) f=43 TT=1800.01 T1=1.47	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_25_2.opb	SAT f=39 TT=1800.54 T1=674.13	No data	No data	No data	SAT (TO) f=40 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=39 TT=1800.54 T1=674.13	SAT (TO) f=44 TT=1800.06 T1=1.23	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_25_3.opb	SAT f=38 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=38 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=40 TT=1800.58 T1=87.21	SAT (TO) f=41 TT=1800.08 T1=1075.87	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_25_4.opb	SAT f=39 TT=1800.08 T1=3.45	No data	No data	No data	SAT (TO) f=39 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=39 TT=1800.08 T1=3.45	SAT (TO) f=44 TT=1800.08 T1=984.63	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_25_5.opb	SAT f=38 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=38 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=40 TT=1800.04 T1=533.33	SAT (TO) f=46 TT=1800.08 T1=1.3	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_60_1.opb	SAT f=19 TT=1800.03 T1=1800.5	No data	No data	No data	SAT (TO) f=19 TT=1800.03 T1=1800.5	No data	No data	No data	SAT (TO) f=20 TT=1800.19 T1=128.76	SAT (TO) f=22 TT=1800.03 T1=1.55	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_60_2.opb	SAT f=19 TT=1800.04 T1=528.98	No data	No data	No data	SAT (TO) f=19 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=19 TT=1800.04 T1=528.98	SAT (TO) f=21 TT=1800.04 T1=1.33	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_60_3.opb	SAT f=19 TT=1800.07 T1=1800.5	No data	No data	No data	SAT (TO) f=19 TT=1800.07 T1=1800.5	No data	No data	No data	SAT (TO) f=20 TT=1800.08 T1=428.74	SAT (TO) f=22 TT=1800.01 T1=1.79	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_60_4.opb	SAT f=19 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=19 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=20 TT=1800.59 T1=230.52	SAT (TO) f=22 TT=1800.05 T1=1.42	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_500_60_5.opb	SAT f=18 TT=1800.02 T1=1800.4	No data	No data	No data	SAT (TO) f=18 TT=1800.02 T1=1800.4	No data	No data	No data	SAT (TO) f=20 TT=1800.12 T1=9.01	SAT (TO) f=21 TT=1800.04 T1=1.35	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_10_1.opb	OPT f=5 TT=0.316 T1=0.31	No data	No data	No data	OPT f=5 TT=0.316 T1=0.31	No data	No data	No data	OPT f=5 TT=18.292 T1=5.74	OPT f=5 TT=16.921 T1=13.67	OPT f=5 TT=41.855 T1=41.54
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_10_2.opb	OPT f=5 TT=0.472 T1=0.47	No data	No data	No data	OPT f=5 TT=0.472 T1=0.47	No data	No data	No data	OPT f=5 TT=11.532 T1=3.23	OPT f=5 TT=17.873 T1=15.67	OPT f=5 TT=7.623 T1=7.56
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_10_3.opb	OPT f=6 TT=0.407 T1=0.03	No data	No data	No data	OPT f=6 TT=0.407 T1=0.4	No data	No data	No data	OPT f=6 TT=55.736 T1=1.75	OPT f=6 TT=26.76 T1=0.26	OPT f=6 TT=60.022 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_10_4.opb	OPT f=6 TT=0.344 T1=0.31	No data	No data	No data	OPT f=6 TT=0.344 T1=0.34	No data	No data	No data	OPT f=6 TT=48.966 T1=1.24	OPT f=6 TT=25.98 T1=0.31	OPT f=6 TT=93.046 T1=36.83
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_10_5.opb	OPT f=6 TT=0.515 T1=0.32	No data	No data	No data	OPT f=6 TT=0.515 T1=0.51	No data	No data	No data	OPT f=6 TT=53.845 T1=1.23	OPT f=6 TT=26.03 T1=0.32	OPT f=6 TT=133.929 T1=67.17
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_25_1.opb	OPT f=3 TT=0.112 T1=0.08	No data	No data	No data	OPT f=3 TT=0.112 T1=0.11	No data	No data	No data	OPT f=3 TT=2.625 T1=1.3	OPT f=3 TT=1.126 T1=0.29	OPT f=3 TT=1.78 T1=0.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_25_2.opb	OPT f=2 TT=0.093 T1=0.09	No data	No data	No data	OPT f=2 TT=0.093 T1=0.09	No data	No data	No data	OPT f=2 TT=2.326 T1=1.83	OPT f=2 TT=0.885 T1=0.46	OPT f=2 TT=1.275 T1=1.22
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_25_3.opb	OPT f=2 TT=0.086 T1=0.08	No data	No data	No data	OPT f=2 TT=0.086 T1=0.08	No data	No data	No data	OPT f=2 TT=2.823 T1=1.32	OPT f=2 TT=1.083 T1=0.64	OPT f=2 TT=1.302 T1=1.24
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_25_4.opb	OPT f=2 TT=0.094 T1=0.09	No data	No data	No data	OPT f=2 TT=0.094 T1=0.09	No data	No data	No data	OPT f=2 TT=2.563 T1=1.8	OPT f=2 TT=1.025 T1=0.61	OPT f=2 TT=1.713 T1=1.65
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mds/normalized-mds_50_25_5.opb	OPT f=3 TT=0.109 T1=0.1	No data	No data	No data	OPT f=3 TT=0.109 T1=0.1	No data	No data	No data	OPT f=3 TT=3.175 T1=1.33	OPT f=3 TT=1.104 T1=0.29	OPT f=3 TT=2.033 T1=0.18
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_25_1.opb	SAT f=-125 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-125 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-121 TT=1800.57 T1=264.69	SAT (TO) f=-110 TT=1800.04 T1=196.46	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_25_2.opb	SAT f=-122 TT=1800.05 T1=141.18	No data	No data	No data	SAT (TO) f=-122 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=-122 TT=1800.73 T1=141.18	SAT (TO) f=-108 TT=1800 T1=9.34	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_25_3.opb	SAT f=-125 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-125 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-123 TT=1800.17 T1=256.7	SAT (TO) f=-105 TT=1800.07 T1=1260.11	? (TO) TT=1800.13
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_25_4.opb	SAT f=-120 TT=1800.03 T1=87.53	No data	No data	No data	SAT (TO) f=-120 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-120 TT=1800.03 T1=87.53	SAT (TO) f=-113 TT=1800.75 T1=1147.03	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_25_5.opb	SAT f=-121 TT=1800.79 T1=359.75	No data	No data	No data	SAT (TO) f=-118 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-121 TT=1800.79 T1=359.75	SAT (TO) f=-109 TT=1800 T1=120.73	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_60_1.opb	SAT f=-70 TT=1800.11 T1=1800.5	No data	No data	No data	SAT (TO) f=-70 TT=1800.11 T1=1800.5	No data	No data	No data	SAT (TO) f=-68 TT=1800.16 T1=507.3	SAT (TO) f=-55 TT=1800.06 T1=3.86	? (TO) TT=1800.17
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_60_2.opb	SAT f=-70 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=-70 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=-69 TT=1800.78 T1=65.66	SAT (TO) f=-59 TT=1800.04 T1=5.05	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_60_3.opb	SAT f=-70 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-70 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-69 TT=1801.4 T1=21.9	SAT (TO) f=-59 TT=1801.98 T1=3.38	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_60_4.opb	SAT f=-68 TT=1800.06 T1=532.28	No data	No data	No data	SAT (TO) f=-68 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=-68 TT=1800.17 T1=532.28	SAT (TO) f=-58 TT=1800.06 T1=11.2	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_1000_60_5.opb	SAT f=-70 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-70 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-68 TT=1800.1 T1=157.76	SAT (TO) f=-59 TT=1800.06 T1=1.28	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_10_1.opb	OPT f=-26 TT=107.847 T1=107.86	No data	No data	No data	OPT f=-26 TT=107.847 T1=107.86	No data	No data	No data	SAT (TO) f=-25 TT=1800.07 T1=112.4	SAT (TO) f=-25 TT=1800.74 T1=509.79	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_10_2.opb	OPT f=-26 TT=164.032 T1=164.05	No data	No data	No data	OPT f=-26 TT=164.032 T1=164.05	No data	No data	No data	SAT (TO) f=-25 TT=1800.79 T1=52.32	SAT (TO) f=-25 TT=1800.06 T1=1539.39	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_10_3.opb	OPT f=-26 TT=140.018 T1=140.03	No data	No data	No data	OPT f=-26 TT=140.018 T1=140.03	No data	No data	No data	SAT (TO) f=-24 TT=1800.16 T1=21.09	SAT (TO) f=-24 TT=1800.02 T1=30.55	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_10_4.opb	OPT f=-25 TT=476.417 T1=476.49	No data	No data	No data	OPT f=-25 TT=476.417 T1=476.49	No data	No data	No data	SAT (TO) f=-25 TT=1800.56 T1=590.11	SAT (TO) f=-24 TT=1800.07 T1=1708.92	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_10_5.opb	OPT f=-25 TT=107.997 T1=108.01	No data	No data	No data	OPT f=-25 TT=107.997 T1=108.01	No data	No data	No data	SAT (TO) f=-24 TT=1800.56 T1=766.36	SAT (TO) f=-24 TT=1800.01 T1=625.92	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_25_1.opb	OPT f=-15 TT=4.833 T1=4.83	No data	No data	No data	OPT f=-15 TT=4.833 T1=4.83	No data	No data	No data	OPT f=-15 TT=52.171 T1=25.13	OPT f=-15 TT=21.041 T1=14.98	OPT f=-15 TT=181.435 T1=181.4
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_25_2.opb	OPT f=-15 TT=4.581 T1=4.58	No data	No data	No data	OPT f=-15 TT=4.581 T1=4.58	No data	No data	No data	OPT f=-15 TT=40.179 T1=18.84	OPT f=-15 TT=29.799 T1=28.5	OPT f=-15 TT=151.304 T1=45.42
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_25_3.opb	OPT f=-14 TT=4.221 T1=1.21	No data	No data	No data	OPT f=-14 TT=4.221 T1=4.22	No data	No data	No data	OPT f=-14 TT=50.207 T1=8.37	OPT f=-14 TT=25.489 T1=2.33	OPT f=-14 TT=191.084 T1=1.21
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_25_4.opb	OPT f=-15 TT=3.342 T1=3.34	No data	No data	No data	OPT f=-15 TT=3.342 T1=3.34	No data	No data	No data	OPT f=-15 TT=52.617 T1=20.43	OPT f=-15 TT=30.669 T1=27.18	OPT f=-15 TT=236.005 T1=235.97
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_100_25_5.opb	OPT f=-13 TT=6.266 T1=0.87	No data	No data	No data	OPT f=-13 TT=6.266 T1=6.26	No data	No data	No data	OPT f=-13 TT=60.024 T1=2.37	OPT f=-13 TT=44.41 T1=0.87	OPT f=-13 TT=117.597 T1=117.55
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_10_4_1.opb	OPT f=-3 TT=0.001 T1=0	No data	No data	No data	OPT f=-3 TT=0.001 T1=0	No data	No data	No data	OPT f=-3 TT=0.184 T1=0.67	OPT f=-3 TT=0.165 T1=0.13	OPT f=-3 TT=0.019 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_10_4_2.opb	OPT f=-3 TT=0.002 T1=0	No data	No data	No data	OPT f=-3 TT=0.002 T1=0	No data	No data	No data	OPT f=-3 TT=0.174 T1=1.13	OPT f=-3 TT=0.163 T1=0.14	OPT f=-3 TT=0.022 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_10_4_3.opb	OPT f=-3 TT=0.001 T1=0	No data	No data	No data	OPT f=-3 TT=0.001 T1=0	No data	No data	No data	OPT f=-3 TT=0.175 T1=1.14	OPT f=-3 TT=0.165 T1=0.12	OPT f=-3 TT=0.02 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_10_4_4.opb	OPT f=-3 TT=0.002 T1=0	No data	No data	No data	OPT f=-3 TT=0.002 T1=0	No data	No data	No data	OPT f=-3 TT=0.175 T1=0.63	OPT f=-3 TT=0.165 T1=0.13	OPT f=-3 TT=0.019 T1=0.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/mis/ normalized-mis_10_4_5.opb	OPT f=-4 TT=0.003 T1=0	No data	No data	No data	OPT f=-4 TT=0.003 T1=0	No data	No data	No data	OPT f=-4 TT=0.174 T1=1.64	OPT f=-4 TT=0.164 T1=0.12	OPT f=-4 TT=0.022 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_10_1.opb	SAT f=-49 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-49 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-46 TT=1800.03 T1=712.53	SAT (TO) f=-41 TT=1800 T1=0.42	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_10_2.opb	SAT f=-48 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-48 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-44 TT=1800.06 T1=29.91	SAT (TO) f=-39 TT=1800.08 T1=0.3	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_10_3.opb	SAT f=-49 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-49 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-46 TT=1800.12 T1=56.85	SAT (TO) f=-44 TT=1800.49 T1=1776.79	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_10_4.opb	SAT f=-49 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-49 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-46 TT=1800.07 T1=63.61	SAT (TO) f=-38 TT=1800.06 T1=0.39	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_10_5.opb	SAT f=-50 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-50 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-47 TT=1800.34 T1=694.74	SAT (TO) f=-42 TT=1800.05 T1=23.11	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_25_1.opb	SAT f=-29 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-29 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-26 TT=1800.69 T1=129.11	SAT (TO) f=-24 TT=1800.09 T1=1.29	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_25_2.opb	SAT f=-30 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-30 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-26 TT=1800.08 T1=45.98	SAT (TO) f=-24 TT=1800.61 T1=1.36	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_25_3.opb	SAT f=-29 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-29 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-26 TT=1800.15 T1=3.97	SAT (TO) f=-24 TT=1800.07 T1=0.87	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_25_4.opb	SAT f=-29 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-29 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-27 TT=1800.09 T1=10.97	SAT (TO) f=-26 TT=1800.7 T1=3.16	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_200_25_5.opb	SAT f=-29 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-29 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-26 TT=1800.85 T1=9.46	SAT (TO) f=-24 TT=1800.07 T1=12.09	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_10_1.opb	SAT f=-111 TT=1800.69 T1=393.17	No data	No data	No data	SAT (TO) f=-109 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-111 TT=1800.69 T1=393.17	SAT (TO) f=-98 TT=1800.79 T1=1757.87	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_10_2.opb	SAT f=-115 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-115 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-109 TT=1800.03 T1=62.78	SAT (TO) f=-91 TT=1800.09 T1=1067.2	? (TO) TT=1800.12
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_10_3.opb	SAT f=-113 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-113 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-110 TT=1800.04 T1=70.38	SAT (TO) f=-101 TT=1800 T1=1441.06	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_10_4.opb	SAT f=-109 TT=1800.02 T1=39.88	No data	No data	No data	SAT (TO) f=-109 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-109 TT=1800.08 T1=39.88	SAT (TO) f=-95 TT=1800.07 T1=1059.45	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_10_5.opb	SAT f=-112 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-112 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-110 TT=1800.16 T1=269.43	SAT (TO) f=-99 TT=1800 T1=25.87	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_25_1.opb	SAT f=-65 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-65 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-63 TT=1800.04 T1=690.65	SAT (TO) f=-57 TT=1801.08 T1=2.7	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_25_2.opb	SAT f=-65 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-65 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-63 TT=1800.06 T1=359.86	SAT (TO) f=-55 TT=1800.82 T1=0.7	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_25_3.opb	SAT f=-68 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-68 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-62 TT=1800.07 T1=64.86	SAT (TO) f=-55 TT=1800.8 T1=3.3	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_25_4.opb	SAT f=-67 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-67 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-63 TT=1800.08 T1=294.02	SAT (TO) f=-55 TT=1800.87 T1=1.54	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_25_5.opb	SAT f=-64 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-64 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-63 TT=1800.04 T1=260.02	SAT (TO) f=-57 TT=1800.03 T1=799.55	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_60_1.opb	SAT f=-37 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-37 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-35 TT=1800.17 T1=544.84	SAT (TO) f=-29 TT=1800.05 T1=2.92	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_60_2.opb	SAT f=-37 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-37 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-34 TT=1800.09 T1=253.07	SAT (TO) f=-31 TT=1800.81 T1=17.15	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_60_3.opb	SAT f=-38 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-38 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-34 TT=1800.14 T1=35.65	SAT (TO) f=-31 TT=1800.02 T1=8.44	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_60_4.opb	SAT f=-37 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-37 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-34 TT=1800.76 T1=15.56	SAT (TO) f=-30 TT=1800.02 T1=2.05	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_500_60_5.opb	SAT f=-37 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=-37 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=-34 TT=1800.11 T1=156.95	SAT (TO) f=-31 TT=1800.08 T1=1.42	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_10_1.opb	OPT f=-12 TT=0.061 T1=0.06	No data	No data	No data	OPT f=-12 TT=0.061 T1=0.06	No data	No data	No data	OPT f=-12 TT=2.419 T1=1.46	OPT f=-12 TT=0.902 T1=0.44	OPT f=-12 TT=0.852 T1=0.81
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_10_2.opb	OPT f=-12 TT=0.09 T1=0.08	No data	No data	No data	OPT f=-12 TT=0.09 T1=0.08	No data	No data	No data	OPT f=-12 TT=2.904 T1=2.7	OPT f=-12 TT=1.034 T1=0.6	OPT f=-12 TT=1.005 T1=0.95
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_10_3.opb	OPT f=-13 TT=0.082 T1=0.08	No data	No data	No data	OPT f=-13 TT=0.082 T1=0.08	No data	No data	No data	OPT f=-13 TT=2.494 T1=2.71	OPT f=-13 TT=0.744 T1=0.37	OPT f=-13 TT=1.326 T1=1.27
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_10_4.opb	OPT f=-12 TT=0.052 T1=0.05	No data	No data	No data	OPT f=-12 TT=0.052 T1=0.05	No data	No data	No data	OPT f=-12 TT=2.165 T1=2.71	OPT f=-12 TT=0.826 T1=0.3	OPT f=-12 TT=1.01 T1=0.2
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_10_5.opb	OPT f=-13 TT=0.061 T1=0.06	No data	No data	No data	OPT f=-13 TT=0.061 T1=0.06	No data	No data	No data	OPT f=-13 TT=2.193 T1=3.7	OPT f=-13 TT=0.894 T1=0.5	OPT f=-13 TT=1.318 T1=1.26
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_25_1.opb	OPT f=-6 TT=0.041 T1=0.04	No data	No data	No data	OPT f=-6 TT=0.041 T1=0.04	No data	No data	No data	OPT f=-6 TT=1.244 T1=2.29	OPT f=-6 TT=0.633 T1=0.27	OPT f=-6 TT=0.151 T1=0.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_25_2.opb	OPT f=-6 TT=0.032 T1=0.03	No data	No data	No data	OPT f=-6 TT=0.032 T1=0.03	No data	No data	No data	OPT f=-6 TT=1.374 T1=1.77	OPT f=-6 TT=0.594 T1=0.29	OPT f=-6 TT=0.166 T1=0.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_25_3.opb	OPT f=-6 TT=0.033 T1=0.03	No data	No data	No data	OPT f=-6 TT=0.033 T1=0.03	No data	No data	No data	OPT f=-6 TT=1.164 T1=1.76	OPT f=-6 TT=0.565 T1=0.26	OPT f=-6 TT=0.185 T1=0.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_25_4.opb	OPT f=-6 TT=0.033 T1=0.03	No data	No data	No data	OPT f=-6 TT=0.033 T1=0.03	No data	No data	No data	OPT f=-6 TT=1.205 T1=2.27	OPT f=-6 TT=0.625 T1=0.31	OPT f=-6 TT=0.168 T1=0.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/manquinho/ mis/normalized-mis_50_25_5.opb	OPT f=-6 TT=0.034 T1=0.03	No data	No data	No data	OPT f=-6 TT=0.034 T1=0.03	No data	No data	No data	OPT f=-6 TT=1.203 T1=1.76	OPT f=-6 TT=0.674 T1=0.26	OPT f=-6 TT=0.174 T1=0.09
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=5-P0=11-P1=13-P2=29-P3=23-P4=5-P5=29-P6=29-P7=31-P8=29-P9=31-B.opb	OPT f=3 TT=0.049 T1=0.05	No data	No data	No data	OPT f=3 TT=0.049 T1=0.05	No data	No data	No data	OPT f=3 TT=4.023 T1=0.67	OPT f=3 TT=1.114 T1=0.51	OPT f=3 TT=6.611 T1=6.55
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=11-P1=23-P2=2-P3=5-P4=29-P5=7-P6=23-P7=17-B.opb	OPT f=2 TT=0.039 T1=0.04	No data	No data	No data	OPT f=2 TT=0.039 T1=0.04	No data	No data	No data	OPT f=2 TT=2.345 T1=1.16	OPT f=2 TT=0.703 T1=0.42	OPT f=2 TT=1.111 T1=1.06
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=11-P1=29-P2=19-P3=7-P4=2-P5=13-P6=23-B.opb	OPT f=2 TT=0.035 T1=0.03	No data	No data	No data	OPT f=2 TT=0.035 T1=0.03	No data	No data	No data	OPT f=2 TT=1.245 T1=0.68	OPT f=2 TT=0.514 T1=0.28	OPT f=2 TT=0.735 T1=0.78
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=11-P1=2-P2=23-B.opb	OPT f=2 TT=0.012 T1=0.01	No data	No data	No data	OPT f=2 TT=0.012 T1=0.01	No data	No data	No data	OPT f=2 TT=0.184 T1=0.64	OPT f=2 TT=0.183 T1=0.14	OPT f=2 TT=0.036 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=11-P1=31-P2=17-B.opb	OPT f=3 TT=0.012 T1=0.01	No data	No data	No data	OPT f=3 TT=0.012 T1=0.01	No data	No data	No data	OPT f=3 TT=2.515 T1=0.65	OPT f=3 TT=0.384 T1=0.21	OPT f=3 TT=0.28 T1=0.27
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=11-P1=7-P2=23-P3=11-P4=23-P5=37-P6=17-P7=29-B.opb	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=4.233 T1=1.68	OPT f=3 TT=0.794 T1=0.4	OPT f=3 TT=3.269 T1=3.2
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=13-P1=13-B.opb	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.175 T1=0.63	OPT f=3 TT=0.164 T1=0.12	OPT f=3 TT=0.034 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=5-P0=13-P1=29-P2=29-P3=31-P4=37-P5=17-P6=29-P7=3-P8=29-P9=17-B.opb	OPT f=3 TT=0.049 T1=0.05	No data	No data	No data	OPT f=3 TT=0.049 T1=0.05	No data	No data	No data	OPT f=3 TT=3.863 T1=0.69	OPT f=3 TT=1.154 T1=0.54	OPT f=3 TT=5.622 T1=5.56
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=13-P1=5-P2=17-P3=2-P4=29-P5=5-P6=19-P7=17-P8=5-B.opb	OPT f=2 TT=0.047 T1=0.05	No data	No data	No data	OPT f=2 TT=0.047 T1=0.05	No data	No data	No data	OPT f=2 TT=2.194 T1=1.67	OPT f=2 TT=0.985 T1=0.52	OPT f=2 TT=0.825 T1=0.79
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=17-P1=13-P2=11-P3=19-P4=11-P5=23-B.opb	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=2.963 T1=1.71	OPT f=3 TT=0.953 T1=0.42	OPT f=3 TT=3.175 T1=3.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=17-P1=13-P2=29-P3=11-B.opb	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=1.903 T1=0.65	OPT f=3 TT=0.584 T1=0.3	OPT f=3 TT=0.657 T1=0.63
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=17-P1=13-P2=29-P3=37-P4=23-B.opb	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=26.13 T1=2.17	OPT f=3 TT=0.735 T1=0.4	OPT f=3 TT=1.653 T1=1.59
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=17-P1=17-P2=13-P3=17-P4=29-B.opb	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=2.043 T1=1.15	OPT f=3 TT=0.784 T1=0.33	OPT f=3 TT=1.944 T1=1.89
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=5-P0=17-P1=29-P2=13-P3=37-P4=29-P5=29-P6=11-P7=11-P8=31-P9=17-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=4.382 T1=1.68	OPT f=3 TT=1.203 T1=0.52	OPT f=3 TT=6.105 T1=6.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=17-P1=29-P2=17-P3=19-P4=2-P5=11-P6=29-P7=17-P8=5-B.opb	OPT f=2 TT=0.047 T1=0.04	No data	No data	No data	OPT f=2 TT=0.047 T1=0.04	No data	No data	No data	OPT f=2 TT=3.342 T1=1.18	OPT f=2 TT=0.714 T1=0.45	OPT f=2 TT=2.586 T1=2.52
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/ factor-mod-B/factor-mod-size=5-P0=17-P1=5-B.opb	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.183 T1=0.63	OPT f=3 TT=0.165 T1=0.12	OPT f=3 TT=0.033 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=17-P1=7-P2=11-P3=17-P4=11-B.opb	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=2.925 T1=1.21	OPT f=3 TT=0.687 T1=0.63	OPT f=3 TT=2.838 T1=2.79
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=19-P1=23-P2=23-P3=23-B.opb	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=1.505 T1=1.14	OPT f=3 TT=0.535 T1=0.21	OPT f=3 TT=1.332 T1=1.27
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=19-P1=29-P2=19-P3=23-P4=2-P5=29-P6=7-B.opb	OPT f=2 TT=0.034 T1=0.03	No data	No data	No data	OPT f=2 TT=0.034 T1=0.03	No data	No data	No data	OPT f=2 TT=0.414 T1=0.66	OPT f=2 TT=0.306 T1=0.18	OPT f=2 TT=1.482 T1=1.42
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=19-P1=5-P2=7-P3=19-P4=29-P5=29-B.opb	OPT f=3 TT=0.028 T1=0.03	No data	No data	No data	OPT f=3 TT=0.028 T1=0.03	No data	No data	No data	OPT f=3 TT=3.192 T1=1.16	OPT f=3 TT=0.945 T1=0.33	OPT f=3 TT=3.272 T1=3.21
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=23-P1=11-B.opb	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.174 T1=0.63	OPT f=3 TT=0.164 T1=0.12	OPT f=3 TT=0.036 T1=0.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=23-P1=11-P2=19-B.opb	OPT f=3 TT=0.012 T1=0.01	No data	No data	No data	OPT f=3 TT=0.012 T1=0.01	No data	No data	No data	OPT f=3 TT=2.634 T1=0.65	OPT f=3 TT=0.384 T1=0.2	OPT f=3 TT=0.293 T1=0.27
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=23-P1=29-P2=23-P3=19-P4=2-P5=23-B.opb	OPT f=2 TT=0.026 T1=0.02	No data	No data	No data	OPT f=2 TT=0.026 T1=0.02	No data	No data	No data	OPT f=2 TT=0.395 T1=0.65	OPT f=2 TT=0.253 T1=0.16	OPT f=2 TT=0.202 T1=0.19
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=23-P1=29-P2=31-P3=29-B.opb	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=1.905 T1=0.65	OPT f=3 TT=0.613 T1=0.22	OPT f=3 TT=0.843 T1=0.81
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=23-P1=31-P2=23-P3=7-P4=31-P5=19-P6=31-P7=11-P8=2-B.opb	OPT f=2 TT=0.046 T1=0.04	No data	No data	No data	OPT f=2 TT=0.046 T1=0.04	No data	No data	No data	OPT f=2 TT=1.563 T1=0.67	OPT f=2 TT=0.514 T1=0.26	OPT f=2 TT=1.832 T1=1.77
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=23-P1=7-P2=29-P3=5-P4=2-P5=13-P6=37-P7=29-B.opb	OPT f=2 TT=0.039 T1=0.04	No data	No data	No data	OPT f=2 TT=0.039 T1=0.04	No data	No data	No data	OPT f=2 TT=1.685 T1=0.68	OPT f=2 TT=0.713 T1=0.42	OPT f=2 TT=1.394 T1=1.33
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=11-P2=11-P3=17-P4=29-P5=23-B.opb	OPT f=3 TT=0.029 T1=0.02	No data	No data	No data	OPT f=3 TT=0.029 T1=0.02	No data	No data	No data	OPT f=3 TT=2.734 T1=1.15	OPT f=3 TT=0.972 T1=0.41	OPT f=3 TT=2.068 T1=2.01
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=13-P2=19-B.opb	OPT f=3 TT=0.013 T1=0.01	No data	No data	No data	OPT f=3 TT=0.013 T1=0.01	No data	No data	No data	OPT f=3 TT=2.263 T1=0.64	OPT f=3 TT=0.393 T1=0.22	OPT f=3 TT=0.082 T1=0.08
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=17-P2=2-P3=19-P4=13-B.opb	OPT f=2 TT=0.022 T1=0.02	No data	No data	No data	OPT f=2 TT=0.022 T1=0.02	No data	No data	No data	OPT f=2 TT=1.494 T1=0.66	OPT f=2 TT=0.505 T1=0.27	OPT f=2 TT=0.057 T1=0.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=19-P2=29-P3=5-P4=17-P5=5-P6=5-P7=13-P8=31-B.opb	OPT f=3 TT=0.045 T1=0.04	No data	No data	No data	OPT f=3 TT=0.045 T1=0.04	No data	No data	No data	OPT f=3 TT=4.455 T1=0.69	OPT f=3 TT=1.082 T1=0.44	OPT f=3 TT=6.646 T1=6.59
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=23-B.opb	OPT f=3 TT=0.007 T1=0	No data	No data	No data	OPT f=3 TT=0.007 T1=0	No data	No data	No data	OPT f=3 TT=0.174 T1=0.64	OPT f=3 TT=0.165 T1=0.13	OPT f=3 TT=0.032 T1=0.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=29-P2=17-P3=7-P4=5-P5=13-P6=5-B.opb	OPT f=3 TT=0.032 T1=0.03	No data	No data	No data	OPT f=3 TT=0.032 T1=0.03	No data	No data	No data	OPT f=3 TT=3.442 T1=1.15	OPT f=3 TT=0.973 T1=0.37	OPT f=3 TT=2.528 T1=2.46
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=29-P1=31-P2=13-P3=17-P4=29-P5=2-P6=29-B.opb	OPT f=2 TT=0.034 T1=0.03	No data	No data	No data	OPT f=2 TT=0.034 T1=0.03	No data	No data	No data	OPT f=2 TT=1.344 T1=0.68	OPT f=2 TT=0.684 T1=0.4	OPT f=2 TT=0.165 T1=0.16
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=2-P1=13-P2=23-P3=29-P4=29-P5=11-B.opb	OPT f=2 TT=0.027 T1=0.02	No data	No data	No data	OPT f=2 TT=0.027 T1=0.02	No data	No data	No data	OPT f=2 TT=0.353 T1=0.65	OPT f=2 TT=0.245 T1=0.16	OPT f=2 TT=0.855 T1=0.82
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=2-P1=23-P2=17-B.opb	OPT f=2 TT=0.012 T1=0.01	No data	No data	No data	OPT f=2 TT=0.012 T1=0.01	No data	No data	No data	OPT f=2 TT=0.174 T1=0.63	OPT f=2 TT=0.174 T1=0.13	OPT f=2 TT=0.022 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=2-P1=23-P2=29-P3=19-B.opb	OPT f=2 TT=0.017 T1=0.01	No data	No data	No data	OPT f=2 TT=0.017 T1=0.01	No data	No data	No data	OPT f=2 TT=0.234 T1=0.64	OPT f=2 TT=0.193 T1=0.15	OPT f=2 TT=0.094 T1=0.08
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=2-P1=29-P2=11-P3=7-P4=17-P5=11-P6=7-P7=29-P8=11-P9=5-B.opb	OPT f=2 TT=0.05 T1=0.05	No data	No data	No data	OPT f=2 TT=0.05 T1=0.05	No data	No data	No data	OPT f=2 TT=3.433 T1=2.18	OPT f=2 TT=1.076 T1=0.6	OPT f=2 TT=1.538 T1=1.48
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=31-P1=23-P2=2-P3=17-P4=17-B.opb	OPT f=2 TT=0.024 T1=0.02	No data	No data	No data	OPT f=2 TT=0.024 T1=0.02	No data	No data	No data	OPT f=2 TT=1.134 T1=0.65	OPT f=2 TT=0.444 T1=0.24	OPT f=2 TT=0.085 T1=0.08
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=3-P1=19-P2=2-P3=19-P4=17-P5=13-P6=37-P7=5-B.opb	OPT f=2 TT=0.042 T1=0.04	No data	No data	No data	OPT f=2 TT=0.042 T1=0.04	No data	No data	No data	OPT f=2 TT=2.254 T1=1.17	OPT f=2 TT=0.684 T1=0.42	OPT f=2 TT=3.102 T1=3.03
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/ factor-mod-B/factor-mod-size=5-P0=3-P1=37-B.opb	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.006 T1=0	No data	No data	No data	OPT f=3 TT=0.174 T1=0.63	OPT f=3 TT=0.165 T1=0.12	OPT f=3 TT=0.032 T1=0.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=5-P0=3-P1=7-P2=31-P3=29-B.opb	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=0.016 T1=0.01	No data	No data	No data	OPT f=3 TT=2.023 T1=0.65	OPT f=3 TT=0.594 T1=0.34	OPT f=3 TT=1.971 T1=1.91
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=5-P0=5-P1=11-P2=11-P3=29-P4=29-P5=23-P6=29-P7=17-P8=29-P9=17-B.opb	OPT f=3 TT=0.049 T1=0.04	No data	No data	No data	OPT f=3 TT=0.049 T1=0.04	No data	No data	No data	OPT f=3 TT=4.56 T1=1.17	OPT f=3 TT=1.123 T1=0.43	OPT f=3 TT=3.906 T1=3.99
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=5-P1=13-P2=29-P3=13-P4=7-P5=5-P6=37-P7=7-P8=29-B.opb	OPT f=3 TT=0.044 T1=0.04	No data	No data	No data	OPT f=3 TT=0.044 T1=0.04	No data	No data	No data	OPT f=3 TT=4.485 T1=0.68	OPT f=3 TT=1.084 T1=0.44	OPT f=3 TT=4.607 T1=4.54
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=5-P1=23-P2=17-P3=7-P4=23-P5=23-P6=17-P7=31-B.opb	OPT f=3 TT=0.039 T1=0.03	No data	No data	No data	OPT f=3 TT=0.039 T1=0.03	No data	No data	No data	OPT f=3 TT=3.533 T1=1.16	OPT f=3 TT=1.274 T1=0.46	OPT f=3 TT=5.237 T1=5.18
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=5-P0=7-P1=11-P2=23-P3=23-P4=29-P5=31-P6=13-B.opb	OPT f=3 TT=0.032 T1=0.03	No data	No data	No data	OPT f=3 TT=0.032 T1=0.03	No data	No data	No data	OPT f=3 TT=3.215 T1=1.66	OPT f=3 TT=1.025 T1=0.36	OPT f=3 TT=4.554 T1=4.49
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=11-P1=2-P2=41-P3=47-P4=37-P5=17-P6=41-P7=43-P8=59-B.opb	OPT f=2 TT=0.074 T1=0.07	No data	No data	No data	OPT f=2 TT=0.074 T1=0.07	No data	No data	No data	OPT f=2 TT=1.304 T1=0.68	OPT f=2 TT=0.493 T1=0.26	OPT f=2 TT=12.151 T1=12.09
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=11-P1=37-P2=37-P3=29-B.opb	OPT f=3 TT=0.029 T1=0.02	No data	No data	No data	OPT f=3 TT=0.029 T1=0.02	No data	No data	No data	OPT f=3 TT=3.215 T1=1.65	OPT f=3 TT=1.344 T1=0.29	OPT f=3 TT=11.416 T1=11.34
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=6-P0=11-P1=37-P2=59-P3=23-P4=53-P5=31-P6=59-P7=29-P8=2-P9=67-B.opb	OPT f=2 TT=0.082 T1=0.08	No data	No data	No data	OPT f=2 TT=0.082 T1=0.08	No data	No data	No data	OPT f=2 TT=5.983 T1=1.69	OPT f=2 TT=2.146 T1=1.2	OPT f=2 TT=36.173 T1=36.11
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=13-P1=23-P2=59-P3=41-P4=53-B.opb	OPT f=3 TT=0.035 T1=0.03	No data	No data	No data	OPT f=3 TT=0.035 T1=0.03	No data	No data	No data	OPT f=3 TT=4.744 T1=1.16	OPT f=3 TT=1.515 T1=0.55	OPT f=3 TT=11.522 T1=11.46
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=17-P1=11-P2=29-P3=59-P4=41-P5=11-P6=13-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=6.153 T1=2.19	OPT f=3 TT=2.765 T1=0.38	OPT f=3 TT=40.332 T1=40.27
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=17-P1=11-P2=61-P3=5-P4=53-P5=7-P6=37-P7=7-B.opb	OPT f=3 TT=0.059 T1=0.05	No data	No data	No data	OPT f=3 TT=0.059 T1=0.05	No data	No data	No data	OPT f=3 TT=8.093 T1=1.18	OPT f=3 TT=2.816 T1=1.23	OPT f=3 TT=24.522 T1=24.47
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=19-P1=53-P2=37-B.opb	OPT f=3 TT=0.018 T1=0.01	No data	No data	No data	OPT f=3 TT=0.018 T1=0.01	No data	No data	No data	OPT f=3 TT=5.823 T1=0.66	OPT f=3 TT=0.503 T1=0.28	OPT f=3 TT=0.508 T1=0.48
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=23-P1=11-P2=13-P3=17-P4=19-P5=53-P6=67-P7=29-P8=7-B.opb	OPT f=3 TT=0.069 T1=0.06	No data	No data	No data	OPT f=3 TT=0.069 T1=0.06	No data	No data	No data	OPT f=3 TT=9.163 T1=2.19	OPT f=3 TT=3.044 T1=0.78	OPT f=3 TT=37.819 T1=37.76
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=29-P1=2-P2=59-P3=2-P4=47-P5=53-P6=37-P7=53-P8=53-B.opb	OPT f=2 TT=0.076 T1=0.07	No data	No data	No data	OPT f=2 TT=0.076 T1=0.07	No data	No data	No data	OPT f=2 TT=3.207 T1=1.19	OPT f=2 TT=0.533 T1=0.28	OPT f=2 TT=0.591 T1=0.56
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=29-P1=59-P2=11-P3=29-P4=29-P5=11-P6=41-P7=53-B.opb	OPT f=3 TT=0.062 T1=0.06	No data	No data	No data	OPT f=3 TT=0.062 T1=0.06	No data	No data	No data	OPT f=3 TT=6.832 T1=1.68	OPT f=3 TT=2.933 T1=0.71	OPT f=3 TT=25.487 T1=25.43
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=2-P1=31-P2=13-P3=31-P4=31-B.opb	OPT f=2 TT=0.032 T1=0.03	No data	No data	No data	OPT f=2 TT=0.032 T1=0.03	No data	No data	No data	OPT f=2 TT=2.333 T1=0.66	OPT f=2 TT=0.525 T1=0.29	OPT f=2 TT=0.185 T1=0.17
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=31-P1=31-P2=37-P3=37-B.opb	OPT f=3 TT=0.027 T1=0.02	No data	No data	No data	OPT f=3 TT=0.027 T1=0.02	No data	No data	No data	OPT f=3 TT=4.363 T1=0.65	OPT f=3 TT=1.025 T1=0.27	OPT f=3 TT=14.741 T1=14.68
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=31-P1=53-P2=29-P3=29-P4=31-P5=19-B.opb	OPT f=3 TT=0.044 T1=0.04	No data	No data	No data	OPT f=3 TT=0.044 T1=0.04	No data	No data	No data	OPT f=3 TT=5.494 T1=1.68	OPT f=3 TT=2.214 T1=0.5	OPT f=3 TT=19.105 T1=19.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=37-P1=23-P2=5-B.opb	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=5.682 T1=0.66	OPT f=3 TT=0.484 T1=0.27	OPT f=3 TT=1.997 T1=1.94
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=37-P1=59-P2=17-P3=29-P4=2-P5=29-B.opb	OPT f=2 TT=0.044 T1=0.04	No data	No data	No data	OPT f=2 TT=0.044 T1=0.04	No data	No data	No data	OPT f=2 TT=3.853 T1=1.17	OPT f=2 TT=0.823 T1=0.49	OPT f=2 TT=5.962 T1=5.9
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=41-P1=19-B.opb	OPT f=3 TT=0.01 T1=0	No data	No data	No data	OPT f=3 TT=0.01 T1=0	No data	No data	No data	OPT f=3 TT=0.235 T1=0.63	OPT f=3 TT=0.163 T1=0.14	OPT f=3 TT=0.104 T1=0.09
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=41-P1=37-P2=47-P3=2-P4=7-P5=29-P6=53-B.opb	OPT f=2 TT=0.047 T1=0.04	No data	No data	No data	OPT f=2 TT=0.047 T1=0.04	No data	No data	No data	OPT f=2 TT=0.915 T1=0.67	OPT f=2 TT=1.343 T1=0.79	OPT f=2 TT=3.215 T1=3.15
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=41-P1=53-P2=59-B.opb	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=7.123 T1=0.64	OPT f=3 TT=0.505 T1=0.27	OPT f=3 TT=3.266 T1=3.2
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=41-P1=53-P2=67-P3=59-P4=53-P5=61-P6=29-P7=29-P8=17-B.opb	OPT f=3 TT=0.067 T1=0.06	No data	No data	No data	OPT f=3 TT=0.067 T1=0.06	No data	No data	No data	OPT f=3 TT=8.523 T1=1.19	OPT f=3 TT=2.905 T1=0.81	OPT f=3 TT=52.607 T1=52.55
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=17-P2=17-P3=31-B.opb	OPT f=3 TT=0.025 T1=0.02	No data	No data	No data	OPT f=3 TT=0.025 T1=0.02	No data	No data	No data	OPT f=3 TT=4.133 T1=1.16	OPT f=3 TT=0.904 T1=0.27	OPT f=3 TT=24.327 T1=24.27
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=17-P2=37-P3=53-P4=13-P5=13-B.opb	OPT f=3 TT=0.046 T1=0.04	No data	No data	No data	OPT f=3 TT=0.046 T1=0.04	No data	No data	No data	OPT f=3 TT=5.432 T1=1.16	OPT f=3 TT=1.774 T1=0.39	OPT f=3 TT=15.676 T1=15.61
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=23-P2=47-P3=53-P4=59-P5=23-P6=37-P7=61-B.opb	OPT f=3 TT=0.06 T1=0.05	No data	No data	No data	OPT f=3 TT=0.06 T1=0.05	No data	No data	No data	OPT f=3 TT=7.142 T1=1.68	OPT f=3 TT=3.035 T1=0.87	OPT f=3 TT=34.278 T1=34.22
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=29-P2=11-P3=29-P4=53-B.opb	OPT f=3 TT=0.035 T1=0.03	No data	No data	No data	OPT f=3 TT=0.035 T1=0.03	No data	No data	No data	OPT f=3 TT=5.28 T1=1.68	OPT f=3 TT=1.063 T1=0.48	OPT f=3 TT=26.262 T1=26.2
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=37-B.opb	OPT f=3 TT=0.009 T1=0.01	No data	No data	No data	OPT f=3 TT=0.009 T1=0.01	No data	No data	No data	OPT f=3 TT=0.224 T1=0.63	OPT f=3 TT=0.164 T1=0.12	OPT f=3 TT=0.129 T1=0.12
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=6-P0=47-P1=43-P2=59-P3=29-P4=31-P5=13-P6=59-P7=53-P8=67-P9=17-B.opb	OPT f=3 TT=0.079 T1=0.07	No data	No data	No data	OPT f=3 TT=0.079 T1=0.07	No data	No data	No data	OPT f=3 TT=10.492 T1=1.7	OPT f=3 TT=4.033 T1=0.85	OPT f=3 TT=20.586 T1=20.52
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=47-P2=67-P3=3-P4=41-P5=53-P6=31-P7=3-P8=41-P9=23-B.opb	OPT f=3 TT=0.076 T1=0.07	No data	No data	No data	OPT f=3 TT=0.076 T1=0.07	No data	No data	No data	OPT f=3 TT=10.123 T1=4.71	OPT f=3 TT=3.361 T1=1.09	OPT f=3 TT=69.666 T1=69.62
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=47-P1=67-P2=7-P3=59-P4=59-B.opb	OPT f=3 TT=0.034 T1=0.03	No data	No data	No data	OPT f=3 TT=0.034 T1=0.03	No data	No data	No data	OPT f=3 TT=4.963 T1=3.17	OPT f=3 TT=1.603 T1=0.79	OPT f=3 TT=23.489 T1=23.43
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=53-P1=13-P2=23-P3=47-P4=2-B.opb	OPT f=2 TT=0.037 T1=0.03	No data	No data	No data	OPT f=2 TT=0.037 T1=0.03	No data	No data	No data	OPT f=2 TT=0.424 T1=0.67	OPT f=2 TT=0.464 T1=0.24	OPT f=2 TT=6.169 T1=6.11
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=53-P1=17-P2=17-P3=13-P4=17-P5=61-B.opb	OPT f=3 TT=0.043 T1=0.04	No data	No data	No data	OPT f=3 TT=0.043 T1=0.04	No data	No data	No data	OPT f=3 TT=5.44 T1=0.67	OPT f=3 TT=1.653 T1=0.43	OPT f=3 TT=10.903 T1=10.85
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=53-P1=41-P2=53-B.opb	OPT f=3 TT=0.018 T1=0.01	No data	No data	No data	OPT f=3 TT=0.018 T1=0.01	No data	No data	No data	OPT f=3 TT=6.475 T1=0.64	OPT f=3 TT=0.474 T1=0.25	OPT f=3 TT=4.641 T1=4.61
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=53-P1=43-P2=37-P3=59-P4=29-P5=29-B.opb	OPT f=3 TT=0.046 T1=0.04	No data	No data	No data	OPT f=3 TT=0.046 T1=0.04	No data	No data	No data	OPT f=3 TT=5.02 T1=0.68	OPT f=3 TT=2.202 T1=0.8	OPT f=3 TT=11.2 T1=11.14
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=53-P1=53-P2=41-P3=41-P4=41-P5=53-P6=41-P7=47-P8=17-B.opb	OPT f=3 TT=0.068 T1=0.06	No data	No data	No data	OPT f=3 TT=0.068 T1=0.06	No data	No data	No data	OPT f=3 TT=7.783 T1=1.18	OPT f=3 TT=3.803 T1=2.1	OPT f=3 TT=38.101 T1=38.04
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=59-P1=23-P2=29-P3=41-B.opb	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=3.857 T1=2.16	OPT f=3 TT=1.075 T1=0.28	OPT f=3 TT=5.393 T1=5.36
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=59-P1=23-P2=2-P3=37-P4=53-P5=47-P6=31-B.opb	OPT f=2 TT=0.054 T1=0.05	No data	No data	No data	OPT f=2 TT=0.054 T1=0.05	No data	No data	No data	OPT f=2 TT=3.472 T1=1.68	OPT f=2 TT=1.024 T1=0.56	OPT f=2 TT=5.512 T1=5.46
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=59-P1=29-B.opb	OPT f=3 TT=0.009 T1=0	No data	No data	No data	OPT f=3 TT=0.009 T1=0	No data	No data	No data	OPT f=3 TT=0.193 T1=0.63	OPT f=3 TT=0.174 T1=0.13	OPT f=3 TT=0.08 T1=0.07
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=59-P1=37-B.opb	OPT f=3 TT=0.009 T1=0.01	No data	No data	No data	OPT f=3 TT=0.009 T1=0.01	No data	No data	No data	OPT f=3 TT=0.174 T1=0.63	OPT f=3 TT=0.163 T1=0.12	OPT f=3 TT=0.196 T1=0.18
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=59-P1=37-P2=37-P3=53-P4=11-P5=7-P6=13-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=7.193 T1=1.17	OPT f=3 TT=1.415 T1=0.41	OPT f=3 TT=22.03 T1=21.97
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=59-P1=53-P2=11-P3=59-B.opb	OPT f=3 TT=0.026 T1=0.02	No data	No data	No data	OPT f=3 TT=0.026 T1=0.02	No data	No data	No data	OPT f=3 TT=4.131 T1=0.65	OPT f=3 TT=1.672 T1=0.27	OPT f=3 TT=12.783 T1=12.72
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=5-P1=53-P2=23-P3=7-P4=31-P5=59-P6=59-P7=37-P8=41-P9=67-B.opb	OPT f=3 TT=0.077 T1=0.07	No data	No data	No data	OPT f=3 TT=0.077 T1=0.07	No data	No data	No data	OPT f=3 TT=8.682 T1=2.19	OPT f=3 TT=4.063 T1=0.8	OPT f=3 TT=37.442 T1=37.38
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=5-P1=53-P2=2-P3=3-P4=59-P5=29-P6=47-P7=67-P8=37-P9=43-B.opb	OPT f=2 TT=0.079 T1=0.09	No data	No data	No data	OPT f=2 TT=0.079 T1=0.09	No data	No data	No data	OPT f=2 TT=8.333 T1=3.21	OPT f=2 TT=0.833 T1=0.49	OPT f=2 TT=47.606 T1=47.56
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=5-P1=59-P2=47-P3=43-P4=7-P5=19-P6=67-P7=41-B.opb	OPT f=3 TT=0.06 T1=0.05	No data	No data	No data	OPT f=3 TT=0.06 T1=0.05	No data	No data	No data	OPT f=3 TT=7.092 T1=0.68	OPT f=3 TT=3.334 T1=1.18	OPT f=3 TT=28.028 T1=27.97
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=5-P1=7-P2=11-B.opb	OPT f=3 TT=0.017 T1=0.01	No data	No data	No data	OPT f=3 TT=0.017 T1=0.01	No data	No data	No data	OPT f=3 TT=6.834 T1=0.65	OPT f=3 TT=0.495 T1=0.26	OPT f=3 TT=5.182 T1=5.21
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=6-P0=61-P1=67-B.opb	OPT f=3 TT=0.008 T1=0	No data	No data	No data	OPT f=3 TT=0.008 T1=0	No data	No data	No data	OPT f=3 TT=0.175 T1=0.63	OPT f=3 TT=0.173 T1=0.13	OPT f=3 TT=0.096 T1=0.09
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=67-P1=47-P2=2-P3=53-P4=23-P5=7-P6=41-P7=31-B.opb	OPT f=2 TT=0.063 T1=0.06	No data	No data	No data	OPT f=2 TT=0.063 T1=0.06	No data	No data	No data	OPT f=2 TT=4.384 T1=2.68	OPT f=2 TT=1.323 T1=0.85	OPT f=2 TT=0.219 T1=0.2
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=6-P0=7-P1=29-P2=53-P3=31-P4=23-P5=47-P6=67-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=6.354 T1=2.17	OPT f=3 TT=2.694 T1=0.36	OPT f=3 TT=27.552 T1=27.49
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=107-P1=13-P2=17-P3=127-P4=13-P5=53-P6=73-P7=59-B.opb	OPT f=3 TT=0.085 T1=0.08	No data	No data	No data	OPT f=3 TT=0.085 T1=0.08	No data	No data	No data	OPT f=3 TT=18.061 T1=4.2	OPT f=3 TT=10.882 T1=3.09	OPT f=3 TT=335.262 T1=335.37
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=107-P1=73-P2=127-B.opb	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=2.174 T1=0.65	OPT f=3 TT=0.663 T1=0.4	OPT f=3 TT=39.974 T1=39.92
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=107-P1=79-P2=47-P3=23-P4=59-P5=43-B.opb	OPT f=3 TT=0.062 T1=0.06	No data	No data	No data	OPT f=3 TT=0.062 T1=0.06	No data	No data	No data	OPT f=3 TT=16.633 T1=2.18	OPT f=3 TT=8.872 T1=0.62	OPT f=3 TT=652.562 T1=652.84
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=107-P1=7-P2=73-P3=61-B.opb	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=7.392 T1=1.67	OPT f=3 TT=2.566 T1=0.53	OPT f=3 TT=44.554 T1=44.5
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=11-P1=71-P2=127-P3=19-P4=89-P5=17-B.opb	OPT f=3 TT=0.06 T1=0.06	No data	No data	No data	OPT f=3 TT=0.06 T1=0.06	No data	No data	No data	OPT f=3 TT=17.521 T1=0.69	OPT f=3 TT=6.723 T1=0.87	OPT f=3 TT=351.827 T1=351.81
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=127-P1=13-P2=109-B.opb	OPT f=3 TT=0.027 T1=0.02	No data	No data	No data	OPT f=3 TT=0.027 T1=0.02	No data	No data	No data	OPT f=3 TT=114.568 T1=0.65	OPT f=3 TT=0.713 T1=0.42	OPT f=3 TT=31.679 T1=31.62
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=127-P1=47-P2=7-P3=127-P4=17-P5=97-P6=127-B.opb	OPT f=3 TT=0.078 T1=0.07	No data	No data	No data	OPT f=3 TT=0.078 T1=0.07	No data	No data	No data	OPT f=3 TT=16.501 T1=2.18	OPT f=3 TT=8.113 T1=1.38	OPT f=3 TT=252.087 T1=252.06
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=127-P1=59-P2=127-P3=89-P4=17-P5=43-P6=53-B.opb	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=16.482 T1=3.7	OPT f=3 TT=8.982 T1=0.88	OPT f=3 TT=116.315 T1=116.28
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=131-P1=89-P2=127-P3=37-B.opb	OPT f=3 TT=0.039 T1=0.03	No data	No data	No data	OPT f=3 TT=0.039 T1=0.03	No data	No data	No data	OPT f=3 TT=6.633 T1=1.16	OPT f=3 TT=3.724 T1=0.6	OPT f=3 TT=65.578 T1=65.54
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=13-P1=53-P2=127-P3=83-P4=37-P5=107-P6=67-P7=41-P8=113-B.opb	OPT f=3 TT=0.095 T1=0.09	No data	No data	No data	OPT f=3 TT=0.095 T1=0.09	No data	No data	No data	OPT f=3 TT=29.439 T1=2.72	OPT f=3 TT=21.561 T1=1.36	OPT f=3 TT=739.208 T1=739.29
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=17-P1=53-P2=109-B.opb	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=0.028 T1=0.02	No data	No data	No data	OPT f=3 TT=129.765 T1=1.16	OPT f=3 TT=0.714 T1=0.46	OPT f=3 TT=56.503 T1=56.46
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=17-P1=89-P2=113-P3=89-P4=67-B.opb	OPT f=3 TT=0.049 T1=0.04	No data	No data	No data	OPT f=3 TT=0.049 T1=0.04	No data	No data	No data	OPT f=3 TT=11.051 T1=2.69	OPT f=3 TT=4.943 T1=0.93	OPT f=3 TT=155.253 T1=155.22
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=23-P1=29-P2=43-B.opb	OPT f=3 TT=0.026 T1=0.02	No data	No data	No data	OPT f=3 TT=0.026 T1=0.02	No data	No data	No data	OPT f=3 TT=138.393 T1=0.65	OPT f=3 TT=0.714 T1=0.43	OPT f=3 TT=48.654 T1=48.6
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=37-P1=43-B.opb	OPT f=3 TT=0.014 T1=0.01	No data	No data	No data	OPT f=3 TT=0.014 T1=0.01	No data	No data	No data	OPT f=3 TT=0.254 T1=0.63	OPT f=3 TT=0.184 T1=0.14	OPT f=3 TT=0.574 T1=0.54
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=37-P1=47-P2=17-P3=127-P4=31-P5=127-P6=17-B.opb	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=16.591 T1=1.7	OPT f=3 TT=6.885 T1=2.29	OPT f=3 TT=310.904 T1=310.98
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=37-P1=67-P2=5-P3=47-P4=73-P5=127-P6=29-P7=127-B.opb	OPT f=3 TT=0.087 T1=0.09	No data	No data	No data	OPT f=3 TT=0.087 T1=0.09	No data	No data	No data	OPT f=3 TT=20.38 T1=2.72	OPT f=3 TT=10.43 T1=1.92	OPT f=3 TT=681.342 T1=681.39
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=43-P1=107-P2=31-P3=113-P4=127-P5=2-P6=79-B.opb	OPT f=2 TT=0.082 T1=0.08	No data	No data	No data	OPT f=2 TT=0.082 T1=0.08	No data	No data	No data	OPT f=2 TT=6.723 T1=2.68	OPT f=2 TT=3.324 T1=2.81	OPT f=2 TT=66.314 T1=66.26
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=47-P1=43-P2=113-P3=61-B.opb	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=7.742 T1=1.66	OPT f=3 TT=2.565 T1=0.54	OPT f=3 TT=354.049 T1=354.04
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=47-P1=43-P2=53-P3=59-P4=67-P5=71-P6=53-P7=67-B.opb	OPT f=3 TT=0.089 T1=0.08	No data	No data	No data	OPT f=3 TT=0.089 T1=0.08	No data	No data	No data	OPT f=3 TT=19.62 T1=3.2	OPT f=3 TT=15.351 T1=0.59	OPT f=3 TT=343.144 T1=343.21
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=7-P0=53-P1=109-P2=43-P3=13-P4=17-P5=101-P6=59-P7=7-P8=29-P9=107-B.opb	OPT f=3 TT=0.121 T1=0.12	No data	No data	No data	OPT f=3 TT=0.121 T1=0.12	No data	No data	No data	OPT f=3 TT=29.391 T1=4.74	OPT f=3 TT=16.383 T1=2.53	OPT f=3 TT=517.299 T1=517.4
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=53-P1=37-P2=29-P3=83-P4=23-P5=67-B.opb	OPT f=3 TT=0.061 T1=0.06	No data	No data	No data	OPT f=3 TT=0.061 T1=0.06	No data	No data	No data	OPT f=3 TT=17.502 T1=0.67	OPT f=3 TT=5.434 T1=0.32	OPT f=3 TT=524.433 T1=524.51
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=53-P1=5-P2=67-P3=53-P4=17-P5=103-P6=29-P7=71-P8=47-B.opb	OPT f=3 TT=0.104 T1=0.1	No data	No data	No data	OPT f=3 TT=0.104 T1=0.1	No data	No data	No data	OPT f=3 TT=24.99 T1=1.72	OPT f=3 TT=11.841 T1=2.99	OPT f=3 TT=1150.04 T1=1150.25
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=59-P1=103-P2=101-P3=43-P4=37-P5=37-P6=17-P7=23-B.opb	OPT f=3 TT=0.088 T1=0.08	No data	No data	No data	OPT f=3 TT=0.088 T1=0.08	No data	No data	No data	OPT f=3 TT=23.68 T1=2.69	OPT f=3 TT=10.712 T1=2.17	OPT f=3 TT=243.805 T1=243.87
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=59-P1=67-P2=97-P3=53-P4=41-P5=89-B.opb	OPT f=3 TT=0.068 T1=0.07	No data	No data	No data	OPT f=3 TT=0.068 T1=0.07	No data	No data	No data	OPT f=3 TT=14.832 T1=1.17	OPT f=3 TT=6.352 T1=2.06	OPT f=3 TT=264.576 T1=264.55
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=59-P1=97-B.opb	OPT f=3 TT=0.014 T1=0.01	No data	No data	No data	OPT f=3 TT=0.014 T1=0.01	No data	No data	No data	OPT f=3 TT=0.224 T1=0.64	OPT f=3 TT=0.174 T1=0.13	OPT f=3 TT=0.517 T1=0.49
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=5-P1=113-P2=107-P3=11-P4=43-P5=101-B.opb	OPT f=3 TT=0.062 T1=0.06	No data	No data	No data	OPT f=3 TT=0.062 T1=0.06	No data	No data	No data	OPT f=3 TT=17.68 T1=0.68	OPT f=3 TT=9.512 T1=0.55	OPT f=3 TT=675.162 T1=675.2
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=5-P1=11-P2=79-P3=109-B.opb	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=10.693 T1=3.19	OPT f=3 TT=3.294 T1=1.12	OPT f=3 TT=359.31 T1=359.3
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=5-P1=47-P2=89-P3=41-P4=37-P5=113-P6=47-P7=127-P8=37-B.opb	OPT f=3 TT=0.103 T1=0.1	No data	No data	No data	OPT f=3 TT=0.103 T1=0.1	No data	No data	No data	OPT f=3 TT=25.25 T1=1.7	OPT f=3 TT=15.592 T1=3.68	OPT f=3 TT=209.602 T1=209.57
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=61-P1=127-P2=131-P3=107-P4=47-B.opb	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=11.082 T1=2.66	OPT f=3 TT=5.413 T1=0.8	OPT f=3 TT=551.291 T1=551.41
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=61-P1=53-B.opb	OPT f=3 TT=0.014 T1=0.01	No data	No data	No data	OPT f=3 TT=0.014 T1=0.01	No data	No data	No data	OPT f=3 TT=0.233 T1=0.63	OPT f=3 TT=0.175 T1=0.12	OPT f=3 TT=0.666 T1=0.63
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=67-P1=11-P2=79-P3=19-B.opb	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=8.911 T1=2.18	OPT f=3 TT=2.804 T1=0.47	OPT f=3 TT=132.023 T1=131.98
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=7-P0=67-P1=127-P2=73-P3=79-P4=17-P5=109-P6=17-P7=23-P8=23-P9=53-B.opb	OPT f=3 TT=0.11 T1=0.1	No data	No data	No data	OPT f=3 TT=0.11 T1=0.1	No data	No data	No data	OPT f=3 TT=30.228 T1=4.73	OPT f=3 TT=19.501 T1=5.11	OPT f=3 TT=674.36 T1=674.58
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=71-P1=131-P2=37-P3=29-P4=71-P5=79-P6=47-P7=41-B.opb	OPT f=3 TT=0.088 T1=0.08	No data	No data	No data	OPT f=3 TT=0.088 T1=0.08	No data	No data	No data	OPT f=3 TT=25.249 T1=1.7	OPT f=3 TT=10.983 T1=1.5	OPT f=3 TT=479.089 T1=479.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=7-P0=71-P1=79-P2=101-P3=109-P4=107-P5=97-P6=127-P7=127-P8=67-B.opb	OPT f=3 TT=0.096 T1=0.09	No data	No data	No data	OPT f=3 TT=0.096 T1=0.09	No data	No data	No data	OPT f=3 TT=29.18 T1=2.71	OPT f=3 TT=21.461 T1=1.36	OPT f=3 TT=326.923 T1=326.96
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=73-P1=113-P2=59-P3=53-P4=29-B.opb	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=8.553 T1=1.67	OPT f=3 TT=5.762 T1=0.43	OPT f=3 TT=90.754 T1=90.71
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=73-P1=127-P2=41-P3=29-P4=59-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=9.962 T1=3.67	OPT f=3 TT=5.093 T1=0.44	OPT f=3 TT=342.401 T1=342.4
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=79-P1=41-B.opb	OPT f=3 TT=0.012 T1=0.01	No data	No data	No data	OPT f=3 TT=0.012 T1=0.01	No data	No data	No data	OPT f=3 TT=0.234 T1=0.63	OPT f=3 TT=0.173 T1=0.13	OPT f=3 TT=0.892 T1=0.85
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=7-P0=83-P1=113-P2=127-P3=71-P4=61-P5=43-P6=71-P7=41-P8=13-P9=71-B.opb	OPT f=3 TT=0.116 T1=0.11	No data	No data	No data	OPT f=3 TT=0.116 T1=0.11	No data	No data	No data	OPT f=3 TT=25.441 T1=4.23	OPT f=3 TT=14.771 T1=2.31	OPT f=3 TT=487.324 T1=487.33
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=83-P1=11-B.opb	OPT f=3 TT=0.013 T1=0.01	No data	No data	No data	OPT f=3 TT=0.013 T1=0.01	No data	No data	No data	OPT f=3 TT=0.264 T1=0.65	OPT f=3 TT=0.184 T1=0.14	OPT f=3 TT=0.493 T1=0.47
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=7-P0=89-P1=13-P2=37-P3=97-P4=101-P5=107-P6=37-P7=19-P8=47-P9=127-B.opb	OPT f=3 TT=0.107 T1=0.1	No data	No data	No data	OPT f=3 TT=0.107 T1=0.1	No data	No data	No data	OPT f=3 TT=37.327 T1=3.21	OPT f=3 TT=12.862 T1=4.69	OPT f=3 TT=441.907 T1=441.93
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=7-P0=89-P1=17-P2=37-B.opb	OPT f=3 TT=0.026 T1=0.02	No data	No data	No data	OPT f=3 TT=0.026 T1=0.02	No data	No data	No data	OPT f=3 TT=2.363 T1=0.65	OPT f=3 TT=0.735 T1=0.46	OPT f=3 TT=33.738 T1=33.69
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=89-P1=37-P2=43-P3=47-P4=41-P5=107-P6=127-B.opb	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=17.41 T1=1.68	OPT f=3 TT=8.281 T1=2.45	OPT f=3 TT=85.233 T1=85.18
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=97-P1=11-P2=73-P3=43-P4=127-P5=127-P6=37-P7=127-P8=5-B.opb	OPT f=3 TT=0.104 T1=0.1	No data	No data	No data	OPT f=3 TT=0.104 T1=0.1	No data	No data	No data	OPT f=3 TT=29.651 T1=4.21	OPT f=3 TT=15.181 T1=3.05	OPT f=3 TT=499.16 T1=499.36
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=7-P0=97-P1=37-P2=107-P3=53-P4=53-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=11.492 T1=0.67	OPT f=3 TT=3.923 T1=0.61	OPT f=3 TT=411.142 T1=411.14
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=7-P0=97-P1=43-P2=127-P3=89-P4=59-P5=127-P6=43-P7=127-P8=67-P9=17-B.opb	OPT f=3 TT=0.11 T1=0.1	No data	No data	No data	OPT f=3 TT=0.11 T1=0.1	No data	No data	No data	OPT f=3 TT=34.709 T1=4.22	OPT f=3 TT=13.562 T1=3.8	OPT f=3 TT=466.627 T1=466.64
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=103-P1=223-P2=29-P3=89-P4=173-P5=97-P6=227-P7=89-P8=127-P9=223-B.opb	OPT f=3 TT=0.153 T1=0.15	No data	No data	No data	OPT f=3 TT=0.153 T1=0.15	No data	No data	No data	OPT f=3 TT=185.146 T1=25.26	OPT f=3 TT=96.78 T1=15.75	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=107-P1=89-P2=97-P3=41-P4=137-P5=181-P6=11-B.opb	OPT f=3 TT=0.101 T1=0.1	No data	No data	No data	OPT f=3 TT=0.101 T1=0.1	No data	No data	No data	OPT f=3 TT=92.62 T1=9.21	OPT f=3 TT=53.635 T1=5.58	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=127-P1=71-P2=13-B.opb	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=7.263 T1=2.17	OPT f=3 TT=2.344 T1=1.78	OPT f=3 TT=214.061 T1=214.09
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=139-P1=101-P2=227-P3=251-P4=227-P5=251-B.opb	OPT f=3 TT=0.084 T1=0.08	No data	No data	No data	OPT f=3 TT=0.084 T1=0.08	No data	No data	No data	OPT f=3 TT=58.815 T1=7.2	OPT f=3 TT=38.23 T1=8.12	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=139-P1=67-P2=211-P3=127-P4=137-P5=173-P6=89-P7=223-P8=227-P9=79-B.opb	OPT f=3 TT=0.159 T1=0.15	No data	No data	No data	OPT f=3 TT=0.159 T1=0.15	No data	No data	No data	OPT f=3 TT=225.971 T1=22.74	OPT f=3 TT=94.02 T1=15.11	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=149-P1=13-P2=53-P3=149-P4=137-B.opb	OPT f=3 TT=0.07 T1=0.06	No data	No data	No data	OPT f=3 TT=0.07 T1=0.06	No data	No data	No data	OPT f=3 TT=46.535 T1=0.69	OPT f=3 TT=28.45 T1=2.29	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=149-P1=163-P2=41-P3=157-P4=223-P5=67-P6=191-P7=17-P8=37-B.opb	OPT f=3 TT=0.131 T1=0.13	No data	No data	No data	OPT f=3 TT=0.131 T1=0.13	No data	No data	No data	OPT f=3 TT=174.168 T1=9.22	OPT f=3 TT=82.7 T1=5.56	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=149-P1=191-P2=149-P3=191-B.opb	OPT f=3 TT=0.055 T1=0.05	No data	No data	No data	OPT f=3 TT=0.055 T1=0.05	No data	No data	No data	OPT f=3 TT=37.018 T1=1.16	OPT f=3 TT=13.642 T1=1.82	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=149-P1=19-P2=137-P3=191-P4=223-B.opb	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=55.848 T1=3.69	OPT f=3 TT=28.96 T1=5.74	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=149-P1=79-P2=59-P3=73-P4=211-B.opb	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=0.075 T1=0.07	No data	No data	No data	OPT f=3 TT=52.015 T1=1.17	OPT f=3 TT=22.331 T1=3.1	OPT f=3 TT=732.995 T1=733.3
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=157-P1=107-B.opb	OPT f=3 TT=0.02 T1=0.01	No data	No data	No data	OPT f=3 TT=0.02 T1=0.01	No data	No data	No data	OPT f=3 TT=0.334 T1=0.64	OPT f=3 TT=0.193 T1=0.15	OPT f=3 TT=1.82 T1=1.76
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=157-P1=211-P2=97-P3=71-B.opb	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=43.157 T1=1.67	OPT f=3 TT=17.85 T1=1.66	? (TO) TT=1800.12
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=157-P1=47-B.opb	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=0.203 T1=0.65	OPT f=3 TT=0.187 T1=0.14	OPT f=3 TT=0.229 T1=0.21
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=167-P1=131-P2=83-P3=109-B.opb	OPT f=3 TT=0.049 T1=0.04	No data	No data	No data	OPT f=3 TT=0.049 T1=0.04	No data	No data	No data	OPT f=3 TT=35.47 T1=1.16	OPT f=3 TT=15.863 T1=1.84	OPT f=3 TT=1656.12 T1=1656.54
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=173-P1=191-P2=127-P3=113-P4=97-P5=167-B.opb	OPT f=3 TT=0.087 T1=0.08	No data	No data	No data	OPT f=3 TT=0.087 T1=0.08	No data	No data	No data	OPT f=3 TT=63.014 T1=3.19	OPT f=3 TT=48.79 T1=8.29	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=179-P1=37-B.opb	OPT f=3 TT=0.02 T1=0.02	No data	No data	No data	OPT f=3 TT=0.02 T1=0.02	No data	No data	No data	OPT f=3 TT=0.224 T1=0.64	OPT f=3 TT=0.183 T1=0.14	OPT f=3 TT=2.069 T1=2.01
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=191-P1=151-P2=41-P3=257-P4=191-B.opb	OPT f=3 TT=0.068 T1=0.07	No data	No data	No data	OPT f=3 TT=0.068 T1=0.07	No data	No data	No data	OPT f=3 TT=35.519 T1=4.18	OPT f=3 TT=25.639 T1=2.88	OPT f=3 TT=1339.93 T1=1340.34
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=191-P1=43-P2=41-B.opb	OPT f=3 TT=0.037 T1=0.03	No data	No data	No data	OPT f=3 TT=0.037 T1=0.03	No data	No data	No data	OPT f=3 TT=6.453 T1=2.15	OPT f=3 TT=2.106 T1=1.5	OPT f=3 TT=670.403 T1=670.45
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=197-P1=29-P2=199-P3=251-P4=227-P5=257-P6=149-P7=53-B.opb	OPT f=3 TT=0.12 T1=0.11	No data	No data	No data	OPT f=3 TT=0.12 T1=0.11	No data	No data	No data	OPT f=3 TT=121.506 T1=11.22	OPT f=3 TT=73.103 T1=0.99	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=197-P1=97-P2=163-P3=151-P4=53-P5=139-P6=107-B.opb	OPT f=3 TT=0.102 T1=0.1	No data	No data	No data	OPT f=3 TT=0.102 T1=0.1	No data	No data	No data	OPT f=3 TT=125.936 T1=1.21	OPT f=3 TT=50.626 T1=5.41	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=19-P1=211-P2=79-B.opb	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=0.038 T1=0.03	No data	No data	No data	OPT f=3 TT=6.961 T1=2.15	OPT f=3 TT=4.004 T1=1.5	OPT f=3 TT=681.693 T1=681.73
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=211-P1=113-P2=103-P3=37-P4=167-P5=5-P6=191-P7=13-P8=223-P9=137-B.opb	OPT f=3 TT=0.165 T1=0.16	No data	No data	No data	OPT f=3 TT=0.165 T1=0.16	No data	No data	No data	OPT f=3 TT=200.113 T1=14.73	OPT f=3 TT=92.69 T1=9.58	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=211-P1=223-P2=251-P3=3-P4=107-B.opb	OPT f=3 TT=0.067 T1=0.07	No data	No data	No data	OPT f=3 TT=0.067 T1=0.07	No data	No data	No data	OPT f=3 TT=42.298 T1=2.19	OPT f=3 TT=27.769 T1=1.15	OPT f=3 TT=486.389 T1=486.4
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=223-P1=29-P2=7-P3=83-P4=113-P5=223-P6=229-B.opb	OPT f=3 TT=0.104 T1=0.1	No data	No data	No data	OPT f=3 TT=0.104 T1=0.1	No data	No data	No data	OPT f=3 TT=88.482 T1=9.7	OPT f=3 TT=76.16 T1=6.16	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=223-P1=61-P2=13-P3=127-P4=37-P5=37-P6=137-P7=37-P8=223-B.opb	OPT f=3 TT=0.137 T1=0.13	No data	No data	No data	OPT f=3 TT=0.137 T1=0.13	No data	No data	No data	OPT f=3 TT=166.609 T1=2.72	OPT f=3 TT=61.07 T1=3.5	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=223-P1=73-B.opb	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=0.019 T1=0.01	No data	No data	No data	OPT f=3 TT=0.354 T1=0.64	OPT f=3 TT=0.174 T1=0.13	OPT f=3 TT=2.75 T1=2.68
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=227-P1=23-P2=89-B.opb	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	OPT f=3 TT=0.036 T1=0.03	No data	No data	No data	SAT (TO) f=3 TT=1800.04 T1=2.65	OPT f=3 TT=2.954 T1=2.32	OPT f=3 TT=316.498 T1=316.48
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=229-P1=67-P2=149-P3=97-P4=149-P5=211-P6=89-P7=59-B.opb	OPT f=3 TT=0.123 T1=0.12	No data	No data	No data	OPT f=3 TT=0.123 T1=0.12	No data	No data	No data	OPT f=3 TT=117.137 T1=9.24	OPT f=3 TT=49.92 T1=10.81	? (TO) TT=1800.09
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=233-P1=223-P2=251-P3=181-P4=197-P5=127-P6=89-P7=149-B.opb	OPT f=3 TT=0.122 T1=0.12	No data	No data	No data	OPT f=3 TT=0.122 T1=0.12	No data	No data	No data	OPT f=3 TT=116.805 T1=3.73	OPT f=3 TT=76.052 T1=7.64	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=233-P1=79-P2=107-P3=23-P4=107-P5=223-P6=239-P7=127-P8=229-P9=181-B.opb	OPT f=3 TT=0.155 T1=0.15	No data	No data	No data	OPT f=3 TT=0.155 T1=0.15	No data	No data	No data	OPT f=3 TT=158.84 T1=14.81	OPT f=3 TT=100.929 T1=6.09	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=239-P1=257-P2=113-P3=223-B.opb	OPT f=3 TT=0.051 T1=0.05	No data	No data	No data	OPT f=3 TT=0.051 T1=0.05	No data	No data	No data	OPT f=3 TT=28.58 T1=2.17	OPT f=3 TT=15.272 T1=1.42	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=257-P1=97-P2=149-B.opb	OPT f=3 TT=0.037 T1=0.03	No data	No data	No data	OPT f=3 TT=0.037 T1=0.03	No data	No data	No data	SAT (TO) f=3 TT=1800.08 T1=2.67	OPT f=3 TT=1.944 T1=1.56	OPT f=3 TT=548.653 T1=548.67
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=29-P1=157-P2=173-P3=83-P4=37-P5=251-P6=29-P7=181-B.opb	OPT f=3 TT=0.12 T1=0.11	No data	No data	No data	OPT f=3 TT=0.12 T1=0.11	No data	No data	No data	OPT f=3 TT=100.518 T1=7.21	OPT f=3 TT=60.646 T1=6.97	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=29-P1=61-P2=43-P3=131-P4=2-P5=59-P6=41-B.opb	OPT f=2 TT=0.107 T1=0.1	No data	No data	No data	OPT f=2 TT=0.107 T1=0.1	No data	No data	No data	OPT f=2 TT=11.225 T1=5.22	OPT f=2 TT=0.663 T1=0.38	OPT f=2 TT=6.525 T1=6.46
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=37-P1=223-P2=197-P3=97-P4=11-P5=157-P6=97-P7=127-P8=79-P9=11-B.opb	OPT f=3 TT=0.156 T1=0.15	No data	No data	No data	OPT f=3 TT=0.156 T1=0.15	No data	No data	No data	OPT f=3 TT=228.418 T1=11.74	OPT f=3 TT=90.11 T1=7.28	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=43-P1=131-P2=257-P3=71-P4=149-P5=223-P6=167-B.opb	OPT f=3 TT=0.11 T1=0.11	No data	No data	No data	OPT f=3 TT=0.11 T1=0.11	No data	No data	No data	OPT f=3 TT=87.902 T1=8.77	OPT f=3 TT=66.214 T1=5.72	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=47-P1=211-P2=233-P3=173-P4=181-P5=71-B.opb	OPT f=3 TT=0.085 T1=0.08	No data	No data	No data	OPT f=3 TT=0.085 T1=0.08	No data	No data	No data	OPT f=3 TT=75.934 T1=6.21	OPT f=3 TT=47.307 T1=1.25	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=53-P1=17-P2=109-P3=2-P4=191-P5=191-P6=47-P7=101-P8=97-B.opb	OPT f=2 TT=0.14 T1=0.14	No data	No data	No data	OPT f=2 TT=0.14 T1=0.14	No data	No data	No data	OPT f=2 TT=24.939 T1=11.72	OPT f=2 TT=10.652 T1=9.75	OPT f=2 TT=845.301 T1=845.6
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=8-P0=5-P1=173-B.opb	OPT f=3 TT=0.018 T1=0.01	No data	No data	No data	OPT f=3 TT=0.018 T1=0.01	No data	No data	No data	OPT f=3 TT=0.374 T1=0.64	OPT f=3 TT=0.184 T1=0.13	OPT f=3 TT=1.752 T1=1.69
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=61-P1=167-P2=157-P3=13-P4=173-P5=47-P6=47-P7=251-P8=79-B.opb	OPT f=3 TT=0.136 T1=0.13	No data	No data	No data	OPT f=3 TT=0.136 T1=0.13	No data	No data	No data	OPT f=3 TT=164.678 T1=2.72	OPT f=3 TT=61.66 T1=3.65	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=71-P1=107-P2=197-P3=67-B.opb	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=0.052 T1=0.05	No data	No data	No data	OPT f=3 TT=45.137 T1=1.18	OPT f=3 TT=19.331 T1=0.38	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=71-P1=29-P2=241-P3=127-P4=67-P5=23-B.opb	OPT f=3 TT=0.086 T1=0.08	No data	No data	No data	OPT f=3 TT=0.086 T1=0.08	No data	No data	No data	OPT f=3 TT=86.892 T1=2.71	OPT f=3 TT=40.72 T1=5.63	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=79-P1=163-P2=61-P3=127-P4=163-P5=211-B.opb	OPT f=3 TT=0.089 T1=0.08	No data	No data	No data	OPT f=3 TT=0.089 T1=0.08	No data	No data	No data	OPT f=3 TT=97.71 T1=2.71	OPT f=3 TT=43.9 T1=2.3	OPT f=3 TT=1747.45 T1=1747.98
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=8-P0=89-P1=127-P2=191-P3=17-P4=97-P5=227-P6=191-P7=41-B.opb	OPT f=3 TT=0.12 T1=0.12	No data	No data	No data	OPT f=3 TT=0.12 T1=0.12	No data	No data	No data	OPT f=3 TT=131.014 T1=9.23	OPT f=3 TT=56.73 T1=4.61	? (TO) TT=1800.03
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=8-P0=89-P1=181-P2=233-P3=19-P4=167-P5=113-P6=191-P7=61-P8=59-B.opb	OPT f=3 TT=0.137 T1=0.13	No data	No data	No data	OPT f=3 TT=0.137 T1=0.13	No data	No data	No data	OPT f=3 TT=116.776 T1=4.24	OPT f=3 TT=84.381 T1=11.66	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=103-P1=127-P2=263-P3=461-P4=191-P5=277-B.opb	OPT f=3 TT=0.114 T1=0.11	No data	No data	No data	OPT f=3 TT=0.114 T1=0.11	No data	No data	No data	OPT f=3 TT=679.932 T1=28.21	OPT f=3 TT=278.151 T1=5.26	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=103-P1=277-P2=401-P3=67-P4=337-P5=17-P6=499-P7=23-B.opb	OPT f=3 TT=0.161 T1=0.15	No data	No data	No data	OPT f=3 TT=0.161 T1=0.15	No data	No data	No data	OPT f=3 TT=1371.46 T1=23.75	OPT f=3 TT=527.734 T1=23.37	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=109-P1=191-P2=263-P3=37-P4=317-P5=89-P6=131-B.opb	OPT f=3 TT=0.151 T1=0.15	No data	No data	No data	OPT f=3 TT=0.151 T1=0.15	No data	No data	No data	OPT f=3 TT=985.385 T1=22.22	OPT f=3 TT=386.77 T1=11.77	? (TO) TT=1800.12
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=113-P1=127-P2=101-P3=419-P4=107-P5=271-P6=379-P7=167-P8=163-B.opb	OPT f=3 TT=0.19 T1=0.18	No data	No data	No data	OPT f=3 TT=0.19 T1=0.18	No data	No data	No data	OPT f=3 TT=1541.6 T1=31.75	OPT f=3 TT=672.18 T1=44.79	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=11-P1=331-P2=7-P3=107-P4=137-P5=439-P6=409-P7=421-P8=491-P9=293-B.opb	OPT f=3 TT=0.221 T1=0.22	No data	No data	No data	OPT f=3 TT=0.221 T1=0.22	No data	No data	No data	OPT f=3 TT=1612.24 T1=97.35	OPT f=3 TT=862.02 T1=102.85	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=127-P1=293-P2=269-P3=7-P4=157-B.opb	OPT f=3 TT=0.092 T1=0.09	No data	No data	No data	OPT f=3 TT=0.092 T1=0.09	No data	No data	No data	OPT f=3 TT=425.209 T1=6.19	OPT f=3 TT=123.865 T1=6.99	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=131-P1=307-P2=281-P3=173-P4=479-P5=461-P6=107-P7=337-P8=353-B.opb	OPT f=3 TT=0.195 T1=0.19	No data	No data	No data	OPT f=3 TT=0.195 T1=0.19	No data	No data	No data	OPT f=3 TT=1250.37 T1=29.26	OPT f=3 TT=663.355 T1=88.98	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=137-P1=101-P2=5-P3=409-P4=419-P5=401-P6=61-P7=239-B.opb	OPT f=3 TT=0.161 T1=0.16	No data	No data	No data	OPT f=3 TT=0.161 T1=0.16	No data	No data	No data	OPT f=3 TT=1496.92 T1=32.24	OPT f=3 TT=476.892 T1=23.82	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=137-P1=127-P2=347-B.opb	OPT f=3 TT=0.05 T1=0.04	No data	No data	No data	OPT f=3 TT=0.05 T1=0.04	No data	No data	No data	SAT (TO) f=3 TT=1800.04 T1=12.67	OPT f=3 TT=9.784 T1=9.22	OPT f=3 TT=1130.5 T1=1130.78
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=149-P1=191-P2=199-B.opb	OPT f=3 TT=0.047 T1=0.04	No data	No data	No data	OPT f=3 TT=0.047 T1=0.04	No data	No data	No data	SAT (TO) f=3 TT=1801.19 T1=11.67	OPT f=3 TT=11.212 T1=10.68	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=149-P1=419-P2=307-P3=223-B.opb	OPT f=3 TT=0.073 T1=0.07	No data	No data	No data	OPT f=3 TT=0.073 T1=0.07	No data	No data	No data	OPT f=3 TT=225.899 T1=2.18	OPT f=3 TT=74.86 T1=2.84	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=173-P1=23-P2=211-P3=199-P4=389-P5=269-P6=383-P7=211-P8=347-B.opb	OPT f=3 TT=0.191 T1=0.19	No data	No data	No data	OPT f=3 TT=0.191 T1=0.19	No data	No data	No data	OPT f=3 TT=1490.04 T1=23.76	OPT f=3 TT=650.49 T1=44.3	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=19-P1=337-P2=467-P3=53-B.opb	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=140.844 T1=2.18	OPT f=3 TT=65.895 T1=0.66	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=211-P1=317-P2=331-P3=491-P4=101-P5=283-P6=487-P7=439-B.opb	OPT f=3 TT=0.171 T1=0.17	No data	No data	No data	OPT f=3 TT=0.171 T1=0.17	No data	No data	No data	OPT f=3 TT=1406.48 T1=61.76	OPT f=3 TT=466.613 T1=85.18	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=211-P1=331-P2=199-P3=307-P4=457-P5=293-B.opb	OPT f=3 TT=0.113 T1=0.11	No data	No data	No data	OPT f=3 TT=0.113 T1=0.11	No data	No data	No data	OPT f=3 TT=620.41 T1=6.22	OPT f=3 TT=344.72 T1=16.13	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=251-P1=139-P2=89-P3=173-P4=107-B.opb	OPT f=3 TT=0.092 T1=0.09	No data	No data	No data	OPT f=3 TT=0.092 T1=0.09	No data	No data	No data	OPT f=3 TT=358.021 T1=3.2	OPT f=3 TT=100.91 T1=12.08	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=251-P1=251-P2=101-P3=11-P4=89-P5=53-P6=439-P7=491-P8=389-B.opb	OPT f=3 TT=0.191 T1=0.19	No data	No data	No data	OPT f=3 TT=0.191 T1=0.19	No data	No data	No data	OPT f=3 TT=1465.39 T1=101.8	OPT f=3 TT=483.382 T1=37.18	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=251-P1=257-P2=19-P3=349-P4=257-P5=479-P6=367-B.opb	OPT f=3 TT=0.15 T1=0.14	No data	No data	No data	OPT f=3 TT=0.15 T1=0.14	No data	No data	No data	OPT f=3 TT=1139.18 T1=19.22	OPT f=3 TT=350.05 T1=45.02	? (TO) TT=1800.07
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=257-P1=53-P2=163-P3=163-P4=251-P5=269-P6=479-P7=113-B.opb	OPT f=3 TT=0.171 T1=0.17	No data	No data	No data	OPT f=3 TT=0.171 T1=0.17	No data	No data	No data	OPT f=3 TT=1185.54 T1=10.29	OPT f=3 TT=523.024 T1=18.4	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=263-P1=269-B.opb	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=0.022 T1=0.02	No data	No data	No data	OPT f=3 TT=0.395 T1=0.64	OPT f=3 TT=0.193 T1=0.15	OPT f=3 TT=11.186 T1=11.13
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=263-P1=409-P2=29-P3=379-B.opb	OPT f=3 TT=0.079 T1=0.08	No data	No data	No data	OPT f=3 TT=0.079 T1=0.08	No data	No data	No data	OPT f=3 TT=299.738 T1=2.18	OPT f=3 TT=72.79 T1=0.67	? (TO) TT=1800.11
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=271-P1=293-B.opb	OPT f=3 TT=0.027 T1=0.03	No data	No data	No data	OPT f=3 TT=0.027 T1=0.03	No data	No data	No data	OPT f=3 TT=0.394 T1=0.65	OPT f=3 TT=0.184 T1=0.13	OPT f=3 TT=13.955 T1=13.89
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=293-P1=97-P2=163-P3=149-P4=163-P5=457-P6=521-P7=173-P8=431-P9=419-B.opb	OPT f=3 TT=0.217 T1=0.21	No data	No data	No data	OPT f=3 TT=0.217 T1=0.21	No data	No data	No data	OPT f=3 TT=1765.33 T1=130.33	OPT f=3 TT=891.76 T1=100.23	? (TO) TT=1800.04
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=307-P1=313-P2=331-P3=461-P4=131-P5=307-P6=149-P7=479-P8=317-P9=431-B.opb	OPT f=3 TT=0.216 T1=0.22	No data	No data	No data	OPT f=3 TT=0.216 T1=0.22	No data	No data	No data	OPT f=3 TT=1512.82 T1=158.93	OPT f=3 TT=833.79 T1=48.63	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=307-P1=59-P2=149-P3=337-P4=409-P5=457-P6=79-P7=53-P8=347-P9=487-B.opb	OPT f=3 TT=0.212 T1=0.21	No data	No data	No data	OPT f=3 TT=0.212 T1=0.21	No data	No data	No data	OPT f=3 TT=1451.92 T1=185.81	OPT f=3 TT=881.06 T1=111.47	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=347-P1=127-P2=53-P3=293-P4=199-P5=107-B.opb	OPT f=3 TT=0.12 T1=0.11	No data	No data	No data	OPT f=3 TT=0.12 T1=0.11	No data	No data	No data	OPT f=3 TT=673.141 T1=5.2	OPT f=3 TT=280.9 T1=19.28	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=347-P1=137-P2=419-P3=449-P4=47-B.opb	OPT f=3 TT=0.097 T1=0.09	No data	No data	No data	OPT f=3 TT=0.097 T1=0.09	No data	No data	No data	OPT f=3 TT=470.304 T1=13.7	OPT f=3 TT=174.866 T1=4.27	? (TO) TT=1800.06
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=349-P1=101-P2=17-P3=271-P4=11-P5=179-P6=127-B.opb	OPT f=3 TT=0.142 T1=0.14	No data	No data	No data	OPT f=3 TT=0.142 T1=0.14	No data	No data	No data	OPT f=3 TT=1110.55 T1=12.72	OPT f=3 TT=394.445 T1=32.11	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=373-P1=127-P2=409-P3=11-P4=263-P5=269-B.opb	OPT f=3 TT=0.12 T1=0.12	No data	No data	No data	OPT f=3 TT=0.12 T1=0.12	No data	No data	No data	OPT f=3 TT=771.186 T1=2.7	OPT f=3 TT=390.66 T1=8.66	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=383-P1=149-P2=409-P3=307-P4=127-P5=191-P6=227-P7=281-P8=211-B.opb	OPT f=3 TT=0.189 T1=0.19	No data	No data	No data	OPT f=3 TT=0.189 T1=0.19	No data	No data	No data	OPT f=3 TT=1784.94 T1=15.79	OPT f=3 TT=624.7 T1=58.01	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=397-P1=307-P2=37-P3=127-P4=401-P5=331-B.opb	OPT f=3 TT=0.135 T1=0.13	No data	No data	No data	OPT f=3 TT=0.135 T1=0.13	No data	No data	No data	OPT f=3 TT=562.13 T1=5.21	OPT f=3 TT=315.466 T1=12.45	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=419-P1=479-P2=367-B.opb	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	OPT f=3 TT=0.05 T1=0.05	No data	No data	No data	SAT (TO) f=3 TT=1801.3 T1=9.68	OPT f=3 TT=9.132 T1=8.47	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=41-P1=331-P2=37-B.opb	OPT f=3 TT=0.048 T1=0.05	No data	No data	No data	OPT f=3 TT=0.048 T1=0.05	No data	No data	No data	OPT f=3 TT=39.538 T1=12.66	OPT f=3 TT=6.94 T1=6.27	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/ factor-mod-B/ factor-mod-size=9-P0=421-P1=401-P2=149-P3=307-P4=521-P5=409-P6=79-P7=59-P8=127-P9=503-B.opb	OPT f=3 TT=0.237 T1=0.23	No data	No data	No data	OPT f=3 TT=0.237 T1=0.23	No data	No data	No data	OPT f=3 TT=1680.6 T1=11.75	OPT f=3 TT=742.54 T1=88.04	? (TO) TT=1800.01
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=43-P1=101-P2=251-P3=307-P4=499-B.opb	OPT f=3 TT=0.095 T1=0.09	No data	No data	No data	OPT f=3 TT=0.095 T1=0.09	No data	No data	No data	OPT f=3 TT=347.153 T1=2.7	OPT f=3 TT=177.576 T1=3.09	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=449-P1=149-P2=137-P3=137-P4=83-B.opb	OPT f=3 TT=0.095 T1=0.09	No data	No data	No data	OPT f=3 TT=0.095 T1=0.09	No data	No data	No data	OPT f=3 TT=341.122 T1=5.7	OPT f=3 TT=214.65 T1=0.78	? (TO) TT=1800.08
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=457-P1=137-P2=191-B.opb	OPT f=3 TT=0.048 T1=0.05	No data	No data	No data	OPT f=3 TT=0.048 T1=0.05	No data	No data	No data	OPT f=3 TT=32.61 T1=10.18	OPT f=3 TT=10.282 T1=6.65	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=487-P1=127-P2=347-P3=419-P4=367-P5=149-P6=419-B.opb	OPT f=3 TT=0.145 T1=0.14	No data	No data	No data	OPT f=3 TT=0.145 T1=0.14	No data	No data	No data	OPT f=3 TT=1060.62 T1=23.28	OPT f=3 TT=383.71 T1=33.25	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=487-P1=163-P2=173-P3=211-B.opb	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=230.97 T1=1.67	OPT f=3 TT=97.818 T1=0.73	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=499-P1=293-P2=223-P3=277-B.opb	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=0.072 T1=0.07	No data	No data	No data	OPT f=3 TT=233.369 T1=2.67	OPT f=3 TT=72.94 T1=3.93	? (TO) TT=1800.05
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=509-P1=457-P2=223-P3=127-P4=431-P5=67-P6=17-P7=479-B.opb	OPT f=3 TT=0.178 T1=0.17	No data	No data	No data	OPT f=3 TT=0.178 T1=0.17	No data	No data	No data	OPT f=3 TT=964.147 T1=17.73	OPT f=3 TT=510.956 T1=9.32	? (TO) TT=1800.1
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/ roussel/factor-mod-B/ factor-mod-size=9-P0=67-P1=349-P2=67-P3=499-P4=79-P5=347-P6=307-B.opb	OPT f=3 TT=0.142 T1=0.14	No data	No data	No data	OPT f=3 TT=0.142 T1=0.14	No data	No data	No data	OPT f=3 TT=1010.45 T1=18.27	OPT f=3 TT=542.88 T1=13.89	? (TO) TT=1800.02
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=67-P1=71-B.opb	OPT f=3 TT=0.027 T1=0.02	No data	No data	No data	OPT f=3 TT=0.027 T1=0.02	No data	No data	No data	OPT f=3 TT=0.404 T1=0.65	OPT f=3 TT=0.204 T1=0.15	OPT f=3 TT=9.437 T1=9.37
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=71-P1=439-B.opb	OPT f=3 TT=0.027 T1=0.03	No data	No data	No data	OPT f=3 TT=0.027 T1=0.03	No data	No data	No data	OPT f=3 TT=0.403 T1=0.64	OPT f=3 TT=0.202 T1=0.15	OPT f=3 TT=10.536 T1=10.48
normalized-PB07/OPT-SMALLINT-NLC/ submittedPB07/roussel/factor-mod-B/ factor-mod-size=9-P0=97-P1=127-B.opb	OPT f=3 TT=0.021 T1=0.02	No data	No data	No data	OPT f=3 TT=0.021 T1=0.02	No data	No data	No data	OPT f=3 TT=0.254 T1=0.64	OPT f=3 TT=0.185 T1=0.13	OPT f=3 TT=10.673 T1=10.63
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_1_15.opb	SAT TT=0.062 T1=0.06	No data	No data	No data	SAT TT=0.123 T1=0.12	No data	No data	No data	SAT TT=4.163 T1=1.32	? (TO) TT=1800.29	SAT TT=0.062 T1=0.06
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_1_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.54	? (TO) TT=1800.01
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_2_15.opb	SAT TT=0.062 T1=0.05	No data	No data	No data	SAT TT=0.136 T1=0.13	No data	No data	No data	SAT TT=3.331 T1=1.33	? (TO) TT=1800.04	SAT TT=0.062 T1=0.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_2_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_3_15.opb	SAT TT=0.06 T1=0.05	No data	No data	No data	SAT TT=0.122 T1=0.12	No data	No data	No data	SAT TT=3.395 T1=1.34	? (TO) TT=1800.07	SAT TT=0.06 T1=0.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_3_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.74	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_4_15.opb	SAT TT=0.062 T1=0.05	No data	No data	No data	SAT TT=0.13 T1=0.13	No data	No data	No data	SAT TT=3.272 T1=1.32	SAT TT=611.51 T1=608.63	SAT TT=0.062 T1=0.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_4_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.87	? (TO) TT=1800.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_5_15.opb	SAT TT=0.062 T1=0.05	No data	No data	No data	SAT TT=0.122 T1=0.12	No data	No data	No data	SAT TT=3.064 T1=1.32	? (TO) TT=1800.56	SAT TT=0.062 T1=0.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_5_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_1_15.opb	SAT TT=1224.98 T1=1225.19	No data	No data	No data	SAT TT=1224.98 T1=1225.19	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_1_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.61	? (TO) TT=1800.09
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_2_15.opb	SAT TT=932.568 T1=932.71	No data	No data	No data	SAT TT=932.568 T1=932.71	No data	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_2_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.64	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_3_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.72	? (TO) TT=1800.07
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_3_40.opb		No data	No data	No data	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.79	? (TO) TT=1800.06
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_4_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.72	? (TO) TT=1800.07
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_4_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.82	? (TO) TT=1800.04
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_5_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.73	? (TO) TT=1800.62	? (TO) TT=1800.09
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_5_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.83	? (TO) TT=1800.74	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_1_5.opb	UNSAT TT=0.008	No data	No data	No data	UNSAT TT=0.008	No data	No data	No data	UNSAT TT=0.604	UNSAT TT=0.304	UNSAT TT=0.025
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_1_8.opb	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.223	UNSAT TT=0.175	UNSAT TT=0.02
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_2_5.opb	UNSAT TT=0.008	No data	No data	No data	UNSAT TT=0.008	No data	No data	No data	UNSAT TT=0.533	UNSAT TT=0.254	UNSAT TT=0.027
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_2_8.opb	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.214	UNSAT TT=0.175	UNSAT TT=0.016
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_3_5.opb	UNSAT TT=0.009	No data	No data	No data	UNSAT TT=0.009	No data	No data	No data	UNSAT TT=0.595	UNSAT TT=0.303	UNSAT TT=0.024
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_3_8.opb	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.184	UNSAT TT=0.174	UNSAT TT=0.019
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_4_5.opb	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.613	UNSAT TT=0.312	UNSAT TT=0.027
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_4_8.opb	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.174	UNSAT TT=0.172	UNSAT TT=0.016
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_5_5.opb	UNSAT TT=0.008	No data	No data	No data	UNSAT TT=0.008	No data	No data	No data	UNSAT TT=0.592	UNSAT TT=0.334	UNSAT TT=0.029
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_5_8.opb	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.007	No data	No data	No data	UNSAT TT=0.203	UNSAT TT=0.175	UNSAT TT=0.019
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_1_15.opb	SAT TT=0.126 T1=0.12	No data	No data	No data	SAT TT=0.246 T1=0.24	No data	No data	No data	SAT TT=1.774 T1=0.93	? (TO) TT=1800.03	SAT TT=0.126 T1=0.12
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_1_40.opb	SAT TT=0.251 T1=0.24	No data	No data	No data	SAT TT=0.553 T1=0.55	No data	No data	No data	SAT TT=94.26 T1=45.95	? (TO) TT=1800.04	SAT TT=0.251 T1=0.24
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_2_15.opb	SAT TT=0.116 T1=0.11	No data	No data	No data	SAT TT=0.313 T1=0.31	No data	No data	No data	SAT TT=1.733 T1=0.93	? (TO) TT=1800.04	SAT TT=0.116 T1=0.11
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_2_40.opb	SAT TT=0.248 T1=0.37	No data	No data	No data	SAT TT=0.373 T1=0.37	No data	No data	No data	SAT TT=12.762 T1=5.44	? (TO) TT=1800.05	SAT TT=0.248 T1=0.43
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_3_15.opb	SAT TT=0.11 T1=0.11	No data	No data	No data	SAT TT=0.346 T1=0.34	No data	No data	No data	SAT TT=1.704 T1=0.95	? (TO) TT=1800.29	SAT TT=0.11 T1=0.11
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_3_40.opb	SAT TT=0.246 T1=0.23	No data	No data	No data	SAT TT=0.376 T1=0.37	No data	No data	No data	SAT TT=16.061 T1=6.93	? (TO) TT=1800.02	SAT TT=0.246 T1=0.23
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_4_15.opb	SAT TT=0.118 T1=0.11	No data	No data	No data	SAT TT=0.293 T1=0.29	No data	No data	No data	SAT TT=1.805 T1=0.92	? (TO) TT=1800.05	SAT TT=0.118 T1=0.11
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_4_40.opb	SAT TT=0.31 T1=0.29	No data	No data	No data	SAT TT=0.412 T1=0.41	No data	No data	No data	SAT TT=8.322 T1=3.44	? (TO) TT=1800	SAT TT=0.31 T1=0.29
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_5_15.opb	SAT TT=0.12 T1=0.11	No data	No data	No data	SAT TT=0.263 T1=0.26	No data	No data	No data	SAT TT=1.814 T1=0.94	? (TO) TT=1800.79	SAT TT=0.12 T1=0.11
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_5_40.opb	SAT TT=0.214 T1=0.2	No data	No data	No data	SAT TT=0.383 T1=0.38	No data	No data	No data	SAT TT=7.892 T1=2.93	? (TO) TT=1800.92	SAT TT=0.214 T1=0.2
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_1_15.opb	SAT TT=0.237 T1=0.22	No data	No data	No data	SAT TT=0.677 T1=0.67	No data	No data	No data	SAT TT=7.923 T1=2.69	? (TO) TT=1800.08	SAT TT=0.237 T1=0.22
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_1_40.opb		No data	No data	No data	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.02
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_2_15.opb	SAT TT=0.233 T1=0.22	No data	No data	No data	SAT TT=0.631 T1=0.62	No data	No data	No data	SAT TT=8.003 T1=2.69	? (TO) TT=1800.08	SAT TT=0.233 T1=0.22
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_2_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_3_15.opb	SAT TT=0.233 T1=0.22	No data	No data	No data	SAT TT=0.72 T1=0.71	No data	No data	No data	SAT TT=8.763 T1=3.18	? (TO) TT=1800.02	SAT TT=0.233 T1=0.22
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_3_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_4_15.opb	SAT TT=0.243 T1=0.23	No data	No data	No data	SAT TT=0.629 T1=0.62	No data	No data	No data	SAT TT=8.333 T1=2.68	? (TO) TT=1800.01	SAT TT=0.243 T1=0.23
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_4_40.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.75	? (TO) TT=1800.07
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_5_15.opb	SAT TT=0.236 T1=0.23	No data	No data	No data	SAT TT=0.736 T1=0.73	No data	No data	No data	SAT TT=9.733 T1=3.69	? (TO) TT=1800.08	SAT TT=0.236 T1=0.23
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_5_40.opb		No data	No data	No data	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_1_15.opb	SAT TT=0.262 T1=0.25	No data	No data	No data	SAT TT=2.403 T1=2.4	No data	No data	No data	SAT TT=4.874 T1=1.75	? (TO) TT=1800.09	SAT TT=0.262 T1=0.25
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_1_80.opb	SAT TT=0.259 T1=0.24	No data	No data	No data	SAT TT=1.694 T1=1.68	No data	No data	No data	SAT TT=18.481 T1=7.72	? (TO) TT=1800	SAT TT=0.259 T1=0.24
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_2_15.opb	SAT TT=0.264 T1=0.46	No data	No data	No data	SAT TT=1.587 T1=1.58	No data	No data	No data	SAT TT=4.762 T1=1.76	? (TO) TT=1800.77	SAT TT=0.264 T1=0.46
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_2_80.opb	SAT TT=0.261 T1=0.25	No data	No data	No data	SAT TT=2.124 T1=2.11	No data	No data	No data	SAT TT=19.072 T1=8.23	? (TO) TT=1800.05	SAT TT=0.261 T1=0.25
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_3_15.opb	SAT TT=0.257 T1=0.24	No data	No data	No data	SAT TT=0.916 T1=0.91	No data	No data	No data	SAT TT=4.673 T1=1.72	? (TO) TT=1800.7	SAT TT=0.257 T1=0.24
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_3_80.opb	SAT TT=0.268 T1=0.26	No data	No data	No data	SAT TT=1.866 T1=1.86	No data	No data	No data	SAT TT=19.611 T1=8.26	? (TO) TT=1800.05	SAT TT=0.268 T1=0.26
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_4_15.opb	SAT TT=0.256 T1=0.24	No data	No data	No data	SAT TT=1.403 T1=1.39	No data	No data	No data	SAT TT=4.65 T1=1.72	? (TO) TT=1800.04	SAT TT=0.256 T1=0.24
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_4_80.opb	SAT TT=0.256 T1=0.24	No data	No data	No data	SAT TT=1.526 T1=1.52	No data	No data	No data	SAT TT=20.63 T1=8.73	? (TO) TT=1800.88	SAT TT=0.256 T1=0.24
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_5_15.opb	SAT TT=0.258 T1=0.24	No data	No data	No data	SAT TT=1.4 T1=1.39	No data	No data	No data	SAT TT=4.642 T1=1.72	? (TO) TT=1800.65	SAT TT=0.258 T1=0.24
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_5_80.opb	SAT TT=0.258 T1=0.24	No data	No data	No data	SAT TT=4.09 T1=4.08	No data	No data	No data	SAT TT=17.401 T1=7.26	? (TO) TT=1800.05	SAT TT=0.258 T1=0.24
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_1_15.opb	SAT TT=0.605 T1=0.73	No data	No data	No data	SAT TT=3.289 T1=3.28	No data	No data	No data	SAT TT=5.435 T1=2.15	? (TO) TT=1800.05	SAT TT=0.605 T1=0.73
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_1_80.opb		No data	No data	No data	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.67	? (TO) TT=1800.04
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_2_15.opb	SAT TT=0.592 T1=0.57	No data	No data	No data	SAT TT=2.577 T1=2.56	No data	No data	No data	SAT TT=4.454 T1=1.62	? (TO) TT=1800.06	SAT TT=0.592 T1=0.57
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_2_80.opb		No data	No data	No data	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.11
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_3_15.opb	SAT TT=0.59 T1=0.58	No data	No data	No data	SAT TT=4.489 T1=4.48	No data	No data	No data	SAT TT=5.013 T1=1.64	? (TO) TT=1800.69	SAT TT=0.59 T1=0.58
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_3_80.opb		No data	No data	No data	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.77	? (TO) TT=1800.08
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_4_15.opb	SAT TT=0.601 T1=0.58	No data	No data	No data	SAT TT=2.818 T1=2.81	No data	No data	No data	SAT TT=5.373 T1=2.12	? (TO) TT=1800.07	SAT TT=0.601 T1=0.58
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_4_80.opb		No data	No data	No data	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.73	? (TO) TT=1800.43	? (TO) TT=1800.12
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_5_15.opb	SAT TT=0.591 T1=0.57	No data	No data	No data	SAT TT=2.016 T1=2	No data	No data	No data	SAT TT=5.071 T1=2.13	? (TO) TT=1800.04	SAT TT=0.591 T1=0.57
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_5_80.opb		No data	No data	No data	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.66	? (TO) TT=1800.02	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_1_15.opb	SAT TT=1.39 T1=1.36	No data	No data	No data	SAT TT=5.426 T1=5.4	No data	No data	No data	SAT TT=5.532 T1=2.01	? (TO) TT=1800.04	SAT TT=1.39 T1=1.36
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_1_80.opb		No data	No data	No data	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.48	? (TO) TT=1800.02
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_2_15.opb	SAT TT=1.474 T1=1.44	No data	No data	No data	SAT TT=6.715 T1=6.77	No data	No data	No data	SAT TT=6.022 T1=2.11	? (TO) TT=1802.35	SAT TT=1.474 T1=1.44
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_2_80.opb		No data	No data	No data	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.13
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_3_15.opb	SAT TT=1.43 T1=1.39	No data	No data	No data	SAT TT=6.815 T1=6.79	No data	No data	No data	SAT TT=5.243 T1=1.99	? (TO) TT=1800.08	SAT TT=1.43 T1=1.39
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_3_80.opb		No data	No data	No data	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1801	? (TO) TT=1800.09
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_4_15.opb	SAT TT=1.455 T1=1.42	No data	No data	No data	SAT TT=7.226 T1=7.2	No data	No data	No data	SAT TT=5.293 T1=2	? (TO) TT=1800.04	SAT TT=1.455 T1=1.42
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_4_80.opb		No data	No data	No data	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.61	? (TO) TT=1800.1
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_5_15.opb	SAT TT=1.416 T1=1.39	No data	No data	No data	SAT TT=10.92 T1=10.9	No data	No data	No data	SAT TT=5.233 T1=1.99	? (TO) TT=1800.08	SAT TT=1.416 T1=1.39
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_5_80.opb		No data	No data	No data	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.51	? (TO) TT=1800.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_1_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.91	? (TO) TT=1800.08	? (TO) TT=1800.06
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_1_5.opb	SAT TT=0.035 T1=0.03	No data	No data	No data	SAT TT=0.079 T1=0.07	No data	No data	No data	SAT TT=0.523 T1=0.76	SAT TT=0.984 T1=0.63	SAT TT=0.035 T1=0.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_2_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.61	? (TO) TT=1800.01
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_2_5.opb	SAT TT=0.037 T1=0.03	No data	No data	No data	SAT TT=0.068 T1=0.06	No data	No data	No data	SAT TT=0.463 T1=0.75	SAT TT=0.804 T1=0.46	SAT TT=0.037 T1=0.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_3_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.95	? (TO) TT=1800.06	? (TO) TT=1800.1
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_3_5.opb	SAT TT=0.033 T1=0.03	No data	No data	No data	SAT TT=0.07 T1=0.07	No data	No data	No data	SAT TT=0.483 T1=0.75	SAT TT=0.775 T1=0.48	SAT TT=0.033 T1=0.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_4_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.14
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_4_5.opb	SAT TT=0.036 T1=0.03	No data	No data	No data	SAT TT=0.074 T1=0.07	No data	No data	No data	SAT TT=0.504 T1=0.75	SAT TT=0.884 T1=0.55	SAT TT=0.036 T1=0.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_5_15.opb		No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.67	? (TO) TT=1800.03	? (TO) TT=1800.1
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_5_5.opb	SAT TT=0.034 T1=0.03	No data	No data	No data	SAT TT=0.075 T1=0.07	No data	No data	No data	SAT TT=0.574 T1=0.76	SAT TT=0.956 T1=0.6	SAT TT=0.034 T1=0.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_1_15.opb	UNSAT TT=6.53	No data	No data	No data	UNSAT TT=6.53	No data	No data	No data	UNSAT TT=34.018	UNSAT TT=31.84	UNSAT TT=180.077
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_1_5.opb	SAT TT=0.165 T1=0.16	No data	No data	No data	SAT TT=0.165 T1=0.16	No data	No data	No data	SAT TT=2.326 T1=0.85	SAT TT=0.892 T1=0.49	SAT TT=0.254 T1=0.23
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_2_15.opb	UNSAT TT=6.032	No data	No data	No data	UNSAT TT=6.032	No data	No data	No data	UNSAT TT=24.63	UNSAT TT=36.939	UNSAT TT=289.04
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_2_5.opb	SAT TT=0.061 T1=0.06	No data	No data	No data	SAT TT=0.159 T1=0.16	No data	No data	No data	SAT TT=2.123 T1=0.83	SAT TT=0.985 T1=0.58	SAT TT=0.061 T1=0.06
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_3_15.opb	UNSAT TT=6.563	No data	No data	No data	UNSAT TT=6.563	No data	No data	No data	UNSAT TT=54.716	UNSAT TT=37.849	UNSAT TT=243.302
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_3_5.opb	SAT TT=0.146 T1=0.14	No data	No data	No data	SAT TT=0.146 T1=0.14	No data	No data	No data	SAT TT=2.183 T1=0.85	SAT TT=0.944 T1=0.52	SAT TT=0.913 T1=0.86
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_4_15.opb	UNSAT TT=6.89	No data	No data	No data	UNSAT TT=6.89	No data	No data	No data	UNSAT TT=71.465	UNSAT TT=41.838	UNSAT TT=229.035
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_4_5.opb	SAT TT=0.162 T1=0.16	No data	No data	No data	SAT TT=0.162 T1=0.16	No data	No data	No data	SAT TT=2.255 T1=0.85	SAT TT=0.874 T1=0.46	SAT TT=0.443 T1=0.41
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_5_15.opb	UNSAT TT=7.127	No data	No data	No data	UNSAT TT=7.127	No data	No data	No data	UNSAT TT=40.048	UNSAT TT=37	UNSAT TT=338.858
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_5_5.opb	SAT TT=0.159 T1=0.16	No data	No data	No data	SAT TT=0.159 T1=0.16	No data	No data	No data	SAT TT=2.154 T1=0.82	SAT TT=0.944 T1=0.57	SAT TT=0.385 T1=0.36
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-0.opb	SAT TT=13.417 T1=13.41	SAT TT=80.726 T1=80.73	No data	No data	SAT TT=13.417 T1=13.41	SAT TT=528.216 T1=528.29	SAT TT=184.801 T1=184.82	SAT TT=182.737 T1=182.76	? (TO) TT=1800.73	SAT TT=225.549 T1=224.48	SAT TT=38.041 T1=37.98
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-1.opb	SAT TT=14.857 T1=14.79	SAT TT=33.616 T1=33.62	No data	No data	SAT TT=19.891 T1=19.89	SAT TT=631.061 T1=631.16	SAT TT=41.4 T1=41.4	SAT TT=41.808 T1=41.81	SAT TT=1198.87 T1=597.11	SAT TT=211.251 T1=209.9	SAT TT=14.857 T1=14.79
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-2.opb	SAT TT=15.599 T1=15.59	SAT TT=91.989 T1=92	No data	No data	SAT TT=15.599 T1=15.59	SAT TT=403.666 T1=403.72	SAT TT=531.89 T1=531.97	SAT TT=542.495 T1=542.57	SAT TT=427.95 T1=212.09	SAT TT=231.2 T1=230.33	SAT TT=65.522 T1=65.47
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-3.opb	SAT TT=16.19 T1=16.18	SAT TT=799.922 T1=800.04	No data	No data	SAT TT=16.19 T1=16.18	SAT TT=536.327 T1=536.41	SAT TT=474.499 T1=474.56	SAT TT=469.408 T1=469.48	SAT TT=1221.68 T1=607.73	SAT TT=20.24 T1=19.39	SAT TT=292.817 T1=292.86
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-4.opb	SAT TT=2.568 T1=2.56	SAT TT=43.547 T1=43.55	No data	No data	SAT TT=2.568 T1=2.56	SAT TT=479.964 T1=480.04	SAT TT=495.69 T1=495.77	SAT TT=499.744 T1=499.82	SAT TT=1603.31 T1=797.12	SAT TT=1198.16 T1=1196.34	SAT TT=66.389 T1=66.33
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-5.opb	SAT TT=17.003 T1=17	SAT TT=244.189 T1=244.22	No data	No data	SAT TT=17.003 T1=17	SAT TT=191.598 T1=191.63	SAT TT=573.702 T1=573.79	SAT TT=580.482 T1=580.57	? (TO) TT=1800.03	SAT TT=221 T1=220.16	SAT TT=103.531 T1=103.48
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-6.opb	SAT TT=48.424 T1=48.43	SAT TT=188.489 T1=188.51	No data	No data	SAT TT=48.424 T1=48.43	SAT TT=239.949 T1=239.98	SAT TT=1548.36 T1=1548.6	SAT TT=1554.11 T1=1554.35	? (TO) TT=1800.82	SAT TT=838.71 T1=837.38	SAT TT=171.989 T1=171.95
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-7.opb	SAT TT=37.025 T1=37.03	SAT TT=661.54 T1=661.63	No data	No data	SAT TT=37.025 T1=37.03	SAT TT=725.704 T1=725.81	SAT TT=1731.01 T1=1731.27	SAT TT=1722.82 T1=1723.09	? (TO) TT=1800.19	SAT TT=503.84 T1=502.97	SAT TT=1518.44 T1=1518.89
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-8.opb	SAT TT=177.323 T1=177.35	? (TO) TT=1800.01	No data	No data	SAT TT=177.323 T1=177.35	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.77	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round21-9.opb	SAT TT=6.853 T1=6.09	? (TO) TT=1800.02	No data	No data	SAT TT=55.972 T1=55.99	SAT TT=390.123 T1=390.18	SAT TT=1671.68 T1=1671.93	SAT TT=1667.51 T1=1667.77	? (TO) TT=1800.19	SAT TT=6.853 T1=6.09	SAT TT=298.573 T1=298.55
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-0.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.73	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-2.opb	SAT TT=1110.7 T1=1111	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.77	SAT TT=1110.7 T1=1111
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-3.opb	SAT TT=200.673 T1=200.71	? (TO) TT=1800.02	No data	No data	SAT TT=200.673 T1=200.71	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.66	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.75	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-5.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-6.opb	SAT TT=1425.54 T1=1425.8	? (TO) TT=1800.02	No data	No data	SAT TT=1425.54 T1=1425.8	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-7.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.67	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-8.opb	SAT TT=1733.27 T1=1733.58	? (TO) TT=1800.02	No data	No data	SAT TT=1733.27 T1=1733.58	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.64	? (TO) TT=1800.71	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round22-9.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.81	? (TO) TT=1800.65	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-0.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.72	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-1.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-2.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.78	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-3.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.75	? (TO) TT=1800.06	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-5.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.74	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.66	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-7.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-8.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.74	? (TO) TT=1800.71	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size112-round23-9.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.87	? (TO) TT=1800.07	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-0.opb	SAT TT=37.833 T1=37.83	? (TO) TT=1800.11	No data	No data	SAT TT=37.833 T1=37.83	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1801.12	? (TO) TT=1800.04	SAT TT=480.535 T1=480.62
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-1.opb	SAT TT=75.249 T1=75.25	? (TO) TT=1800.01	No data	No data	SAT TT=75.249 T1=75.25	SAT TT=527.082 T1=527.16	SAT TT=1705.64 T1=1705.9	SAT TT=1641.57 T1=1641.86	? (TO) TT=1800.04	SAT TT=720.831 T1=720.08	SAT TT=274.942 T1=274.92
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-2.opb	SAT TT=122.482 T1=122.5	SAT TT=384.805 T1=384.85	No data	No data	SAT TT=122.482 T1=122.5	SAT TT=531.393 T1=531.47	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.14	SAT TT=426.2 T1=425.29	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-3.opb	SAT TT=31.509 T1=31.45	? (TO) TT=1800.01	No data	No data	SAT TT=80.651 T1=80.66	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=548.561 T1=272.07	? (TO) TT=1800.03	SAT TT=31.509 T1=31.45
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-4.opb	SAT TT=31.637 T1=31.64	? (TO) TT=1800.02	No data	No data	SAT TT=31.637 T1=31.64	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=167.269 T1=81.63	? (TO) TT=1800.72	SAT TT=1552.64 T1=1553.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-5.opb	SAT TT=51.137 T1=50.05	? (TO) TT=1800.02	No data	No data	SAT TT=84.712 T1=84.72	SAT TT=455.421 T1=455.49	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.72	SAT TT=51.137 T1=50.05	SAT TT=1108.39 T1=1108.86
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-6.opb	SAT TT=8.625 T1=8.56	SAT TT=452.813 T1=452.87	No data	No data	SAT TT=35.497 T1=35.5	SAT TT=829.303 T1=829.43	SAT TT=44.361 T1=44.36	SAT TT=42.585 T1=42.59	SAT TT=910.786 T1=452.29	SAT TT=417.65 T1=416.75	SAT TT=8.625 T1=8.56
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-7.opb	SAT TT=2.826 T1=2.82	SAT TT=84.021 T1=84.03	No data	No data	SAT TT=2.826 T1=2.82	SAT TT=97.955 T1=97.96	SAT TT=944.067 T1=944.21	SAT TT=900.075 T1=900.21	SAT TT=1251.8 T1=622.91	SAT TT=921.78 T1=920.42	SAT TT=67.624 T1=67.57
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-8.opb	SAT TT=13.799 T1=13.73	? (TO) TT=1800.01	No data	No data	SAT TT=86.838 T1=86.84	SAT TT=460.382 T1=460.45	SAT TT=1289.44 T1=1289.63	SAT TT=1302.67 T1=1302.87	? (TO) TT=1800.15	SAT TT=294.79 T1=294.12	SAT TT=13.799 T1=13.73
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round21-9.opb	SAT TT=94.078 T1=94.08	SAT TT=1519.42 T1=1519.65	No data	No data	SAT TT=94.078 T1=94.08	SAT TT=1079.32 T1=1079.48	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=711.857 T1=354	SAT TT=703.43 T1=701.95	SAT TT=407.437 T1=407.49
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-0.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.69	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-2.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-3.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.67	? (TO) TT=1800.72	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-5.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-7.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.68	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-8.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.65	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round22-9.opb	SAT TT=1772.08 T1=1772.36	? (TO) TT=1800.02	No data	No data	SAT TT=1772.08 T1=1772.36	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.76	? (TO) TT=1800	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-0.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.86	? (TO) TT=1800.6	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.54	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-2.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.04	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-3.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.78	? (TO) TT=1800.8	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.9	? (TO) TT=1800.7	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-5.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.83	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-7.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-8.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.67	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size128-round23-9.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.63	? (TO) TT=1800.5	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-0.opb	SAT TT=1.67 T1=1.66	SAT TT=46.045 T1=46.06	No data	No data	SAT TT=1.67 T1=1.66	SAT TT=803.579 T1=803.7	SAT TT=450.635 T1=450.7	SAT TT=429.871 T1=429.93	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=89.008 T1=88.97
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-1.opb	SAT TT=197.041 T1=197.07	? (TO) TT=1800.01	No data	No data	SAT TT=197.041 T1=197.07	SAT TT=1069.6 T1=1069.77	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.07	SAT TT=903.325 T1=903.51
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-2.opb	SAT TT=51.081 T1=51.08	? (TO) TT=1800.01	No data	No data	SAT TT=153.966 T1=153.98	SAT TT=51.081 T1=51.08	SAT TT=446.031 T1=446.09	SAT TT=447.758 T1=447.82	? (TO) TT=1800.12	? (TO) TT=1800.72	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-3.opb	SAT TT=2.319 T1=2.31	? (TO) TT=1802.58	No data	No data	SAT TT=2.319 T1=2.31	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=381.876 T1=188.7	SAT TT=1259.41 T1=1257.51	SAT TT=14.065 T1=13.99
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-4.opb	SAT TT=165.396 T1=165.35	SAT TT=1484.87 T1=1485.1	No data	No data	SAT TT=181.724 T1=181.74	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=165.396 T1=165.35
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-5.opb	SAT TT=10.227 T1=10.22	SAT TT=497.094 T1=497.17	No data	No data	SAT TT=10.227 T1=10.22	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.64	SAT TT=534.44 T1=533.3	SAT TT=95.465 T1=95.41
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-6.opb	SAT TT=48.358 T1=48.3	? (TO) TT=1800.02	No data	No data	SAT TT=56.482 T1=56.49	? (TO) TT=1800.09	SAT TT=407.423 T1=407.48	SAT TT=404.242 T1=404.3	? (TO) TT=1800.88	? (TO) TT=1800.09	SAT TT=48.358 T1=48.3
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-7.opb	SAT TT=183.545 T1=89.58	? (TO) TT=1800.02	No data	No data	SAT TT=321.584 T1=321.62	? (TO) TT=1800.02	SAT TT=903.625 T1=903.76	SAT TT=863.028 T1=863.16	SAT TT=183.545 T1=89.58	? (TO) TT=1800.08	SAT TT=756.247 T1=756.44
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-8.opb	SAT TT=184.668 T1=184.69	? (TO) TT=1800.02	No data	No data	SAT TT=184.668 T1=184.69	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.68	? (TO) TT=1800.59	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round21-9.opb	SAT TT=6.356 T1=6.35	? (TO) TT=1800.02	No data	No data	SAT TT=6.356 T1=6.35	? (TO) TT=1800.11	SAT TT=1308.64 T1=1308.84	SAT TT=1365.03 T1=1365.23	? (TO) TT=1800.07	SAT TT=903.81 T1=901.89	? (TO) TT=1800.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-0.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-1.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-2.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.2	? (TO) TT=1800.59	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-3.opb	SAT TT=1731.89 T1=1732.38	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.9	? (TO) TT=1800.69	SAT TT=1731.89 T1=1732.38
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.6	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-5.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.71	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-6.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.73	? (TO) TT=1800.57	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-7.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.83	? (TO) TT=1800.03	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-8.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.84	? (TO) TT=1800	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round22-9.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.75	? (TO) TT=1800.09	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-0.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.83	? (TO) TT=1800.78	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-2.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.71	? (TO) TT=1800.1	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-3.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.65	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-5.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.69	? (TO) TT=1800.89	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.91	? (TO) TT=1800.09	? (TO) TT=1800.12
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-7.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-8.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.66	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size144-round23-9.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.59	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-0.opb	SAT TT=82.448 T1=82.45	? (TO) TT=1800.02	No data	No data	SAT TT=82.448 T1=82.45	? (TO) TT=1800.1	SAT TT=259.38 T1=259.41	SAT TT=261.469 T1=261.51	? (TO) TT=1800.09	? (TO) TT=1800.63	SAT TT=551.162 T1=551.18
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-1.opb	SAT TT=65.362 T1=65.31	? (TO) TT=1800.02	No data	No data	SAT TT=212.52 T1=212.55	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.68	? (TO) TT=1800.61	SAT TT=65.362 T1=65.31
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-2.opb	SAT TT=231.317 T1=231.33	? (TO) TT=1800.02	No data	No data	SAT TT=307.976 T1=308.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1801.04	? (TO) TT=1800.07	SAT TT=231.317 T1=231.33
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-3.opb	SAT TT=57.615 T1=57.57	? (TO) TT=1800.02	No data	No data	SAT TT=689.467 T1=689.6	SAT TT=420.907 T1=420.98	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=57.615 T1=57.57
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-4.opb	SAT TT=78.487 T1=78.47	? (TO) TT=1800.02	No data	No data	SAT TT=232.679 T1=232.71	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=78.487 T1=78.47
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-5.opb	SAT TT=174.735 T1=174.76	? (TO) TT=1800.02	No data	No data	SAT TT=174.735 T1=174.76	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=1570.52 T1=1571.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-6.opb	SAT TT=49.959 T1=49.9	? (TO) TT=1800.02	No data	No data	SAT TT=127.637 T1=127.66	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.65	SAT TT=49.959 T1=49.9
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-7.opb	SAT TT=165.251 T1=157.73	? (TO) TT=1800.02	No data	No data	SAT TT=360.585 T1=360.64	SAT TT=1320.14 T1=1320.34	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=318.666 T1=157.73	? (TO) TT=1800.07	SAT TT=165.251 T1=165.24
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-8.opb	SAT TT=34.72 T1=34.72	? (TO) TT=1800.03	No data	No data	SAT TT=34.72 T1=34.72	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round21-9.opb	SAT TT=302.588 T1=302.63	? (TO) TT=1800.02	No data	No data	SAT TT=302.588 T1=302.63	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.19	SAT TT=1326.82 T1=1325.07	SAT TT=407.345 T1=407.34
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-0.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.82	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-1.opb		? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.64	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-2.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-3.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.77	? (TO) TT=1800.54	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-4.opb	SAT TT=259.892 T1=259.94	? (TO) TT=1800.02	No data	No data	SAT TT=259.892 T1=259.94	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-5.opb	SAT TT=1627.74 T1=1628.24	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.04	SAT TT=1627.74 T1=1628.24
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.67	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-7.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-8.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.78	? (TO) TT=1800.01	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round22-9.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.72	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-0.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-1.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.64	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-2.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.68	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-3.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.84	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-4.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.55	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-5.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.95	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-6.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.8	? (TO) TT=1800.6	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-7.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.65	? (TO) TT=1800.62	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-8.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.82	? (TO) TT=1800.79	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size160-round23-9.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-0.opb	SAT TT=14.704 T1=14.7	SAT TT=132.254 T1=132.27	No data	No data	SAT TT=14.704 T1=14.7	SAT TT=381.871 T1=381.93	SAT TT=256.311 T1=256.35	SAT TT=270.927 T1=270.97	SAT TT=513.006 T1=253.82	SAT TT=315.07 T1=314.08	SAT TT=79.116 T1=79.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-1.opb	SAT TT=1.08 T1=1.05	SAT TT=7.143 T1=7.14	No data	No data	SAT TT=5.296 T1=5.29	SAT TT=107.982 T1=108	SAT TT=4.919 T1=4.92	SAT TT=4.606 T1=4.71	SAT TT=13.773 T1=6.03	SAT TT=41.558 T1=40.77	SAT TT=1.08 T1=1.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-2.opb	SAT TT=25.213 T1=25.21	SAT TT=136.005 T1=136.02	No data	No data	SAT TT=25.213 T1=25.21	? (TO) TT=1800.03	SAT TT=1443.86 T1=1444.07	SAT TT=1459.95 T1=1460.17	SAT TT=98.921 T1=48.02	SAT TT=426.44 T1=425.39	SAT TT=332.357 T1=332.34
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-3.opb	SAT TT=6.175 T1=6.17	SAT TT=266.527 T1=266.56	No data	No data	SAT TT=6.175 T1=6.17	SAT TT=573.52 T1=573.6	SAT TT=669.653 T1=669.77	SAT TT=632.972 T1=633.07	? (TO) TT=1800.14	SAT TT=1549.16 T1=1546.65	SAT TT=47.006 T1=46.94
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-4.opb	SAT TT=1.048 T1=1.04	SAT TT=18.351 T1=18.35	No data	No data	SAT TT=1.048 T1=1.04	SAT TT=55.639 T1=55.64	SAT TT=89.521 T1=89.54	SAT TT=84.52 T1=84.53	SAT TT=25.39 T1=11.5	SAT TT=188.157 T1=187.03	SAT TT=14.129 T1=14.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-5.opb	SAT TT=10.782 T1=4.5	SAT TT=182.104 T1=182.12	No data	No data	SAT TT=30.842 T1=30.84	SAT TT=178.706 T1=178.73	SAT TT=598.887 T1=598.98	SAT TT=600.955 T1=601.04	SAT TT=10.782 T1=4.5	SAT TT=288.92 T1=287.7	SAT TT=210.53 T1=210.5
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-6.opb	SAT TT=6.636 T1=3.5	SAT TT=504.29 T1=504.37	No data	No data	SAT TT=6.636 T1=6.63	SAT TT=35.892 T1=35.89	SAT TT=145.954 T1=146	SAT TT=147.82 T1=147.84	SAT TT=8.213 T1=3.5	SAT TT=12.812 T1=12.04	SAT TT=6.676 T1=6.61
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-7.opb	SAT TT=11.289 T1=5.55	SAT TT=218.529 T1=218.56	No data	No data	SAT TT=11.289 T1=11.28	SAT TT=64.508 T1=64.51	SAT TT=402.619 T1=402.68	SAT TT=421.79 T1=421.85	SAT TT=14.142 T1=5.55	SAT TT=30.95 T1=29.8	SAT TT=16.571 T1=16.51
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-8.opb	SAT TT=10.86 T1=10.85	SAT TT=784.728 T1=784.84	No data	No data	SAT TT=10.86 T1=10.85	SAT TT=96.393 T1=96.4	SAT TT=27.823 T1=27.82	SAT TT=28.059 T1=28.06	SAT TT=143.771 T1=70.47	SAT TT=62.248 T1=61.67	SAT TT=49.871 T1=49.82
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round21-9.opb	SAT TT=31.93 T1=30.8	SAT TT=208.816 T1=208.84	No data	No data	SAT TT=35.473 T1=35.48	SAT TT=153.565 T1=153.58	SAT TT=44.171 T1=44.17	SAT TT=44.567 T1=44.57	SAT TT=139.543 T1=67.71	SAT TT=31.93 T1=30.8	SAT TT=1141.52 T1=1141.94
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-0.opb	SAT TT=747.322 T1=747.49	? (TO) TT=1800.02	No data	No data	SAT TT=747.322 T1=747.49	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.8	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-1.opb	SAT TT=542.002 T1=542.08	? (TO) TT=1800.02	No data	No data	SAT TT=542.002 T1=542.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.07	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-2.opb	SAT TT=69.803 T1=69.81	SAT TT=1134.71 T1=1134.88	No data	No data	SAT TT=69.803 T1=69.81	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-3.opb	SAT TT=705.001 T1=705.1	? (TO) TT=1800.01	No data	No data	SAT TT=1018.51 T1=1018.68	? (TO) TT=1800.02	SAT TT=705.001 T1=705.1	SAT TT=708.306 T1=708.41	? (TO) TT=1800.19	? (TO) TT=1800.58	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-4.opb	SAT TT=116.534 T1=116.48	? (TO) TT=1800.01	No data	No data	SAT TT=159.887 T1=159.91	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1801.81	? (TO) TT=1800.81	SAT TT=116.534 T1=116.48
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-5.opb	SAT TT=1108.62 T1=1108.8	? (TO) TT=1800.02	No data	No data	SAT TT=1108.62 T1=1108.8	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-6.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-7.opb	SAT TT=197.594 T1=197.63	? (TO) TT=1800.02	No data	No data	SAT TT=197.594 T1=197.63	SAT TT=443.036 T1=443.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.6	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-8.opb	SAT TT=206.872 T1=206.92	? (TO) TT=1800.02	No data	No data	SAT TT=206.872 T1=206.92	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=1774.04 T1=1774.32	? (TO) TT=1800.08	? (TO) TT=1800.72	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round22-9.opb	SAT TT=650.938 T1=651.06	? (TO) TT=1800.02	No data	No data	SAT TT=650.938 T1=651.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.64	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-0.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.74	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.67	? (TO) TT=1800.67	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-2.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.69	? (TO) TT=1800.06	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-3.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.79	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-4.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.65	? (TO) TT=1800.64	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-5.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.89	? (TO) TT=1800.78	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.72	? (TO) TT=1800.68	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-7.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.69	? (TO) TT=1800.77	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-8.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.03	? (TO) TT=1800.06	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size80-round23-9.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.03	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-0.opb	SAT TT=6.474 T1=6.47	SAT TT=450.322 T1=450.39	No data	No data	SAT TT=6.474 T1=6.47	SAT TT=552.603 T1=552.68	SAT TT=739.07 T1=739.18	SAT TT=711.904 T1=712.01	? (TO) TT=1800.02	SAT TT=291.31 T1=290.44	SAT TT=142.909 T1=142.86
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-1.opb	SAT TT=6.875 T1=6.87	SAT TT=648.092 T1=648.19	No data	No data	SAT TT=6.875 T1=6.87	SAT TT=211.892 T1=211.92	SAT TT=448.146 T1=448.21	SAT TT=469.942 T1=470.02	SAT TT=170.067 T1=83.12	SAT TT=240.13 T1=239.22	SAT TT=15.068 T1=15
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-2.opb	SAT TT=34.273 T1=34.27	SAT TT=182.457 T1=182.48	No data	No data	SAT TT=34.273 T1=34.27	SAT TT=133.031 T1=133.05	SAT TT=363.779 T1=363.83	SAT TT=361.01 T1=361.06	SAT TT=344.341 T1=205.95	SAT TT=783.81 T1=782.72	SAT TT=99.975 T1=99.92
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-3.opb	SAT TT=20.033 T1=20.03	SAT TT=194.687 T1=194.71	No data	No data	SAT TT=20.033 T1=20.03	SAT TT=104.024 T1=104.04	SAT TT=170.499 T1=170.52	SAT TT=179.448 T1=179.47	SAT TT=177.787 T1=86.67	SAT TT=145.55 T1=144.73	SAT TT=31.745 T1=31.68
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-4.opb	SAT TT=39.946 T1=39.88	? (TO) TT=1800.02	No data	No data	SAT TT=77.763 T1=77.77	SAT TT=619.936 T1=620.03	SAT TT=925.544 T1=925.69	SAT TT=896.689 T1=896.82	SAT TT=758.428 T1=378.29	SAT TT=1040.69 T1=1039.36	SAT TT=39.946 T1=39.88
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-5.opb	SAT TT=20.441 T1=20.44	? (TO) TT=1800.02	No data	No data	SAT TT=35.329 T1=35.33	SAT TT=20.441 T1=20.44	SAT TT=555.339 T1=555.42	SAT TT=557.859 T1=557.95	SAT TT=1648.38 T1=819.8	SAT TT=683.57 T1=682.16	SAT TT=104.571 T1=104.54
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-6.opb	SAT TT=6.382 T1=6.38	SAT TT=200.483 T1=200.51	No data	No data	SAT TT=6.382 T1=6.38	SAT TT=57.882 T1=57.89	SAT TT=306.423 T1=306.47	SAT TT=310.588 T1=310.63	SAT TT=42.288 T1=19.51	SAT TT=33.84 T1=32.7	SAT TT=20.698 T1=20.63
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-7.opb	SAT TT=38.514 T1=23.56	SAT TT=480.469 T1=480.53	No data	No data	SAT TT=38.514 T1=38.51	SAT TT=372.684 T1=372.73	SAT TT=330.56 T1=330.6	SAT TT=330.904 T1=330.95	SAT TT=50.618 T1=23.56	SAT TT=1114.91 T1=1112.79	SAT TT=291.376 T1=291.42
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-8.opb	SAT TT=13.29 T1=13.23	? (TO) TT=1800.01	No data	No data	SAT TT=88.452 T1=88.46	SAT TT=569.67 T1=569.75	SAT TT=230.056 T1=230.09	SAT TT=219.555 T1=219.59	? (TO) TT=1800.13	SAT TT=476.693 T1=475.04	SAT TT=13.29 T1=13.23
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round21-9.opb	SAT TT=75.546 T1=75.57	? (TO) TT=1800.02	No data	No data	SAT TT=75.546 T1=75.57	SAT TT=546.455 T1=546.53	SAT TT=228.363 T1=228.39	SAT TT=216.326 T1=216.36	? (TO) TT=1800.77	SAT TT=1718.93 T1=1716.81	SAT TT=170.119 T1=170.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-0.opb	SAT TT=98.568 T1=98.58	? (TO) TT=1800.02	No data	No data	SAT TT=98.568 T1=98.58	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.3	? (TO) TT=1800.18	? (TO) TT=1800.68	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-2.opb	SAT TT=1556.4 T1=1556.64	? (TO) TT=1800.02	No data	No data	SAT TT=1556.4 T1=1556.64	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.63	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-3.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-4.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.69	? (TO) TT=1800.7	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-5.opb	SAT TT=1011.38 T1=1011.7	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.57	SAT TT=1011.38 T1=1011.7
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-7.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.97	? (TO) TT=1800.71	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-8.opb	SAT TT=593.848 T1=593.94	? (TO) TT=1800.07	No data	No data	SAT TT=593.848 T1=593.94	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round22-9.opb	SAT TT=1305.04 T1=1305.26	? (TO) TT=1800.01	No data	No data	SAT TT=1305.04 T1=1305.26	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.66	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-0.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.85	? (TO) TT=1800	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-1.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.79	? (TO) TT=1800.07	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-2.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.69	? (TO) TT=1800.65	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-3.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.77	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-4.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-5.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.86	? (TO) TT=1800.74	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-6.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.75	? (TO) TT=1800.72	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-7.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.72	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-8.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.64	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ nossum/ normalized-sha1-size96-round23-9.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.91	? (TO) TT=1800.04	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x100split.opb	UNSAT TT=0.507	UNSAT TT=0.507	No data	No data	UNSAT TT=8.607	UNSAT TT=0.537	UNSAT TT=1.44	UNSAT TT=1.445	UNSAT TT=4.794	UNSAT TT=1.824	UNSAT TT=1470.58
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x10split.opb	UNSAT TT=0.018	UNSAT TT=0.02	No data	No data	UNSAT TT=0.079	UNSAT TT=0.018	UNSAT TT=0.058	UNSAT TT=0.059	UNSAT TT=1.034	UNSAT TT=0.616	UNSAT TT=0.613
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x20split.opb	UNSAT TT=0.041	UNSAT TT=0.041	No data	No data	UNSAT TT=0.329	UNSAT TT=0.044	UNSAT TT=0.151	UNSAT TT=0.152	UNSAT TT=1.854	UNSAT TT=0.765	UNSAT TT=4.014
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x30split.opb	UNSAT TT=0.075	UNSAT TT=0.085	No data	No data	UNSAT TT=1.177	UNSAT TT=0.075	UNSAT TT=0.231	UNSAT TT=0.229	UNSAT TT=2.793	UNSAT TT=0.913	UNSAT TT=12.875
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x40split.opb	UNSAT TT=0.108	UNSAT TT=0.108	No data	No data	UNSAT TT=2.117	UNSAT TT=0.125	UNSAT TT=0.359	UNSAT TT=0.381	UNSAT TT=3.483	UNSAT TT=1.543	UNSAT TT=25.517
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x50split.opb	UNSAT TT=0.171	UNSAT TT=0.171	No data	No data	UNSAT TT=3.94	UNSAT TT=0.196	UNSAT TT=0.542	UNSAT TT=0.543	UNSAT TT=3.402	UNSAT TT=1.276	UNSAT TT=125.203
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x60split.opb	UNSAT TT=0.222	UNSAT TT=0.222	No data	No data	UNSAT TT=3.629	UNSAT TT=0.275	UNSAT TT=0.624	UNSAT TT=0.628	UNSAT TT=4.078	UNSAT TT=1.444	UNSAT TT=148.013
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x70split.opb	UNSAT TT=0.242	UNSAT TT=0.242	No data	No data	UNSAT TT=8.251	UNSAT TT=0.267	UNSAT TT=0.812	UNSAT TT=0.859	UNSAT TT=4.785	UNSAT TT=1.892	UNSAT TT=275.908
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x80split.opb	UNSAT TT=0.247	UNSAT TT=0.247	No data	No data	UNSAT TT=12.023	UNSAT TT=0.373	UNSAT TT=1.123	UNSAT TT=1.127	UNSAT TT=4.1	UNSAT TT=1.636	UNSAT TT=445.593
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid3x90split.opb	UNSAT TT=0.38	UNSAT TT=0.38	No data	No data	UNSAT TT=9.552	UNSAT TT=0.444	UNSAT TT=1.156	UNSAT TT=1.147	UNSAT TT=4.223	UNSAT TT=1.874	UNSAT TT=862.077
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x100split.opb	UNSAT TT=402.85	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	UNSAT TT=481.364	UNSAT TT=402.85	UNSAT TT=404.691	? (TO) TT=1800.15	UNSAT TT=1463.63	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x10split.opb	UNSAT TT=0.332	UNSAT TT=0.332	No data	No data	UNSAT TT=26.218	UNSAT TT=1.985	UNSAT TT=3.096	UNSAT TT=3.126	UNSAT TT=13.171	UNSAT TT=8.88	UNSAT TT=124.868
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x110split.opb	UNSAT TT=443.131	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	UNSAT TT=443.131	UNSAT TT=1008.92	UNSAT TT=1017.56	? (TO) TT=1800.12	? (TO) TT=1800.58	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x120split.opb	UNSAT TT=580.189	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.09	UNSAT TT=580.189	UNSAT TT=846.437	UNSAT TT=849.345	? (TO) TT=1800.04	? (TO) TT=1800.71	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x130split.opb	UNSAT TT=593.916	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	UNSAT TT=593.916	UNSAT TT=695.617	UNSAT TT=695.754	? (TO) TT=1800.18	? (TO) TT=1800.72	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x140split.opb	UNSAT TT=662.89	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	UNSAT TT=662.89	UNSAT TT=948.757	UNSAT TT=953.11	? (TO) TT=1800.05	? (TO) TT=1800.59	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x150split.opb	UNSAT TT=659.6	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.01	UNSAT TT=659.6	UNSAT TT=1016.26	UNSAT TT=1018.87	? (TO) TT=1800.13	? (TO) TT=1800.59	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x20split.opb	UNSAT TT=1.78	UNSAT TT=1.78	No data	No data	? (TO) TT=1800.02	UNSAT TT=16.248	UNSAT TT=51.893	UNSAT TT=52.17	UNSAT TT=107.967	UNSAT TT=95.25	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x30split.opb	UNSAT TT=6.164	UNSAT TT=6.164	No data	No data	? (TO) TT=1800.02	UNSAT TT=31.052	UNSAT TT=188.687	UNSAT TT=189.445	UNSAT TT=791.361	UNSAT TT=169.142	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x40split.opb	UNSAT TT=18.086	UNSAT TT=18.086	No data	No data	? (TO) TT=1800.01	UNSAT TT=86.153	UNSAT TT=113.004	UNSAT TT=113.592	UNSAT TT=762.548	UNSAT TT=282.969	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x50split.opb	UNSAT TT=86.015	UNSAT TT=422.808	No data	No data	? (TO) TT=1800.01	UNSAT TT=86.015	UNSAT TT=154.59	UNSAT TT=156.308	UNSAT TT=759.168	UNSAT TT=430.469	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x60split.opb	UNSAT TT=107.751	UNSAT TT=122.742	No data	No data	? (TO) TT=1800.11	UNSAT TT=107.751	UNSAT TT=486.79	UNSAT TT=474.775	UNSAT TT=1181.38	UNSAT TT=503.142	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x70split.opb	UNSAT TT=162.257	UNSAT TT=356.85	No data	No data	? (TO) TT=1800.1	UNSAT TT=162.257	UNSAT TT=400.043	UNSAT TT=401.708	UNSAT TT=1656.82	UNSAT TT=733.921	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x80split.opb	UNSAT TT=219.568	UNSAT TT=1087.99	No data	No data	? (TO) TT=1800.09	UNSAT TT=219.568	UNSAT TT=360.096	UNSAT TT=356.25	? (TO) TT=1800.06	UNSAT TT=1645.46	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_ODD_GRIDS/ normalized-ECgrid5x90split.opb	UNSAT TT=294.718	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.1	UNSAT TT=294.718	UNSAT TT=781.877	UNSAT TT=840.211	? (TO) TT=1800.18	UNSAT TT=1291.79	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v010-n1.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.204	UNSAT TT=0.174	UNSAT TT=0.019
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v020-n1.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	UNSAT TT=0.03	UNSAT TT=0.015	UNSAT TT=0.05	UNSAT TT=0.05	UNSAT TT=1.256	UNSAT TT=0.674	UNSAT TT=0.237
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v030-n1.opb	UNSAT TT=0.028	UNSAT TT=0.028	No data	No data	UNSAT TT=0.52	UNSAT TT=0.139	UNSAT TT=0.412	UNSAT TT=0.442	UNSAT TT=5.845	UNSAT TT=3.179	UNSAT TT=3.272
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v040-n1.opb	UNSAT TT=0.023	UNSAT TT=0.023	No data	No data	UNSAT TT=147.303	UNSAT TT=211.875	UNSAT TT=54.198	UNSAT TT=53.972	UNSAT TT=1.874	UNSAT TT=86.462	UNSAT TT=207.859
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v050-n1.opb	UNSAT TT=0.028	UNSAT TT=0.028	No data	No data	UNSAT TT=634.708	UNSAT TT=770.108	UNSAT TT=79.074	UNSAT TT=79.737	UNSAT TT=1766.35	UNSAT TT=1026.22	UNSAT TT=896.044
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v060-n1.opb	UNSAT TT=0.023	UNSAT TT=0.023	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v070-n1.opb	UNSAT TT=0.276	UNSAT TT=0.276	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.74	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v080-n1.opb	UNSAT TT=0.039	UNSAT TT=0.039	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.5	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v090-n1.opb	UNSAT TT=0.081	UNSAT TT=0.081	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v100-n1.opb	UNSAT TT=8.781	UNSAT TT=8.781	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.69	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v110-n1.opb	UNSAT TT=0.364	UNSAT TT=0.364	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.67	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v011-n1.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=1.148	UNSAT TT=0.461	UNSAT TT=2.067	UNSAT TT=2.074	UNSAT TT=1.276	UNSAT TT=2.362	UNSAT TT=2.852
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v021-n1.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	UNSAT TT=907.715	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v031-n1.opb	UNSAT TT=0.217	UNSAT TT=0.217	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=3.023	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v041-n1.opb	UNSAT TT=0.071	UNSAT TT=0.071	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.72	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v051-n1.opb	UNSAT TT=0.02	UNSAT TT=0.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.8	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v061-n1.opb	UNSAT TT=0.157	UNSAT TT=0.157	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.56	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v071-n1.opb	UNSAT TT=0.03	UNSAT TT=0.03	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.66	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v081-n1.opb	UNSAT TT=18.052	UNSAT TT=18.052	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.46	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v091-n1.opb	UNSAT TT=2.477	UNSAT TT=2.477	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.49	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v101-n1.opb	UNSAT TT=27.482	UNSAT TT=27.482	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/EC_RANDOM_GRAPHS/ normalized-ECrand6reg-v111-n1.opb	UNSAT TT=0.401	UNSAT TT=0.401	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.66	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l010-r009-n1.opb	UNSAT TT=0.029	UNSAT TT=0.052	No data	No data	UNSAT TT=0.033	UNSAT TT=0.04	UNSAT TT=0.029	UNSAT TT=0.029	UNSAT TT=1.375	UNSAT TT=0.744	UNSAT TT=0.312
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l015-r014-n1.opb	UNSAT TT=0.05	UNSAT TT=0.114	No data	No data	UNSAT TT=0.05	UNSAT TT=0.058	UNSAT TT=0.06	UNSAT TT=0.06	UNSAT TT=1.693	UNSAT TT=1.023	UNSAT TT=0.74
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l020-r019-n1.opb	UNSAT TT=0.072	UNSAT TT=0.268	No data	No data	UNSAT TT=0.072	UNSAT TT=0.078	UNSAT TT=0.102	UNSAT TT=0.103	UNSAT TT=2.194	UNSAT TT=1.135	UNSAT TT=1.615
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l025-r024-n1.opb	UNSAT TT=0.118	UNSAT TT=0.608	No data	No data	UNSAT TT=0.118	UNSAT TT=0.13	UNSAT TT=0.343	UNSAT TT=0.346	UNSAT TT=3.353	UNSAT TT=1.554	UNSAT TT=4.181
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l030-r029-n1.opb	UNSAT TT=0.646	UNSAT TT=5.978	No data	No data	UNSAT TT=0.646	UNSAT TT=1.043	UNSAT TT=3.416	UNSAT TT=3.449	UNSAT TT=11.802	UNSAT TT=5.531	UNSAT TT=66.056
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l035-r034-n1.opb	UNSAT TT=0.609	UNSAT TT=7.961	No data	No data	UNSAT TT=0.609	UNSAT TT=0.95	UNSAT TT=3.301	UNSAT TT=3.323	UNSAT TT=13.263	UNSAT TT=5.301	UNSAT TT=55.116
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l040-r039-n1.opb	UNSAT TT=1.59	UNSAT TT=55.824	No data	No data	UNSAT TT=1.59	UNSAT TT=3.553	UNSAT TT=6.75	UNSAT TT=6.801	UNSAT TT=23.51	UNSAT TT=11.802	UNSAT TT=1372.61
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l045-r044-n1.opb	UNSAT TT=3.946	UNSAT TT=115.49	No data	No data	UNSAT TT=3.946	UNSAT TT=7.12	UNSAT TT=13.183	UNSAT TT=13.515	UNSAT TT=43.607	UNSAT TT=20.333	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l050-r049-n1.opb	UNSAT TT=48.391	UNSAT TT=1737.9	No data	No data	UNSAT TT=48.391	UNSAT TT=97.217	UNSAT TT=127.935	UNSAT TT=128.586	UNSAT TT=436.329	UNSAT TT=271.79	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l055-r054-n1.opb	UNSAT TT=405.016	? (TO) TT=1800.02	No data	No data	UNSAT TT=562.732	UNSAT TT=866.735	UNSAT TT=406.145	UNSAT TT=405.016	? (TO) TT=1800.03	UNSAT TT=1154.87	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l060-r059-n1.opb	UNSAT TT=325.635	? (TO) TT=1800.02	No data	No data	UNSAT TT=581.51	UNSAT TT=439.693	UNSAT TT=327.553	UNSAT TT=325.635	UNSAT TT=1321.4	UNSAT TT=601.432	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l065-r064-n1.opb		? (TO) TT=1800	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.63	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l070-r069-n1.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.54	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l080-r079-n1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.61	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l090-r089-n1.opb		? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.61	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-almost3reg-l100-r099-n1.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.78	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l010-r010-n1.opb	UNSAT TT=0.02	UNSAT TT=0.041	No data	No data	UNSAT TT=0.037	UNSAT TT=0.04	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=1.104	UNSAT TT=0.705	UNSAT TT=0.268
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l020-r019-n1.opb	UNSAT TT=0.083	UNSAT TT=0.161	No data	No data	UNSAT TT=0.083	UNSAT TT=0.09	UNSAT TT=0.087	UNSAT TT=0.087	UNSAT TT=1.804	UNSAT TT=1.144	UNSAT TT=1.085
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l030-r029-n1.opb	UNSAT TT=0.154	UNSAT TT=0.579	No data	No data	UNSAT TT=0.154	UNSAT TT=0.165	UNSAT TT=0.272	UNSAT TT=0.275	UNSAT TT=4.233	UNSAT TT=1.687	UNSAT TT=3.289
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l040-r039-n1.opb	UNSAT TT=0.203	UNSAT TT=0.595	No data	No data	UNSAT TT=0.203	UNSAT TT=0.215	UNSAT TT=0.304	UNSAT TT=0.309	UNSAT TT=3.932	UNSAT TT=1.574	UNSAT TT=3.233
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l050-r049-n1.opb	UNSAT TT=0.662	UNSAT TT=4.985	No data	No data	UNSAT TT=0.662	UNSAT TT=0.82	UNSAT TT=3.152	UNSAT TT=3.338	UNSAT TT=9.942	UNSAT TT=4.754	UNSAT TT=47.439
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l060-r059-n1.opb	UNSAT TT=1.309	UNSAT TT=32.57	No data	No data	UNSAT TT=1.309	UNSAT TT=1.366	UNSAT TT=7.824	UNSAT TT=7.816	UNSAT TT=20.761	UNSAT TT=11.571	UNSAT TT=128.013
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l070-r069-n1.opb	UNSAT TT=2.06	UNSAT TT=57.362	No data	No data	UNSAT TT=2.06	UNSAT TT=3.699	UNSAT TT=7.605	UNSAT TT=7.84	UNSAT TT=21.563	UNSAT TT=9.675	UNSAT TT=85.073
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l080-r079-n1.opb	UNSAT TT=5.337	UNSAT TT=146.863	No data	No data	UNSAT TT=6.582	UNSAT TT=5.337	UNSAT TT=11.467	UNSAT TT=11.518	UNSAT TT=44.097	UNSAT TT=13.213	UNSAT TT=1719.38
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l090-r089-n1.opb	UNSAT TT=9.154	UNSAT TT=135.661	No data	No data	UNSAT TT=9.751	UNSAT TT=9.154	UNSAT TT=21.363	UNSAT TT=21.296	UNSAT TT=51.215	UNSAT TT=33.528	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/Instances3col_OPB/ normalized-3col-left3reg-l100-r099-n1.opb	UNSAT TT=3.844	UNSAT TT=58.236	No data	No data	UNSAT TT=3.91	UNSAT TT=3.844	UNSAT TT=9.085	UNSAT TT=8.702	UNSAT TT=68.134	UNSAT TT=34.959	UNSAT TT=237.838
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v011-n1.opb	UNSAT TT=0.002	UNSAT TT=0.014	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.193	UNSAT TT=0.283	UNSAT TT=0.032
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v011-n2.opb	UNSAT TT=0.003	UNSAT TT=0.01	No data	No data	UNSAT TT=0.004	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.215	UNSAT TT=0.285	UNSAT TT=0.032
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v011-n3.opb	UNSAT TT=0.002	UNSAT TT=0.013	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.524	UNSAT TT=0.263	UNSAT TT=0.034
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v021-n1.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	UNSAT TT=0.335	UNSAT TT=0.239	UNSAT TT=0.559	UNSAT TT=0.563	UNSAT TT=3.922	UNSAT TT=1.605	UNSAT TT=2.016
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v021-n2.opb	UNSAT TT=0.014	UNSAT TT=0.014	No data	No data	UNSAT TT=0.399	UNSAT TT=0.271	UNSAT TT=0.542	UNSAT TT=0.544	UNSAT TT=0.224	UNSAT TT=1.494	UNSAT TT=2.751
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v021-n3.opb	UNSAT TT=0.015	UNSAT TT=0.015	No data	No data	UNSAT TT=0.275	UNSAT TT=0.204	UNSAT TT=0.223	UNSAT TT=0.221	UNSAT TT=3.433	UNSAT TT=0.903	UNSAT TT=1.487
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v031-n1.opb	UNSAT TT=0.354	UNSAT TT=0.573	No data	No data	UNSAT TT=115.408	UNSAT TT=73.839	UNSAT TT=76.184	UNSAT TT=76.7	UNSAT TT=0.354	UNSAT TT=98.15	UNSAT TT=114.874
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v031-n2.opb	UNSAT TT=0.015	UNSAT TT=0.015	No data	No data	UNSAT TT=50.164	UNSAT TT=45.666	UNSAT TT=52.868	UNSAT TT=53.037	UNSAT TT=0.335	UNSAT TT=75.064	UNSAT TT=113.119
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v031-n3.opb	UNSAT TT=0.027	UNSAT TT=0.027	No data	No data	UNSAT TT=35.131	UNSAT TT=18.084	UNSAT TT=14.03	UNSAT TT=14.234	UNSAT TT=0.283	UNSAT TT=35.029	UNSAT TT=63.027
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v041-n1.opb	UNSAT TT=0.056	UNSAT TT=0.056	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v041-n2.opb	UNSAT TT=0.015	UNSAT TT=0.015	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v041-n3.opb	UNSAT TT=0.042	UNSAT TT=0.042	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1408.04	UNSAT TT=1415.54	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v051-n1.opb	UNSAT TT=0.056	UNSAT TT=0.056	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v051-n2.opb	UNSAT TT=0.068	UNSAT TT=0.068	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.6	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v051-n3.opb	UNSAT TT=0.322	UNSAT TT=0.322	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.48	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v061-n1.opb	UNSAT TT=70.001	UNSAT TT=70.001	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v061-n2.opb	UNSAT TT=0.241	UNSAT TT=0.241	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v061-n3.opb	UNSAT TT=0.658	UNSAT TT=0.658	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v071-n1.opb	UNSAT TT=1.511	UNSAT TT=1.511	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.73	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v071-n2.opb	UNSAT TT=2.107	UNSAT TT=2.107	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v071-n3.opb	UNSAT TT=0.049	UNSAT TT=0.049	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.64	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v081-n1.opb	UNSAT TT=0.521	UNSAT TT=0.521	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.66	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v081-n2.opb	UNSAT TT=0.571	UNSAT TT=0.571	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.66	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v081-n3.opb	UNSAT TT=0.711	UNSAT TT=0.711	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v091-n1.opb	UNSAT TT=1.922	UNSAT TT=1.922	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v091-n2.opb	UNSAT TT=2.664	UNSAT TT=2.664	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.58	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v091-n3.opb	UNSAT TT=11.817	UNSAT TT=11.817	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v101-n1.opb	UNSAT TT=4.426	UNSAT TT=4.426	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.74	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v101-n2.opb	UNSAT TT=0.27	UNSAT TT=0.27	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.67	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v101-n3.opb	UNSAT TT=0.43	UNSAT TT=0.43	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.87	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v111-n1.opb	UNSAT TT=8.19	UNSAT TT=8.19	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.67	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v111-n2.opb	UNSAT TT=16.334	UNSAT TT=16.334	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/rand6reg/ normalized-rand6reg-v111-n3.opb	UNSAT TT=39.043	UNSAT TT=39.043	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.71	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-15.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=10.163	UNSAT TT=8.411	UNSAT TT=12.728	UNSAT TT=12.67	UNSAT TT=0.163	UNSAT TT=20.62	UNSAT TT=16.164
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-20.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=464.792	UNSAT TT=669.172	UNSAT TT=72.187	UNSAT TT=72.568	UNSAT TT=0.194	UNSAT TT=437.18	UNSAT TT=294.279
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-25.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=591.438	UNSAT TT=590.757	UNSAT TT=0.213	? (TO) TT=1800.06	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-30.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.224	? (TO) TT=1800.05	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-35.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.214	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-40.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.225	? (TO) TT=1800.06	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-45.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.314	? (TO) TT=1800.01	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-50.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	UNSAT TT=0.304	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-55.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.335	? (TO) TT=1800.02	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-60.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.345	? (TO) TT=1800.04	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-65.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.354	? (TO) TT=1800.06	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-70.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.343	? (TO) TT=1800.61	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-75.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=795.226	UNSAT TT=794.72	UNSAT TT=0.365	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-fixedbandwidth-80.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=264.443	UNSAT TT=266.288	UNSAT TT=0.444	? (TO) TT=1800.6	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-15.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=1.732	UNSAT TT=0.501	UNSAT TT=1.101	UNSAT TT=1.098	UNSAT TT=0.164	UNSAT TT=2.563	UNSAT TT=3.44
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-20.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=10.21	UNSAT TT=4.996	UNSAT TT=2.24	UNSAT TT=2.244	UNSAT TT=0.213	UNSAT TT=12.722	UNSAT TT=40.304
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-25.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=269.031	UNSAT TT=178.104	UNSAT TT=91.678	UNSAT TT=92.924	UNSAT TT=0.215	UNSAT TT=122.04	UNSAT TT=528.033
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-30.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.224	? (TO) TT=1800.02	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-35.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.214	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-40.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.242	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-45.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.334	? (TO) TT=1800.67	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-50.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.423	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-55.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.324	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-60.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.404	? (TO) TT=1800.03	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-65.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=0.414	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-70.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.364	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-75.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.424	? (TO) TT=1800.73	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-eq-random4regular-80.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.424	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-15.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=5.97	UNSAT TT=7.608	UNSAT TT=16.864	UNSAT TT=16.912	UNSAT TT=0.163	UNSAT TT=12.981	UNSAT TT=17.051
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-20.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=157.524	UNSAT TT=217.132	UNSAT TT=71.326	UNSAT TT=73.946	UNSAT TT=0.184	UNSAT TT=479.82	UNSAT TT=340.213
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-25.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=193.069	UNSAT TT=193.855	UNSAT TT=0.223	? (TO) TT=1800	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-30.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=1273.92	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.214	? (TO) TT=1800	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-35.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	UNSAT TT=775.659	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.224	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-40.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	UNSAT TT=469.583	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.216	? (TO) TT=1800.01	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-45.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	UNSAT TT=179.215	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.223	? (TO) TT=1800	? (TO) TT=1800.15
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-50.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	UNSAT TT=143.391	UNSAT TT=1377.68	UNSAT TT=1348.16	UNSAT TT=0.275	? (TO) TT=1800	? (TO) TT=1800.12
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-55.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	UNSAT TT=106.364	UNSAT TT=511.269	UNSAT TT=514.681	UNSAT TT=0.353	UNSAT TT=1243.25	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-60.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	UNSAT TT=91.245	UNSAT TT=203.803	UNSAT TT=201.218	UNSAT TT=0.245	? (TO) TT=1800.02	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-65.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	UNSAT TT=97.353	UNSAT TT=174.474	UNSAT TT=173.22	UNSAT TT=0.303	UNSAT TT=1392.29	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-70.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=89.107	UNSAT TT=63.793	UNSAT TT=64.51	UNSAT TT=0.334	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-75.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	UNSAT TT=89.359	UNSAT TT=106.81	UNSAT TT=106.478	UNSAT TT=0.315	UNSAT TT=1294.76	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-fixedbandwidth-80.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=87.244	UNSAT TT=99.312	UNSAT TT=98.991	UNSAT TT=0.333	UNSAT TT=1378.47	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-15.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=0.852	UNSAT TT=0.324	UNSAT TT=0.782	UNSAT TT=0.791	UNSAT TT=0.175	UNSAT TT=3.327	UNSAT TT=4.002
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-20.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=12.279	UNSAT TT=2.956	UNSAT TT=2.026	UNSAT TT=2.025	UNSAT TT=0.212	UNSAT TT=8.553	UNSAT TT=31.356
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-25.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=173.173	UNSAT TT=250.844	UNSAT TT=49.062	UNSAT TT=49.97	UNSAT TT=0.213	UNSAT TT=75.592	UNSAT TT=520.817
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-30.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.223	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-35.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.214	? (TO) TT=1800.66	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-40.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.283	? (TO) TT=1800.07	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-45.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.343	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-50.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.305	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-55.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.315	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-60.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.383	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-65.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.395	? (TO) TT=1800.58	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-70.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.413	? (TO) TT=1800.55	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-75.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.375	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/subsetcard/ normalized-subsetcard-geq-random4regular-80.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.473	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity3houseP016.opb	UNSAT TT=0.035	UNSAT TT=0.035	No data	No data	UNSAT TT=0.066	UNSAT TT=0.093	UNSAT TT=0.072	UNSAT TT=0.074	UNSAT TT=1.995	UNSAT TT=0.835	UNSAT TT=0.394
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity3houseP032.opb	UNSAT TT=0.105	UNSAT TT=0.105	No data	No data	UNSAT TT=0.252	UNSAT TT=0.392	UNSAT TT=0.415	UNSAT TT=0.414	UNSAT TT=4.313	UNSAT TT=1.954	UNSAT TT=3.974
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity3houseP064.opb	UNSAT TT=1.129	UNSAT TT=2.307	No data	No data	UNSAT TT=1.129	UNSAT TT=1.627	UNSAT TT=2.549	UNSAT TT=2.548	UNSAT TT=11.052	UNSAT TT=3.165	UNSAT TT=32.417
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity3houseP128.opb	UNSAT TT=4.4	UNSAT TT=28.429	No data	No data	UNSAT TT=4.4	UNSAT TT=6.727	UNSAT TT=31.568	UNSAT TT=31.818	UNSAT TT=82.102	UNSAT TT=33.829	UNSAT TT=323.264
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity3pyramidP0016.opb	UNSAT TT=0.019	UNSAT TT=0.022	No data	No data	UNSAT TT=0.034	UNSAT TT=0.051	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=1.374	UNSAT TT=0.664	UNSAT TT=0.198
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity3pyramidP0032.opb	UNSAT TT=0.049	UNSAT TT=0.049	No data	No data	UNSAT TT=0.129	UNSAT TT=0.195	UNSAT TT=0.187	UNSAT TT=0.186	UNSAT TT=3.551	UNSAT TT=1.114	UNSAT TT=1.815
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity3pyramidP0064.opb	UNSAT TT=0.488	UNSAT TT=0.488	No data	No data	UNSAT TT=0.529	UNSAT TT=0.805	UNSAT TT=1.377	UNSAT TT=1.372	UNSAT TT=6.384	UNSAT TT=2.275	UNSAT TT=11.416
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity3pyramidP0125.opb	UNSAT TT=2.103	UNSAT TT=6.768	No data	No data	UNSAT TT=2.103	UNSAT TT=3.2	UNSAT TT=7.903	UNSAT TT=7.902	UNSAT TT=25.35	UNSAT TT=6.504	UNSAT TT=111.127
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity4houseP016.opb	UNSAT TT=0.083	UNSAT TT=0.083	No data	No data	UNSAT TT=0.117	UNSAT TT=0.189	UNSAT TT=0.23	UNSAT TT=0.231	UNSAT TT=3.803	UNSAT TT=1.124	UNSAT TT=3.947
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity4houseP032.opb	UNSAT TT=0.385	UNSAT TT=0.385	No data	No data	UNSAT TT=0.493	UNSAT TT=0.789	UNSAT TT=1.524	UNSAT TT=1.523	UNSAT TT=7.143	UNSAT TT=2.633	UNSAT TT=284.138
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity4houseP064.opb	UNSAT TT=2.091	UNSAT TT=24.654	No data	No data	UNSAT TT=2.091	UNSAT TT=3.364	UNSAT TT=16.391	UNSAT TT=16.596	UNSAT TT=20.342	UNSAT TT=6.393	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity4houseP128.opb	UNSAT TT=8.531	UNSAT TT=186.707	No data	No data	UNSAT TT=8.531	UNSAT TT=13.957	UNSAT TT=41.296	UNSAT TT=41.247	UNSAT TT=154.801	UNSAT TT=73.603	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity4pyramidP0016.opb	UNSAT TT=0.022	UNSAT TT=0.022	No data	No data	UNSAT TT=0.064	UNSAT TT=0.099	UNSAT TT=0.059	UNSAT TT=0.058	UNSAT TT=3.632	UNSAT TT=0.985	UNSAT TT=1.9
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity4pyramidP0032.opb	UNSAT TT=0.094	UNSAT TT=0.094	No data	No data	UNSAT TT=0.251	UNSAT TT=0.397	UNSAT TT=0.779	UNSAT TT=0.808	UNSAT TT=5.51	UNSAT TT=1.828	UNSAT TT=120.496
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity4pyramidP0064.opb	UNSAT TT=1.053	UNSAT TT=21.73	No data	No data	UNSAT TT=1.053	UNSAT TT=1.672	UNSAT TT=4.707	UNSAT TT=4.767	UNSAT TT=9.644	UNSAT TT=3.464	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity4pyramidP0125.opb	UNSAT TT=4.109	UNSAT TT=14.391	No data	No data	UNSAT TT=4.109	UNSAT TT=6.574	UNSAT TT=42.325	UNSAT TT=42.399	UNSAT TT=43.019	UNSAT TT=8.812	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity5houseP016.opb	UNSAT TT=0.323	UNSAT TT=0.711	No data	No data	UNSAT TT=0.457	UNSAT TT=0.323	UNSAT TT=0.596	UNSAT TT=0.594	UNSAT TT=6.702	UNSAT TT=2.834	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity5houseP032.opb	UNSAT TT=1.876	UNSAT TT=82.4	No data	No data	UNSAT TT=2.557	UNSAT TT=1.876	UNSAT TT=4.165	UNSAT TT=4.097	UNSAT TT=28.723	UNSAT TT=12.483	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity5houseP064.opb	UNSAT TT=10.481	UNSAT TT=1747.07	No data	No data	UNSAT TT=14.667	UNSAT TT=10.481	UNSAT TT=16.33	UNSAT TT=16.356	UNSAT TT=196.505	UNSAT TT=107.139	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/ normalized-sumineqArity5houseP128.opb	UNSAT TT=42.553	? (TO) TT=1800.1	No data	No data	UNSAT TT=63.712	UNSAT TT=42.553	UNSAT TT=263.911	UNSAT TT=252.176	? (TO) TT=1800.08	UNSAT TT=1288.48	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity5pyramidP0016.opb	UNSAT TT=0.137	UNSAT TT=0.646	No data	No data	UNSAT TT=0.137	UNSAT TT=0.162	UNSAT TT=0.201	UNSAT TT=0.202	UNSAT TT=4.962	UNSAT TT=1.784	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity5pyramidP0032.opb	UNSAT TT=0.802	UNSAT TT=3.365	No data	No data	UNSAT TT=0.987	UNSAT TT=0.802	UNSAT TT=1.788	UNSAT TT=1.799	UNSAT TT=18.371	UNSAT TT=6.203	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity5pyramidP0064.opb	UNSAT TT=5.116	UNSAT TT=56.44	No data	No data	UNSAT TT=7.199	UNSAT TT=5.116	UNSAT TT=9.5	UNSAT TT=9.547	UNSAT TT=47.937	UNSAT TT=34.519	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/SUMINEQ/normalized-sumineqArity5pyramidP0125.opb	UNSAT TT=22.882	? (TO) TT=1800.1	No data	No data	UNSAT TT=32.455	UNSAT TT=22.882	UNSAT TT=38.537	UNSAT TT=38.787	UNSAT TT=450.708	UNSAT TT=233.828	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-11.opb	UNSAT TT=0	UNSAT TT=0.009	No data	No data	UNSAT TT=0.002	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.174	UNSAT TT=0.164	UNSAT TT=0.018
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-13.opb	UNSAT TT=0	UNSAT TT=0.012	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.183	UNSAT TT=0.165	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-15.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.174	UNSAT TT=0.018
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-17.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.173	UNSAT TT=0.018
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-19.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.186	UNSAT TT=0.184	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-21.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.183	UNSAT TT=0.176	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-23.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.005	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.203	UNSAT TT=0.192	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-25.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.213	UNSAT TT=0.215	UNSAT TT=0.025
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-27.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.007	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.213	UNSAT TT=0.205	UNSAT TT=0.023
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-29.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.009	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.215	UNSAT TT=0.203	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-31.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.007	UNSAT TT=0.009	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.235	UNSAT TT=0.227	UNSAT TT=0.026
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-33.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.009	UNSAT TT=0.011	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.245	UNSAT TT=0.223	UNSAT TT=0.026
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-35.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.01	UNSAT TT=0.012	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.274	UNSAT TT=0.245	UNSAT TT=0.025
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-37.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.01	UNSAT TT=0.013	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.273	UNSAT TT=0.245	UNSAT TT=0.026
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-39.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.012	UNSAT TT=0.016	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.273	UNSAT TT=0.254	UNSAT TT=0.029
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-3.opb	UNSAT TT=0	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.165	UNSAT TT=0.154	UNSAT TT=0.012
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-41.opb	UNSAT TT=0.003	UNSAT TT=0.014	No data	No data	UNSAT TT=0.012	UNSAT TT=0.016	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.292	UNSAT TT=0.266	UNSAT TT=0.033
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-43.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.013	UNSAT TT=0.017	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.292	UNSAT TT=0.265	UNSAT TT=0.033
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-45.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.015	UNSAT TT=0.019	UNSAT TT=0.005	UNSAT TT=0.003	UNSAT TT=0.353	UNSAT TT=0.284	UNSAT TT=0.037
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-47.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.016	UNSAT TT=0.021	UNSAT TT=0.003	UNSAT TT=0.005	UNSAT TT=0.413	UNSAT TT=0.303	UNSAT TT=0.039
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-49.opb	UNSAT TT=0.004	UNSAT TT=0.013	No data	No data	UNSAT TT=0.017	UNSAT TT=0.022	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=0.394	UNSAT TT=0.326	UNSAT TT=0.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-51.opb	UNSAT TT=0.005	UNSAT TT=0.013	No data	No data	UNSAT TT=0.019	UNSAT TT=0.024	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.413	UNSAT TT=0.326	UNSAT TT=0.044
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-5.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.173	UNSAT TT=0.155	UNSAT TT=0.014
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-7.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.164	UNSAT TT=0.163	UNSAT TT=0.016
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-completegraph-9.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0	UNSAT TT=0.174	UNSAT TT=0.163	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x11-hard.opb	UNSAT TT=0.061	UNSAT TT=1.696	No data	No data	UNSAT TT=37.068	UNSAT TT=0.159	UNSAT TT=0.061	UNSAT TT=0.063	UNSAT TT=13.662	? (TO) TT=1800.73	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x11.opb	UNSAT TT=0.006	UNSAT TT=0.027	No data	No data	UNSAT TT=1.791	UNSAT TT=0.057	UNSAT TT=0.007	UNSAT TT=0.006	UNSAT TT=9.552	? (TO) TT=1800.99	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x13-hard.opb	UNSAT TT=0.068	UNSAT TT=2.015	No data	No data	UNSAT TT=286.034	UNSAT TT=0.244	UNSAT TT=0.068	UNSAT TT=0.069	? (TO) TT=1800.11	? (TO) TT=1800.62	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x13.opb	UNSAT TT=0.007	UNSAT TT=0.041	No data	No data	UNSAT TT=31.768	UNSAT TT=0.086	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=6.473	? (TO) TT=1800.63	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x15-hard.opb	UNSAT TT=0.114	UNSAT TT=1.3	No data	No data	UNSAT TT=291.203	UNSAT TT=0.271	UNSAT TT=0.114	UNSAT TT=0.115	? (TO) TT=1800.14	? (TO) TT=1800.65	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x15.opb	UNSAT TT=0.007	UNSAT TT=0.145	No data	No data	UNSAT TT=15.526	UNSAT TT=0.113	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=61.984	? (TO) TT=1800.6	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x17-hard.opb	UNSAT TT=0.134	UNSAT TT=9.202	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.394	UNSAT TT=0.134	UNSAT TT=0.134	? (TO) TT=1800.13	? (TO) TT=1800.84	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x17.opb	UNSAT TT=0.009	UNSAT TT=0.452	No data	No data	? (TO) TT=1800.03	UNSAT TT=0.137	UNSAT TT=0.009	UNSAT TT=0.01	UNSAT TT=18.85	? (TO) TT=1800.89	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x19-hard.opb	UNSAT TT=0.211	UNSAT TT=3.306	No data	No data	? (TO) TT=1800.01	UNSAT TT=0.514	UNSAT TT=0.211	UNSAT TT=0.232	? (TO) TT=1800.03	? (TO) TT=1800.63	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x19.opb	UNSAT TT=0.012	UNSAT TT=2.458	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.174	UNSAT TT=0.012	UNSAT TT=0.012	? (TO) TT=1800	? (TO) TT=1800.54	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x21-hard.opb	UNSAT TT=0.186	UNSAT TT=1.984	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.615	UNSAT TT=0.187	UNSAT TT=0.186	? (TO) TT=1800.03	? (TO) TT=1800.75	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x21.opb	UNSAT TT=0.016	UNSAT TT=1.338	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.241	UNSAT TT=0.017	UNSAT TT=0.016	? (TO) TT=1800.14	? (TO) TT=1800.77	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x23-hard.opb	UNSAT TT=0.188	UNSAT TT=20.912	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.758	UNSAT TT=0.189	UNSAT TT=0.188	? (TO) TT=1800.13	? (TO) TT=1800.81	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x23.opb	UNSAT TT=0.017	UNSAT TT=2.939	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.291	UNSAT TT=0.017	UNSAT TT=0.017	UNSAT TT=1112.07	? (TO) TT=1800.81	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x25-hard.opb	UNSAT TT=0.276	UNSAT TT=140.693	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.992	UNSAT TT=0.276	UNSAT TT=0.278	UNSAT TT=448.857	? (TO) TT=1800.59	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x25.opb	UNSAT TT=0.017	UNSAT TT=12.214	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.393	UNSAT TT=0.018	UNSAT TT=0.017	? (TO) TT=1800.09	? (TO) TT=1800.62	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x27-hard.opb	UNSAT TT=0.245	UNSAT TT=489.186	No data	No data	? (TO) TT=1800.02	UNSAT TT=1.193	UNSAT TT=0.245	UNSAT TT=0.246	UNSAT TT=227.779	? (TO) TT=1800.85	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x27.opb	UNSAT TT=0.019	UNSAT TT=3.264	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.447	UNSAT TT=0.019	UNSAT TT=0.02	UNSAT TT=725.234	? (TO) TT=1800.66	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid10x29-hard.opb	UNSAT TT=0.388	UNSAT TT=323.434	No data	No data	? (TO) TT=1800.02	UNSAT TT=1.347	UNSAT TT=0.388	UNSAT TT=0.388	UNSAT TT=38.788	? (TO) TT=1800.69	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/ vertexcover-instances/normalized-vertexcover-grid10x29.opb	UNSAT TT=0.027	UNSAT TT=1.024	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.511	UNSAT TT=0.028	UNSAT TT=0.027	? (TO) TT=1800.17	? (TO) TT=1800.8	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x11-hard.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.009	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.994	UNSAT TT=0.703	UNSAT TT=0.378
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x11.opb	UNSAT TT=0.002	UNSAT TT=0.01	No data	No data	UNSAT TT=0.006	UNSAT TT=0.01	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.454	UNSAT TT=0.567	UNSAT TT=0.368
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x13-hard.opb	UNSAT TT=0.003	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.012	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=1.013	UNSAT TT=2.103	UNSAT TT=1.763
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x13.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.012	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.844	UNSAT TT=1.605	UNSAT TT=1.16
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x15-hard.opb	UNSAT TT=0.004	UNSAT TT=0.011	No data	No data	UNSAT TT=0.008	UNSAT TT=0.016	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=1.283	UNSAT TT=11.432	UNSAT TT=6.123
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x15.opb	UNSAT TT=0.003	UNSAT TT=0.011	No data	No data	UNSAT TT=0.007	UNSAT TT=0.016	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=1.104	UNSAT TT=4.903	UNSAT TT=4.695
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x17-hard.opb	UNSAT TT=0.005	UNSAT TT=0.011	No data	No data	UNSAT TT=0.08	UNSAT TT=0.022	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=1.123	UNSAT TT=53.454	UNSAT TT=43.089
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x17.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.07	UNSAT TT=0.022	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.564	UNSAT TT=37.657	UNSAT TT=25.564
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x19-hard.opb	UNSAT TT=0.004	UNSAT TT=0.011	No data	No data	UNSAT TT=0.177	UNSAT TT=0.027	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=2.055	UNSAT TT=562.218	UNSAT TT=244.191
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x19.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.085	UNSAT TT=0.026	UNSAT TT=0.003	UNSAT TT=0.005	UNSAT TT=1.143	UNSAT TT=346.892	UNSAT TT=137.146
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x21-hard.opb	UNSAT TT=0.005	UNSAT TT=0.013	No data	No data	UNSAT TT=0.069	UNSAT TT=0.031	UNSAT TT=0.006	UNSAT TT=0.005	UNSAT TT=1.434	? (TO) TT=1800.91	UNSAT TT=1137.23
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x21.opb	UNSAT TT=0.004	UNSAT TT=0.013	No data	No data	UNSAT TT=0.063	UNSAT TT=0.029	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=1.386	? (TO) TT=1800.57	UNSAT TT=750.656
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x23-hard.opb	UNSAT TT=0.006	UNSAT TT=0.013	No data	No data	UNSAT TT=1.172	UNSAT TT=0.04	UNSAT TT=0.006	UNSAT TT=0.006	UNSAT TT=2.006	? (TO) TT=1800.88	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x23.opb	UNSAT TT=0.004	UNSAT TT=0.013	No data	No data	UNSAT TT=0.526	UNSAT TT=0.036	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=1.254	? (TO) TT=1800.87	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x25-hard.opb	UNSAT TT=0.006	UNSAT TT=0.014	No data	No data	UNSAT TT=2.587	UNSAT TT=0.047	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=1.826	? (TO) TT=1800.7	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x25.opb	UNSAT TT=0.005	UNSAT TT=0.015	No data	No data	UNSAT TT=0.883	UNSAT TT=0.043	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=1.363	? (TO) TT=1800.66	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x27-hard.opb	UNSAT TT=0.007	UNSAT TT=0.014	No data	No data	UNSAT TT=0.106	UNSAT TT=0.053	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=0.584	? (TO) TT=1800.64	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x27.opb	UNSAT TT=0.006	UNSAT TT=0.02	No data	No data	UNSAT TT=0.083	UNSAT TT=0.053	UNSAT TT=0.006	UNSAT TT=0.006	UNSAT TT=1.684	? (TO) TT=1800.54	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x29-hard.opb	UNSAT TT=0.009	UNSAT TT=0.013	No data	No data	UNSAT TT=43.313	UNSAT TT=0.061	UNSAT TT=0.009	UNSAT TT=0.01	UNSAT TT=2.404	? (TO) TT=1800.67	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x29.opb	UNSAT TT=0.007	UNSAT TT=0.022	No data	No data	UNSAT TT=13.239	UNSAT TT=0.063	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=1.643	? (TO) TT=1800.54	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x5-hard.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.205	UNSAT TT=0.164	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x5.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.165	UNSAT TT=0.166	UNSAT TT=0.018
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x7-hard.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.343	UNSAT TT=0.264	UNSAT TT=0.032
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x7.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.215	UNSAT TT=0.195	UNSAT TT=0.029
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x9-hard.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.007	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.304	UNSAT TT=0.465	UNSAT TT=0.104
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid4x9.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.008	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.293	UNSAT TT=0.434	UNSAT TT=0.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x11-hard.opb	UNSAT TT=0.005	UNSAT TT=0.013	No data	No data	UNSAT TT=0.043	UNSAT TT=0.024	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=1.973	UNSAT TT=40.647	UNSAT TT=36.319
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x11.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.02	UNSAT TT=0.019	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.653	UNSAT TT=17.61	UNSAT TT=13.936
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x13-hard.opb	UNSAT TT=0.007	UNSAT TT=0.018	No data	No data	UNSAT TT=0.104	UNSAT TT=0.033	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=2.734	UNSAT TT=1425.82	UNSAT TT=462.653
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x13.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.036	UNSAT TT=0.028	UNSAT TT=0.004	UNSAT TT=0.003	UNSAT TT=1.705	UNSAT TT=320.114	UNSAT TT=210.68
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x15-hard.opb	UNSAT TT=0.009	UNSAT TT=0.019	No data	No data	UNSAT TT=0.085	UNSAT TT=0.041	UNSAT TT=0.009	UNSAT TT=0.01	UNSAT TT=4.461	? (TO) TT=1800.64	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x15.opb	UNSAT TT=0.004	UNSAT TT=0.019	No data	No data	UNSAT TT=0.038	UNSAT TT=0.038	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=2.984	? (TO) TT=1800.72	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x17-hard.opb	UNSAT TT=0.011	UNSAT TT=0.019	No data	No data	UNSAT TT=0.531	UNSAT TT=0.057	UNSAT TT=0.011	UNSAT TT=0.011	UNSAT TT=4.532	? (TO) TT=1800.62	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x17.opb	UNSAT TT=0.005	UNSAT TT=0.016	No data	No data	UNSAT TT=0.173	UNSAT TT=0.047	UNSAT TT=0.006	UNSAT TT=0.005	UNSAT TT=2.994	? (TO) TT=1800.65	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x19-hard.opb	UNSAT TT=0.013	UNSAT TT=0.02	No data	No data	UNSAT TT=1.803	UNSAT TT=0.069	UNSAT TT=0.013	UNSAT TT=0.015	UNSAT TT=2.868	? (TO) TT=1800.59	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x19.opb	UNSAT TT=0.006	UNSAT TT=0.016	No data	No data	UNSAT TT=0.623	UNSAT TT=0.061	UNSAT TT=0.008	UNSAT TT=0.006	UNSAT TT=3.054	? (TO) TT=1800.83	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x21-hard.opb	UNSAT TT=0.016	UNSAT TT=0.036	No data	No data	UNSAT TT=0.881	UNSAT TT=0.09	UNSAT TT=0.016	UNSAT TT=0.016	UNSAT TT=12.931	? (TO) TT=1800.67	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x21.opb	UNSAT TT=0.006	UNSAT TT=0.038	No data	No data	UNSAT TT=0.34	UNSAT TT=0.077	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=3.823	? (TO) TT=1800.99	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x23-hard.opb	UNSAT TT=0.017	UNSAT TT=0.077	No data	No data	UNSAT TT=31.275	UNSAT TT=0.111	UNSAT TT=0.017	UNSAT TT=0.017	UNSAT TT=10.892	? (TO) TT=1800.7	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x23.opb	UNSAT TT=0.008	UNSAT TT=0.072	No data	No data	UNSAT TT=7.74	UNSAT TT=0.09	UNSAT TT=0.008	UNSAT TT=0.008	UNSAT TT=3.883	? (TO) TT=1800.66	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x25-hard.opb	UNSAT TT=0.017	UNSAT TT=0.038	No data	No data	UNSAT TT=52.53	UNSAT TT=0.135	UNSAT TT=0.017	UNSAT TT=0.018	UNSAT TT=43.947	? (TO) TT=1800.72	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x25.opb	UNSAT TT=0.008	UNSAT TT=0.056	No data	No data	UNSAT TT=25.697	UNSAT TT=0.116	UNSAT TT=0.008	UNSAT TT=0.008	UNSAT TT=5.152	? (TO) TT=1800.72	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x27-hard.opb	UNSAT TT=0.022	UNSAT TT=0.086	No data	No data	UNSAT TT=12.326	UNSAT TT=0.159	UNSAT TT=0.022	UNSAT TT=0.023	UNSAT TT=61.625	? (TO) TT=1800.78	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x27.opb	UNSAT TT=0.01	UNSAT TT=0.063	No data	No data	UNSAT TT=3.319	UNSAT TT=0.126	UNSAT TT=0.01	UNSAT TT=0.01	UNSAT TT=4.011	? (TO) TT=1800.65	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x29-hard.opb	UNSAT TT=0.023	UNSAT TT=0.069	No data	No data	UNSAT TT=912.963	UNSAT TT=0.184	UNSAT TT=0.025	UNSAT TT=0.023	UNSAT TT=305.427	? (TO) TT=1800.54	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x29.opb	UNSAT TT=0.011	UNSAT TT=0.033	No data	No data	UNSAT TT=674.81	UNSAT TT=0.151	UNSAT TT=0.011	UNSAT TT=0.011	UNSAT TT=3.942	? (TO) TT=1800.62	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x7-hard.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.006	UNSAT TT=0.009	UNSAT TT=0.004	UNSAT TT=0.003	UNSAT TT=0.784	UNSAT TT=0.604	UNSAT TT=0.408
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x7.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.005	UNSAT TT=0.008	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.593	UNSAT TT=0.523	UNSAT TT=0.188
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x9-hard.opb	UNSAT TT=0.004	UNSAT TT=0.014	No data	No data	UNSAT TT=0.008	UNSAT TT=0.015	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=1.214	UNSAT TT=3.294	UNSAT TT=3.182
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid6x9.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.007	UNSAT TT=0.014	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.704	UNSAT TT=1.495	UNSAT TT=1.52
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x11-hard.opb	UNSAT TT=0.013	UNSAT TT=0.114	No data	No data	UNSAT TT=1.334	UNSAT TT=0.057	UNSAT TT=0.013	UNSAT TT=0.013	UNSAT TT=29.279	? (TO) TT=1800.82	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x13-hard.opb	UNSAT TT=0.02	UNSAT TT=0.17	No data	No data	UNSAT TT=10.409	UNSAT TT=0.076	UNSAT TT=0.022	UNSAT TT=0.02	UNSAT TT=3.754	? (TO) TT=1800.58	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x15-hard.opb	UNSAT TT=0.031	UNSAT TT=0.336	No data	No data	UNSAT TT=8.247	UNSAT TT=0.113	UNSAT TT=0.031	UNSAT TT=0.031	UNSAT TT=27.18	? (TO) TT=1800.75	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x17-hard.opb	UNSAT TT=0.04	UNSAT TT=0.333	No data	No data	UNSAT TT=279.722	UNSAT TT=0.152	UNSAT TT=0.04	UNSAT TT=0.041	? (TO) TT=1800.08	? (TO) TT=1800.67	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x19-hard.opb	UNSAT TT=0.04	UNSAT TT=0.763	No data	No data	UNSAT TT=1714.48	UNSAT TT=0.181	UNSAT TT=0.041	UNSAT TT=0.04	UNSAT TT=61.704	? (TO) TT=1800.65	? (TO) TT=1800.13
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x21-hard.opb	UNSAT TT=0.046	UNSAT TT=3.677	No data	No data	UNSAT TT=312.177	UNSAT TT=0.244	UNSAT TT=0.047	UNSAT TT=0.046	? (TO) TT=1800.01	? (TO) TT=1800.56	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x23-hard.opb	UNSAT TT=0.059	UNSAT TT=6.564	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.255	UNSAT TT=0.059	UNSAT TT=0.059	? (TO) TT=1800.38	? (TO) TT=1800.83	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x25-hard.opb	UNSAT TT=0.055	UNSAT TT=3.016	No data	No data	? (TO) TT=1800.03	UNSAT TT=0.343	UNSAT TT=0.055	UNSAT TT=0.056	? (TO) TT=1800.04	? (TO) TT=1800.67	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x27-hard.opb	UNSAT TT=0.07	UNSAT TT=8.751	No data	No data	UNSAT TT=348.535	UNSAT TT=0.41	UNSAT TT=0.077	UNSAT TT=0.07	UNSAT TT=40.397	? (TO) TT=1800.76	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x29-hard.opb	UNSAT TT=0.098	UNSAT TT=6.9	No data	No data	? (TO) TT=1800.02	UNSAT TT=0.406	UNSAT TT=0.104	UNSAT TT=0.098	UNSAT TT=10.301	? (TO) TT=1800.62	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x9-hard.opb	UNSAT TT=0.012	UNSAT TT=0.045	No data	No data	UNSAT TT=0.065	UNSAT TT=0.034	UNSAT TT=0.014	UNSAT TT=0.012	UNSAT TT=7.234	UNSAT TT=346.701	UNSAT TT=244.547
normalized-PB16/DEC-SMALLINT-LIN/ pb16-16-elffers/vertexcover-instances/ normalized-vertexcover-grid8x9.opb	UNSAT TT=0.003	UNSAT TT=0.014	No data	No data	UNSAT TT=0.018	UNSAT TT=0.023	UNSAT TT=0.004	UNSAT TT=0.003	UNSAT TT=2.044	UNSAT TT=66.755	UNSAT TT=42.707
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_10.opb	UNSAT TT=1.767	UNSAT TT=107.704	No data	No data	UNSAT TT=4.19	UNSAT TT=2.093	UNSAT TT=1.767	UNSAT TT=1.88	UNSAT TT=30.649	UNSAT TT=12.962	UNSAT TT=47.116
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_11.opb	SAT TT=0.618 T1=0.61	SAT TT=61.747 T1=61.76	No data	No data	SAT TT=3.091 T1=3.09	SAT TT=0.618 T1=0.61	SAT TT=6.711 T1=6.71	SAT TT=6.872 T1=6.87	SAT TT=12.481 T1=5.36	SAT TT=8.983 T1=8.21	SAT TT=48.783 T1=48.73
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_12.opb	SAT TT=0.043 T1=0.04	SAT TT=14.803 T1=14.8	No data	No data	SAT TT=5.121 T1=5.12	SAT TT=0.625 T1=0.62	SAT TT=0.043 T1=0.04	SAT TT=0.044 T1=0.04	SAT TT=3.953 T1=1.36	SAT TT=3.582 T1=2.89	SAT TT=4.337 T1=4.52
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_13.opb	SAT TT=0.045 T1=0.04	SAT TT=1.364 T1=1.36	No data	No data	SAT TT=0.17 T1=0.17	SAT TT=0.101 T1=0.1	SAT TT=0.045 T1=0.04	SAT TT=0.045 T1=0.04	SAT TT=3.823 T1=1.4	SAT TT=1.062 T1=0.5	SAT TT=1.867 T1=1.8
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_14.opb	SAT TT=0.034 T1=0.03	SAT TT=0.034 T1=0.03	No data	No data	SAT TT=0.111 T1=0.11	SAT TT=0.108 T1=0.1	SAT TT=0.046 T1=0.04	SAT TT=0.04 T1=0.04	SAT TT=2.994 T1=1.38	SAT TT=2.284 T1=1.66	SAT TT=4.156 T1=4.09
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_15.opb	SAT TT=0.032 T1=0.03	SAT TT=0.035 T1=0.03	No data	No data	SAT TT=0.118 T1=0.11	SAT TT=0.117 T1=0.11	SAT TT=0.032 T1=0.03	SAT TT=0.033 T1=0.03	SAT TT=2.404 T1=0.88	SAT TT=0.964 T1=0.49	SAT TT=1.887 T1=1.82
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression16_16.opb	SAT TT=0.03 T1=0.03	SAT TT=0.037 T1=0.03	No data	No data	SAT TT=0.142 T1=0.14	SAT TT=0.123 T1=0.12	SAT TT=0.03 T1=0.03	SAT TT=0.032 T1=0.03	SAT TT=1.974 T1=0.91	SAT TT=1.043 T1=0.55	SAT TT=2.118 T1=2.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_3.opb	UNSAT TT=0.011	UNSAT TT=0.021	No data	No data	UNSAT TT=0.04	UNSAT TT=0.039	UNSAT TT=0.011	UNSAT TT=0.011	UNSAT TT=0.543	UNSAT TT=0.505	UNSAT TT=0.071
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_4.opb	UNSAT TT=0.012	UNSAT TT=0.021	No data	No data	UNSAT TT=0.048	UNSAT TT=0.048	UNSAT TT=0.012	UNSAT TT=0.012	UNSAT TT=0.743	UNSAT TT=0.613	UNSAT TT=0.124
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_5.opb	UNSAT TT=0.016	UNSAT TT=0.027	No data	No data	UNSAT TT=0.055	UNSAT TT=0.054	UNSAT TT=0.017	UNSAT TT=0.016	UNSAT TT=1.675	UNSAT TT=0.933	UNSAT TT=0.215
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_6.opb	UNSAT TT=0.025	UNSAT TT=0.073	No data	No data	UNSAT TT=0.065	UNSAT TT=0.067	UNSAT TT=0.025	UNSAT TT=0.027	UNSAT TT=2.155	UNSAT TT=0.993	UNSAT TT=0.492
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_7.opb	UNSAT TT=0.038	UNSAT TT=0.241	No data	No data	UNSAT TT=0.084	UNSAT TT=0.116	UNSAT TT=0.038	UNSAT TT=0.04	UNSAT TT=3.017	UNSAT TT=1.164	UNSAT TT=1.463
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_8.opb	UNSAT TT=0.094	UNSAT TT=1.907	No data	No data	UNSAT TT=0.153	UNSAT TT=0.177	UNSAT TT=0.094	UNSAT TT=0.103	UNSAT TT=4.803	UNSAT TT=2.055	UNSAT TT=3.736
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression16_9.opb	UNSAT TT=0.355	UNSAT TT=5.847	No data	No data	UNSAT TT=0.531	UNSAT TT=0.359	UNSAT TT=0.355	UNSAT TT=0.355	UNSAT TT=9.963	UNSAT TT=4.741	UNSAT TT=12.359
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_10.opb	UNSAT TT=23.837	? (TO) TT=1800.02	No data	No data	UNSAT TT=64.704	UNSAT TT=23.837	UNSAT TT=25.815	UNSAT TT=25.847	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_11.opb	UNSAT TT=211.696	? (TO) TT=1800.02	No data	No data	UNSAT TT=1705.19	UNSAT TT=211.773	UNSAT TT=213.322	UNSAT TT=211.696	? (TO) TT=1800.72	? (TO) TT=1800.02	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_12.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_13.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.9	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_14.opb	SAT TT=645.412 T1=645.51	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=651.014 T1=651.13	SAT TT=645.412 T1=645.51	? (TO) TT=1800.15	? (TO) TT=1800.7	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_15.opb	SAT TT=10.784 T1=10.78	? (TO) TT=1800.02	No data	No data	SAT TT=10.784 T1=10.78	SAT TT=17.171 T1=17.17	SAT TT=22.032 T1=22.03	SAT TT=21.783 T1=21.78	SAT TT=41.8 T1=19.64	? (TO) TT=1800.01	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_16.opb	SAT TT=0.481 T1=0.48	SAT TT=39.682 T1=39.68	No data	No data	SAT TT=0.481 T1=0.48	SAT TT=1.915 T1=1.91	SAT TT=4.698 T1=4.69	SAT TT=4.625 T1=4.62	SAT TT=6.241 T1=2.57	SAT TT=8.273 T1=7.42	SAT TT=774.593 T1=774.66
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_17.opb	SAT TT=0.9 T1=0.9	SAT TT=9.44 T1=9.44	No data	No data	SAT TT=4.802 T1=4.8	SAT TT=1.223 T1=1.22	SAT TT=0.9 T1=0.9	SAT TT=0.907 T1=0.9	SAT TT=6.573 T1=2.14	SAT TT=8.573 T1=7.69	SAT TT=554.272 T1=554.4
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_18.opb	SAT TT=0.107 T1=0.1	SAT TT=0.107 T1=0.1	No data	No data	SAT TT=1.347 T1=1.34	SAT TT=2.655 T1=2.65	SAT TT=0.242 T1=0.24	SAT TT=0.244 T1=0.24	SAT TT=8.262 T1=3.1	SAT TT=2.394 T1=1.57	SAT TT=668.687 T1=668.72
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_19.opb	SAT TT=0.169 T1=0.16	SAT TT=0.856 T1=0.85	No data	No data	SAT TT=0.663 T1=0.66	SAT TT=0.7 T1=0.7	SAT TT=0.169 T1=0.16	SAT TT=0.17 T1=0.17	SAT TT=5.552 T1=2.1	SAT TT=1.372 T1=0.73	SAT TT=152.035 T1=152.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression32_20.opb	SAT TT=0.117 T1=0.11	SAT TT=0.117 T1=0.11	No data	No data	SAT TT=0.584 T1=0.58	SAT TT=0.859 T1=0.85	SAT TT=0.272 T1=0.27	SAT TT=0.275 T1=0.27	SAT TT=4.802 T1=1.67	SAT TT=1.544 T1=0.83	SAT TT=925.406 T1=925.72
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression32_5.opb	UNSAT TT=0.072	UNSAT TT=0.218	No data	No data	UNSAT TT=0.291	UNSAT TT=0.312	UNSAT TT=0.072	UNSAT TT=0.073	UNSAT TT=4.383	UNSAT TT=1.453	UNSAT TT=2.487
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression32_6.opb	UNSAT TT=0.114	UNSAT TT=1.372	No data	No data	UNSAT TT=0.314	UNSAT TT=0.372	UNSAT TT=0.114	UNSAT TT=0.115	UNSAT TT=10.973	UNSAT TT=3.154	UNSAT TT=9.929
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression32_7.opb	UNSAT TT=0.304	UNSAT TT=41.2	No data	No data	UNSAT TT=0.608	UNSAT TT=0.661	UNSAT TT=0.304	UNSAT TT=0.304	UNSAT TT=32.96	UNSAT TT=13.592	UNSAT TT=58.243
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression32_8.opb	UNSAT TT=1.006	UNSAT TT=635.753	No data	No data	UNSAT TT=1.413	UNSAT TT=2.271	UNSAT TT=1.006	UNSAT TT=1.006	UNSAT TT=150.74	UNSAT TT=73.403	UNSAT TT=374.71
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression32_9.opb	UNSAT TT=4.969	? (TO) TT=1800.02	No data	No data	UNSAT TT=10.197	UNSAT TT=5.619	UNSAT TT=4.969	UNSAT TT=5.207	UNSAT TT=1155.98	UNSAT TT=395.004	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_10.opb	UNSAT TT=386.1	? (TO) TT=1800.02	No data	No data	UNSAT TT=1642.13	UNSAT TT=390.419	UNSAT TT=392.691	UNSAT TT=386.1	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_11.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.92	? (TO) TT=1800.67	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_12.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_13.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.56	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_14.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_15.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.75	? (TO) TT=1800.08	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_16.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_17.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_18.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.68	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_19.opb		? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_20.opb		? (TO) TT=1800.03	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_21.opb	SAT TT=495.651 T1=495.73	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=495.651 T1=495.73	SAT TT=496.315 T1=496.4	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_22.opb	SAT TT=37.721 T1=37.72	? (TO) TT=1800.03	No data	No data	SAT TT=593.184 T1=593.31	SAT TT=37.721 T1=37.72	SAT TT=494.652 T1=494.73	SAT TT=492.182 T1=492.27	? (TO) TT=1800.03	SAT TT=1257.33 T1=1250.88	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_23.opb	SAT TT=6.839 T1=6.83	? (TO) TT=1800.02	No data	No data	SAT TT=6.839 T1=6.83	SAT TT=17.068 T1=17.07	SAT TT=91.116 T1=91.12	SAT TT=90.442 T1=90.45	? (TO) TT=1800.74	SAT TT=573.09 T1=568.88	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_24.opb	SAT TT=6.169 T1=6.16	SAT TT=161.839 T1=161.85	No data	No data	SAT TT=9.064 T1=9.05	SAT TT=27.174 T1=27.17	SAT TT=6.169 T1=6.16	SAT TT=6.217 T1=6.21	SAT TT=18.581 T1=8.48	SAT TT=69.96 T1=69	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_25.opb	SAT TT=4.354 T1=4.34	SAT TT=12.728 T1=12.72	No data	No data	SAT TT=4.354 T1=4.34	SAT TT=26.709 T1=26.7	SAT TT=12.043 T1=12.04	SAT TT=12.102 T1=12.1	SAT TT=74.374 T1=35.49	SAT TT=348.58 T1=346.94	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_26.opb	SAT TT=0.646 T1=0.64	SAT TT=0.646 T1=0.64	No data	No data	SAT TT=3.548 T1=3.54	SAT TT=13.927 T1=13.92	SAT TT=1.326 T1=1.32	SAT TT=1.266 T1=1.27	SAT TT=9.484 T1=4.02	SAT TT=2.923 T1=2.11	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_27.opb	SAT TT=0.85 T1=0.85	SAT TT=16.564 T1=16.56	No data	No data	SAT TT=3.785 T1=3.77	SAT TT=4.476 T1=4.47	SAT TT=0.85 T1=0.85	SAT TT=0.858 T1=0.85	SAT TT=10.962 T1=5.04	SAT TT=4.31 T1=3.48	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_28.opb	SAT TT=0.591 T1=0.58	SAT TT=0.591 T1=0.58	No data	No data	SAT TT=3.733 T1=3.72	SAT TT=4.495 T1=4.5	SAT TT=1.466 T1=1.46	SAT TT=1.473 T1=1.47	SAT TT=25.648 T1=12.09	SAT TT=16.85 T1=15.92	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_29.opb	SAT TT=0.681 T1=0.67	SAT TT=0.681 T1=0.67	No data	No data	SAT TT=3.827 T1=3.81	SAT TT=5.259 T1=5.25	SAT TT=1.463 T1=1.46	SAT TT=1.473 T1=1.47	SAT TT=15.451 T1=7.09	SAT TT=7.302 T1=6.44	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d-equals-n_k/ normalized-compression64_30.opb	SAT TT=0.52 T1=0.51	SAT TT=0.52 T1=0.51	No data	No data	SAT TT=3.884 T1=3.87	SAT TT=5.612 T1=5.61	SAT TT=2.198 T1=2.19	SAT TT=2.108 T1=2.1	SAT TT=14.012 T1=6.11	SAT TT=4.802 T1=3.94	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_3.opb	UNSAT TT=0.257	UNSAT TT=0.257	No data	No data	UNSAT TT=1.491	UNSAT TT=1.474	UNSAT TT=0.339	UNSAT TT=0.345	UNSAT TT=1.773	UNSAT TT=1.264	UNSAT TT=1.801
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_4.opb	UNSAT TT=0.342	UNSAT TT=0.342	No data	No data	UNSAT TT=2.507	UNSAT TT=2.437	UNSAT TT=0.35	UNSAT TT=0.355	UNSAT TT=2.712	UNSAT TT=1.614	UNSAT TT=11.734
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_5.opb	UNSAT TT=0.428	UNSAT TT=17.372	No data	No data	UNSAT TT=2.622	UNSAT TT=2.618	UNSAT TT=0.428	UNSAT TT=0.436	UNSAT TT=9.553	UNSAT TT=7.813	UNSAT TT=18.179
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_6.opb	UNSAT TT=0.959	UNSAT TT=536.44	No data	No data	UNSAT TT=3.138	UNSAT TT=3.051	UNSAT TT=0.959	UNSAT TT=0.98	UNSAT TT=149.149	UNSAT TT=66.53	UNSAT TT=580.463
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_7.opb	UNSAT TT=3.134	? (TO) TT=1800.02	No data	No data	UNSAT TT=5.939	UNSAT TT=6.384	UNSAT TT=3.134	UNSAT TT=3.134	? (TO) TT=1800.14	UNSAT TT=712.77	? (TO) TT=1800.01
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_8.opb	UNSAT TT=14.805	? (TO) TT=1800.03	No data	No data	UNSAT TT=28.566	UNSAT TT=16.935	UNSAT TT=14.805	UNSAT TT=15.36	? (TO) TT=1800.03	? (TO) TT=1800.69	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression64_9.opb	UNSAT TT=55.877	? (TO) TT=1800.02	No data	No data	UNSAT TT=156.407	UNSAT TT=64.284	UNSAT TT=55.877	UNSAT TT=56.274	? (TO) TT=1800.57	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_14.opb	UNSAT TT=2.397	UNSAT TT=274.107	No data	No data	UNSAT TT=3.096	UNSAT TT=2.397	UNSAT TT=5.219	UNSAT TT=5.229	UNSAT TT=34.239	UNSAT TT=20.331	UNSAT TT=59.961
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_15.opb	SAT TT=0.051 T1=0.05	SAT TT=0.211 T1=0.21	No data	No data	SAT TT=0.104 T1=0.1	SAT TT=0.051 T1=0.05	SAT TT=0.669 T1=0.67	SAT TT=0.671 T1=0.67	SAT TT=9.872 T1=4.32	SAT TT=1.253 T1=0.76	SAT TT=15.468 T1=15.41
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_16.opb	SAT TT=0.29 T1=0.29	SAT TT=0.979 T1=0.97	No data	No data	SAT TT=0.855 T1=0.85	SAT TT=0.854 T1=0.85	SAT TT=0.29 T1=0.29	SAT TT=0.29 T1=0.29	SAT TT=5.534 T1=2.33	SAT TT=11.762 T1=10.98	SAT TT=1.688 T1=1.63
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_17.opb	SAT TT=0.145 T1=0.14	SAT TT=3.215 T1=3.21	No data	No data	SAT TT=0.162 T1=0.16	SAT TT=0.145 T1=0.14	SAT TT=1.349 T1=1.35	SAT TT=1.355 T1=1.35	SAT TT=15.961 T1=7.33	SAT TT=17.491 T1=16.74	SAT TT=12.464 T1=12.41
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_18.opb	SAT TT=0.078 T1=0.08	SAT TT=0.387 T1=0.38	No data	No data	SAT TT=0.749 T1=0.74	SAT TT=0.18 T1=0.17	SAT TT=0.078 T1=0.08	SAT TT=0.081 T1=0.08	SAT TT=14.982 T1=6.84	SAT TT=12.682 T1=12.03	SAT TT=0.564 T1=0.53
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_19.opb	SAT TT=0.029 T1=0.02	SAT TT=9.953 T1=9.95	No data	No data	SAT TT=0.233 T1=0.23	SAT TT=0.257 T1=0.25	SAT TT=0.032 T1=0.03	SAT TT=0.029 T1=0.02	SAT TT=3.303 T1=1.34	SAT TT=5.403 T1=4.81	SAT TT=17.875 T1=17.81
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_20.opb	SAT TT=0.019 T1=0.01	SAT TT=2.652 T1=2.65	No data	No data	SAT TT=0.485 T1=0.48	SAT TT=0.086 T1=0.08	SAT TT=0.019 T1=0.01	SAT TT=0.02 T1=0.01	SAT TT=17.5 T1=7.85	SAT TT=3.043 T1=2.46	SAT TT=9.658 T1=9.6
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_21.opb	SAT TT=0.098 T1=0.09	SAT TT=1.13 T1=1.12	No data	No data	SAT TT=0.123 T1=0.12	SAT TT=0.577 T1=0.57	SAT TT=0.098 T1=0.09	SAT TT=0.099 T1=0.1	SAT TT=7.234 T1=2.85	SAT TT=5.092 T1=4.36	SAT TT=8.099 T1=8.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_23.opb	SAT TT=0.038 T1=0.03	SAT TT=0.038 T1=0.03	No data	No data	SAT TT=0.113 T1=0.11	SAT TT=0.09 T1=0.09	SAT TT=0.21 T1=0.21	SAT TT=0.195 T1=0.19	SAT TT=3.035 T1=1.38	SAT TT=2.843 T1=2.18	SAT TT=1.528 T1=1.46
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_24.opb	SAT TT=0.05 T1=0.04	SAT TT=0.05 T1=0.04	No data	No data	SAT TT=0.139 T1=0.13	SAT TT=0.09 T1=0.09	SAT TT=0.246 T1=0.24	SAT TT=0.25 T1=0.25	SAT TT=3.202 T1=1.37	SAT TT=2.104 T1=1.45	SAT TT=1.048 T1=1
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_25.opb	SAT TT=0.028 T1=0.02	SAT TT=0.118 T1=0.11	No data	No data	SAT TT=0.139 T1=0.14	SAT TT=0.111 T1=0.11	SAT TT=0.029 T1=0.02	SAT TT=0.028 T1=0.02	SAT TT=3.273 T1=1.37	SAT TT=3.683 T1=2.97	SAT TT=1.208 T1=1.15
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/ d-equals-n_k/normalized-compression8_26.opb	SAT TT=0.033 T1=0.03	SAT TT=0.173 T1=0.17	No data	No data	SAT TT=0.11 T1=0.1	SAT TT=0.204 T1=0.2	SAT TT=0.034 T1=0.03	SAT TT=0.033 T1=0.03	SAT TT=2.615 T1=0.89	SAT TT=1.293 T1=0.75	SAT TT=1.218 T1=1.16
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_0.opb	UNSAT TT=0	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.164	UNSAT TT=0.153	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_1.opb	UNSAT TT=0	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.163	UNSAT TT=0.155	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_2.opb	UNSAT TT=0	UNSAT TT=0.012	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.164	UNSAT TT=0.018
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_3.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.183	UNSAT TT=0.173	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_4.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.183	UNSAT TT=0.175	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_5.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.215	UNSAT TT=0.195	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_3_6.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.235	UNSAT TT=0.214	UNSAT TT=0.021
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_0.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.164	UNSAT TT=0.154	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_1.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.164	UNSAT TT=0.153	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_2.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.184	UNSAT TT=0.174	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_3.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.185	UNSAT TT=0.163	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_4.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.193	UNSAT TT=0.175	UNSAT TT=0.019
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_5.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.224	UNSAT TT=0.194	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_4_6.opb	SAT TT=0.002 T1=0	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0.005 T1=0	SAT TT=0.005 T1=0	SAT TT=0.002 T1=0	SAT TT=0.002 T1=0	SAT TT=0.233 T1=0.67	SAT TT=0.214 T1=0.16	SAT TT=0.025 T1=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_5_0.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.164	UNSAT TT=0.165	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_5_1.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.163	UNSAT TT=0.163	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_5_2.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.164	UNSAT TT=0.015
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_5_3.opb	SAT TT=0.001 T1=0	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0.002 T1=0	SAT TT=0.002 T1=0	SAT TT=0.001 T1=0	SAT TT=0.001 T1=0	SAT TT=0.183 T1=0.66	SAT TT=0.185 T1=0.14	SAT TT=0.018 T1=0.01
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_6_0.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0	UNSAT TT=0	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.164	UNSAT TT=0.164	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_6_1.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.163	UNSAT TT=0.154	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_6_2.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.173	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_6_3.opb	SAT TT=0.001 T1=0	SAT TT=0.01 T1=0.01	No data	No data	SAT TT=0.002 T1=0	SAT TT=0.002 T1=0	SAT TT=0.002 T1=0	SAT TT=0.001 T1=0	SAT TT=0.184 T1=0.65	SAT TT=0.174 T1=0.13	SAT TT=0.02 T1=0.01
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_7_0.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.164	UNSAT TT=0.166	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_7_1.opb	UNSAT TT=0	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.165	UNSAT TT=0.155	UNSAT TT=0.012
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_7_2.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.165	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-2_7_3.opb	SAT TT=0.001 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.003 T1=0	SAT TT=0.003 T1=0	SAT TT=0.001 T1=0	SAT TT=0.001 T1=0	SAT TT=0.182 T1=0.64	SAT TT=0.174 T1=0.13	SAT TT=0.017 T1=0.01
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_0.opb	UNSAT TT=0	UNSAT TT=0.011	No data	No data	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.165	UNSAT TT=0.153	UNSAT TT=0.016
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_10.opb	UNSAT TT=0.004	UNSAT TT=0.014	No data	No data	UNSAT TT=0.013	UNSAT TT=0.015	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=0.646	UNSAT TT=0.474	UNSAT TT=0.056
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_11.opb	UNSAT TT=0.004	UNSAT TT=0.015	No data	No data	UNSAT TT=0.014	UNSAT TT=0.015	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.706	UNSAT TT=0.514	UNSAT TT=0.062
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_12.opb	UNSAT TT=0.007	UNSAT TT=0.017	No data	No data	UNSAT TT=0.017	UNSAT TT=0.017	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=0.844	UNSAT TT=0.575	UNSAT TT=0.078
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_13.opb	UNSAT TT=0.008	UNSAT TT=0.016	No data	No data	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=0.008	UNSAT TT=0.008	UNSAT TT=0.855	UNSAT TT=0.563	UNSAT TT=0.105
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_1.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.175	UNSAT TT=0.164	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_2.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.183	UNSAT TT=0.174	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_3.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.194	UNSAT TT=0.182	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_4.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.204	UNSAT TT=0.194	UNSAT TT=0.021
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_5.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.233	UNSAT TT=0.204	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_6.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.283	UNSAT TT=0.224	UNSAT TT=0.025
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_7.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.303	UNSAT TT=0.254	UNSAT TT=0.029
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_8.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.009	UNSAT TT=0.011	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.644	UNSAT TT=0.363	UNSAT TT=0.036
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_4_9.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.011	UNSAT TT=0.01	UNSAT TT=0.004	UNSAT TT=0.003	UNSAT TT=0.573	UNSAT TT=0.405	UNSAT TT=0.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_0.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.163	UNSAT TT=0.165	UNSAT TT=0.014
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_10.opb	UNSAT TT=0.01	UNSAT TT=0.021	No data	No data	UNSAT TT=0.016	UNSAT TT=0.019	UNSAT TT=0.01	UNSAT TT=0.01	UNSAT TT=1.424	UNSAT TT=0.765	UNSAT TT=0.142
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_11.opb	UNSAT TT=0.01	UNSAT TT=0.021	No data	No data	UNSAT TT=0.018	UNSAT TT=0.018	UNSAT TT=0.01	UNSAT TT=0.011	UNSAT TT=1.143	UNSAT TT=0.636	UNSAT TT=0.122
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_12.opb	SAT TT=0.005 T1=0	SAT TT=0.015 T1=0.01	No data	No data	SAT TT=0.017 T1=0.01	SAT TT=0.017 T1=0.01	SAT TT=0.005 T1=0	SAT TT=0.006 T1=0	SAT TT=0.865 T1=0.75	SAT TT=0.524 T1=0.29	SAT TT=0.076 T1=0.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_1.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.163	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_2.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.184	UNSAT TT=0.173	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_3.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.204	UNSAT TT=0.176	UNSAT TT=0.018
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_4.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.214	UNSAT TT=0.193	UNSAT TT=0.021
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_5.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.262	UNSAT TT=0.224	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_6.opb	UNSAT TT=0.002	UNSAT TT=0.014	No data	No data	UNSAT TT=0.007	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.403	UNSAT TT=0.274	UNSAT TT=0.025
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_7.opb	UNSAT TT=0.003	UNSAT TT=0.012	No data	No data	UNSAT TT=0.008	UNSAT TT=0.01	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.642	UNSAT TT=0.414	UNSAT TT=0.034
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_8.opb	UNSAT TT=0.005	UNSAT TT=0.015	No data	No data	UNSAT TT=0.01	UNSAT TT=0.01	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.855	UNSAT TT=0.473	UNSAT TT=0.047
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_5_9.opb	UNSAT TT=0.004	UNSAT TT=0.016	No data	No data	UNSAT TT=0.012	UNSAT TT=0.012	UNSAT TT=0.006	UNSAT TT=0.004	UNSAT TT=0.824	UNSAT TT=0.532	UNSAT TT=0.078
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_0.opb	UNSAT TT=0	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.173	UNSAT TT=0.156	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_1.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.175	UNSAT TT=0.164	UNSAT TT=0.014
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_2.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.186	UNSAT TT=0.174	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_3.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.195	UNSAT TT=0.174	UNSAT TT=0.019
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_4.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.214	UNSAT TT=0.214	UNSAT TT=0.024
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_5.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.294	UNSAT TT=0.224	UNSAT TT=0.026
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_6_6.opb	SAT TT=0.002 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.007 T1=0	SAT TT=0.007 T1=0	SAT TT=0.002 T1=0	SAT TT=0.002 T1=0	SAT TT=0.403 T1=0.68	SAT TT=0.274 T1=0.18	SAT TT=0.028 T1=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_7_0.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.173	UNSAT TT=0.153	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_7_1.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.163	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_7_2.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.183	UNSAT TT=0.175	UNSAT TT=0.018
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_7_3.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.194	UNSAT TT=0.174	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-3_7_4.opb	SAT TT=0.001 T1=0	SAT TT=0.011 T1=0.01	No data	No data	SAT TT=0.004 T1=0	SAT TT=0.004 T1=0	SAT TT=0.001 T1=0	SAT TT=0.002 T1=0	SAT TT=0.215 T1=0.66	SAT TT=0.195 T1=0.15	SAT TT=0.02 T1=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_0.opb	UNSAT TT=0	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.172	UNSAT TT=0.163	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_10.opb	UNSAT TT=0.01	UNSAT TT=0.021	No data	No data	UNSAT TT=0.019	UNSAT TT=0.018	UNSAT TT=0.01	UNSAT TT=0.012	UNSAT TT=1.201	UNSAT TT=0.644	UNSAT TT=0.102
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_11.opb	UNSAT TT=0.009	UNSAT TT=0.023	No data	No data	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=0.009	UNSAT TT=0.01	UNSAT TT=1.234	UNSAT TT=0.643	UNSAT TT=0.158
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_12.opb	UNSAT TT=0.027	UNSAT TT=0.038	No data	No data	UNSAT TT=0.031	UNSAT TT=0.027	UNSAT TT=0.028	UNSAT TT=0.027	UNSAT TT=2.035	UNSAT TT=0.854	UNSAT TT=0.333
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_13.opb	UNSAT TT=0.025	UNSAT TT=0.036	No data	No data	UNSAT TT=0.033	UNSAT TT=0.029	UNSAT TT=0.025	UNSAT TT=0.025	UNSAT TT=1.895	UNSAT TT=0.835	UNSAT TT=0.328
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_14.opb	UNSAT TT=0.051	UNSAT TT=0.115	No data	No data	UNSAT TT=0.06	UNSAT TT=0.054	UNSAT TT=0.051	UNSAT TT=0.051	UNSAT TT=3.403	UNSAT TT=1.253	UNSAT TT=0.932
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_15.opb	UNSAT TT=0.048	UNSAT TT=0.091	No data	No data	UNSAT TT=0.054	UNSAT TT=0.048	UNSAT TT=0.075	UNSAT TT=0.071	UNSAT TT=2.733	UNSAT TT=1.283	UNSAT TT=0.878
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_16.opb	UNSAT TT=0.116	UNSAT TT=0.412	No data	No data	UNSAT TT=0.116	UNSAT TT=0.135	UNSAT TT=0.148	UNSAT TT=0.15	UNSAT TT=5.333	UNSAT TT=2.533	UNSAT TT=1.396
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_17.opb	UNSAT TT=0.092	UNSAT TT=0.257	No data	No data	UNSAT TT=0.112	UNSAT TT=0.092	UNSAT TT=0.139	UNSAT TT=0.14	UNSAT TT=5.652	UNSAT TT=2.335	UNSAT TT=1.673
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_18.opb	UNSAT TT=0.196	UNSAT TT=1.074	No data	No data	UNSAT TT=0.23	UNSAT TT=0.196	UNSAT TT=0.288	UNSAT TT=0.289	UNSAT TT=5.3	UNSAT TT=3.922	UNSAT TT=2.976
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_19.opb	UNSAT TT=0.211	UNSAT TT=0.693	No data	No data	UNSAT TT=0.214	UNSAT TT=0.211	UNSAT TT=0.256	UNSAT TT=0.272	UNSAT TT=4.972	UNSAT TT=1.953	UNSAT TT=3.138
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_1.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.175	UNSAT TT=0.163	UNSAT TT=0.017
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_20.opb	UNSAT TT=0.34	UNSAT TT=1.637	No data	No data	UNSAT TT=0.513	UNSAT TT=0.479	UNSAT TT=0.341	UNSAT TT=0.34	UNSAT TT=7.813	UNSAT TT=7.531	UNSAT TT=5.797
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_21.opb	UNSAT TT=0.282	UNSAT TT=1.516	No data	No data	UNSAT TT=0.372	UNSAT TT=0.282	UNSAT TT=0.519	UNSAT TT=0.523	UNSAT TT=7.724	UNSAT TT=2.564	UNSAT TT=7.749
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_22.opb	UNSAT TT=0.475	UNSAT TT=3.141	No data	No data	UNSAT TT=0.997	UNSAT TT=0.755	UNSAT TT=0.475	UNSAT TT=0.478	UNSAT TT=10.087	UNSAT TT=3.923	UNSAT TT=10.683
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_23.opb	UNSAT TT=0.509	UNSAT TT=2.984	No data	No data	UNSAT TT=0.794	UNSAT TT=0.509	UNSAT TT=1.297	UNSAT TT=1.368	UNSAT TT=10.635	UNSAT TT=4.583	UNSAT TT=13.325
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_24.opb	UNSAT TT=1.634	UNSAT TT=5.523	No data	No data	UNSAT TT=1.849	UNSAT TT=1.673	UNSAT TT=1.634	UNSAT TT=1.639	UNSAT TT=15.143	UNSAT TT=6.113	UNSAT TT=25.068
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_25.opb	UNSAT TT=1.062	UNSAT TT=6.021	No data	No data	UNSAT TT=1.818	UNSAT TT=1.13	UNSAT TT=1.068	UNSAT TT=1.062	UNSAT TT=15.012	UNSAT TT=7.422	UNSAT TT=23.475
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_26.opb	UNSAT TT=1.461	UNSAT TT=22.885	No data	No data	UNSAT TT=3.488	UNSAT TT=2.543	UNSAT TT=1.461	UNSAT TT=1.467	UNSAT TT=19.972	UNSAT TT=9.763	UNSAT TT=33.963
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_27.opb	UNSAT TT=1.541	UNSAT TT=23.104	No data	No data	UNSAT TT=2.72	UNSAT TT=2.308	UNSAT TT=1.541	UNSAT TT=1.543	UNSAT TT=22.831	UNSAT TT=10.491	UNSAT TT=39.955
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_28.opb	UNSAT TT=2.332	UNSAT TT=25.676	No data	No data	UNSAT TT=4.57	UNSAT TT=4.556	UNSAT TT=2.332	UNSAT TT=2.345	UNSAT TT=29.38	UNSAT TT=13.702	UNSAT TT=67.724
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_2.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.194	UNSAT TT=0.174	UNSAT TT=0.018
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_3.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.214	UNSAT TT=0.204	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_4.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.223	UNSAT TT=0.204	UNSAT TT=0.021
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_5.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.255	UNSAT TT=0.243	UNSAT TT=0.024
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_6.opb	UNSAT TT=0.004	UNSAT TT=0.012	No data	No data	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.384	UNSAT TT=0.275	UNSAT TT=0.035
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_7.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.009	UNSAT TT=0.01	UNSAT TT=0.004	UNSAT TT=0.003	UNSAT TT=0.545	UNSAT TT=0.375	UNSAT TT=0.035
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_8.opb	UNSAT TT=0.005	UNSAT TT=0.014	No data	No data	UNSAT TT=0.012	UNSAT TT=0.012	UNSAT TT=0.006	UNSAT TT=0.005	UNSAT TT=0.784	UNSAT TT=0.513	UNSAT TT=0.05
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_5_9.opb	UNSAT TT=0.005	UNSAT TT=0.015	No data	No data	UNSAT TT=0.013	UNSAT TT=0.014	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.906	UNSAT TT=0.535	UNSAT TT=0.068
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_0.opb	UNSAT TT=0	UNSAT TT=0.012	No data	No data	UNSAT TT=0.002	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.173	UNSAT TT=0.163	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_1.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.184	UNSAT TT=0.174	UNSAT TT=0.019
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_2.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.194	UNSAT TT=0.185	UNSAT TT=0.018
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_3.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.224	UNSAT TT=0.205	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_4.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.235	UNSAT TT=0.204	UNSAT TT=0.025
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_5.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.006	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.303	UNSAT TT=0.244	UNSAT TT=0.025
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_6.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.008	UNSAT TT=0.009	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.624	UNSAT TT=0.393	UNSAT TT=0.033
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_7.opb	UNSAT TT=0.004	UNSAT TT=0.013	No data	No data	UNSAT TT=0.01	UNSAT TT=0.012	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.783	UNSAT TT=0.495	UNSAT TT=0.052
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_6_8.opb	SAT TT=0.003 T1=0	SAT TT=0.012 T1=0.01	No data	No data	SAT TT=0.011 T1=0.01	SAT TT=0.012 T1=0.01	SAT TT=0.003 T1=0	SAT TT=0.004 T1=0	SAT TT=0.563 T1=0.71	SAT TT=0.404 T1=0.24	SAT TT=0.047 T1=0.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_0.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.173	UNSAT TT=0.164	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_1.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.173	UNSAT TT=0.163	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_2.opb	UNSAT TT=0.002	UNSAT TT=0.01	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.203	UNSAT TT=0.183	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_3.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.213	UNSAT TT=0.193	UNSAT TT=0.022
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_4.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.235	UNSAT TT=0.224	UNSAT TT=0.028
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_5.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.323	UNSAT TT=0.263	UNSAT TT=0.026
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_6.opb	UNSAT TT=0.004	UNSAT TT=0.013	No data	No data	UNSAT TT=0.009	UNSAT TT=0.009	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.704	UNSAT TT=0.436	UNSAT TT=0.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-4_7_7.opb	SAT TT=0.004 T1=0	SAT TT=0.015 T1=0.01	No data	No data	SAT TT=0.011 T1=0.01	SAT TT=0.012 T1=0.01	SAT TT=0.004 T1=0	SAT TT=0.005 T1=0	SAT TT=0.823 T1=0.72	SAT TT=0.515 T1=0.28	SAT TT=0.054 T1=0.05
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_0.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.174	UNSAT TT=0.164	UNSAT TT=0.015
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_10.opb	UNSAT TT=0.02	UNSAT TT=0.076	No data	No data	UNSAT TT=0.038	UNSAT TT=0.031	UNSAT TT=0.02	UNSAT TT=0.02	UNSAT TT=2.083	UNSAT TT=0.815	UNSAT TT=0.221
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_11.opb	UNSAT TT=0.032	UNSAT TT=0.049	No data	No data	UNSAT TT=0.032	UNSAT TT=0.038	UNSAT TT=0.041	UNSAT TT=0.041	UNSAT TT=2.194	UNSAT TT=1.064	UNSAT TT=0.521
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_12.opb	UNSAT TT=0.064	UNSAT TT=0.317	No data	No data	UNSAT TT=0.066	UNSAT TT=0.064	UNSAT TT=0.12	UNSAT TT=0.121	UNSAT TT=3.633	UNSAT TT=1.175	UNSAT TT=1.277
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_13.opb	UNSAT TT=0.069	UNSAT TT=0.272	No data	No data	UNSAT TT=0.073	UNSAT TT=0.069	UNSAT TT=0.106	UNSAT TT=0.107	UNSAT TT=5.282	UNSAT TT=1.284	UNSAT TT=1.69
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_14.opb	UNSAT TT=0.168	UNSAT TT=1.528	No data	No data	UNSAT TT=0.232	UNSAT TT=0.168	UNSAT TT=0.366	UNSAT TT=0.371	UNSAT TT=6.383	UNSAT TT=2.744	UNSAT TT=3.783
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_15.opb	UNSAT TT=0.216	UNSAT TT=0.789	No data	No data	UNSAT TT=0.216	UNSAT TT=0.226	UNSAT TT=0.94	UNSAT TT=0.942	UNSAT TT=10.762	UNSAT TT=2.104	UNSAT TT=3.583
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_16.opb	UNSAT TT=0.637	UNSAT TT=13.46	No data	No data	UNSAT TT=0.967	UNSAT TT=0.637	UNSAT TT=1.058	UNSAT TT=1.057	UNSAT TT=13.963	UNSAT TT=4.741	UNSAT TT=11.156
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_17.opb	UNSAT TT=0.76	UNSAT TT=5.382	No data	No data	UNSAT TT=0.891	UNSAT TT=0.76	UNSAT TT=1.012	UNSAT TT=1.014	UNSAT TT=9.443	UNSAT TT=5.083	UNSAT TT=7.384
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_18.opb	UNSAT TT=1.354	UNSAT TT=88.224	No data	No data	UNSAT TT=4.452	UNSAT TT=2.663	UNSAT TT=1.359	UNSAT TT=1.354	UNSAT TT=19.291	UNSAT TT=9.713	UNSAT TT=22.019
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_19.opb	UNSAT TT=2.389	UNSAT TT=38.933	No data	No data	UNSAT TT=4.276	UNSAT TT=2.389	UNSAT TT=3.697	UNSAT TT=3.706	UNSAT TT=22.461	UNSAT TT=11.402	UNSAT TT=29.106
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_1.opb	UNSAT TT=0.001	UNSAT TT=0.012	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.184	UNSAT TT=0.175	UNSAT TT=0.019
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_20.opb	UNSAT TT=3.541	UNSAT TT=362.38	No data	No data	UNSAT TT=21.927	UNSAT TT=11.143	UNSAT TT=3.541	UNSAT TT=3.552	UNSAT TT=129.224	UNSAT TT=28.25	UNSAT TT=86.88
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_21.opb	UNSAT TT=12.343	UNSAT TT=193.976	No data	No data	UNSAT TT=20.858	UNSAT TT=14.537	UNSAT TT=12.545	UNSAT TT=12.343	UNSAT TT=68.98	UNSAT TT=28.849	UNSAT TT=86.509
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_22.opb	UNSAT TT=7.662	UNSAT TT=1383.2	No data	No data	UNSAT TT=69.706	UNSAT TT=57.889	UNSAT TT=7.714	UNSAT TT=7.662	UNSAT TT=223.029	UNSAT TT=118.685	UNSAT TT=234.724
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_23.opb	UNSAT TT=36.397	UNSAT TT=979.071	No data	No data	UNSAT TT=54.282	UNSAT TT=36.397	UNSAT TT=44.695	UNSAT TT=47.395	UNSAT TT=269.852	UNSAT TT=102.568	UNSAT TT=307.357
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_24.opb	UNSAT TT=26.209	? (TO) TT=1800.1	No data	No data	UNSAT TT=314.522	UNSAT TT=195.003	UNSAT TT=26.209	UNSAT TT=27.818	UNSAT TT=975.546	UNSAT TT=336.425	UNSAT TT=942.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_25.opb	UNSAT TT=70.249	? (TO) TT=1800.02	No data	No data	UNSAT TT=219.235	UNSAT TT=180.733	UNSAT TT=72.594	UNSAT TT=70.249	UNSAT TT=1257.89	UNSAT TT=405.372	UNSAT TT=1343.75
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_26.opb	UNSAT TT=49.036	? (TO) TT=1800.1	No data	No data	UNSAT TT=1076.16	UNSAT TT=749.346	UNSAT TT=49.036	UNSAT TT=49.088	? (TO) TT=1800.96	UNSAT TT=1433.03	? (TO) TT=1800.11
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_27.opb	UNSAT TT=145.88	? (TO) TT=1800.02	No data	No data	UNSAT TT=857.959	UNSAT TT=591.614	UNSAT TT=145.88	UNSAT TT=147.183	? (TO) TT=1800.06	UNSAT TT=1516.82	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_28.opb	UNSAT TT=142.97	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=151.165	UNSAT TT=142.97	? (TO) TT=1801.3	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_29.opb	UNSAT TT=277.767	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=284.38	UNSAT TT=277.767	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_2.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.214	UNSAT TT=0.193	UNSAT TT=0.021
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_30.opb	UNSAT TT=589.463	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=593.691	UNSAT TT=589.463	? (TO) TT=1800.18	? (TO) TT=1800.64	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_31.opb	UNSAT TT=759.729	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=759.729	UNSAT TT=774.044	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_32.opb	UNSAT TT=914.792	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=959.113	UNSAT TT=914.792	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_33.opb	UNSAT TT=1741.64	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1758.93	UNSAT TT=1741.64	? (TO) TT=1801.19	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_34.opb	UNSAT TT=1782.3	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1782.3	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.65	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_35.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.05	? (TO) TT=1800.79	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_36.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.74	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_37.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_38.opb		? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.2	? (TO) TT=1800.84	? (TO) TT=1800.1
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_3.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.005	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.234	UNSAT TT=0.213	UNSAT TT=0.021
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_4.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.244	UNSAT TT=0.225	UNSAT TT=0.026
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_5.opb	UNSAT TT=0.002	UNSAT TT=0.014	No data	No data	UNSAT TT=0.008	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.314	UNSAT TT=0.254	UNSAT TT=0.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_6.opb	UNSAT TT=0.003	UNSAT TT=0.015	No data	No data	UNSAT TT=0.01	UNSAT TT=0.01	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.546	UNSAT TT=0.394	UNSAT TT=0.036
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_7.opb	UNSAT TT=0.004	UNSAT TT=0.015	No data	No data	UNSAT TT=0.012	UNSAT TT=0.012	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=0.874	UNSAT TT=0.494	UNSAT TT=0.047
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_8.opb	UNSAT TT=0.006	UNSAT TT=0.019	No data	No data	UNSAT TT=0.015	UNSAT TT=0.016	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=1.043	UNSAT TT=0.564	UNSAT TT=0.068
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_6_9.opb	UNSAT TT=0.011	UNSAT TT=0.021	No data	No data	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=0.011	UNSAT TT=0.013	UNSAT TT=1.703	UNSAT TT=0.684	UNSAT TT=0.134
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_0.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.176	UNSAT TT=0.163	UNSAT TT=0.017
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_1.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.184	UNSAT TT=0.173	UNSAT TT=0.019
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_2.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.223	UNSAT TT=0.205	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_3.opb	UNSAT TT=0.002	UNSAT TT=0.013	No data	No data	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.224	UNSAT TT=0.227	UNSAT TT=0.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_4.opb	UNSAT TT=0.002	UNSAT TT=0.01	No data	No data	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.263	UNSAT TT=0.232	UNSAT TT=0.027
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_5.opb	UNSAT TT=0.002	UNSAT TT=0.013	No data	No data	UNSAT TT=0.008	UNSAT TT=0.009	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.394	UNSAT TT=0.283	UNSAT TT=0.031
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_6.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.011	UNSAT TT=0.012	UNSAT TT=0.003	UNSAT TT=0.005	UNSAT TT=0.752	UNSAT TT=0.453	UNSAT TT=0.045
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_7.opb	UNSAT TT=0.006	UNSAT TT=0.016	No data	No data	UNSAT TT=0.016	UNSAT TT=0.014	UNSAT TT=0.007	UNSAT TT=0.006	UNSAT TT=0.994	UNSAT TT=0.584	UNSAT TT=0.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_8.opb	UNSAT TT=0.013	UNSAT TT=0.034	No data	No data	UNSAT TT=0.023	UNSAT TT=0.022	UNSAT TT=0.013	UNSAT TT=0.013	UNSAT TT=1.613	UNSAT TT=0.714	UNSAT TT=0.113
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-5_7_9.opb	SAT TT=0.004 T1=0	SAT TT=0.021 T1=0.02	No data	No data	SAT TT=0.018 T1=0.02	SAT TT=0.018 T1=0.01	SAT TT=0.004 T1=0	SAT TT=0.005 T1=0	SAT TT=1.324 T1=0.74	SAT TT=0.674 T1=0.34	SAT TT=0.071 T1=0.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_10.opb	UNSAT TT=0.018	UNSAT TT=0.047	No data	No data	UNSAT TT=0.035	UNSAT TT=0.027	UNSAT TT=0.018	UNSAT TT=0.022	UNSAT TT=1.924	UNSAT TT=0.814	UNSAT TT=0.192
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_11.opb	UNSAT TT=0.028	UNSAT TT=0.054	No data	No data	UNSAT TT=0.038	UNSAT TT=0.033	UNSAT TT=0.028	UNSAT TT=0.028	UNSAT TT=3.623	UNSAT TT=0.994	UNSAT TT=0.386
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_12.opb	UNSAT TT=0.06	UNSAT TT=0.186	No data	No data	UNSAT TT=0.071	UNSAT TT=0.06	UNSAT TT=0.063	UNSAT TT=0.062	UNSAT TT=2.773	UNSAT TT=1.044	UNSAT TT=0.713
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_13.opb	UNSAT TT=0.062	UNSAT TT=0.248	No data	No data	UNSAT TT=0.078	UNSAT TT=0.062	UNSAT TT=0.091	UNSAT TT=0.092	UNSAT TT=4.732	UNSAT TT=1.434	UNSAT TT=1.478
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_14.opb	UNSAT TT=0.17	UNSAT TT=0.91	No data	No data	UNSAT TT=0.247	UNSAT TT=0.17	UNSAT TT=0.185	UNSAT TT=0.186	UNSAT TT=6.05	UNSAT TT=2.035	UNSAT TT=3.144
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_15.opb	UNSAT TT=0.195	UNSAT TT=0.813	No data	No data	UNSAT TT=0.23	UNSAT TT=0.195	UNSAT TT=0.289	UNSAT TT=0.29	UNSAT TT=8.373	UNSAT TT=3.822	UNSAT TT=2.487
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_16.opb	UNSAT TT=0.595	UNSAT TT=5.24	No data	No data	UNSAT TT=0.748	UNSAT TT=0.595	UNSAT TT=0.688	UNSAT TT=0.688	UNSAT TT=11.291	UNSAT TT=4.853	UNSAT TT=14.967
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_17.opb	UNSAT TT=0.476	UNSAT TT=5.925	No data	No data	UNSAT TT=0.835	UNSAT TT=0.61	UNSAT TT=0.476	UNSAT TT=0.477	UNSAT TT=11.222	UNSAT TT=3.652	UNSAT TT=10.701
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_18.opb	UNSAT TT=2.335	UNSAT TT=39.666	No data	No data	UNSAT TT=2.69	UNSAT TT=2.335	UNSAT TT=2.667	UNSAT TT=2.667	UNSAT TT=27.94	UNSAT TT=17.471	UNSAT TT=26.552
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_19.opb	UNSAT TT=2.639	UNSAT TT=33.635	No data	No data	UNSAT TT=3.045	UNSAT TT=2.639	UNSAT TT=2.965	UNSAT TT=2.975	UNSAT TT=25.039	UNSAT TT=13.712	UNSAT TT=35.539
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_20.opb	UNSAT TT=1.033	UNSAT TT=325.347	No data	No data	UNSAT TT=18.112	UNSAT TT=8.178	UNSAT TT=1.033	UNSAT TT=1.033	UNSAT TT=125.245	UNSAT TT=55.38	UNSAT TT=104.104
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_21.opb	UNSAT TT=2.386	UNSAT TT=192.321	No data	No data	UNSAT TT=13.251	UNSAT TT=9.983	UNSAT TT=2.386	UNSAT TT=2.412	UNSAT TT=87.652	UNSAT TT=43.89	UNSAT TT=107.573
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_22.opb	UNSAT TT=9.111	UNSAT TT=981.524	No data	No data	UNSAT TT=62.162	UNSAT TT=37.942	UNSAT TT=9.111	UNSAT TT=9.16	UNSAT TT=278.812	UNSAT TT=145.58	UNSAT TT=366.52
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_23.opb	UNSAT TT=8.446	UNSAT TT=1161.51	No data	No data	UNSAT TT=74.027	UNSAT TT=35.143	UNSAT TT=8.446	UNSAT TT=8.506	UNSAT TT=309.018	UNSAT TT=197.645	UNSAT TT=363.751
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_2.opb	UNSAT TT=0.002	UNSAT TT=0.01	No data	No data	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.224	UNSAT TT=0.214	UNSAT TT=0.022
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_30.opb	UNSAT TT=163.418	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=163.418	UNSAT TT=166.98	? (TO) TT=1800.01	? (TO) TT=1800.77	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_31.opb	UNSAT TT=211.893	? (TO) TT=1800.01	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=211.893	UNSAT TT=215.091	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_32.opb	UNSAT TT=237.9	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=238.136	UNSAT TT=237.9	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_33.opb	UNSAT TT=257.395	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=267.225	UNSAT TT=257.395	? (TO) TT=1801.15	? (TO) TT=1800.91	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_34.opb	UNSAT TT=611.576	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=617.146	UNSAT TT=611.576	? (TO) TT=1801.1	? (TO) TT=1800.74	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_3.opb	UNSAT TT=0.001	UNSAT TT=0.013	No data	No data	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.243	UNSAT TT=0.223	UNSAT TT=0.023
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_4.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.009	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.254	UNSAT TT=0.244	UNSAT TT=0.028
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_5.opb	UNSAT TT=0.002	UNSAT TT=0.012	No data	No data	UNSAT TT=0.01	UNSAT TT=0.01	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.384	UNSAT TT=0.295	UNSAT TT=0.032
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_6.opb	UNSAT TT=0.004	UNSAT TT=0.014	No data	No data	UNSAT TT=0.011	UNSAT TT=0.012	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.535	UNSAT TT=0.355	UNSAT TT=0.04
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_7.opb	UNSAT TT=0.006	UNSAT TT=0.014	No data	No data	UNSAT TT=0.014	UNSAT TT=0.014	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=0.814	UNSAT TT=0.525	UNSAT TT=0.047
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_8.opb	UNSAT TT=0.007	UNSAT TT=0.019	No data	No data	UNSAT TT=0.024	UNSAT TT=0.018	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=1.012	UNSAT TT=0.574	UNSAT TT=0.068
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-6_6_9.opb	UNSAT TT=0.009	UNSAT TT=0.021	No data	No data	UNSAT TT=0.023	UNSAT TT=0.02	UNSAT TT=0.01	UNSAT TT=0.009	UNSAT TT=1.293	UNSAT TT=0.695	UNSAT TT=0.117
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_18.opb	UNSAT TT=0.31	UNSAT TT=16.776	No data	No data	UNSAT TT=2.798	UNSAT TT=3.984	UNSAT TT=0.31	UNSAT TT=0.314	UNSAT TT=18.92	UNSAT TT=13.241	UNSAT TT=42.389
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_19.opb	UNSAT TT=1.183	UNSAT TT=13.887	No data	No data	UNSAT TT=2.511	UNSAT TT=1.866	UNSAT TT=1.185	UNSAT TT=1.183	UNSAT TT=28.85	UNSAT TT=10.694	UNSAT TT=36.794
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_20.opb	UNSAT TT=0.783	UNSAT TT=88.212	No data	No data	UNSAT TT=8.824	UNSAT TT=10.223	UNSAT TT=0.783	UNSAT TT=0.786	UNSAT TT=68.574	UNSAT TT=36.008	UNSAT TT=220.877
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_21.opb	UNSAT TT=1.5	UNSAT TT=200.251	No data	No data	UNSAT TT=7.678	UNSAT TT=7.219	UNSAT TT=1.501	UNSAT TT=1.5	UNSAT TT=89.87	UNSAT TT=38.667	UNSAT TT=137.058
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_22.opb	UNSAT TT=3.016	UNSAT TT=203.364	No data	No data	UNSAT TT=13.297	UNSAT TT=29.096	UNSAT TT=3.016	UNSAT TT=3.023	UNSAT TT=321.414	UNSAT TT=113.346	UNSAT TT=800.783
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_23.opb	UNSAT TT=4.768	UNSAT TT=792.538	No data	No data	UNSAT TT=56.152	UNSAT TT=25.201	UNSAT TT=4.768	UNSAT TT=4.9	UNSAT TT=339.741	UNSAT TT=173.17	UNSAT TT=501.804
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_24.opb	UNSAT TT=8.697	UNSAT TT=1391.32	No data	No data	UNSAT TT=75.098	UNSAT TT=113.912	UNSAT TT=8.697	UNSAT TT=8.799	? (TO) TT=1800.18	UNSAT TT=366.16	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_25.opb	UNSAT TT=5.729	? (TO) TT=1800.02	No data	No data	UNSAT TT=95.889	UNSAT TT=72.749	UNSAT TT=5.729	UNSAT TT=5.785	UNSAT TT=1357.11	UNSAT TT=489.13	UNSAT TT=1615.5
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_26.opb	UNSAT TT=13.143	? (TO) TT=1800.02	No data	No data	UNSAT TT=228.045	UNSAT TT=387.762	UNSAT TT=13.143	UNSAT TT=13.255	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_27.opb	UNSAT TT=16.516	? (TO) TT=1800.02	No data	No data	UNSAT TT=332.367	UNSAT TT=202.169	UNSAT TT=16.516	UNSAT TT=17.503	? (TO) TT=1800.1	? (TO) TT=1801.03	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_28.opb	UNSAT TT=31.639	? (TO) TT=1800.02	No data	No data	UNSAT TT=241.164	UNSAT TT=1328.1	UNSAT TT=31.639	UNSAT TT=31.714	? (TO) TT=1800.07	? (TO) TT=1800.67	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_29.opb	UNSAT TT=65.561	? (TO) TT=1800.01	No data	No data	UNSAT TT=917.998	UNSAT TT=881.081	UNSAT TT=65.561	UNSAT TT=66.621	? (TO) TT=1800.01	? (TO) TT=1800.53	? (TO) TT=1800.06
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_6_30.opb	UNSAT TT=64.114	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=65.402	UNSAT TT=64.114	? (TO) TT=1800.02	? (TO) TT=1800.54	? (TO) TT=1800.08
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_0.opb	UNSAT TT=0.001	UNSAT TT=0.01	No data	No data	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.193	UNSAT TT=0.184	UNSAT TT=0.016
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_10.opb	UNSAT TT=0.043	UNSAT TT=0.094	No data	No data	UNSAT TT=0.052	UNSAT TT=0.043	UNSAT TT=0.051	UNSAT TT=0.052	UNSAT TT=3.572	UNSAT TT=1.133	UNSAT TT=0.418
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_11.opb	UNSAT TT=0.061	UNSAT TT=0.188	No data	No data	UNSAT TT=0.061	UNSAT TT=0.067	UNSAT TT=0.087	UNSAT TT=0.082	UNSAT TT=3.563	UNSAT TT=1.143	UNSAT TT=1.004
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_12.opb	UNSAT TT=0.089	UNSAT TT=1.264	No data	No data	UNSAT TT=0.176	UNSAT TT=0.185	UNSAT TT=0.089	UNSAT TT=0.09	UNSAT TT=5.64	UNSAT TT=1.414	UNSAT TT=2.117
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_13.opb	UNSAT TT=0.159	UNSAT TT=1.803	No data	No data	UNSAT TT=0.174	UNSAT TT=0.159	UNSAT TT=0.369	UNSAT TT=0.371	UNSAT TT=7.953	UNSAT TT=2.875	UNSAT TT=5.89
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_14.opb	UNSAT TT=0.383	UNSAT TT=7.011	No data	No data	UNSAT TT=1.247	UNSAT TT=0.84	UNSAT TT=0.383	UNSAT TT=0.383	UNSAT TT=15.712	UNSAT TT=5.924	UNSAT TT=17.257
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_15.opb	UNSAT TT=1.162	UNSAT TT=53.511	No data	No data	UNSAT TT=1.162	UNSAT TT=1.234	UNSAT TT=2.072	UNSAT TT=2	UNSAT TT=19.622	UNSAT TT=12.392	UNSAT TT=50.079
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_16.opb	UNSAT TT=4.033	UNSAT TT=350.703	No data	No data	UNSAT TT=4.033	UNSAT TT=4.978	UNSAT TT=5.46	UNSAT TT=5.448	UNSAT TT=63.885	UNSAT TT=38.6	UNSAT TT=117.344
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_18.opb	SAT TT=0.147 T1=0.14	SAT TT=5.607 T1=5.6	No data	No data	SAT TT=0.754 T1=0.75	SAT TT=0.76 T1=0.76	SAT TT=0.147 T1=0.15	SAT TT=0.148 T1=0.14	SAT TT=12.032 T1=5.36	SAT TT=11.142 T1=10.47	SAT TT=11.04 T1=10.98
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_1.opb	UNSAT TT=0.001	UNSAT TT=0.011	No data	No data	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.001	UNSAT TT=0.002	UNSAT TT=0.214	UNSAT TT=0.203	UNSAT TT=0.021
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_2.opb	UNSAT TT=0.002	UNSAT TT=0.011	No data	No data	UNSAT TT=0.006	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.243	UNSAT TT=0.224	UNSAT TT=0.024
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_3.opb	UNSAT TT=0.002	UNSAT TT=0.013	No data	No data	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.263	UNSAT TT=0.244	UNSAT TT=0.029
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_4.opb	UNSAT TT=0.003	UNSAT TT=0.013	No data	No data	UNSAT TT=0.011	UNSAT TT=0.01	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.294	UNSAT TT=0.275	UNSAT TT=0.034
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_5.opb	UNSAT TT=0.004	UNSAT TT=0.013	No data	No data	UNSAT TT=0.012	UNSAT TT=0.012	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.464	UNSAT TT=0.353	UNSAT TT=0.038
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_6.opb	UNSAT TT=0.005	UNSAT TT=0.015	No data	No data	UNSAT TT=0.015	UNSAT TT=0.014	UNSAT TT=0.005	UNSAT TT=0.005	UNSAT TT=0.773	UNSAT TT=0.493	UNSAT TT=0.054
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_7.opb	UNSAT TT=0.007	UNSAT TT=0.018	No data	No data	UNSAT TT=0.018	UNSAT TT=0.018	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=1.025	UNSAT TT=0.575	UNSAT TT=0.072
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_8.opb	UNSAT TT=0.009	UNSAT TT=0.021	No data	No data	UNSAT TT=0.024	UNSAT TT=0.025	UNSAT TT=0.009	UNSAT TT=0.009	UNSAT TT=1.475	UNSAT TT=0.715	UNSAT TT=0.112
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-7_7_9.opb	UNSAT TT=0.013	UNSAT TT=0.036	No data	No data	UNSAT TT=0.026	UNSAT TT=0.025	UNSAT TT=0.013	UNSAT TT=0.014	UNSAT TT=2.085	UNSAT TT=0.785	UNSAT TT=0.196
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_18.opb	UNSAT TT=0.503	UNSAT TT=5.651	No data	No data	UNSAT TT=0.965	UNSAT TT=1.578	UNSAT TT=0.505	UNSAT TT=0.503	UNSAT TT=20.551	UNSAT TT=13.441	UNSAT TT=27.359
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_19.opb	UNSAT TT=0.467	UNSAT TT=10.469	No data	No data	UNSAT TT=1.293	UNSAT TT=1.006	UNSAT TT=0.467	UNSAT TT=0.469	UNSAT TT=36.37	UNSAT TT=11.661	UNSAT TT=39.694
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_20.opb	UNSAT TT=1.828	UNSAT TT=41.992	No data	No data	UNSAT TT=6.377	UNSAT TT=8.239	UNSAT TT=1.828	UNSAT TT=1.834	UNSAT TT=51.965	UNSAT TT=14.033	UNSAT TT=137.9
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_21.opb	UNSAT TT=1.98	UNSAT TT=74.749	No data	No data	UNSAT TT=4.92	UNSAT TT=4.472	UNSAT TT=1.98	UNSAT TT=1.986	UNSAT TT=100.388	UNSAT TT=38.05	UNSAT TT=276.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_22.opb	UNSAT TT=1.456	UNSAT TT=280.525	No data	No data	UNSAT TT=5.894	UNSAT TT=22.158	UNSAT TT=1.456	UNSAT TT=1.46	UNSAT TT=134.244	UNSAT TT=46.509	UNSAT TT=417.916
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_23.opb	UNSAT TT=4.012	UNSAT TT=327.444	No data	No data	UNSAT TT=18.907	UNSAT TT=20.091	UNSAT TT=4.083	UNSAT TT=4.012	UNSAT TT=436.468	UNSAT TT=217.23	UNSAT TT=793.917
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_24.opb	UNSAT TT=6.894	UNSAT TT=910.842	No data	No data	UNSAT TT=19.249	UNSAT TT=73.337	UNSAT TT=6.894	UNSAT TT=6.922	UNSAT TT=647.447	UNSAT TT=140.854	? (TO) TT=1800.03
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_25.opb	UNSAT TT=4.268	? (TO) TT=1800.02	No data	No data	UNSAT TT=42.739	UNSAT TT=42.152	UNSAT TT=4.27	UNSAT TT=4.268	UNSAT TT=1378.96	UNSAT TT=598.22	? (TO) TT=1800.02
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_26.opb	UNSAT TT=14.277	? (TO) TT=1800.02	No data	No data	UNSAT TT=65.957	UNSAT TT=234.561	UNSAT TT=14.399	UNSAT TT=14.277	? (TO) TT=1800.14	UNSAT TT=521.32	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_27.opb	UNSAT TT=17.139	? (TO) TT=1800.02	No data	No data	UNSAT TT=151.424	UNSAT TT=134.012	UNSAT TT=17.139	UNSAT TT=17.294	? (TO) TT=1800.06	? (TO) TT=1800.71	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_28.opb	UNSAT TT=26.504	? (TO) TT=1800.01	No data	No data	UNSAT TT=145.745	UNSAT TT=476.424	UNSAT TT=27.178	UNSAT TT=26.504	? (TO) TT=1800.1	UNSAT TT=1021.89	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_29.opb	UNSAT TT=8.376	? (TO) TT=1800.02	No data	No data	UNSAT TT=364.253	UNSAT TT=402.478	UNSAT TT=8.376	UNSAT TT=8.426	? (TO) TT=1800.16	? (TO) TT=1800.6	? (TO) TT=1800.07
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_6_30.opb	UNSAT TT=28.147	? (TO) TT=1800.02	No data	No data	UNSAT TT=571.172	UNSAT TT=1238.53	UNSAT TT=28.147	UNSAT TT=28.323	? (TO) TT=1800.11	? (TO) TT=1800.71	? (TO) TT=1800.05
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_7_18.opb	UNSAT TT=4.957	UNSAT TT=1499.77	No data	No data	UNSAT TT=9.28	UNSAT TT=4.957	UNSAT TT=5.667	UNSAT TT=5.661	UNSAT TT=225.329	UNSAT TT=87.34	UNSAT TT=405.049
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_7_19.opb	UNSAT TT=14.573	? (TO) TT=1800.02	No data	No data	UNSAT TT=48.125	UNSAT TT=19.946	UNSAT TT=14.66	UNSAT TT=14.573	UNSAT TT=460.945	UNSAT TT=226.849	UNSAT TT=741.522
normalized-PB16/DEC-SMALLINT-LIN/ quimper/SyncCodes/d_n_k/ normalized-8_7_20.opb	SAT TT=0.068 T1=0.06	SAT TT=2.959 T1=2.95	No data	No data	SAT TT=0.068 T1=0.06	SAT TT=0.744 T1=0.74	SAT TT=2.908 T1=2.9	SAT TT=2.913 T1=2.91	SAT TT=9.922 T1=4.34	SAT TT=4.594 T1=3.85	SAT TT=169.844 T1=169.82
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-A-2-2-irEDCBA.opb	SAT f=47431265904 TT=1800.12 T1=54.44	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=61646774317 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=47431265904 TT=1800.12 T1=54.44	SAT (TO) f=58526285992 TT=1800.04 T1=3.66	? (exit code) TT=647.446
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-A-3-1-irabcde.opb	OPT f=193017991871 TT=152.29 T1=152.31	No data	No data	No data	SAT (TO) f=193029475043 TT=1800.02 T1=1800.3	OPT f=193017991871 TT=152.29 T1=152.31	No data	No data	SAT (TO) f=196918355011 TT=1800.09 T1=551.11	SAT (TO) f=201901854523 TT=1800.02 T1=69.42	? (MO) TT=955.133
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-A-3-1-irEDCBA.opb	OPT f=192984207671 TT=77.912 T1=77.91	No data	No data	No data	SAT (TO) f=201860234167 TT=1800.11 T1=1800.4	OPT f=192984207671 TT=77.912 T1=77.91	No data	No data	SAT (TO) f=197422230315 TT=1800.18 T1=224.67	SAT (TO) f=202414992663 TT=1800.02 T1=1.04	? (MO) TT=837.414
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-A-3-2-irabcde.opb	OPT f=192998376839 TT=28.827 T1=28.82	No data	No data	No data	SAT (TO) f=192998672543 TT=1800.11 T1=1800.4	OPT f=192998376839 TT=28.827 T1=28.82	No data	No data	SAT (TO) f=197462214903 TT=1800.07 T1=323.37	SAT (TO) f=202429253559 TT=1800.04 T1=1.11	? (MO) TT=867.469
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-A-3-2-irEDCBA.opb	OPT f=192984219263 TT=142.646 T1=142.66	No data	No data	No data	? (TO) TT=1800.01	OPT f=192984219263 TT=142.646 T1=142.66	No data	No data	SAT (TO) f=197422238127 TT=1800 T1=503.8	SAT (TO) f=202969750403 TT=1800.03 T1=885.03	? (exit code) TT=868.883
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-A-3-combined-irabcde.opb	OPT f=192998376839 TT=88.335 T1=88.33	No data	No data	No data	SAT (TO) f=194107880151 TT=1800.1 T1=1800.4	OPT f=192998376839 TT=88.335 T1=88.33	No data	No data	SAT (TO) f=199664859239 TT=1800.6 T1=834.96	SAT (TO) f=204648112331 TT=1800.67 T1=318.23	? (exit code) TT=864.307
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-2-1-irabcde.opb	SAT f=43640551061 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=51252029371 TT=1800.08 T1=1800.4	SAT (TO) f=43640551061 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=45998346831 TT=1800.15 T1=151.96	SAT (TO) f=60954655551 TT=1800.05 T1=0.87	? (MO) TT=707.489
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-2-1-irEDCBA.opb	SAT f=43616941865 TT=1800.01 T1=1800.3	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=43616941865 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=48748391767 TT=1800.15 T1=195.84	SAT (TO) f=57138761228 TT=1800.01 T1=179.23	? (MO) TT=716.334
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-2-2-irabcde.opb	SAT f=45010633681 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=52314174718 TT=1800.07 T1=1800.4	SAT (TO) f=45010633681 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=51961687373 TT=1800.04 T1=807.69	SAT (TO) f=59566508347 TT=1800.01 T1=0.76	? (MO) TT=911.191
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-2-combined-irabcde.opb	SAT f=50215270612 TT=1800.23 T1=878.15	No data	No data	No data	SAT (TO) f=52594702058 TT=1800.09 T1=1800.4	SAT (TO) f=61649335213 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=50215270612 TT=1800.23 T1=878.15	SAT (TO) f=63380425982 TT=1800.77 T1=1.07	? (MO) TT=642.208
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-2-combined-irEDCBA.opb	SAT f=39803311546 TT=1800.02 T1=1800.3	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=39803311546 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=47084183383 TT=1800.06 T1=773.85	SAT (TO) f=59912861940 TT=1800.71 T1=0.89	? (exit code) TT=847.115
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-3-1-irabcde.opb	OPT f=192985144751 TT=34.146 T1=34.14	No data	No data	No data	SAT (TO) f=195204155371 TT=1800.01 T1=1800.3	OPT f=192985144751 TT=34.146 T1=34.14	No data	No data	SAT (TO) f=193005668207 TT=1800.12 T1=611.32	SAT (TO) f=202415872287 TT=1800.02 T1=883.22	? (MO) TT=1113.55
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-3-1-irEDCBA.opb	OPT f=192983319911 TT=190.648 T1=190.66	No data	No data	No data	SAT (TO) f=197976483731 TT=1800.02 T1=1800.3	OPT f=192983319911 TT=190.648 T1=190.66	No data	No data	SAT (TO) f=195203082427 TT=1800.19 T1=761.16	SAT (TO) f=200749994943 TT=1800.66 T1=1.04	? (MO) TT=636.515
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-3-combined-abcdeir.opb	OPT f=1496382247 TT=60.3 T1=60.26	No data	No data	No data	SAT (TO) f=10804281495 TT=1800.01 T1=1800.3	OPT f=1496382247 TT=60.3 T1=60.26	No data	No data	SAT (TO) f=1496382463 TT=1802.17 T1=222.05	SAT (TO) f=1496382367 TT=1800.07 T1=891.91	? (TO) TT=1800.07
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f10-DCTotalLoss.seq-B-3-combined-irabcde.opb	OPT f=192984614615 TT=83.985 T1=83.98	No data	No data	No data	SAT (TO) f=196869804943 TT=1800.06 T1=1800.4	OPT f=192984614615 TT=83.985 T1=83.98	No data	No data	SAT (TO) f=196352557079 TT=1800.05 T1=65.07	SAT (TO) f=203524897411 TT=1800.07 T1=1228.25	? (MO) TT=1124.33
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-2-1-irabcde.opb	SAT f=42972848395 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=50248739776 TT=1800.03 T1=1800.4	SAT (TO) f=42972848395 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=48177341470 TT=1800.05 T1=694.24	SAT (TO) f=58228321799 TT=1800.06 T1=1.23	? (exit code) TT=660.628
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-2-1-irEDCBA.opb	SAT f=43270620924 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=62686928884 TT=1800.01 T1=1800.3	SAT (TO) f=43270620924 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=48471406683 TT=1800.04 T1=420.83	SAT (TO) f=60606608806 TT=1800.02 T1=0.77	? (MO) TT=687.234
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-2-2-irabcde.opb	SAT f=40885482073 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=48819919952 TT=1800.01 T1=1800.3	SAT (TO) f=40885482073 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=49558799370 TT=1800.18 T1=849.74	SAT (TO) f=60261722141 TT=1800.62 T1=0.84	? (TO) TT=1800.4
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-2-combined-irabcde.opb	SAT f=42600796634 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=47798044961 TT=1800.08 T1=1800.4	SAT (TO) f=42600796634 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=50245043476 TT=1800.72 T1=358.68	SAT (TO) f=60261672857 TT=1800.67 T1=0.93	? (MO) TT=740.928
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-2-combined-irEDCBA.opb	SAT f=42577186070 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=57832856610 TT=1800.02 T1=1800.3	SAT (TO) f=42577186070 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=51245164747 TT=1800.11 T1=162.41	SAT (TO) f=59913170280 TT=1800.05 T1=1.09	? (MO) TT=715.498
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-3-1-EDCBAir.opb	OPT f=-107608689 TT=91.812 T1=91.82	No data	No data	No data	OPT f=-107608689 TT=369.596 T1=369.63	OPT f=-107608689 TT=91.812 T1=91.82	No data	No data	SAT (TO) f=-107608601 TT=1800.12 T1=305.05	SAT (TO) f=-107608561 TT=1800.06 T1=73.62	? (TO) TT=1800.19
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-A-3-combined-irEDCBA.opb	OPT f=192984207671 TT=52.88 T1=52.87	No data	No data	No data	? (TO) TT=1800.11	OPT f=192984207671 TT=52.88 T1=52.87	No data	No data	SAT (TO) f=198531740431 TT=1800.1 T1=165.54	SAT (TO) f=211291013687 TT=1800.89 T1=3.78	? (MO) TT=914.443
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-B-2-2-irEDCBA.opb	SAT f=44657300768 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=54018788171 TT=1800.11 T1=1800.4	SAT (TO) f=44657300768 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=50551620957 TT=1800.67 T1=221.15	SAT (TO) f=60259491041 TT=1800.05 T1=0.81	? (MO) TT=691.715
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-B-3-1-abcdeir.opb	OPT f=3186349263 TT=77.293 T1=77.3	No data	No data	No data	SAT (TO) f=11348419359 TT=1800.02 T1=1800.3	OPT f=3186349263 TT=77.293 T1=77.3	No data	No data	SAT (TO) f=3385169095 TT=1800.01 T1=274.85	SAT (TO) f=3782808431 TT=1800.01 T1=1.2	? (TO) TT=1800
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-B-3-2-irabcde.opb	OPT f=192984614615 TT=30.434 T1=30.43	No data	No data	No data	SAT (TO) f=193541638663 TT=1800.09 T1=1800.4	OPT f=192984614615 TT=30.434 T1=30.43	No data	No data	SAT (TO) f=194678990099 TT=1800.38 T1=888.64	No Cert. TT=1800.06	? (MO) TT=1035.93
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-B-3-2-irEDCBA.opb	OPT f=192983748815 TT=33.301 T1=33.29	No data	No data	No data	SAT (TO) f=196867168915 TT=1800.11 T1=1800.4	OPT f=192983748815 TT=33.301 T1=33.29	No data	No data	? (TO) TT=1828.6	SAT (TO) f=211845457075 TT=1800.85 T1=1.07	? (MO) TT=641.728
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f11-DCTotalLoss.seq-B-3-combined-irEDCBA.opb	OPT f=192983319911 TT=39.554 T1=39.55	No data	No data	No data	SAT (TO) f=196312468163 TT=1800.1 T1=1800.4	OPT f=192983319911 TT=39.554 T1=39.55	No data	No data	SAT (TO) f=197421978171 TT=1800.51 T1=839.82	SAT (TO) f=209071117935 TT=1800.08 T1=53.88	? (exit code) TT=620.387
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-A-2-1-abcdeir.opb	OPT f=70405940399 TT=18.122 T1=18.11	No data	No data	No data	? (TO) TT=1800.02	OPT f=70405940399 TT=18.122 T1=18.11	No data	No data	SAT (TO) f=70405940531 TT=1800.2 T1=308.24	SAT (TO) f=82811314745 TT=1800.09 T1=0.62	? (TO) TT=1800.06
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-A-2-1-irabcde.opb	SAT f=62387332847 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=69040902839 TT=1800.09 T1=1800.4	SAT (TO) f=62387332847 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=66129984449 TT=1800.1 T1=119.52	SAT (TO) f=76949317397 TT=1800 T1=0.79	? (MO) TT=1098.13
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-A-2-1-irEDCBA.opb	SAT f=64836588815 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=73157858183 TT=1800.01 T1=1800.3	SAT (TO) f=64836588815 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=66084779825 TT=1800.04 T1=279.31	SAT (TO) f=76486366751 TT=1800.1 T1=31.64	? (MO) TT=1227.17
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-A-2-combined-irabcde.opb	SAT f=66506325287 TT=1800.24 T1=624.7	No data	No data	No data	SAT (TO) f=69002658455 TT=1800.01 T1=1800.3	SAT (TO) f=73199766035 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=66506325287 TT=1800.24 T1=624.7	SAT (TO) f=76907918837 TT=1800.09 T1=0.78	? (MO) TT=1247.58
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-A-2-combined-irEDCBA.opb	SAT f=64836592379 TT=1800.02 T1=375.13	No data	No data	No data	SAT (TO) f=77318507411 TT=1800.02 T1=1800.3	SAT (TO) f=66500854151 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=64836592379 TT=1800.02 T1=375.13	SAT (TO) f=77318494235 TT=1800.01 T1=8.25	? (exit code) TT=1312.78
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-B-2-1-irabcde.opb	SAT f=63597122513 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=71495044907 TT=1800.08 T1=1800.4	SAT (TO) f=63597122513 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=68582397581 TT=1800.02 T1=267.47	SAT (TO) f=76903615145 TT=1800.08 T1=1.02	? (MO) TT=1007.51
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f16-DCdoubleLoss.seq-B-2-1-irEDCBA.opb	SAT f=64420181309 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=71909427845 TT=1800.06 T1=1800.4	SAT (TO) f=64420181309 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=70661390087 TT=1800.12 T1=61.77	SAT (TO) f=76901990285 TT=1800.06 T1=0.81	? (MO) TT=668.238
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f17-DCdoubleLoss.seq-A-2-2-irabcde.opb	SAT f=64883813867 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=68586594713 TT=1800 T1=1800.3	SAT (TO) f=64883813867 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=66549892343 TT=1800.18 T1=820.64	SAT (TO) f=74827550843 TT=1800 T1=0.58	? (MO) TT=746.898
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f17-DCdoubleLoss.seq-A-2-2-irEDCBA.opb	SAT f=61092018557 TT=1800.02 T1=156.13	No data	No data	No data	SAT (TO) f=73157867651 TT=1800.02 T1=1800.3	SAT (TO) f=61092019169 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=61092018557 TT=1800.02 T1=156.13	SAT (TO) f=74822117111 TT=1800.06 T1=0.64	? (exit code) TT=672.133
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f17-DCdoubleLoss.seq-B-2-2-irabcde.opb	SAT f=63187917239 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=72742155881 TT=1800.1 T1=1800.4	SAT (TO) f=63187917239 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=67342739147 TT=1800.11 T1=31.71	SAT (TO) f=74822276123 TT=1800.33 T1=0.57	? (MO) TT=1114.23
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f17-DCdoubleLoss.seq-B-2-2-irEDCBA.opb	SAT f=65668459871 TT=1800.12 T1=62.57	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=69412843037 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=65668459871 TT=1800.12 T1=62.57	SAT (TO) f=74821667435 TT=1800.07 T1=0.71	? (MO) TT=634.553
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f17-DCdoubleLoss.seq-B-2-combined-irabcde.opb	SAT f=60303561593 TT=1800.33 T1=152.49	No data	No data	No data	SAT (TO) f=73990199255 TT=1800.1 T1=1800.4	SAT (TO) f=63178701131 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=60303561593 TT=1800.33 T1=152.49	SAT (TO) f=75654404939 TT=1800.03 T1=362.71	? (MO) TT=1004.68
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f17-DCdoubleLoss.seq-B-2-combined-irEDCBA.opb	SAT f=67748633465 TT=1800.26 T1=22.29	No data	No data	No data	SAT (TO) f=72325679435 TT=1800.08 T1=1800.4	SAT (TO) f=69413241809 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=67748633465 TT=1800.26 T1=22.29	SAT (TO) f=77317903511 TT=1800.07 T1=0.67	? (exit code) TT=599.592
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-A-2-1-irabcde.opb	OPT f=4676728603 TT=1.776 T1=1.77	No data	No data	No data	OPT f=4676728603 TT=697.483 T1=697.61	OPT f=4676728603 TT=1.776 T1=1.77	No data	No data	SAT (TO) f=4676757433 TT=1800.06 T1=90.61	SAT (TO) f=4820796918 TT=1800.03 T1=45.81	? (MO) TT=1183.38
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-A-2-2-irabcde.opb	OPT f=4670876113 TT=2.908 T1=2.9	No data	No data	No data	OPT f=4670876113 TT=150.275 T1=150.29	OPT f=4670876113 TT=2.908 T1=2.9	No data	No data	SAT (TO) f=5255077623 TT=1800.12 T1=845.45	SAT (TO) f=5682842748 TT=1800.05 T1=1699.21	? (MO) TT=1021.59
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-B-2-1-irabcde.opb	OPT f=4666879903 TT=2.355 T1=2.35	No data	No data	No data	OPT f=4666879903 TT=1479.51 T1=1479.77	OPT f=4666879903 TT=2.355 T1=2.35	No data	No data	SAT (TO) f=4666939423 TT=1800.03 T1=46.21	SAT (TO) f=4810055418 TT=1800.02 T1=16.26	? (MO) TT=1172.15
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-B-2-2-irabcde.opb	OPT f=4666691113 TT=2.759 T1=2.75	No data	No data	No data	OPT f=4666691113 TT=1749.79 T1=1750.07	OPT f=4666691113 TT=2.759 T1=2.75	No data	No data	SAT (TO) f=5246828523 TT=1800.03 T1=196.15	SAT (TO) f=5811856223 TT=1800.84 T1=5.7	? (MO) TT=1102.02
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-B-2-2-irEDCBA.opb	OPT f=4666220533 TT=2.611 T1=2.6	No data	No data	No data	OPT f=4666220533 TT=1254.58 T1=1254.79	OPT f=4666220533 TT=2.611 T1=2.6	No data	No data	SAT (TO) f=5239006593 TT=1800.04 T1=722.76	SAT (TO) f=6842036009 TT=1800.01 T1=0.54	? (MO) TT=987.684
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-B-2-combined-irabcde.opb	OPT f=4666691113 TT=2.78 T1=2.77	No data	No data	No data	OPT f=4666691113 TT=769.595 T1=769.7	OPT f=4666691113 TT=2.78 T1=2.77	No data	No data	SAT (TO) f=4666693903 TT=1800.02 T1=296.71	SAT (TO) f=4811938668 TT=1800 T1=68.14	? (exit code) TT=999.205
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f33-AC_ESS.seq-B-2-combined-irEDCBA.opb	OPT f=4665985243 TT=2.983 T1=2.97	No data	No data	No data	OPT f=4665985243 TT=802.835 T1=802.96	OPT f=4665985243 TT=2.983 T1=2.97	No data	No data	SAT (TO) f=4809130998 TT=1800.07 T1=28.59	SAT (TO) f=4952366033 TT=1800.03 T1=0.6	? (MO) TT=923.725
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f34-AC_ESS.seq-A-2-1-irEDCBA.opb	OPT f=4666533343 TT=4.272 T1=4.26	No data	No data	No data	OPT f=4666533343 TT=354.62 T1=354.69	OPT f=4666533343 TT=4.272 T1=4.26	No data	No data	SAT (TO) f=4666535263 TT=1800.17 T1=124.07	SAT (TO) f=5239119243 TT=1800.06 T1=0.71	? (MO) TT=1077.74
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f34-AC_ESS.seq-A-2-2-irEDCBA.opb	OPT f=4666540933 TT=4.332 T1=4.33	No data	No data	No data	OPT f=4666540933 TT=352.997 T1=353.06	OPT f=4666540933 TT=4.332 T1=4.33	No data	No data	SAT (TO) f=5095981768 TT=1800.13 T1=504.32	SAT (TO) f=6412919144 TT=1800.02 T1=60.3	? (MO) TT=962.217
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f34-AC_ESS.seq-A-2-combined-irabcde.opb	OPT f=4670876113 TT=3.321 T1=3.31	No data	No data	No data	OPT f=4670876113 TT=525.227 T1=525.28	OPT f=4670876113 TT=3.321 T1=3.31	No data	No data	SAT (TO) f=4681600873 TT=1800.09 T1=567.96	SAT (TO) f=4814079528 TT=1800.09 T1=6.08	? (MO) TT=1078.24
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f34-AC_ESS.seq-A-2-combined-irEDCBA.opb	OPT f=4666533343 TT=3.345 T1=3.34	No data	No data	No data	OPT f=4666533343 TT=364.283 T1=364.35	OPT f=4666533343 TT=3.345 T1=3.34	No data	No data	SAT (TO) f=4666534303 TT=1800.19 T1=14.04	SAT (TO) f=4952827733 TT=1800.01 T1=0.48	? (MO) TT=979.066
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f34-AC_ESS.seq-B-2-1-irEDCBA.opb	OPT f=4665985243 TT=6.809 T1=6.81	No data	No data	No data	OPT f=4665985243 TT=347.983 T1=348.05	OPT f=4665985243 TT=6.809 T1=6.81	No data	No data	SAT (TO) f=4666250353 TT=1800.18 T1=19.57	SAT (TO) f=5238657543 TT=1800.76 T1=0.91	? (MO) TT=899.857
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-A-2-1-irabcde.opb	OPT f=1682556057 TT=3.187 T1=3.18	No data	No data	No data	OPT f=1682556057 TT=309.306 T1=309.34	OPT f=1682556057 TT=3.187 T1=3.18	No data	No data	SAT (TO) f=1975428891 TT=1800.04 T1=12.5	SAT (TO) f=2056689063 TT=1800.02 T1=174.37	? (MO) TT=980.109
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-A-2-1-irEDCBA.opb	OPT f=1678808261 TT=6.38 T1=6.37	No data	No data	No data	OPT f=1678808261 TT=91.188 T1=91.21	OPT f=1678808261 TT=6.38 T1=6.37	No data	No data	SAT (TO) f=1693165748 TT=1800.19 T1=310.28	SAT (TO) f=2410604702 TT=1800.08 T1=0.6	? (MO) TT=947.942
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-A-2-2-irabcde.opb	OPT f=1679182245 TT=3.878 T1=3.87	No data	No data	No data	OPT f=1679182245 TT=313.976 T1=314.04	OPT f=1679182245 TT=3.878 T1=3.87	No data	No data	SAT (TO) f=2055892995 TT=1800.12 T1=379.3	SAT (TO) f=2195856621 TT=1800.04 T1=1290.39	? (exit code) TT=980.145
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-A-2-combined-irEDCBA.opb	OPT f=1678808261 TT=6.118 T1=6.11	No data	No data	No data	OPT f=1678808261 TT=306.199 T1=306.23	OPT f=1678808261 TT=6.118 T1=6.11	No data	No data	SAT (TO) f=1822304455 TT=1800.54 T1=494.11	SAT (TO) f=2410604702 TT=1800.02 T1=0.76	? (MO) TT=966.854
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-B-2-1-irabcde.opb	OPT f=1678960413 TT=6.447 T1=6.44	No data	No data	No data	SAT (TO) f=1678960413 TT=1800.04 T1=1800.4	OPT f=1678960413 TT=6.447 T1=6.44	No data	No data	SAT (TO) f=1753993818 TT=1800.15 T1=589.16	SAT (TO) f=1965958209 TT=1800.05 T1=276.31	? (MO) TT=921.952
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-B-2-1-irEDCBA.opb	OPT f=1678447953 TT=5.677 T1=5.67	No data	No data	No data	OPT f=1678447953 TT=394.814 T1=394.89	OPT f=1678447953 TT=5.677 T1=5.67	No data	No data	SAT (TO) f=1750407456 TT=1800.16 T1=524.72	SAT (TO) f=2410301178 TT=1800.01 T1=0.61	? (TO) TT=1800.25
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-B-2-2-irabcde.opb	OPT f=1678835457 TT=3.753 T1=3.75	No data	No data	No data	OPT f=1678835457 TT=1087.8 T1=1088	OPT f=1678835457 TT=3.753 T1=3.75	No data	No data	SAT (TO) f=1826211501 TT=1800.07 T1=620.09	SAT (TO) f=2342789001 TT=1800.01 T1=1028.56	? (MO) TT=947.861
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-B-2-2-irEDCBA.opb	OPT f=1678544829 TT=6.064 T1=6.06	No data	No data	No data	OPT f=1678544829 TT=693.615 T1=693.74	OPT f=1678544829 TT=6.064 T1=6.06	No data	No data	SAT (TO) f=1822205343 TT=1800.06 T1=523.17	SAT (TO) f=2553828156 TT=1800.82 T1=0.85	? (MO) TT=948.719
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-B-2-combined-irabcde.opb	OPT f=1678835457 TT=7.676 T1=7.67	No data	No data	No data	SAT (TO) f=1693185066 TT=1800.06 T1=1800.4	OPT f=1678835457 TT=7.676 T1=7.67	No data	No data	SAT (TO) f=1824638319 TT=1800.11 T1=832.76	SAT (TO) f=2267143452 TT=1800.01 T1=35.93	? (MO) TT=1057.08
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f37-AC_TotalLoss.seq-B-2-combined-irEDCBA.opb	OPT f=1678447953 TT=5.875 T1=5.87	No data	No data	No data	OPT f=1678447953 TT=906.634 T1=906.82	OPT f=1678447953 TT=5.875 T1=5.87	No data	No data	SAT (TO) f=1750365908 TT=1800.12 T1=852.1	SAT (TO) f=2410301178 TT=1800.68 T1=0.78	? (MO) TT=994.897
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f38-AC_TotalLoss.seq-A-2-2-irEDCBA.opb	OPT f=1678811849 TT=4.501 T1=4.49	No data	No data	No data	OPT f=1678811849 TT=335.331 T1=335.4	OPT f=1678811849 TT=4.501 T1=4.49	No data	No data	SAT (TO) f=2123633634 TT=1800.02 T1=818.39	SAT (TO) f=2554095176 TT=1800.06 T1=0.72	? (MO) TT=973.898
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f38-AC_TotalLoss.seq-A-2-combined-irabcde.opb	OPT f=1679182245 TT=3.486 T1=3.48	No data	No data	No data	OPT f=1679182245 TT=376.712 T1=376.8	OPT f=1679182245 TT=3.486 T1=3.48	No data	No data	SAT (TO) f=1782316062 TT=1800.18 T1=814.9	SAT (TO) f=2138423085 TT=1800 T1=709.81	? (MO) TT=953.276
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f41-DC_DoubleLoss.seq-A-2-1-irabcde.opb	OPT f=35579842025 TT=412.048 T1=412.1	No data	No data	No data	SAT (TO) f=40314516025 TT=1800.01 T1=1800.3	OPT f=35579842025 TT=412.048 T1=412.1	No data	No data	SAT (TO) f=44106586825 TT=1800.03 T1=115.87	SAT (TO) f=53861952725 TT=1800.01 T1=11.32	? (MO) TT=666.309
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f41-DC_DoubleLoss.seq-A-2-2-irabcde.opb	OPT f=35558433925 TT=417.307 T1=417.36	No data	No data	No data	SAT (TO) f=41868680875 TT=1800.02 T1=1800.3	OPT f=35558433925 TT=417.307 T1=417.36	No data	No data	SAT (TO) f=44093342125 TT=1800.58 T1=773.58	SAT (TO) f=51630419225 TT=1800.06 T1=796.73	? (MO) TT=997.13
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f41-DC_DoubleLoss.seq-A-2-2-irEDCBA.opb	OPT f=35557296931 TT=256.685 T1=256.72	No data	No data	No data	SAT (TO) f=47532285689 TT=1800.02 T1=1800.3	OPT f=35557296931 TT=256.685 T1=256.72	No data	No data	SAT (TO) f=42490188953 TT=1800.52 T1=5.76	SAT (TO) f=52259253215 TT=1800.61 T1=0.67	? (MO) TT=685.202
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f41-DC_DoubleLoss.seq-A-2-combined-irabcde.opb	OPT f=35558433925 TT=209.952 T1=209.98	No data	No data	No data	SAT (TO) f=39970604625 TT=1800.01 T1=1800.3	OPT f=35558433925 TT=209.952 T1=209.98	No data	No data	SAT (TO) f=43461538575 TT=1800.09 T1=310.23	SAT (TO) f=53836379625 TT=1800.04 T1=0.61	? (MO) TT=713.234
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f41-DC_DoubleLoss.seq-B-2-1-irEDCBA.opb	OPT f=35556494225 TT=594.058 T1=594.14	No data	No data	No data	? (TO) TT=1800.02	OPT f=35556494225 TT=594.058 T1=594.14	No data	No data	SAT (TO) f=44695894727 TT=1800.03 T1=301.99	SAT (TO) f=55094801929 TT=1800.07 T1=0.95	? (MO) TT=747.254
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f41-DC_DoubleLoss.seq-B-2-combined-irabcde.opb	OPT f=35557341505 TT=21.045 T1=21.04	No data	No data	No data	SAT (TO) f=41545590905 TT=1800.02 T1=1800.3	OPT f=35557341505 TT=21.045 T1=21.04	No data	No data	SAT (TO) f=43471735685 TT=1800.12 T1=47.38	SAT (TO) f=51629044775 TT=1800.06 T1=1242.04	? (exit code) TT=678.984
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f42-DC_DoubleLoss.seq-A-2-1-irEDCBA.opb	OPT f=35557286085 TT=460.019 T1=460.09	No data	No data	No data	? (TO) TT=1800.02	OPT f=35557286085 TT=460.019 T1=460.09	No data	No data	SAT (TO) f=45011239293 TT=1800.02 T1=248.85	SAT (TO) f=55095427257 TT=1800.04 T1=0.98	? (MO) TT=666.451
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f42-DC_DoubleLoss.seq-A-2-combined-irEDCBA.opb	OPT f=35557286085 TT=76.694 T1=76.69	No data	No data	No data	SAT (TO) f=44380980125 TT=1800.01 T1=1800.3	OPT f=35557286085 TT=76.694 T1=76.69	No data	No data	SAT (TO) f=44696106887 TT=1800.11 T1=405.83	SAT (TO) f=52889510955 TT=1800.8 T1=19.85	? (MO) TT=703.531
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f42-DC_DoubleLoss.seq-B-2-1-irabcde.opb	OPT f=35557953165 TT=898.463 T1=898.6	No data	No data	No data	SAT (TO) f=41553254505 TT=1800.02 T1=1800.3	OPT f=35557953165 TT=898.463 T1=898.6	No data	No data	SAT (TO) f=44081509955 TT=1800.56 T1=849.33	SAT (TO) f=52896691925 TT=1800.04 T1=47.79	? (MO) TT=719.958
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f42-DC_DoubleLoss.seq-B-2-2-irabcde.opb	OPT f=35557341505 TT=427.321 T1=427.38	No data	No data	No data	SAT (TO) f=43440836145 TT=1800.02 T1=1800.3	OPT f=35557341505 TT=427.321 T1=427.38	No data	No data	SAT (TO) f=44405426975 TT=1800.14 T1=309.17	SAT (TO) f=50998782275 TT=1800.06 T1=1.21	? (MO) TT=1072.15
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f42-DC_DoubleLoss.seq-B-2-2-irEDCBA.opb	OPT f=35556873835 TT=377.363 T1=377.41	No data	No data	No data	SAT (TO) f=45956253161 TT=1800.02 T1=1800.3	OPT f=35556873835 TT=377.363 T1=377.41	No data	No data	SAT (TO) f=39968748395 TT=1800.19 T1=254.04	SAT (TO) f=52258831275 TT=1800 T1=0.68	? (MO) TT=678.997
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f42-DC_DoubleLoss.seq-B-2-combined-irEDCBA.opb	OPT f=35556494225 TT=22.071 T1=22.06	No data	No data	No data	SAT (TO) f=44695969527 TT=1800.02 T1=1800.3	OPT f=35556494225 TT=22.071 T1=22.06	No data	No data	SAT (TO) f=45956458861 TT=1800.13 T1=365.17	SAT (TO) f=53834320925 TT=1800.06 T1=1.23	? (MO) TT=638.027
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f43-DC_ESS.seq-A-2-1-abcdeir.opb	OPT f=48262096663 TT=19.331 T1=19.32	No data	No data	No data	SAT (TO) f=58320222229 TT=1800.02 T1=1800.3	OPT f=48262096663 TT=19.331 T1=19.32	No data	No data	SAT (TO) f=48262096823 TT=1800.75 T1=4.73	SAT (TO) f=64321288194 TT=1800.74 T1=1697.11	? (TO) TT=1800.05
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f43-DC_ESS.seq-A-2-1-irEDCBA.opb	SAT f=27668225055 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=43617336533 TT=1800.09 T1=1800.4	SAT (TO) f=27668225055 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=37029661878 TT=1800.54 T1=807.16	SAT (TO) f=45350927322 TT=1800.04 T1=0.97	? (exit code) TT=1276.09
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f43-DC_ESS.seq-A-2-2-irabcde.opb	SAT f=27009347357 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=34936243415 TT=1800.02 T1=1800.3	SAT (TO) f=27009347357 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=38102655537 TT=1800.09 T1=58.21	SAT (TO) f=46400224773 TT=1800.07 T1=0.66	? (MO) TT=1135.92
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f43-DC_ESS.seq-A-2-combined-irEDCBA.opb	SAT f=26974797077 TT=1800.02 T1=1800.3	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=26974797077 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=38069815833 TT=1800.16 T1=186.57	SAT (TO) f=42577171778 TT=1800.02 T1=1.12	? (exit code) TT=1247.02
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f43-DC_ESS.seq-B-2-1-irEDCBA.opb	SAT f=28707837822 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=39040424483 TT=1800.02 T1=1800.3	SAT (TO) f=28707837822 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=37722754696 TT=1800.19 T1=26.83	SAT (TO) f=45003466297 TT=1800.64 T1=1215.35	? (MO) TT=754.591
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-A-2-1-EDCBAir.opb	OPT f=-49329857 TT=29.641 T1=29.63	No data	No data	No data	OPT f=-49329857 TT=325.06 T1=325.1	OPT f=-49329857 TT=29.641 T1=29.63	No data	No data	SAT (TO) f=-49329771 TT=1800.13 T1=7.25	SAT (TO) f=-35253001 TT=1800.86 T1=113.66	? (TO) TT=1800.08
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-A-2-1-irabcde.opb	SAT f=26667605256 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=35266108072 TT=1800.02 T1=1800.3	SAT (TO) f=26667605256 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=37783091236 TT=1800.19 T1=830.26	SAT (TO) f=44348293647 TT=1800.08 T1=56.84	? (MO) TT=1384.82
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-A-2-2-irEDCBA.opb	SAT f=26974795889 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=45697656503 TT=1800.01 T1=1800.3	SAT (TO) f=26974795889 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=38693923650 TT=1800.05 T1=709.42	SAT (TO) f=46044370888 TT=1800.06 T1=135.4	? (MO) TT=1094.84
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-A-2-combined-irabcde.opb	SAT f=27700569147 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=35294199952 TT=1800.01 T1=1800.3	SAT (TO) f=27700569147 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=37427401763 TT=1800.04 T1=15.29	SAT (TO) f=41546147783 TT=1800.01 T1=83.34	? (exit code) TT=1274.91
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-B-2-1-irabcde.opb	SAT f=28729626282 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=41538506099 TT=1800.11 T1=1800.4	SAT (TO) f=28729626282 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=38790078463 TT=1800.09 T1=381.13	SAT (TO) f=43618313321 TT=1800.06 T1=78.26	? (MO) TT=1003.04
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-B-2-2-irabcde.opb	SAT f=36683199673 TT=1800.17 T1=5.17	No data	No data	No data	SAT (TO) f=40150394859 TT=1800.02 T1=1800.3	SAT (TO) f=38694755178 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=36683199673 TT=1800.17 T1=5.17	SAT (TO) f=43964315158 TT=1800.02 T1=1741.83	? (MO) TT=1016.5
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-B-2-2-irEDCBA.opb	SAT f=36613441752 TT=1800.05 T1=8.67	No data	No data	No data	SAT (TO) f=38069689869 TT=1800.09 T1=1800.4	SAT (TO) f=38693505762 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=36613441752 TT=1800.05 T1=8.67	SAT (TO) f=46390495845 TT=1800.08 T1=0.67	? (MO) TT=742.883
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-B-2-combined-irabcde.opb	SAT f=27687458271 TT=1800.02 T1=1800.3	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=27687458271 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=39124028364 TT=1800.12 T1=121.56	SAT (TO) f=41537276663 TT=1800.02 T1=122.13	? (exit code) TT=906.394
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f44-DC_ESS.seq-B-2-combined-irEDCBA.opb	SAT f=27668210979 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=41814405711 TT=1800.01 T1=1800.3	SAT (TO) f=27668210979 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=39040630691 TT=1800.12 T1=251.67	SAT (TO) f=42576530402 TT=1800.03 T1=1.31	? (MO) TT=873.93
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-A-2-1-irabcde.opb	OPT f=19661215700 TT=10.836 T1=10.83	No data	No data	No data	? (TO) TT=1800.01	OPT f=19661215700 TT=10.836 T1=10.83	No data	No data	SAT (TO) f=23630344325 TT=1800.34 T1=885.04	SAT (TO) f=27015777600 TT=1800.05 T1=1479.53	? (MO) TT=1184.8
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-A-2-1-irEDCBA.opb	OPT f=19643154288 TT=28.485 T1=28.48	No data	No data	No data	SAT (TO) f=28834487275 TT=1800.08 T1=1800.4	OPT f=19643154288 TT=28.485 T1=28.48	No data	No data	SAT (TO) f=22269261264 TT=1800.14 T1=585.36	SAT (TO) f=27784048585 TT=1800.07 T1=0.66	? (MO) TT=1318.24
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-A-2-2-irabcde.opb	OPT f=19647179650 TT=12.633 T1=12.63	No data	No data	No data	OPT f=19647179650 TT=388.173 T1=388.22	OPT f=19647179650 TT=12.633 T1=12.63	No data	No data	SAT (TO) f=23614350725 TT=1800.03 T1=730.68	SAT (TO) f=33040632625 TT=1800 T1=0.62	? (MO) TT=1064.58
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-A-2-combined-irabcde.opb	OPT f=19647179650 TT=7.035 T1=7.03	No data	No data	No data	OPT f=19647179650 TT=1026.14 T1=1026.29	OPT f=19647179650 TT=7.035 T1=7.03	No data	No data	SAT (TO) f=20174147700 TT=1800.15 T1=746.79	SAT (TO) f=31727585750 TT=1800.05 T1=223.6	? (MO) TT=1227.81
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-A-2-combined-irEDCBA.opb	OPT f=19643154288 TT=6.639 T1=6.63	No data	No data	No data	SAT (TO) f=26471006436 TT=1800.11 T1=1800.4	OPT f=19643154288 TT=6.639 T1=6.63	No data	No data	SAT (TO) f=22531861085 TT=1800.03 T1=552.27	SAT (TO) f=31985800999 TT=1800.06 T1=3.33	? (MO) TT=1201.66
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-B-2-1-irabcde.opb	OPT f=19643696520 TT=12.467 T1=12.46	No data	No data	No data	SAT (TO) f=23584899415 TT=1800.02 T1=1800.3	OPT f=19643696520 TT=12.467 T1=12.46	No data	No data	SAT (TO) f=21775999420 TT=1800.19 T1=86.88	SAT (TO) f=26996803050 TT=1800 T1=1633.96	? (exit code) TT=958.518
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f46-DC_Side1.seq-B-2-1-irEDCBA.opb	OPT f=19642237580 TT=13.763 T1=13.75	No data	No data	No data	SAT (TO) f=23582015263 TT=1800.06 T1=1800.4	OPT f=19642237580 TT=13.763 T1=13.75	No data	No data	SAT (TO) f=24106852805 TT=1800.17 T1=35.71	SAT (TO) f=27783256725 TT=1800.84 T1=0.68	? (MO) TT=711.202
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f47-DC_Side1.seq-A-2-2-irEDCBA.opb	OPT f=19643167616 TT=12.221 T1=12.21	No data	No data	No data	SAT (TO) f=26471011298 TT=1800.09 T1=1800.4	OPT f=19643167616 TT=12.221 T1=12.21	No data	No data	SAT (TO) f=24632745775 TT=1800.15 T1=34.71	SAT (TO) f=32248417616 TT=1800.86 T1=1.53	? (MO) TT=1010.34
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f47-DC_Side1.seq-B-2-1-EDCBAir.opb	OPT f=-1593213266 TT=3.151 T1=3.14	No data	No data	No data	OPT f=-1593213266 TT=853.992 T1=854.12	OPT f=-1593213266 TT=3.151 T1=3.14	No data	No data	OPT f=-1593213266 TT=99.238 T1=20.26	OPT f=-1593213266 TT=25.813 T1=8.54	? (TO) TT=1800.21
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f47-DC_Side1.seq-B-2-2-irabcde.opb	OPT f=19643295490 TT=5.011 T1=5	No data	No data	No data	SAT (TO) f=23845053820 TT=1800.11 T1=1800.4	OPT f=19643295490 TT=5.011 T1=5	No data	No data	SAT (TO) f=23057228075 TT=1800.07 T1=437.59	SAT (TO) f=31198118700 TT=1800.79 T1=385.79	? (MO) TT=1033.28
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f47-DC_Side1.seq-B-2-2-irEDCBA.opb	OPT f=19642704060 TT=27.093 T1=27.09	No data	No data	No data	SAT (TO) f=24107052725 TT=1800.1 T1=1800.4	OPT f=19642704060 TT=27.093 T1=27.09	No data	No data	SAT (TO) f=23844456440 TT=1800.17 T1=372.93	SAT (TO) f=33035782185 TT=1800.05 T1=0.64	? (MO) TT=698.57
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f47-DC_Side1.seq-B-2-combined-irabcde.opb	OPT f=19643295490 TT=5.06 T1=5.05	No data	No data	No data	SAT (TO) f=24660031795 TT=1800.08 T1=1800.4	OPT f=19643295490 TT=5.06 T1=5.05	No data	No data	SAT (TO) f=19643295490 TT=1800.05 T1=383.9	SAT (TO) f=28572024950 TT=1800.76 T1=227.6	? (MO) TT=1019.27
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f47-DC_Side1.seq-B-2-combined-irEDCBA.opb	OPT f=19642237580 TT=5.916 T1=5.91	No data	No data	No data	SAT (TO) f=25419939154 TT=1800.08 T1=1800.4	OPT f=19642237580 TT=5.916 T1=5.91	No data	No data	SAT (TO) f=19904932635 TT=1800.15 T1=50.84	SAT (TO) f=31985092405 TT=1800 T1=0.62	? (MO) TT=699.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-A-2-2-irabcde.opb	SAT f=16065942344 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=19687767796 TT=1800.02 T1=1800.3	SAT (TO) f=16065942344 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=22918871028 TT=1800.17 T1=264.07	SAT (TO) f=26535584648 TT=1800.08 T1=862.58	? (MO) TT=680.961
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-A-2-combined-irabcde.opb	SAT f=18148189656 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=18825753624 TT=1800.02 T1=1800.3	SAT (TO) f=18148189656 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=24070282864 TT=1800.03 T1=494.24	SAT (TO) f=29034532968 TT=1800.05 T1=1.62	? (exit code) TT=680.089
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-B-2-1-irabcde.opb	SAT f=20401293020 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=20401293020 TT=1800.03 T1=1800.3	SAT (TO) f=23586882288 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=22902842136 TT=1800.02 T1=380.53	SAT (TO) f=28809566188 TT=1800.08 T1=360.06	? (exit code) TT=651.328
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-B-2-2-irabcde.opb	SAT f=19520026416 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=19520026416 TT=1800.02 T1=1800.3	SAT (TO) f=19906929348 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=23366280088 TT=1800.03 T1=728.71	SAT (TO) f=25852794404 TT=1800.02 T1=132.82	? (exit code) TT=628.49
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-B-2-2-irEDCBA.opb	SAT f=19264418311 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=19264418311 TT=1800.02 T1=1800.3	SAT (TO) f=20627444731 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=23535231314 TT=1800.05 T1=200.16	SAT (TO) f=28124012458 TT=1800 T1=0.74	? (MO) TT=792.457
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-B-2-combined-irabcde.opb	SAT f=16998528140 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=19037518952 TT=1800.02 T1=1800.3	SAT (TO) f=16998528140 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=24227028644 TT=1800.12 T1=544.51	SAT (TO) f=28578919844 TT=1800 T1=1221.27	? (MO) TT=757.695
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f48-DC_TotalLoss.seq-B-2-combined-irEDCBA.opb	SAT f=18355740917 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=18355740917 TT=1800.02 T1=1800.3	SAT (TO) f=19718838353 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=21263533044 TT=1800.06 T1=302.3	SAT (TO) f=30395982417 TT=1800.06 T1=0.82	? (MO) TT=782.376
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f49-DC_TotalLoss.seq-A-2-1-irabcde.opb	SAT f=18155704812 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=18155704812 TT=1800.02 T1=1800.3	SAT (TO) f=23146734812 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=23106716404 TT=1800.82 T1=222.17	SAT (TO) f=29737503504 TT=1800.05 T1=0.94	? (exit code) TT=667.098
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f49-DC_TotalLoss.seq-A-2-1-irEDCBA.opb	SAT f=15402594612 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=19264609249 TT=1800.02 T1=1800.3	SAT (TO) f=15402594612 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=23762719624 TT=1800.15 T1=420.63	SAT (TO) f=29714748783 TT=1800.01 T1=0.66	? (MO) TT=866.472
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f49-DC_TotalLoss.seq-A-2-2-irEDCBA.opb	SAT f=19037435462 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=19037435462 TT=1800.02 T1=1800.3	SAT (TO) f=19718969132 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=23580978951 TT=1800.19 T1=33.32	SAT (TO) f=28124512309 TT=1800.09 T1=0.74	? (MO) TT=771.079
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f49-DC_TotalLoss.seq-A-2-combined-irEDCBA.opb	SAT f=15856962250 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=20627677447 TT=1800.02 T1=1800.3	SAT (TO) f=15856962250 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=23081191531 TT=1800.14 T1=341.17	SAT (TO) f=30396281298 TT=1800.01 T1=2.39	? (MO) TT=674.993
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f49-DC_TotalLoss.seq-B-2-1-irEDCBA.opb	SAT f=15629430380 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=18128416914 TT=1800.02 T1=1800.3	SAT (TO) f=15629430380 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=24943847367 TT=1800.09 T1=40.81	SAT (TO) f=29714137854 TT=1800.02 T1=0.71	? (MO) TT=669.223
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-1-abcdeir.opb	OPT f=87859328 TT=39.567 T1=3.2	No data	No data	No data	OPT f=87859328 TT=39.567 T1=39.57	OPT f=87859328 TT=181.667 T1=181.69	No data	No data	SAT (TO) f=87859328 TT=1800.13 T1=103.62	OPT f=87859328 TT=1409.01 T1=3.2	? (TO) TT=1800.26
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-1-irabcde.opb	OPT f=134417408 TT=597.077 T1=293.3	No data	No data	No data	OPT f=134417408 TT=597.077 T1=597.17	SAT (TO) f=134417408 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=134417408 TT=1800 T1=293.3	SAT (TO) f=134417408 TT=1800.03 T1=713.93	? (MO) TT=753.857
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-1-irEDCBA.opb	OPT f=134214653 TT=214.725 T1=214.76	No data	No data	No data	OPT f=134214653 TT=214.725 T1=214.76	SAT (TO) f=134214653 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=134214653 TT=1800.59 T1=850.76	SAT (TO) f=149943293 TT=1800.78 T1=186.55	? (TO) TT=1800.21
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-2-irabcde.opb	OPT f=134248448 TT=288.303 T1=231.34	No data	No data	No data	OPT f=134248448 TT=288.303 T1=288.34	SAT (TO) f=134248448 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=134248448 TT=1800.16 T1=231.34	SAT (TO) f=134248448 TT=1800 T1=1106.43	? (MO) TT=787.253
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-2-irEDCBA.opb	OPT f=134215568 TT=390.677 T1=390.73	No data	No data	No data	OPT f=134215568 TT=390.677 T1=390.73	OPT f=134215568 TT=1366.75 T1=1366.95	No data	No data	SAT (TO) f=139458703 TT=1800.15 T1=676.51	SAT (TO) f=160429968 TT=1800.07 T1=60.41	? (TO) TT=1800.32
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-combined-EDCBAir.opb	OPT f=-1352872 TT=42.125 T1=2.98	No data	No data	No data	OPT f=-1352872 TT=42.125 T1=42.13	OPT f=-1352872 TT=142.428 T1=142.44	No data	No data	SAT (TO) f=-1352872 TT=1800.14 T1=143.9	OPT f=-1352872 TT=1225.8 T1=2.98	? (TO) TT=1800.16
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-combined-irabcde.opb	OPT f=134248448 TT=313.328 T1=39.68	No data	No data	No data	OPT f=134248448 TT=313.328 T1=313.38	SAT (TO) f=134248448 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=134248448 TT=1800.05 T1=627.63	SAT (TO) f=134248448 TT=1800.59 T1=39.68	? (MO) TT=747.205
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-A-3-combined-irEDCBA.opb	OPT f=134214653 TT=77.515 T1=77.53	No data	No data	No data	OPT f=134214653 TT=77.515 T1=77.53	OPT f=134214653 TT=1533.66 T1=1533.89	No data	No data	SAT (TO) f=139457533 TT=1800.03 T1=604.23	SAT (TO) f=192935149 TT=1800.72 T1=89.02	? (TO) TT=1800.22
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-1-irabcde.opb	OPT f=134230208 TT=294.985 T1=55.88	No data	No data	No data	OPT f=134230208 TT=294.985 T1=295.03	SAT (TO) f=134230208 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=139543888 TT=1800.88 T1=1147.36	SAT (TO) f=134230208 TT=1800.01 T1=55.88	? (MO) TT=734.494
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-1-irEDCBA.opb	OPT f=134168528 TT=276.867 T1=276.9	No data	No data	No data	OPT f=134168528 TT=276.867 T1=276.9	SAT (TO) f=134168528 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=134201213 TT=1800.02 T1=505.63	SAT (TO) f=165625808 TT=1800.01 T1=121.37	? (TO) TT=1800.59
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-2-irabcde.opb	OPT f=134219648 TT=124.842 T1=124.86	No data	No data	No data	OPT f=134219648 TT=124.842 T1=124.86	SAT (TO) f=134219648 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=139920208 TT=1800.19 T1=602.99	SAT (TO) f=134219648 TT=1800.06 T1=1426.94	? (MO) TT=732.073
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-2-irEDCBA.opb	OPT f=134183168 TT=322.01 T1=322.05	No data	No data	No data	OPT f=134183168 TT=322.01 T1=322.05	SAT (TO) f=134183168 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=139426303 TT=1800.04 T1=816.44	SAT (TO) f=149911808 TT=1800.09 T1=70.21	? (MO) TT=774.186
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-combined-EDCBAir.opb	OPT f=-21647872 TT=173.884 T1=2.5	No data	No data	No data	OPT f=-21647872 TT=173.884 T1=173.9	OPT f=-21647872 TT=210.325 T1=210.35	No data	No data	SAT (TO) f=-21647872 TT=1800.09 T1=10.09	OPT f=-21647872 TT=1126.32 T1=2.5	? (TO) TT=1800.1
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-combined-irabcde.opb	OPT f=134219648 TT=249.716 T1=249.75	No data	No data	No data	OPT f=134219648 TT=249.716 T1=249.75	SAT (TO) f=134219648 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=134219648 TT=1800.15 T1=683.25	SAT (TO) f=134219648 TT=1800.03 T1=891.15	? (MO) TT=657.573
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f4-DataDisplay_2_order9.seq-B-3-combined-irEDCBA.opb	OPT f=134168528 TT=405.515 T1=405.58	No data	No data	No data	OPT f=134168528 TT=405.515 T1=405.58	OPT f=134168528 TT=1568.94 T1=1569.18	No data	No data	SAT (TO) f=144661488 TT=1800.09 T1=883.41	SAT (TO) f=192892864 TT=1800.03 T1=1.5	? (MO) TT=767.074
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f50-DC_side2.seq-A-2-1-irabcde.opb	OPT f=22549918825 TT=48.243 T1=48.24	No data	No data	No data	OPT f=22549918825 TT=976.696 T1=976.85	OPT f=22549918825 TT=48.243 T1=48.24	No data	No data	SAT (TO) f=23874960900 TT=1800.13 T1=459.51	SAT (TO) f=36472713900 TT=1800.02 T1=824.03	? (exit code) TT=1128.56
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f50-DC_side2.seq-A-2-1-irEDCBA.opb	OPT f=22531857413 TT=33.442 T1=33.44	No data	No data	No data	SAT (TO) f=24895347908 TT=1800.06 T1=1800.4	OPT f=22531857413 TT=33.442 T1=33.44	No data	No data	SAT (TO) f=23844916256 TT=1800.06 T1=62.23	SAT (TO) f=36450159184 TT=1800.06 T1=387.5	? (exit code) TT=1071.25
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f50-DC_side2.seq-A-2-combined-irabcde.opb	OPT f=22534425025 TT=24.559 T1=24.55	No data	No data	No data	OPT f=22534425025 TT=1355.67 T1=1355.89	OPT f=22534425025 TT=24.559 T1=24.55	No data	No data	SAT (TO) f=23588152875 TT=1800.17 T1=277.81	SAT (TO) f=28837383225 TT=1800 T1=194.7	? (exit code) TT=1124.93
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f50-DC_side2.seq-A-2-combined-irEDCBA.opb	OPT f=22531857413 TT=17.536 T1=17.53	No data	No data	No data	SAT (TO) f=27784062967 TT=1800.06 T1=1800.4	OPT f=22531857413 TT=17.536 T1=17.53	No data	No data	SAT (TO) f=25420580666 TT=1800.35 T1=887.13	SAT (TO) f=31197969236 TT=1800.08 T1=0.62	? (MO) TT=1193.61
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f50-DC_side2.seq-B-2-combined-irabcde.opb	OPT f=22531956965 TT=25.438 T1=25.44	No data	No data	No data	SAT (TO) f=23582402795 TT=1800.11 T1=1800.4	OPT f=22531956965 TT=25.438 T1=25.44	No data	No data	SAT (TO) f=27784155175 TT=1800.16 T1=48.47	SAT (TO) f=28572309360 TT=1800.01 T1=55.97	? (MO) TT=1054.8
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f50-DC_side2.seq-B-2-combined-irEDCBA.opb	OPT f=22530940705 TT=28.028 T1=28.02	No data	No data	No data	SAT (TO) f=24369632520 TT=1800.08 T1=1800.4	OPT f=22530940705 TT=28.028 T1=28.02	No data	No data	SAT (TO) f=25945161474 TT=1800.14 T1=752.14	SAT (TO) f=30671874170 TT=1800.02 T1=1018.3	? (MO) TT=735.359
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f51-DC_side2.seq-A-2-2-irabcde.opb	OPT f=22534425025 TT=40.329 T1=40.33	No data	No data	No data	OPT f=22534425025 TT=916.503 T1=916.65	OPT f=22534425025 TT=40.329 T1=40.33	No data	No data	SAT (TO) f=25185550425 TT=1800.14 T1=36.74	SAT (TO) f=37503534250 TT=1800.05 T1=0.61	? (exit code) TT=923.235
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f51-DC_side2.seq-A-2-2-irEDCBA.opb	OPT f=22531870741 TT=86.909 T1=86.91	No data	No data	No data	SAT (TO) f=28309277093 TT=1800.1 T1=1800.4	OPT f=22531870741 TT=86.909 T1=86.91	No data	No data	SAT (TO) f=25945792616 TT=1800.89 T1=62.48	SAT (TO) f=37763214423 TT=1800.09 T1=0.6	? (MO) TT=966.566
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f51-DC_side2.seq-B-2-1-irabcde.opb	OPT f=22532399645 TT=35.946 T1=35.94	No data	No data	No data	SAT (TO) f=24900773730 TT=1800.01 T1=1800.3	OPT f=22532399645 TT=35.946 T1=35.94	No data	No data	SAT (TO) f=25692894185 TT=1800.04 T1=319.78	SAT (TO) f=35674798145 TT=1800.08 T1=1720.45	? (MO) TT=1006.12
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f51-DC_side2.seq-B-2-1-irEDCBA.opb	OPT f=22530940705 TT=29.614 T1=29.61	No data	No data	No data	SAT (TO) f=30147041116 TT=1800.08 T1=1800.4	OPT f=22530940705 TT=29.614 T1=29.61	No data	No data	SAT (TO) f=29097066696 TT=1800.51 T1=632.96	SAT (TO) f=38287760245 TT=1800.82 T1=0.89	? (MO) TT=780.048
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f51-DC_side2.seq-B-2-2-irabcde.opb	OPT f=22531956965 TT=60.995 T1=60.99	No data	No data	No data	SAT (TO) f=24373437970 TT=1800.02 T1=1800.3	OPT f=22531956965 TT=60.995 T1=60.99	No data	No data	SAT (TO) f=28052762150 TT=1800.06 T1=67.22	SAT (TO) f=36975483300 TT=1800.01 T1=4.77	? (MO) TT=1014.89
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f51-DC_side2.seq-B-2-2-irEDCBA.opb	OPT f=22531407185 TT=25.676 T1=25.67	No data	No data	No data	SAT (TO) f=26733161945 TT=1800.1 T1=1800.4	OPT f=22531407185 TT=25.676 T1=25.67	No data	No data	SAT (TO) f=26733617885 TT=1800.04 T1=655.94	SAT (TO) f=37762748555 TT=1800.04 T1=0.61	? (exit code) TT=658.413
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f52-ACTotalLoss.seq-A-2-1-irabcde.opb	OPT f=4213126827 TT=316.847 T1=316.89	No data	No data	No data	SAT (TO) f=4818029238 TT=1800.07 T1=1800.4	OPT f=4213126827 TT=316.847 T1=316.89	No data	No data	SAT (TO) f=4647436362 TT=1800.22 T1=787.06	SAT (TO) f=6117555903 TT=1800.01 T1=65.34	? (exit code) TT=814.401
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f52-ACTotalLoss.seq-A-2-1-irEDCBA.opb	OPT f=4208461167 TT=1625.38 T1=1625.64	No data	No data	No data	SAT (TO) f=4809676218 TT=1800.08 T1=1800.4	OPT f=4208461167 TT=1625.38 T1=1625.64	No data	No data	SAT (TO) f=4781058437 TT=1800.02 T1=688.03	SAT (TO) f=6241135688 TT=1800.01 T1=51.35	? (MO) TT=892.558
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f52-ACTotalLoss.seq-A-2-2-irabcde.opb	OPT f=4208917647 TT=419.79 T1=419.85	No data	No data	No data	SAT (TO) f=4209032967 TT=1800.06 T1=1800.4	OPT f=4208917647 TT=419.79 T1=419.85	No data	No data	SAT (TO) f=5223738452 TT=1800.07 T1=83.05	SAT (TO) f=7558874274 TT=1800.01 T1=2.01	? (exit code) TT=803.467
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f52-ACTotalLoss.seq-A-2-combined-irEDCBA.opb	OPT f=4208461167 TT=1076.03 T1=1076.2	No data	No data	No data	SAT (TO) f=4351618322 TT=1800.03 T1=1800.4	OPT f=4208461167 TT=1076.03 T1=1076.2	No data	No data	SAT (TO) f=4380252843 TT=1800.05 T1=124.54	SAT (TO) f=7243157893 TT=1800.06 T1=0.78	? (MO) TT=807.287
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f52-ACTotalLoss.seq-B-2-1-irEDCBA.opb	OPT f=4207740267 TT=961.901 T1=962.05	No data	No data	No data	SAT (TO) f=4809160008 TT=1800.09 T1=1800.4	OPT f=4207740267 TT=961.901 T1=962.05	No data	No data	SAT (TO) f=4923942712 TT=1800.12 T1=221.66	SAT (TO) f=6669996053 TT=1800.03 T1=1.68	? (TO) TT=1800.22
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f52-ACTotalLoss.seq-B-2-2-irabcde.opb	OPT f=4208499147 TT=919.511 T1=919.65	No data	No data	No data	SAT (TO) f=4952863583 TT=1800.03 T1=1800.4	OPT f=4208499147 TT=919.511 T1=919.65	No data	No data	SAT (TO) f=4964140763 TT=1800.03 T1=737.91	SAT (TO) f=7271830394 TT=1800.06 T1=81.91	? (MO) TT=969.232
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-1-abcdeir.opb	OPT f=2576583730017 TT=121.404 T1=121.41	No data	No data	No data	SAT (TO) f=4495470072334 TT=1800.02 T1=1800.3	OPT f=2576583730017 TT=121.404 T1=121.41	No data	No data	SAT (TO) f=2712098302148 TT=1800.01 T1=14.04	SAT (TO) f=2847612874338 TT=1800.02 T1=1.41	? (TO) TT=1800.49
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-1-EDCBAir.opb	OPT f=-1336666903 TT=114.646 T1=114.64	No data	No data	No data	OPT f=-1336666903 TT=1398.79 T1=1399	OPT f=-1336666903 TT=114.646 T1=114.64	No data	No data	SAT (TO) f=-1336666752 TT=1800.22 T1=276.5	SAT (TO) f=-1287172582 TT=1800.95 T1=1.38	? (TO) TT=1800.4
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-1-irabcde.opb	SAT f=3380782709420 TT=1800.07 T1=81.11	No data	No data	No data	SAT (TO) f=4346198497620 TT=1800.02 T1=1800.5	SAT (TO) f=4647681988492 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3380782709420 TT=1800.07 T1=81.11	SAT (TO) f=4825439968724 TT=1800.08 T1=0.98	? (exit code) TT=615.115
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-1-irEDCBA.opb	SAT f=3736807054514 TT=1800.7 T1=366.03	No data	No data	No data	SAT (TO) f=4768645179204 TT=1800.02 T1=1800.3	SAT (TO) f=4646599700420 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3736807054514 TT=1800.7 T1=366.03	SAT (TO) f=4768645015903 TT=1800.02 T1=525	? (MO) TT=693.557
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-2-irabcde.opb	SAT f=3536442965200 TT=1800.85 T1=122.81	No data	No data	No data	SAT (TO) f=4213922760580 TT=1800.06 T1=1800.4	SAT (TO) f=4902282519180 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=3536442965200 TT=1800.85 T1=122.81	SAT (TO) f=5223565977524 TT=1800.05 T1=1245.88	? (MO) TT=677.706
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-2-irEDCBA.opb	SAT f=3823348345481 TT=1800.04 T1=161.62	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=4901785547152 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=3823348345481 TT=1800.04 T1=161.62	SAT (TO) f=5234636450159 TT=1800.04 T1=59.05	? (MO) TT=608.975
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-combined-EDCBAir.opb	OPT f=-1336666903 TT=342.93 T1=342.97	No data	No data	No data	SAT (TO) f=-1336666857 TT=1800.06 T1=1800.4	OPT f=-1336666903 TT=342.93 T1=342.97	No data	No data	SAT (TO) f=-1336666687 TT=1800.17 T1=165.96	SAT (TO) f=-1336666667 TT=1800.04 T1=17.53	? (TO) TT=1800.75
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-combined-irabcde.opb	SAT f=3214539497708 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=4138417367184 TT=1800.12 T1=1800.4	SAT (TO) f=3214539497708 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3702395560116 TT=1800.12 T1=70.27	SAT (TO) f=4657722486388 TT=1800.06 T1=2.47	? (MO) TT=655.782
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-A-2-combined-irEDCBA.opb	SAT f=3792282240992 TT=1800.07 T1=30.12	No data	No data	No data	SAT (TO) f=4702074968731 TT=1800.02 T1=1800.3	SAT (TO) f=4879595475875 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=3792282240992 TT=1800.07 T1=30.12	SAT (TO) f=4679884761893 TT=1800.03 T1=50.77	? (MO) TT=832.697
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-1-abcdeir.opb	OPT f=34818700097 TT=272.778 T1=272.79	No data	No data	No data	SAT (TO) f=1978341834889 TT=1800.02 T1=1800.3	OPT f=34818700097 TT=272.778 T1=272.79	No data	No data	SAT (TO) f=34818700283 TT=1800.08 T1=4.53	SAT (TO) f=38481256418 TT=1800.05 T1=1.37	? (TO) TT=1800.47
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-1-EDCBAir.opb	OPT f=-98913427983 TT=144.089 T1=144.08	No data	No data	No data	SAT (TO) f=-64139931851 TT=1800.1 T1=1800.4	OPT f=-98913427983 TT=144.089 T1=144.08	No data	No data	SAT (TO) f=-98913427762 TT=1800.04 T1=866.83	SAT (TO) f=-95250871662 TT=1800.03 T1=1.3	? (TO) TT=1800.82
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-1-irabcde.opb	SAT f=3979585040724 TT=1800.18 T1=15.02	No data	No data	No data	SAT (TO) f=4209804507918 TT=1800.11 T1=1800.4	SAT (TO) f=4036503550572 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=3979585040724 TT=1800.18 T1=15.02	SAT (TO) f=4757563577208 TT=1800.05 T1=763.84	? (MO) TT=566.675
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-1-irEDCBA.opb	SAT f=3479394257955 TT=1800.12 T1=85.89	No data	No data	No data	SAT (TO) f=4491268015815 TT=1800.1 T1=1800.5	SAT (TO) f=4036356821740 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3479394257955 TT=1800.12 T1=85.89	SAT (TO) f=4813010771252 TT=1800.87 T1=1.26	? (MO) TT=786.029
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-2-irabcde.opb	SAT f=3659782692010 TT=1800.09 T1=144.67	No data	No data	No data	? (TO) TT=1800.1	SAT (TO) f=4269411760702 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3659782692010 TT=1800.09 T1=144.67	SAT (TO) f=5201351856178 TT=1800.03 T1=1230.99	? (exit code) TT=615.14
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-2-irEDCBA.opb	SAT f=3858846811047 TT=1800.55 T1=238.49	No data	No data	No data	SAT (TO) f=4125127027475 TT=1800.08 T1=1800.4	SAT (TO) f=4269356930475 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=3858846811047 TT=1800.55 T1=238.49	SAT (TO) f=5234623608291 TT=1800.07 T1=251.43	? (exit code) TT=639.213
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-combined-EDCBAir.opb	OPT f=-98913427983 TT=172.67 T1=172.67	No data	No data	No data	SAT (TO) f=-49904467296 TT=1800.02 T1=1800.3	OPT f=-98913427983 TT=172.67 T1=172.67	No data	No data	SAT (TO) f=-98913427697 TT=1800.01 T1=10.86	SAT (TO) f=-98913427747 TT=1800.66 T1=30.93	? (TO) TT=1800.4
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-combined-irabcde.opb	SAT f=3703522428194 TT=1800.38 T1=17.31	No data	No data	No data	SAT (TO) f=4345215058118 TT=1800.1 T1=1800.4	SAT (TO) f=4790959606638 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=3703522428194 TT=1800.38 T1=17.31	SAT (TO) f=4657695276514 TT=1800.01 T1=2.84	? (MO) TT=642.888
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f53-AC_FC1.seq-B-2-combined-irEDCBA.opb	SAT f=3601441923162 TT=1800.04 T1=64.63	No data	No data	No data	SAT (TO) f=4890684466055 TT=1800.01 T1=1800.3	SAT (TO) f=4790833778144 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3601441923162 TT=1800.04 T1=64.63	SAT (TO) f=4690965007184 TT=1800.06 T1=7.25	? (MO) TT=582.74
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-1-abcdeir.opb	SAT f=4202116363268 TT=1800.02 T1=1800.3	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=4202116363268 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=4202116363298 TT=1800.13 T1=10.61	SAT (TO) f=4202116363508 TT=1800.09 T1=8.67	? (TO) TT=1800.46
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-1-EDCBAir.opb	SAT f=-1905303592 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-1905303543 TT=1800.08 T1=1800.4	SAT (TO) f=-1905303592 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=-1905303417 TT=1800.14 T1=9.11	SAT (TO) f=-1905303352 TT=1800.02 T1=10.94	? (TO) TT=1800.52
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-1-irabcde.opb	SAT f=5963765120916 TT=1800.46 T1=751.81	No data	No data	No data	SAT (TO) f=6893389152176 TT=1800.08 T1=1800.5	SAT (TO) f=7115903861816 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=5963765120916 TT=1800.46 T1=751.81	SAT (TO) f=8284136859812 TT=1800.09 T1=24.53	? (MO) TT=681.368
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-1-irEDCBA.opb	SAT f=6424921346495 TT=1800 T1=473	No data	No data	No data	SAT (TO) f=8134032130648 TT=1800.02 T1=1800.3	SAT (TO) f=7114497307913 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=6424921346495 TT=1800 T1=473	SAT (TO) f=8282327801195 TT=1800.72 T1=208.79	? (MO) TT=686.663
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-2-EDCBAir.opb	OPT f=-1264934517 TT=3.244 T1=0.87	No data	No data	No data	OPT f=-1264934517 TT=1408.91 T1=1409.16	OPT f=-1264934517 TT=5.431 T1=5.41	No data	No data	OPT f=-1264934517 TT=10.082 T1=2.21	OPT f=-1264934517 TT=3.244 T1=0.87	? (TO) TT=1800.69
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-2-irabcde.opb	SAT f=5483896943016 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=7357041617368 TT=1800.07 T1=1800.4	SAT (TO) f=5483896943016 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=5926736886692 TT=1800.63 T1=331.19	SAT (TO) f=8208216074952 TT=1800.73 T1=1695.35	? (MO) TT=750.598
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-2-irEDCBA.opb	SAT f=5483242089444 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=6502776639209 TT=1800.02 T1=1800.3	SAT (TO) f=5483242089444 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6109792506181 TT=1813.29 T1=46.75	SAT (TO) f=8245253843119 TT=1800.04 T1=49.65	? (MO) TT=703.45
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-combined-EDCBAir.opb	SAT f=-1905303527 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-1905303527 TT=1800.08 T1=1800.4	SAT (TO) f=-1905303358 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=-1905303487 TT=1800.03 T1=30.18	SAT (TO) f=-1905303427 TT=1800.03 T1=691.42	? (TO) TT=1800.66
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-combined-irabcde.opb	SAT f=6077263692520 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=7317465531788 TT=1800.08 T1=1800.4	SAT (TO) f=6077263692520 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6871808137976 TT=1800 T1=80.49	SAT (TO) f=7837480044260 TT=1800.86 T1=1.08	? (MO) TT=585.933
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-A-2-combined-irEDCBA.opb	SAT f=6076425892024 TT=1800.03 T1=1800.3	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=6076425892024 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=6369310349522 TT=1800.08 T1=332.31	SAT (TO) f=7781829046490 TT=1800.04 T1=1.08	? (MO) TT=653.163
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-1-abcdeir.opb	SAT f=51245322588 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=1181449937739 TT=1800.11 T1=1800.4	SAT (TO) f=51245322588 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=51245322627 TT=1800.1 T1=29.54	SAT (TO) f=51245322818 TT=1800.04 T1=6.18	? (TO) TT=1800.56
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-1-EDCBAir.opb	SAT f=-156234982622 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-115566281891 TT=1800.11 T1=1800.4	SAT (TO) f=-156234982622 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=-156234982557 TT=1800.15 T1=12.59	SAT (TO) f=-156234982432 TT=1800.05 T1=6.33	? (TO) TT=1800.77
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-1-irabcde.opb	SAT f=6370637185898 TT=1800.73 T1=660.28	No data	No data	No data	SAT (TO) f=7263080847924 TT=1800.08 T1=1800.4	SAT (TO) f=6688209106498 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6370637185898 TT=1800.73 T1=660.28	SAT (TO) f=8282349603884 TT=1800.79 T1=2.31	? (MO) TT=612.917
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-1-irEDCBA.opb	SAT f=5909580349021 TT=1800.08 T1=63.88	No data	No data	No data	SAT (TO) f=7355473290913 TT=1800.1 T1=1800.4	SAT (TO) f=6688121930329 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=5909580349021 TT=1800.08 T1=63.88	SAT (TO) f=8337914810342 TT=1800.01 T1=9.12	? (MO) TT=696.227
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-2-EDCBAir.opb	OPT f=-103724725407 TT=2.554 T1=0.88	No data	No data	No data	SAT (TO) f=-103570464541 TT=1800.1 T1=1800.4	OPT f=-103724725407 TT=8.541 T1=8.53	No data	No data	OPT f=-103724725407 TT=7.663 T1=2.2	OPT f=-103724725407 TT=2.554 T1=0.88	? (TO) TT=1800.52
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-2-irabcde.opb	SAT f=6150574516764 TT=1800.02 T1=6.69	No data	No data	No data	SAT (TO) f=7485804893478 TT=1800.02 T1=1800.3	SAT (TO) f=7207190043984 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6150574516764 TT=1800.02 T1=6.69	SAT (TO) f=8208180566820 TT=1800.83 T1=391.38	? (MO) TT=626.812
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-2-irEDCBA.opb	SAT f=6280320683810 TT=1800.14 T1=116.52	No data	No data	No data	SAT (TO) f=7559364369902 TT=1800.03 T1=1800.3	SAT (TO) f=7207171200630 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=6280320683810 TT=1800.14 T1=116.52	SAT (TO) f=8282305985870 TT=1800.86 T1=2.07	? (MO) TT=710.386
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-combined-EDCBAir.opb	SAT f=-156234982667 TT=1800.02 T1=1800.3	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=-156234982667 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=-156234982542 TT=1800.14 T1=22.38	SAT (TO) f=-156234982507 TT=1800 T1=538.08	? (TO) TT=1800.64
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-combined-irabcde.opb	SAT f=6558441081764 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=6558441081764 TT=1800.11 T1=1800.4	SAT (TO) f=7299920827942 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6818250476100 TT=1800 T1=23.82	SAT (TO) f=7763292801474 TT=1800 T1=1.06	? (exit code) TT=691.609
normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/ normalized-single-obj-f56-FCS_FC1_order3_PB.seq-B-2-combined-irEDCBA.opb	SAT f=6706667704752 TT=1800.17 T1=657.75	No data	No data	No data	? (TO) TT=1800.12	SAT (TO) f=7299862165879 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6706667704752 TT=1800.17 T1=657.75	SAT (TO) f=7652051615712 TT=1800.05 T1=1.04	? (MO) TT=665.191
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-2-1-irabcde.opb	OPT f=2541829880 TT=9.441 T1=9.43	No data	No data	No data	OPT f=2541829880 TT=10.43 T1=10.42	OPT f=2541829880 TT=9.441 T1=9.43	No data	No data	SAT (TO) f=2541829880 TT=1800.11 T1=75.33	SAT (TO) f=2938005720 TT=1800.06 T1=600.62	? (MO) TT=1098.67
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-2-1-irEDCBA.opb	OPT f=2535476277 TT=15.238 T1=15.22	No data	No data	No data	OPT f=2535476277 TT=56.976 T1=56.97	OPT f=2535476277 TT=15.238 T1=15.22	No data	No data	SAT (TO) f=2535477720 TT=1800.09 T1=44.78	SAT (TO) f=3724008089 TT=1800.55 T1=281.93	? (MO) TT=980.529
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-2-2-irabcde.opb	OPT f=2536006228 TT=73.6 T1=40.93	No data	No data	No data	OPT f=2536006228 TT=96.302 T1=96.3	OPT f=2536006228 TT=73.6 T1=73.6	No data	No data	SAT (TO) f=2536006228 TT=1800.16 T1=40.93	SAT (TO) f=2536006228 TT=1800.07 T1=770.44	? (MO) TT=1783.22
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-2-combined-irabcde.opb	OPT f=2536006228 TT=117.942 T1=55.07	No data	No data	No data	OPT f=2536006228 TT=191.099 T1=191.15	OPT f=2536006228 TT=117.942 T1=117.94	No data	No data	SAT (TO) f=2536006228 TT=1800.05 T1=55.07	SAT (TO) f=2536006228 TT=1800.06 T1=706.6	? (MO) TT=1093.22
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-1-abcdeir.opb	SAT f=25458174978 TT=1800.02 T1=4.96	No data	No data	No data	? (TO) TT=1800.08	SAT (TO) f=25458174998 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=25458174978 TT=1800.12 T1=405.53	SAT (TO) f=25458174978 TT=1800.02 T1=4.96	? (TO) TT=1800.03
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-1-EDCBAir.opb	SAT f=-144635862 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-144635862 TT=1800.09 T1=1800.4	SAT (TO) f=-144635846 TT=1800.05 T1=1800.4	No data	No data	SAT (TO) f=-144635852 TT=1800.06 T1=487.8	SAT (TO) f=-144635837 TT=1800.09 T1=2.72	? (TO) TT=1800.08
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-1-irabcde.opb	SAT f=8962015608 TT=1800.06 T1=1800.6	No data	No data	No data	SAT (TO) f=8962015608 TT=1800.06 T1=1800.6	SAT (TO) f=9387843988 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=10169723780 TT=1800.17 T1=801.93	SAT (TO) f=12133452592 TT=1800 T1=71.19	? (TO) TT=1800.78
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-1-irEDCBA.opb	SAT f=7765001694 TT=1800.07 T1=1800.5	No data	No data	No data	SAT (TO) f=7765001694 TT=1800.07 T1=1800.5	SAT (TO) f=9349716561 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=10142079526 TT=1800.17 T1=188.61	SAT (TO) f=12122935934 TT=1800.09 T1=324.17	? (TO) TT=1800.88
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-2-abcdeir.opb	SAT f=13458780458 TT=1800.06 T1=225.86	No data	No data	No data	SAT (TO) f=27404023509 TT=1800.07 T1=1800.5	SAT (TO) f=13458780518 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=13458780458 TT=1800.06 T1=225.86	No Cert. TT=1800.94	? (TO) TT=1800.12
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-2-EDCBAir.opb	SAT f=-136326012 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-136326012 TT=1800.08 T1=1800.4	SAT (TO) f=-136325932 TT=1800.14 T1=1800.4	No data	No data	SAT (TO) f=-136326007 TT=1800.16 T1=76.93	No Cert. TT=1800	? (TO) TT=1800.26
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-2-irabcde.opb	SAT f=7774022368 TT=1800.06 T1=1800.5	No data	No data	No data	SAT (TO) f=7774022368 TT=1800.06 T1=1800.5	SAT (TO) f=9369571612 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=8587104112 TT=1800.18 T1=324	SAT (TO) f=12127682368 TT=1800.09 T1=2.24	? (TO) TT=1800.75
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-2-irEDCBA.opb	SAT f=8953532026 TT=1800.17 T1=1800.6	No data	No data	No data	SAT (TO) f=8953532026 TT=1800.17 T1=1800.6	SAT (TO) f=9349722000 TT=1801.02 T1=1801.35	No data	No data	SAT (TO) f=10934412743 TT=1800.06 T1=661.58	SAT (TO) f=12122940263 TT=1800.04 T1=2.16	? (TO) TT=1800.75
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-combined-abcdeir.opb	SAT f=13458780458 TT=1800.01 T1=5.76	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=13458780469 TT=1800.06 T1=1800.4	No data	No data	SAT (TO) f=13458780458 TT=1800.01 T1=5.76	No Cert. TT=1800	? (TO) TT=1800
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-combined-EDCBAir.opb	SAT f=-144635862 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-144635862 TT=1800.12 T1=1800.5	SAT (TO) f=-144635862 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=-144635847 TT=1800.16 T1=575.92	SAT (TO) f=-144635837 TT=1800.06 T1=3.06	? (TO) TT=1800.19
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-combined-irabcde.opb	SAT f=9392171656 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=12523965064 TT=1800.14 T1=1800.6	SAT (TO) f=9392171656 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=10174051448 TT=1800.04 T1=359.99	SAT (TO) f=12127628940 TT=1800.04 T1=2.53	? (TO) TT=1800.79
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-A-3-combined-irEDCBA.opb	SAT f=8161181715 TT=1800.05 T1=1800.5	No data	No data	No data	SAT (TO) f=8161181715 TT=1800.05 T1=1800.5	SAT (TO) f=8953569063 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=9745899209 TT=1800.02 T1=713.18	SAT (TO) f=12122935897 TT=1801 T1=75.83	? (TO) TT=1800.82
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-2-1-abcdeir.opb	OPT f=503530812 TT=5.587 T1=0.95	No data	No data	No data	OPT f=503530812 TT=142.843 T1=142.86	OPT f=503530812 TT=5.587 T1=5.57	No data	No data	OPT f=503530812 TT=1504.26 T1=3.05	OPT f=503530812 TT=405.78 T1=0.95	? (TO) TT=1800.16
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-2-1-irabcde.opb	OPT f=2535691284 TT=15.356 T1=15.34	No data	No data	No data	OPT f=2535691284 TT=22.594 T1=22.58	OPT f=2535691284 TT=15.356 T1=15.34	No data	No data	SAT (TO) f=2535691284 TT=1800.13 T1=70.03	SAT (TO) f=2535691284 TT=1800.61 T1=1244.69	? (MO) TT=951.784
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-2-1-irEDCBA.opb	OPT f=2533659614 TT=16.294 T1=16.28	No data	No data	No data	OPT f=2533659614 TT=94.695 T1=94.69	OPT f=2533659614 TT=16.294 T1=16.28	No data	No data	SAT (TO) f=2533714448 TT=1800.14 T1=39.57	SAT (TO) f=3722351673 TT=1800.01 T1=64.61	? (MO) TT=1000.31
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-2-2-irabcde.opb	OPT f=2535538030 TT=58.59 T1=54.46	No data	No data	No data	OPT f=2535538030 TT=220.621 T1=220.68	OPT f=2535538030 TT=58.59 T1=58.58	No data	No data	SAT (TO) f=2535538030 TT=1800.02 T1=54.46	SAT (TO) f=2931713870 TT=1800.01 T1=145.46	? (exit code) TT=1384.29
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-2-2-irEDCBA.opb	OPT f=2533821304 TT=24.204 T1=24.19	No data	No data	No data	OPT f=2533821304 TT=165.646 T1=165.66	OPT f=2533821304 TT=24.204 T1=24.19	No data	No data	SAT (TO) f=2533824116 TT=1800.01 T1=135.08	SAT (TO) f=2929998550 TT=1800.03 T1=1688.34	? (MO) TT=1171.31
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-2-combined-irabcde.opb	OPT f=2535538030 TT=80.851 T1=62.03	No data	No data	No data	OPT f=2535538030 TT=80.851 T1=80.85	OPT f=2535538030 TT=97.896 T1=97.89	No data	No data	SAT (TO) f=2535538030 TT=1800.11 T1=62.03	SAT (TO) f=2535538030 TT=1800.67 T1=271.02	? (MO) TT=1192.52
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-1-abcdeir.opb	SAT f=669952073 TT=1800.04 T1=1800.5	No data	No data	No data	SAT (TO) f=669952073 TT=1800.04 T1=1800.5	SAT (TO) f=669952254 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=669952088 TT=1800.07 T1=506.11	No Cert. TT=1800.01	? (TO) TT=1800.11
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-1-EDCBAir.opb	SAT f=-5496166382 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=-5496166322 TT=1800.06 T1=1800.5	SAT (TO) f=-5496166382 TT=1800.12 T1=1800.4	No data	No data	SAT (TO) f=-5496166367 TT=1800.06 T1=280.13	SAT (TO) f=-5496166357 TT=1800.96 T1=2.89	? (TO) TT=1800.32
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-1-irabcde.opb	SAT f=8161454294 TT=1800.04 T1=1800.6	No data	No data	No data	SAT (TO) f=8161454294 TT=1800.04 T1=1800.6	SAT (TO) f=9366997226 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=10538552920 TT=1800.11 T1=263.54	SAT (TO) f=12123256280 TT=1800.06 T1=48.9	? (MO) TT=1050.49
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-1-irEDCBA.opb	SAT f=8555696958 TT=1800.04 T1=1800.5	No data	No data	No data	SAT (TO) f=8555696958 TT=1800.04 T1=1800.5	SAT (TO) f=8952475935 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=12121278038 TT=1800.16 T1=48.45	SAT (TO) f=12121278038 TT=1801.23 T1=422.16	? (MO) TT=890.812
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-2-abcdeir.opb	SAT f=354178548 TT=1800.04 T1=796.6	No data	No data	No data	SAT (TO) f=354178548 TT=1800.04 T1=1800.5	SAT (TO) f=354178559 TT=1800.13 T1=1800.4	No data	No data	SAT (TO) f=354178548 TT=1800.14 T1=796.6	No Cert. TT=1800.06	? (TO) TT=1800.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-2-EDCBAir.opb	SAT f=-5180392822 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-5180392822 TT=1800.1 T1=1800.4	SAT (TO) f=-5180392802 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=-5180392812 TT=1800.97 T1=53.72	SAT (TO) f=-5180392802 TT=1800.07 T1=602.21	? (TO) TT=1800.65
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-2-irabcde.opb	SAT f=8557627322 TT=1800.14 T1=1800.5	No data	No data	No data	SAT (TO) f=8557627322 TT=1800.14 T1=1800.5	SAT (TO) f=9439764794 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=8975202482 TT=1800.11 T1=280.53	SAT (TO) f=12123101620 TT=1800.06 T1=554.74	? (MO) TT=957.231
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-2-irEDCBA.opb	SAT f=8555803777 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=8555803777 TT=1800.09 T1=1800.4	SAT (TO) f=9348588468 TT=1800.03 T1=1800.4	No data	No data	SAT (TO) f=11329090860 TT=1800.07 T1=401.87	SAT (TO) f=12121442540 TT=1800.03 T1=23.21	? (exit code) TT=891.279
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-combined-abcdeir.opb	SAT f=354178533 TT=1800.1 T1=6.3	No data	No data	No data	SAT (TO) f=354178533 TT=1800.1 T1=1800.5	SAT (TO) f=354178568 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=354178533 TT=1800.15 T1=6.3	SAT (TO) f=354178558 TT=1800.05 T1=2.43	? (TO) TT=1800.09
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-combined-EDCBAir.opb	SAT f=-5496166366 TT=1800.11 T1=1800.4	No data	No data	No data	? (TO) TT=1800.12	SAT (TO) f=-5496166366 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=-5496166362 TT=1800.39 T1=877.94	SAT (TO) f=-5496166357 TT=1800.08 T1=3.8	? (TO) TT=1800.72
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-combined-irabcde.opb	SAT f=8557523278 TT=1800.13 T1=1800.5	No data	No data	No data	SAT (TO) f=8557523278 TT=1800.13 T1=1800.5	SAT (TO) f=9354445864 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=10173615588 TT=1800.12 T1=654.49	SAT (TO) f=11330749940 TT=1800.03 T1=38.32	? (MO) TT=1010.88
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f58-fob_fxl_loss.seq-B-3-combined-irEDCBA.opb	SAT f=8951816558 TT=1800.09 T1=1800.5	No data	No data	No data	SAT (TO) f=8951816558 TT=1800.09 T1=1800.5	SAT (TO) f=9349503811 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=12121224610 TT=1800.13 T1=236.83	SAT (TO) f=12121278038 TT=1800.86 T1=42.2	? (MO) TT=983.034
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f6-ACTotalLoss.seq-A-2-2-irEDCBA.opb	OPT f=4208467707 TT=1588.5 T1=1588.74	No data	No data	No data	SAT (TO) f=4237097038 TT=1800.1 T1=1800.4	OPT f=4208467707 TT=1588.5 T1=1588.74	No data	No data	SAT (TO) f=5382263048 TT=1800.07 T1=227.57	SAT (TO) f=7844370064 TT=1800.64 T1=1.24	? (exit code) TT=823.439
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f6-ACTotalLoss.seq-A-2-combined-irabcde.opb	OPT f=4208917647 TT=403.578 T1=403.64	No data	No data	No data	SAT (TO) f=4822699698 TT=1800.03 T1=1800.4	OPT f=4208917647 TT=403.578 T1=403.64	No data	No data	SAT (TO) f=4934650432 TT=1800.05 T1=579.71	SAT (TO) f=6528167178 TT=1800.82 T1=0.76	? (MO) TT=826.426
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f6-ACTotalLoss.seq-B-2-1-irabcde.opb	OPT f=4208634927 TT=682.027 T1=682.13	No data	No data	No data	SAT (TO) f=4675072273 TT=1800.06 T1=1800.4	OPT f=4208634927 TT=682.027 T1=682.13	No data	No data	SAT (TO) f=4930929502 TT=1800.17 T1=772.58	SAT (TO) f=5668841598 TT=1800.02 T1=1411.35	? (MO) TT=815.88
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f6-ACTotalLoss.seq-B-2-2-irEDCBA.opb	OPT f=4207943007 TT=690.509 T1=690.61	No data	No data	No data	SAT (TO) f=4809157968 TT=1800.06 T1=1800.4	OPT f=4207943007 TT=690.509 T1=690.61	No data	No data	SAT (TO) f=5353431847 TT=1800.5 T1=749.16	SAT (TO) f=7843850764 TT=1800.06 T1=0.95	? (MO) TT=912.035
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f6-ACTotalLoss.seq-B-2-combined-irabcde.opb	OPT f=4208499147 TT=682.481 T1=682.58	No data	No data	No data	SAT (TO) f=4380314973 TT=1800.06 T1=1800.4	OPT f=4208499147 TT=682.481 T1=682.58	No data	No data	SAT (TO) f=5104488148 TT=1800.26 T1=871.28	SAT (TO) f=5668595148 TT=1800.04 T1=79.24	? (MO) TT=840.899
normalized-PB16/OPT-BIGINT-LIN/ lion9-single-obj/ normalized-single-obj-f6-ACTotalLoss.seq-B-2-combined-irEDCBA.opb	OPT f=4207740267 TT=884.755 T1=884.89	No data	No data	No data	SAT (TO) f=4952275853 TT=1800.05 T1=1800.4	OPT f=4207740267 TT=884.755 T1=884.89	No data	No data	SAT (TO) f=4351300112 TT=1800.06 T1=103.11	SAT (TO) f=7242638593 TT=1800.02 T1=0.66	? (exit code) TT=766.91
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__1024.opb		No data	No data	No data	? (TO) TT=1800.24	? TT=727.593	No data	No data	? (TO) TT=1802.65	? (TO) TT=1800.9	? (MO) TT=422.552
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__128.opb	SAT f=425329 TT=1800.34 T1=202.52	No data	No data	No data	? (TO) TT=1800.12	SAT (TO) f=2700363 TT=1800.29 T1=1800.3	No data	No data	SAT (TO) f=527828 TT=1801.42 T1=105.93	SAT (TO) f=425329 TT=1800.34 T1=202.52	? (TO) TT=1800.39
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__16.opb	SAT f=498558 TT=1800.95 T1=7.85	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	No data	SAT (TO) f=498558 TT=1800.95 T1=7.85	No Cert. TT=1800.73	? (TO) TT=1800.28
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__2048.opb		No data	No data	No data	? (TO) TT=1800.47	Signal TT=370.779	No data	No data	? TT=535.994	? (TO) TT=1802.03	? (MO) TT=165.276
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__256.opb	SAT f=498379 TT=1800.82 T1=248.57	No data	No data	No data	? (TO) TT=1800.09	SAT (TO) f=1370045 TT=1800.48 T1=1800.3	No data	No data	SAT (TO) f=1035601 TT=1801.16 T1=193.89	SAT (TO) f=498379 TT=1800.82 T1=248.57	? (TO) TT=1800.32
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__32.opb	SAT f=132571 TT=1800.19 T1=8.07	No data	No data	No data	? (TO) TT=1800.07	SAT (TO) f=3726061 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=132571 TT=1800.19 T1=8.07	SAT (TO) f=1435801 TT=1800.98 T1=8.44	? (TO) TT=1800.33
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__512.opb	SAT f=775554 TT=1801.88 T1=1034.92	No data	No data	No data	? (TO) TT=1800.09	SAT (TO) f=1681059 TT=1800.92 T1=1800.4	No data	No data	? (TO) TT=1800.16	SAT (TO) f=775554 TT=1801.88 T1=1034.92	? (TO) TT=1800.66
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__64.opb	SAT f=1453208 TT=1800.71 T1=1623.79	No data	No data	No data	? (TO) TT=1800.09	SAT (TO) f=5685731 TT=1800.08 T1=1800.3	No data	No data	SAT (TO) f=1453208 TT=1800.71 T1=1623.79	No Cert. TT=1800.34	? (TO) TT=1800.2
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766__8.opb	SAT f=426607 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=29254387 TT=1800.02 T1=1800.3	SAT (TO) f=426607 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=774987 TT=1800.16 T1=4.75	No Cert. TT=1800.08	? (TO) TT=1800.35
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_1000_5__369_766.opb	SAT f=426884 TT=1800.03 T1=0.86	No data	No data	No data	SAT (TO) f=26658062 TT=1800.03 T1=1800.3	SAT (TO) f=1077897 TT=1800.23 T1=1800.4	No data	No data	SAT (TO) f=426884 TT=1800.1 T1=2.92	SAT (TO) f=426884 TT=1800.03 T1=0.86	? (TO) TT=1800.08
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__1024.opb	SAT f=883780 TT=1800.08 T1=1800.3	No data	No data	No data	? (TO) TT=1800.13	SAT (TO) f=883780 TT=1800.08 T1=1800.3	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.12
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__128.opb	SAT f=71863 TT=1800.04 T1=44.59	No data	No data	No data	SAT (TO) f=2315654 TT=1800.04 T1=1800.3	SAT (MO) f=381307 TT=1758.37 T1=1758.1	No data	No data	SAT (TO) f=71863 TT=1800.82 T1=44.59	SAT (TO) f=71863 TT=1800.04 T1=57.13	? (TO) TT=1800.49
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__16.opb	SAT f=70998 TT=564.672 T1=371.5	No data	No data	No data	? (TO) TT=1800.02	SAT f=70998 TT=564.672 T1=564.22	No data	No data	SAT (TO) f=70998 TT=1800.67 T1=743.9	SAT (TO) f=70998 TT=1800.06 T1=371.5	? (TO) TT=1800.1
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__2048.opb	SAT f=294004 TT=1800.32 T1=1262.67	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=376758 TT=1800.32 T1=1800.3	No data	No data	? (TO) TT=1800	SAT (TO) f=294004 TT=1800.32 T1=1262.67	? (TO) TT=1800.04
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__256.opb	SAT f=72735 TT=1800.03 T1=2.88	No data	No data	No data	? (TO) TT=1800.13	SAT (TO) f=415897 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=72735 TT=1800.03 T1=2.88	No Cert. TT=1800.08	? (TO) TT=1800.34
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__32.opb	SAT f=71837 TT=1800 T1=380.25	No data	No data	No data	? (TO) TT=1800.02	SAT f=97475 TT=858.33 T1=857.9	No data	No data	SAT (TO) f=71837 TT=1800 T1=380.25	No Cert. TT=1800.8	? (TO) TT=1800.03
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__512.opb	SAT f=72735 TT=1800.07 T1=440.77	No data	No data	No data	? (TO) TT=1800.13	SAT (TO) f=476264 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=72735 TT=1800.07 T1=440.77	No Cert. TT=1800.02	? (TO) TT=1800.68
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__64.opb	SAT f=71863 TT=1800.11 T1=7.78	No data	No data	No data	SAT (TO) f=2651752 TT=1800.01 T1=1800.3	SAT (MO) f=2615389 TT=935.068 T1=934.7	No data	No data	SAT (TO) f=71863 TT=1800.11 T1=7.78	No Cert. TT=1800.78	? (TO) TT=1800.36
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91__8.opb	OPT f=70998 TT=165.66 T1=5.87	No data	No data	No data	SAT (TO) f=2179600 TT=1800.01 T1=1800.3	OPT f=70998 TT=261.765 T1=260.8	No data	No data	OPT f=70998 TT=452.734 T1=5.87	OPT f=70998 TT=165.66 T1=25.95	? (TO) TT=1800.02
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_100_3__3_91.opb	OPT f=70998 TT=0.574 T1=0.2	No data	No data	No data	SAT (TO) f=939731 TT=1800.03 T1=1800.3	OPT f=70998 TT=21.073 T1=21.03	No data	No data	OPT f=70998 TT=1.414 T1=2.19	OPT f=70998 TT=0.574 T1=0.2	OPT f=70998 TT=116.951 T1=54.94
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__128.opb	SAT f=506585 TT=1800.67 T1=82.77	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.22	No data	No data	SAT (TO) f=1722960 TT=1801.07 T1=198.99	SAT (TO) f=506585 TT=1800.67 T1=82.77	? (TO) TT=1800.6
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__16.opb	SAT f=2157428 TT=1800.03 T1=25.25	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	No data	SAT (TO) f=2157428 TT=1800.03 T1=25.25	No Cert. TT=1800.78	? (TO) TT=1800.37
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__256.opb	SAT f=723548 TT=1802.64 T1=462.03	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.46	No data	No data	SAT (TO) f=1834166 TT=1803.26 T1=338.8	SAT (TO) f=723548 TT=1802.64 T1=462.03	? (TO) TT=1800.66
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__32.opb	SAT f=3029839 TT=1800.42 T1=70.93	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	No data	No data	SAT (TO) f=3029839 TT=1800.42 T1=70.93	No Cert. TT=1800.29	? (TO) TT=1800.32
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__512.opb		No data	No data	No data	? (TO) TT=1800.24	? TT=764.746	No data	No data	? (TO) TT=1802.01	? (TO) TT=1803.17	? (MO) TT=264.91
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__64.opb	SAT f=814752 TT=1800.27 T1=1800.3	No data	No data	No data	? (TO) TT=1800.12	SAT (TO) f=814752 TT=1800.27 T1=1800.3	No data	No data	SAT (TO) f=1132700 TT=1800.56 T1=47.09	No Cert. TT=1800.96	? (TO) TT=1800.62
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792__8.opb	SAT f=774413 TT=1800.92 T1=8.58	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=1457061 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=774413 TT=1800.92 T1=8.58	No Cert. TT=1800	? (TO) TT=1800.41
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_2000_5__647_1792.opb	SAT f=333329 TT=1800.05 T1=0.87	No data	No data	No data	SAT (TO) f=59460729 TT=1800.02 T1=1800.3	SAT f=2932803 TT=916.989 T1=916.59	No data	No data	SAT (TO) f=333329 TT=1800.05 T1=6.83	SAT (TO) f=333329 TT=1800.76 T1=0.87	? (TO) TT=1800.04
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__1024.opb	OPT f=46877 TT=5.635 T1=1.8	No data	No data	No data	SAT (TO) f=360359 TT=1800.1 T1=1800.3	SAT f=78430 TT=707.078 T1=706.63	No data	No data	OPT f=46877 TT=5.635 T1=1.8	SAT (TO) f=46877 TT=1800.06 T1=2.55	? (TO) TT=1800.35
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__128.opb	OPT f=46877 TT=2.855 T1=0.52	No data	No data	No data	SAT (TO) f=347807 TT=1800.1 T1=1800.4	OPT f=46877 TT=204.371 T1=203.44	No data	No data	OPT f=46877 TT=2.855 T1=0.98	OPT f=46877 TT=174.07 T1=0.52	? (TO) TT=1800.38
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__16.opb	OPT f=46877 TT=0.993 T1=0.23	No data	No data	No data	OPT f=46877 TT=1430.12 T1=1430.34	OPT f=46877 TT=16.62 T1=16.57	No data	No data	OPT f=46877 TT=1.065 T1=0.72	OPT f=46877 TT=0.993 T1=0.23	OPT f=46877 TT=1677.99 T1=677.26
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__2048.opb	OPT f=46877 TT=10.933 T1=4.24	No data	No data	No data	SAT (TO) f=618752 TT=1800.17 T1=1800.4	SAT f=78430 TT=1337.95 T1=1337.68	No data	No data	OPT f=46877 TT=10.933 T1=4.24	SAT (TO) f=46877 TT=1800.04 T1=12.54	? (TO) TT=1800.07
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__256.opb	OPT f=46877 TT=3.453 T1=0.63	No data	No data	No data	SAT (TO) f=390236 TT=1800.02 T1=1800.3	OPT f=46877 TT=450.095 T1=447.66	No data	No data	OPT f=46877 TT=3.453 T1=1.06	OPT f=46877 TT=1256.99 T1=0.63	? (TO) TT=1800.11
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__32.opb	OPT f=46877 TT=1.454 T1=0.29	No data	No data	No data	SAT (TO) f=263415 TT=1800.01 T1=1800.3	OPT f=46877 TT=37.758 T1=37.65	No data	No data	OPT f=46877 TT=1.454 T1=0.77	OPT f=46877 TT=1.574 T1=0.29	? (TO) TT=1800.17
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__512.opb	OPT f=46877 TT=4.084 T1=1.11	No data	No data	No data	SAT (TO) f=483196 TT=1800.11 T1=1800.4	SAT (MO) f=46877 TT=557.504 T1=557	No data	No data	OPT f=46877 TT=4.084 T1=1.11	No Cert. TT=1800.09	? (TO) TT=1800.21
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__64.opb	OPT f=46877 TT=2.274 T1=0.42	No data	No data	No data	SAT (TO) f=339447 TT=1800.02 T1=1800.3	OPT f=46877 TT=86.573 T1=86.24	No data	No data	OPT f=46877 TT=2.274 T1=0.89	OPT f=46877 TT=7.422 T1=0.42	? (TO) TT=1800.48
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12__8.opb	OPT f=46877 TT=0.453 T1=0.22	No data	No data	No data	OPT f=46877 TT=267.3 T1=267.32	OPT f=46877 TT=7.557 T1=7.54	No data	No data	OPT f=46877 TT=0.476 T1=0.69	OPT f=46877 TT=0.453 T1=0.22	OPT f=46877 TT=91.461 T1=35.41
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_20_2__17_12.opb	OPT f=46877 TT=0.033 T1=0.03	No data	No data	No data	OPT f=46877 TT=31.449 T1=31.45	OPT f=46877 TT=1.785 T1=1.78	No data	No data	OPT f=46877 TT=0.174 T1=0.63	OPT f=46877 TT=0.164 T1=0.13	OPT f=46877 TT=0.033 T1=0.03
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__1024.opb		No data	No data	No data	? (MO) TT=486.78	? (MO) TT=494.088	No data	No data	? TT=572.85	? (TO) TT=1802.95	? (MO) TT=179.304
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__128.opb	SAT f=1286344 TT=1805.27 T1=325.05	No data	No data	No data	? (TO) TT=1800.2	? (TO) TT=1800.38	No data	No data	SAT (TO) f=1286344 TT=1805.27 T1=325.05	SAT (TO) f=2262814 TT=1800.87 T1=125.99	? (TO) TT=1800.56
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__16.opb	SAT f=4941435 TT=1800.48 T1=43.79	No data	No data	No data	? (TO) TT=1800.07	SAT (TO) f=24451986 TT=1800.15 T1=1800.4	No data	No data	SAT (TO) f=5244074 TT=1800.54 T1=36.62	SAT (TO) f=4941435 TT=1800.48 T1=43.79	? (TO) TT=1800.52
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__256.opb	SAT f=1659203 TT=1801.73 T1=1610.41	No data	No data	No data	? (TO) TT=1800.16	? TT=535.259	No data	No data	? (TO) TT=1802.1	SAT (TO) f=1659203 TT=1801.73 T1=1610.41	? (TO) TT=1800.77
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__32.opb	SAT f=762407 TT=1801.03 T1=109.55	No data	No data	No data	? (TO) TT=1800.08	SAT (TO) f=7121134 TT=1800.16 T1=1800.3	No data	No data	SAT (TO) f=762407 TT=1801.03 T1=109.55	No Cert. TT=1800.33	? (TO) TT=1800.53
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__512.opb		No data	No data	No data	? (TO) TT=1800.38	? TT=1073.82	No data	No data	? TT=703.587	? (TO) TT=1800.05	? (MO) TT=154.41
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__64.opb	SAT f=85788 TT=1800.46 T1=37.4	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=2180977 TT=1800.39 T1=1800.3	No data	No data	SAT (TO) f=85788 TT=1801.55 T1=68.56	SAT (TO) f=85788 TT=1800.46 T1=37.4	? (TO) TT=1800.78
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812__8.opb	SAT f=1185909 TT=1800.16 T1=15.14	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	No data	SAT (TO) f=1185909 TT=1800.16 T1=15.14	No Cert. TT=1800.05	? (TO) TT=1800.38
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_3000_5__126_2812.opb	OPT f=60720 TT=19.464 T1=1.3	No data	No data	No data	SAT (TO) f=84536536 TT=1800.02 T1=1800.3	SAT f=13004584 TT=985.769 T1=985.34	No data	No data	OPT f=60720 TT=1195.15 T1=606.32	OPT f=60720 TT=33.928 T1=32.29	OPT f=60720 TT=19.464 T1=1.3
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__1024.opb	SAT f=782133 TT=1800.52 T1=1800.3	No data	No data	No data	? (TO) TT=1800.11	SAT (TO) f=782133 TT=1800.52 T1=1800.3	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.8	? (TO) TT=1800.33
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__128.opb	SAT f=403527 TT=1800.08 T1=67.66	No data	No data	No data	SAT (TO) f=12757345 TT=1800.12 T1=1800.4	SAT (TO) f=13010799 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=403527 TT=1800.08 T1=67.66	SAT (TO) f=980004 TT=1800.09 T1=44.86	? (TO) TT=1800.56
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__16.opb	SAT f=107914 TT=1800.62 T1=2.96	No data	No data	No data	? (TO) TT=1800.11	SAT f=519608 TT=1220.51 T1=1220.12	No data	No data	SAT (TO) f=107914 TT=1800.62 T1=2.96	SAT (TO) f=700693 TT=1800.63 T1=1.28	? (TO) TT=1800.21
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__2048.opb		No data	No data	No data	? (TO) TT=1800.06	? (MO) TT=487.61	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.71
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__256.opb	SAT f=2482085 TT=1800.31 T1=468.87	No data	No data	No data	? (TO) TT=1800.14	SAT (TO) f=13182697 TT=1800.16 T1=1800.3	No data	No data	SAT (TO) f=2482085 TT=1800.31 T1=468.87	No Cert. TT=1800.26	? (TO) TT=1800.16
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__32.opb	SAT f=676244 TT=1800.03 T1=1800.3	No data	No data	No data	? (TO) TT=1800.04	SAT (TO) f=676244 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=1757358 TT=1800.89 T1=3.87	No Cert. TT=1800.01	? (TO) TT=1800.29
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__512.opb	SAT f=677059 TT=1800.31 T1=1800.3	No data	No data	No data	? (TO) TT=1800.13	SAT (TO) f=677059 TT=1800.31 T1=1800.3	No data	No data	? (TO) TT=1800.62	? (TO) TT=1800.02	? (TO) TT=1800.18
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__64.opb	SAT f=274955 TT=1800.19 T1=4.09	No data	No data	No data	SAT (TO) f=13414923 TT=1800.13 T1=1800.4	SAT (TO) f=1330917 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=274955 TT=1800.19 T1=4.09	SAT (TO) f=1656249 TT=1800.05 T1=7.47	? (TO) TT=1800.47
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366__8.opb	SAT f=1106627 TT=1800.34 T1=1800.4	No data	No data	No data	? (TO) TT=1800.01	SAT (TO) f=1106627 TT=1800.34 T1=1800.4	No data	No data	SAT (TO) f=2275543 TT=1800.15 T1=2.37	SAT (TO) f=1733532 TT=1800.03 T1=0.91	? (TO) TT=1800.11
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_500_3__212_366.opb	OPT f=95378 TT=1.647 T1=0.7	No data	No data	No data	? (TO) TT=1800.02	OPT f=95378 TT=280.33 T1=279.22	No data	No data	OPT f=95378 TT=3.429 T1=3.07	OPT f=95378 TT=1.647 T1=0.7	OPT f=95378 TT=128.717 T1=125.94
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__1024.opb	OPT f=45008 TT=10.023 T1=4.63	No data	No data	No data	SAT (TO) f=964580 TT=1800.23 T1=1800.4	SAT (TO) f=265206 TT=1800.04 T1=1800.3	No data	No data	OPT f=45008 TT=10.023 T1=4.63	SAT (TO) f=72813 TT=1800.78 T1=4.72	? (TO) TT=1800.09
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__128.opb	OPT f=45008 TT=4.054 T1=1.67	No data	No data	No data	? (TO) TT=1800.09	SAT (MO) f=72813 TT=928.464 T1=928.1	No data	No data	OPT f=45008 TT=4.054 T1=1.67	No Cert. TT=1800.01	? (TO) TT=1800.53
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__16.opb	OPT f=45008 TT=1.864 T1=1.29	No data	No data	No data	SAT (TO) f=798948 TT=1800.02 T1=1800.3	OPT f=45008 TT=107.564 T1=107.39	No data	No data	OPT f=45008 TT=1.864 T1=1.29	OPT f=45008 TT=2.704 T1=1.91	OPT f=45008 TT=58.859 T1=58.2
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__2048.opb	OPT f=45008 TT=19.671 T1=9.04	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	No data	No data	OPT f=45008 TT=19.671 T1=9.04	SAT (TO) f=72813 TT=1800.09 T1=24.14	? (TO) TT=1800.01
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__256.opb	OPT f=45008 TT=5.114 T1=1.85	No data	No data	No data	SAT (TO) f=1320679 TT=1800.11 T1=1800.4	SAT f=265206 TT=1381.83 T1=1381.5	No data	No data	OPT f=45008 TT=5.114 T1=1.85	No Cert. TT=1800.03	? (TO) TT=1800.31
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__32.opb	OPT f=45008 TT=2.784 T1=1.42	No data	No data	No data	SAT (TO) f=933891 TT=1800.02 T1=1800.3	OPT f=45008 TT=314.853 T1=313.63	No data	No data	OPT f=45008 TT=2.784 T1=1.42	OPT f=45008 TT=549.19 T1=543.93	OPT f=45008 TT=527.826 T1=512.42
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__512.opb	OPT f=45008 TT=6.942 T1=3.08	No data	No data	No data	SAT (TO) f=1250018 TT=1800.11 T1=1800.4	SAT (TO) f=265206 TT=1800.89 T1=1801.16	No data	No data	OPT f=45008 TT=6.942 T1=3.08	SAT (TO) f=72813 TT=1800.02 T1=1.6	? (TO) TT=1800.5
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__64.opb	OPT f=45008 TT=3.084 T1=1.52	No data	No data	No data	SAT (TO) f=939594 TT=1800.02 T1=1800.3	SAT f=45008 TT=639.171 T1=638.75	No data	No data	OPT f=45008 TT=3.084 T1=1.52	No Cert. TT=1800.05	? (TO) TT=1800.41
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45__8.opb	OPT f=45008 TT=1.133 T1=0.48	No data	No data	No data	? (TO) TT=1800.11	OPT f=45008 TT=73.772 T1=73.58	No data	No data	OPT f=45008 TT=1.533 T1=1.24	OPT f=45008 TT=1.133 T1=0.48	OPT f=45008 TT=50.918 T1=4.3
/OPT-BIGINT-LIN/aries-da_nrp/ normalized-aries-da_network_50_2__8_45.opb	OPT f=45008 TT=0.031 T1=0.02	No data	No data	No data	OPT f=45008 TT=339.611 T1=339.67	OPT f=45008 TT=6.34 T1=6.33	No data	No data	OPT f=45008 TT=0.194 T1=1.15	OPT f=45008 TT=0.185 T1=0.15	OPT f=45008 TT=0.031 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.01-2.opb	OPT f=46566 TT=175.601 T1=175.05	No data	No data	No data	SAT (TO) f=259243 TT=1800.16 T1=1800.5	OPT f=46566 TT=175.601 T1=175.05	No data	No data	SAT (TO) f=119828 TT=1800.88 T1=9.67	SAT (TO) f=93089 TT=1800.83 T1=8.02	? (TO) TT=1800.14
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.01-4.opb	OPT f=58784 TT=403.014 T1=402.67	No data	No data	No data	SAT (TO) f=259841 TT=1800.09 T1=1800.5	OPT f=58784 TT=403.014 T1=402.67	No data	No data	SAT (TO) f=150641 TT=1800.81 T1=10.08	SAT (TO) f=102407 TT=1800.86 T1=11.47	? (TO) TT=1800.09
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.01-5.opb	OPT f=59945 TT=168.561 T1=168.05	No data	No data	No data	SAT (TO) f=279606 TT=1800.16 T1=1800.5	OPT f=59945 TT=168.561 T1=168.05	No data	No data	No Cert. TT=1804.42	No Cert. TT=1801.27	? (TO) TT=1800.12
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.10-10.opb	OPT f=57616 TT=159.837 T1=159.39	No data	No data	No data	SAT (TO) f=512588 TT=1800.17 T1=1800.5	OPT f=57616 TT=159.837 T1=159.39	No data	No data	? (TO) TT=1803.78	SAT (TO) f=125072 TT=1800.3 T1=11.2	? (TO) TT=1800.2
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.10-7.opb	OPT f=52383 TT=203.179 T1=202.7	No data	No data	No data	SAT (TO) f=394610 TT=1800.08 T1=1800.4	OPT f=52383 TT=203.179 T1=202.7	No data	No data	SAT (TO) f=123910 TT=1800.79 T1=15.1	No Cert. TT=1800.05	? (TO) TT=1800.1
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb1-0.01-2.opb	OPT f=4686 TT=45.982 T1=45.76	No data	No data	No data	SAT (TO) f=130782 TT=1800.15 T1=1800.5	OPT f=4686 TT=45.982 T1=45.76	No data	No data	SAT (TO) f=7014 TT=1800.15 T1=774.94	No Cert. TT=1800.83	? (TO) TT=1800.16
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.20-11.opb	SAT f=50065 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=625871 TT=1800.08 T1=1800.4	SAT (TO) f=50065 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=147177 TT=1800.92 T1=18.73	No Cert. TT=1800.69	? (TO) TT=1800.22
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.20-13.opb	SAT f=40787 TT=1800.17 T1=1800.5	No data	No data	No data	SAT (TO) f=605532 TT=1800.06 T1=1800.4	SAT (TO) f=40787 TT=1800.17 T1=1800.5	No data	No data	SAT (TO) f=109384 TT=1800.87 T1=23.79	SAT (TO) f=108804 TT=1800.34 T1=15.99	? (TO) TT=1800.15
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb10-0.20-14.opb	OPT f=41339 TT=209.761 T1=209.4	No data	No data	No data	SAT (TO) f=577625 TT=1800.12 T1=1800.4	OPT f=41339 TT=209.761 T1=209.4	No data	No data	SAT (TO) f=132047 TT=1800.95 T1=22.37	SAT (TO) f=151237 TT=1800.31 T1=15.37	? (TO) TT=1800.23
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb1-0.10-8.opb	OPT f=8175 TT=102.258 T1=101.87	No data	No data	No data	SAT (TO) f=452095 TT=1800.16 T1=1800.5	OPT f=8175 TT=102.258 T1=101.87	No data	No data	SAT (TO) f=22727 TT=1800.07 T1=52.59	No Cert. TT=1800.77	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb1-0.20-13.opb	OPT f=6430 TT=91.478 T1=91.14	No data	No data	No data	SAT (TO) f=454977 TT=1800.06 T1=1800.4	OPT f=6430 TT=91.478 T1=91.14	No data	No data	SAT (TO) f=45411 TT=1800.57 T1=850.47	No Cert. TT=1800.26	? (TO) TT=1800.34
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb1-0.20-15.opb	OPT f=5265 TT=85.429 T1=85.12	No data	No data	No data	SAT (TO) f=619992 TT=1800.13 T1=1800.5	OPT f=5265 TT=85.429 T1=85.12	No data	No data	SAT (TO) f=20394 TT=1800.57 T1=638.04	No Cert. TT=1800.85	? (TO) TT=1800.14
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.01-1.opb	OPT f=29116 TT=112.852 T1=112.47	No data	No data	No data	SAT (TO) f=276663 TT=1800.17 T1=1800.5	OPT f=29116 TT=112.852 T1=112.47	No data	No data	SAT (TO) f=91313 TT=1800.85 T1=76.99	No Cert. TT=1800	? (TO) TT=1800.06
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.01-2.opb	OPT f=34935 TT=96.788 T1=96.39	No data	No data	No data	SAT (TO) f=213913 TT=1800.15 T1=1800.5	OPT f=34935 TT=96.788 T1=96.39	No data	No data	SAT (TO) f=92493 TT=1801.01 T1=20.4	No Cert. TT=1800.84	? (TO) TT=1800.11
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.01-5.opb	OPT f=25054 TT=143.089 T1=142.73	No data	No data	No data	SAT (TO) f=208102 TT=1800.16 T1=1800.6	OPT f=25054 TT=143.089 T1=142.73	No data	No data	SAT (TO) f=54709 TT=1800.19 T1=9.62	SAT (TO) f=44825 TT=1800.79 T1=60.75	? (TO) TT=1800.07
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.10-10.opb	OPT f=25042 TT=93.567 T1=93.23	No data	No data	No data	SAT (TO) f=360881 TT=1800.14 T1=1800.5	OPT f=25042 TT=93.567 T1=93.23	No data	No data	SAT (TO) f=47165 TT=1800.89 T1=200.9	No Cert. TT=1800.07	? (TO) TT=1800.09
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.10-7.opb	OPT f=25626 TT=122.061 T1=121.59	No data	No data	No data	SAT (TO) f=377749 TT=1800.12 T1=1800.5	OPT f=25626 TT=122.061 T1=121.59	No data	No data	SAT (TO) f=77972 TT=1800.04 T1=12.77	No Cert. TT=1800.35	? (TO) TT=1800.1
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.10-8.opb	OPT f=25048 TT=173.889 T1=173.37	No data	No data	No data	SAT (TO) f=359714 TT=1800.1 T1=1800.4	OPT f=25048 TT=173.889 T1=173.37	No data	No data	? (TO) TT=1803.89	SAT (TO) f=51228 TT=1800.31 T1=36.32	? (TO) TT=1800.04
OPT-BIGINT-LIN/graca/ normalized-ped2.G.recomb5-0.10-9.opb	OPT f=31445 TT=187.857 T1=187.4	No data	No data	No data	SAT (TO) f=408563 TT=1800.09 T1=1800.4	OPT f=31445 TT=187.857 T1=187.4	No data	No data	SAT (TO) f=82043 TT=1800.89 T1=12.95	No Cert. TT=1800.84	? (TO) TT=1800.22
OPT-BIGINT-LIN/graca/ normalized-ped3.E.recomb10-0.20-11.opb	OPT f=9588 TT=22.88 T1=22.79	No data	No data	No data	OPT f=9588 TT=896.84 T1=896.98	OPT f=9588 TT=22.88 T1=22.79	No data	No data	SAT (TO) f=19507 TT=1800.74 T1=5.67	No Cert. TT=1800.07	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
OPT-BIGINT-LIN/graca/ normalized-ped3.E.recomb10-0.20-14.opb	OPT f=8555 TT=67.07 T1=66.95	No data	No data	No data	OPT f=8555 TT=1252.78 T1=1252.93	OPT f=8555 TT=67.07 T1=66.95	No data	No data	SAT (TO) f=14044 TT=1800.13 T1=146.09	SAT (TO) f=15402 TT=1800.67 T1=957.44	? (TO) TT=1800.13
OPT-BIGINT-LIN/graca/ normalized-ped3.F.recomb10-0.01-1.opb	OPT f=6853 TT=13.261 T1=13.19	No data	No data	No data	OPT f=6853 TT=264.438 T1=264.4	OPT f=6853 TT=13.261 T1=13.19	No data	No data	SAT (TO) f=15392 TT=1800.67 T1=447.57	SAT (TO) f=15051 TT=1800.04 T1=26.63	? (TO) TT=1800.1
OPT-BIGINT-LIN/graca/ normalized-ped3.F.recomb10-0.10-10.opb	OPT f=7537 TT=14.392 T1=14.33	No data	No data	No data	OPT f=7537 TT=388.961 T1=388.94	OPT f=7537 TT=14.392 T1=14.33	No data	No data	SAT (TO) f=10954 TT=1800.04 T1=171.07	SAT (TO) f=12332 TT=1801.07 T1=3.6	? (TO) TT=1800.03
OPT-BIGINT-LIN/graca/ normalized-ped3.F.recomb10-0.10-7.opb	OPT f=8905 TT=17.908 T1=17.84	No data	No data	No data	OPT f=8905 TT=948.914 T1=949.12	OPT f=8905 TT=17.908 T1=17.84	No data	No data	SAT (TO) f=12334 TT=1800.73 T1=394.25	SAT (TO) f=13709 TT=1800.02 T1=3.75	? (TO) TT=1800.05
OPT-BIGINT-LIN/graca/ normalized-ped3.F.recomb10-0.10-9.opb	OPT f=5488 TT=17.085 T1=17.02	No data	No data	No data	OPT f=5488 TT=809.821 T1=809.86	OPT f=5488 TT=17.085 T1=17.02	No data	No data	SAT (TO) f=9261 TT=1800.69 T1=348.1	SAT (TO) f=8255 TT=1800.71 T1=748.05	? (TO) TT=1800.1
OPT-BIGINT-LIN/graca/ normalized-ped3.F.recomb10-0.20-12.opb	OPT f=5840 TT=63.328 T1=63.28	No data	No data	No data	OPT f=5840 TT=725.72 T1=725.84	OPT f=5840 TT=63.328 T1=63.28	No data	No data	SAT (TO) f=13366 TT=1800.86 T1=13.66	No Cert. TT=1800.75	? (TO) TT=1800.08
OPT-BIGINT-LIN/graca/ normalized-ped3.G.recomb10-0.01-2.opb	OPT f=16784 TT=55.199 T1=54.98	No data	No data	No data	SAT (TO) f=16787 TT=1800.1 T1=1800.4	OPT f=16784 TT=55.199 T1=54.98	No data	No data	SAT (TO) f=20903 TT=1800.91 T1=4.83	SAT (TO) f=19875 TT=1800.06 T1=4.36	? (TO) TT=1800.08
OPT-BIGINT-LIN/graca/ normalized-ped3.G.recomb10-0.10-10.opb	OPT f=18485 TT=112.481 T1=112.2	No data	No data	No data	SAT (TO) f=47041 TT=1800.07 T1=1800.4	OPT f=18485 TT=112.481 T1=112.2	No data	No data	SAT (TO) f=22953 TT=1800.85 T1=8.71	SAT (TO) f=30468 TT=1800.88 T1=240.34	? (TO) TT=1800.1
OPT-BIGINT-LIN/graca/ normalized-ped3.G.recomb10-0.20-12.opb	OPT f=13027 TT=434.993 T1=434.83	No data	No data	No data	SAT (TO) f=176728 TT=1800.13 T1=1800.5	OPT f=13027 TT=434.993 T1=434.83	No data	No data	SAT (TO) f=26367 TT=1800.83 T1=7.05	SAT (TO) f=20554 TT=1800.92 T1=5.64	? (TO) TT=1800.01
OPT-BIGINT-LIN/graca/ normalized-ped3.G.recomb10-0.20-13.opb	OPT f=17465 TT=149.42 T1=149.27	No data	No data	No data	SAT (TO) f=223460 TT=1800.06 T1=1800.4	OPT f=17465 TT=149.42 T1=149.27	No data	No data	SAT (TO) f=40015 TT=1800.68 T1=7.26	SAT (TO) f=41394 TT=1800.66 T1=20.33	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/ heinz/normalized-air04.opb	SAT f=72627 TT=1800.2 T1=1800.4	No data	No data	No data	SAT (TO) f=81355 TT=1800.09 T1=1800.4	SAT (TO) f=72627 TT=1800.2 T1=1800.4	No data	No data	? (TO) TT=1800.71	? (TO) TT=1800.09	? (TO) TT=1800.03
/OPT-BIGINT-LIN/heinz/ normalized-bley_xl1.opb	OPT f=38 TT=17.259 T1=11.72	No data	No data	No data	OPT f=38 TT=139.633 T1=139.71	OPT f=38 TT=226.709 T1=226.63	No data	No data	OPT f=38 TT=17.259 T1=11.72	OPT f=38 TT=236.989 T1=223.82	OPT f=38 TT=838.768 T1=22.83
/OPT-BIGINT-LIN/ heinz/normalized-co-100.opb	SAT f=276962066 TT=1800.41 T1=538.28	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.25	No data	No data	SAT (TO) f=276962066 TT=1800.41 T1=538.28	SAT (TO) f=402628765 TT=1800.05 T1=4.34	? (TO) TT=1800.67
/OPT-BIGINT-LIN/ heinz/normalized-ds-big.opb	SAT f=4645117612430000 TT=1800.43 T1=448.68	No data	No data	No data	? (TO) TT=1800.1	SAT (TO) f=12607327000030000 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=4645117612430000 TT=1800.43 T1=448.68	No Cert. TT=1800.03	? (MO) TT=1071.46
/OPT-BIGINT-LIN/heinz/ normalized-eilB101.opb	SAT f=654210537500000006 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=654210537500000006 TT=1800.03 T1=1800.3	SAT (TO) f=656224944500000005 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=937348411000000014 TT=1800.31 T1=582.22	No Cert. TT=1800.04	? (MO) TT=240.857
/OPT-BIGINT-LIN/ heinz/normalized-harp2.opb	SAT f=-66807036 TT=1800.67 T1=2.32	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=-30075895 TT=1800.14 T1=1800.4	No data	No data	SAT (TO) f=-66807036 TT=1800.67 T1=2.32	SAT (TO) f=-59289730 TT=1800.06 T1=0.54	? (MO) TT=315.278
/OPT-BIGINT-LIN/heinz/ normalized-ivu06-big.opb	SAT f=4815396877710000015 TT=1801.11 T1=133.2	No data	No data	No data	? (TO) TT=1800.33	Signal TT=387.151	No data	No data	? (TO) TT=1800.76	SAT (TO) f=4815396877710000015 TT=1801.11 T1=133.2	? (MO) TT=837.487
/OPT-BIGINT-LIN/ heinz/normalized-ivu52.opb		No data	No data	No data	? (TO) TT=1800.02	Signal TT=50.108	No data	No data	? (TO) TT=1800.62	? (TO) TT=1801.33	? (TO) TT=1800.18
/OPT-BIGINT-LIN/heinz/ normalized-n3div36.opb	SAT f=1530 TT=1800.38 T1=1800.4	No data	No data	No data	SAT (TO) f=251684 TT=1800.04 T1=1800.4	SAT (TO) f=1530 TT=1800.38 T1=1800.4	No data	No data	SAT (TO) f=5484 TT=1800.11 T1=710.64	No Cert. TT=1800.09	? (TO) TT=1800.12
/OPT-BIGINT-LIN/heinz/ normalized-n3seq24.opb	SAT f=280 TT=1800 T1=7.44	No data	No data	No data	? (TO) TT=1800.01	SAT f=6815 TT=762.199 T1=761.86	No data	No data	SAT (TO) f=280 TT=1800.16 T1=11.7	SAT (TO) f=280 TT=1800 T1=7.44	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/ heinz/ normalized-neos-941313.opb	SAT f=17524 TT=1800.05 T1=36.52	No data	No data	No data	? (TO) TT=1800.02	? (MO) TT=853.026	No data	No data	SAT (TO) f=17524 TT=1800.05 T1=36.52	No Cert. TT=1800.71	? (TO) TT=1800.04
/OPT-BIGINT-LIN/ heinz/ normalized-netdiversion.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	No data	? (TO) TT=1801.22	? (TO) TT=1800.03	? (TO) TT=1800.02
/OPT-BIGINT-LIN/heinz/ normalized-ns1663818.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.28	No data	No data	? (TO) TT=1800.66	? (TO) TT=1800.83	? (TO) TT=1800.36
/OPT-BIGINT-LIN/heinz/ normalized-ns1685374.opb	OPT f=-13 TT=523.886 T1=255.72	No data	No data	No data	SAT (TO) f=-8 TT=1800.1 T1=1800.4	SAT (TO) f=-7 TT=1800.09 T1=1800.4	No data	No data	OPT f=-13 TT=523.886 T1=255.72	? (TO) TT=1800.01	? (TO) TT=1800.05
/OPT-BIGINT-LIN/ heinz/ normalized-opm2-z10-s2.opb	SAT f=-19984 TT=1800.12 T1=133.73	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.17	No data	No data	SAT (TO) f=-19984 TT=1800.12 T1=133.73	SAT (TO) f=-19981 TT=1800.03 T1=1.31	? (TO) TT=1800.06
/OPT-BIGINT-LIN/ heinz/ normalized-opm2-z11-s8.opb	SAT f=-26981 TT=1800.06 T1=7.06	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.28	No data	No data	SAT (TO) f=-26981 TT=1800.06 T1=7.06	SAT (TO) f=-22943 TT=1800.08 T1=1.65	? (TO) TT=1800.1
/OPT-BIGINT-LIN/ heinz/ normalized-opm2-z12-s14.opb	SAT f=-38774 TT=1800.09 T1=390.16	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.4	No data	No data	SAT (TO) f=-38774 TT=1800.09 T1=390.16	SAT (TO) f=-38687 TT=1800.67 T1=2.05	? (TO) TT=1800.04
/OPT-BIGINT-LIN/ heinz/ normalized-opm2-z12-s7.opb	SAT f=-32138 TT=1800 T1=1.93	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.32	No data	No data	SAT (TO) f=-31820 TT=1800.54 T1=290.83	SAT (TO) f=-32138 TT=1800 T1=1.93	? (TO) TT=1800.02
/OPT-BIGINT-LIN/heinz/ normalized-opm2-z7-s2.opb	SAT f=-6346 TT=1800.15 T1=130.43	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	No data	SAT (TO) f=-6346 TT=1800.15 T1=130.43	SAT (TO) f=-4630 TT=1800.81 T1=1.14	? (TO) TT=1800.09
/OPT-BIGINT-LIN/ heinz/ normalized-opm2-z9-s14.opb	SAT f=-15963 TT=1800.07 T1=96.5	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.16	No data	No data	SAT (TO) f=-15963 TT=1800.07 T1=96.5	SAT (TO) f=-12538 TT=1800.81 T1=11.21	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/ heinz/normalized-sp97ar.opb	SAT f=2193774424000000011 TT=1800.04 T1=322.29	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	No data	SAT (TO) f=2193774424000000011 TT=1800.04 T1=322.29	SAT (TO) f=2194784492800000011 TT=1801.32 T1=2	? (MO) TT=322.986
/OPT-BIGINT-LIN/ heinz/normalized-sp98ar.opb	SAT f=1684166798400000016 TT=1800.81 T1=5.09	No data	No data	No data	SAT (TO) f=20314491131200000020 TT=1800.2 T1=1800.4	SAT (TO) f=14452021271999999909 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=1684166798400000016 TT=1800.81 T1=5.09	No Cert. TT=1800.07	? (MO) TT=290.978
/OPT-BIGINT-LIN/ heinz/normalized-sp98ic.opb	SAT f=629504033759999996 TT=1800.08 T1=665.59	No data	No data	No data	SAT (TO) f=15757628994080000031 TT=1800.03 T1=1800.3	SAT (TO) f=5596705514400000015 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=630323063039999996 TT=1800.16 T1=3.31	SAT (TO) f=629504033759999996 TT=1800.08 T1=665.59	? (MO) TT=292.087
/OPT-BIGINT-LIN/ heinz/normalized-stp3d.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	No data	? (TO) TT=1800.77	? (TO) TT=1800.73	? (TO) TT=1800.1
/OPT-BIGINT-LIN/ heinz/normalized-t1717.opb	SAT f=204519 TT=1800.24 T1=1800.3	No data	No data	No data	SAT (TO) f=204519 TT=1800.24 T1=1800.3	No Cert. TT=377.009	No data	No data	SAT (TO) f=333424 TT=1800.05 T1=3.78	No Cert. TT=1800.09	? (TO) TT=1800.11
/OPT-BIGINT-LIN/ heinz/normalized-t1722.opb	SAT f=195004 TT=1800.05 T1=1.05	No data	No data	No data	SAT (TO) f=224023 TT=1800.17 T1=1800.4	SAT (MO) f=232745 TT=200.002 T1=199.5	No data	No data	SAT (TO) f=204114 TT=1800.13 T1=5.08	SAT (TO) f=195004 TT=1800.05 T1=1.05	? (TO) TT=1800.07
/OPT-BIGINT-LIN/ heinz/normalized-zib01.opb		No data	No data	No data	? (MO) TT=282.637	? (MO) TT=280.464	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (MO) TT=213.531
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-codebreaker.cudf.paranoid.opb	OPT f=193395 TT=25.14 T1=25.01	No data	No data	No data	SAT (TO) f=5067444 TT=1800.1 T1=1800.5	OPT f=193395 TT=25.14 T1=25.01	No data	No data	OPT f=193395 TT=1587 T1=609.64	SAT (TO) f=219323 TT=1800.01 T1=552.22	? (TO) TT=1800.05
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-dwww.cudf.paranoid.opb	OPT f=176457 TT=33.076 T1=32.88	No data	No data	No data	SAT (TO) f=1441244 TT=1800.02 T1=1800.4	OPT f=176457 TT=33.076 T1=32.88	No data	No data	SAT (TO) f=180829 TT=1800.35 T1=904.29	No Cert. TT=1800.07	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/misc2010/ datasets/10orplus/normalized-epiphany-browser.cudf.paranoid.opb	OPT f=244977 TT=41.004 T1=40.7	No data	No data	No data	SAT (TO) f=6402455 TT=1800.04 T1=1800.4	OPT f=244977 TT=41.004 T1=40.7	No data	No data	SAT (TO) f=262422 TT=1800.2 T1=1188.18	SAT (TO) f=266678 TT=1800.03 T1=1106.04	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-evolution-dev.cudf.paranoid.opb	OPT f=197900 TT=37.064 T1=36.85	No data	No data	No data	SAT (TO) f=210908 TT=1800.05 T1=1800.5	OPT f=197900 TT=37.064 T1=36.85	No data	No data	SAT (TO) f=223749 TT=1800.45 T1=1084.43	SAT (TO) f=202277 TT=1800.04 T1=1336.72	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-hal-cups-utils.cudf.paranoid.opb	OPT f=141814 TT=24.759 T1=24.64	No data	No data	No data	SAT (TO) f=352491 TT=1800.04 T1=1800.4	OPT f=141814 TT=24.759 T1=24.64	No data	No data	OPT f=141814 TT=1284.98 T1=653.46	SAT (TO) f=146172 TT=1800.04 T1=1577.67	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-konq-plugins.cudf.paranoid.opb	OPT f=141778 TT=16.606 T1=16.52	No data	No data	No data	SAT (TO) f=4666864 TT=1800.09 T1=1800.5	OPT f=141778 TT=16.606 T1=16.52	No data	No data	OPT f=141778 TT=1344.9 T1=673.65	SAT (TO) f=141854 TT=1800 T1=1334.02	? (TO) TT=1800.1
/OPT-BIGINT-LIN/leberre/opb-paranoid/misc2010/ datasets/10orplus/normalized-libcatalyst-perl.cudf.paranoid.opb	OPT f=178324 TT=30.963 T1=30.77	No data	No data	No data	SAT (TO) f=5461136 TT=1800.05 T1=1800.4	OPT f=178324 TT=30.963 T1=30.77	No data	No data	SAT (TO) f=178324 TT=1800.29 T1=911.27	No Cert. TT=1800.04	? (TO) TT=1800.05
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-libcyrus-imap-perl22.cudf.paranoid.opb	OPT f=176246 TT=32.96 T1=32.77	No data	No data	No data	SAT (TO) f=4294228 TT=1800.04 T1=1800.4	OPT f=176246 TT=32.96 T1=32.77	No data	No data	SAT (TO) f=193466 TT=1800.31 T1=1047.67	No Cert. TT=1800.07	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-libhtml-parser-perl.cudf.paranoid.opb	OPT f=141778 TT=27.103 T1=26.95	No data	No data	No data	SAT (TO) f=2635124 TT=1800.12 T1=1800.5	OPT f=141778 TT=27.103 T1=26.95	No data	No data	OPT f=141778 TT=1374.81 T1=727.39	No Cert. TT=1800.05	? (TO) TT=1800.06
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-libpango-perl.cudf.paranoid.opb	OPT f=176205 TT=38.265 T1=37.99	No data	No data	No data	SAT (TO) f=5410065 TT=1800.04 T1=1800.4	OPT f=176205 TT=38.265 T1=37.99	No data	No data	OPT f=176205 TT=1059.1 T1=337.35	No Cert. TT=1800.06	? (TO) TT=1800.03
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-libpoe-perl.cudf.paranoid.opb	OPT f=176288 TT=23.202 T1=23.06	No data	No data	No data	SAT (TO) f=6400909 TT=1800.06 T1=1800.5	OPT f=176288 TT=23.202 T1=23.06	No data	No data	SAT (TO) f=176380 TT=1800.27 T1=892.57	No Cert. TT=1800.03	? (TO) TT=1800.04
/OPT-BIGINT-LIN/leberre/opb-paranoid/misc2010/datasets/ 10orplus/normalized-monodevelop-nunit.cudf.paranoid.opb	OPT f=142331 TT=21.343 T1=21.23	No data	No data	No data	SAT (TO) f=3970951 TT=1800.07 T1=1800.5	OPT f=142331 TT=21.343 T1=21.23	No data	No data	OPT f=142331 TT=928.004 T1=309	No Cert. TT=1800.01	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-python-cairo.cudf.paranoid.opb	OPT f=141778 TT=25.916 T1=25.76	No data	No data	No data	SAT (TO) f=5994777 TT=1800.03 T1=1800.4	OPT f=141778 TT=25.916 T1=25.76	No data	No data	OPT f=141778 TT=1191.77 T1=524.12	No Cert. TT=1800.08	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-python-hippocanvas.cudf.paranoid.opb	OPT f=167684 TT=30.195 T1=30.01	No data	No data	No data	SAT (TO) f=8339179 TT=1800.1 T1=1800.5	OPT f=167684 TT=30.195 T1=30.01	No data	No data	SAT (TO) f=167726 TT=1800.17 T1=929.44	SAT (TO) f=171992 TT=1800.73 T1=1447.6	? (TO) TT=1800.09
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-synaptic.cudf.paranoid.opb	OPT f=141778 TT=24.461 T1=24.3	No data	No data	No data	SAT (TO) f=4331559 TT=1800.12 T1=1800.5	OPT f=141778 TT=24.461 T1=24.3	No data	No data	OPT f=141778 TT=1148.78 T1=554.46	SAT (TO) f=141854 TT=1800.57 T1=1710.92	? (TO) TT=1800.11
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-system-config-printer.cudf.paranoid.opb	OPT f=141781 TT=23.318 T1=23.18	No data	No data	No data	SAT (TO) f=5650424 TT=1800.04 T1=1800.4	OPT f=141781 TT=23.318 T1=23.18	No data	No data	OPT f=141781 TT=1107.43 T1=555.68	No Cert. TT=1800.03	? (TO) TT=1800.03
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-txt2html.cudf.paranoid.opb	OPT f=176330 TT=30.734 T1=30.52	No data	No data	No data	SAT (TO) f=305336 TT=1800.08 T1=1800.4	OPT f=176330 TT=30.734 T1=30.52	No data	No data	SAT (TO) f=176331 TT=1800.23 T1=909.96	No Cert. TT=1800.45	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/10orplus/ normalized-unattended-upgrades.cudf.paranoid.opb	OPT f=158971 TT=28.33 T1=28.16	No data	No data	No data	SAT (TO) f=537109 TT=1800.05 T1=1800.4	OPT f=158971 TT=28.33 T1=28.16	No data	No data	SAT (TO) f=158971 TT=1800.16 T1=826.46	No Cert. TT=1800.06	? (TO) TT=1800.06
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-gtwitter.cudf.paranoid.opb	OPT f=141888 TT=27.194 T1=27.04	No data	No data	No data	SAT (TO) f=5324887 TT=1800.11 T1=1800.5	OPT f=141888 TT=27.194 T1=27.04	No data	No data	OPT f=141888 TT=614.542 T1=210.3	OPT f=141888 TT=1163.1 T1=511.09	? (TO) TT=1800.05
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-kdessh.cudf.paranoid.opb	OPT f=141778 TT=26.277 T1=26.11	No data	No data	No data	SAT (TO) f=6264786 TT=1800.09 T1=1800.5	OPT f=141778 TT=26.277 T1=26.11	No data	No data	OPT f=141778 TT=1250.39 T1=536.14	No Cert. TT=1800.02	? (TO) TT=1800.01
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-kjumpingcube.cudf.paranoid.opb	OPT f=141778 TT=32.131 T1=31.94	No data	No data	No data	SAT (TO) f=4024194 TT=1800.11 T1=1800.5	OPT f=141778 TT=32.131 T1=31.94	No data	No data	OPT f=141778 TT=1334.17 T1=647.44	No Cert. TT=1800.02	? (TO) TT=1800.03
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-kmines.cudf.paranoid.opb	OPT f=141778 TT=21.747 T1=21.64	No data	No data	No data	SAT (TO) f=4877487 TT=1800.13 T1=1800.5	OPT f=141778 TT=21.747 T1=21.64	No data	No data	OPT f=141778 TT=767.337 T1=289.23	No Cert. TT=1800.03	? (TO) TT=1800.08
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-kphotoalbum.cudf.paranoid.opb	OPT f=141778 TT=26.072 T1=25.91	No data	No data	No data	SAT (TO) f=5878367 TT=1800.09 T1=1800.5	OPT f=141778 TT=26.072 T1=25.91	No data	No data	OPT f=141778 TT=849.656 T1=317.61	SAT (TO) f=141850 TT=1800.03 T1=1693.27	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-libgnokii4.cudf.paranoid.opb	OPT f=146081 TT=29.894 T1=29.71	No data	No data	No data	SAT (TO) f=3785656 TT=1800.1 T1=1800.5	OPT f=146081 TT=29.894 T1=29.71	No data	No data	OPT f=146081 TT=1009.81 T1=459.31	No Cert. TT=1800.06	? (TO) TT=1800.01
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-libmono-relaxng1.0-cil.cudf.paranoid.opb	OPT f=141854 TT=32.793 T1=32.57	No data	No data	No data	SAT (TO) f=6247432 TT=1800.11 T1=1800.5	OPT f=141854 TT=32.793 T1=32.57	No data	No data	OPT f=141854 TT=1189.15 T1=542.46	SAT (TO) f=141854 TT=1800.04 T1=1470.8	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-mono-gac.cudf.paranoid.opb	OPT f=141778 TT=19.596 T1=19.49	No data	No data	No data	SAT (TO) f=1681153 TT=1800.07 T1=1800.4	OPT f=141778 TT=19.596 T1=19.49	No data	No data	OPT f=141778 TT=1270.57 T1=614.21	No Cert. TT=1800.06	? (TO) TT=1800.05
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-mono-mcs.cudf.paranoid.opb	OPT f=141778 TT=23.495 T1=23.35	No data	No data	No data	SAT (TO) f=3132968 TT=1800.09 T1=1800.5	OPT f=141778 TT=23.495 T1=23.35	No data	No data	OPT f=141778 TT=1358.43 T1=735.53	SAT (TO) f=142351 TT=1800.06 T1=1793.08	? (TO) TT=1800.01
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-plasma-widgets-workspace.cudf.paranoid.opb	OPT f=146133 TT=39.567 T1=39.28	No data	No data	No data	SAT (TO) f=5418902 TT=1800.09 T1=1800.5	OPT f=146133 TT=39.567 T1=39.28	No data	No data	OPT f=146133 TT=989.971 T1=473.22	No Cert. TT=1800.58	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-r-cran-car.cudf.paranoid.opb	OPT f=146110 TT=36.222 T1=36	No data	No data	No data	SAT (TO) f=4547195 TT=1800.13 T1=1800.5	OPT f=146110 TT=36.222 T1=36	No data	No data	OPT f=146110 TT=1246.62 T1=605.65	SAT (TO) f=146658 TT=1800.62 T1=1643.35	? (TO) TT=1800.09
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-r-cran-rodbc.cudf.paranoid.opb	OPT f=146110 TT=25.048 T1=24.93	No data	No data	No data	SAT (TO) f=3684005 TT=1800.13 T1=1800.5	OPT f=146110 TT=25.048 T1=24.93	No data	No data	OPT f=146110 TT=1363.84 T1=630.66	No Cert. TT=1800.58	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-tasque.cudf.paranoid.opb	OPT f=141990 TT=43.745 T1=43.41	No data	No data	No data	SAT (TO) f=163447 TT=1800.07 T1=1800.5	OPT f=141990 TT=43.745 T1=43.41	No data	No data	SAT (TO) f=141990 TT=1800.13 T1=455.32	SAT (TO) f=146288 TT=1800.01 T1=1471.03	? (TO) TT=1800.03
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/9orless/ normalized-upstart-compat-sysv.cudf.paranoid.opb	OPT f=154743 TT=18.685 T1=18.57	No data	No data	No data	SAT (TO) f=2713323 TT=1800.12 T1=1800.5	OPT f=154743 TT=18.685 T1=18.57	No data	No data	SAT (TO) f=154743 TT=1800.12 T1=915.23	No Cert. TT=1800.53	? (TO) TT=1800.02
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1131.cudf.paranoid.opb	UNSAT TT=0.406	No data	No data	No data	UNSAT TT=0.406	UNSAT TT=0.418	No data	No data	UNSAT TT=1.954	UNSAT TT=0.863	UNSAT TT=0.808
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1468.cudf.paranoid.opb	OPT f=6 TT=1.493 T1=0.65	No data	No data	No data	OPT f=6 TT=449.543 T1=449.41	OPT f=6 TT=5.083 T1=5.06	No data	No data	OPT f=6 TT=3.393 T1=1.36	OPT f=6 TT=1.493 T1=0.65	OPT f=6 TT=145.771 T1=145.71
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-520.cudf.paranoid.opb	UNSAT TT=0.329	No data	No data	No data	UNSAT TT=0.329	UNSAT TT=0.342	No data	No data	UNSAT TT=1.874	UNSAT TT=0.834	UNSAT TT=0.629
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-550.cudf.paranoid.opb	OPT f=2 TT=1.174 T1=0.56	No data	No data	No data	SAT (TO) f=68572 TT=1800.1 T1=1800.4	OPT f=2 TT=3.286 T1=3.27	No data	No data	OPT f=2 TT=2.836 T1=1.25	OPT f=2 TT=1.174 T1=0.56	OPT f=2 TT=23.371 T1=23.31
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand43bd88.cudf.paranoid.opb	OPT f=19007 TT=8.263 T1=8.22	No data	No data	No data	OPT f=19007 TT=1379.57 T1=1379.74	OPT f=19007 TT=8.263 T1=8.22	No data	No data	SAT (TO) f=19010 TT=1800.27 T1=586.87	SAT (TO) f=19017 TT=1800.7 T1=1600.36	OPT f=19007 TT=1302.04 T1=1300.2
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand5c0b12.cudf.paranoid.opb	UNSAT TT=0.347	No data	No data	No data	UNSAT TT=0.456	UNSAT TT=0.347	No data	No data	UNSAT TT=2.368	UNSAT TT=0.923	UNSAT TT=0.687
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand659e05.cudf.paranoid.opb	UNSAT TT=0.329	No data	No data	No data	UNSAT TT=0.433	UNSAT TT=0.329	No data	No data	UNSAT TT=2.393	UNSAT TT=0.914	UNSAT TT=0.689
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randee102b.cudf.paranoid.opb	OPT f=14734 TT=9.223 T1=9.18	No data	No data	No data	OPT f=14734 TT=423.992 T1=423.99	OPT f=14734 TT=9.223 T1=9.18	No data	No data	SAT (TO) f=14735 TT=1800.05 T1=8.33	SAT (TO) f=16787 TT=1800.71 T1=1.86	OPT f=14734 TT=1406.22 T1=1401.9
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand2fa1f8.cudf.paranoid.opb	UNSAT TT=0.147	No data	No data	No data	UNSAT TT=0.147	UNSAT TT=0.154	No data	No data	UNSAT TT=1.514	UNSAT TT=0.775	UNSAT TT=0.33
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand396cf8.cudf.paranoid.opb	OPT f=2369 TT=1.401 T1=0.67	No data	No data	No data	OPT f=2369 TT=263.496 T1=263.5	OPT f=2369 TT=1.401 T1=1.39	No data	No data	OPT f=2369 TT=18.031 T1=1.68	OPT f=2369 TT=23.4 T1=0.67	? (TO) TT=1800.01
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand49e642.cudf.paranoid.opb	OPT f=408 TT=2.594 T1=2.15	No data	No data	No data	OPT f=408 TT=1140.33 T1=1140.46	OPT f=408 TT=2.594 T1=2.58	No data	No data	OPT f=408 TT=6.683 T1=2.15	OPT f=408 TT=17.961 T1=12.56	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand56b853.cudf.paranoid.opb	OPT f=337 TT=1.854 T1=0.7	No data	No data	No data	OPT f=337 TT=463.307 T1=463.34	OPT f=337 TT=3.409 T1=3.39	No data	No data	OPT f=337 TT=4.683 T1=1.71	OPT f=337 TT=1.854 T1=0.7	? (TO) TT=1800.1
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand59f7dd.cudf.paranoid.opb	OPT f=344 TT=2.057 T1=2.05	No data	No data	No data	OPT f=344 TT=140.813 T1=140.74	OPT f=344 TT=2.057 T1=2.05	No data	No data	OPT f=344 TT=5.064 T1=2.13	OPT f=344 TT=6.973 T1=3.34	? (TO) TT=1800.11
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand682c92.cudf.paranoid.opb	UNSAT TT=0.143	No data	No data	No data	UNSAT TT=0.143	UNSAT TT=0.148	No data	No data	UNSAT TT=1.434	UNSAT TT=0.764	UNSAT TT=0.329
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand6c4744.cudf.paranoid.opb	UNSAT TT=0.167	No data	No data	No data	UNSAT TT=0.167	UNSAT TT=0.173	No data	No data	UNSAT TT=1.223	UNSAT TT=0.785	UNSAT TT=0.386
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rand88811a.cudf.paranoid.opb	OPT f=2256 TT=3.483 T1=3.46	No data	No data	No data	OPT f=2256 TT=844.145 T1=844.1	OPT f=2256 TT=3.483 T1=3.46	No data	No data	OPT f=2256 TT=7.265 T1=4.68	OPT f=2256 TT=12.082 T1=10.34	? (TO) TT=1800.09
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-randa65dfb.cudf.paranoid.opb	OPT f=2355 TT=1.72 T1=0.71	No data	No data	No data	OPT f=2355 TT=229.388 T1=229.36	OPT f=2355 TT=1.72 T1=1.71	No data	No data	OPT f=2355 TT=77.562 T1=1.7	OPT f=2355 TT=27.81 T1=0.71	? (TO) TT=1800.1
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-randab5933.cudf.paranoid.opb	UNSAT TT=0.158	No data	No data	No data	UNSAT TT=0.23	UNSAT TT=0.158	No data	No data	UNSAT TT=2.225	UNSAT TT=0.842	UNSAT TT=0.351
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-randd6bc17.cudf.paranoid.opb	OPT f=0 TT=1.073 T1=0.47	No data	No data	No data	OPT f=0 TT=294.665 T1=294.63	OPT f=0 TT=1.464 T1=1.45	No data	No data	OPT f=0 TT=2.453 T1=1.09	OPT f=0 TT=1.073 T1=0.47	OPT f=0 TT=8.784 T1=8.72
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-randdd5509.cudf.paranoid.opb	UNSAT TT=0.171	No data	No data	No data	UNSAT TT=0.25	UNSAT TT=0.171	No data	No data	UNSAT TT=2.134	UNSAT TT=0.843	UNSAT TT=0.404
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-rande22180.cudf.paranoid.opb	UNSAT TT=0.154	No data	No data	No data	UNSAT TT=0.226	UNSAT TT=0.154	No data	No data	UNSAT TT=2.114	UNSAT TT=0.844	UNSAT TT=0.338
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.smallist/ normalized-randea4da3.cudf.paranoid.opb	UNSAT TT=0.156	No data	No data	No data	UNSAT TT=0.229	UNSAT TT=0.156	No data	No data	UNSAT TT=2.144	UNSAT TT=0.844	UNSAT TT=0.348
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-gnochm.cudf.trendy.opb	OPT f=2786692279328 TT=44.915 T1=44.82	No data	No data	No data	? (TO) TT=1800.01	OPT f=2786692279328 TT=44.915 T1=44.82	No data	No data	SAT (TO) f=3343794393350 TT=1800 T1=3.82	SAT (TO) f=3347025629875 TT=1800 T1=424.82	? (TO) TT=1800.11
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-idle.cudf.trendy.opb	OPT f=3099786807987 TT=383.207 T1=382.97	No data	No data	No data	SAT (TO) f=207014356175619 TT=1800.02 T1=1800.3	OPT f=3099786807987 TT=383.207 T1=382.97	No data	No data	SAT (TO) f=4211756127699 TT=1800.14 T1=14.72	SAT (TO) f=3895666792409 TT=1800 T1=836.07	? (TO) TT=1800.08
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-konq-plugins.cudf.trendy.opb	OPT f=2624366011833 TT=90.697 T1=90.53	No data	No data	No data	? (TO) TT=1800.02	OPT f=2624366011833 TT=90.697 T1=90.53	No data	No data	SAT (TO) f=3191169301902 TT=1800.1 T1=561.68	SAT (TO) f=3259736893981 TT=1800.02 T1=2.72	? (TO) TT=1800.07
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/datasets/ 10orplus/normalized-libdbd-pg-perl.cudf.trendy.opb	OPT f=3256361088357 TT=103.857 T1=103.61	No data	No data	No data	? (TO) TT=1800.02	OPT f=3256361088357 TT=103.857 T1=103.61	No data	No data	SAT (TO) f=4369952646483 TT=1800.64 T1=203.22	SAT (TO) f=3892082463982 TT=1800.1 T1=2.92	? (TO) TT=1800.14
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-libpoe-perl.cudf.trendy.opb	OPT f=3260908559096 TT=58.299 T1=58.07	No data	No data	No data	SAT (TO) f=207872853017561 TT=1800.02 T1=1800.3	OPT f=3260908559096 TT=58.299 T1=58.07	No data	No data	SAT (TO) f=3817456746893 TT=1800.71 T1=6.89	SAT (TO) f=4131385228358 TT=1800.07 T1=5.04	? (TO) TT=1800.15
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-lirc.cudf.trendy.opb	OPT f=2626197245777 TT=375.169 T1=375.02	No data	No data	No data	SAT (TO) f=212088340226882 TT=1800.02 T1=1800.3	OPT f=2626197245777 TT=375.169 T1=375.02	No data	No data	SAT (TO) f=3500624331910 TT=1800.17 T1=627.7	SAT (TO) f=3262417696204 TT=1800.05 T1=2.78	? (TO) TT=1800.09
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-mercurial-common.cudf.trendy.opb	OPT f=2626215701393 TT=377.682 T1=377.52	No data	No data	No data	? (TO) TT=1800.02	OPT f=2626215701393 TT=377.682 T1=377.52	No data	No data	SAT (TO) f=3576809114828 TT=1800.03 T1=6.43	SAT (TO) f=3179754992195 TT=1800.05 T1=48.94	? (TO) TT=1800.09
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-monodevelop-nunit.cudf.trendy.opb	OPT f=2650173698357 TT=97.526 T1=97.26	No data	No data	No data	SAT (TO) f=181940481086383 TT=1800.02 T1=1800.3	OPT f=2650173698357 TT=97.526 T1=97.26	No data	No data	SAT (TO) f=3211672891301 TT=1800.01 T1=7.9	SAT (TO) f=3211988538473 TT=1800.04 T1=2.72	? (TO) TT=1800.12
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-sonata.cudf.trendy.opb	OPT f=2628047795598 TT=74.53 T1=74.22	No data	No data	No data	SAT (TO) f=199542835912469 TT=1800.02 T1=1800.3	OPT f=2628047795598 TT=74.53 T1=74.22	No data	No data	SAT (TO) f=3185205302234 TT=1800.78 T1=3.81	SAT (TO) f=3186608582116 TT=1800.05 T1=10.49	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-texlive-generic-recommended.cudf.trendy.opb	OPT f=2624366011833 TT=91.898 T1=91.74	No data	No data	No data	? (TO) TT=1800.02	OPT f=2624366011833 TT=91.898 T1=91.74	No data	No data	SAT (TO) f=3494881121701 TT=1800.12 T1=211.52	SAT (TO) f=3187627473142 TT=1800.04 T1=541.03	? (TO) TT=1800.06
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-txt2html.cudf.trendy.opb	OPT f=3263183881226 TT=202.37 T1=202.12	No data	No data	No data	SAT (TO) f=213178781298171 TT=1800.03 T1=1800.3	OPT f=3263183881226 TT=202.37 T1=202.12	No data	No data	SAT (TO) f=3818217750295 TT=1800.11 T1=508.39	SAT (TO) f=3820619214771 TT=1800.71 T1=1334.67	? (TO) TT=1800.08
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/10orplus/ normalized-xvfb.cudf.trendy.opb	OPT f=2626215701393 TT=389.439 T1=389.33	No data	No data	No data	SAT (TO) f=209551320517829 TT=1800.02 T1=1800.3	OPT f=2626215701393 TT=389.439 T1=389.33	No data	No data	SAT (TO) f=3182781713122 TT=1800.04 T1=620.79	SAT (TO) f=3182873991257 TT=1800.06 T1=2.73	? (TO) TT=1800.16
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-ark.cudf.trendy.opb	OPT f=2624366011833 TT=97.057 T1=96.89	No data	No data	No data	SAT (TO) f=197838882805629 TT=1800.02 T1=1800.3	OPT f=2624366011833 TT=97.057 T1=96.89	No data	No data	SAT (TO) f=3180506921595 TT=1800.07 T1=29.98	SAT (TO) f=3259736893911 TT=1800.08 T1=683.23	? (TO) TT=1800.07
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-gnash-common-opengl.cudf.trendy.opb	OPT f=2784767898449 TT=380.979 T1=380.82	No data	No data	No data	? (TO) TT=1800.02	OPT f=2784767898449 TT=380.979 T1=380.82	No data	No data	SAT (TO) f=3418939775530 TT=1800.09 T1=6.88	SAT (TO) f=3351687510677 TT=1800.08 T1=381.41	? (TO) TT=1800.1
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-gtwitter.cudf.trendy.opb	OPT f=2626197245822 TT=391.519 T1=391.18	No data	No data	No data	SAT (TO) f=188146257158043 TT=1800.03 T1=1800.3	OPT f=2626197245822 TT=391.519 T1=391.18	No data	No data	SAT (TO) f=3191548130683 TT=1800.54 T1=483.72	SAT (TO) f=3262140861976 TT=1800.05 T1=2.7	? (TO) TT=1800.11
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-inetutils-syslogd.cudf.trendy.opb	OPT f=2782825956584 TT=88.81 T1=88.67	No data	No data	No data	SAT (TO) f=211623330001726 TT=1800.02 T1=1800.3	OPT f=2782825956584 TT=88.81 T1=88.67	No data	No data	SAT (TO) f=3418252179731 TT=1800.21 T1=360.9	SAT (TO) f=3417698769078 TT=1800.69 T1=22.21	? (TO) TT=1800.08
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-kblocks.cudf.trendy.opb	OPT f=2701659046634 TT=99.807 T1=99.58	No data	No data	No data	SAT (TO) f=194907798109333 TT=1800.02 T1=1800.3	OPT f=2701659046634 TT=99.807 T1=99.58	No data	No data	SAT (TO) f=3257098969360 TT=1800.09 T1=794.05	SAT (TO) f=3257689274225 TT=1800.66 T1=12.81	? (TO) TT=1800.07
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-kommander.cudf.trendy.opb	OPT f=2624366011833 TT=103.543 T1=103.32	No data	No data	No data	SAT (TO) f=198156005612381 TT=1800.02 T1=1800.3	OPT f=2624366011833 TT=103.543 T1=103.32	No data	No data	SAT (TO) f=3180488474536 TT=1800 T1=371.9	SAT (TO) f=3180506921605 TT=1800.05 T1=2.7	? (TO) TT=1800.1
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-kphotoalbum.cudf.trendy.opb	OPT f=2624366011833 TT=99.508 T1=99.29	No data	No data	No data	SAT (TO) f=187935357623061 TT=1800.11 T1=1800.4	OPT f=2624366011833 TT=99.508 T1=99.29	No data	No data	SAT (TO) f=3184454584875 TT=1800.72 T1=140.01	SAT (TO) f=3259238824300 TT=1800.02 T1=5.99	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-libmono-addins-gui0.2-cil.cudf.trendy.opb	OPT f=2628029331434 TT=58.8 T1=58.58	No data	No data	No data	SAT (TO) f=206524854975315 TT=1800.02 T1=1800.3	OPT f=2628029331434 TT=58.8 T1=58.58	No data	No data	SAT (TO) f=3343739000711 TT=1800.09 T1=259.03	No Cert. TT=1800.08	? (TO) TT=1800.08
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-mono-gac.cudf.trendy.opb	OPT f=2624366011833 TT=102.087 T1=101.87	No data	No data	No data	SAT (TO) f=214555005002825 TT=1800.09 T1=1800.4	OPT f=2624366011833 TT=102.087 T1=101.87	No data	No data	SAT (TO) f=3111865541469 TT=1800.5 T1=427.34	SAT (TO) f=3180506921605 TT=1800.03 T1=2.73	? (TO) TT=1800.14
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-plasma-widgets-workspace.cudf.trendy.opb	OPT f=2701659046637 TT=99.294 T1=99.08	No data	No data	No data	SAT (TO) f=193164738717092 TT=1800.02 T1=1800.3	OPT f=2701659046637 TT=99.294 T1=99.08	No data	No data	SAT (TO) f=3257781509378 TT=1800.07 T1=3.81	SAT (TO) f=3186022581999 TT=1800.02 T1=37.08	? (TO) TT=1800.08
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/9orless/ normalized-r-cran-car.cudf.trendy.opb	OPT f=2704891992412 TT=394.987 T1=394.73	No data	No data	No data	SAT (TO) f=207807523184453 TT=1800.02 T1=1800.3	OPT f=2704891992412 TT=394.987 T1=394.73	No data	No data	SAT (TO) f=3340927886676 TT=1800.17 T1=8.38	SAT (TO) f=3186251368914 TT=1800.03 T1=71.34	? (TO) TT=1800.09
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-1093.cudf.trendy.opb	UNSAT TT=0.054	No data	No data	No data	UNSAT TT=0.054	UNSAT TT=0.055	No data	No data	UNSAT TT=0.683	UNSAT TT=0.574	UNSAT TT=0.117
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-1097.cudf.trendy.opb	OPT f=24774 TT=0.026 T1=0.02	No data	No data	No data	OPT f=24774 TT=0.03 T1=0.03	OPT f=24774 TT=0.026 T1=0.02	No data	No data	OPT f=24774 TT=0.714 T1=1.8	OPT f=24774 TT=0.455 T1=0.27	OPT f=24774 TT=0.189 T1=0.18
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-1098.cudf.trendy.opb	OPT f=102017 TT=0.069 T1=0.06	No data	No data	No data	OPT f=102017 TT=0.075 T1=0.07	OPT f=102017 TT=0.069 T1=0.06	No data	No data	OPT f=102017 TT=2.524 T1=0.89	OPT f=102017 TT=0.765 T1=0.36	OPT f=102017 TT=0.517 T1=0.5
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-121.cudf.trendy.opb	UNSAT TT=0.125	No data	No data	No data	UNSAT TT=0.125	UNSAT TT=0.129	No data	No data	UNSAT TT=1.355	UNSAT TT=0.664	UNSAT TT=0.273
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-1335.cudf.trendy.opb	UNSAT TT=0.411	No data	No data	No data	UNSAT TT=0.411	UNSAT TT=0.422	No data	No data	UNSAT TT=1.963	UNSAT TT=0.874	UNSAT TT=0.86
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-557.cudf.trendy.opb	UNSAT TT=0.296	No data	No data	No data	UNSAT TT=0.296	UNSAT TT=0.308	No data	No data	UNSAT TT=1.713	UNSAT TT=0.834	UNSAT TT=0.635
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-658.cudf.trendy.opb	UNSAT TT=0.019	No data	No data	No data	UNSAT TT=0.019	UNSAT TT=0.021	No data	No data	UNSAT TT=0.453	UNSAT TT=0.364	UNSAT TT=0.06
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/datasets/caixa/ normalized-902.cudf.trendy.opb	OPT f=283030 TT=0.861 T1=0.52	No data	No data	No data	OPT f=283030 TT=12.093 T1=12.09	OPT f=283030 TT=0.861 T1=0.86	No data	No data	OPT f=283030 TT=2.965 T1=1.95	OPT f=283030 TT=1.123 T1=0.52	OPT f=283030 TT=0.944 T1=0.92
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand0c02bc.cudf.trendy.opb	OPT f=23334331450 TT=7.012 T1=4.97	No data	No data	No data	SAT (TO) f=339624698744 TT=1800.06 T1=1800.4	OPT f=23334331450 TT=8.653 T1=8.63	No data	No data	OPT f=23334331450 TT=31.219 T1=15.33	OPT f=23334331450 TT=7.012 T1=4.97	? (TO) TT=1800.27
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand2d8467.cudf.trendy.opb	OPT f=41472152248 TT=6.134 T1=4.51	No data	No data	No data	SAT (TO) f=977689696894 TT=1800.1 T1=1800.4	OPT f=41472152248 TT=38.334 T1=38.32	No data	No data	OPT f=41472152248 TT=25.67 T1=20.85	OPT f=41472152248 TT=6.134 T1=4.51	? (TO) TT=1800.37
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand5c0b12.cudf.trendy.opb	UNSAT TT=0.373	No data	No data	No data	UNSAT TT=0.507	UNSAT TT=0.373	No data	No data	UNSAT TT=2.39	UNSAT TT=0.933	UNSAT TT=0.617
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand659e05.cudf.trendy.opb	UNSAT TT=0.333	No data	No data	No data	UNSAT TT=0.481	UNSAT TT=0.333	No data	No data	UNSAT TT=2.403	UNSAT TT=0.922	UNSAT TT=0.589
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand65d021.cudf.trendy.opb	UNSAT TT=0.432	No data	No data	No data	UNSAT TT=0.455	UNSAT TT=0.432	No data	No data	UNSAT TT=4.074	UNSAT TT=1.233	UNSAT TT=0.763
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand6d579e.cudf.trendy.opb	OPT f=28002816255 TT=8.483 T1=5.95	No data	No data	No data	SAT (TO) f=414030166312 TT=1800.08 T1=1800.4	OPT f=28002816255 TT=49.155 T1=49.13	No data	No data	OPT f=28002816255 TT=42.548 T1=27.89	OPT f=28002816255 TT=8.483 T1=5.95	? (TO) TT=1800.25
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-rand8177e7.cudf.trendy.opb	OPT f=27874403091 TT=25.88 T1=24.07	No data	No data	No data	SAT (TO) f=1480325019276 TT=1800.09 T1=1800.4	OPT f=27874403091 TT=59.986 T1=59.95	No data	No data	OPT f=27874403091 TT=151.56 T1=133.35	OPT f=27874403091 TT=25.88 T1=24.07	? (TO) TT=1800.48
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randa491d5.cudf.trendy.opb	UNSAT TT=0.457	No data	No data	No data	UNSAT TT=0.485	UNSAT TT=0.457	No data	No data	UNSAT TT=3.734	UNSAT TT=1.195	UNSAT TT=0.775
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randaefc7c.cudf.trendy.opb	OPT f=394243446 TT=2.365 T1=1.03	No data	No data	No data	SAT (TO) f=170749379100 TT=1800.1 T1=1800.4	OPT f=394243446 TT=16.4 T1=16.38	No data	No data	OPT f=394243446 TT=7.982 T1=6.42	OPT f=394243446 TT=2.365 T1=1.03	? (TO) TT=1800.27
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randb87834.cudf.trendy.opb	OPT f=36760393453 TT=6.383 T1=4.74	No data	No data	No data	SAT (TO) f=299467999872 TT=1800.08 T1=1800.4	OPT f=36760393453 TT=50.316 T1=50.28	No data	No data	OPT f=36760393453 TT=16.161 T1=10.86	OPT f=36760393453 TT=6.383 T1=4.74	? (TO) TT=1800.3
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randd1cab2.cudf.trendy.opb	OPT f=52432601474 TT=3.074 T1=1.67	No data	No data	No data	SAT (TO) f=519782177845 TT=1800.1 T1=1800.4	OPT f=52432601474 TT=8.072 T1=8.05	No data	No data	OPT f=52432601474 TT=12.822 T1=8.65	OPT f=52432601474 TT=3.074 T1=1.67	? (TO) TT=1800.13
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randee102b.cudf.trendy.opb	OPT f=56868381951 TT=6.932 T1=1.86	No data	No data	No data	? (TO) TT=1800.07	OPT f=56868381951 TT=32.54 T1=32.51	No data	No data	OPT f=56868381951 TT=12.961 T1=4.38	OPT f=56868381951 TT=6.932 T1=1.86	? (TO) TT=1800.59
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randf7d077.cudf.trendy.opb	UNSAT TT=0.478	No data	No data	No data	UNSAT TT=0.502	UNSAT TT=0.478	No data	No data	UNSAT TT=3.184	UNSAT TT=0.964	UNSAT TT=0.756
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.biglist/ normalized-randfe95e3.cudf.trendy.opb	UNSAT TT=0.3	No data	No data	No data	UNSAT TT=0.436	UNSAT TT=0.3	No data	No data	UNSAT TT=2.364	UNSAT TT=0.903	UNSAT TT=0.613
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand00ebc7.cudf.trendy.opb	UNSAT TT=0.268	No data	No data	No data	UNSAT TT=0.384	UNSAT TT=0.268	No data	No data	UNSAT TT=2.294	UNSAT TT=0.876	UNSAT TT=0.556
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand085d8a.cudf.trendy.opb	OPT f=22328675631 TT=3.384 T1=1.8	No data	No data	No data	? (TO) TT=1800.11	OPT f=22328675631 TT=6.134 T1=6.12	No data	No data	OPT f=22328675631 TT=9.052 T1=4.73	OPT f=22328675631 TT=3.384 T1=1.8	? (TO) TT=1800.36
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand0a62b6.cudf.trendy.opb	OPT f=18540641211 TT=2.775 T1=1.38	No data	No data	No data	? (TO) TT=1800.08	OPT f=18540641211 TT=75.751 T1=75.74	No data	No data	OPT f=18540641211 TT=6.824 T1=3.3	OPT f=18540641211 TT=2.775 T1=1.38	? (TO) TT=1800.22
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand271a0d.cudf.trendy.opb	UNSAT TT=0.253	No data	No data	No data	UNSAT TT=0.253	UNSAT TT=0.258	No data	No data	UNSAT TT=1.343	UNSAT TT=0.783	UNSAT TT=0.519
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand27da90.cudf.trendy.opb	OPT f=27562740203 TT=2.375 T1=1.21	No data	No data	No data	SAT (TO) f=492013208221 TT=1800.08 T1=1800.4	OPT f=27562740203 TT=43.457 T1=43.44	No data	No data	OPT f=27562740203 TT=6.802 T1=2.74	OPT f=27562740203 TT=2.375 T1=1.21	? (TO) TT=1800.39
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand362510.cudf.trendy.opb	OPT f=5239100859 TT=4.622 T1=3.33	No data	No data	No data	SAT (TO) f=597869366149 TT=1800.13 T1=1800.4	OPT f=5239100859 TT=21.265 T1=21.24	No data	No data	OPT f=5239100859 TT=20.03 T1=13.59	OPT f=5239100859 TT=4.622 T1=3.33	? (TO) TT=1800.17
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand5d20db.cudf.trendy.opb	OPT f=12384786448 TT=5.563 T1=3.85	No data	No data	No data	SAT (TO) f=318196678612 TT=1800.08 T1=1800.4	OPT f=12384786448 TT=9.47 T1=9.43	No data	No data	OPT f=12384786448 TT=88.252 T1=55.68	OPT f=12384786448 TT=5.563 T1=3.85	? (TO) TT=1800.13
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-rand767898.cudf.trendy.opb	OPT f=10741049961 TT=3.405 T1=2.15	No data	No data	No data	SAT (TO) f=337600269335 TT=1800.09 T1=1800.4	OPT f=10741049961 TT=122.646 T1=122.62	No data	No data	OPT f=10741049961 TT=7.394 T1=4.27	OPT f=10741049961 TT=3.405 T1=2.15	? (TO) TT=1800.29
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randb54299.cudf.trendy.opb	OPT f=25345912719 TT=2.754 T1=1.38	No data	No data	No data	SAT (TO) f=265178987103 TT=1800.06 T1=1800.4	OPT f=25345912719 TT=16.022 T1=16.01	No data	No data	OPT f=25345912719 TT=7.123 T1=4.26	OPT f=25345912719 TT=2.754 T1=1.38	? (TO) TT=1800.23
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randc18b26.cudf.trendy.opb	OPT f=30185484701 TT=3.282 T1=1.68	No data	No data	No data	SAT (TO) f=855579964034 TT=1800.03 T1=1800.3	OPT f=30185484701 TT=212.03 T1=212.02	No data	No data	OPT f=30185484701 TT=7.772 T1=5.33	OPT f=30185484701 TT=3.282 T1=1.68	? (TO) TT=1800.33
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randc5b1f2.cudf.trendy.opb	UNSAT TT=0.255	No data	No data	No data	UNSAT TT=0.255	UNSAT TT=0.259	No data	No data	UNSAT TT=1.395	UNSAT TT=0.783	UNSAT TT=0.531
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randc5fe62.cudf.trendy.opb	OPT f=4241573758 TT=3.602 T1=1.84	No data	No data	No data	? (TO) TT=1800.09	OPT f=4241573758 TT=27.74 T1=27.7	No data	No data	OPT f=4241573758 TT=8.912 T1=7.29	OPT f=4241573758 TT=3.602 T1=1.84	? (TO) TT=1800.38
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randd92c9f.cudf.trendy.opb	OPT f=13908610268 TT=2.614 T1=1.32	No data	No data	No data	SAT (TO) f=310551900637 TT=1800.1 T1=1800.4	OPT f=13908610268 TT=41.977 T1=41.95	No data	No data	OPT f=13908610268 TT=6.28 T1=6.27	OPT f=13908610268 TT=2.614 T1=1.32	? (TO) TT=1800.34
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randec6fe1.cudf.trendy.opb	OPT f=20182527402 TT=2.604 T1=1.28	No data	No data	No data	SAT (TO) f=295970059226 TT=1800.06 T1=1800.4	OPT f=20182527402 TT=15.477 T1=15.46	No data	No data	OPT f=20182527402 TT=5.912 T1=3.75	OPT f=20182527402 TT=2.604 T1=1.28	? (TO) TT=1800.32
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randf794d2.cudf.trendy.opb	OPT f=20204418175 TT=4.402 T1=2.92	No data	No data	No data	SAT (TO) f=378033697640 TT=1800.05 T1=1800.4	OPT f=20204418175 TT=20.419 T1=20.38	No data	No data	OPT f=20204418175 TT=10.103 T1=5.29	OPT f=20204418175 TT=4.402 T1=2.92	? (TO) TT=1800.3
/OPT-BIGINT-LIN/leberre/opb-trendy/ misc2010/random/rand.newlist/ normalized-randfd04d4.cudf.trendy.opb	OPT f=8960372673 TT=2.834 T1=1.56	No data	No data	No data	SAT (TO) f=267243906527 TT=1800.08 T1=1800.4	OPT f=8960372673 TT=51.142 T1=51.1	No data	No data	OPT f=8960372673 TT=7.963 T1=6.31	OPT f=8960372673 TT=2.834 T1=1.56	? (TO) TT=1800.24
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-rand03b0b5.cudf.trendy.opb	UNSAT TT=0.157	No data	No data	No data	UNSAT TT=0.158	UNSAT TT=0.157	No data	No data	UNSAT TT=1.575	UNSAT TT=0.735	UNSAT TT=0.357
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-rand1958fb.cudf.trendy.opb	OPT f=15832587875 TT=2.033 T1=0.64	No data	No data	No data	? (TO) TT=1800.08	OPT f=15832587875 TT=4.23 T1=4.22	No data	No data	OPT f=15832587875 TT=4.683 T1=1.21	OPT f=15832587875 TT=2.033 T1=0.64	? (TO) TT=1800.86
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-rand56b853.cudf.trendy.opb	OPT f=3334613 TT=1.865 T1=0.68	No data	No data	No data	SAT (TO) f=1345647108532 TT=1800 T1=1800.3	OPT f=3334613 TT=29.881 T1=29.87	No data	No data	OPT f=3334613 TT=4.712 T1=1.69	OPT f=3334613 TT=1.865 T1=0.68	? (TO) TT=1800.77
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-rand7e9372.cudf.trendy.opb	OPT f=502 TT=16.471 T1=1.25	No data	No data	No data	SAT (TO) f=3464720114991 TT=1800.02 T1=1800.3	OPT f=502 TT=26.996 T1=26.99	No data	No data	OPT f=502 TT=16.471 T1=5.19	OPT f=502 TT=144.65 T1=1.25	? (TO) TT=1800.79
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-randa65dfb.cudf.trendy.opb	OPT f=7514177838 TT=3.057 T1=0.93	No data	No data	No data	SAT (TO) f=1697115312998 TT=1800.09 T1=1800.4	OPT f=7514177838 TT=31.438 T1=31.43	No data	No data	OPT f=7514177838 TT=7.013 T1=3.24	OPT f=7514177838 TT=3.057 T1=0.93	? (TO) TT=1800.77
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-randcbf550.cudf.trendy.opb	UNSAT TT=0.147	No data	No data	No data	UNSAT TT=0.152	UNSAT TT=0.147	No data	No data	UNSAT TT=1.493	UNSAT TT=0.724	UNSAT TT=0.332
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-randcef367.cudf.trendy.opb	UNSAT TT=0.211	No data	No data	No data	UNSAT TT=0.302	UNSAT TT=0.211	No data	No data	UNSAT TT=2.344	UNSAT TT=0.864	UNSAT TT=0.41
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-randd6bc17.cudf.trendy.opb	OPT f=0 TT=1.254 T1=0.54	No data	No data	No data	SAT (TO) f=938759324699 TT=1800.01 T1=1800.3	OPT f=0 TT=9.718 T1=9.71	No data	No data	OPT f=0 TT=3.063 T1=1.15	OPT f=0 TT=1.254 T1=0.54	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-randdd5509.cudf.trendy.opb	UNSAT TT=0.182	No data	No data	No data	UNSAT TT=0.264	UNSAT TT=0.182	No data	No data	UNSAT TT=2.154	UNSAT TT=0.834	UNSAT TT=0.34
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/ rand.smallist/normalized-rande2165e.cudf.trendy.opb	OPT f=19002374606 TT=5.402 T1=0.74	No data	No data	No data	SAT (TO) f=324287446787 TT=1800.09 T1=1800.4	OPT f=19002374606 TT=33.129 T1=33.12	No data	No data	OPT f=19002374606 TT=5.402 T1=1.72	OPT f=19002374606 TT=18.422 T1=0.74	? (TO) TT=1800.79
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE1.0_TMAX120_K67_cod3.opb	SAT f=-53866 TT=1800.42 T1=1.81	No data	No data	No data	SAT (TO) f=-52427 TT=1800.07 T1=1800.4	SAT (MO) f=0 TT=312.722 T1=312.2	No data	No data	SAT (TO) f=-53743 TT=1800.11 T1=2.94	SAT (TO) f=-53866 TT=1800.42 T1=1.81	? (TO) TT=1800.06
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE1.0_TMAX180_K67_cod3.opb	SAT f=-169358 TT=1800.1 T1=2.4	No data	No data	No data	SAT (TO) f=-39905 TT=1800.06 T1=1800.4	SAT (MO) f=0 TT=511.033 T1=510.6	No data	No data	SAT (TO) f=-169358 TT=1800.1 T1=2.4	SAT (TO) f=-38425 TT=1800.61 T1=25.63	? (TO) TT=1800.12
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE1.0_TMAX300_K67_cod1.opb	SAT f=-215116 TT=1800.09 T1=3.52	No data	No data	No data	SAT (TO) f=-59331 TT=1800.08 T1=1800.4	SAT (MO) f=0 TT=408.004 T1=407.4	No data	No data	SAT (TO) f=-215116 TT=1800.09 T1=3.52	No Cert. TT=1585.7	? (TO) TT=1800.07
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_0null20mast_rapportOE2.0_TMAX120_K67_cod2.opb	SAT f=-111146 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-111146 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.05 T1=1800.4	No data	No data	SAT (TO) f=-44771 TT=1800.53 T1=900.4	SAT (TO) f=-43784 TT=1800.03 T1=304.12	? (TO) TT=1800.02
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_0null50mast_rapportOE1.0_TMAX300_K67_cod3.opb	SAT f=-321303 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-321303 TT=1800.08 T1=1800.4	SAT (MO) f=0 TT=1288.41 T1=1288.2	No data	No data	SAT (TO) f=-186090 TT=1800.04 T1=2.98	SAT (TO) f=-186108 TT=1800.03 T1=1.68	? (TO) TT=1800.19
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_10null10mast_rapportOE1.0_TMAX300_K67_cod3.opb	SAT f=-417922 TT=1800.12 T1=2.4	No data	No data	No data	SAT (TO) f=-134599 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.51 T1=1800.3	No data	No data	SAT (TO) f=-417922 TT=1800.12 T1=2.4	SAT (TO) f=-92153 TT=1800.08 T1=1.47	? (TO) TT=1800.1
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_10null50mast_rapportOE1.0_TMAX120_K67_cod3.opb	SAT f=-177724 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-177724 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.28 T1=1800.3	No data	No data	SAT (TO) f=-142298 TT=1800.05 T1=86.16	No Cert. TT=1800.72	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_20null0mast_rapportOE2.0_TMAX15_K67_cod1.opb	SAT f=-13530 TT=1800.01 T1=153.66	No data	No data	No data	SAT (TO) f=-4181 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.34 T1=1800.3	No data	No data	SAT (TO) f=-13530 TT=1800.03 T1=274.46	SAT (TO) f=-13530 TT=1800.01 T1=153.66	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_20null10mast_rapportOE1.0_TMAX120_K67_cod1.opb	SAT f=-199612 TT=1800.08 T1=15.51	No data	No data	No data	SAT (TO) f=-93637 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.48 T1=1800.3	No data	No data	SAT (TO) f=-199612 TT=1800.08 T1=15.51	SAT (TO) f=-51002 TT=1800.63 T1=8.6	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_20null50mast_rapportOE2.0_TMAX60_K67_cod2.opb	SAT f=-55717 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-55717 TT=1800.04 T1=1800.4	SAT (TO) f=0 TT=1800.05 T1=1800.4	No data	No data	SAT (TO) f=-3 TT=1800.37 T1=888.4	? (TO) TT=1800.37	? (TO) TT=1800.1
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null10mast_rapportOE1.0_TMAX15_K67_cod3.opb	SAT f=-8129 TT=1800.02 T1=1326.52	No data	No data	No data	SAT (TO) f=-7155 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.3 T1=1800.4	No data	No data	SAT (TO) f=-7142 TT=1800.08 T1=248.85	SAT (TO) f=-8129 TT=1800.02 T1=1326.52	? (TO) TT=1800.03
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null10mast_rapportOE2.0_TMAX300_K67_cod3.opb	SAT f=-212765 TT=1800.06 T1=672.11	No data	No data	No data	SAT (TO) f=-104107 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.4 T1=1800.4	No data	No data	SAT (TO) f=-212765 TT=1800.06 T1=672.11	SAT (TO) f=-65688 TT=1800.84 T1=1.35	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null10mast_rapportOE2.0_TMAX60_K67_cod1.opb	SAT f=-26505 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-26505 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.38 T1=1800.4	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.06
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null20mast_rapportOE1.0_TMAX15_K67_cod2.opb	SAT f=-12022 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-10946 TT=1800.06 T1=1800.4	SAT (TO) f=-12022 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=-10946 TT=1800.12 T1=209.18	No Cert. TT=1800.02	? (TO) TT=1800.14
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null20mast_rapportOE2.0_TMAX60_K67_cod1.opb	SAT f=-28937 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-28937 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.31 T1=1800.4	No data	No data	SAT (TO) f=0 TT=1800.02 T1=1.96	? (TO) TT=1800.04	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_0null50mast_rapportOE1.0_TMAX180_K67_cod1.opb	SAT f=-6685 TT=1800.11 T1=1800.5	No data	No data	No data	SAT (TO) f=-6685 TT=1800.11 T1=1800.5	SAT (TO) f=0 TT=1800.19 T1=1800.5	No data	No data	SAT (TO) f=-3356 TT=1800.1 T1=409.04	No Cert. TT=1750.99	? (TO) TT=1800.07
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null20mast_rapportOE2.0_TMAX300_K67_cod3.opb	SAT f=-4236 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-4236 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.44 T1=1800.6	No data	No data	SAT (TO) f=-3073 TT=1800.07 T1=12.3	SAT (TO) f=-1047 TT=1800.02 T1=1273.81	? (TO) TT=1800.05
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null50mast_rapportOE1.0_TMAX120_K67_cod1.opb	SAT f=-3363 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-3363 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.29 T1=1800.4	No data	No data	SAT (TO) f=-1282 TT=1800.09 T1=151.52	No Cert. TT=1800.71	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_20null50mast_rapportOE1.0_TMAX15_K67_cod1.opb	SAT f=-256 TT=1800.09 T1=440.04	No data	No data	No data	SAT (TO) f=-256 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.14 T1=1800.4	No data	No data	SAT (TO) f=-3 TT=1800.26 T1=883.37	SAT (TO) f=-256 TT=1800.51 T1=440.04	? (TO) TT=1800.07
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_50null20mast_rapportOE1.0_TMAX180_K67_cod3.opb	SAT f=-4397 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-4397 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.23 T1=1800.6	No data	No data	SAT (TO) f=-4352 TT=1800.08 T1=824.93	SAT (TO) f=-2310 TT=1801.32 T1=1.36	? (TO) TT=1800.01
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_50null20mast_rapportOE2.0_TMAX120_K67_cod1.opb	SAT f=-2308 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=-2308 TT=1800.12 T1=1800.4	SAT (TO) f=0 TT=1800.15 T1=1800.4	No data	No data	SAT (TO) f=-770 TT=1800.03 T1=8.61	SAT (TO) f=-770 TT=1800 T1=1.76	? (TO) TT=1800.06
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_0null50mast_rapportOE2.0_TMAX15_K67_cod1.opb	SAT f=-2277 TT=1800.15 T1=803.54	No data	No data	No data	SAT (TO) f=-1598 TT=1800.12 T1=1800.4	SAT f=0 TT=569.628 T1=569.18	No data	No data	SAT (TO) f=-2277 TT=1800.15 T1=803.54	No Cert. TT=1800.71	? (TO) TT=1800.03
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_10null50mast_rapportOE2.0_TMAX120_K67_cod3.opb	SAT f=-8039 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-8039 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.27 T1=1800.3	No data	No data	SAT (TO) f=-7157 TT=1800.13 T1=619.61	SAT (TO) f=-5045 TT=1800.08 T1=50.4	? (TO) TT=1800.1
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null0mast_rapportOE1.0_TMAX180_K67_cod1.opb	SAT f=-38598 TT=1800.05 T1=199.51	No data	No data	No data	SAT (TO) f=-30471 TT=1800.09 T1=1800.4	SAT f=0 TT=229.547 T1=228.98	No data	No data	SAT (TO) f=-38598 TT=1800.05 T1=199.51	SAT (TO) f=-3066 TT=1801.51 T1=206.76	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null10mast_rapportOE1.0_TMAX60_K67_cod1.opb	SAT f=-9148 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-9148 TT=1800.09 T1=1800.4	SAT (MO) f=0 TT=160.085 T1=159.5	No data	No data	SAT (TO) f=-5 TT=1800.14 T1=2.97	SAT (TO) f=0 TT=1800.4 T1=1.46	? (TO) TT=1800.02
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null10mast_rapportOE2.0_TMAX60_K67_cod1.opb	SAT f=-9401 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-9401 TT=1800.1 T1=1800.4	SAT f=0 TT=163.18 T1=162.63	No data	No data	SAT (TO) f=-1 TT=1800.13 T1=24.45	SAT (TO) f=0 TT=1800.07 T1=284.28	? (TO) TT=1800.06
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null10mast_rapportOE2.0_TMAX60_K67_cod3.opb	SAT f=-4957 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=-4957 TT=1800.06 T1=1800.4	SAT (TO) f=0 TT=1800.47 T1=1800.3	No data	No data	SAT (TO) f=-1000 TT=1800.13 T1=288.56	? (TO) TT=1800.09	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null20mast_rapportOE1.0_TMAX120_K67_cod1.opb	SAT f=-16586 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-16586 TT=1800.09 T1=1800.4	SAT (MO) f=0 TT=189.54 T1=189	No data	No data	SAT (TO) f=-9528 TT=1800.15 T1=14.12	SAT (TO) f=-9131 TT=1800.06 T1=1.78	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null50mast_rapportOE1.0_TMAX15_K67_cod3.opb	SAT f=-2434 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-2434 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.21 T1=1800.3	No data	No data	SAT (TO) f=-961 TT=1800.19 T1=803.94	No Cert. TT=1800.04	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_50null0mast_rapportOE1.0_TMAX300_K67_cod1.opb	SAT f=-65815 TT=1800.06 T1=126.11	No data	No data	No data	SAT (TO) f=-27351 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.45 T1=1800.3	No data	No data	SAT (TO) f=-65815 TT=1800.06 T1=126.11	SAT (TO) f=-8327 TT=1800.69 T1=1.58	? (TO) TT=1800.02
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_0null0mast_rapportOE2.0_TMAX15_K192_cod2.opb	SAT f=-7375 TT=1800.19 T1=1800.4	No data	No data	No data	SAT (TO) f=-7375 TT=1800.19 T1=1800.4	Signal TT=19.187	No data	No data	SAT (TO) f=-1 TT=1800.51 T1=58.58	? (TO) TT=1800.08	? (TO) TT=1800.12
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_0null10mast_rapportOE1.0_TMAX180_K192_cod1.opb		No data	No data	No data	Signal TT=32.309	Signal TT=21.385	No data	No data	? (TO) TT=1800.06	No Cert. TT=1800.31	? (TO) TT=1800.21
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_0null50mast_rapportOE2.0_TMAX300_K192_cod2.opb	SAT f=-125093 TT=1800.12 T1=1800.3	No data	No data	No data	SAT (TO) f=-125093 TT=1800.12 T1=1800.3	Signal TT=19.179	No data	No data	SAT (TO) f=0 TT=1800.45 T1=13.04	No Cert. TT=1800.87	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_10null0mast_rapportOE1.0_TMAX180_K192_cod1.opb	SAT f=0 TT=1800 T1=31.36	No data	No data	No data	Signal TT=31.832	Signal TT=21.303	No data	No data	SAT (TO) f=0 TT=1800 T1=31.36	No Cert. TT=1800.76	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_10null10mast_rapportOE1.0_TMAX15_K192_cod1.opb	SAT f=-10947 TT=1800.48 T1=22.88	No data	No data	No data	Signal TT=32.744	Signal TT=21.46	No data	No data	SAT (TO) f=-10947 TT=1800.48 T1=22.88	? (TO) TT=1800.04	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_10null10mast_rapportOE1.0_TMAX300_K192_cod1.opb	SAT f=-54730 TT=1800.5 T1=10.69	No data	No data	No data	Signal TT=33.701	Signal TT=21.404	No data	No data	SAT (TO) f=-54730 TT=1800.5 T1=10.69	SAT f=-9459 TT=1185.5 T1=11.07	? (TO) TT=1800.17
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_10null10mast_rapportOE2.0_TMAX15_K192_cod1.opb		No data	No data	No data	Signal TT=33.597	Signal TT=21.471	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.71	? (TO) TT=1800.05
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_20null20mast_rapportOE2.0_TMAX120_K192_cod1.opb		No data	No data	No data	Signal TT=32.242	Signal TT=21.572	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.17
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_20null50mast_rapportOE1.0_TMAX300_K192_cod2.opb	SAT f=-458472 TT=1800.13 T1=1800.3	No data	No data	No data	SAT (TO) f=-458472 TT=1800.13 T1=1800.3	Signal TT=19.019	No data	No data	SAT (TO) f=0 TT=1800.37 T1=13.04	? (TO) TT=1800.05	? (TO) TT=1800.11
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_20null50mast_rapportOE1.0_TMAX60_K192_cod1.opb		No data	No data	No data	Signal TT=32.163	Signal TT=21.481	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_50null10mast_rapportOE2.0_TMAX15_K192_cod2.opb	SAT f=-9349 TT=1800.13 T1=1800.3	No data	No data	No data	SAT (TO) f=-9349 TT=1800.13 T1=1800.3	Signal TT=19.357	No data	No data	SAT (TO) f=0 TT=1800.37 T1=403.75	No Cert. TT=1800.23	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_50null10mast_rapportOE2.0_TMAX180_K192_cod1.opb	SAT f=-10947 TT=1801.19 T1=18.31	No data	No data	No data	Signal TT=32.199	Signal TT=21.121	No data	No data	SAT (TO) f=-10947 TT=1801.19 T1=18.31	? (TO) TT=1800.07	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_50null20mast_rapportOE2.0_TMAX15_K192_cod2.opb	SAT f=-8362 TT=1800.12 T1=1800.3	No data	No data	No data	SAT (TO) f=-8362 TT=1800.12 T1=1800.3	Signal TT=19.235	No data	No data	SAT (TO) f=0 TT=1800.04 T1=9.01	? (TO) TT=1800.8	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_0null10mast_rapportOE1.0_TMAX300_K192_cod1.opb	SAT f=-2159 TT=846.365 T1=10.67	No data	No data	No data	Signal TT=32.209	Signal TT=21.313	No data	No data	? (TO) TT=1801.99	SAT f=-2159 TT=846.365 T1=10.67	? (TO) TT=1800.17
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX60_K192_cod1.opb		No data	No data	No data	Signal TT=32.14	Signal TT=21.316	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null10mast_rapportOE2.0_TMAX15_K192_cod1.opb		No data	No data	No data	Signal TT=33.326	Signal TT=21.643	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.81	? (TO) TT=1800.11
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null10mast_rapportOE2.0_TMAX60_K192_cod1.opb		No data	No data	No data	Signal TT=31.957	Signal TT=21.349	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.21	? (TO) TT=1800.1
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null50mast_rapportOE2.0_TMAX60_K192_cod1.opb		No data	No data	No data	Signal TT=33.251	Signal TT=21.84	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.2
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_20null20mast_rapportOE1.0_TMAX300_K192_cod1.opb	SAT f=-2217 TT=709.206 T1=12.21	No data	No data	No data	Signal TT=31.813	Signal TT=21.334	No data	No data	? (TO) TT=1803.18	SAT f=-2217 TT=709.206 T1=12.21	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_20null20mast_rapportOE2.0_TMAX120_K192_cod1.opb	SAT f=-1025 TT=1800.12 T1=17.85	No data	No data	No data	Signal TT=32.9	Signal TT=21.393	No data	No data	SAT (TO) f=-1025 TT=1800.12 T1=17.85	No Cert. TT=1801.02	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_20null20mast_rapportOE2.0_TMAX300_K192_cod1.opb	SAT f=-2101 TT=1253.29 T1=10.19	No data	No data	No data	Signal TT=32.3	Signal TT=21.527	No data	No data	? (TO) TT=1802.05	SAT f=-2101 TT=1253.29 T1=10.19	? (TO) TT=1800.09
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null20mast_rapportOE1.0_TMAX180_K192_cod1.opb	SAT f=-1026 TT=1800.1 T1=341.5	No data	No data	No data	Signal TT=31.954	Signal TT=21.15	No data	No data	SAT (TO) f=-1026 TT=1800.1 T1=341.5	No Cert. TT=1801.12	? (TO) TT=1800.08
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null50mast_rapportOE2.0_TMAX300_K192_cod1.opb	SAT f=-4096 TT=1800.43 T1=326.42	No data	No data	No data	Signal TT=32.304	Signal TT=21.289	No data	No data	SAT (TO) f=-4096 TT=1800.43 T1=326.42	No Cert. TT=1800.98	? (TO) TT=1800.17
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_0null20mast_rapportOE2.0_TMAX120_K192_cod2.opb	SAT f=-9509 TT=1800.13 T1=1800.3	No data	No data	No data	SAT (TO) f=-9509 TT=1800.13 T1=1800.3	Signal TT=18.956	No data	No data	SAT (TO) f=0 TT=1800.42 T1=11.92	? (TO) TT=1800.51	? (TO) TT=1800.07
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_0null50mast_rapportOE1.0_TMAX300_K192_cod1.opb	SAT f=-23356 TT=1800.91 T1=668.33	No data	No data	No data	Signal TT=32.326	Signal TT=21.431	No data	No data	SAT (TO) f=-12527 TT=1800.18 T1=25.8	SAT (TO) f=-23356 TT=1800.91 T1=668.33	? (TO) TT=1800.15
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_10null0mast_rapportOE2.0_TMAX300_K192_cod1.opb		No data	No data	No data	Signal TT=33.772	Signal TT=24.263	No data	No data	? (TO) TT=1748.48	No Cert. TT=1800.28	? (TO) TT=1800.11
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_10null0mast_rapportOE2.0_TMAX60_K192_cod1.opb	SAT f=0 TT=1800.15 T1=239.78	No data	No data	No data	Signal TT=32.366	Signal TT=21.971	No data	No data	SAT (TO) f=0 TT=1800.15 T1=239.78	? (TO) TT=1800.53	? (TO) TT=1800.11
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX120_K192_cod1.opb		No data	No data	No data	Signal TT=33.078	Signal TT=21.856	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.72	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX180_K192_cod1.opb		No data	No data	No data	Signal TT=32.345	Signal TT=21.76	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.73	? (TO) TT=1800.02
/OPT-BIGINT-LIN/sroussel/NG/ normalized-NG.dot_unif_50null50mast_rapportOE1.0_TMAX15_K192_cod1.opb		No data	No data	No data	Signal TT=33.371	Signal TT=21.097	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.75	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_2.opb	SAT f=8525853 TT=1800.03 T1=1.25	No data	No data	No data	SAT (TO) f=254330285 TT=1800.03 T1=1800.3	? (TO) TT=1800.01	No data	No data	SAT (TO) f=29286999 TT=1800.07 T1=388.24	SAT (TO) f=8525853 TT=1800.03 T1=1.25	? (TO) TT=1800.01
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_3.opb	SAT f=9945255 TT=1800.19 T1=42.58	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	SAT (TO) f=9945255 TT=1800.19 T1=42.58	? (TO) TT=1800.58	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_4.opb	SAT f=10590801 TT=1800.02 T1=3.03	No data	No data	No data	SAT (TO) f=289387061 TT=1800.03 T1=1800.3	SAT (TO) f=188709839 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=10590801 TT=1800.02 T1=3.03	SAT (TO) f=16135109 TT=1800.77 T1=2.74	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_6.opb	SAT f=7625357 TT=1800.78 T1=1.35	No data	No data	No data	SAT (TO) f=234348069 TT=1800.03 T1=1800.3	SAT (TO) f=195157041 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=50701081 TT=1800 T1=1.99	SAT (TO) f=7625357 TT=1800.78 T1=1.35	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_7.opb	SAT f=8580043 TT=1800.16 T1=25.14	No data	No data	No data	SAT (TO) f=299840465 TT=1800.03 T1=1800.3	SAT (TO) f=92601421 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=8580043 TT=1800.16 T1=25.14	SAT (TO) f=36966529 TT=1800.02 T1=1.65	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_8.opb	SAT f=6474781 TT=1800.07 T1=111.97	No data	No data	No data	SAT (TO) f=99726255 TT=1800.03 T1=1800.3	SAT (TO) f=99463641 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=7056807 TT=1800.09 T1=2.01	SAT (TO) f=6474781 TT=1800.07 T1=111.97	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat100_4_32_9.opb	SAT f=5405739 TT=1800.69 T1=1.18	No data	No data	No data	SAT (TO) f=280755849 TT=1800.03 T1=1800.3	SAT (TO) f=197478829 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=14891019 TT=1800.67 T1=1.96	SAT (TO) f=5405739 TT=1800.69 T1=1.18	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_0.opb	SAT f=2928469 TT=1800.55 T1=46.86	No data	No data	No data	SAT (TO) f=79672457 TT=1800.03 T1=1800.3	SAT (TO) f=142131429 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=2928469 TT=1800.55 T1=46.86	SAT (TO) f=3372641 TT=1800.01 T1=0.77	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_1.opb	SAT f=4846877 TT=1800.45 T1=746.37	No data	No data	No data	SAT (TO) f=258418101 TT=1800.03 T1=1800.3	SAT (TO) f=354465287 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=4846877 TT=1800.45 T1=746.37	SAT (TO) f=5565577 TT=1800.67 T1=0.68	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_2.opb	SAT f=3406405 TT=1800.51 T1=617.36	No data	No data	No data	SAT (TO) f=309196317 TT=1800.02 T1=1800.3	SAT (TO) f=240220793 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=3406405 TT=1800.51 T1=617.36	SAT (TO) f=3406633 TT=1800.76 T1=0.79	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_5.opb	SAT f=6012437 TT=1800.14 T1=0.92	No data	No data	No data	SAT (TO) f=213186229 TT=1800.03 T1=1800.3	SAT (TO) f=347443083 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=6012437 TT=1800.14 T1=5.75	SAT (TO) f=6012437 TT=1800.76 T1=0.92	? (TO) TT=1800.02
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_6.opb	SAT f=5473551 TT=1800.1 T1=1.13	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=148308993 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=5473551 TT=1800.1 T1=1.13	SAT (TO) f=5905423 TT=1800.08 T1=21.69	? (TO) TT=1800.11
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_8.opb	SAT f=3840169 TT=1800.05 T1=3.64	No data	No data	No data	SAT (TO) f=209186739 TT=1800.02 T1=1800.3	? (TO) TT=1800.01	No data	No data	SAT (TO) f=3840169 TT=1800.05 T1=3.64	SAT (TO) f=3841241 TT=1800.71 T1=0.61	? (MO) TT=828.93
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat50_4_16_9.opb	SAT f=3169501 TT=1800.85 T1=6.19	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=45298241 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=3169501 TT=1800.85 T1=6.19	SAT (TO) f=3194111 TT=1800.69 T1=0.72	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_0.opb	SAT f=4276771 TT=1800.04 T1=1.13	No data	No data	No data	? (TO) TT=1800.03	SAT (TO) f=299411491 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=4278795 TT=1800.61 T1=4.38	SAT (TO) f=4276771 TT=1800.04 T1=1.13	? (TO) TT=1800.1
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_2.opb	SAT f=3947303 TT=1800.02 T1=0.84	No data	No data	No data	SAT (TO) f=123108567 TT=1800.03 T1=1800.3	SAT (TO) f=92294249 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=3967909 TT=1800.06 T1=1.21	SAT (TO) f=3947303 TT=1800.02 T1=0.84	? (MO) TT=381.357
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_3.opb	SAT f=4527423 TT=1800 T1=1.48	No data	No data	No data	SAT (TO) f=121509273 TT=1800.03 T1=1800.3	SAT (TO) f=78160273 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=4535839 TT=1800.7 T1=11.28	SAT (TO) f=4527423 TT=1800 T1=1.48	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_4.opb	SAT f=3447571 TT=1800 T1=11.65	No data	No data	No data	SAT (TO) f=52717207 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	No data	No data	SAT (TO) f=3447571 TT=1800 T1=11.65	SAT (TO) f=3471965 TT=1800.72 T1=0.86	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_5.opb	SAT f=4583443 TT=1800.05 T1=1.14	No data	No data	No data	SAT (TO) f=212197845 TT=1800.03 T1=1800.3	? (TO) TT=1800.09	No data	No data	SAT (TO) f=4617061 TT=1800.66 T1=2.84	SAT (TO) f=4583443 TT=1800.05 T1=1.14	? (TO) TT=1800.12
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_6.opb	SAT f=5295317 TT=1800.07 T1=1.28	No data	No data	No data	SAT (TO) f=289193773 TT=1800.03 T1=1800.3	SAT (TO) f=143482995 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=5295317 TT=1800.62 T1=3.09	SAT (TO) f=5295317 TT=1800.07 T1=1.28	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_7.opb	SAT f=4630639 TT=1800.02 T1=219.89	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=231427259 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=4630639 TT=1800.02 T1=219.89	SAT (TO) f=4636291 TT=1800.81 T1=1.14	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_8.opb	SAT f=6479021 TT=1800.1 T1=1.23	No data	No data	No data	SAT (TO) f=139559407 TT=1800.06 T1=1800.4	SAT (TO) f=164891879 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=6479021 TT=1800.1 T1=1.23	? (TO) TT=1800.9	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat70_4_22_9.opb	SAT f=4072923 TT=1800.13 T1=3.26	No data	No data	No data	SAT (TO) f=321498321 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	No data	No data	SAT (TO) f=4072923 TT=1800.13 T1=3.26	SAT (TO) f=4081443 TT=1800.56 T1=0.8	? (TO) TT=1800.11
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_0.opb	SAT f=6470919 TT=1800.01 T1=1.27	No data	No data	No data	SAT (TO) f=210584099 TT=1800.03 T1=1800.3	SAT (TO) f=344589727 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=8581761 TT=1800.81 T1=3.69	SAT (TO) f=6470919 TT=1800.01 T1=1.27	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_1.opb	SAT f=5230471 TT=1800.73 T1=1	No data	No data	No data	SAT (TO) f=54980695 TT=1800.03 T1=1800.3	? (TO) TT=1800.09	No data	No data	SAT (TO) f=6286047 TT=1800.69 T1=93.45	SAT (TO) f=5230471 TT=1800.73 T1=1	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_4.opb	SAT f=6700817 TT=1800.76 T1=1.33	No data	No data	No data	SAT (TO) f=66999239 TT=1800.03 T1=1800.3	? (TO) TT=1800.09	No data	No data	SAT (TO) f=7445797 TT=1800.7 T1=1.36	SAT (TO) f=6700817 TT=1800.76 T1=1.33	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_5.opb	SAT f=5202779 TT=1800.57 T1=0.98	No data	No data	No data	SAT (TO) f=269615819 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	No data	No data	SAT (TO) f=44339077 TT=1800.11 T1=2.35	SAT (TO) f=5202779 TT=1800.57 T1=0.98	? (TO) TT=1800.02
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_7.opb	SAT f=12818063 TT=1800.13 T1=85.08	No data	No data	No data	? (TO) TT=1800.03	SAT (TO) f=127777795 TT=1800.07 T1=1800.4	No data	No data	SAT (TO) f=12818063 TT=1800.13 T1=85.08	SAT (TO) f=14902415 TT=1800.56 T1=1.02	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_8.opb	SAT f=4486431 TT=1800.77 T1=2.75	No data	No data	No data	SAT (TO) f=56352867 TT=1800.03 T1=1800.3	SAT (TO) f=283422781 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=6564171 TT=1800.09 T1=255.85	SAT (TO) f=4486431 TT=1800.77 T1=2.75	? (TO) TT=1800.02
/OPT-BIGINT-LIN/zahidi/ Base/ normalized-minisat85_4_27_9.opb	SAT f=5327765 TT=1800 T1=1.42	No data	No data	No data	SAT (TO) f=104119813 TT=1800.03 T1=1800.3	SAT (TO) f=150220133 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=5327765 TT=1800 T1=1.42	SAT (TO) f=82408871 TT=1800.05 T1=1	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_0_ic.opb	OPT f=5767234 TT=1.953 T1=0.58	No data	No data	No data	SAT (TO) f=210355568 TT=1800.02 T1=1800.3	OPT f=5767234 TT=596.988 T1=596.81	No data	No data	OPT f=5767234 TT=4.244 T1=1.93	OPT f=5767234 TT=1.953 T1=0.58	? (MO) TT=290.688
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_1_ic.opb	OPT f=18260924 TT=2.043 T1=0.54	No data	No data	No data	SAT (TO) f=401010728 TT=1800.02 T1=1800.3	OPT f=18260924 TT=693.281 T1=693.17	No data	No data	OPT f=18260924 TT=4.594 T1=2.44	OPT f=18260924 TT=2.043 T1=0.54	? (MO) TT=283.84
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_2_ic.opb	OPT f=6838116 TT=5.015 T1=0.64	No data	No data	No data	? (TO) TT=1800.02	OPT f=6838116 TT=726.875 T1=726.77	No data	No data	OPT f=6838116 TT=10.053 T1=4.47	OPT f=6838116 TT=5.015 T1=0.64	? (MO) TT=260.692
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_3_ic.opb	OPT f=5900212 TT=3.294 T1=0.55	No data	No data	No data	SAT (TO) f=214329880 TT=1800.02 T1=1800.3	OPT f=5900212 TT=737.486 T1=737.42	No data	No data	OPT f=5900212 TT=7.744 T1=1.95	OPT f=5900212 TT=3.294 T1=0.55	? (exit code) TT=337.41
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_4_ic.opb	OPT f=4225708 TT=3.209 T1=2.13	No data	No data	No data	SAT (TO) f=284948344 TT=1800.03 T1=1800.3	OPT f=4225708 TT=671.664 T1=671.56	No data	No data	OPT f=4225708 TT=6.511 T1=4.96	OPT f=4225708 TT=3.209 T1=2.13	? (MO) TT=477.938
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_5_ic.opb	OPT f=2624620 TT=1.984 T1=0.55	No data	No data	No data	SAT (TO) f=100173948 TT=1800.02 T1=1800.3	OPT f=2624620 TT=541.253 T1=541.13	No data	No data	OPT f=2624620 TT=4.481 T1=2.46	OPT f=2624620 TT=1.984 T1=0.55	? (MO) TT=295.694
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_6_ic.opb	OPT f=8489816 TT=2.254 T1=0.95	No data	No data	No data	SAT (TO) f=344007854 TT=1800.03 T1=1800.3	OPT f=8489816 TT=503.933 T1=503.88	No data	No data	OPT f=8489816 TT=4.964 T1=2.44	OPT f=8489816 TT=2.254 T1=0.95	? (MO) TT=222.375
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_7_ic.opb	OPT f=16633202 TT=3.853 T1=1.8	No data	No data	No data	SAT (TO) f=391369252 TT=1800.03 T1=1800.3	OPT f=16633202 TT=687.558 T1=687.42	No data	No data	OPT f=16633202 TT=10.271 T1=7.46	OPT f=16633202 TT=3.853 T1=1.8	? (MO) TT=161.015
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_8_ic.opb	OPT f=5065770 TT=2.025 T1=0.53	No data	No data	No data	? (TO) TT=1800.02	OPT f=5065770 TT=736.191 T1=736.09	No data	No data	OPT f=5065770 TT=4.393 T1=1.43	OPT f=5065770 TT=2.025 T1=0.53	? (MO) TT=284.097
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat15_5_3_9_ic.opb	OPT f=7836062 TT=2.734 T1=0.43	No data	No data	No data	SAT (TO) f=429633624 TT=1800.03 T1=1800.3	OPT f=7836062 TT=643.784 T1=643.7	No data	No data	OPT f=7836062 TT=6.453 T1=0.94	OPT f=7836062 TT=2.734 T1=0.43	? (MO) TT=213.306
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_0_ic.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.72	? (TO) TT=1800	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_1_ic.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	No data	? (TO) TT=1800.88	? (TO) TT=1800.01	? (TO) TT=1800.02
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_2_ic.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.75	? (TO) TT=1800.09	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_3_ic.opb		No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_4_ic.opb		No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_5_ic.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_6_ic.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.67	? (TO) TT=1800.04	? (TO) TT=1800.1
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_7_ic.opb		No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.56	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_8_ic.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	No data	? (TO) TT=1800.81	? (TO) TT=1800.07	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat25_6_3_9_ic.opb		No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.03
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_0_ic.opb	SAT f=22753379 TT=1800.03 T1=9.18	No data	No data	No data	SAT (TO) f=335630297 TT=1800.09 T1=1800.4	? (TO) TT=1800.08	No data	No data	SAT (TO) f=72136569 TT=1800.4 T1=896.65	SAT (TO) f=22753379 TT=1800.03 T1=9.18	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_1_ic.opb	SAT f=24465097 TT=1800.04 T1=4.88	No data	No data	No data	? (TO) TT=1800.08	SAT (TO) f=429877983 TT=1800.13 T1=1800.4	No data	No data	SAT (TO) f=24465097 TT=1800.04 T1=4.88	SAT (TO) f=29595515 TT=1800 T1=2.88	? (TO) TT=1800.23
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_2_ic.opb	SAT f=20594351 TT=1800.97 T1=4.39	No data	No data	No data	SAT (TO) f=149821303 TT=1800.08 T1=1800.5	SAT (TO) f=401774313 TT=1800.12 T1=1800.4	No data	No data	SAT (TO) f=20594351 TT=1800.97 T1=4.39	No Cert. TT=1800.03	? (TO) TT=1800.09
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_3_ic.opb	SAT f=19457339 TT=1800.09 T1=2.95	No data	No data	No data	SAT (TO) f=451213043 TT=1800.13 T1=1800.6	? (TO) TT=1800.07	No data	No data	SAT (TO) f=28461739 TT=1800.86 T1=8.34	SAT (TO) f=19457339 TT=1800.09 T1=2.95	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_4_ic.opb	SAT f=24067041 TT=1801.38 T1=3.02	No data	No data	No data	SAT (TO) f=407409335 TT=1800.06 T1=1800.4	SAT (TO) f=615140177 TT=1800.12 T1=1800.4	No data	No data	SAT (TO) f=29191225 TT=1800.8 T1=4.33	SAT (TO) f=24067041 TT=1801.38 T1=3.02	? (MO) TT=642.733
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_5_ic.opb	SAT f=30254559 TT=1800.8 T1=5.4	No data	No data	No data	SAT (TO) f=388549833 TT=1800.1 T1=1800.4	SAT (TO) f=497811765 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=30254559 TT=1800.8 T1=5.4	No Cert. TT=1800.07	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_6_ic.opb	SAT f=23942597 TT=1800.79 T1=4.28	No data	No data	No data	SAT (TO) f=719186195 TT=1800.1 T1=1800.4	SAT (TO) f=760764495 TT=1800.12 T1=1800.4	No data	No data	SAT (TO) f=23942597 TT=1800.79 T1=4.28	SAT (TO) f=24275211 TT=1800.07 T1=373.68	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_7_ic.opb	SAT f=22647773 TT=1800.08 T1=7.92	No data	No data	No data	SAT (TO) f=383108463 TT=1800.1 T1=1800.4	? (TO) TT=1800.09	No data	No data	SAT (TO) f=22647773 TT=1800.08 T1=7.92	SAT (TO) f=23693193 TT=1800 T1=3.32	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_8_ic.opb	SAT f=29394503 TT=1800.03 T1=3.8	No data	No data	No data	SAT (TO) f=295042235 TT=1800.1 T1=1800.4	SAT (TO) f=308213061 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=39250665 TT=1800.92 T1=6.45	SAT (TO) f=29394503 TT=1800.03 T1=3.8	? (TO) TT=1800.1
/OPT-BIGINT-LIN/zahidi/ IC/ normalized-minisat50_6_9_9_ic.opb	SAT f=26386625 TT=1800.19 T1=4.38	No data	No data	No data	SAT (TO) f=600192001 TT=1800.13 T1=1800.7	SAT (TO) f=809177339 TT=1800.11 T1=1800.4	No data	No data	SAT (TO) f=26386625 TT=1800.19 T1=4.38	SAT (TO) f=27977819 TT=1800.08 T1=3.11	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_0_ic.opb	SAT f=15549637 TT=1803.24 T1=70.84	No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.14	No data	No data	SAT (TO) f=15549637 TT=1803.24 T1=70.84	No Cert. TT=1800.49	? (TO) TT=1800.31
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_0_mh.opb	SAT f=10689768 TT=1801.72 T1=66.24	No data	No data	No data	? (TO) TT=1800.2	? (TO) TT=1800.27	No data	No data	SAT (TO) f=10689768 TT=1801.72 T1=66.24	? (TO) TT=1804.23	? (TO) TT=1800.54
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_1_ic.opb	SAT f=26153579 TT=1800.78 T1=36.08	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.13	No data	No data	SAT (TO) f=26153579 TT=1800.78 T1=36.08	No Cert. TT=1801.03	? (TO) TT=1800.32
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_1_mh.opb		No data	No data	No data	? (TO) TT=1800.17	? (TO) TT=1800.25	No data	No data	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.66
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_2_ic.opb	SAT f=1958196751 TT=1801.88 T1=606.13	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	No data	No data	SAT (TO) f=1958196751 TT=1801.88 T1=606.13	No Cert. TT=1801.51	? (TO) TT=1800.4
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_2_mh.opb	SAT f=9014519 TT=1801.11 T1=63.22	No data	No data	No data	? (TO) TT=1800.2	? (TO) TT=1800.27	No data	No data	SAT (TO) f=9014519 TT=1801.11 T1=63.22	No Cert. TT=1800.9	? (TO) TT=1800.62
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_3_ic.opb	SAT f=19879383 TT=1800.73 T1=24.09	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	No data	SAT (TO) f=19879383 TT=1800.73 T1=24.09	No Cert. TT=1800.49	? (TO) TT=1800.31
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_3_mh.opb	SAT f=78110625 TT=1800.88 T1=128.38	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.27	No data	No data	SAT (TO) f=78110625 TT=1800.88 T1=128.38	? (TO) TT=1800.01	? (TO) TT=1800.65
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_4_ic.opb		No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.06	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.33
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_4_mh.opb		No data	No data	No data	? (TO) TT=1800.22	? (TO) TT=1800.25	No data	No data	No Cert. TT=1800.78	? (TO) TT=1804.25	? (TO) TT=1800.71
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_5_ic.opb	SAT f=16056081 TT=1800.76 T1=32.56	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.05	No data	No data	SAT (TO) f=16056081 TT=1800.76 T1=32.56	No Cert. TT=1800.56	? (TO) TT=1800.41
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_5_mh.opb	SAT f=46762170 TT=1804.23 T1=83.78	No data	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.23	No data	No data	SAT (TO) f=46762170 TT=1804.23 T1=83.78	? (TO) TT=1800.87	? (TO) TT=1800.53
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_6_ic.opb	SAT f=18148975 TT=1802.67 T1=43.35	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	No data	SAT (TO) f=18148975 TT=1802.67 T1=43.35	SAT (TO) f=18245883 TT=1801.25 T1=18.29	? (TO) TT=1800.33
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_6_mh.opb		No data	No data	No data	? (TO) TT=1800.2	? (TO) TT=1800.23	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.66
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_7_ic.opb	SAT f=22869587 TT=1800.67 T1=71.66	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	No data	SAT (TO) f=22869587 TT=1800.67 T1=71.66	No Cert. TT=1803.1	? (TO) TT=1800.31
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_7_mh.opb		No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.25	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.66
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_8_ic.opb	SAT f=19677987 TT=1800.84 T1=64.65	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.12	No data	No data	SAT (TO) f=19677987 TT=1800.84 T1=64.65	No Cert. TT=1800.42	? (TO) TT=1800.3
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_8_mh.opb		No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.2	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.53	? (TO) TT=1800.61
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_9_ic.opb	SAT f=20561029 TT=1802.68 T1=39.11	No data	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.07	No data	No data	SAT (TO) f=20561029 TT=1802.68 T1=39.11	No Cert. TT=1801.09	? (TO) TT=1800.54
/OPT-BIGINT-LIN/zahidi/ Large/ normalized-minisat100_16_6_9_mh.opb		No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.25	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.75	? (TO) TT=1800.66
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_0_mh_ic.opb	OPT f=2252617 TT=603.74 T1=592.85	No data	No data	No data	SAT (TO) f=203501353 TT=1800.1 T1=1800.4	SAT (TO) f=220754017 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=2463293 TT=1800.02 T1=686.61	OPT f=2252617 TT=603.74 T1=592.85	? (MO) TT=290.538
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_1_mh_ic.opb	OPT f=1396365 TT=1751.33 T1=1745.42	No data	No data	No data	SAT (TO) f=68557543 TT=1800.03 T1=1800.3	? (TO) TT=1800.02	No data	No data	SAT (TO) f=1484432 TT=1800.1 T1=870.2	OPT f=1396365 TT=1751.33 T1=1745.42	? (MO) TT=1196.39
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_3_mh_ic.opb	SAT f=4466220 TT=1800.04 T1=413.72	No data	No data	No data	SAT (TO) f=302459643 TT=1800.02 T1=1800.3	SAT (TO) f=208577928 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=4636324 TT=1800.21 T1=1660.46	SAT (TO) f=4466220 TT=1800.04 T1=413.72	? (MO) TT=903.032
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_5_mh_ic.opb	SAT f=2990429 TT=1800.08 T1=1506.45	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=331484083 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3074089 TT=1800.05 T1=427.03	SAT (TO) f=2990429 TT=1800.08 T1=1506.45	? (MO) TT=397.702
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_6_mh_ic.opb	OPT f=2886748 TT=965.776 T1=338.93	No data	No data	No data	SAT (TO) f=214276387 TT=1800.03 T1=1800.3	SAT (TO) f=395705141 TT=1800.03 T1=1800.3	No data	No data	OPT f=2886748 TT=965.776 T1=338.93	OPT f=2886748 TT=1043.57 T1=974.25	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_8_mh_ic.opb	OPT f=5227195 TT=123.806 T1=120.73	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	OPT f=5227195 TT=569.647 T1=275.82	OPT f=5227195 TT=123.806 T1=120.73	? (MO) TT=458.973
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat15_4_4_9_mh_ic.opb	OPT f=3056260 TT=398.99 T1=388.05	No data	No data	No data	SAT (TO) f=191994022 TT=1800.03 T1=1800.3	SAT (TO) f=246875885 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3732777 TT=1801.44 T1=1538.13	OPT f=3056260 TT=398.99 T1=388.05	? (MO) TT=1187.17
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_0_mh_ic.opb	SAT f=5973745 TT=1800.51 T1=8.84	No data	No data	No data	? (TO) TT=1800.1	SAT (TO) f=348799743 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=5973745 TT=1800.51 T1=8.84	SAT (TO) f=6335279 TT=1800.03 T1=2.6	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_1_mh_ic.opb	SAT f=3623164 TT=1800.07 T1=4.38	No data	No data	No data	SAT (TO) f=310245301 TT=1800.03 T1=1800.3	SAT (TO) f=207154863 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3623164 TT=1800.07 T1=4.38	SAT (TO) f=4015589 TT=1800.6 T1=721.84	? (MO) TT=1056.16
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_2_mh_ic.opb	SAT f=4020435 TT=1800.1 T1=4.34	No data	No data	No data	SAT (TO) f=108816851 TT=1800.03 T1=1800.3	SAT (TO) f=222049718 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=4020435 TT=1800.1 T1=4.34	SAT (TO) f=4280579 TT=1800.02 T1=85	? (TO) TT=1800.09
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_3_mh_ic.opb	SAT f=3843968 TT=1800.2 T1=88.94	No data	No data	No data	SAT (TO) f=180310441 TT=1800.03 T1=1800.3	SAT (TO) f=344399399 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=3843968 TT=1800.2 T1=88.94	SAT (TO) f=4056293 TT=1800.05 T1=173.32	? (MO) TT=1655.44
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_4_mh_ic.opb	SAT f=3953881 TT=1800.01 T1=96.43	No data	No data	No data	SAT (TO) f=43906101 TT=1800.02 T1=1800.3	SAT (TO) f=119967418 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=14210029 TT=1800.1 T1=8.81	SAT (TO) f=3953881 TT=1800.01 T1=96.43	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_5_mh_ic.opb	SAT f=5842145 TT=1800.11 T1=3.87	No data	No data	No data	SAT (TO) f=190574123 TT=1800.03 T1=1800.3	SAT (TO) f=119968452 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=5842145 TT=1800.11 T1=3.87	SAT (TO) f=10219205 TT=1800.08 T1=381.56	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_6_mh_ic.opb	SAT f=1443321 TT=1800.07 T1=9.71	No data	No data	No data	SAT (TO) f=77105712 TT=1800.03 T1=1800.3	? (TO) TT=1800.02	No data	No data	SAT (TO) f=1443321 TT=1800.07 T1=9.71	SAT (TO) f=1633741 TT=1800.7 T1=351.9	? (MO) TT=952.799
/OPT-BIGINT-LIN/zahidi/ MH+IC/ normalized-minisat25_4_7_8_mh_ic.opb	SAT f=3154154 TT=1800.12 T1=19.94	No data	No data	No data	SAT (TO) f=253514488 TT=1800.11 T1=1800.4	SAT (TO) f=38775399 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3154154 TT=1800.12 T1=19.94	SAT (TO) f=4049401 TT=1800.85 T1=318.24	? (MO) TT=1430.73
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat35_4_11_0_mh_ic.opb	SAT f=5342211 TT=1800 T1=10.2	No data	No data	No data	SAT (TO) f=202276284 TT=1800.04 T1=1800.3	SAT (TO) f=154370574 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=5342211 TT=1800 T1=10.2	No Cert. TT=1800.98	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat35_4_11_4_mh_ic.opb	SAT f=10515627 TT=1800.13 T1=715.11	No data	No data	No data	SAT (TO) f=289599041 TT=1800.09 T1=1800.5	SAT (TO) f=470662197 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=10515627 TT=1800.13 T1=715.11	No Cert. TT=1800.06	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat35_4_11_6_mh_ic.opb	SAT f=4279238 TT=1800.05 T1=41.51	No data	No data	No data	SAT (TO) f=167940394 TT=1800.04 T1=1800.3	SAT (TO) f=237881575 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=4279238 TT=1800.05 T1=41.51	No Cert. TT=1800.08	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat35_4_11_7_mh_ic.opb	SAT f=66230726 TT=1800.06 T1=105.83	No data	No data	No data	SAT (TO) f=232126137 TT=1800.04 T1=1800.3	SAT (TO) f=212170293 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=66230726 TT=1800.06 T1=105.83	No Cert. TT=1801.11	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat35_4_11_8_mh_ic.opb	SAT f=9970804 TT=1800.15 T1=76.34	No data	No data	No data	SAT (TO) f=146594517 TT=1800.24 T1=1800.9	SAT (TO) f=176266403 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=9970804 TT=1800.15 T1=76.34	No Cert. TT=1800.83	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat35_4_11_9_mh_ic.opb	SAT f=270560600 TT=1800.13 T1=6.29	No data	No data	No data	SAT (TO) f=322211758 TT=1800.05 T1=1800.3	SAT (TO) f=412408015 TT=1800.07 T1=1800.3	No data	No data	SAT (TO) f=270560600 TT=1800.13 T1=6.29	No Cert. TT=1800.09	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_0_mh_ic.opb	SAT f=3267825 TT=1800.42 T1=349.82	No data	No data	No data	? (TO) TT=1800.15	SAT (TO) f=68946395 TT=1800.18 T1=1800.4	No data	No data	SAT (TO) f=3267825 TT=1800.42 T1=349.82	? (TO) TT=1800.2	? (TO) TT=1800.02
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_1_mh_ic.opb	SAT f=7723597 TT=1800.03 T1=18.91	No data	No data	No data	? (TO) TT=1800.21	SAT (TO) f=321656196 TT=1800.17 T1=1800.4	No data	No data	SAT (TO) f=7723597 TT=1800.03 T1=18.91	? (TO) TT=1800.09	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_3_mh_ic.opb	SAT f=3539617 TT=1800 T1=100.05	No data	No data	No data	? (TO) TT=1800.24	SAT (TO) f=182352679 TT=1800.18 T1=1800.4	No data	No data	SAT (TO) f=3539617 TT=1800 T1=100.05	? (TO) TT=1800.89	? (TO) TT=1800.01
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_4_mh_ic.opb	SAT f=157579642 TT=1800.13 T1=1800.3	No data	No data	No data	? (TO) TT=1800.14	SAT (TO) f=157579642 TT=1800.13 T1=1800.3	No data	No data	SAT (TO) f=218837079 TT=1800.14 T1=105.43	No Cert. TT=1801.03	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_5_mh_ic.opb	SAT f=20465538 TT=1800.29 T1=13.93	No data	No data	No data	? (TO) TT=1800.19	SAT (TO) f=64358945 TT=1800.19 T1=1800.4	No data	No data	SAT (TO) f=20465538 TT=1800.29 T1=13.93	? (TO) TT=1800.08	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_6_mh_ic.opb	SAT f=140202277 TT=1800.21 T1=779.8	No data	No data	No data	? (TO) TT=1800.24	SAT (TO) f=164858992 TT=1800.17 T1=1800.4	No data	No data	SAT (TO) f=140202277 TT=1800.21 T1=779.8	? (TO) TT=1800.05	? (TO) TT=1800.09
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_7_mh_ic.opb	SAT f=25105751 TT=1800.46 T1=149.06	No data	No data	No data	? (TO) TT=1800.24	SAT (TO) f=210444699 TT=1800.19 T1=1800.4	No data	No data	SAT (TO) f=25105751 TT=1800.46 T1=149.06	? (TO) TT=1800.73	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_8_mh_ic.opb	SAT f=4216880 TT=1800.08 T1=9.97	No data	No data	No data	? (TO) TT=1800.24	? (TO) TT=1800.03	No data	No data	SAT (TO) f=4216880 TT=1800.08 T1=9.97	? (TO) TT=1800.81	? (TO) TT=1800.04
/OPT-BIGINT-LIN/zahidi/MH+IC/ normalized-minisat50_4_16_9_mh_ic.opb	SAT f=18704900 TT=1800.01 T1=40.13	No data	No data	No data	? (TO) TT=1800.24	SAT (TO) f=355040422 TT=1800.09 T1=1800.3	No data	No data	SAT (TO) f=18704900 TT=1800.01 T1=40.13	? (TO) TT=1800.6	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_0_mh.opb	OPT f=5088349 TT=3.204 T1=0.63	No data	No data	No data	SAT (TO) f=237416309 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	No data	No data	OPT f=5088349 TT=7.703 T1=2.68	OPT f=5088349 TT=3.204 T1=0.63	? (MO) TT=1675.45
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_1_mh.opb	OPT f=17754249 TT=72.584 T1=2.47	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	No data	No data	OPT f=17754249 TT=147.451 T1=12.7	OPT f=17754249 TT=72.584 T1=2.47	? (MO) TT=260.54
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_2_mh.opb	OPT f=5950590 TT=123.885 T1=96.53	No data	No data	No data	SAT (TO) f=114996058 TT=1800.02 T1=1800.3	SAT (TO) f=167312214 TT=1800.02 T1=1800.3	No data	No data	OPT f=5950590 TT=250.776 T1=96.53	OPT f=5950590 TT=123.885 T1=117.38	? (MO) TT=1213.37
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_3_mh.opb	OPT f=4911296 TT=40.729 T1=0.71	No data	No data	No data	SAT (TO) f=132026909 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	No data	No data	OPT f=4911296 TT=88.282 T1=4.2	OPT f=4911296 TT=40.729 T1=0.71	? (MO) TT=1050.09
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_4_mh.opb	OPT f=3608846 TT=51.47 T1=50.07	No data	No data	No data	SAT (TO) f=156823535 TT=1800.01 T1=1800.3	? (TO) TT=1800.02	No data	No data	SAT (TO) f=3632206 TT=1800.06 T1=1014.91	OPT f=3608846 TT=51.47 T1=50.07	? (TO) TT=1800.09
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_5_mh.opb	OPT f=2014265 TT=24.009 T1=19.16	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=207748120 TT=1800.02 T1=1800.3	No data	No data	OPT f=2014265 TT=50.846 T1=21.23	OPT f=2014265 TT=24.009 T1=19.16	? (exit code) TT=1079.49
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_6_mh.opb	OPT f=7586846 TT=3.195 T1=0.51	No data	No data	No data	SAT (TO) f=289132512 TT=1800.01 T1=1800.3	SAT (TO) f=347212379 TT=1800.02 T1=1800.3	No data	No data	OPT f=7586846 TT=7.612 T1=1.13	OPT f=7586846 TT=3.195 T1=0.51	? (MO) TT=624.834
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_7_mh.opb	OPT f=15820949 TT=196.955 T1=172.51	No data	No data	No data	SAT (TO) f=271887849 TT=1800.02 T1=1800.3	SAT (TO) f=260706054 TT=1800.03 T1=1800.3	No data	No data	OPT f=15820949 TT=395.414 T1=172.51	OPT f=15820949 TT=196.955 T1=178.6	? (MO) TT=1414.64
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_8_mh.opb	OPT f=4415664 TT=193.84 T1=153.23	No data	No data	No data	SAT (TO) f=460615165 TT=1800.02 T1=1800.3	SAT (TO) f=160299144 TT=1800.02 T1=1800.3	No data	No data	OPT f=4415664 TT=345.961 T1=153.23	OPT f=4415664 TT=193.84 T1=158.02	? (MO) TT=498.159
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat15_5_3_9_mh.opb	OPT f=6925310 TT=42.26 T1=15.87	No data	No data	No data	SAT (TO) f=298883367 TT=1800.02 T1=1800.3	SAT (TO) f=512490751 TT=1800.02 T1=1800.3	No data	No data	OPT f=6925310 TT=104.71 T1=40.44	OPT f=6925310 TT=42.26 T1=15.87	? (TO) TT=1800.02
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_0_mh.opb	SAT f=3758624 TT=1800.06 T1=1.24	No data	No data	No data	SAT (TO) f=506221758 TT=1800.03 T1=1800.3	? (TO) TT=1800.02	No data	No data	SAT (TO) f=3794580 TT=1800.05 T1=1.56	SAT (TO) f=3758624 TT=1800.06 T1=1.24	? (MO) TT=267.389
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_1_mh.opb	SAT f=3646471 TT=1800.07 T1=476.48	No data	No data	No data	SAT (TO) f=79917054 TT=1800.03 T1=1800.3	SAT (TO) f=459623515 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=3646471 TT=1800.07 T1=476.48	No Cert. TT=1800	? (MO) TT=705.274
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_2_mh.opb	SAT f=6241905 TT=1800.1 T1=1.58	No data	No data	No data	SAT (TO) f=269259295 TT=1800.07 T1=1800.4	SAT (TO) f=322828465 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=6241905 TT=1800.1 T1=1.58	SAT (TO) f=6248032 TT=1800.81 T1=4.42	? (MO) TT=749.649
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_3_mh.opb	SAT f=5339858 TT=1800.13 T1=670.04	No data	No data	No data	SAT (TO) f=308341531 TT=1800.02 T1=1800.3	SAT (TO) f=111564593 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=5339858 TT=1800.13 T1=670.04	No Cert. TT=1800.07	? (MO) TT=314.133
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_4_mh.opb	SAT f=4083721 TT=1800.58 T1=497.63	No data	No data	No data	SAT (TO) f=608982867 TT=1800.09 T1=1800.4	SAT (TO) f=231130273 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=4088550 TT=1800.02 T1=35.51	SAT (TO) f=4083721 TT=1800.58 T1=497.63	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_5_mh.opb	SAT f=6221015 TT=1800.07 T1=535.62	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	No data	SAT (TO) f=6221015 TT=1800.07 T1=535.62	SAT (TO) f=6389780 TT=1800.58 T1=756.37	? (MO) TT=206.477
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_6_mh.opb	SAT f=5675195 TT=1800.01 T1=1.07	No data	No data	No data	SAT (TO) f=449857272 TT=1800.02 T1=1800.3	SAT (TO) f=539298199 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=5675195 TT=1800.01 T1=1.58	SAT (TO) f=5675195 TT=1800.74 T1=1.07	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_7_mh.opb	SAT f=7782565 TT=1800.14 T1=619.57	No data	No data	No data	SAT (TO) f=121011388 TT=1800.03 T1=1800.3	SAT (TO) f=552920423 TT=1800.03 T1=1800.3	No data	No data	SAT (TO) f=7782565 TT=1800.14 T1=619.57	No Cert. TT=1800.55	? (MO) TT=636.763
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_8_mh.opb	SAT f=7715044 TT=1800.04 T1=240.75	No data	No data	No data	SAT (TO) f=604215691 TT=1800.01 T1=1800.3	SAT (TO) f=521612722 TT=1800.01 T1=1800.3	No data	No data	SAT (TO) f=7795866 TT=1800.06 T1=429.13	SAT (TO) f=7715044 TT=1800.04 T1=240.75	? (MO) TT=762.952
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat25_6_4_9_mh.opb	SAT f=2582906 TT=1800.19 T1=45.94	No data	No data	No data	SAT (TO) f=328072836 TT=1800.03 T1=1800.3	SAT (TO) f=597728497 TT=1800.02 T1=1800.3	No data	No data	SAT (TO) f=2582906 TT=1800.19 T1=45.94	SAT (TO) f=2650306 TT=1800.71 T1=9.8	? (TO) TT=1800.72
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_0_mh.opb	SAT f=4862766 TT=1800.11 T1=72.44	No data	No data	No data	? (TO) TT=1800.08	SAT (TO) f=223639442 TT=1800.06 T1=1800.3	No data	No data	SAT (TO) f=4862766 TT=1800.11 T1=72.44	? (TO) TT=1800.02	? (TO) TT=1800.1
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_1_mh.opb	SAT f=3310393 TT=1800.36 T1=7.93	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.12	No data	No data	SAT (TO) f=3310393 TT=1800.36 T1=7.93	No Cert. TT=1800.02	? (TO) TT=1800.07
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_2_mh.opb	SAT f=16990510 TT=1800.19 T1=776.14	No data	No data	No data	? (TO) TT=1800.09	SAT (TO) f=304848723 TT=1800.06 T1=1800.3	No data	No data	SAT (TO) f=16990510 TT=1800.19 T1=776.14	No Cert. TT=1800.74	? (TO) TT=1800.05
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_3_mh.opb	SAT f=3501332 TT=1800.2 T1=13.24	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=413782636 TT=1800.15 T1=1800.4	No data	No data	SAT (TO) f=3501332 TT=1800.2 T1=13.24	SAT (TO) f=3902748 TT=1800.37 T1=6.03	? (TO) TT=1800.14
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_4_mh.opb	SAT f=4238786 TT=1800.37 T1=756.48	No data	No data	No data	? (TO) TT=1800.05	SAT (TO) f=658455200 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=4238786 TT=1800.37 T1=756.48	? (TO) TT=1800.76	? (TO) TT=1800.09
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_5_mh.opb	SAT f=4789134 TT=1800.09 T1=491.11	No data	No data	No data	? (TO) TT=1800.05	SAT (TO) f=168086763 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=4789134 TT=1800.09 T1=491.11	No Cert. TT=1800.28	? (TO) TT=1800.09
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_6_mh.opb	SAT f=275800362 TT=1800.06 T1=1800.3	No data	No data	No data	? (TO) TT=1800.07	SAT (TO) f=275800362 TT=1800.06 T1=1800.3	No data	No data	SAT (TO) f=508911011 TT=1800.12 T1=724.56	No Cert. TT=1800.31	? (TO) TT=1800.06
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_7_mh.opb	SAT f=5119540 TT=1800.07 T1=7.45	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=172178685 TT=1800.06 T1=1800.3	No data	No data	SAT (TO) f=5119540 TT=1800.07 T1=7.45	? (TO) TT=1800.71	? (MO) TT=327.444
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_8_mh.opb	SAT f=2457690 TT=1800.12 T1=580.83	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	No data	SAT (TO) f=2457690 TT=1800.12 T1=580.83	SAT (TO) f=2458141 TT=1800.37 T1=4.61	? (TO) TT=1800.08
/OPT-BIGINT-LIN/zahidi/ Multihop/ normalized-minisat50_6_9_9_mh.opb	SAT f=319069963 TT=1800.06 T1=1800.3	No data	No data	No data	? (TO) TT=1800.06	SAT (TO) f=319069963 TT=1800.06 T1=1800.3	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.71	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-10000opt.opb	OPT f=-164 TT=4.404 T1=4.4	No data	OPT f=-164 TT=1271.95 T1=1272.16	OPT f=-164 TT=791.823 T1=791.94	OPT f=-164 TT=10.839 T1=10.83	OPT f=-164 TT=8.79 T1=8.79	OPT f=-164 TT=5.915 T1=5.91	OPT f=-164 TT=4.404 T1=4.4	OPT f=-164 TT=36.799 T1=12.92	OPT f=-164 TT=43.48 T1=36.55	OPT f=-164 TT=500.669 T1=324.69
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-1000opt.opb	OPT f=-178 TT=0.629 T1=0.62	No data	OPT f=-178 TT=47.353 T1=47.35	OPT f=-178 TT=69.389 T1=69.39	OPT f=-178 TT=3.673 T1=3.67	OPT f=-178 TT=4.465 T1=4.46	OPT f=-178 TT=0.629 T1=0.62	OPT f=-178 TT=1.847 T1=1.84	SAT (TO) f=-170 TT=1801.06 T1=18.93	OPT f=-178 TT=25.68 T1=19.15	OPT f=-178 TT=537.89 T1=505.22
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-2000opt.opb	OPT f=-167 TT=4.908 T1=4.9	No data	OPT f=-167 TT=1394.59 T1=1394.79	OPT f=-167 TT=544.658 T1=544.75	OPT f=-167 TT=9.461 T1=9.45	OPT f=-167 TT=12.289 T1=12.28	OPT f=-167 TT=4.908 T1=4.9	OPT f=-167 TT=5.738 T1=5.73	OPT f=-167 TT=64.065 T1=22.95	OPT f=-167 TT=109.93 T1=100.25	OPT f=-167 TT=467.073 T1=338.25
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-3000opt.opb	OPT f=-187 TT=3.068 T1=3.06	No data	OPT f=-187 TT=272.942 T1=272.98	OPT f=-187 TT=218.171 T1=218.2	OPT f=-187 TT=7.57 T1=7.56	OPT f=-187 TT=8.928 T1=8.92	OPT f=-187 TT=3.068 T1=3.06	OPT f=-187 TT=3.219 T1=3.22	OPT f=-187 TT=166.939 T1=86.62	OPT f=-187 TT=150.68 T1=146.92	OPT f=-187 TT=908.421 T1=870.69
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-4000opt.opb	OPT f=-164 TT=3.866 T1=3.86	No data	OPT f=-164 TT=448.79 T1=448.84	OPT f=-164 TT=672.322 T1=672.42	OPT f=-164 TT=11.839 T1=11.83	OPT f=-164 TT=8.235 T1=8.23	OPT f=-164 TT=6.331 T1=6.33	OPT f=-164 TT=3.866 T1=3.86	OPT f=-164 TT=77.963 T1=36.62	OPT f=-164 TT=170.339 T1=123.13	OPT f=-164 TT=965.034 T1=761.21
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-5000opt.opb	OPT f=-169 TT=2.166 T1=2.16	No data	OPT f=-169 TT=274.742 T1=274.78	OPT f=-169 TT=464.804 T1=464.87	OPT f=-169 TT=12.434 T1=12.43	OPT f=-169 TT=7.648 T1=7.64	OPT f=-169 TT=2.166 T1=2.16	OPT f=-169 TT=3.634 T1=3.63	OPT f=-169 TT=1359.65 T1=1302.46	OPT f=-169 TT=41.329 T1=26.88	OPT f=-169 TT=264.443 T1=158.67
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-6000opt.opb	OPT f=-175 TT=4.324 T1=4.32	No data	OPT f=-175 TT=908.477 T1=908.62	? (TO) TT=1800.02	OPT f=-175 TT=8.287 T1=8.28	OPT f=-175 TT=10.231 T1=10.23	OPT f=-175 TT=4.324 T1=4.32	OPT f=-175 TT=5.254 T1=5.25	SAT (TO) f=-170 TT=1800.05 T1=94.07	OPT f=-175 TT=97.97 T1=95.51	OPT f=-175 TT=676.7 T1=506.92
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-7000opt.opb	OPT f=-172 TT=1.759 T1=1.75	No data	OPT f=-172 TT=422.086 T1=422.15	OPT f=-172 TT=771.792 T1=771.91	OPT f=-172 TT=13.966 T1=13.96	OPT f=-172 TT=8.192 T1=8.19	OPT f=-172 TT=1.759 T1=1.75	OPT f=-172 TT=5.391 T1=5.39	SAT (TO) f=-163 TT=1800.07 T1=69.57	OPT f=-172 TT=414.07 T1=409.85	OPT f=-172 TT=372.526 T1=214.5
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-8000opt.opb	OPT f=-162 TT=13.074 T1=13.07	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	OPT f=-162 TT=57.629 T1=57.63	OPT f=-162 TT=22.582 T1=22.58	OPT f=-162 TT=21.456 T1=21.45	OPT f=-162 TT=13.074 T1=13.07	SAT (TO) f=-154 TT=1800.42 T1=1260.42	OPT f=-162 TT=408.2 T1=404.34	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-250-false-45-90-4-9000opt.opb	OPT f=-193 TT=2.341 T1=2.34	No data	OPT f=-193 TT=142.792 T1=142.81	OPT f=-193 TT=450.717 T1=450.79	OPT f=-193 TT=5.632 T1=5.63	OPT f=-193 TT=3.432 T1=3.43	OPT f=-193 TT=2.341 T1=2.34	OPT f=-193 TT=2.414 T1=2.41	SAT (TO) f=-189 TT=1800.09 T1=22.98	OPT f=-193 TT=49.07 T1=26.38	OPT f=-193 TT=525.55 T1=342.76
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-10000opt.opb	OPT f=-75 TT=1.637 T1=1.63	No data	OPT f=-75 TT=59.792 T1=59.79	OPT f=-75 TT=23.852 T1=23.85	OPT f=-75 TT=2.503 T1=2.5	OPT f=-75 TT=3.808 T1=3.8	OPT f=-75 TT=2.94 T1=2.94	OPT f=-75 TT=1.637 T1=1.63	OPT f=-75 TT=21.511 T1=19.8	OPT f=-75 TT=6.023 T1=4.7	OPT f=-75 TT=25.77 T1=17.88
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-1000opt.opb	OPT f=-78 TT=1.908 T1=1.9	No data	OPT f=-78 TT=57.167 T1=57.16	OPT f=-78 TT=41.078 T1=41.08	OPT f=-78 TT=3.513 T1=3.51	OPT f=-78 TT=2.902 T1=2.9	OPT f=-78 TT=2.557 T1=2.55	OPT f=-78 TT=1.908 T1=1.9	OPT f=-78 TT=107.988 T1=102.77	OPT f=-78 TT=8.353 T1=6.5	OPT f=-78 TT=34.095 T1=34.04
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-2000opt.opb	OPT f=-70 TT=2.444 T1=2.44	No data	OPT f=-70 TT=125.087 T1=125.09	OPT f=-70 TT=66.594 T1=66.6	OPT f=-70 TT=5.254 T1=5.25	OPT f=-70 TT=4.756 T1=4.75	OPT f=-70 TT=7.272 T1=7.27	OPT f=-70 TT=2.444 T1=2.44	OPT f=-70 TT=18.761 T1=10.14	OPT f=-70 TT=8.002 T1=6.66	OPT f=-70 TT=78.816 T1=78.76
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-3000opt.opb	OPT f=-81 TT=1.618 T1=1.61	No data	OPT f=-81 TT=95.655 T1=95.66	OPT f=-81 TT=26.847 T1=26.84	OPT f=-81 TT=4.028 T1=4.02	OPT f=-81 TT=3.314 T1=3.31	OPT f=-81 TT=4.374 T1=4.37	OPT f=-81 TT=1.618 T1=1.61	OPT f=-81 TT=10.901 T1=5.66	OPT f=-81 TT=8.035 T1=6	OPT f=-81 TT=23.552 T1=21.98
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-4000opt.opb	OPT f=-82 TT=0.756 T1=0.75	No data	OPT f=-82 TT=21.635 T1=21.63	OPT f=-82 TT=16.037 T1=16.03	OPT f=-82 TT=1.777 T1=1.77	OPT f=-82 TT=1.948 T1=1.94	OPT f=-82 TT=1.778 T1=1.77	OPT f=-82 TT=0.756 T1=0.75	OPT f=-82 TT=7.565 T1=5.15	OPT f=-82 TT=3.904 T1=2.45	OPT f=-82 TT=20.742 T1=20.13
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-5000opt.opb	OPT f=-70 TT=2.359 T1=2.35	No data	OPT f=-70 TT=66.859 T1=66.86	OPT f=-70 TT=41.465 T1=41.46	OPT f=-70 TT=4.204 T1=4.2	OPT f=-70 TT=4.069 T1=4.06	OPT f=-70 TT=6.117 T1=6.11	OPT f=-70 TT=2.359 T1=2.35	OPT f=-70 TT=11.382 T1=7.68	OPT f=-70 TT=6.604 T1=4.9	OPT f=-70 TT=46.576 T1=13.17
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-6000opt.opb	OPT f=-74 TT=2.542 T1=2.54	No data	OPT f=-74 TT=232.789 T1=232.81	OPT f=-74 TT=94.823 T1=94.83	OPT f=-74 TT=4.32 T1=4.31	OPT f=-74 TT=4.695 T1=4.69	OPT f=-74 TT=7.287 T1=7.28	OPT f=-74 TT=2.542 T1=2.54	OPT f=-74 TT=16.222 T1=11.66	OPT f=-74 TT=11.642 T1=8.82	OPT f=-74 TT=96.858 T1=63.26
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-7000opt.opb	OPT f=-68 TT=1.506 T1=1.5	No data	OPT f=-68 TT=130.736 T1=130.75	OPT f=-68 TT=24.433 T1=24.43	OPT f=-68 TT=3.671 T1=3.66	OPT f=-68 TT=4.083 T1=4.08	OPT f=-68 TT=3.853 T1=3.85	OPT f=-68 TT=1.506 T1=1.5	OPT f=-68 TT=31.39 T1=26.49	OPT f=-68 TT=7.794 T1=4.74	OPT f=-68 TT=37.016 T1=23.67
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-8000opt.opb	OPT f=-76 TT=1.52 T1=1.51	No data	OPT f=-76 TT=105.016 T1=105.02	OPT f=-76 TT=17.211 T1=17.21	OPT f=-76 TT=3.852 T1=3.91	OPT f=-76 TT=3.611 T1=3.61	OPT f=-76 TT=2.26 T1=2.25	OPT f=-76 TT=1.52 T1=1.51	OPT f=-76 TT=18.022 T1=15.18	OPT f=-76 TT=9.333 T1=7.62	OPT f=-76 TT=41.972 T1=40.26
/OPT-SMALLINT-LIN/featureSubscription/ normalized-50-750-false-45-90-4-9000opt.opb	OPT f=-79 TT=1.937 T1=1.69	No data	OPT f=-79 TT=93.077 T1=93.08	OPT f=-79 TT=43.408 T1=43.41	OPT f=-79 TT=2.411 T1=2.4	OPT f=-79 TT=3.278 T1=3.28	OPT f=-79 TT=3.212 T1=3.21	OPT f=-79 TT=1.937 T1=1.93	OPT f=-79 TT=12.261 T1=5.67	OPT f=-79 TT=6.923 T1=1.69	OPT f=-79 TT=53.275 T1=48.64
/OPT-SMALLINT-LIN/flexray/ normalized-fx30.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.2	? (TO) TT=1800	? (TO) TT=1800.02
/OPT-SMALLINT-LIN/flexray/ normalized-fx49.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.83	? (TO) TT=1800.02	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/flexray/ normalized-fx57.opb	OPT f=6 TT=0.273 T1=0.27	No data	OPT f=6 TT=0.345 T1=0.34	OPT f=6 TT=0.273 T1=0.27	OPT f=6 TT=90.844 T1=90.85	OPT f=6 TT=6.886 T1=6.86	OPT f=6 TT=3.997 T1=4.05	OPT f=6 TT=3.987 T1=4.09	OPT f=6 TT=6.133 T1=2.5	OPT f=6 TT=1.923 T1=0.97	OPT f=6 TT=0.831 T1=0.81
/OPT-SMALLINT-LIN/flexray/ normalized-fx60.opb	OPT f=6 TT=7.423 T1=6.36	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	OPT f=6 TT=1001.81 T1=1001.98	OPT f=6 TT=225.618 T1=225.67	OPT f=6 TT=115.564 T1=115.59	OPT f=6 TT=116.101 T1=116.11	OPT f=6 TT=56.515 T1=26.57	OPT f=6 TT=7.423 T1=6.36	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/flexray/ normalized-fx63.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/flexray/ normalized-fx75.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/flexray/ normalized-fx84.opb	OPT f=8 TT=1.705 T1=0.74	No data	OPT f=8 TT=20.269 T1=20.25	OPT f=8 TT=19.545 T1=19.54	? (TO) TT=1800.04	OPT f=8 TT=35.645 T1=35.61	OPT f=8 TT=32.182 T1=32.18	OPT f=8 TT=30.955 T1=30.95	OPT f=8 TT=3.536 T1=1.27	OPT f=8 TT=1.705 T1=0.74	OPT f=8 TT=3.187 T1=3.13
/OPT-SMALLINT-LIN/flexray/ normalized-fx92.opb	OPT f=9 TT=3.882 T1=2.75	No data	OPT f=9 TT=1570.6 T1=1570.82	OPT f=9 TT=1568.69 T1=1568.93	? (TO) TT=1800.09	OPT f=9 TT=157.746 T1=157.73	OPT f=9 TT=165.061 T1=165.07	OPT f=9 TT=158.326 T1=158.37	OPT f=9 TT=8.613 T1=3.32	OPT f=9 TT=3.882 T1=2.75	OPT f=9 TT=10.19 T1=10.13
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/flexray/ normalized-fx97.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.01-1.opb	OPT f=7 TT=1.635 T1=1.59	No data	OPT f=7 TT=2.365 T1=2.33	OPT f=7 TT=5.847 T1=5.82	OPT f=7 TT=70.013 T1=69.97	OPT f=7 TT=4.314 T1=4.28	OPT f=7 TT=1.635 T1=1.59	OPT f=7 TT=1.769 T1=1.73	OPT f=7 TT=7.534 T1=3.29	OPT f=7 TT=4.152 T1=2.22	OPT f=7 TT=9.022 T1=8.83
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.01-2.opb	OPT f=7 TT=1.72 T1=1.67	No data	OPT f=7 TT=2.386 T1=2.35	OPT f=7 TT=5.24 T1=5.21	OPT f=7 TT=66.238 T1=66.18	OPT f=7 TT=4.998 T1=4.95	OPT f=7 TT=1.72 T1=1.67	OPT f=7 TT=1.921 T1=1.88	OPT f=7 TT=7.763 T1=3.75	OPT f=7 TT=4.503 T1=2.62	OPT f=7 TT=9.307 T1=9.11
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.01-3.opb	OPT f=6 TT=1.682 T1=1.63	No data	OPT f=6 TT=2.303 T1=2.27	OPT f=6 TT=4.662 T1=4.63	OPT f=6 TT=32.124 T1=32.07	OPT f=6 TT=4.216 T1=4.18	OPT f=6 TT=1.682 T1=1.63	OPT f=6 TT=1.805 T1=1.76	OPT f=6 TT=6.363 T1=3.12	OPT f=6 TT=3.743 T1=2.21	OPT f=6 TT=8.454 T1=8.23
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.01-4.opb	OPT f=7 TT=1.616 T1=1.57	No data	OPT f=7 TT=2.314 T1=2.27	OPT f=7 TT=6.021 T1=5.99	OPT f=7 TT=159.602 T1=159.56	OPT f=7 TT=4.955 T1=4.91	OPT f=7 TT=1.616 T1=1.57	OPT f=7 TT=1.752 T1=1.7	OPT f=7 TT=6.662 T1=3.01	OPT f=7 TT=4.094 T1=2.22	OPT f=7 TT=11.793 T1=11.6
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.01-5.opb	OPT f=7 TT=1.661 T1=1.61	No data	OPT f=7 TT=2.298 T1=2.26	OPT f=7 TT=5.136 T1=5.11	OPT f=7 TT=103.767 T1=103.73	OPT f=7 TT=4.726 T1=4.68	OPT f=7 TT=1.661 T1=1.61	OPT f=7 TT=1.828 T1=1.78	OPT f=7 TT=6.462 T1=3.03	OPT f=7 TT=3.894 T1=2.23	OPT f=7 TT=9.591 T1=9.38
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.10-10.opb	OPT f=6 TT=2.098 T1=2.05	No data	OPT f=6 TT=3.097 T1=3.05	OPT f=6 TT=8.849 T1=8.82	OPT f=6 TT=14.583 T1=14.52	OPT f=6 TT=5.984 T1=5.94	OPT f=6 TT=2.098 T1=2.05	OPT f=6 TT=2.247 T1=2.2	OPT f=6 TT=8.233 T1=4.03	OPT f=6 TT=4.703 T1=2.74	OPT f=6 TT=15.353 T1=15.11
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.10-6.opb	OPT f=7 TT=2.23 T1=2.18	No data	OPT f=7 TT=3.406 T1=3.36	OPT f=7 TT=9.692 T1=9.66	OPT f=7 TT=200.5 T1=200.46	OPT f=7 TT=6.667 T1=6.62	OPT f=7 TT=2.23 T1=2.18	OPT f=7 TT=2.43 T1=2.38	OPT f=7 TT=9.162 T1=4.4	OPT f=7 TT=5.233 T1=3.16	OPT f=7 TT=13.836 T1=12.99
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.10-7.opb	OPT f=588 TT=2.327 T1=2.29	No data	OPT f=588 TT=4.004 T1=3.96	OPT f=588 TT=8.672 T1=8.64	OPT f=588 TT=144.712 T1=144.69	OPT f=588 TT=7.068 T1=7.02	OPT f=588 TT=2.327 T1=2.29	OPT f=588 TT=2.45 T1=2.6	OPT f=588 TT=10.063 T1=5.47	OPT f=588 TT=6.083 T1=3.44	OPT f=588 TT=18.671 T1=18.4
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.10-8.opb	OPT f=589 TT=2.203 T1=2.15	No data	OPT f=589 TT=3.4 T1=3.35	OPT f=589 TT=6.715 T1=6.68	OPT f=589 TT=28.209 T1=28.15	OPT f=589 TT=6.152 T1=6.11	OPT f=589 TT=2.203 T1=2.15	OPT f=589 TT=2.38 T1=2.33	OPT f=589 TT=9.123 T1=4.45	OPT f=589 TT=5.233 T1=2.98	OPT f=589 TT=17.006 T1=16.52
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.10-9.opb	OPT f=7 TT=2.175 T1=2.13	No data	OPT f=7 TT=3.108 T1=3.06	OPT f=7 TT=6.29 T1=6.26	OPT f=7 TT=76.599 T1=76.54	OPT f=7 TT=6.681 T1=6.63	OPT f=7 TT=2.175 T1=2.13	OPT f=7 TT=2.357 T1=2.31	OPT f=7 TT=8.604 T1=3.69	OPT f=7 TT=5.145 T1=2.86	OPT f=7 TT=15.73 T1=15.49
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.20-11.opb	OPT f=7 TT=2.694 T1=2.65	No data	OPT f=7 TT=4.086 T1=4.05	OPT f=7 TT=22.321 T1=22.29	OPT f=7 TT=223.914 T1=223.88	OPT f=7 TT=7.613 T1=7.56	OPT f=7 TT=2.694 T1=2.65	OPT f=7 TT=2.972 T1=2.92	OPT f=7 TT=11.051 T1=5.23	OPT f=7 TT=6.524 T1=3.6	OPT f=7 TT=27.959 T1=27.56
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.20-12.opb	OPT f=7 TT=2.647 T1=2.6	No data	OPT f=7 TT=4.126 T1=4.08	OPT f=7 TT=30.932 T1=30.9	OPT f=7 TT=176.906 T1=176.86	OPT f=7 TT=7.825 T1=7.78	OPT f=7 TT=2.647 T1=2.6	OPT f=7 TT=2.964 T1=2.91	OPT f=7 TT=11.704 T1=5.19	OPT f=7 TT=6.082 T1=3.46	OPT f=7 TT=27.238 T1=24.97
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.20-13.opb	OPT f=7 TT=2.691 T1=2.65	No data	OPT f=7 TT=4.556 T1=4.51	OPT f=7 TT=16.141 T1=16.11	OPT f=7 TT=100.415 T1=100.36	OPT f=7 TT=8.262 T1=8.21	OPT f=7 TT=2.691 T1=2.65	OPT f=7 TT=2.903 T1=2.85	OPT f=7 TT=13.543 T1=5.32	OPT f=7 TT=11.042 T1=3.7	OPT f=7 TT=28.801 T1=28.61
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.20-14.opb	OPT f=7 TT=2.684 T1=2.63	No data	OPT f=7 TT=3.81 T1=3.76	OPT f=7 TT=8.242 T1=8.21	OPT f=7 TT=133.683 T1=133.63	OPT f=7 TT=7.104 T1=7.06	OPT f=7 TT=2.684 T1=2.63	OPT f=7 TT=2.741 T1=2.69	OPT f=7 TT=9.893 T1=4.57	OPT f=7 TT=5.673 T1=3.47	OPT f=7 TT=29.007 T1=28.8
OPT-SMALLINT-LIN/graca/ normalized-ped2.B.recomb1-0.20-15.opb	OPT f=7 TT=2.78 T1=2.73	No data	OPT f=7 TT=4.294 T1=4.24	OPT f=7 TT=59.423 T1=59.39	OPT f=7 TT=290.636 T1=290.61	OPT f=7 TT=8.122 T1=8.07	OPT f=7 TT=2.78 T1=2.73	OPT f=7 TT=3.152 T1=3.1	OPT f=7 TT=10.981 T1=5.63	OPT f=7 TT=6.564 T1=3.99	OPT f=7 TT=28.256 T1=28.05
OPT-SMALLINT-LIN/graca/ normalized-ped3.D.recomb10-0.20-11.opb	OPT f=690 TT=2.158 T1=2.13	No data	OPT f=690 TT=416.175 T1=416.21	? (TO) TT=1800.03	OPT f=690 TT=29.512 T1=29.48	OPT f=690 TT=5.338 T1=5.31	OPT f=690 TT=2.265 T1=2.24	OPT f=690 TT=2.158 T1=2.13	OPT f=690 TT=38.928 T1=3.81	OPT f=690 TT=101.95 T1=2.47	OPT f=690 TT=24.343 T1=16.46
OPT-SMALLINT-LIN/graca/ normalized-ped3.D.recomb10-0.20-12.opb	OPT f=349 TT=1.259 T1=1.24	No data	OPT f=349 TT=2.861 T1=2.84	OPT f=349 TT=22.546 T1=22.53	OPT f=349 TT=26.443 T1=26.41	OPT f=349 TT=3.727 T1=3.7	OPT f=349 TT=1.259 T1=1.24	OPT f=349 TT=1.324 T1=1.3	OPT f=349 TT=8.682 T1=3.35	OPT f=349 TT=4.814 T1=1.96	OPT f=349 TT=10.227 T1=10.08
OPT-SMALLINT-LIN/graca/ normalized-ped3.D.recomb10-0.20-13.opb	OPT f=350 TT=1.796 T1=1.77	No data	OPT f=350 TT=1561.07 T1=1561.29	OPT f=350 TT=271.319 T1=271.34	OPT f=350 TT=40.017 T1=39.99	OPT f=350 TT=5.449 T1=5.42	OPT f=350 TT=1.796 T1=1.77	OPT f=350 TT=2.042 T1=2.02	OPT f=350 TT=32.781 T1=3.68	OPT f=350 TT=58.06 T1=31.22	OPT f=350 TT=33.866 T1=33.5
OPT-SMALLINT-LIN/graca/ normalized-ped3.D.recomb10-0.20-14.opb	OPT f=7 TT=1.296 T1=1.28	No data	OPT f=7 TT=2.813 T1=2.79	OPT f=7 TT=4.347 T1=4.33	OPT f=7 TT=30.893 T1=30.87	OPT f=7 TT=3.979 T1=3.96	OPT f=7 TT=1.296 T1=1.28	OPT f=7 TT=1.339 T1=1.32	OPT f=7 TT=7.573 T1=3.17	OPT f=7 TT=5.662 T1=1.98	OPT f=7 TT=14.224 T1=14.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
OPT-SMALLINT-LIN/graca/ normalized-ped3.D.recomb10-0.20-15.opb	OPT f=689 TT=2.09 T1=1.97	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	OPT f=689 TT=71.771 T1=71.75	OPT f=689 TT=74.139 T1=74.14	OPT f=689 TT=2.09 T1=2.07	OPT f=689 TT=12.895 T1=12.88	OPT f=689 TT=69.294 T1=3.04	OPT f=689 TT=69.18 T1=1.97	OPT f=689 TT=30.746 T1=8.79
/OPT-SMALLINT-LIN/ heinz/ normalized-222__neos-1330346.opb	OPT f=8 TT=34.003 T1=0.42	No data	OPT f=8 TT=509.664 T1=509.73	OPT f=8 TT=520.286 T1=520.36	OPT f=8 TT=72.777 T1=72.78	OPT f=8 TT=58.218 T1=58.22	OPT f=8 TT=62.88 T1=62.88	OPT f=8 TT=34.003 T1=34	OPT f=8 TT=623.949 T1=1.87	OPT f=8 TT=620.32 T1=0.42	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/heinz/ normalized-acc-tight4.opb	OPT f=0 TT=0.295 T1=0.29	No data	OPT f=0 TT=0.339 T1=0.33	OPT f=0 TT=0.295 T1=0.29	OPT f=0 TT=1.027 T1=1.02	OPT f=0 TT=0.705 T1=0.7	OPT f=0 TT=2.148 T1=2.14	OPT f=0 TT=2.204 T1=2.2	OPT f=0 TT=2.364 T1=0.86	OPT f=0 TT=2.016 T1=1.23	OPT f=0 TT=2.1 T1=2.04
/OPT-SMALLINT-LIN/heinz/ normalized-acc-tight6.opb	OPT f=0 TT=0.326 T1=0.32	No data	OPT f=0 TT=0.367 T1=0.36	OPT f=0 TT=0.326 T1=0.32	OPT f=0 TT=0.52 T1=0.51	OPT f=0 TT=0.559 T1=0.55	OPT f=0 TT=2.051 T1=2.05	OPT f=0 TT=2.039 T1=2.03	OPT f=0 TT=4.04 T1=1.34	OPT f=0 TT=2.054 T1=1.12	OPT f=0 TT=2.016 T1=1.95
/OPT-SMALLINT-LIN/ heinz/ normalized-ash608gpia-3col.opb	UNSAT TT=0.107	No data	UNSAT TT=0.188	UNSAT TT=0.107	UNSAT TT=1.097	UNSAT TT=1.38	UNSAT TT=0.134	UNSAT TT=0.134	UNSAT TT=1.612	UNSAT TT=1.224	UNSAT TT=0.628
/OPT-SMALLINT-LIN/ heinz/normalized-bnatt350.opb	OPT f=0 TT=0.174 T1=0.17	No data	OPT f=0 TT=1.047 T1=1.04	OPT f=0 TT=0.97 T1=0.96	OPT f=0 TT=0.174 T1=0.17	OPT f=0 TT=0.232 T1=0.23	OPT f=0 TT=2.968 T1=2.96	OPT f=0 TT=2.99 T1=2.99	OPT f=0 TT=5.983 T1=2.43	OPT f=0 TT=1.755 T1=1.13	OPT f=0 TT=3.592 T1=3.54
/OPT-SMALLINT-LIN/ heinz/normalized-bnatt400.opb	OPT f=1 TT=0.245 T1=0.24	No data	OPT f=1 TT=1.071 T1=1.06	OPT f=1 TT=1.019 T1=1.01	OPT f=1 TT=0.245 T1=0.24	OPT f=1 TT=0.292 T1=0.29	OPT f=1 TT=1.396 T1=1.39	OPT f=1 TT=1.396 T1=1.39	OPT f=1 TT=5.012 T1=1.44	OPT f=1 TT=3.205 T1=2.07	OPT f=1 TT=5.058 T1=2.94
/OPT-SMALLINT-LIN/ heinz/normalized-datt256.opb		No data	? (exit code) TT=0.691	? (exit code) TT=0.006	? (TO) TT=1800.07	? (TO) TT=1800.31	? TT=72.777	? TT=72.752	? (TO) TT=1800.61	? (TO) TT=1800.01	? (TO) TT=1800.06
/OPT-SMALLINT-LIN/heinz/ normalized-ex1010-pi.opb	SAT f=441 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT (TO) f=641 TT=1800.1 T1=1800.4	SAT (TO) f=641 TT=1800.05 T1=1800.3	SAT (TO) f=641 TT=1800.11 T1=1800.4	SAT (TO) f=441 TT=1800.1 T1=1800.4	SAT (TO) f=543 TT=1800.05 T1=673.39	SAT (TO) f=639 TT=1800.08 T1=3.74	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/heinz/ normalized-ex9.opb	OPT f=81 TT=0.784 T1=0.77	No data	OPT f=81 TT=2.624 T1=2.61	OPT f=81 TT=0.784 T1=0.77	OPT f=81 TT=26.985 T1=26.97	OPT f=81 TT=23.361 T1=23.17	OPT f=81 TT=0.825 T1=0.82	OPT f=81 TT=1.103 T1=1.09	OPT f=81 TT=4.628 T1=1.74	OPT f=81 TT=2.606 T1=1.2	OPT f=81 TT=13.104 T1=2.96
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/heinz/ normalized-f2000.opb		No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.51	? (TO) TT=1800.07	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/heinz/ normalized-go19.opb	SAT f=91 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=92 TT=1800.02 T1=1800.3	SAT (TO) f=95 TT=1800.02 T1=1800.3	SAT (TO) f=95 TT=1800.02 T1=1800.3	SAT (TO) f=91 TT=1800.02 T1=1800.3	SAT (TO) f=104 TT=1800.12 T1=41.75	SAT (TO) f=132 TT=1800.06 T1=30.82	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/heinz/ normalized-hanoi5.opb	OPT f=1931 TT=0.995 T1=0.99	No data	OPT f=1931 TT=2.421 T1=2.41	OPT f=1931 TT=1.958 T1=1.95	OPT f=1931 TT=2.03 T1=2.02	OPT f=1931 TT=5.828 T1=5.8	OPT f=1931 TT=1.302 T1=1.3	OPT f=1931 TT=0.995 T1=0.99	OPT f=1931 TT=11.672 T1=4.04	OPT f=1931 TT=5.901 T1=3.64	OPT f=1931 TT=106.007 T1=34.32
/OPT-SMALLINT-LIN/heinz/ normalized-iis-bupa-cov.opb	SAT f=42 TT=1800.09 T1=3.9	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=48 TT=1800.01 T1=1800.3	SAT (TO) f=48 TT=1800.02 T1=1800.3	SAT (TO) f=48 TT=1800.02 T1=1800.3	SAT (TO) f=45 TT=1800.02 T1=1800.3	SAT (TO) f=42 TT=1800.09 T1=3.9	SAT (TO) f=43 TT=1800.07 T1=65.32	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/heinz/ normalized-iis-pima-cov.opb	SAT f=39 TT=1800.02 T1=4.02	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=44 TT=1800.01 T1=1800.3	SAT (TO) f=44 TT=1800.02 T1=1800.3	SAT (TO) f=44 TT=1800.02 T1=1800.3	SAT (TO) f=39 TT=1800.02 T1=1800.3	SAT (TO) f=39 TT=1800.81 T1=4.02	SAT (TO) f=40 TT=1800.03 T1=6.05	? (TO) TT=1800.01
/OPT-SMALLINT-LIN/heinz/ normalized-macrophage.opb	OPT f=374 TT=0.133 T1=0.13	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT (TO) f=455 TT=1800.02 T1=1800.3	SAT (TO) f=592 TT=1800.02 T1=1800.3	OPT f=374 TT=0.133 T1=0.13	SAT (TO) f=427 TT=1800.01 T1=1800.3	SAT (TO) f=522 TT=1800.16 T1=484.89	SAT (TO) f=556 TT=1800.05 T1=0.43	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/heinz/ normalized-methanosarcina.opb	SAT f=3124 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=3962 TT=1800.02 T1=1800.3	SAT (TO) f=3218 TT=1800.09 T1=1800.4	SAT (TO) f=4623 TT=1800.01 T1=1800.3	SAT (TO) f=3124 TT=1800.02 T1=1800.3	SAT (TO) f=3195 TT=1800.18 T1=1.01	SAT (TO) f=3195 TT=1800.06 T1=0.61	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/heinz/ normalized-mspp16.opb	OPT f=33 TT=131.081 T1=130.99	No data	OPT f=33 TT=131.081 T1=130.99	OPT f=33 TT=1059.34 T1=1059.49	Signal TT=843.88	? (TO) TT=1800.54	? TT=64.179	? TT=65.039	OPT f=33 TT=1041.37 T1=281.79	SAT (TO) f=36 TT=1801.88 T1=45.96	? (TO) TT=1800.6
/OPT-SMALLINT-LIN/heinz/ normalized-neos-1109824.opb	SAT f=426 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=521 TT=1800.06 T1=1800.4	SAT (TO) f=741 TT=1800.1 T1=1800.4	SAT (TO) f=426 TT=1800.03 T1=1800.3	SAT (TO) f=483 TT=1800.07 T1=1800.4	SAT (TO) f=436 TT=1800.78 T1=26.23	SAT (TO) f=477 TT=1800.08 T1=0.61	? (TO) TT=1800.01
/OPT-SMALLINT-LIN/heinz/ normalized-neos-1440225.opb	OPT f=36 TT=51.716 T1=2.87	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=36 TT=1800.05 T1=1800.4	SAT (TO) f=36 TT=1800.09 T1=1800.4	OPT f=36 TT=51.716 T1=51.72	SAT (TO) f=36 TT=1800.02 T1=1800.3	SAT (TO) f=36 TT=1800.84 T1=38.34	SAT (TO) f=36 TT=1800.03 T1=2.87	OPT f=36 TT=57.018 T1=56.14
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/heinz/ normalized-neos-1616732.opb	SAT f=161 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800	SAT (TO) f=161 TT=1800.02 T1=1800.3	SAT (TO) f=172 TT=1800.02 T1=1800.3	SAT (TO) f=172 TT=1800.02 T1=1800.3	SAT (TO) f=161 TT=1800.02 T1=1800.3	SAT (TO) f=163 TT=1800.1 T1=105.78	SAT (TO) f=163 TT=1800.07 T1=288.14	? (TO) TT=1800.02
/OPT-SMALLINT-LIN/heinz/ normalized-neos18.opb	OPT f=16 TT=0.042 T1=0.04	No data	OPT f=16 TT=0.253 T1=0.25	OPT f=16 TT=0.155 T1=0.15	OPT f=16 TT=0.113 T1=0.11	OPT f=16 TT=0.119 T1=0.12	OPT f=16 TT=0.042 T1=0.04	OPT f=16 TT=0.046 T1=0.04	OPT f=16 TT=3.124 T1=0.95	OPT f=16 TT=1.453 T1=0.43	OPT f=16 TT=0.646 T1=0.38
/OPT-SMALLINT-LIN/heinz/ normalized-neos-506428.opb	OPT f=1 TT=0.465 T1=0.45	No data	OPT f=1 TT=0.853 T1=0.83	OPT f=1 TT=0.465 T1=0.45	OPT f=1 TT=1.717 T1=1.7	OPT f=1 TT=1.678 T1=1.67	OPT f=1 TT=0.5 T1=0.48	OPT f=1 TT=0.498 T1=0.48	OPT f=1 TT=2.584 T1=1.56	OPT f=1 TT=1.845 T1=0.98	OPT f=1 TT=2.876 T1=2.84
/OPT-SMALLINT-LIN/heinz/ normalized-neos-538867.opb	OPT f=122 TT=22.464 T1=22.46	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=122 TT=79.734 T1=79.74	OPT f=122 TT=33.09 T1=33.08	OPT f=122 TT=35.195 T1=35.2	OPT f=122 TT=22.464 T1=22.46	SAT (TO) f=127 TT=1800.15 T1=413.24	SAT (TO) f=122 TT=1800.09 T1=1638.83	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/heinz/ normalized-neos-544324.opb	SAT f=17 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT (TO) f=17 TT=1800.09 T1=1800.4	? (TO) TT=1800.05	? (TO) TT=1800.22	? (TO) TT=1800.33	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/heinz/ normalized-neos-547911.opb	SAT f=15 TT=1800.05 T1=572.46	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=16 TT=1800.01 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=15 TT=1800.05 T1=572.46	SAT (TO) f=16 TT=1800.04 T1=62.74	? (TO) TT=1800.06
/OPT-SMALLINT-LIN/heinz/ normalized-neos-631710.opb	SAT f=206 TT=1800.22 T1=1800.5	No data	? (TO) TT=1800.18	? (TO) TT=1800.03	SAT (TO) f=206 TT=1800.22 T1=1800.5	? (TO) TT=1800.05	SAT (TO) f=555 TT=1800.17 T1=1800.4	SAT (TO) f=555 TT=1800.21 T1=1800.4	SAT (TO) f=509 TT=1800.73 T1=130.67	SAT (TO) f=316 TT=1800.08 T1=870.36	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/heinz/ normalized-neos-777800.opb	OPT f=-80 TT=97.778 T1=97.78	No data	? (TO) TT=1800.35	? (TO) TT=1800.03	OPT f=-80 TT=1786.21 T1=1786.54	OPT f=-80 TT=678.928 T1=679.02	SAT (TO) f=-80 TT=1800.1 T1=1800.4	OPT f=-80 TT=97.778 T1=97.78	? (TO) TT=1802.54	? (TO) TT=1800.8	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/heinz/ normalized-neos-785912.opb	UNSAT TT=3.381	No data	UNSAT TT=14.75	UNSAT TT=14.52	UNSAT TT=68.218	UNSAT TT=6.565	UNSAT TT=3.381	UNSAT TT=3.438	UNSAT TT=12.412	UNSAT TT=6.174	UNSAT TT=36.165
/OPT-SMALLINT-LIN/heinz/ normalized-neos788725.opb	UNSAT TT=370.61	No data	UNSAT TT=398.97	UNSAT TT=402.791	? (TO) TT=1800.02	UNSAT TT=370.61	UNSAT TT=1353.75	UNSAT TT=1324.74	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/heinz/ normalized-neos-807456.opb		No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/heinz/ normalized-neos-859770.opb	UNSAT TT=56.336	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=318.225	UNSAT TT=56.336	? (TO) TT=1800.07	? (TO) TT=1800.16	UNSAT TT=1444.08	? (TO) TT=1800.68	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/heinz/ normalized-ns1696083.opb	OPT f=45 TT=393.475 T1=185.25	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=50 TT=1800.08 T1=1800.4	SAT (TO) f=47 TT=1800.07 T1=1800.5	? TT=65.981	? TT=66.43	SAT (TO) f=45 TT=1800.41 T1=705.79	OPT f=45 TT=393.475 T1=185.25	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/heinz/ normalized-ns1745726.opb	UNSAT TT=5.661	No data	UNSAT TT=9.024	UNSAT TT=8.907	UNSAT TT=17.757	UNSAT TT=54.931	UNSAT TT=103.755	UNSAT TT=107.956	UNSAT TT=13.861	UNSAT TT=5.661	UNSAT TT=39.166
/OPT-SMALLINT-LIN/heinz/ normalized-ns1853823.opb	SAT f=43 TT=1800.06 T1=146.28	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT (TO) f=1730 TT=1800.35 T1=1800.4	? (TO) TT=1800.35	? (TO) TT=1800.24	SAT (TO) f=43 TT=1800.06 T1=146.28	No Cert. TT=1800.79	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/ heinz/normalized-ns894244.opb		No data	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ heinz/normalized-ns894788.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/heinz/ normalized-p6b.opb	SAT f=-61 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT (TO) f=-59 TT=1800.02 T1=1800.3	SAT (TO) f=-52 TT=1800.02 T1=1800.3	SAT (TO) f=-52 TT=1800.02 T1=1800.3	SAT (TO) f=-61 TT=1800.02 T1=1800.3	SAT (TO) f=-54 TT=1800.95 T1=1.38	SAT (TO) f=-54 TT=1800.78 T1=0.36	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/ heinz/ normalized-pb-simp-nonunif.opb	OPT f=42 TT=5.88 T1=5.86	No data	OPT f=42 TT=18.103 T1=18.09	OPT f=42 TT=11 T1=10.99	OPT f=42 TT=11.187 T1=11.17	OPT f=42 TT=10.535 T1=10.53	OPT f=42 TT=5.88 T1=5.86	OPT f=42 TT=6.96 T1=6.94	SAT (TO) f=43 TT=1800.1 T1=177.02	SAT (TO) f=42 TT=1800.06 T1=328.14	OPT f=42 TT=26.985 T1=26.71
/OPT-SMALLINT-LIN/ heinz/normalized-protfold.opb	SAT f=-25 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=-25 TT=1800.08 T1=1800.4	SAT (TO) f=-13 TT=1800.06 T1=1800.4	SAT (TO) f=-11 TT=1800.02 T1=1800.3	SAT (TO) f=-25 TT=1800.1 T1=1800.4	SAT (TO) f=-22 TT=1800.04 T1=677.54	SAT (TO) f=-24 TT=1800.03 T1=632.27	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/heinz/ normalized-queens-30.opb	SAT f=-38 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-36 TT=1800.09 T1=1800.4	SAT (TO) f=-34 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.08 T1=1800.4	SAT (TO) f=-38 TT=1800.07 T1=1800.4	SAT (TO) f=-36 TT=1800.57 T1=18.69	SAT (TO) f=-31 TT=1800.07 T1=0.62	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/ heinz/normalized-seymour.opb	SAT f=449 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=459 TT=1800.01 T1=1800.3	SAT (TO) f=502 TT=1800.02 T1=1800.3	SAT (TO) f=502 TT=1800.02 T1=1800.3	SAT (TO) f=449 TT=1800.02 T1=1800.3	SAT (TO) f=483 TT=1800.17 T1=889.72	SAT (TO) f=501 TT=1800.75 T1=0.62	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/heinz/ normalized-tanglegram1.opb	OPT f=5182 TT=1210.91 T1=1211.14	No data	? (TO) TT=1800.05	? (TO) TT=1800.16	SAT (TO) f=7518 TT=1800.08 T1=1800.4	SAT (TO) f=7518 TT=1800.12 T1=1800.4	SAT (TO) f=9688 TT=1800.09 T1=1800.4	OPT f=5182 TT=1210.91 T1=1211.14	SAT (TO) f=7160 TT=1800.13 T1=162.88	SAT (TO) f=7102 TT=1800.01 T1=95.63	? (TO) TT=1800.15
/OPT-SMALLINT-LIN/heinz/ normalized-tanglegram3.opb	SAT f=15979 TT=1800.09 T1=1800.4	No data	Signal TT=1623.02	? (TO) TT=1800.08	SAT (TO) f=27171 TT=1800.08 T1=1800.5	SAT (TO) f=27171 TT=1800.15 T1=1800.3	SAT (TO) f=27426 TT=1800.09 T1=1800.4	SAT (TO) f=15979 TT=1800.09 T1=1800.4	SAT (TO) f=23598 TT=1800.12 T1=2.37	SAT (TO) f=23598 TT=1800.24 T1=1.9	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/heinz/ normalized-toll-like.opb	SAT f=761 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=956 TT=1800.02 T1=1800.3	SAT (TO) f=1118 TT=1800.11 T1=1800.4	SAT (TO) f=853 TT=1800.02 T1=1800.3	SAT (TO) f=761 TT=1800.01 T1=1800.3	SAT (TO) f=806 TT=1800.05 T1=743.29	SAT (TO) f=833 TT=1800.02 T1=0.5	? (TO) TT=1800.13
/OPT-SMALLINT-LIN/ heinz/ normalized-wnq-n100-mw99-14.opb	SAT f=398 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=6109 TT=1800.05 T1=1800.6	SAT (TO) f=4612 TT=1800.08 T1=1800.4	SAT (TO) f=398 TT=1800.09 T1=1800.4	? TT=70.593	SAT (TO) f=869 TT=1800.04 T1=124.26	SAT (TO) f=778 TT=1800 T1=3.36	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/ kullmann/ normalized-mul_8_11_shg.opb	SAT f=176 TT=1800.61 T1=331.09	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=194 TT=1800.04 T1=1800.5	SAT (TO) f=194 TT=1800.06 T1=1800.4	SAT (TO) f=194 TT=1800.06 T1=1800.4	SAT (TO) f=194 TT=1800.1 T1=1800.4	SAT (TO) f=176 TT=1800.61 T1=331.09	No Cert. TT=1800.02	? (TO) TT=1800.22
/OPT-SMALLINT-LIN/ kullmann/ normalized-mul_8_13_shg.opb	SAT f=155 TT=1800.64 T1=256.06	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT (TO) f=162 TT=1800.17 T1=1800.5	SAT (TO) f=162 TT=1800.09 T1=1800.4	SAT (TO) f=162 TT=1800.12 T1=1800.5	SAT (TO) f=162 TT=1800.07 T1=1800.4	SAT (TO) f=155 TT=1800.64 T1=256.06	No Cert. TT=1800.09	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/ kullmann/ normalized-mul_8_14_shg.opb	SAT f=104 TT=1800 T1=9.78	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=110 TT=1800.03 T1=1800.4	SAT (TO) f=110 TT=1800.1 T1=1800.4	SAT (TO) f=110 TT=1800.1 T1=1800.5	SAT (TO) f=110 TT=1800.11 T1=1800.4	SAT (TO) f=104 TT=1800 T1=9.78	No Cert. TT=1800.35	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/ kullmann/normalized-mul_8_3_shg.opb	SAT f=44 TT=1800.05 T1=3.25	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT (TO) f=45 TT=1800.02 T1=1800.4	SAT (TO) f=45 TT=1800.08 T1=1800.4	SAT (TO) f=45 TT=1800.1 T1=1800.4	SAT (TO) f=45 TT=1800.11 T1=1800.4	SAT (TO) f=44 TT=1800.05 T1=4.46	SAT (TO) f=44 TT=1800.08 T1=3.25	? (TO) TT=1800
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ kullmann/normalized-mul_8_9_shg.opb	SAT f=81 TT=1800.07 T1=209.86	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT (TO) f=83 TT=1800.08 T1=1800.4	SAT (TO) f=83 TT=1800.04 T1=1800.4	SAT (TO) f=83 TT=1800.1 T1=1800.4	SAT (TO) f=83 TT=1800.09 T1=1800.4	SAT (TO) f=81 TT=1800.07 T1=209.86	No Cert. TT=1800.08	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/ kullmann/normalized-sbox_4_shg.opb	OPT f=22 TT=0.194 T1=0.19	No data	OPT f=22 TT=86.236 T1=86.24	OPT f=22 TT=111.737 T1=111.75	SAT (TO) f=22 TT=1800.02 T1=1800.3	SAT (TO) f=22 TT=1800.02 T1=1800.3	OPT f=22 TT=0.194 T1=0.19	SAT (TO) f=22 TT=1800.02 T1=1800.3	SAT (TO) f=22 TT=1800.12 T1=149.26	SAT (TO) f=29 TT=1800.7 T1=1141.7	? (TO) TT=1800.02
/OPT-SMALLINT-LIN/ kullmann/normalized-sbox_8_shg.opb	SAT f=842 TT=1800.02 T1=865.55	No data	? (TO) TT=1800.28	? (TO) TT=1800.04	? (TO) TT=1800.5	SAT (TO) f=845 TT=1800.32 T1=1800.3	SAT (TO) f=845 TT=1800.09 T1=1800.4	SAT (TO) f=845 TT=1800.16 T1=1800.4	SAT (TO) f=842 TT=1800.02 T1=865.55	No Cert. TT=1800.9	? (MO) TT=393.968
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1034.cudf.paranoid.opb	UNSAT TT=0.019	No data	UNSAT TT=0.037	UNSAT TT=0.03	UNSAT TT=0.073	UNSAT TT=0.062	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=1.824	UNSAT TT=0.633	UNSAT TT=0.118
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1037.cudf.paranoid.opb	OPT f=90 TT=0.006 T1=0	No data	OPT f=90 TT=0.032 T1=0.03	OPT f=90 TT=0.019 T1=0.02	OPT f=90 TT=0.027 T1=0.02	OPT f=90 TT=0.029 T1=0.03	OPT f=90 TT=0.006 T1=0	OPT f=90 TT=0.007 T1=0	OPT f=90 TT=0.654 T1=1.78	OPT f=90 TT=0.465 T1=0.28	OPT f=90 TT=0.145 T1=0.13
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1077.cudf.paranoid.opb	UNSAT TT=0.014	No data	UNSAT TT=0.031	UNSAT TT=0.025	UNSAT TT=0.041	UNSAT TT=0.045	UNSAT TT=0.014	UNSAT TT=0.014	UNSAT TT=0.584	UNSAT TT=0.524	UNSAT TT=0.101
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1078.cudf.paranoid.opb	OPT f=4 TT=0 T1=0	No data	OPT f=4 TT=0.021 T1=0.02	OPT f=4 TT=0.012 T1=0.01	OPT f=4 TT=0 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.002 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.164 T1=0.62	OPT f=4 TT=0.156 T1=0.11	OPT f=4 TT=0.014 T1=0.01
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1093.cudf.paranoid.opb	UNSAT TT=0.017	No data	UNSAT TT=0.035	UNSAT TT=0.029	UNSAT TT=0.054	UNSAT TT=0.055	UNSAT TT=0.017	UNSAT TT=0.017	UNSAT TT=0.674	UNSAT TT=0.564	UNSAT TT=0.111
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1094.cudf.paranoid.opb	OPT f=126 TT=0.008 T1=0	No data	OPT f=126 TT=0.033 T1=0.03	OPT f=126 TT=0.018 T1=0.01	OPT f=126 TT=0.026 T1=0.02	OPT f=126 TT=0.022 T1=0.02	OPT f=126 TT=0.008 T1=0	OPT f=126 TT=0.008 T1=0	OPT f=126 TT=0.592 T1=0.79	OPT f=126 TT=0.433 T1=0.26	OPT f=126 TT=0.179 T1=0.17
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1097.cudf.paranoid.opb	OPT f=125 TT=0.007 T1=0	No data	OPT f=125 TT=0.032 T1=0.03	OPT f=125 TT=0.02 T1=0.01	OPT f=125 TT=0.023 T1=0.02	OPT f=125 TT=0.022 T1=0.02	OPT f=125 TT=0.007 T1=0	OPT f=125 TT=0.008 T1=0	OPT f=125 TT=0.613 T1=0.79	OPT f=125 TT=0.435 T1=0.26	OPT f=125 TT=0.176 T1=0.16
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1098.cudf.paranoid.opb	OPT f=256 TT=0.018 T1=0.01	No data	OPT f=256 TT=0.051 T1=0.05	OPT f=256 TT=0.031 T1=0.03	OPT f=256 TT=0.063 T1=0.06	OPT f=256 TT=0.062 T1=0.06	OPT f=256 TT=0.018 T1=0.01	OPT f=256 TT=0.019 T1=0.02	OPT f=256 TT=2.234 T1=1.85	OPT f=256 TT=0.804 T1=0.39	OPT f=256 TT=0.393 T1=0.38
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/ normalized-1125.cudf.paranoid.opb	UNSAT TT=0.003	No data	UNSAT TT=0.02	UNSAT TT=0.014	UNSAT TT=0.008	UNSAT TT=0.008	UNSAT TT=0.003	UNSAT TT=0.004	UNSAT TT=0.263	UNSAT TT=0.224	UNSAT TT=0.028
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-121.cudf.paranoid.opb	UNSAT TT=0.045	No data	UNSAT TT=0.061	UNSAT TT=0.049	UNSAT TT=0.124	UNSAT TT=0.127	UNSAT TT=0.045	UNSAT TT=0.048	UNSAT TT=1.334	UNSAT TT=0.713	UNSAT TT=0.263
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-122.cudf.paranoid.opb	UNSAT TT=0.047	No data	UNSAT TT=0.061	UNSAT TT=0.05	UNSAT TT=0.124	UNSAT TT=0.127	UNSAT TT=0.047	UNSAT TT=0.049	UNSAT TT=1.313	UNSAT TT=0.714	UNSAT TT=0.261
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-658.cudf.paranoid.opb	UNSAT TT=0.007	No data	UNSAT TT=0.024	UNSAT TT=0.019	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=0.474	UNSAT TT=0.364	UNSAT TT=0.059
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-787.cudf.paranoid.opb	OPT f=14 TT=0.001 T1=0	No data	OPT f=14 TT=0.022 T1=0.02	OPT f=14 TT=0.014 T1=0.01	OPT f=14 TT=0.003 T1=0	OPT f=14 TT=0.003 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.195 T1=0.65	OPT f=14 TT=0.186 T1=0.14	OPT f=14 TT=0.024 T1=0.01
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-869.cudf.paranoid.opb	UNSAT TT=0.007	No data	UNSAT TT=0.024	UNSAT TT=0.019	UNSAT TT=0.02	UNSAT TT=0.02	UNSAT TT=0.008	UNSAT TT=0.007	UNSAT TT=0.444	UNSAT TT=0.365	UNSAT TT=0.058
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-902.cudf.paranoid.opb	OPT f=277 TT=0.025 T1=0.02	No data	OPT f=277 TT=0.074 T1=0.07	OPT f=277 TT=0.047 T1=0.04	OPT f=277 TT=0.11 T1=0.11	OPT f=277 TT=0.097 T1=0.1	OPT f=277 TT=0.025 T1=0.02	OPT f=277 TT=0.034 T1=0.03	OPT f=277 TT=3.184 T1=2.41	OPT f=277 TT=1.053 T1=0.47	OPT f=277 TT=0.593 T1=0.57
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-990.cudf.paranoid.opb	OPT f=273 TT=0.023 T1=0.02	No data	OPT f=273 TT=0.069 T1=0.06	OPT f=273 TT=0.051 T1=0.04	OPT f=273 TT=0.114 T1=0.11	OPT f=273 TT=0.113 T1=0.11	OPT f=273 TT=0.023 T1=0.02	OPT f=273 TT=0.034 T1=0.03	OPT f=273 TT=2.815 T1=3.41	OPT f=273 TT=1.074 T1=0.45	OPT f=273 TT=0.606 T1=0.59
/OPT-SMALLINT-LIN/leberre/ opb-paranoid/misc2010/datasets/caixa/ normalized-995.cudf.paranoid.opb	UNSAT TT=0.003	No data	UNSAT TT=0.02	UNSAT TT=0.014	UNSAT TT=0.009	UNSAT TT=0.01	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.294	UNSAT TT=0.273	UNSAT TT=0.034
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand0c02bc.cudf.paranoid.opb	OPT f=8730 TT=0.303 T1=0.3	No data	OPT f=8730 TT=59.729 T1=59.72	? (TO) TT=1800.02	OPT f=8730 TT=78.396 T1=78.36	OPT f=8730 TT=4.411 T1=4.38	OPT f=8730 TT=0.303 T1=0.3	OPT f=8730 TT=0.688 T1=0.68	OPT f=8730 TT=897.65 T1=718.89	OPT f=8730 TT=637.66 T1=614.42	OPT f=8730 TT=619.273 T1=618.52
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand199fd6.cudf.paranoid.opb	UNSAT TT=0.097	No data	UNSAT TT=0.117	UNSAT TT=0.097	UNSAT TT=0.311	UNSAT TT=0.31	UNSAT TT=0.115	UNSAT TT=0.119	UNSAT TT=1.494	UNSAT TT=0.833	UNSAT TT=0.6
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand2d8467.cudf.paranoid.opb	OPT f=13125 TT=0.338 T1=0.33	No data	OPT f=13125 TT=18.44 T1=18.43	? (TO) TT=1800.03	OPT f=13125 TT=709.223 T1=709.28	OPT f=13125 TT=6.037 T1=6	OPT f=13125 TT=0.338 T1=0.33	OPT f=13125 TT=0.656 T1=0.65	OPT f=13125 TT=782.864 T1=354.98	OPT f=13125 TT=437.58 T1=437.87	OPT f=13125 TT=495.156 T1=492.4
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand35d0c8.cudf.paranoid.opb	OPT f=5656 TT=0.332 T1=0.33	No data	OPT f=5656 TT=1.724 T1=1.71	? (TO) TT=1800.03	OPT f=5656 TT=106.236 T1=106.2	OPT f=5656 TT=7.256 T1=7.22	OPT f=5656 TT=0.332 T1=0.33	OPT f=5656 TT=0.538 T1=0.54	OPT f=5656 TT=1365.91 T1=381.94	SAT (TO) f=5665 TT=1800.01 T1=1413.57	OPT f=5656 TT=713.954 T1=713.37
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand4bf850.cudf.paranoid.opb	OPT f=10949 TT=0.332 T1=0.33	No data	OPT f=10949 TT=15.68 T1=15.67	? (TO) TT=1800.03	OPT f=10949 TT=222.194 T1=222.19	OPT f=10949 TT=5.95 T1=5.91	OPT f=10949 TT=0.332 T1=0.33	OPT f=10949 TT=0.632 T1=0.63	OPT f=10949 TT=628.149 T1=66.8	OPT f=10949 TT=785.4 T1=395.37	OPT f=10949 TT=654.293 T1=650.44
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand65d021.cudf.paranoid.opb	UNSAT TT=0.106	No data	UNSAT TT=0.202	UNSAT TT=0.115	UNSAT TT=0.417	UNSAT TT=0.395	UNSAT TT=0.106	UNSAT TT=0.113	UNSAT TT=3.373	UNSAT TT=1.133	UNSAT TT=0.704
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-rand902db1.cudf.paranoid.opb	OPT f=0 TT=0.101 T1=0.1	No data	OPT f=0 TT=0.2 T1=0.19	OPT f=0 TT=0.324 T1=0.32	OPT f=0 TT=0.75 T1=0.74	OPT f=0 TT=0.5 T1=0.49	OPT f=0 TT=0.101 T1=0.1	OPT f=0 TT=0.15 T1=0.14	OPT f=0 TT=2.714 T1=1.2	OPT f=0 TT=1.093 T1=0.53	OPT f=0 TT=2.109 T1=2.04
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randa09fe9.cudf.paranoid.opb	OPT f=9469 TT=0.378 T1=0.37	No data	OPT f=9469 TT=5.879 T1=5.87	? (TO) TT=1800.02	SAT (TO) f=11369 TT=1800.06 T1=1800.4	OPT f=9469 TT=3.763 T1=3.73	OPT f=9469 TT=0.378 T1=0.37	OPT f=9469 TT=0.643 T1=0.64	OPT f=9469 TT=17.98 T1=7.78	OPT f=9469 TT=34.358 T1=29.2	OPT f=9469 TT=912.291 T1=911.5
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randa491d5.cudf.paranoid.opb	UNSAT TT=0.115	No data	UNSAT TT=0.212	UNSAT TT=0.121	UNSAT TT=0.44	UNSAT TT=0.415	UNSAT TT=0.115	UNSAT TT=0.119	UNSAT TT=3.584	UNSAT TT=1.205	UNSAT TT=0.757
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randa6997e.cudf.paranoid.opb	OPT f=5898 TT=0.42 T1=0.42	No data	OPT f=5898 TT=58.208 T1=58.2	? (TO) TT=1800.03	OPT f=5898 TT=570.437 T1=570.47	OPT f=5898 TT=5.226 T1=5.2	OPT f=5898 TT=0.42 T1=0.42	OPT f=5898 TT=0.667 T1=0.66	OPT f=5898 TT=534.744 T1=26.31	OPT f=5898 TT=585.35 T1=163.73	OPT f=5898 TT=954.676 T1=954.35
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randaef248.cudf.paranoid.opb	UNSAT TT=0.098	No data	UNSAT TT=0.116	UNSAT TT=0.098	UNSAT TT=0.424	UNSAT TT=0.392	UNSAT TT=0.113	UNSAT TT=0.121	UNSAT TT=2.324	UNSAT TT=0.904	UNSAT TT=0.609
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randaefc7c.cudf.paranoid.opb	OPT f=0 TT=0.103 T1=0.1	No data	OPT f=0 TT=0.243 T1=0.23	OPT f=0 TT=464.289 T1=464.35	OPT f=0 TT=443.964 T1=443.92	OPT f=0 TT=2.927 T1=2.9	OPT f=0 TT=0.103 T1=0.1	OPT f=0 TT=0.156 T1=0.15	OPT f=0 TT=2.696 T1=1.16	OPT f=0 TT=1.103 T1=0.49	OPT f=0 TT=4.765 T1=4.84
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randb87834.cudf.paranoid.opb	OPT f=11434 TT=0.364 T1=0.36	No data	OPT f=11434 TT=33.371 T1=33.36	? (TO) TT=1800.03	OPT f=11434 TT=973.101 T1=973.19	OPT f=11434 TT=5.525 T1=5.49	OPT f=11434 TT=0.364 T1=0.36	OPT f=11434 TT=0.575 T1=0.57	OPT f=11434 TT=294.528 T1=196.46	OPT f=11434 TT=128.443 T1=112.77	OPT f=11434 TT=843.336 T1=842.29
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randbccf2d.cudf.paranoid.opb	OPT f=6128 TT=0.387 T1=0.38	No data	OPT f=6128 TT=5.203 T1=5.19	? (TO) TT=1800.03	OPT f=6128 TT=1566.49 T1=1566.63	OPT f=6128 TT=3.819 T1=3.79	OPT f=6128 TT=0.387 T1=0.38	OPT f=6128 TT=0.612 T1=0.61	OPT f=6128 TT=513.107 T1=183.87	OPT f=6128 TT=666.84 T1=650.67	OPT f=6128 TT=659.754 T1=659.12
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randd1cab2.cudf.paranoid.opb	OPT f=15492 TT=0.358 T1=0.35	No data	OPT f=15492 TT=1.537 T1=1.53	? (TO) TT=1800.03	OPT f=15492 TT=497.656 T1=497.65	OPT f=15492 TT=4.86 T1=4.82	OPT f=15492 TT=0.358 T1=0.35	OPT f=15492 TT=0.735 T1=0.73	OPT f=15492 TT=124.085 T1=2.74	OPT f=15492 TT=320.786 T1=294.73	OPT f=15492 TT=851.15 T1=849.77
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randf7d077.cudf.paranoid.opb	UNSAT TT=0.112	No data	UNSAT TT=0.215	UNSAT TT=0.122	UNSAT TT=0.463	UNSAT TT=0.435	UNSAT TT=0.112	UNSAT TT=0.12	UNSAT TT=2.784	UNSAT TT=1.154	UNSAT TT=0.76
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.biglist/ normalized-randfe95e3.cudf.paranoid.opb	UNSAT TT=0.094	No data	UNSAT TT=0.111	UNSAT TT=0.094	UNSAT TT=0.395	UNSAT TT=0.299	UNSAT TT=0.107	UNSAT TT=0.113	UNSAT TT=2.343	UNSAT TT=0.934	UNSAT TT=0.564
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand00ebc7.cudf.paranoid.opb	UNSAT TT=0.086	No data	UNSAT TT=0.101	UNSAT TT=0.086	UNSAT TT=0.35	UNSAT TT=0.265	UNSAT TT=0.094	UNSAT TT=0.1	UNSAT TT=2.305	UNSAT TT=0.904	UNSAT TT=0.456
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand085d8a.cudf.paranoid.opb	OPT f=10580 TT=0.222 T1=0.22	No data	OPT f=10580 TT=1.981 T1=1.97	? (TO) TT=1800.03	OPT f=10580 TT=375.957 T1=375.96	OPT f=10580 TT=3.282 T1=3.25	OPT f=10580 TT=0.222 T1=0.22	OPT f=10580 TT=0.367 T1=0.36	OPT f=10580 TT=6.452 T1=5.7	OPT f=10580 TT=3.036 T1=1.56	OPT f=10580 TT=378.075 T1=377.04
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand0a62b6.cudf.paranoid.opb	OPT f=6943 TT=0.258 T1=0.27	No data	OPT f=6943 TT=4.756 T1=4.75	? (TO) TT=1800.03	OPT f=6943 TT=198.872 T1=198.87	OPT f=6943 TT=4.423 T1=4.4	OPT f=6943 TT=0.258 T1=0.27	OPT f=6943 TT=0.435 T1=0.43	OPT f=6943 TT=11.623 T1=8.29	OPT f=6943 TT=2.824 T1=1.37	OPT f=6943 TT=443.098 T1=442.27
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand18b530.cudf.paranoid.opb	OPT f=6563 TT=0.23 T1=0.22	No data	OPT f=6563 TT=2.899 T1=2.89	? (TO) TT=1800.03	OPT f=6563 TT=566.673 T1=566.72	OPT f=6563 TT=4.442 T1=4.41	OPT f=6563 TT=0.23 T1=0.22	OPT f=6563 TT=0.355 T1=0.35	OPT f=6563 TT=5.133 T1=2.72	OPT f=6563 TT=2.093 T1=0.84	OPT f=6563 TT=319.575 T1=318.77
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand271a0d.cudf.paranoid.opb	UNSAT TT=0.083	No data	UNSAT TT=0.098	UNSAT TT=0.083	UNSAT TT=0.252	UNSAT TT=0.254	UNSAT TT=0.093	UNSAT TT=0.099	UNSAT TT=1.373	UNSAT TT=0.817	UNSAT TT=0.43
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand27da90.cudf.paranoid.opb	OPT f=11364 TT=0.244 T1=0.24	No data	OPT f=11364 TT=5.23 T1=5.22	? (TO) TT=1800.03	OPT f=11364 TT=1242.43 T1=1242.55	OPT f=11364 TT=5.119 T1=5.09	OPT f=11364 TT=0.244 T1=0.24	OPT f=11364 TT=0.444 T1=0.44	OPT f=11364 TT=23.481 T1=20.81	OPT f=11364 TT=4.353 T1=3.13	OPT f=11364 TT=517.048 T1=515.86
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand362510.cudf.paranoid.opb	OPT f=1964 TT=0.255 T1=0.25	No data	OPT f=1964 TT=5.104 T1=5.09	? (TO) TT=1800.03	OPT f=1964 TT=1243.47 T1=1243.58	OPT f=1964 TT=4.328 T1=4.3	OPT f=1964 TT=0.255 T1=0.25	OPT f=1964 TT=0.527 T1=0.52	OPT f=1964 TT=172.129 T1=136.59	OPT f=1964 TT=34.87 T1=28.82	OPT f=1964 TT=469.535 T1=469.3
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand3c03fd.cudf.paranoid.opb	OPT f=4927 TT=0.223 T1=0.22	No data	OPT f=4927 TT=19.104 T1=19.09	? (TO) TT=1800.03	OPT f=4927 TT=418.817 T1=418.81	OPT f=4927 TT=3.757 T1=3.73	OPT f=4927 TT=0.223 T1=0.22	OPT f=4927 TT=0.409 T1=0.41	OPT f=4927 TT=34.57 T1=23.83	OPT f=4927 TT=14.482 T1=13.02	OPT f=4927 TT=293.556 T1=292.4
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand4a23d9.cudf.paranoid.opb	OPT f=6114 TT=0.184 T1=0.18	No data	OPT f=6114 TT=4.147 T1=4.14	? (TO) TT=1800.03	OPT f=6114 TT=896.474 T1=896.6	OPT f=6114 TT=4.951 T1=4.92	OPT f=6114 TT=0.184 T1=0.18	OPT f=6114 TT=0.288 T1=0.28	OPT f=6114 TT=6.112 T1=4.7	OPT f=6114 TT=2.453 T1=1.21	OPT f=6114 TT=273.926 T1=265.67
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand4b919e.cudf.paranoid.opb	OPT f=5116 TT=0.234 T1=0.23	No data	OPT f=5116 TT=26.305 T1=26.29	? (TO) TT=1800.03	OPT f=5116 TT=312.119 T1=312.13	OPT f=5116 TT=6.209 T1=6.17	OPT f=5116 TT=0.234 T1=0.23	OPT f=5116 TT=0.464 T1=0.46	OPT f=5116 TT=32.889 T1=16.76	OPT f=5116 TT=34.72 T1=32.91	OPT f=5116 TT=413.988 T1=407.12
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand5d20db.cudf.paranoid.opb	OPT f=5106 TT=0.276 T1=0.27	No data	OPT f=5106 TT=4.27 T1=4.26	? (TO) TT=1800.03	OPT f=5106 TT=702.217 T1=702.28	OPT f=5106 TT=3.686 T1=3.66	OPT f=5106 TT=0.276 T1=0.27	OPT f=5106 TT=0.365 T1=0.36	OPT f=5106 TT=7.822 T1=5.27	OPT f=5106 TT=3.784 T1=2.22	OPT f=5106 TT=394.812 T1=394.25
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand71b131.cudf.paranoid.opb	OPT f=5657 TT=0.315 T1=0.31	No data	OPT f=5657 TT=17.453 T1=17.44	? (TO) TT=1800.03	OPT f=5657 TT=1059.85 T1=1059.99	OPT f=5657 TT=2.719 T1=2.7	OPT f=5657 TT=0.315 T1=0.31	OPT f=5657 TT=0.591 T1=0.59	OPT f=5657 TT=96.289 T1=32.37	OPT f=5657 TT=45.276 T1=27.72	OPT f=5657 TT=834.001 T1=832.81
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand767898.cudf.paranoid.opb	OPT f=4821 TT=0.235 T1=0.23	No data	OPT f=4821 TT=7.986 T1=7.98	? (TO) TT=1800.03	OPT f=4821 TT=181.181 T1=181.17	OPT f=4821 TT=3.974 T1=3.95	OPT f=4821 TT=0.235 T1=0.23	OPT f=4821 TT=0.424 T1=0.42	OPT f=4821 TT=10.232 T1=7.76	OPT f=4821 TT=7.343 T1=5.67	OPT f=4821 TT=452.058 T1=451.54
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-rand9ffe99.cudf.paranoid.opb	OPT f=4905 TT=0.268 T1=0.26	No data	OPT f=4905 TT=3.996 T1=3.99	? (TO) TT=1800.03	OPT f=4905 TT=820.273 T1=820.24	OPT f=4905 TT=2.607 T1=2.59	OPT f=4905 TT=0.268 T1=0.26	OPT f=4905 TT=0.421 T1=0.41	OPT f=4905 TT=7.923 T1=4.25	OPT f=4905 TT=3.073 T1=1.7	OPT f=4905 TT=486.641 T1=486.22
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randa2004a.cudf.paranoid.opb	OPT f=1859 TT=0.225 T1=0.22	No data	OPT f=1859 TT=0.639 T1=0.63	? (TO) TT=1800.03	OPT f=1859 TT=458.108 T1=458.17	OPT f=1859 TT=4.511 T1=4.48	OPT f=1859 TT=0.225 T1=0.22	OPT f=1859 TT=0.339 T1=0.33	OPT f=1859 TT=7.313 T1=2.25	OPT f=1859 TT=2.403 T1=0.77	OPT f=1859 TT=419.37 T1=419.19
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randb54299.cudf.paranoid.opb	OPT f=11142 TT=0.27 T1=0.27	No data	OPT f=11142 TT=1.808 T1=1.8	OPT f=11142 TT=1182.71 T1=1182.88	OPT f=11142 TT=382.624 T1=382.61	OPT f=11142 TT=3.605 T1=3.58	OPT f=11142 TT=0.27 T1=0.27	OPT f=11142 TT=0.382 T1=0.38	OPT f=11142 TT=29.313 T1=24.31	OPT f=11142 TT=3.374 T1=1.6	OPT f=11142 TT=513.408 T1=512.43
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randc18b26.cudf.paranoid.opb	OPT f=10655 TT=0.3 T1=0.29	No data	OPT f=10655 TT=11.613 T1=11.6	? (TO) TT=1800.03	OPT f=10655 TT=497.708 T1=497.69	OPT f=10655 TT=5.46 T1=5.43	OPT f=10655 TT=0.3 T1=0.29	OPT f=10655 TT=0.598 T1=0.59	OPT f=10655 TT=19.302 T1=6.27	OPT f=10655 TT=119.25 T1=115.85	OPT f=10655 TT=714.352 T1=713.29
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randc5b1f2.cudf.paranoid.opb	UNSAT TT=0.084	No data	UNSAT TT=0.099	UNSAT TT=0.084	UNSAT TT=0.254	UNSAT TT=0.26	UNSAT TT=0.094	UNSAT TT=0.098	UNSAT TT=1.414	UNSAT TT=0.835	UNSAT TT=0.432
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randc5fe62.cudf.paranoid.opb	OPT f=1882 TT=0.266 T1=0.26	No data	OPT f=1882 TT=6.984 T1=6.97	? (TO) TT=1800.03	OPT f=1882 TT=336.046 T1=336.09	OPT f=1882 TT=4.683 T1=4.66	OPT f=1882 TT=0.266 T1=0.26	OPT f=1882 TT=0.592 T1=0.59	OPT f=1882 TT=496.778 T1=457.8	OPT f=1882 TT=103.69 T1=93.4	OPT f=1882 TT=619.883 T1=619.49
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randc7f8e5.cudf.paranoid.opb	OPT f=9465 TT=0.239 T1=0.23	No data	OPT f=9465 TT=9.884 T1=9.87	? (TO) TT=1800.03	OPT f=9465 TT=1047.75 T1=1047.89	OPT f=9465 TT=4.918 T1=4.89	OPT f=9465 TT=0.239 T1=0.23	OPT f=9465 TT=0.409 T1=0.41	OPT f=9465 TT=9.844 T1=5.74	OPT f=9465 TT=4.342 T1=2.48	OPT f=9465 TT=527.896 T1=526.83
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randcebca4.cudf.paranoid.opb	OPT f=6576 TT=0.26 T1=0.25	No data	OPT f=6576 TT=3.615 T1=3.6	? (TO) TT=1800.03	OPT f=6576 TT=523.323 T1=523.35	OPT f=6576 TT=4.029 T1=4	OPT f=6576 TT=0.26 T1=0.25	OPT f=6576 TT=0.437 T1=0.43	OPT f=6576 TT=12.582 T1=10.23	OPT f=6576 TT=3.204 T1=1.91	OPT f=6576 TT=518.953 T1=518.3
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randd7b2b4.cudf.paranoid.opb	OPT f=4750 TT=0.208 T1=0.2	No data	OPT f=4750 TT=4.711 T1=4.7	? (TO) TT=1800.03	OPT f=4750 TT=328.116 T1=328.14	OPT f=4750 TT=4.49 T1=4.46	OPT f=4750 TT=0.208 T1=0.2	OPT f=4750 TT=0.389 T1=0.38	OPT f=4750 TT=8.015 T1=6.76	OPT f=4750 TT=3.663 T1=2.43	OPT f=4750 TT=372.797 T1=372.28
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randd92c9f.cudf.paranoid.opb	OPT f=6259 TT=0.204 T1=0.2	No data	OPT f=6259 TT=1.163 T1=1.15	? (TO) TT=1800.03	OPT f=6259 TT=236.983 T1=236.99	OPT f=6259 TT=4.031 T1=4	OPT f=6259 TT=0.204 T1=0.2	OPT f=6259 TT=0.351 T1=0.35	OPT f=6259 TT=6.17 T1=4.77	OPT f=6259 TT=2.484 T1=1.25	OPT f=6259 TT=274.636 T1=273.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randec6fe1.cudf.paranoid.opb	OPT f=9316 TT=0.255 T1=0.25	No data	OPT f=9316 TT=2.53 T1=2.52	? (TO) TT=1800.03	OPT f=9316 TT=47.186 T1=47.16	OPT f=9316 TT=3.743 T1=3.72	OPT f=9316 TT=0.255 T1=0.25	OPT f=9316 TT=0.395 T1=0.39	OPT f=9316 TT=16.163 T1=6.21	OPT f=9316 TT=10.701 T1=6.04	OPT f=9316 TT=391.845 T1=390.95
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randf66c83.cudf.paranoid.opb	OPT f=4917 TT=0.226 T1=0.26	No data	OPT f=4917 TT=3.124 T1=3.11	? (TO) TT=1800.02	OPT f=4917 TT=549.327 T1=549.37	OPT f=4917 TT=3.35 T1=3.33	OPT f=4917 TT=0.226 T1=0.26	OPT f=4917 TT=0.364 T1=0.36	OPT f=4917 TT=7.133 T1=4.25	OPT f=4917 TT=3.942 T1=2.48	OPT f=4917 TT=413.647 T1=413.03
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randf794d2.cudf.paranoid.opb	OPT f=8228 TT=0.246 T1=0.24	No data	OPT f=8228 TT=8.585 T1=8.57	OPT f=8228 TT=1294.23 T1=1294.42	OPT f=8228 TT=433.946 T1=433.96	OPT f=8228 TT=4.312 T1=4.28	OPT f=8228 TT=0.246 T1=0.24	OPT f=8228 TT=0.412 T1=0.4	OPT f=8228 TT=24.94 T1=8.25	OPT f=8228 TT=38.118 T1=31.81	OPT f=8228 TT=495.616 T1=494.69
/OPT-SMALLINT-LIN/leberre/opb-paranoid/ misc2010/random/rand.newlist/ normalized-randfd04d4.cudf.paranoid.opb	OPT f=3511 TT=0.24 T1=0.23	No data	OPT f=3511 TT=0.774 T1=0.76	? (TO) TT=1800.02	OPT f=3511 TT=578.195 T1=578.23	OPT f=3511 TT=5.24 T1=5.21	OPT f=3511 TT=0.24 T1=0.23	OPT f=3511 TT=0.38 T1=0.38	OPT f=3511 TT=8.113 T1=5.52	OPT f=3511 TT=2.605 T1=1.17	OPT f=3511 TT=512.09 T1=510.64
/OPT-SMALLINT-LIN/leberre/ opb-trendy/misc2010/datasets/caixa/ normalized-1021.cudf.trendy.opb	UNSAT TT=0.003	No data	UNSAT TT=0.021	UNSAT TT=0.015	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=0.003	UNSAT TT=0.003	UNSAT TT=0.263	UNSAT TT=0.243	UNSAT TT=0.03
/OPT-SMALLINT-LIN/leberre/ opb-trendy/misc2010/datasets/caixa/ normalized-1078.cudf.trendy.opb	OPT f=4 TT=0 T1=0	No data	OPT f=4 TT=0.022 T1=0.02	OPT f=4 TT=0.012 T1=0.01	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.175 T1=0.67	OPT f=4 TT=0.154 T1=0.11	OPT f=4 TT=0.014 T1=0.01
/OPT-SMALLINT-LIN/leberre/ opb-trendy/misc2010/datasets/caixa/ normalized-787.cudf.trendy.opb	OPT f=14 TT=0.001 T1=0	No data	OPT f=14 TT=0.022 T1=0.02	OPT f=14 TT=0.013 T1=0.01	OPT f=14 TT=0.003 T1=0	OPT f=14 TT=0.004 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.215 T1=0.65	OPT f=14 TT=0.204 T1=0.15	OPT f=14 TT=0.028 T1=0.03
/OPT-SMALLINT-LIN/leberre/ opb-trendy/misc2010/datasets/caixa/ normalized-995.cudf.trendy.opb	UNSAT TT=0.004	No data	UNSAT TT=0.021	UNSAT TT=0.015	UNSAT TT=0.01	UNSAT TT=0.01	UNSAT TT=0.005	UNSAT TT=0.004	UNSAT TT=0.304	UNSAT TT=0.275	UNSAT TT=0.034
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1201_2.std.opb	OPT f=109 TT=1.725 T1=1.7	No data	OPT f=109 TT=5.122 T1=5.09	OPT f=109 TT=5.336 T1=5.32	OPT f=109 TT=27.321 T1=27.28	OPT f=109 TT=10.995 T1=10.96	OPT f=109 TT=1.725 T1=1.7	OPT f=109 TT=4.964 T1=5.15	OPT f=109 TT=15.502 T1=10.04	OPT f=109 TT=7.534 T1=5.7	OPT f=109 TT=35.47 T1=35.35
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12013_5.std.opb	SAT f=93 TT=1800.08 T1=334.62	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT (TO) f=111 TT=1800.04 T1=1800.4	SAT (TO) f=96 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=94 TT=1800.11 T1=1800.4	SAT (TO) f=93 TT=1800.29 T1=851.08	SAT (TO) f=93 TT=1800.08 T1=334.62	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12015_5.std.opb	OPT f=87 TT=1.72 T1=1.69	No data	OPT f=87 TT=1.72 T1=1.69	OPT f=87 TT=2.237 T1=2.22	OPT f=87 TT=198.476 T1=198.49	OPT f=87 TT=68.783 T1=68.6	OPT f=87 TT=5.109 T1=5.05	OPT f=87 TT=6.947 T1=6.88	OPT f=87 TT=7.554 T1=3.01	OPT f=87 TT=3.244 T1=1.82	OPT f=87 TT=7.521 T1=7.4
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12016_10.std.opb	SAT f=235 TT=1800.04 T1=312.02	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT (TO) f=291 TT=1800.08 T1=1800.4	SAT (TO) f=300 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=245 TT=1800.1 T1=1800.4	SAT (TO) f=235 TT=1800.04 T1=312.02	No Cert. TT=1800	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12016_2.std.opb	SAT f=256 TT=1800.13 T1=440.64	No data	? (TO) TT=1800.05	? (TO) TT=1800	SAT (TO) f=296 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.5	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=267 TT=1800.11 T1=1800.4	SAT (TO) f=256 TT=1800.13 T1=440.64	No Cert. TT=1800.4	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12017_7.std.opb	SAT f=155 TT=1800.24 T1=870.7	No data	? (TO) TT=1800.06	? (TO) TT=1800.11	SAT (TO) f=278 TT=1800.08 T1=1800.4	SAT (TO) f=199 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.09 T1=1800.4	SAT (TO) f=161 TT=1800.1 T1=1800.4	SAT (TO) f=155 TT=1800.24 T1=870.7	No Cert. TT=1800.83	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12018_6.std.opb	SAT f=142 TT=1800.2 T1=114.61	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=159 TT=1800.08 T1=1800.4	SAT (TO) f=162 TT=1800.05 T1=1800.4	SAT (TO) f=300 TT=1800.13 T1=1800.4	SAT (TO) f=147 TT=1800.09 T1=1800.4	SAT (TO) f=142 TT=1800.2 T1=114.61	No Cert. TT=1800.06	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12019_2.std.opb	SAT f=85 TT=1800.11 T1=16.65	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=89 TT=1800.08 T1=1800.4	SAT (TO) f=89 TT=1800.11 T1=1800.6	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=87 TT=1800.08 T1=1800.4	SAT (TO) f=85 TT=1800.11 T1=16.65	No Cert. TT=1800.38	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12019_5.std.opb	SAT f=108 TT=1800.2 T1=250.58	No data	? (TO) TT=1800.19	? (TO) TT=1800.01	SAT (TO) f=127 TT=1800.06 T1=1800.4	SAT (TO) f=131 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=111 TT=1800.11 T1=1800.4	SAT (TO) f=108 TT=1800.2 T1=250.58	SAT (TO) f=109 TT=1800.05 T1=15.77	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12020_5.std.opb	OPT f=69 TT=1.718 T1=1.68	No data	OPT f=69 TT=1.718 T1=1.68	OPT f=69 TT=3.317 T1=3.3	OPT f=69 TT=138.712 T1=138.67	OPT f=69 TT=115.542 T1=115.31	OPT f=69 TT=9.07 T1=8.98	OPT f=69 TT=31.517 T1=31.44	OPT f=69 TT=17.33 T1=8.79	OPT f=69 TT=17.25 T1=15.25	OPT f=69 TT=7.971 T1=7.85
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12020_7.std.opb	OPT f=81 TT=1.737 T1=1.71	No data	OPT f=81 TT=1.737 T1=1.71	OPT f=81 TT=3.415 T1=3.39	OPT f=81 TT=413.66 T1=413.72	OPT f=81 TT=102.622 T1=102.36	OPT f=81 TT=7.333 T1=7.25	OPT f=81 TT=42.453 T1=42.38	OPT f=81 TT=11.922 T1=4.67	OPT f=81 TT=5.483 T1=3.61	OPT f=81 TT=7.8 T1=7.69
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12020_8.std.opb	OPT f=107 TT=5.757 T1=5.73	No data	OPT f=107 TT=5.757 T1=5.73	OPT f=107 TT=32.271 T1=32.25	SAT (TO) f=112 TT=1800.07 T1=1800.4	OPT f=107 TT=81.86 T1=81.67	OPT f=107 TT=325.697 T1=325.73	OPT f=107 TT=349.995 T1=350.01	OPT f=107 TT=27.022 T1=14.69	OPT f=107 TT=31.221 T1=29.1	OPT f=107 TT=48.429 T1=48.31
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12021_8.std.opb	OPT f=127 TT=1.226 T1=1.2	No data	OPT f=127 TT=1.703 T1=1.67	OPT f=127 TT=2.828 T1=2.81	OPT f=127 TT=13.568 T1=13.53	OPT f=127 TT=8.469 T1=8.43	OPT f=127 TT=1.226 T1=1.2	OPT f=127 TT=1.494 T1=1.47	OPT f=127 TT=7.925 T1=3.06	OPT f=127 TT=3.493 T1=1.86	OPT f=127 TT=13.034 T1=12.91
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12024_7.std.opb	OPT f=112 TT=1.303 T1=1.27	No data	OPT f=112 TT=1.678 T1=1.64	OPT f=112 TT=2.732 T1=2.71	OPT f=112 TT=35.35 T1=35.29	OPT f=112 TT=11.471 T1=11.43	OPT f=112 TT=1.303 T1=1.28	OPT f=112 TT=1.303 T1=1.27	OPT f=112 TT=7.104 T1=2.95	OPT f=112 TT=3.382 T1=1.7	OPT f=112 TT=6.387 T1=6.27
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12025_2.std.opb	OPT f=108 TT=1.355 T1=1.32	No data	OPT f=108 TT=1.675 T1=1.64	OPT f=108 TT=2.235 T1=2.21	OPT f=108 TT=23.964 T1=23.92	OPT f=108 TT=11.326 T1=11.29	OPT f=108 TT=1.355 T1=1.33	OPT f=108 TT=1.355 T1=1.32	OPT f=108 TT=7.352 T1=3.08	OPT f=108 TT=3.076 T1=1.69	OPT f=108 TT=6.44 T1=6.32
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12025_6.std.opb	OPT f=92 TT=1.333 T1=1.3	No data	OPT f=92 TT=1.583 T1=1.55	OPT f=92 TT=3.16 T1=3.14	OPT f=92 TT=33.66 T1=33.59	OPT f=92 TT=11.505 T1=11.46	OPT f=92 TT=1.339 T1=1.31	OPT f=92 TT=1.333 T1=1.3	OPT f=92 TT=7.138 T1=3	OPT f=92 TT=3.103 T1=1.65	OPT f=92 TT=6.739 T1=6.62
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12025_7.std.opb	OPT f=92 TT=1.302 T1=1.27	No data	OPT f=92 TT=1.577 T1=1.55	OPT f=92 TT=3.075 T1=3.05	OPT f=92 TT=14.919 T1=14.89	OPT f=92 TT=11.408 T1=11.37	OPT f=92 TT=1.302 T1=1.27	OPT f=92 TT=1.324 T1=1.3	OPT f=92 TT=7.413 T1=2.94	OPT f=92 TT=3.234 T1=1.76	OPT f=92 TT=6.707 T1=6.59
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12026_4.std.opb	SAT f=175 TT=1800.07 T1=731.53	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=191 TT=1800.04 T1=1800.4	SAT (TO) f=175 TT=1800.07 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=175 TT=1800.1 T1=1800.4	SAT (TO) f=175 TT=1800.12 T1=731.53	No Cert. TT=1800.01	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12026_6.std.opb	SAT f=192 TT=1800.12 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=204 TT=1800.06 T1=1800.4	SAT (TO) f=199 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.12 T1=1800.4	SAT (TO) f=192 TT=1800.12 T1=1800.4	SAT (TO) f=193 TT=1800.01 T1=387.22	No Cert. TT=1800	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1202_7.std.opb	OPT f=90 TT=1.243 T1=1.22	No data	OPT f=90 TT=1.542 T1=1.51	OPT f=90 TT=2.324 T1=2.3	OPT f=90 TT=46.558 T1=46.48	OPT f=90 TT=10.244 T1=10.21	OPT f=90 TT=1.243 T1=1.22	OPT f=90 TT=3.244 T1=3.37	OPT f=90 TT=6.992 T1=2.81	OPT f=90 TT=3.035 T1=1.64	OPT f=90 TT=6.703 T1=6.58
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12030_10.std.opb	OPT f=86 TT=1.64 T1=1.61	No data	OPT f=86 TT=1.64 T1=1.61	OPT f=86 TT=3.341 T1=3.32	OPT f=86 TT=68.982 T1=68.91	OPT f=86 TT=26.715 T1=26.63	OPT f=86 TT=2.364 T1=2.32	OPT f=86 TT=2.359 T1=2.32	OPT f=86 TT=7.474 T1=3.11	OPT f=86 TT=3.104 T1=1.7	OPT f=86 TT=6.989 T1=6.87
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12036_6.std.opb	SAT f=251 TT=1800.03 T1=415.08	No data	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT (TO) f=289 TT=1800.05 T1=1800.4	SAT (TO) f=300 TT=1800.12 T1=1800.5	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=261 TT=1800.09 T1=1800.4	SAT (TO) f=251 TT=1800.03 T1=415.08	No Cert. TT=1800.84	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12036_9.std.opb	SAT f=245 TT=1800.13 T1=341.32	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT (TO) f=281 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=253 TT=1800.04 T1=1800.4	SAT (TO) f=245 TT=1800.13 T1=341.32	No Cert. TT=1800.09	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12037_10.std.opb	SAT f=140 TT=1800.9 T1=552.83	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT (TO) f=211 TT=1800.06 T1=1800.4	SAT (TO) f=195 TT=1800.13 T1=1800.5	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=145 TT=1800.09 T1=1800.4	SAT (TO) f=141 TT=1800.11 T1=286.6	SAT (TO) f=140 TT=1800.9 T1=552.83	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12037_6.std.opb	SAT f=175 TT=1800.03 T1=252.11	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT (TO) f=215 TT=1800.06 T1=1800.4	SAT (TO) f=199 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=182 TT=1800.11 T1=1800.4	SAT (TO) f=175 TT=1800.03 T1=252.11	No Cert. TT=1800	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12038_4.std.opb	SAT f=147 TT=1800.03 T1=329.05	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=155 TT=1800.06 T1=1800.4	SAT (TO) f=198 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=152 TT=1800.1 T1=1800.4	SAT (TO) f=147 TT=1800.03 T1=329.05	No Cert. TT=1800.69	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12039_5.std.opb	OPT f=106 TT=2.506 T1=2.47	No data	OPT f=106 TT=2.506 T1=2.47	OPT f=106 TT=3.7 T1=3.68	OPT f=106 TT=951.225 T1=951.41	OPT f=106 TT=71.263 T1=71.09	OPT f=106 TT=13.685 T1=13.63	OPT f=106 TT=80.687 T1=80.64	OPT f=106 TT=12.35 T1=7.4	OPT f=106 TT=8.781 T1=6.75	OPT f=106 TT=9.163 T1=9
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12040_1.std.opb	SAT f=82 TT=1800.06 T1=24.81	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=84 TT=1800.04 T1=1800.4	SAT (TO) f=87 TT=1800.06 T1=1800.5	SAT (TO) f=299 TT=1800.09 T1=1800.4	SAT (TO) f=83 TT=1800.11 T1=1800.4	SAT (TO) f=82 TT=1800.06 T1=53.9	SAT (TO) f=82 TT=1800.08 T1=24.81	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12040_4.std.opb	OPT f=112 TT=1.807 T1=1.77	No data	OPT f=112 TT=1.807 T1=1.77	OPT f=112 TT=2.113 T1=2.09	OPT f=112 TT=140.657 T1=140.63	OPT f=112 TT=93.564 T1=93.37	OPT f=112 TT=5.956 T1=5.89	OPT f=112 TT=13.696 T1=13.62	OPT f=112 TT=11.281 T1=4.69	OPT f=112 TT=7.412 T1=5.66	OPT f=112 TT=7.267 T1=7.15
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1204_10.std.opb	OPT f=77 TT=1.417 T1=1.39	No data	OPT f=77 TT=1.581 T1=1.55	OPT f=77 TT=1.956 T1=1.94	OPT f=77 TT=49.304 T1=49.23	OPT f=77 TT=11.343 T1=11.3	OPT f=77 TT=1.418 T1=1.39	OPT f=77 TT=1.417 T1=1.39	OPT f=77 TT=7.196 T1=2.98	OPT f=77 TT=2.963 T1=1.63	OPT f=77 TT=6.867 T1=6.74
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12041_1.std.opb	OPT f=127 TT=1.315 T1=1.29	No data	OPT f=127 TT=1.879 T1=1.85	OPT f=127 TT=2.644 T1=2.62	OPT f=127 TT=22.788 T1=22.74	OPT f=127 TT=8.993 T1=8.96	OPT f=127 TT=1.315 T1=1.29	OPT f=127 TT=3.867 T1=3.84	OPT f=127 TT=8.864 T1=3.57	OPT f=127 TT=3.833 T1=2.21	OPT f=127 TT=26.94 T1=26.79
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1204_1.std.opb	OPT f=74 TT=1.401 T1=1.37	No data	OPT f=74 TT=1.547 T1=1.52	OPT f=74 TT=3.19 T1=3.17	OPT f=74 TT=118.846 T1=118.71	OPT f=74 TT=12.826 T1=12.78	OPT f=74 TT=1.401 T1=1.37	OPT f=74 TT=2.48 T1=2.45	OPT f=74 TT=7.393 T1=3	OPT f=74 TT=2.994 T1=1.65	OPT f=74 TT=6.919 T1=6.8
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12044_1.std.opb	OPT f=100 TT=1.284 T1=1.26	No data	OPT f=100 TT=1.8 T1=1.77	OPT f=100 TT=3.212 T1=3.19	OPT f=100 TT=28.986 T1=28.93	OPT f=100 TT=9.652 T1=9.62	OPT f=100 TT=1.284 T1=1.26	OPT f=100 TT=1.43 T1=1.4	OPT f=100 TT=7.193 T1=3.01	OPT f=100 TT=3.093 T1=1.69	OPT f=100 TT=6.761 T1=6.64
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12044_8.std.opb	OPT f=108 TT=1.31 T1=1.28	No data	OPT f=108 TT=1.75 T1=1.72	OPT f=108 TT=3.043 T1=3.02	OPT f=108 TT=35.799 T1=35.74	OPT f=108 TT=10.213 T1=10.18	OPT f=108 TT=1.311 T1=1.28	OPT f=108 TT=1.31 T1=1.28	OPT f=108 TT=7.553 T1=3.05	OPT f=108 TT=3.173 T1=1.73	OPT f=108 TT=8.083 T1=7.96
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12046_3.std.opb	SAT f=181 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=186 TT=1800.04 T1=1800.4	SAT (TO) f=199 TT=1800.09 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=181 TT=1800.1 T1=1800.4	SAT (TO) f=182 TT=1800.02 T1=536.61	No Cert. TT=1800.04	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12047_2.std.opb	SAT f=134 TT=1800.01 T1=139.34	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=137 TT=1800.07 T1=1800.4	SAT (TO) f=199 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=135 TT=1800.11 T1=1800.4	SAT (TO) f=134 TT=1800.01 T1=139.34	No Cert. TT=1800.2	? (TO) TT=1800.02
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12048_10.std.opb	OPT f=111 TT=83.602 T1=7.66	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	OPT f=111 TT=807.439 T1=807.6	OPT f=111 TT=88.775 T1=88.74	OPT f=111 TT=138.518 T1=138.51	OPT f=111 TT=171.586 T1=171.58	OPT f=111 TT=359.35 T1=97.11	OPT f=111 TT=83.602 T1=7.66	OPT f=111 TT=731.282 T1=731.42
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12048_7.std.opb	SAT f=107 TT=1800.06 T1=464.65	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=108 TT=1800.06 T1=1800.4	SAT (TO) f=107 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.12 T1=1800.4	SAT (TO) f=107 TT=1800.12 T1=1800.4	SAT (TO) f=107 TT=1800.12 T1=464.65	No Cert. TT=1800.06	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12049_10.std.opb	OPT f=97 TT=142.185 T1=14.19	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=97 TT=1800.03 T1=1800.4	OPT f=97 TT=142.185 T1=142.14	OPT f=97 TT=472.494 T1=472.57	OPT f=97 TT=392.591 T1=392.66	OPT f=97 TT=744.871 T1=14.19	OPT f=97 TT=1150.83 T1=29.54	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12051_6.std.opb	SAT f=228 TT=1800.76 T1=486.88	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=260 TT=1800.08 T1=1800.4	SAT (TO) f=300 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=229 TT=1800.11 T1=1800.4	SAT (TO) f=228 TT=1800.76 T1=486.88	No Cert. TT=1800.05	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12052_10.std.opb	SAT f=156 TT=1800.01 T1=545.63	No data	? (TO) TT=1800.09	? (TO) TT=1800	SAT (TO) f=169 TT=1800.03 T1=1800.4	SAT (TO) f=188 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=158 TT=1800.08 T1=1800.4	SAT (TO) f=156 TT=1800.01 T1=545.63	No Cert. TT=1800.08	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12052_2.std.opb	SAT f=196 TT=1800.17 T1=483.25	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=212 TT=1800.05 T1=1800.4	SAT (TO) f=199 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.09 T1=1800.4	SAT (TO) f=199 TT=1800.09 T1=1800.4	SAT (TO) f=196 TT=1800.17 T1=483.25	No Cert. TT=1800.04	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12053_3.std.opb	SAT f=117 TT=1800.09 T1=21.27	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=119 TT=1800.1 T1=1800.4	SAT (TO) f=123 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.09 T1=1800.4	SAT (TO) f=117 TT=1800.09 T1=1800.4	SAT (TO) f=117 TT=1800.15 T1=21.27	No Cert. TT=1800.07	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12053_6.std.opb	SAT f=109 TT=1800.02 T1=54.93	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=114 TT=1800.05 T1=1800.4	SAT (TO) f=115 TT=1800.05 T1=1800.4	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=111 TT=1800.11 T1=1800.4	SAT (TO) f=109 TT=1800.33 T1=903.61	SAT (TO) f=109 TT=1800.02 T1=54.93	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12055_4.std.opb	OPT f=90 TT=1.8 T1=1.77	No data	OPT f=90 TT=1.8 T1=1.77	OPT f=90 TT=3.155 T1=3.13	OPT f=90 TT=63.079 T1=63.04	OPT f=90 TT=51.364 T1=51.24	OPT f=90 TT=18.246 T1=18.2	OPT f=90 TT=30.74 T1=30.69	OPT f=90 TT=13.932 T1=11.24	OPT f=90 TT=7.673 T1=5.74	OPT f=90 TT=8.034 T1=7.88
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12057_1.std.opb	SAT f=199 TT=1800.18 T1=357.21	No data	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=220 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=206 TT=1800.11 T1=1800.4	SAT (TO) f=199 TT=1800.18 T1=357.21	No Cert. TT=1800.5	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1205_7.std.opb	OPT f=84 TT=1.351 T1=1.32	No data	OPT f=84 TT=1.539 T1=1.51	OPT f=84 TT=3.15 T1=3.13	OPT f=84 TT=69.495 T1=69.4	OPT f=84 TT=10.764 T1=10.72	OPT f=84 TT=1.371 T1=1.34	OPT f=84 TT=1.351 T1=1.32	OPT f=84 TT=7.292 T1=3.01	OPT f=84 TT=2.973 T1=1.63	OPT f=84 TT=6.796 T1=6.64
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12058_7.std.opb	SAT f=158 TT=1800.12 T1=336.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=169 TT=1800.08 T1=1800.4	SAT (TO) f=187 TT=1800.1 T1=1800.5	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=162 TT=1800.11 T1=1800.4	SAT (TO) f=158 TT=1800.12 T1=336.3	No Cert. TT=1800.03	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12060_5.std.opb	SAT f=107 TT=1800.05 T1=213.01	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=109 TT=1800.13 T1=1800.5	SAT (TO) f=154 TT=1800.03 T1=1800.4	SAT (TO) f=299 TT=1800.1 T1=1800.4	SAT (TO) f=108 TT=1800.1 T1=1800.4	SAT (TO) f=107 TT=1800.05 T1=257.4	SAT (TO) f=107 TT=1800.8 T1=213.01	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j12060_6.std.opb	OPT f=110 TT=2.049 T1=2.02	No data	OPT f=110 TT=2.049 T1=2.02	OPT f=110 TT=2.912 T1=2.89	OPT f=110 TT=370.184 T1=370.19	OPT f=110 TT=114.974 T1=114.81	OPT f=110 TT=25.348 T1=25.29	OPT f=110 TT=49.645 T1=49.59	OPT f=110 TT=19.502 T1=9.62	OPT f=110 TT=5.981 T1=4.16	OPT f=110 TT=8.603 T1=8.48
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1206_4.std.opb	SAT f=155 TT=1800.08 T1=435.33	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=159 TT=1800.05 T1=1800.4	SAT (TO) f=155 TT=1800.08 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=155 TT=1800.11 T1=1800.4	SAT (TO) f=155 TT=1800.13 T1=435.33	No Cert. TT=1800.03	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1207_10.std.opb	SAT f=121 TT=1800.12 T1=415.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=126 TT=1800.07 T1=1800.4	SAT (TO) f=131 TT=1800.07 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=121 TT=1800.12 T1=1800.4	SAT (TO) f=121 TT=1800.12 T1=415.4	No Cert. TT=1800.07	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1207_6.std.opb	SAT f=126 TT=1800.11 T1=176.93	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=132 TT=1800.08 T1=1800.4	SAT (TO) f=129 TT=1800.05 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=126 TT=1800.11 T1=1800.4	SAT (TO) f=126 TT=1800.86 T1=176.93	No Cert. TT=1800.81	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1209_1.std.opb	OPT f=88 TT=1.62 T1=1.59	No data	OPT f=88 TT=1.62 T1=1.59	OPT f=88 TT=2.007 T1=1.98	OPT f=88 TT=225.922 T1=226.01	OPT f=88 TT=23.318 T1=23.25	OPT f=88 TT=2.418 T1=2.38	OPT f=88 TT=9.464 T1=9.43	OPT f=88 TT=9.143 T1=4.05	OPT f=88 TT=3.563 T1=1.92	OPT f=88 TT=7.809 T1=7.69
/OPT-SMALLINT-LIN/ oliveras/j120opt/ normalized-j1209_3.std.opb	OPT f=87 TT=1.629 T1=1.59	No data	OPT f=87 TT=1.629 T1=1.59	OPT f=87 TT=2.971 T1=2.96	OPT f=87 TT=188.194 T1=188.14	OPT f=87 TT=22.379 T1=22.3	OPT f=87 TT=2.629 T1=2.59	OPT f=87 TT=12.174 T1=12.14	OPT f=87 TT=12.041 T1=8.36	OPT f=87 TT=5.013 T1=3.34	OPT f=87 TT=7.842 T1=7.68
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3010_10.std.opb	OPT f=41 TT=0.431 T1=0.42	No data	OPT f=41 TT=0.431 T1=0.42	OPT f=41 TT=0.693 T1=0.68	OPT f=41 TT=17.154 T1=17.09	OPT f=41 TT=8.767 T1=8.74	OPT f=41 TT=0.638 T1=0.62	OPT f=41 TT=0.629 T1=0.61	OPT f=41 TT=4.972 T1=1.84	OPT f=41 TT=2.063 T1=0.89	OPT f=41 TT=6.105 T1=6.03
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3010_3.std.opb	OPT f=62 TT=0.424 T1=0.41	No data	OPT f=62 TT=0.424 T1=0.41	OPT f=62 TT=0.69 T1=0.68	OPT f=62 TT=36.074 T1=35.99	OPT f=62 TT=7.986 T1=7.96	OPT f=62 TT=0.588 T1=0.57	OPT f=62 TT=0.572 T1=0.56	OPT f=62 TT=5.263 T1=1.86	OPT f=62 TT=2.133 T1=0.9	OPT f=62 TT=5.536 T1=5.46
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3010_4.std.opb	OPT f=58 TT=0.428 T1=0.41	No data	OPT f=58 TT=0.428 T1=0.41	OPT f=58 TT=0.609 T1=0.6	OPT f=58 TT=13.973 T1=13.92	OPT f=58 TT=7.848 T1=7.83	OPT f=58 TT=0.563 T1=0.55	OPT f=58 TT=0.56 T1=0.54	OPT f=58 TT=4.752 T1=1.77	OPT f=58 TT=2.025 T1=0.89	OPT f=58 TT=7.529 T1=7.45
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3016_8.std.opb	OPT f=44 TT=0.437 T1=0.42	No data	OPT f=44 TT=0.437 T1=0.42	OPT f=44 TT=0.508 T1=0.5	OPT f=44 TT=41.492 T1=41.39	OPT f=44 TT=13.38 T1=13.34	OPT f=44 TT=1.223 T1=1.2	OPT f=44 TT=1.224 T1=1.2	OPT f=44 TT=4.302 T1=1.86	OPT f=44 TT=1.81 T1=0.86	OPT f=44 TT=3.913 T1=3.84
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j301_8.std.opb	OPT f=53 TT=0.264 T1=0.26	No data	OPT f=53 TT=0.409 T1=0.39	OPT f=53 TT=0.671 T1=0.67	OPT f=53 TT=2.155 T1=2.14	OPT f=53 TT=2.238 T1=2.23	OPT f=53 TT=0.269 T1=0.26	OPT f=53 TT=0.264 T1=0.26	OPT f=53 TT=3.763 T1=1.72	OPT f=53 TT=1.494 T1=0.72	OPT f=53 TT=3.628 T1=3.56
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3020_9.std.opb	OPT f=41 TT=0.297 T1=0.29	No data	OPT f=41 TT=0.428 T1=0.41	OPT f=41 TT=0.555 T1=0.55	OPT f=41 TT=37.132 T1=37.07	OPT f=41 TT=4.301 T1=4.29	OPT f=41 TT=0.301 T1=0.29	OPT f=41 TT=0.297 T1=0.29	OPT f=41 TT=3.342 T1=1.66	OPT f=41 TT=1.516 T1=0.73	OPT f=41 TT=3.86 T1=3.84
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3021_10.std.opb	OPT f=69 TT=0.365 T1=0.39	No data	OPT f=69 TT=0.439 T1=0.42	OPT f=69 TT=0.71 T1=0.7	OPT f=69 TT=2.176 T1=2.16	OPT f=69 TT=4.005 T1=4	OPT f=69 TT=0.365 T1=0.4	OPT f=69 TT=0.404 T1=0.39	OPT f=69 TT=3.944 T1=1.64	OPT f=69 TT=1.784 T1=0.81	OPT f=69 TT=16.194 T1=16.12
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3024_7.std.opb	OPT f=44 TT=0.432 T1=0.42	No data	OPT f=44 TT=0.432 T1=0.42	OPT f=44 TT=0.706 T1=0.7	OPT f=44 TT=10.019 T1=9.98	OPT f=44 TT=8.957 T1=8.93	OPT f=44 TT=0.459 T1=0.45	OPT f=44 TT=0.452 T1=0.44	OPT f=44 TT=3.323 T1=1.65	OPT f=44 TT=1.553 T1=0.79	OPT f=44 TT=3.909 T1=3.83
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3027_1.std.opb	OPT f=43 TT=0.449 T1=0.44	No data	OPT f=43 TT=0.449 T1=0.44	OPT f=43 TT=0.796 T1=0.79	OPT f=43 TT=16.854 T1=16.8	OPT f=43 TT=7.983 T1=7.96	OPT f=43 TT=0.573 T1=0.56	OPT f=43 TT=0.588 T1=0.57	OPT f=43 TT=4.223 T1=1.72	OPT f=43 TT=2.185 T1=0.86	OPT f=43 TT=3.917 T1=3.85
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3028_7.std.opb	OPT f=48 TT=0.445 T1=0.43	No data	OPT f=48 TT=0.445 T1=0.43	OPT f=48 TT=0.701 T1=0.69	OPT f=48 TT=20.559 T1=20.49	OPT f=48 TT=8.732 T1=8.71	OPT f=48 TT=0.775 T1=0.76	OPT f=48 TT=0.777 T1=0.76	OPT f=48 TT=4.416 T1=1.84	OPT f=48 TT=1.795 T1=0.84	OPT f=48 TT=3.799 T1=3.72
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3028_8.std.opb	OPT f=53 TT=0.445 T1=0.43	No data	OPT f=53 TT=0.445 T1=0.43	OPT f=53 TT=0.678 T1=0.67	OPT f=53 TT=11.893 T1=11.83	OPT f=53 TT=7.178 T1=7.15	OPT f=53 TT=0.739 T1=0.73	OPT f=53 TT=0.736 T1=0.72	OPT f=53 TT=3.873 T1=1.74	OPT f=53 TT=1.894 T1=0.82	OPT f=53 TT=3.743 T1=3.68
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3029_1.std.opb	OPT f=85 TT=0.733 T1=0.72	No data	OPT f=85 TT=0.733 T1=0.72	OPT f=85 TT=0.858 T1=0.85	OPT f=85 TT=13.684 T1=13.63	OPT f=85 TT=9.945 T1=9.92	OPT f=85 TT=1.169 T1=1.16	OPT f=85 TT=3.071 T1=3.06	OPT f=85 TT=6.551 T1=2.73	OPT f=85 TT=2.624 T1=1.19	OPT f=85 TT=30.698 T1=30.62
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3030_10.std.opb	OPT f=53 TT=0.489 T1=0.48	No data	OPT f=53 TT=0.489 T1=0.48	OPT f=53 TT=0.707 T1=0.7	OPT f=53 TT=17.177 T1=17.12	OPT f=53 TT=12.35 T1=12.31	OPT f=53 TT=0.842 T1=0.83	OPT f=53 TT=1.578 T1=1.56	OPT f=53 TT=4.773 T1=1.77	OPT f=53 TT=2.263 T1=0.97	OPT f=53 TT=10.045 T1=9.95
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3032_2.std.opb	OPT f=60 TT=0.448 T1=0.43	No data	OPT f=60 TT=0.448 T1=0.43	OPT f=60 TT=0.705 T1=0.7	OPT f=60 TT=27.816 T1=27.73	OPT f=60 TT=10.032 T1=9.99	OPT f=60 TT=0.899 T1=0.88	OPT f=60 TT=0.899 T1=0.88	OPT f=60 TT=3.863 T1=1.76	OPT f=60 TT=1.866 T1=0.83	OPT f=60 TT=3.678 T1=3.65
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3034_9.std.opb	OPT f=60 TT=0.281 T1=0.27	No data	OPT f=60 TT=0.436 T1=0.42	OPT f=60 TT=0.682 T1=0.67	OPT f=60 TT=9.488 T1=9.46	OPT f=60 TT=4.182 T1=4.17	OPT f=60 TT=0.284 T1=0.28	OPT f=60 TT=0.281 T1=0.27	OPT f=60 TT=3.342 T1=1.64	OPT f=60 TT=1.514 T1=0.75	OPT f=60 TT=3.663 T1=3.59
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3037_10.std.opb	OPT f=81 TT=0.389 T1=0.38	No data	OPT f=81 TT=0.46 T1=0.45	OPT f=81 TT=0.487 T1=0.48	OPT f=81 TT=2.924 T1=2.91	OPT f=81 TT=4.032 T1=4.02	OPT f=81 TT=0.389 T1=0.38	OPT f=81 TT=0.437 T1=0.43	OPT f=81 TT=4.214 T1=1.64	OPT f=81 TT=1.764 T1=0.83	OPT f=81 TT=21.947 T1=21.87
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3039_1.std.opb	OPT f=55 TT=0.446 T1=0.43	No data	OPT f=55 TT=0.446 T1=0.43	OPT f=55 TT=0.684 T1=0.68	OPT f=55 TT=3.63 T1=3.61	OPT f=55 TT=5.296 T1=5.28	OPT f=55 TT=0.463 T1=0.45	OPT f=55 TT=0.458 T1=0.45	OPT f=55 TT=3.795 T1=1.65	OPT f=55 TT=1.932 T1=0.84	OPT f=55 TT=3.692 T1=3.61
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3039_5.std.opb	OPT f=55 TT=0.433 T1=0.42	No data	OPT f=55 TT=0.449 T1=0.44	OPT f=55 TT=0.717 T1=0.71	OPT f=55 TT=9.016 T1=8.98	OPT f=55 TT=3.786 T1=3.77	OPT f=55 TT=0.436 T1=0.42	OPT f=55 TT=0.433 T1=0.42	OPT f=55 TT=3.985 T1=1.68	OPT f=55 TT=1.903 T1=0.87	OPT f=55 TT=3.698 T1=3.62
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3040_5.std.opb	OPT f=65 TT=0.444 T1=0.43	No data	OPT f=65 TT=0.444 T1=0.43	OPT f=65 TT=0.658 T1=0.65	OPT f=65 TT=5.835 T1=5.81	OPT f=65 TT=7.776 T1=7.76	OPT f=65 TT=0.463 T1=0.45	OPT f=65 TT=0.459 T1=0.45	OPT f=65 TT=3.424 T1=1.67	OPT f=65 TT=1.535 T1=0.76	OPT f=65 TT=3.516 T1=3.44
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3044_1.std.opb	OPT f=50 TT=0.462 T1=0.45	No data	OPT f=50 TT=0.462 T1=0.45	OPT f=50 TT=0.773 T1=0.77	OPT f=50 TT=6.188 T1=6.15	OPT f=50 TT=10.812 T1=10.79	OPT f=50 TT=0.66 T1=0.65	OPT f=50 TT=0.656 T1=0.64	OPT f=50 TT=4.053 T1=1.75	OPT f=50 TT=1.983 T1=0.85	OPT f=50 TT=3.826 T1=3.75
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3045_1.std.opb	OPT f=82 TT=0.99 T1=0.98	No data	OPT f=82 TT=0.998 T1=0.98	OPT f=82 TT=0.99 T1=0.98	OPT f=82 TT=24.665 T1=24.6	OPT f=82 TT=9.556 T1=9.53	OPT f=82 TT=1.512 T1=1.5	OPT f=82 TT=3.129 T1=3.22	OPT f=82 TT=8.322 T1=6.78	OPT f=82 TT=3.362 T1=1.75	OPT f=82 TT=45.983 T1=45.91
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j304_5.std.opb	OPT f=59 TT=0.262 T1=0.25	No data	OPT f=59 TT=0.401 T1=0.39	OPT f=59 TT=0.656 T1=0.65	OPT f=59 TT=1.872 T1=1.86	OPT f=59 TT=4.068 T1=4.06	OPT f=59 TT=0.266 T1=0.37	OPT f=59 TT=0.262 T1=0.25	OPT f=59 TT=3.753 T1=1.7	OPT f=59 TT=1.544 T1=0.77	OPT f=59 TT=3.5 T1=3.41
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3046_5.std.opb	OPT f=57 TT=0.471 T1=0.46	No data	OPT f=57 TT=0.471 T1=0.46	OPT f=57 TT=0.726 T1=0.72	OPT f=57 TT=14.758 T1=14.69	OPT f=57 TT=10.72 T1=10.68	OPT f=57 TT=0.721 T1=0.71	OPT f=57 TT=0.714 T1=0.7	OPT f=57 TT=4.172 T1=1.76	OPT f=57 TT=2.074 T1=0.84	OPT f=57 TT=3.751 T1=3.68
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j3047_1.std.opb	OPT f=58 TT=0.475 T1=0.46	No data	OPT f=58 TT=0.475 T1=0.46	OPT f=58 TT=0.719 T1=0.71	OPT f=58 TT=23.55 T1=23.46	OPT f=58 TT=9.733 T1=9.7	OPT f=58 TT=0.694 T1=0.68	OPT f=58 TT=0.692 T1=0.68	OPT f=58 TT=3.903 T1=1.75	OPT f=58 TT=1.893 T1=0.84	OPT f=58 TT=3.731 T1=3.65
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j305_3.std.opb	OPT f=76 TT=0.414 T1=0.4	No data	OPT f=76 TT=0.452 T1=0.44	OPT f=76 TT=0.665 T1=0.66	OPT f=76 TT=4.937 T1=4.92	OPT f=76 TT=3.638 T1=3.63	OPT f=76 TT=0.414 T1=0.4	OPT f=76 TT=1.386 T1=1.38	OPT f=76 TT=5.443 T1=1.77	OPT f=76 TT=2.134 T1=0.92	OPT f=76 TT=30.23 T1=30.16
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j307_6.std.opb	OPT f=35 TT=0.432 T1=0.42	No data	OPT f=35 TT=0.432 T1=0.42	OPT f=35 TT=0.765 T1=0.76	OPT f=35 TT=4.124 T1=4.1	OPT f=35 TT=6.926 T1=6.9	OPT f=35 TT=0.495 T1=0.48	OPT f=35 TT=0.474 T1=0.47	OPT f=35 TT=4.413 T1=1.8	OPT f=35 TT=1.643 T1=0.74	OPT f=35 TT=4.014 T1=3.93
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j308_4.std.opb	OPT f=48 TT=0.416 T1=0.4	No data	OPT f=48 TT=0.416 T1=0.4	OPT f=48 TT=0.671 T1=0.66	OPT f=48 TT=11.208 T1=11.17	OPT f=48 TT=7.802 T1=7.78	OPT f=48 TT=0.473 T1=0.46	OPT f=48 TT=0.452 T1=0.45	OPT f=48 TT=3.995 T1=1.8	OPT f=48 TT=1.514 T1=0.74	OPT f=48 TT=3.718 T1=3.64
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j309_3.std.opb	OPT f=68 TT=0.407 T1=0.4	No data	OPT f=68 TT=0.479 T1=0.47	OPT f=68 TT=0.407 T1=0.4	OPT f=68 TT=10.134 T1=10.1	OPT f=68 TT=6.675 T1=6.65	OPT f=68 TT=0.538 T1=0.53	OPT f=68 TT=2.066 T1=2.05	OPT f=68 TT=5.393 T1=1.82	OPT f=68 TT=2.465 T1=1.04	OPT f=68 TT=22.668 T1=22.59
/OPT-SMALLINT-LIN/ oliveras/j30opt/ normalized-j309_7.std.opb	OPT f=63 TT=0.583 T1=0.57	No data	OPT f=63 TT=0.583 T1=0.57	OPT f=63 TT=0.854 T1=0.85	OPT f=63 TT=13.295 T1=13.24	OPT f=63 TT=7.237 T1=7.21	OPT f=63 TT=0.658 T1=0.65	OPT f=63 TT=1.554 T1=1.54	OPT f=63 TT=8.213 T1=5.8	OPT f=63 TT=2.783 T1=1.32	OPT f=63 TT=32.011 T1=31.94
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6012_3.std.opb	OPT f=75 TT=0.848 T1=0.83	No data	OPT f=75 TT=0.848 T1=0.83	OPT f=75 TT=1.391 T1=1.38	OPT f=75 TT=89.765 T1=89.66	OPT f=75 TT=18.719 T1=18.65	OPT f=75 TT=1.985 T1=1.95	OPT f=75 TT=1.987 T1=1.95	OPT f=75 TT=4.394 T1=2.07	OPT f=75 TT=2.174 T1=1.12	OPT f=75 TT=4.736 T1=4.65
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6012_9.std.opb	OPT f=59 TT=0.826 T1=0.81	No data	OPT f=59 TT=0.826 T1=0.81	OPT f=59 TT=1.453 T1=1.44	OPT f=59 TT=17.133 T1=17.09	OPT f=59 TT=22.772 T1=22.7	OPT f=59 TT=2.463 T1=2.42	OPT f=59 TT=2.463 T1=2.42	OPT f=59 TT=4.352 T1=2.1	OPT f=59 TT=2.135 T1=1.11	OPT f=59 TT=4.946 T1=4.85
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6013_4.std.opb	SAT f=107 TT=1800.02 T1=68.45	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT (TO) f=109 TT=1800.1 T1=1800.4	SAT (TO) f=116 TT=1800.07 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=108 TT=1800.11 T1=1800.4	SAT (TO) f=107 TT=1800.08 T1=160.4	SAT (TO) f=107 TT=1800.02 T1=68.45	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6019_2.std.opb	OPT f=83 TT=0.621 T1=0.6	No data	OPT f=83 TT=0.809 T1=0.79	OPT f=83 TT=1.249 T1=1.24	OPT f=83 TT=4.113 T1=4.08	OPT f=83 TT=6.371 T1=6.35	OPT f=83 TT=0.621 T1=0.6	OPT f=83 TT=0.623 T1=0.61	OPT f=83 TT=4.652 T1=1.98	OPT f=83 TT=2.174 T1=1.1	OPT f=83 TT=4.473 T1=4.37
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6020_6.std.opb	OPT f=97 TT=0.709 T1=0.69	No data	OPT f=97 TT=0.859 T1=0.84	OPT f=97 TT=1.323 T1=1.31	OPT f=97 TT=7.605 T1=7.58	OPT f=97 TT=8.084 T1=8.06	OPT f=97 TT=0.712 T1=0.69	OPT f=97 TT=0.709 T1=0.69	OPT f=97 TT=4.072 T1=1.98	OPT f=97 TT=2.084 T1=1.07	OPT f=97 TT=4.259 T1=4.17
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6021_5.std.opb	OPT f=89 TT=1.93 T1=1.91	No data	OPT f=89 TT=3.041 T1=3.02	OPT f=89 TT=3.069 T1=3.05	OPT f=89 TT=22.973 T1=22.91	OPT f=89 TT=11.565 T1=11.53	OPT f=89 TT=1.93 T1=1.91	OPT f=89 TT=6.163 T1=6.15	OPT f=89 TT=11.232 T1=7.02	OPT f=89 TT=5.412 T1=3.6	OPT f=89 TT=28.879 T1=28.79
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j602_4.std.opb	OPT f=78 TT=0.603 T1=0.59	No data	OPT f=78 TT=0.78 T1=0.76	OPT f=78 TT=1.377 T1=1.37	OPT f=78 TT=7.525 T1=7.49	OPT f=78 TT=6.187 T1=6.17	OPT f=78 TT=0.606 T1=0.59	OPT f=78 TT=0.603 T1=0.59	OPT f=78 TT=3.964 T1=1.94	OPT f=78 TT=1.925 T1=1.02	OPT f=78 TT=4.495 T1=4.4
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6026_2.std.opb	OPT f=66 TT=0.868 T1=0.85	No data	OPT f=66 TT=0.868 T1=0.85	OPT f=66 TT=1.341 T1=1.33	OPT f=66 TT=58.494 T1=58.44	OPT f=66 TT=16.812 T1=16.75	OPT f=66 TT=1.277 T1=1.25	OPT f=66 TT=1.304 T1=1.28	OPT f=66 TT=4.833 T1=2.13	OPT f=66 TT=2.365 T1=1.15	OPT f=66 TT=4.911 T1=4.81
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6027_6.std.opb	OPT f=64 TT=0.869 T1=0.85	No data	OPT f=64 TT=0.869 T1=0.85	OPT f=64 TT=1.496 T1=1.48	OPT f=64 TT=102.019 T1=101.9	OPT f=64 TT=19.182 T1=19.13	OPT f=64 TT=1.726 T1=1.69	OPT f=64 TT=1.725 T1=1.7	OPT f=64 TT=4.502 T1=2.09	OPT f=64 TT=2.323 T1=1.13	OPT f=64 TT=4.915 T1=4.89
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6029_8.std.opb	SAT f=105 TT=1801.07 T1=107.64	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=106 TT=1800.07 T1=1800.4	SAT (TO) f=106 TT=1800.05 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=106 TT=1800.1 T1=1800.4	SAT (TO) f=105 TT=1801.07 T1=107.64	No Cert. TT=1800.05	? (TO) TT=1800.02
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6030_8.std.opb	OPT f=63 TT=0.897 T1=0.88	No data	OPT f=63 TT=0.897 T1=0.88	OPT f=63 TT=1.492 T1=1.48	OPT f=63 TT=139.449 T1=139.32	OPT f=63 TT=27.277 T1=27.19	OPT f=63 TT=2.37 T1=2.33	OPT f=63 TT=4.529 T1=4.5	OPT f=63 TT=5.333 T1=2.15	OPT f=63 TT=2.514 T1=1.23	OPT f=63 TT=5.089 T1=4.99
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6031_6.std.opb	OPT f=72 TT=0.872 T1=0.85	No data	OPT f=72 TT=0.872 T1=0.85	OPT f=72 TT=1.388 T1=1.37	OPT f=72 TT=125.407 T1=125.28	OPT f=72 TT=33.828 T1=33.73	OPT f=72 TT=2.578 T1=2.54	OPT f=72 TT=2.575 T1=2.54	OPT f=72 TT=4.464 T1=2.12	OPT f=72 TT=2.324 T1=1.16	OPT f=72 TT=4.902 T1=4.81
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6035_5.std.opb	OPT f=76 TT=0.658 T1=0.64	No data	OPT f=76 TT=0.839 T1=0.82	OPT f=76 TT=0.883 T1=0.87	OPT f=76 TT=11.437 T1=11.4	OPT f=76 TT=7.548 T1=7.53	OPT f=76 TT=0.666 T1=0.65	OPT f=76 TT=0.658 T1=0.64	OPT f=76 TT=4.604 T1=1.93	OPT f=76 TT=2.134 T1=1.08	OPT f=76 TT=4.64 T1=4.53
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j603_6.std.opb	OPT f=57 TT=0.641 T1=0.62	No data	OPT f=57 TT=0.789 T1=0.77	OPT f=57 TT=1.519 T1=1.51	OPT f=57 TT=6.886 T1=6.85	OPT f=57 TT=8.694 T1=8.67	OPT f=57 TT=0.643 T1=0.63	OPT f=57 TT=0.641 T1=0.62	OPT f=57 TT=3.873 T1=1.9	OPT f=57 TT=1.913 T1=1.06	OPT f=57 TT=4.809 T1=4.72
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6039_5.std.opb	OPT f=73 TT=0.875 T1=0.85	No data	OPT f=73 TT=0.875 T1=0.85	OPT f=73 TT=1.383 T1=1.37	OPT f=73 TT=24.016 T1=23.94	OPT f=73 TT=10.432 T1=10.4	OPT f=73 TT=1.025 T1=1	OPT f=73 TT=1.069 T1=1.05	OPT f=73 TT=4.562 T1=2.04	OPT f=73 TT=2.154 T1=1.11	OPT f=73 TT=4.757 T1=4.67
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j603_9.std.opb	OPT f=67 TT=0.636 T1=0.62	No data	OPT f=67 TT=0.788 T1=0.77	OPT f=67 TT=1.514 T1=1.5	OPT f=67 TT=16.23 T1=16.18	OPT f=67 TT=5.365 T1=5.34	OPT f=67 TT=0.641 T1=0.63	OPT f=67 TT=0.636 T1=0.62	OPT f=67 TT=4.092 T1=1.95	OPT f=67 TT=1.996 T1=1.05	OPT f=67 TT=4.668 T1=4.57
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6043_1.std.opb	OPT f=108 TT=0.832 T1=0.82	No data	OPT f=108 TT=0.922 T1=0.9	OPT f=108 TT=0.832 T1=0.82	OPT f=108 TT=33.554 T1=33.5	OPT f=108 TT=14.632 T1=14.59	OPT f=108 TT=1.399 T1=1.38	OPT f=108 TT=1.403 T1=1.38	OPT f=108 TT=4.842 T1=2.1	OPT f=108 TT=2.443 T1=1.19	OPT f=108 TT=4.344 T1=4.26
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6044_1.std.opb	OPT f=84 TT=0.883 T1=0.86	No data	OPT f=84 TT=0.883 T1=0.86	OPT f=84 TT=1.521 T1=1.51	OPT f=84 TT=41.392 T1=41.33	OPT f=84 TT=20.305 T1=20.24	OPT f=84 TT=1.697 T1=1.67	OPT f=84 TT=1.692 T1=1.66	OPT f=84 TT=4.523 T1=2.1	OPT f=84 TT=2.374 T1=1.17	OPT f=84 TT=4.646 T1=4.55
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j6046_1.std.opb	OPT f=79 TT=0.926 T1=0.91	No data	OPT f=79 TT=0.926 T1=0.91	OPT f=79 TT=1.364 T1=1.35	OPT f=79 TT=71.958 T1=71.86	OPT f=79 TT=22.64 T1=22.57	OPT f=79 TT=1.827 T1=1.8	OPT f=79 TT=1.807 T1=1.88	OPT f=79 TT=5.473 T1=2.17	OPT f=79 TT=2.624 T1=1.27	OPT f=79 TT=6.785 T1=6.69
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j605_7.std.opb	OPT f=75 TT=17.386 T1=6.06	No data	OPT f=75 TT=103.633 T1=103.63	OPT f=75 TT=147.01 T1=147.02	OPT f=75 TT=89.64 T1=89.67	OPT f=75 TT=17.386 T1=17.35	OPT f=75 TT=23.569 T1=23.56	OPT f=75 TT=18.333 T1=18.32	OPT f=75 TT=40.329 T1=17.07	OPT f=75 TT=23.709 T1=6.06	OPT f=75 TT=160.265 T1=160.2
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j606_1.std.opb	OPT f=60 TT=0.813 T1=0.79	No data	OPT f=60 TT=0.813 T1=0.79	OPT f=60 TT=0.825 T1=0.81	OPT f=60 TT=94.953 T1=94.81	OPT f=60 TT=10.001 T1=9.96	OPT f=60 TT=0.94 T1=0.92	OPT f=60 TT=0.941 T1=0.92	OPT f=60 TT=4.533 T1=2	OPT f=60 TT=2.293 T1=1.14	OPT f=60 TT=4.87 T1=4.78
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j607_3.std.opb	OPT f=62 TT=0.805 T1=0.78	No data	OPT f=62 TT=0.805 T1=0.78	OPT f=62 TT=1.498 T1=1.49	OPT f=62 TT=48.44 T1=48.31	OPT f=62 TT=12.953 T1=12.91	OPT f=62 TT=1.101 T1=1.08	OPT f=62 TT=1.099 T1=1.08	OPT f=62 TT=4.362 T1=2.05	OPT f=62 TT=2.213 T1=1.1	OPT f=62 TT=4.817 T1=4.73
/OPT-SMALLINT-LIN/ oliveras/j60opt/ normalized-j609_6.std.opb	SAT f=112 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=114 TT=1800.08 T1=1800.4	SAT (TO) f=113 TT=1800.05 T1=1800.4	SAT (TO) f=296 TT=1800.09 T1=1800.4	SAT (TO) f=112 TT=1800.11 T1=1800.4	SAT (TO) f=113 TT=1800.06 T1=266.93	No Cert. TT=1800.01	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9010_6.std.opb	OPT f=92 TT=1.283 T1=1.25	No data	OPT f=92 TT=1.283 T1=1.25	OPT f=92 TT=1.782 T1=1.76	OPT f=92 TT=54.525 T1=54.46	OPT f=92 TT=31.468 T1=31.38	OPT f=92 TT=2.761 T1=2.72	OPT f=92 TT=3.324 T1=3.29	OPT f=92 TT=4.992 T1=2.35	OPT f=92 TT=2.675 T1=1.42	OPT f=92 TT=5.823 T1=5.72
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j901_1.std.opb	OPT f=73 TT=0.924 T1=0.9	No data	OPT f=73 TT=1.227 T1=1.2	OPT f=73 TT=2.344 T1=2.33	OPT f=73 TT=9.797 T1=9.85	OPT f=73 TT=9.226 T1=9.2	OPT f=73 TT=0.924 T1=0.9	OPT f=73 TT=1.176 T1=1.15	OPT f=73 TT=5.462 T1=2.25	OPT f=73 TT=2.765 T1=1.39	OPT f=73 TT=7.652 T1=7.54
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9013_1.std.opb	SAT f=146 TT=1800.69 T1=169.85	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT (TO) f=156 TT=1800.06 T1=1800.4	SAT (TO) f=199 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.09 T1=1800.4	SAT (TO) f=150 TT=1800.11 T1=1800.4	SAT (TO) f=146 TT=1800.78 T1=169.85	SAT (TO) f=146 TT=1800.69 T1=360.37	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9013_9.std.opb	SAT f=131 TT=1800.05 T1=251.61	No data	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT (TO) f=140 TT=1800.07 T1=1800.4	SAT (TO) f=199 TT=1800.03 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=134 TT=1800.11 T1=1800.4	SAT (TO) f=131 TT=1800.05 T1=251.61	No Cert. TT=1800.03	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9014_2.std.opb	OPT f=79 TT=1.272 T1=1.25	No data	OPT f=79 TT=1.272 T1=1.25	OPT f=79 TT=1.945 T1=1.93	OPT f=79 TT=296.195 T1=296.12	OPT f=79 TT=54.854 T1=54.71	OPT f=79 TT=4.265 T1=4.21	OPT f=79 TT=20.413 T1=20.37	OPT f=79 TT=9.532 T1=8.43	OPT f=79 TT=5.353 T1=3.7	OPT f=79 TT=7.428 T1=7.32
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9016_1.std.opb	OPT f=85 TT=1.246 T1=1.22	No data	OPT f=85 TT=1.246 T1=1.22	OPT f=85 TT=2.199 T1=2.18	OPT f=85 TT=69.896 T1=69.85	OPT f=85 TT=95.072 T1=94.84	OPT f=85 TT=7.293 T1=7.19	OPT f=85 TT=7.315 T1=7.22	OPT f=85 TT=5.293 T1=2.47	OPT f=85 TT=2.764 T1=1.47	OPT f=85 TT=5.943 T1=5.84
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9017_9.std.opb	OPT f=96 TT=0.932 T1=0.91	No data	OPT f=96 TT=1.313 T1=1.29	OPT f=96 TT=1.994 T1=1.98	OPT f=96 TT=4.729 T1=4.7	OPT f=96 TT=7.858 T1=7.83	OPT f=96 TT=0.943 T1=0.92	OPT f=96 TT=0.932 T1=0.91	OPT f=96 TT=5.642 T1=2.18	OPT f=96 TT=2.744 T1=1.44	OPT f=96 TT=17.356 T1=17.25
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9019_6.std.opb	OPT f=136 TT=0.966 T1=0.94	No data	OPT f=136 TT=1.234 T1=1.21	OPT f=136 TT=1.746 T1=1.73	OPT f=136 TT=15.712 T1=15.68	OPT f=136 TT=8.388 T1=8.36	OPT f=136 TT=0.966 T1=0.94	OPT f=136 TT=0.969 T1=0.95	OPT f=136 TT=5.012 T1=2.27	OPT f=136 TT=2.713 T1=1.37	OPT f=136 TT=4.704 T1=4.6
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9020_8.std.opb	OPT f=85 TT=1.134 T1=1.11	No data	OPT f=85 TT=1.196 T1=1.17	OPT f=85 TT=2.167 T1=2.15	OPT f=85 TT=29.746 T1=29.68	OPT f=85 TT=9.983 T1=9.95	OPT f=85 TT=1.134 T1=1.11	OPT f=85 TT=1.141 T1=1.12	OPT f=85 TT=4.932 T1=2.33	OPT f=85 TT=2.643 T1=1.4	OPT f=85 TT=5.526 T1=5.42
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j902_10.std.opb	OPT f=80 TT=0.94 T1=0.92	No data	OPT f=80 TT=1.16 T1=1.13	OPT f=80 TT=2.276 T1=2.26	OPT f=80 TT=69.588 T1=69.53	OPT f=80 TT=11.215 T1=11.18	OPT f=80 TT=0.94 T1=0.92	OPT f=80 TT=0.941 T1=0.92	OPT f=80 TT=4.754 T1=2.18	OPT f=80 TT=2.573 T1=1.36	OPT f=80 TT=5.603 T1=5.5
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9021_5.std.opb	OPT f=112 TT=249.992 T1=47.11	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=112 TT=1800.06 T1=1800.4	OPT f=112 TT=286.268 T1=286.26	OPT f=112 TT=410.067 T1=410.13	OPT f=112 TT=249.992 T1=250.03	OPT f=112 TT=1101.76 T1=118.38	OPT f=112 TT=875.901 T1=47.11	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9022_8.std.opb	OPT f=97 TT=1.325 T1=1.3	No data	OPT f=97 TT=1.325 T1=1.3	OPT f=97 TT=2.176 T1=2.16	OPT f=97 TT=40.379 T1=40.34	OPT f=97 TT=18.762 T1=18.7	OPT f=97 TT=1.861 T1=1.83	OPT f=97 TT=1.857 T1=1.82	OPT f=97 TT=4.953 T1=2.29	OPT f=97 TT=2.695 T1=1.42	OPT f=97 TT=5.778 T1=5.67
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9023_3.std.opb	OPT f=116 TT=1.296 T1=1.27	No data	OPT f=116 TT=1.296 T1=1.27	OPT f=116 TT=1.484 T1=1.47	OPT f=116 TT=29.184 T1=29.14	OPT f=116 TT=16.252 T1=16.19	OPT f=116 TT=1.736 T1=1.7	OPT f=116 TT=1.742 T1=1.71	OPT f=116 TT=4.843 T1=2.3	OPT f=116 TT=2.816 T1=1.7	OPT f=116 TT=5.403 T1=5.29
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j902_3.std.opb	OPT f=75 TT=0.983 T1=0.96	No data	OPT f=75 TT=1.169 T1=1.14	OPT f=75 TT=2.293 T1=2.28	OPT f=75 TT=16.796 T1=16.74	OPT f=75 TT=9.831 T1=9.8	OPT f=75 TT=0.983 T1=0.96	OPT f=75 TT=0.985 T1=0.97	OPT f=75 TT=4.803 T1=2.19	OPT f=75 TT=2.643 T1=1.36	OPT f=75 TT=5.748 T1=5.62
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9024_9.std.opb	OPT f=80 TT=1.224 T1=1.2	No data	OPT f=80 TT=1.224 T1=1.2	OPT f=80 TT=2.208 T1=2.19	OPT f=80 TT=102.555 T1=102.44	OPT f=80 TT=19.877 T1=19.81	OPT f=80 TT=2.271 T1=2.23	OPT f=80 TT=2.272 T1=2.23	OPT f=80 TT=4.832 T1=2.32	OPT f=80 TT=2.693 T1=1.43	OPT f=80 TT=5.953 T1=5.85
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9025_10.std.opb	SAT f=134 TT=1800.02 T1=536.76	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=137 TT=1800.08 T1=1800.4	SAT (TO) f=199 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=136 TT=1800.11 T1=1800.4	SAT (TO) f=134 TT=1800.02 T1=536.76	No Cert. TT=1800	? (TO) TT=1800.02
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9025_7.std.opb	SAT f=139 TT=1800.15 T1=470.53	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT (TO) f=145 TT=1800.05 T1=1800.4	SAT (TO) f=199 TT=1800.05 T1=1800.4	SAT (TO) f=300 TT=1800.11 T1=1800.4	SAT (TO) f=141 TT=1800.11 T1=1800.4	SAT (TO) f=139 TT=1800.15 T1=470.53	No Cert. TT=1800.04	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9027_5.std.opb	OPT f=99 TT=1.341 T1=1.31	No data	OPT f=99 TT=1.341 T1=1.31	OPT f=99 TT=2.131 T1=2.11	OPT f=99 TT=37.562 T1=37.53	OPT f=99 TT=36.699 T1=36.59	OPT f=99 TT=3.1 T1=3.06	OPT f=99 TT=3.53 T1=3.49	OPT f=99 TT=4.913 T1=2.37	OPT f=99 TT=2.684 T1=1.43	OPT f=99 TT=5.727 T1=5.62
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9027_6.std.opb	OPT f=87 TT=1.268 T1=1.24	No data	OPT f=87 TT=1.268 T1=1.24	OPT f=87 TT=1.79 T1=1.77	OPT f=87 TT=16.499 T1=16.46	OPT f=87 TT=38.149 T1=38.04	OPT f=87 TT=2.956 T1=2.91	OPT f=87 TT=2.953 T1=2.91	OPT f=87 TT=5.452 T1=2.4	OPT f=87 TT=2.844 T1=1.49	OPT f=87 TT=5.929 T1=5.82
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9031_6.std.opb	OPT f=80 TT=1.311 T1=1.28	No data	OPT f=80 TT=1.311 T1=1.28	OPT f=80 TT=2.083 T1=2.07	OPT f=80 TT=150.68 T1=150.6	OPT f=80 TT=63.169 T1=63.01	OPT f=80 TT=4.331 T1=4.28	OPT f=80 TT=5.522 T1=5.47	OPT f=80 TT=5.983 T1=2.42	OPT f=80 TT=3.024 T1=1.6	OPT f=80 TT=6.491 T1=6.35
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9033_3.std.opb	OPT f=108 TT=0.893 T1=0.87	No data	OPT f=108 TT=1.607 T1=1.58	OPT f=108 TT=1.841 T1=1.83	OPT f=108 TT=8.196 T1=8.17	OPT f=108 TT=6.637 T1=6.61	OPT f=108 TT=0.896 T1=0.88	OPT f=108 TT=0.893 T1=0.87	OPT f=108 TT=5.434 T1=2.24	OPT f=108 TT=2.736 T1=1.44	OPT f=108 TT=5.311 T1=5.29
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9036_4.std.opb	OPT f=79 TT=1.143 T1=1.12	No data	OPT f=79 TT=1.251 T1=1.23	OPT f=79 TT=2.52 T1=2.5	OPT f=79 TT=7.696 T1=7.65	OPT f=79 TT=8.466 T1=8.43	OPT f=79 TT=1.154 T1=1.13	OPT f=79 TT=1.143 T1=1.12	OPT f=79 TT=4.863 T1=2.32	OPT f=79 TT=2.685 T1=1.44	OPT f=79 TT=5.987 T1=5.88
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9038_2.std.opb	OPT f=78 TT=1.284 T1=1.26	No data	OPT f=78 TT=1.284 T1=1.26	OPT f=78 TT=2.178 T1=2.16	OPT f=78 TT=29.861 T1=29.79	OPT f=78 TT=16.72 T1=16.66	OPT f=78 TT=1.532 T1=1.5	OPT f=78 TT=3.724 T1=3.7	OPT f=78 TT=5.304 T1=2.4	OPT f=78 TT=2.764 T1=1.44	OPT f=78 TT=6.028 T1=5.92
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9038_7.std.opb	OPT f=85 TT=1.242 T1=1.22	No data	OPT f=85 TT=1.278 T1=1.25	OPT f=85 TT=1.242 T1=1.22	OPT f=85 TT=80.901 T1=80.86	OPT f=85 TT=16.378 T1=16.32	OPT f=85 TT=1.559 T1=1.53	OPT f=85 TT=1.591 T1=1.56	OPT f=85 TT=5.313 T1=2.39	OPT f=85 TT=2.795 T1=1.51	OPT f=85 TT=6.004 T1=5.9
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9039_4.std.opb	OPT f=81 TT=1.281 T1=1.26	No data	OPT f=81 TT=1.281 T1=1.26	OPT f=81 TT=1.966 T1=1.95	OPT f=81 TT=66.623 T1=66.62	OPT f=81 TT=18.665 T1=18.6	OPT f=81 TT=1.798 T1=1.76	OPT f=81 TT=1.803 T1=1.77	OPT f=81 TT=5.112 T1=2.37	OPT f=81 TT=2.734 T1=1.6	OPT f=81 TT=5.993 T1=5.88
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9041_1.std.opb	SAT f=150 TT=1800.09 T1=193.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT (TO) f=155 TT=1800.05 T1=1800.4	SAT (TO) f=191 TT=1800.06 T1=1800.4	SAT (TO) f=300 TT=1800.12 T1=1800.4	SAT (TO) f=151 TT=1800.1 T1=1800.4	SAT (TO) f=150 TT=1800.09 T1=193.3	No Cert. TT=1800.01	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9043_10.std.opb	OPT f=92 TT=1.308 T1=1.28	No data	OPT f=92 TT=1.308 T1=1.28	OPT f=92 TT=1.601 T1=1.58	OPT f=92 TT=57.368 T1=57.31	OPT f=92 TT=33.168 T1=33.07	OPT f=92 TT=2.757 T1=2.71	OPT f=92 TT=2.775 T1=2.73	OPT f=92 TT=5.713 T1=2.4	OPT f=92 TT=2.843 T1=1.53	OPT f=92 TT=5.945 T1=5.84
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9043_5.std.opb	OPT f=98 TT=1.375 T1=1.35	No data	OPT f=98 TT=1.375 T1=1.35	OPT f=98 TT=2.204 T1=2.19	OPT f=98 TT=37.984 T1=37.98	OPT f=98 TT=35.872 T1=35.77	OPT f=98 TT=2.779 T1=2.74	OPT f=98 TT=2.786 T1=2.75	OPT f=98 TT=5.254 T1=2.41	OPT f=98 TT=2.715 T1=1.66	OPT f=98 TT=5.863 T1=5.75
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9044_5.std.opb	OPT f=84 TT=1.304 T1=1.28	No data	OPT f=84 TT=1.304 T1=1.28	OPT f=84 TT=2.332 T1=2.31	OPT f=84 TT=67.172 T1=67.1	OPT f=84 TT=46.776 T1=46.65	OPT f=84 TT=3.743 T1=3.69	OPT f=84 TT=3.746 T1=3.7	OPT f=84 TT=5.213 T1=2.39	OPT f=84 TT=2.723 T1=1.5	OPT f=84 TT=6.051 T1=5.94
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j9045_2.std.opb	SAT f=155 TT=1800.49 T1=882.42	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT (TO) f=164 TT=1800.05 T1=1800.4	SAT (TO) f=199 TT=1800.12 T1=1800.5	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=159 TT=1800.09 T1=1800.4	SAT (TO) f=155 TT=1800.49 T1=882.42	No Cert. TT=1800.03	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j907_10.std.opb	OPT f=98 TT=1.25 T1=1.22	No data	OPT f=98 TT=1.25 T1=1.22	OPT f=98 TT=2.099 T1=2.08	OPT f=98 TT=43.383 T1=43.33	OPT f=98 TT=19.276 T1=19.21	OPT f=98 TT=1.964 T1=1.93	OPT f=98 TT=1.97 T1=1.93	OPT f=98 TT=4.782 T1=2.27	OPT f=98 TT=2.694 T1=1.45	OPT f=98 TT=5.572 T1=5.46
/OPT-SMALLINT-LIN/ oliveras/j90opt/ normalized-j909_4.std.opb	SAT f=132 TT=1800.75 T1=184.77	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=140 TT=1800.14 T1=1800.5	SAT (TO) f=196 TT=1800.04 T1=1800.4	SAT (TO) f=300 TT=1800.1 T1=1800.4	SAT (TO) f=135 TT=1800.11 T1=1800.4	SAT (TO) f=133 TT=1800.86 T1=135.75	SAT (TO) f=132 TT=1800.75 T1=184.77	? (TO) TT=1800.06
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE2.0_TMAX180_K67_cod2.opb	SAT f=-148830 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=-57444 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.03 T1=1800.4	SAT (TO) f=-148830 TT=1800.11 T1=1800.4	? TT=129.36	SAT (TO) f=-124354 TT=1800.35 T1=663.04	SAT (TO) f=-114628 TT=1800.02 T1=159.77	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_10null10mast_rapportOE1.0_TMAX120_K67_cod2.opb	SAT f=-177720 TT=1800.02 T1=447.49	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=-110143 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.05 T1=1800.4	SAT (TO) f=0 TT=1800.11 T1=1800.4	? TT=161	SAT (TO) f=-177720 TT=1800.02 T1=447.49	SAT (TO) f=-87568 TT=1800 T1=95.63	? (TO) TT=1800.06
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_20null0mast_rapportOE1.0_TMAX180_K67_cod2.opb	SAT f=-166774 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=-91554 TT=1800.1 T1=1800.4	SAT (TO) f=-101962 TT=1800.09 T1=1800.5	SAT (TO) f=-166774 TT=1800.02 T1=1800.3	? TT=1052.19	SAT (TO) f=-95896 TT=1800.47 T1=869.41	SAT (TO) f=-101764 TT=1800.06 T1=140.38	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_20null10mast_rapportOE2.0_TMAX15_K67_cod2.opb	OPT f=-22879 TT=95.133 T1=95.13	No data	OPT f=-22879 TT=355.844 T1=355.88	OPT f=-22879 TT=95.133 T1=95.13	SAT (TO) f=-22879 TT=1800.07 T1=1800.4	SAT (TO) f=-22879 TT=1800.11 T1=1800.4	OPT f=-22879 TT=239.162 T1=239.18	? TT=156.557	SAT (TO) f=-13530 TT=1800.53 T1=654.19	No Cert. TT=1800.43	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null0mast_rapportOE1.0_TMAX120_K67_cod2.opb	SAT f=-115005 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=-73428 TT=1800.09 T1=1800.4	SAT (TO) f=-84607 TT=1800.05 T1=1800.4	SAT (TO) f=-115005 TT=1800.11 T1=1800.4	SAT (TO) f=-73477 TT=1800.09 T1=1800.4	SAT (TO) f=-65299 TT=1800.56 T1=782.22	? (TO) TT=1800.03	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_fibo_50null50mast_rapportOE2.0_TMAX15_K67_cod2.opb	OPT f=0 TT=0.724 T1=0.71	No data	OPT f=0 TT=11.015 T1=10.98	OPT f=0 TT=10.971 T1=10.96	OPT f=0 TT=283.351 T1=283.41	OPT f=0 TT=4.507 T1=4.48	OPT f=0 TT=1.825 T1=1.81	OPT f=0 TT=0.724 T1=0.71	OPT f=0 TT=8.274 T1=2.17	OPT f=0 TT=26.469 T1=23.58	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_0null0mast_rapportOE1.0_TMAX15_K67_cod1.opb	OPT f=-192 TT=1067.16 T1=3.45	No data	? (TO) TT=1800.06	OPT f=-192 TT=1599.23 T1=1599.46	SAT (TO) f=-24 TT=1800.12 T1=1800.4	SAT (TO) f=0 TT=1800.14 T1=1800.3	OPT f=-192 TT=1067.16 T1=1067.33	? TT=75.55	SAT (TO) f=-192 TT=1800.05 T1=3.45	No Cert. TT=1800.66	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_0null0mast_rapportOE2.0_TMAX120_K67_cod1.opb	SAT f=-544 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=-295 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.2 T1=1800.5	SAT (TO) f=-544 TT=1800.1 T1=1800.4	? TT=73.483	SAT (TO) f=-270 TT=1800.16 T1=6.18	SAT (TO) f=-264 TT=1800.06 T1=2.17	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_0null10mast_rapportOE1.0_TMAX120_K67_cod3.opb	SAT f=-2157 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT (TO) f=-2157 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.27 T1=1800.4	SAT (TO) f=0 TT=1800.1 T1=1800.4	? TT=78.095	SAT (TO) f=-526 TT=1800.01 T1=1.97	SAT (TO) f=-1117 TT=1800.79 T1=47.39	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_0null20mast_rapportOE2.0_TMAX120_K67_cod2.opb	SAT f=-2832 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT (TO) f=-809 TT=1800.13 T1=1800.5	SAT (TO) f=0 TT=1800.06 T1=1800.4	SAT (TO) f=0 TT=1800.12 T1=1800.4	SAT (TO) f=-2832 TT=1800.09 T1=1800.4	SAT (TO) f=-2560 TT=1800.89 T1=630.08	SAT (TO) f=-1024 TT=1800.65 T1=60.33	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_0null20mast_rapportOE2.0_TMAX300_K67_cod2.opb	SAT f=-6935 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=-3177 TT=1800.12 T1=1800.4	SAT (TO) f=0 TT=1800.07 T1=1800.4	SAT (TO) f=-541 TT=1800.09 T1=1800.4	SAT (TO) f=-6935 TT=1800.1 T1=1800.4	SAT (TO) f=-5432 TT=1800.41 T1=585.79	SAT (TO) f=-5232 TT=1800.09 T1=51.82	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null0mast_rapportOE1.0_TMAX120_K67_cod1.opb	SAT f=-512 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=-324 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.27 T1=1800.3	SAT (TO) f=-512 TT=1800.06 T1=1800.4	? TT=76.678	SAT (TO) f=-456 TT=1800.13 T1=712.59	No Cert. TT=1800.71	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null0mast_rapportOE1.0_TMAX60_K67_cod1.opb	SAT f=-256 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT (TO) f=-98 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.09 T1=1800.4	SAT (TO) f=-256 TT=1800.11 T1=1800.4	? TT=74.802	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null0mast_rapportOE2.0_TMAX60_K67_cod1.opb	SAT f=-256 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=-45 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.1 T1=1800.3	SAT (TO) f=-256 TT=1800.1 T1=1800.4	? TT=75.923	SAT (TO) f=-201 TT=1800.83 T1=3.65	? (TO) TT=1800.06	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null10mast_rapportOE2.0_TMAX120_K67_cod1.opb	SAT f=-775 TT=1800.84 T1=80.8	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=-649 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.27 T1=1800.4	SAT (TO) f=0 TT=1800.09 T1=1800.4	? TT=89.966	SAT (TO) f=-775 TT=1800.84 T1=80.8	No Cert. TT=1797.64	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null10mast_rapportOE2.0_TMAX15_K67_cod1.opb	SAT f=-80 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT (TO) f=0 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.17 T1=1800.3	SAT (TO) f=-80 TT=1800.11 T1=1800.4	? TT=88.361	SAT (TO) f=-64 TT=1800.13 T1=285.95	SAT (TO) f=-48 TT=1800.02 T1=1178.66	? (TO) TT=1800.13
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_10null10mast_rapportOE2.0_TMAX60_K67_cod3.opb	SAT f=-47 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=-47 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.21 T1=1800.3	SAT (TO) f=0 TT=1800.11 T1=1800.4	? TT=90.329	SAT (TO) f=-1 TT=1800.7 T1=26.55	? (TO) TT=1800.03	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_20null0mast_rapportOE1.0_TMAX60_K67_cod2.opb	SAT f=-397 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-358 TT=1800.05 T1=1800.4	SAT (TO) f=0 TT=1800.07 T1=1800.4	SAT (TO) f=-320 TT=1800.02 T1=1800.3	SAT (TO) f=-397 TT=1800.1 T1=1800.4	SAT (TO) f=-3 TT=1800.15 T1=831.22	? (TO) TT=1800	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_20null0mast_rapportOE2.0_TMAX180_K67_cod1.opb	SAT f=-640 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=-306 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.28 T1=1800.4	SAT (TO) f=-640 TT=1800.07 T1=1800.4	? TT=76.843	SAT (TO) f=-539 TT=1800.06 T1=832.36	SAT (TO) f=-314 TT=1800.03 T1=1.36	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_20null0mast_rapportOE2.0_TMAX300_K67_cod2.opb	SAT f=-672 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=-382 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.03 T1=1800.4	SAT (TO) f=-672 TT=1800.1 T1=1800.4	SAT (TO) f=-438 TT=1800.1 T1=1800.4	SAT (TO) f=-406 TT=1800.17 T1=817.52	No Cert. TT=1800.68	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_20null10mast_rapportOE1.0_TMAX180_K67_cod1.opb	SAT f=-4384 TT=1800.73 T1=33.23	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=-1792 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.21 T1=1800.5	SAT (TO) f=0 TT=1800.09 T1=1800.4	? TT=93.002	SAT (TO) f=-4384 TT=1800.73 T1=33.23	SAT (TO) f=-1662 TT=1800.04 T1=15.95	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_20null10mast_rapportOE1.0_TMAX60_K67_cod3.opb	SAT f=-783 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=-783 TT=1800.09 T1=1800.4	? (TO) TT=1800.07	SAT (TO) f=0 TT=1800.1 T1=1800.4	? TT=93.724	SAT (TO) f=-256 TT=1800.09 T1=225.47	? (TO) TT=1800.07	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_50null0mast_rapportOE1.0_TMAX300_K67_cod2.opb	SAT f=-592 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=-461 TT=1800.1 T1=1800.4	SAT (TO) f=-319 TT=1800.03 T1=1800.4	SAT (TO) f=-592 TT=1800.09 T1=1800.4	SAT (TO) f=-479 TT=1800.09 T1=1800.4	SAT (TO) f=-419 TT=1800.58 T1=660.92	SAT (TO) f=-372 TT=1800.02 T1=215.06	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_50null50mast_rapportOE1.0_TMAX300_K67_cod1.opb	SAT f=-57 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-53 TT=1800.04 T1=1800.3	SAT (TO) f=0 TT=1800.4 T1=1800.4	SAT (TO) f=-13 TT=1800.11 T1=1800.4	SAT (TO) f=-57 TT=1800.07 T1=1800.4	SAT (TO) f=-43 TT=1800.84 T1=241.41	SAT (TO) f=-17 TT=1800.01 T1=454.85	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_luby_50null50mast_rapportOE2.0_TMAX120_K67_cod2.opb	OPT f=-11 TT=284.656 T1=284.6	No data	OPT f=-11 TT=1677.31 T1=1677.56	? (TO) TT=1800.03	SAT (TO) f=-10 TT=1800.02 T1=1800.4	OPT f=-11 TT=284.656 T1=284.6	SAT (TO) f=0 TT=1800.12 T1=1800.4	SAT (TO) f=-11 TT=1800.02 T1=1800.3	SAT (TO) f=-10 TT=1800.52 T1=462.35	SAT (TO) f=-9 TT=1800.05 T1=190.2	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_10null10mast_rapportOE1.0_TMAX60_K67_cod2.opb	SAT f=-13964 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=-13964 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.06 T1=1800.4	SAT (TO) f=0 TT=1800.03 T1=1800.3	? TT=78.617	SAT (TO) f=-34 TT=1800.72 T1=155.27	? (TO) TT=1800.06	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null0mast_rapportOE1.0_TMAX180_K67_cod2.opb	SAT f=-38615 TT=1800.44 T1=779.94	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-35157 TT=1800.11 T1=1800.4	SAT (TO) f=0 TT=1800.08 T1=1800.5	SAT (TO) f=-13797 TT=1800.05 T1=1800.4	? TT=76.856	SAT (TO) f=-38615 TT=1800.44 T1=779.94	SAT (TO) f=-25704 TT=1800.07 T1=1038.59	? (TO) TT=1800.05
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_20null10mast_rapportOE2.0_TMAX180_K67_cod2.opb	SAT f=-22694 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-22694 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.12 T1=1800.5	SAT (TO) f=0 TT=1800.11 T1=1800.4	? TT=78.049	SAT (TO) f=-12945 TT=1800.02 T1=845.32	No Cert. TT=1800.06	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_50null0mast_rapportOE1.0_TMAX180_K67_cod2.opb	SAT f=-39314 TT=1802.95 T1=587.93	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=-35892 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.11 T1=1800.5	SAT (TO) f=-13661 TT=1800.08 T1=1800.4	? TT=78.935	SAT (TO) f=-39314 TT=1802.95 T1=587.93	SAT (TO) f=-29000 TT=1800.79 T1=1543.25	? (TO) TT=1800.06
/OPT-SMALLINT-LIN/sroussel/BA/ normalized-BA_RDC4.dot_unif_50null50mast_rapportOE2.0_TMAX15_K67_cod1.opb	OPT f=0 TT=5.941 T1=2.34	No data	OPT f=0 TT=371.582 T1=371.3	OPT f=0 TT=118.923 T1=118.92	SAT (TO) f=0 TT=1800.09 T1=1800.4	OPT f=0 TT=931.461 T1=931.26	SAT (TO) f=0 TT=1800.11 T1=1800.4	OPT f=0 TT=5.941 T1=5.91	OPT f=0 TT=850.727 T1=4.43	OPT f=0 TT=247.4 T1=2.34	? (TO) TT=1800.01
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_50null0mast_rapportOE2.0_TMAX120_K192_cod2.opb	SAT f=-27582 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.097	? (exit code) TT=0.007	SAT (TO) f=-27582 TT=1800.13 T1=1800.3	Signal TT=19.198	SAT (TO) f=0 TT=1800.22 T1=1800.4	? TT=163.431	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.01
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_fibo_50null50mast_rapportOE2.0_TMAX120_K192_cod2.opb	SAT f=-7578 TT=1800.14 T1=1800.4	No data	? (exit code) TT=1.096	? (exit code) TT=0.006	SAT (TO) f=-7578 TT=1800.14 T1=1800.4	Signal TT=19.393	SAT (TO) f=0 TT=1800.18 T1=1800.4	? (TO) TT=1800.11	SAT (TO) f=0 TT=1800.08 T1=12.38	? (TO) TT=1800.04	? (TO) TT=1800.14
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null0mast_rapportOE1.0_TMAX60_K192_cod2.opb	SAT f=-512 TT=1800.2 T1=1800.4	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-124 TT=1800.12 T1=1800.3	Signal TT=19.142	SAT (TO) f=-512 TT=1800.2 T1=1800.4	SAT (TO) f=-236 TT=1800.13 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX15_K192_cod2.opb	SAT f=-2272 TT=1800.2 T1=1800.4	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-2048 TT=1800.13 T1=1800.3	Signal TT=19.227	SAT (TO) f=-2272 TT=1800.2 T1=1800.4	SAT (TO) f=-2061 TT=1800.39 T1=1800.4	SAT (TO) f=-4 TT=1800.01 T1=59.54	? (TO) TT=1800.67	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX300_K192_cod2.opb	SAT f=-14603 TT=1800.39 T1=1800.4	No data	? (exit code) TT=1.095	? (exit code) TT=0.006	SAT (TO) f=-13667 TT=1800.13 T1=1800.4	Signal TT=19.214	SAT (TO) f=0 TT=1800.21 T1=1800.5	SAT (TO) f=-14603 TT=1800.39 T1=1800.4	SAT (TO) f=-1 TT=1800.04 T1=54.09	? (TO) TT=1800.55	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null10mast_rapportOE2.0_TMAX180_K192_cod2.opb	SAT f=-7307 TT=1800.42 T1=1800.4	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-4152 TT=1800.13 T1=1800.3	Signal TT=19.266	SAT (TO) f=0 TT=1800.13 T1=1800.4	SAT (TO) f=-7307 TT=1800.42 T1=1800.4	SAT (TO) f=-2 TT=1801.04 T1=192.82	? (TO) TT=1800.01	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX180_K192_cod2.opb	SAT f=-12735 TT=1800.72 T1=1800.41	No data	? (exit code) TT=1.092	? (exit code) TT=0.007	SAT (TO) f=-12386 TT=1800.13 T1=1800.3	Signal TT=19.167	SAT (TO) f=-1026 TT=1800.17 T1=1800.4	SAT (TO) f=-12735 TT=1800.72 T1=1800.41	SAT (TO) f=0 TT=1800.97 T1=12.25	? (TO) TT=1800.09	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb	SAT f=-25670 TT=1800.7 T1=1800.4	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-12510 TT=1800.12 T1=1800.3	Signal TT=19.332	SAT (TO) f=-6144 TT=1800.15 T1=1800.4	SAT (TO) f=-25670 TT=1800.7 T1=1800.4	SAT (TO) f=0 TT=1800.03 T1=11.99	? (TO) TT=1800.66	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX60_K192_cod2.opb	SAT f=-4204 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.096	? (exit code) TT=0.006	SAT (TO) f=-4204 TT=1800.13 T1=1800.3	Signal TT=19.154	SAT (TO) f=0 TT=1800.18 T1=1800.4	SAT (TO) f=-2061 TT=1800.75 T1=1800.4	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.14
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_20null0mast_rapportOE2.0_TMAX300_K192_cod2.opb	SAT f=-2560 TT=1800.11 T1=1800.4	No data	? (exit code) TT=1.092	? (exit code) TT=0.006	SAT (TO) f=-302 TT=1800.12 T1=1800.3	Signal TT=19.386	SAT (TO) f=-2560 TT=1800.11 T1=1800.4	SAT (TO) f=-1087 TT=1800.13 T1=1800.4	? (TO) TT=1800.03	No Cert. TT=1800.3	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_20null10mast_rapportOE1.0_TMAX180_K192_cod2.opb	SAT f=-4271 TT=1800.4 T1=1800.4	No data	? (exit code) TT=1.092	? (exit code) TT=0.006	SAT (TO) f=-3105 TT=1800.13 T1=1800.3	Signal TT=19.204	SAT (TO) f=0 TT=1800.14 T1=1800.4	SAT (TO) f=-4271 TT=1800.4 T1=1800.4	SAT (TO) f=0 TT=1800.06 T1=12.02	? (TO) TT=1800.03	? (TO) TT=1800.04
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_20null50mast_rapportOE1.0_TMAX15_K192_cod2.opb	SAT f=-2336 TT=1800.54 T1=1800.3	No data	? (exit code) TT=1.091	? (exit code) TT=0.007	SAT (TO) f=-8 TT=1800.12 T1=1800.3	Signal TT=19.149	SAT (TO) f=0 TT=1800.2 T1=1800.4	SAT (TO) f=-2336 TT=1800.54 T1=1800.3	SAT (TO) f=0 TT=1800.09 T1=11.99	? (TO) TT=1800.01	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null0mast_rapportOE1.0_TMAX15_K192_cod2.opb	SAT f=-432 TT=1800.18 T1=1800.4	No data	? (exit code) TT=1.093	? (exit code) TT=0.007	SAT (TO) f=-4 TT=1800.13 T1=1800.3	Signal TT=19.26	SAT (TO) f=-432 TT=1800.18 T1=1800.4	SAT (TO) f=-387 TT=1800.19 T1=1800.4	? (TO) TT=1800.15	No Cert. TT=1800.27	? (TO) TT=1800.14
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null20mast_rapportOE2.0_TMAX60_K192_cod2.opb	SAT f=-5120 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.094	? (exit code) TT=0.007	SAT (TO) f=-5120 TT=1800.13 T1=1800.3	Signal TT=19.246	SAT (TO) f=0 TT=1800.19 T1=1800.4	SAT (TO) f=-4164 TT=1800.23 T1=1800.4	SAT (TO) f=0 TT=1801.05 T1=12.23	? (TO) TT=1800	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null50mast_rapportOE1.0_TMAX180_K192_cod2.opb	SAT f=-25600 TT=1800.12 T1=1800.3	No data	? (exit code) TT=1.096	? (exit code) TT=0.006	SAT (TO) f=-25600 TT=1800.12 T1=1800.3	Signal TT=19.218	SAT (TO) f=0 TT=1800.15 T1=1800.4	? (TO) TT=1800.04	SAT (TO) f=0 TT=1800.18 T1=13.73	? (TO) TT=1800.6	? (TO) TT=1800.08
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null50mast_rapportOE1.0_TMAX300_K192_cod2.opb	SAT f=-1536 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.094	? (exit code) TT=0.006	SAT (TO) f=-1536 TT=1800.13 T1=1800.3	Signal TT=19.21	SAT (TO) f=-512 TT=1800.17 T1=1800.3	? (TO) TT=1800.09	SAT (TO) f=-32 TT=1800.03 T1=442.37	? (TO) TT=1800.04	? (TO) TT=1800.07
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_luby_50null50mast_rapportOE2.0_TMAX120_K192_cod2.opb	SAT f=-10240 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.096	? (exit code) TT=0.005	SAT (TO) f=-10240 TT=1800.13 T1=1800.3	Signal TT=19.409	SAT (TO) f=0 TT=1800.18 T1=1800.4	? (TO) TT=1800.07	SAT (TO) f=0 TT=1800.54 T1=13.12	? (TO) TT=1800.65	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_0null10mast_rapportOE1.0_TMAX60_K192_cod2.opb	SAT f=-11641 TT=1800.12 T1=1800.3	No data	? (exit code) TT=1.095	? (exit code) TT=0.005	SAT (TO) f=-11641 TT=1800.12 T1=1800.3	Signal TT=19.192	SAT (TO) f=0 TT=1800.16 T1=1800.4	? TT=91.84	SAT (TO) f=0 TT=1801.19 T1=11.94	? (TO) TT=1800.07	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_10null0mast_rapportOE2.0_TMAX15_K192_cod2.opb	SAT f=-9498 TT=1800.18 T1=1800.4	No data	? (exit code) TT=1.095	? (exit code) TT=0.006	SAT (TO) f=-1687 TT=1800.12 T1=1800.3	Signal TT=19.506	SAT (TO) f=-9498 TT=1800.18 T1=1800.4	? TT=77.527	SAT (TO) f=0 TT=1800.5 T1=836.1	? (TO) TT=1800.29	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb	SAT f=-51080 TT=1800.12 T1=1800.3	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-51080 TT=1800.12 T1=1800.3	Signal TT=19.072	SAT (TO) f=-341 TT=1800.12 T1=1800.4	? TT=76.927	SAT (TO) f=0 TT=1800.13 T1=12.31	? (TO) TT=1800.61	? (TO) TT=1800.1
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_10null20mast_rapportOE2.0_TMAX60_K192_cod2.opb	SAT f=-2532 TT=1800.12 T1=1800.3	No data	? (exit code) TT=1.096	? (exit code) TT=0.006	SAT (TO) f=-2532 TT=1800.12 T1=1800.3	Signal TT=19.37	SAT (TO) f=0 TT=1800.17 T1=1800.4	? TT=80.9	SAT (TO) f=0 TT=1800.97 T1=12.98	? (TO) TT=1800.06	? (TO) TT=1800.01
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null0mast_rapportOE1.0_TMAX300_K192_cod2.opb	SAT f=-47956 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-47956 TT=1800.13 T1=1800.3	Signal TT=19.257	SAT (TO) f=-41421 TT=1800.14 T1=1800.4	? TT=81.322	SAT (TO) f=-3 TT=1800.3 T1=766.93	? (TO) TT=1800.68	? (TO) TT=1800.11
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null0mast_rapportOE2.0_TMAX180_K192_cod2.opb	SAT f=-20785 TT=1800.15 T1=1800.4	No data	? (exit code) TT=1.09	? (exit code) TT=0.007	SAT (TO) f=-15538 TT=1800.13 T1=1800.3	Signal TT=19.212	SAT (TO) f=-20785 TT=1800.15 T1=1800.4	? TT=79.923	SAT (TO) f=0 TT=1800.05 T1=10.52	? (TO) TT=1800.09	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null20mast_rapportOE1.0_TMAX120_K192_cod2.opb	SAT f=-16727 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.093	? (exit code) TT=0.006	SAT (TO) f=-16727 TT=1800.13 T1=1800.3	Signal TT=19.237	SAT (TO) f=-9314 TT=1800.15 T1=1800.4	? TT=76.004	SAT (TO) f=0 TT=1800.12 T1=12.32	? (TO) TT=1800.04	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX15_K192_cod2.opb	SAT f=-6662 TT=1800.19 T1=1800.4	No data	? (exit code) TT=1.094	? (exit code) TT=0.007	SAT (TO) f=-909 TT=1800.12 T1=1800.3	Signal TT=19.217	SAT (TO) f=-6662 TT=1800.19 T1=1800.4	? TT=76.315	SAT (TO) f=0 TT=1800.1 T1=19.86	No Cert. TT=1800.94	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX300_K192_cod2.opb	SAT f=-23105 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.096	? (exit code) TT=0.005	SAT (TO) f=-23105 TT=1800.13 T1=1800.3	Signal TT=19.293	SAT (TO) f=0 TT=1800.2 T1=1800.5	? TT=82.934	SAT (TO) f=0 TT=1800.16 T1=12.71	No Cert. TT=1800.85	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_50null0mast_rapportOE2.0_TMAX60_K192_cod2.opb	SAT f=-5661 TT=1800.15 T1=1800.5	No data	? (exit code) TT=1.096	? (exit code) TT=0.006	SAT (TO) f=-5661 TT=1800.15 T1=1800.5	Signal TT=19.296	SAT (TO) f=0 TT=1800.18 T1=1800.4	? TT=93.048	? (TO) TT=1800.46	? (TO) TT=1800.08	? (TO) TT=1800.03
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_50null20mast_rapportOE1.0_TMAX15_K192_cod2.opb	SAT f=-8640 TT=1800.18 T1=1800.4	No data	? (exit code) TT=1.097	? (exit code) TT=0.006	? (TO) TT=1800.04	Signal TT=19.124	SAT (TO) f=-8640 TT=1800.18 T1=1800.4	? TT=82.212	? (TO) TT=1800.16	No Cert. TT=1800.77	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_50null20mast_rapportOE2.0_TMAX120_K192_cod2.opb	SAT f=-9679 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.097	? (exit code) TT=0.006	SAT (TO) f=-9679 TT=1800.13 T1=1800.3	Signal TT=19.104	SAT (TO) f=0 TT=1800.17 T1=1800.4	? TT=95.702	SAT (TO) f=0 TT=1800.95 T1=12.11	? (TO) TT=1800.05	? (TO) TT=1800.09
/OPT-SMALLINT-LIN/sroussel/NG/ normalized-NG.dot_unif_50null50mast_rapportOE1.0_TMAX180_K192_cod2.opb	SAT f=-24000 TT=1800.13 T1=1800.3	No data	? (exit code) TT=1.096	? (exit code) TT=0.006	SAT (TO) f=-24000 TT=1800.13 T1=1800.3	Signal TT=19.026	SAT (TO) f=-2000 TT=1800.16 T1=1800.4	? (TO) TT=1800.11	SAT (TO) f=0 TT=1800.16 T1=13.04	? (TO) TT=1800.01	? (TO) TT=1800.12
/OPT-SMALLINT-NLC/oren/ keeloq_tasca_instances/ normalized-90_rounds_0_errors.opb	OPT f=0 TT=0.934 T1=0.47	No data	No data	No data	OPT f=0 TT=177.06 T1=177.08	No data	No data	No data	OPT f=0 TT=1.283 T1=1.04	OPT f=0 TT=0.934 T1=0.47	OPT f=0 TT=28.46 T1=28.41
/OPT-SMALLINT-NLC/oren/ keeloq_tasca_instances/ normalized-90_rounds_10_errors.opb	OPT f=10 TT=789.012 T1=789.13	No data	No data	No data	OPT f=10 TT=789.012 T1=789.13	No data	No data	No data	SAT (TO) f=32 TT=1800.78 T1=591.01	SAT (TO) f=34 TT=1800.06 T1=872.4	? (TO) TT=1800.09
/OPT-SMALLINT-NLC/oren/ keeloq_tasca_instances/ normalized-90_rounds_15_errors.opb	OPT f=15 TT=107.715 T1=107.72	No data	No data	No data	OPT f=15 TT=107.715 T1=107.72	No data	No data	No data	SAT (TO) f=36 TT=1800.15 T1=665.48	SAT (TO) f=31 TT=1800.09 T1=1658.03	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/OPT-SMALLINT-NLC/oren/ keeloq_tasca_instances/ normalized-90_rounds_5_errors.opb	OPT f=5 TT=62.405 T1=33.55	No data	No data	No data	OPT f=5 TT=458.138 T1=458.2	No data	No data	No data	OPT f=5 TT=62.405 T1=33.55	SAT (TO) f=34 TT=1800.08 T1=196.16	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/pbfvmc-formulae/ pbfvmc-formulae/hw128/normalized-hw128-vm100p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	No data	? (TO) TT=1800.98	? (TO) TT=1800.78	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw128/ normalized-hw128-vm90p-dec.opb.negationfix.opb	SAT TT=5.154 T1=3.36	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	No data	No data	SAT TT=12.031 T1=7.42	SAT TT=5.154 T1=3.36	SAT TT=100.856 T1=100.67
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw128/ normalized-hw128-vm95p-dec.opb.negationfix.opb	SAT TT=105.639 T1=53.22	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.16	No data	No data	SAT TT=105.639 T1=53.22	SAT TT=1029.77 T1=1025.84	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw128/ normalized-hw128-vm98p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	No data	? (TO) TT=1800.64	? (TO) TT=1800	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw128/ normalized-hw128-vm99p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.12	No data	No data	? (TO) TT=1800.19	? (TO) TT=1800.81	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/pbfvmc-formulae/ pbfvmc-formulae/hw256/normalized-hw256-vm100p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.33	? (TO) TT=1800.18	No data	No data	? (TO) TT=1800.86	? (TO) TT=1800.98	? (TO) TT=1800.17
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm25p-dec.opb.negationfix.opb	SAT TT=4.582 T1=2.81	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	No data	SAT TT=19.601 T1=15.32	SAT TT=4.582 T1=2.81	SAT TT=4.997 T1=4.79
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm50p-dec.opb.negationfix.opb	SAT TT=8.394 T1=5.97	No data	No data	No data	? (TO) TT=1800.22	? (TO) TT=1800.13	No data	No data	SAT TT=16.673 T1=9.67	SAT TT=8.394 T1=5.97	SAT TT=9.616 T1=9.15
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm75p-dec.opb.negationfix.opb	SAT TT=13.351 T1=10.44	No data	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.13	No data	No data	SAT TT=32.44 T1=20.28	SAT TT=13.351 T1=10.44	SAT TT=14.203 T1=13.68
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm85p-dec.opb.negationfix.opb	SAT TT=16.332 T1=13.08	No data	No data	No data	? (TO) TT=1800.24	? (TO) TT=1800.12	No data	No data	SAT TT=47.138 T1=31.17	SAT TT=16.332 T1=13.08	SAT TT=17.785 T1=17.23
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm90p-dec.opb.negationfix.opb	SAT TT=19.72 T1=16.51	No data	No data	No data	? (TO) TT=1800.28	? (TO) TT=1800.18	No data	No data	SAT TT=58.485 T1=37.43	SAT TT=19.72 T1=16.51	SAT TT=44.585 T1=43.92
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm95p-dec.opb.negationfix.opb	SAT TT=51.594 T1=47.99	No data	No data	No data	? (TO) TT=1800.34	? (TO) TT=1800.09	No data	No data	SAT TT=676.881 T1=361.34	SAT TT=51.594 T1=47.99	? (TO) TT=1800.25
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm98p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.43	? (TO) TT=1800.2	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.16
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw256/ normalized-hw256-vm99p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.29	? (TO) TT=1800.21	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/pbfvmc-formulae/ pbfvmc-formulae/hw512/normalized-hw512-vm100p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.36	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.94	? (TO) TT=1800.51
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm25p-dec.opb.negationfix.opb	SAT TT=14.492 T1=11.08	No data	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.07	No data	No data	SAT TT=31.401 T1=19.14	SAT TT=14.492 T1=11.08	SAT TT=18.489 T1=17.83
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm50p-dec.opb.negationfix.opb	SAT TT=36.687 T1=28.41	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.19	No data	No data	SAT TT=300.569 T1=266.01	SAT TT=36.687 T1=28.41	SAT TT=62.766 T1=61.39
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm75p-dec.opb.negationfix.opb	SAT TT=63.438 T1=49.59	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.29	No data	No data	SAT TT=1224.2 T1=1159.08	SAT TT=63.438 T1=49.59	SAT TT=105.54 T1=103.57
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm85p-dec.opb.negationfix.opb	SAT TT=71.046 T1=68.8	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.29	No data	No data	? (TO) TT=1800	SAT TT=87.1 T1=69.13	SAT TT=71.046 T1=68.8
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm90p-dec.opb.negationfix.opb	SAT TT=91.83 T1=71.86	No data	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.24	No data	No data	SAT TT=210.412 T1=124.37	SAT TT=91.83 T1=71.86	SAT TT=120.73 T1=118.32
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm95p-dec.opb.negationfix.opb	SAT TT=329.086 T1=306.16	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.35	No data	No data	? (TO) TT=1801.08	SAT TT=329.086 T1=306.16	? (TO) TT=1800.41
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm98p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.33	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.85	? (TO) TT=1800.59
PB15eval/normalized-PB15eval/DEC-BIGINT-LIN/ pbfvmc-formulae/pbfvmc-formulae/hw512/ normalized-hw512-vm99p-dec.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.27	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.54
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm25p-dec.opb.negationfix.opb	SAT f=0 TT=1.591 T1=1.11	SAT f=0 TT=1.969 T1=1.95	No data	No data	? (TO) TT=1800.08	SAT f=0 TT=1554.31 T1=1552.42	? TT=75.732	? TT=74.992	SAT f=0 TT=3.672 T1=1.55	SAT f=0 TT=2.362 T1=1.11	SAT f=0 TT=1.591 T1=1.51
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm50p-dec.opb.negationfix.opb	SAT f=0 TT=2.99 T1=1.89	SAT f=0 TT=3.415 T1=3.39	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=68.413	? TT=68.02	SAT f=0 TT=7.473 T1=4.25	SAT f=0 TT=3.383 T1=1.89	SAT f=0 TT=2.99 T1=2.9
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm75p-dec.opb.negationfix.opb	SAT f=0 TT=3.886 T1=2.8	SAT f=0 TT=14.227 T1=14.18	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=69.482	? TT=70.183	SAT f=0 TT=27.64 T1=23.36	SAT f=0 TT=4.663 T1=2.8	SAT f=0 TT=3.886 T1=3.73
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm85p-dec.opb.negationfix.opb	SAT f=0 TT=4.548 T1=3.17	SAT f=0 TT=101.664 T1=101.64	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=69.407	? TT=69.577	SAT f=0 TT=9.783 T1=4.95	SAT f=0 TT=5.173 T1=3.17	SAT f=0 TT=4.548 T1=4.36
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-100.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=127.388	UNSAT TT=119.384	UNSAT TT=120.37	UNSAT TT=0.354	UNSAT TT=1290.41	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-15.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.188	UNSAT TT=47.918	No data	No data	UNSAT TT=7.777	UNSAT TT=3.188	UNSAT TT=8.942	UNSAT TT=8.952	UNSAT TT=26.329	UNSAT TT=17.61	UNSAT TT=19.054
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-16.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=13.119	UNSAT TT=15.963	UNSAT TT=20.185	UNSAT TT=19.976	UNSAT TT=0.196	UNSAT TT=22.481	UNSAT TT=21.666
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-16.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.284	UNSAT TT=52.956	No data	No data	UNSAT TT=12.504	UNSAT TT=6.284	UNSAT TT=8.909	UNSAT TT=8.984	UNSAT TT=75.402	UNSAT TT=40.06	UNSAT TT=34.156
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-17.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=23.948	UNSAT TT=30.83	UNSAT TT=26.182	UNSAT TT=26.716	UNSAT TT=0.175	UNSAT TT=79.78	UNSAT TT=61.674
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-17.cnf.gz-plain.pb.metafix.opb	UNSAT TT=16.306	UNSAT TT=301.576	No data	No data	UNSAT TT=26.846	UNSAT TT=17.301	UNSAT TT=16.306	UNSAT TT=16.693	UNSAT TT=151.571	UNSAT TT=63.48	UNSAT TT=50.882
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-18.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=66.835	UNSAT TT=149.944	UNSAT TT=22.089	UNSAT TT=21.758	UNSAT TT=0.184	UNSAT TT=195.064	UNSAT TT=73.475
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-18.cnf.gz-plain.pb.metafix.opb	UNSAT TT=40.554	UNSAT TT=423.968	No data	No data	UNSAT TT=60.539	UNSAT TT=96.734	UNSAT TT=41.291	UNSAT TT=40.554	UNSAT TT=268.252	UNSAT TT=106.75	UNSAT TT=145.324
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-19.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=109.318	UNSAT TT=237.724	UNSAT TT=57.37	UNSAT TT=57.419	UNSAT TT=0.194	UNSAT TT=319.614	UNSAT TT=259.747
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-19.cnf.gz-plain.pb.metafix.opb	UNSAT TT=49.834	UNSAT TT=1026.39	No data	No data	UNSAT TT=102.786	UNSAT TT=208.998	UNSAT TT=50.784	UNSAT TT=49.834	UNSAT TT=579.187	UNSAT TT=203.72	UNSAT TT=207.136
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-20.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=166.31	UNSAT TT=1112.17	UNSAT TT=41.869	UNSAT TT=42.315	UNSAT TT=0.194	UNSAT TT=455.684	UNSAT TT=341.262
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-21.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=339.291	? (TO) TT=1800.01	UNSAT TT=72.426	UNSAT TT=73.603	UNSAT TT=0.213	UNSAT TT=721.425	UNSAT TT=471.627
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-22.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=416.051	? (TO) TT=1800.02	UNSAT TT=96.523	UNSAT TT=96.372	UNSAT TT=0.215	UNSAT TT=1476.49	UNSAT TT=1319.69
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-23.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=809.854	? (TO) TT=1800.02	UNSAT TT=171.888	UNSAT TT=169.629	UNSAT TT=0.224	? (TO) TT=1800.82	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-24.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=1436.56	? (TO) TT=1800.02	UNSAT TT=208.53	UNSAT TT=204.169	UNSAT TT=0.223	? (TO) TT=1800.05	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-25.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=235.628	UNSAT TT=234.918	UNSAT TT=0.224	? (TO) TT=1800.06	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-26.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=854.305	UNSAT TT=882.498	UNSAT TT=0.223	? (TO) TT=1800.06	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-27.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=1491.02	UNSAT TT=1477.85	UNSAT TT=0.224	? (TO) TT=1800.5	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-51.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.03	UNSAT TT=154.415	UNSAT TT=1409.18	UNSAT TT=1420.36	UNSAT TT=0.274	? (TO) TT=1800.09	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-55.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=78.381	UNSAT TT=622.334	UNSAT TT=623.74	UNSAT TT=0.263	? (TO) TT=1800.04	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-58.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=67.962	UNSAT TT=143.063	UNSAT TT=140.877	UNSAT TT=0.273	? (TO) TT=1800.53	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-60.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=75.883	UNSAT TT=339.362	UNSAT TT=344.28	UNSAT TT=0.283	? (TO) TT=1800.06	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-61.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	UNSAT TT=84.394	UNSAT TT=240.531	UNSAT TT=243.863	UNSAT TT=0.393	UNSAT TT=1604.01	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-62.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	UNSAT TT=80.178	UNSAT TT=165.621	UNSAT TT=166.897	UNSAT TT=0.383	? (TO) TT=1800.59	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-63.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	UNSAT TT=80.583	UNSAT TT=296.054	UNSAT TT=296.173	UNSAT TT=0.385	UNSAT TT=1462.02	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-64.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=84.163	UNSAT TT=261.973	UNSAT TT=264.408	UNSAT TT=0.394	? (TO) TT=1800.55	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-65.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.02	UNSAT TT=67.522	UNSAT TT=144.301	UNSAT TT=144.314	UNSAT TT=0.375	UNSAT TT=1236.97	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-66.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=70.864	UNSAT TT=178.937	UNSAT TT=179.691	UNSAT TT=0.306	? (TO) TT=1800.91	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-67.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=91.056	UNSAT TT=225.692	UNSAT TT=227.868	UNSAT TT=0.404	? (TO) TT=1800.05	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-68.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=80.607	UNSAT TT=94.277	UNSAT TT=99.454	UNSAT TT=0.354	? (TO) TT=1800.02	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-69.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	UNSAT TT=83.865	UNSAT TT=102.483	UNSAT TT=103.484	UNSAT TT=0.415	? (TO) TT=1800.01	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-70.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=87.76	UNSAT TT=106.672	UNSAT TT=107.22	UNSAT TT=0.373	UNSAT TT=1679.04	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-71.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	UNSAT TT=101.568	UNSAT TT=125.041	UNSAT TT=127.488	UNSAT TT=0.385	UNSAT TT=1674.5	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-72.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=90.086	UNSAT TT=138.249	UNSAT TT=141.125	UNSAT TT=0.384	? (TO) TT=1800.06	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-73.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.02	UNSAT TT=82.502	UNSAT TT=156.162	UNSAT TT=154.378	UNSAT TT=0.423	UNSAT TT=1527.46	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-75.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=89.549	UNSAT TT=130.87	UNSAT TT=132.217	UNSAT TT=0.313	UNSAT TT=1442.11	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-76.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.06	UNSAT TT=102.657	UNSAT TT=120.656	UNSAT TT=120.927	UNSAT TT=0.413	UNSAT TT=1370.26	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-77.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=79.115	UNSAT TT=109.614	UNSAT TT=109.276	UNSAT TT=0.375	UNSAT TT=1024.3	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-78.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.014	UNSAT TT=0.014	No data	No data	? (TO) TT=1800.02	UNSAT TT=99.033	UNSAT TT=121.943	UNSAT TT=114.491	UNSAT TT=0.372	? (TO) TT=1800.54	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-80.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.02	UNSAT TT=102.264	UNSAT TT=95.828	UNSAT TT=95.992	UNSAT TT=0.403	UNSAT TT=1515.12	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-81.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=99.677	UNSAT TT=147.686	UNSAT TT=147.876	UNSAT TT=0.383	UNSAT TT=1608.19	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-83.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=94.136	UNSAT TT=125.551	UNSAT TT=125.239	UNSAT TT=0.434	UNSAT TT=1118.31	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-84.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.02	UNSAT TT=113.39	UNSAT TT=96.287	UNSAT TT=95.45	UNSAT TT=0.394	UNSAT TT=1573.65	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-85.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=108.679	UNSAT TT=107.393	UNSAT TT=107.677	UNSAT TT=0.404	UNSAT TT=1764.13	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-86.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=116.882	UNSAT TT=172.276	UNSAT TT=172.638	UNSAT TT=0.394	UNSAT TT=937.955	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-87.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.03	UNSAT TT=115.106	UNSAT TT=117.898	UNSAT TT=117.611	UNSAT TT=0.393	UNSAT TT=978.175	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-88.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.01	UNSAT TT=113.217	UNSAT TT=82.346	UNSAT TT=82.053	UNSAT TT=0.403	UNSAT TT=1251.16	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-89.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=109.759	UNSAT TT=136.209	UNSAT TT=136.672	UNSAT TT=0.424	UNSAT TT=1506.57	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-90.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=128.752	UNSAT TT=134.925	UNSAT TT=134.717	UNSAT TT=0.393	UNSAT TT=1271.45	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-91.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	? (TO) TT=1800.03	UNSAT TT=112.096	UNSAT TT=89.636	UNSAT TT=89.686	UNSAT TT=0.423	UNSAT TT=1359.02	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-92.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=109.051	UNSAT TT=124.149	UNSAT TT=125.679	UNSAT TT=0.394	UNSAT TT=1221.46	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-93.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.02	UNSAT TT=96.907	UNSAT TT=129.816	UNSAT TT=130.338	UNSAT TT=0.405	UNSAT TT=1327.5	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-94.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=140.105	UNSAT TT=104.445	UNSAT TT=104.815	UNSAT TT=0.424	UNSAT TT=1088.96	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-95.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=143.916	UNSAT TT=143.264	UNSAT TT=143.494	UNSAT TT=0.404	UNSAT TT=1236.6	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-97.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=123.501	UNSAT TT=172.388	UNSAT TT=172.142	UNSAT TT=0.424	UNSAT TT=1184.53	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-fixed-bandwidth-98.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	? (TO) TT=1800.02	UNSAT TT=132.122	UNSAT TT=126.933	UNSAT TT=127.469	UNSAT TT=0.414	UNSAT TT=1594.73	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n16-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.939	UNSAT TT=2.619	No data	No data	UNSAT TT=1.869	UNSAT TT=1.489	UNSAT TT=0.939	UNSAT TT=1	UNSAT TT=8.384	UNSAT TT=4.404	UNSAT TT=4.699
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n17-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.259	UNSAT TT=1.381	No data	No data	UNSAT TT=1.712	UNSAT TT=0.259	UNSAT TT=0.534	UNSAT TT=0.534	UNSAT TT=6.723	UNSAT TT=4.953	UNSAT TT=9.366
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n17-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.164	UNSAT TT=4.291	No data	No data	UNSAT TT=2.118	UNSAT TT=1.388	UNSAT TT=1.164	UNSAT TT=1.167	UNSAT TT=9.963	UNSAT TT=4.003	UNSAT TT=7.058
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n17-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.624	UNSAT TT=23.365	No data	No data	UNSAT TT=4.879	UNSAT TT=4.848	UNSAT TT=3.625	UNSAT TT=3.624	UNSAT TT=17.182	UNSAT TT=16.452	UNSAT TT=12.93
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n18-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.646	UNSAT TT=4.367	No data	No data	UNSAT TT=4.627	UNSAT TT=0.646	UNSAT TT=0.877	UNSAT TT=0.876	UNSAT TT=12.641	UNSAT TT=11.752	UNSAT TT=11.041
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n18-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.071	UNSAT TT=23.228	No data	No data	UNSAT TT=9.001	UNSAT TT=5.071	UNSAT TT=5.288	UNSAT TT=5.281	UNSAT TT=34.928	UNSAT TT=17.582	UNSAT TT=25.965
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n19-d4-i1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=11.331	UNSAT TT=10.474	UNSAT TT=5.098	UNSAT TT=5.179	UNSAT TT=0.215	UNSAT TT=18.632	UNSAT TT=39.233
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n19-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=11.49	UNSAT TT=90.375	No data	No data	UNSAT TT=12.202	UNSAT TT=11.49	UNSAT TT=12.796	UNSAT TT=12.728	UNSAT TT=35.18	UNSAT TT=18.82	UNSAT TT=40.479
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n19-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.276	UNSAT TT=4.767	No data	No data	UNSAT TT=5.037	UNSAT TT=1.561	UNSAT TT=1.276	UNSAT TT=1.277	UNSAT TT=6.383	UNSAT TT=3.723	UNSAT TT=21.834
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n20-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.514	UNSAT TT=0.937	No data	No data	UNSAT TT=2.855	UNSAT TT=0.949	UNSAT TT=0.514	UNSAT TT=0.515	UNSAT TT=5.922	UNSAT TT=3.602	UNSAT TT=7.74
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n20-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.495	UNSAT TT=38.183	No data	No data	UNSAT TT=16.012	UNSAT TT=7.046	UNSAT TT=5.495	UNSAT TT=5.506	UNSAT TT=37.098	UNSAT TT=19.15	UNSAT TT=49.871
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n21-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.057	UNSAT TT=1.63	No data	No data	UNSAT TT=4.558	UNSAT TT=1.836	UNSAT TT=1.057	UNSAT TT=1.058	UNSAT TT=7.172	UNSAT TT=3.793	UNSAT TT=13.61
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n21-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=29.091	UNSAT TT=8.865	UNSAT TT=6.191	UNSAT TT=6.246	UNSAT TT=0.215	UNSAT TT=13.881	UNSAT TT=106.778
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n21-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	UNSAT TT=44.494	UNSAT TT=34.996	UNSAT TT=15.353	UNSAT TT=15.368	UNSAT TT=0.205	UNSAT TT=40.8	UNSAT TT=191.041
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n21-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=23.564	UNSAT TT=128.312	No data	No data	UNSAT TT=57.153	UNSAT TT=43.607	UNSAT TT=23.564	UNSAT TT=23.602	UNSAT TT=58.845	UNSAT TT=43.416	UNSAT TT=136.227
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n22-d4-i1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=44.861	UNSAT TT=14.946	UNSAT TT=9.382	UNSAT TT=9.328	UNSAT TT=0.214	UNSAT TT=44.918	UNSAT TT=81.939
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n22-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=25.634	UNSAT TT=8.514	UNSAT TT=5.335	UNSAT TT=5.357	UNSAT TT=0.224	UNSAT TT=23.961	UNSAT TT=111.076
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n22-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=10.771	UNSAT TT=142.684	No data	No data	UNSAT TT=26.893	UNSAT TT=15.894	UNSAT TT=10.771	UNSAT TT=10.803	UNSAT TT=46.318	UNSAT TT=28.111	UNSAT TT=72.992
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n22-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=110.521	UNSAT TT=20.111	UNSAT TT=40.714	UNSAT TT=41.139	UNSAT TT=0.193	UNSAT TT=82.901	UNSAT TT=192.567
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n22-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=20.275	UNSAT TT=264.535	No data	No data	UNSAT TT=115.222	UNSAT TT=27.286	UNSAT TT=20.275	UNSAT TT=20.424	UNSAT TT=132.564	UNSAT TT=69.77	UNSAT TT=171.126
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n23-d4-i1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=62.864	UNSAT TT=78.696	UNSAT TT=24.265	UNSAT TT=24.08	UNSAT TT=0.182	UNSAT TT=87.821	UNSAT TT=152.813
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n23-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=42.713	UNSAT TT=261.767	No data	No data	UNSAT TT=63.878	UNSAT TT=80.749	UNSAT TT=42.713	UNSAT TT=43.138	UNSAT TT=109.638	UNSAT TT=55.82	UNSAT TT=136.68
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n23-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=21.026	UNSAT TT=21.137	UNSAT TT=3.772	UNSAT TT=3.973	UNSAT TT=0.224	UNSAT TT=21.902	UNSAT TT=47.006
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n23-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=11.514	UNSAT TT=112.99	No data	No data	UNSAT TT=18.322	UNSAT TT=11.514	UNSAT TT=14.094	UNSAT TT=14.096	UNSAT TT=36.898	UNSAT TT=15.482	UNSAT TT=40.932
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n23-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=154.971	UNSAT TT=282.549	UNSAT TT=104.785	UNSAT TT=103.924	UNSAT TT=0.214	UNSAT TT=349.95	UNSAT TT=486.459
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n24-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=609.877	? (TO) TT=1800.02	No data	No data	UNSAT TT=750.05	UNSAT TT=1017.17	UNSAT TT=609.877	UNSAT TT=611.46	UNSAT TT=1339.65	UNSAT TT=1090.24	UNSAT TT=1269.33
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n24-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=161.576	UNSAT TT=119.293	UNSAT TT=54.997	UNSAT TT=54.945	UNSAT TT=0.224	UNSAT TT=161.11	UNSAT TT=406.811
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n24-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=65.839	UNSAT TT=743.361	No data	No data	UNSAT TT=148.32	UNSAT TT=196.175	UNSAT TT=65.839	UNSAT TT=65.967	UNSAT TT=515.975	UNSAT TT=154.66	UNSAT TT=466.201
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n24-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=358.874	UNSAT TT=697.489	UNSAT TT=106.386	UNSAT TT=108.039	UNSAT TT=0.233	UNSAT TT=663.853	UNSAT TT=1206.27
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n24-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=221.402	? (TO) TT=1800.01	No data	No data	UNSAT TT=425.353	UNSAT TT=588.299	UNSAT TT=221.402	UNSAT TT=224.718	UNSAT TT=1121.7	UNSAT TT=424.65	UNSAT TT=1654.82
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n25-d4-i1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=341.765	UNSAT TT=1159.06	UNSAT TT=152.528	UNSAT TT=156.147	UNSAT TT=0.222	UNSAT TT=397.246	UNSAT TT=515.728
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n25-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=326.566	UNSAT TT=144.306	UNSAT TT=82.314	UNSAT TT=82.418	UNSAT TT=0.225	UNSAT TT=189.345	UNSAT TT=1612.35
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n25-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=78.596	UNSAT TT=1109.56	No data	No data	UNSAT TT=326.056	UNSAT TT=156.301	UNSAT TT=78.596	UNSAT TT=79.948	UNSAT TT=442.897	UNSAT TT=121.805	UNSAT TT=874.468
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n25-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=90.634	UNSAT TT=1461.09	No data	No data	UNSAT TT=771.547	UNSAT TT=181.04	UNSAT TT=90.634	UNSAT TT=90.899	UNSAT TT=1757.44	UNSAT TT=1781.53	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n26-d4-i1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=1084.66	UNSAT TT=216.467	UNSAT TT=75.325	UNSAT TT=74.647	UNSAT TT=0.223	UNSAT TT=499.91	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n26-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=672.261	UNSAT TT=1500.98	UNSAT TT=494.642	UNSAT TT=505.218	UNSAT TT=0.223	UNSAT TT=1633.06	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n26-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=329.541	UNSAT TT=466.48	UNSAT TT=167.608	UNSAT TT=177.001	UNSAT TT=0.223	UNSAT TT=578.485	UNSAT TT=869.448
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n26-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=192.6	? (TO) TT=1800.02	No data	No data	UNSAT TT=325.033	UNSAT TT=530.104	UNSAT TT=192.6	UNSAT TT=202.749	UNSAT TT=1303.58	UNSAT TT=667.405	UNSAT TT=657.576
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n27-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1771.06	UNSAT TT=1732.43	UNSAT TT=0.225	? (TO) TT=1800.45	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n27-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=803.088	? (TO) TT=1800.02	UNSAT TT=175.482	UNSAT TT=170.274	UNSAT TT=0.223	UNSAT TT=871.155	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n28-d4-i3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	UNSAT TT=346.707	UNSAT TT=98.242	UNSAT TT=21.539	UNSAT TT=22.056	UNSAT TT=0.223	UNSAT TT=107.598	UNSAT TT=1513.78
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n28-d4-i3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=71.273	UNSAT TT=607.814	No data	No data	UNSAT TT=356.192	UNSAT TT=90.11	UNSAT TT=72.61	UNSAT TT=71.273	UNSAT TT=196.853	UNSAT TT=98.01	UNSAT TT=1557.76
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n29-d4-i2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=246.142	UNSAT TT=296.039	UNSAT TT=87.229	UNSAT TT=89.759	UNSAT TT=0.224	UNSAT TT=476.501	UNSAT TT=1445.59
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-regular-n29-d4-i2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=151.136	UNSAT TT=929.76	No data	No data	UNSAT TT=219.029	UNSAT TT=305.052	UNSAT TT=153.404	UNSAT TT=151.136	UNSAT TT=916.175	UNSAT TT=491.379	UNSAT TT=1030.84
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-17-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.197	UNSAT TT=0.392	No data	No data	UNSAT TT=0.383	UNSAT TT=0.255	UNSAT TT=0.198	UNSAT TT=0.197	UNSAT TT=5.293	UNSAT TT=3.623	UNSAT TT=1.977
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-18-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.394	UNSAT TT=1.025	No data	No data	UNSAT TT=0.841	UNSAT TT=0.394	UNSAT TT=0.557	UNSAT TT=0.58	UNSAT TT=4.812	UNSAT TT=2.553	UNSAT TT=3.625
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-19-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.243	UNSAT TT=13.285	No data	No data	UNSAT TT=10.559	UNSAT TT=6.361	UNSAT TT=2.243	UNSAT TT=2.25	UNSAT TT=14.732	UNSAT TT=12.712	UNSAT TT=27.501
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-19-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.292	UNSAT TT=12.455	No data	No data	UNSAT TT=4.752	UNSAT TT=1.292	UNSAT TT=2.257	UNSAT TT=2.264	UNSAT TT=16.88	UNSAT TT=6.614	UNSAT TT=19.374
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-20-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.989	UNSAT TT=4.428	No data	No data	UNSAT TT=2.035	UNSAT TT=0.989	UNSAT TT=1.281	UNSAT TT=1.286	UNSAT TT=6.863	UNSAT TT=4.173	UNSAT TT=6.111
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-20-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.106	UNSAT TT=7.489	No data	No data	UNSAT TT=3.517	UNSAT TT=2.106	UNSAT TT=2.692	UNSAT TT=2.69	UNSAT TT=12.123	UNSAT TT=6.196	UNSAT TT=15.19
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-20-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.337	UNSAT TT=5.005	No data	No data	UNSAT TT=5.165	UNSAT TT=2.964	UNSAT TT=2.337	UNSAT TT=2.338	UNSAT TT=13.453	UNSAT TT=10.672	UNSAT TT=15.29
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-21-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.011	UNSAT TT=39.328	No data	No data	UNSAT TT=9.148	UNSAT TT=8.263	UNSAT TT=5.011	UNSAT TT=5.03	UNSAT TT=24.969	UNSAT TT=16.12	UNSAT TT=23.806
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-21-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.265	UNSAT TT=4.978	No data	No data	UNSAT TT=4.515	UNSAT TT=1.265	UNSAT TT=1.462	UNSAT TT=1.466	UNSAT TT=13.221	UNSAT TT=6.671	UNSAT TT=13.872
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-22-1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=27.44	UNSAT TT=32.524	UNSAT TT=13.882	UNSAT TT=13.937	UNSAT TT=0.193	UNSAT TT=39.58	UNSAT TT=89.584
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-22-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.124	UNSAT TT=63.171	No data	No data	UNSAT TT=21.641	UNSAT TT=7.45	UNSAT TT=5.124	UNSAT TT=5.131	UNSAT TT=26.581	UNSAT TT=15.351	UNSAT TT=69.646
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-22-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.833	UNSAT TT=6.255	No data	No data	UNSAT TT=2.733	UNSAT TT=0.833	UNSAT TT=1.239	UNSAT TT=1.238	UNSAT TT=7.223	UNSAT TT=4.664	UNSAT TT=6.995
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-22-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=8.744	UNSAT TT=88.39	No data	No data	UNSAT TT=28.343	UNSAT TT=11.009	UNSAT TT=8.745	UNSAT TT=8.744	UNSAT TT=61.055	UNSAT TT=44.23	UNSAT TT=70.474
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-23-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=13.698	UNSAT TT=101.731	No data	No data	UNSAT TT=24.789	UNSAT TT=24.229	UNSAT TT=13.698	UNSAT TT=13.786	UNSAT TT=91.35	UNSAT TT=48.707	UNSAT TT=53.973
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-23-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=41.676	UNSAT TT=76.334	UNSAT TT=19.222	UNSAT TT=19.059	UNSAT TT=0.215	UNSAT TT=50.415	UNSAT TT=165.208
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-23-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=24.225	UNSAT TT=111.613	No data	No data	UNSAT TT=34.648	UNSAT TT=47.824	UNSAT TT=24.225	UNSAT TT=24.763	UNSAT TT=160.701	UNSAT TT=41.23	UNSAT TT=166.282
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-23-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=21.046	UNSAT TT=23.964	UNSAT TT=9.487	UNSAT TT=9.589	UNSAT TT=0.214	UNSAT TT=19.141	UNSAT TT=55.912
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-23-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=7.118	UNSAT TT=58.038	No data	No data	UNSAT TT=21.361	UNSAT TT=7.118	UNSAT TT=8.759	UNSAT TT=8.767	UNSAT TT=52.175	UNSAT TT=16.401	UNSAT TT=104.342
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-24-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=9.314	UNSAT TT=105.442	No data	No data	UNSAT TT=27.67	UNSAT TT=34.616	UNSAT TT=9.314	UNSAT TT=9.317	UNSAT TT=60.184	UNSAT TT=22.902	UNSAT TT=68.621
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-24-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=30.19	UNSAT TT=21.933	UNSAT TT=6.22	UNSAT TT=6.237	UNSAT TT=0.225	UNSAT TT=26.35	UNSAT TT=143.422
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-24-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=10.084	UNSAT TT=97.751	No data	No data	UNSAT TT=62.302	UNSAT TT=16.06	UNSAT TT=10.197	UNSAT TT=10.084	UNSAT TT=52.966	UNSAT TT=53.99	UNSAT TT=168.975
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-24-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.012	No data	No data	UNSAT TT=22.735	UNSAT TT=24.418	UNSAT TT=4.738	UNSAT TT=4.743	UNSAT TT=0.225	UNSAT TT=23.201	UNSAT TT=70.275
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-24-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.716	UNSAT TT=88.435	No data	No data	UNSAT TT=20.924	UNSAT TT=9.144	UNSAT TT=6.751	UNSAT TT=6.716	UNSAT TT=62.345	UNSAT TT=88.271	UNSAT TT=72.294
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-25-1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.013	No data	No data	UNSAT TT=40.746	UNSAT TT=7.589	UNSAT TT=5.581	UNSAT TT=5.586	UNSAT TT=0.225	UNSAT TT=23.072	UNSAT TT=115.289
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-25-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.835	UNSAT TT=55.003	No data	No data	UNSAT TT=26.367	UNSAT TT=7.482	UNSAT TT=6.835	UNSAT TT=6.843	UNSAT TT=55.456	UNSAT TT=20.29	UNSAT TT=52.974
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-25-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=109.931	UNSAT TT=91.857	UNSAT TT=47.336	UNSAT TT=46.853	UNSAT TT=0.235	UNSAT TT=170.87	UNSAT TT=402.893
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-25-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=85.837	UNSAT TT=500.948	No data	No data	UNSAT TT=85.837	UNSAT TT=125.021	UNSAT TT=111.939	UNSAT TT=111.828	UNSAT TT=293.041	UNSAT TT=192.2	UNSAT TT=344.022
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-25-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=19.397	UNSAT TT=6.741	UNSAT TT=5.165	UNSAT TT=5.164	UNSAT TT=0.214	UNSAT TT=25.791	UNSAT TT=76.337
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-25-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=4.915	UNSAT TT=41.301	No data	No data	UNSAT TT=18.224	UNSAT TT=10.404	UNSAT TT=4.915	UNSAT TT=5.023	UNSAT TT=33.399	UNSAT TT=14.764	UNSAT TT=71.822
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-26-1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=109.834	UNSAT TT=79.514	UNSAT TT=85.46	UNSAT TT=85.056	UNSAT TT=0.224	UNSAT TT=146.83	UNSAT TT=364.22
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-26-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=65.804	UNSAT TT=320.803	No data	No data	UNSAT TT=142.175	UNSAT TT=65.804	UNSAT TT=102.969	UNSAT TT=103.24	UNSAT TT=562.279	UNSAT TT=91.789	UNSAT TT=267.875
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-26-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=144.813	UNSAT TT=27.828	UNSAT TT=13.132	UNSAT TT=13.233	UNSAT TT=0.225	UNSAT TT=62.7	UNSAT TT=297.977
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-26-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=12.517	UNSAT TT=271.198	No data	No data	UNSAT TT=63.948	UNSAT TT=38.842	UNSAT TT=12.651	UNSAT TT=12.517	UNSAT TT=128.584	UNSAT TT=88.42	UNSAT TT=239.987
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-26-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=62.412	UNSAT TT=74.758	UNSAT TT=19.294	UNSAT TT=19.661	UNSAT TT=0.253	UNSAT TT=103.918	UNSAT TT=162.691
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-27-1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=176.802	UNSAT TT=187.453	UNSAT TT=46.259	UNSAT TT=46.087	UNSAT TT=0.233	UNSAT TT=196.025	UNSAT TT=372.504
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-27-1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=80.522	UNSAT TT=485.95	No data	No data	UNSAT TT=117.113	UNSAT TT=162.578	UNSAT TT=80.66	UNSAT TT=80.522	UNSAT TT=277.152	UNSAT TT=336.253	UNSAT TT=376.608
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-27-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=308.663	UNSAT TT=529.29	UNSAT TT=197.325	UNSAT TT=193.847	UNSAT TT=0.225	UNSAT TT=181.897	UNSAT TT=822.91
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-27-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=95.187	UNSAT TT=800.856	No data	No data	UNSAT TT=230.477	UNSAT TT=281.668	UNSAT TT=95.187	UNSAT TT=96.476	UNSAT TT=698.038	UNSAT TT=404.62	UNSAT TT=768.362
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-27-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=69.604	UNSAT TT=170.848	UNSAT TT=37.158	UNSAT TT=37.334	UNSAT TT=0.223	UNSAT TT=76.373	UNSAT TT=319.598
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-27-3.cnf.gz-plain.pb.metafix.opb	UNSAT TT=38.67	UNSAT TT=454.783	No data	No data	UNSAT TT=67.055	UNSAT TT=245.775	UNSAT TT=38.67	UNSAT TT=40.371	UNSAT TT=329.876	UNSAT TT=96.7	UNSAT TT=218.047
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-28-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=157.427	UNSAT TT=276.575	UNSAT TT=52.705	UNSAT TT=56.32	UNSAT TT=0.224	UNSAT TT=203.83	UNSAT TT=348.612
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-28-2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=113.947	UNSAT TT=869.707	No data	No data	UNSAT TT=148.227	UNSAT TT=258.289	UNSAT TT=114.221	UNSAT TT=113.947	UNSAT TT=286.171	UNSAT TT=248.515	UNSAT TT=632.523
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-28-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=847.818	? (TO) TT=1800.02	UNSAT TT=195.583	UNSAT TT=198.086	UNSAT TT=0.227	? (TO) TT=1800.03	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-29-1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=680.465	UNSAT TT=681.48	UNSAT TT=0.233	? (TO) TT=1800.83	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-29-3.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=577.389	UNSAT TT=583.583	UNSAT TT=0.255	? (TO) TT=1800.08	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-30-2.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.011	UNSAT TT=0.011	No data	No data	UNSAT TT=868.76	UNSAT TT=352.583	UNSAT TT=167.88	UNSAT TT=169.408	UNSAT TT=0.225	UNSAT TT=467.973	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-subsetCardinalitySigma-31-1.cnf.gz-extracted.pb.metafix.opb	UNSAT TT=0.01	UNSAT TT=0.01	No data	No data	UNSAT TT=789.938	? (TO) TT=1800.02	UNSAT TT=324.475	UNSAT TT=326.484	UNSAT TT=0.234	? (TO) TT=1800.06	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n36-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.012	UNSAT TT=0.064	No data	No data	UNSAT TT=0.16	UNSAT TT=0.037	UNSAT TT=0.013	UNSAT TT=0.012	UNSAT TT=2.514	UNSAT TT=147.92	UNSAT TT=0.886
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.018	UNSAT TT=0.09	No data	No data	UNSAT TT=0.043	UNSAT TT=0.019	UNSAT TT=0.018	UNSAT TT=0.019	UNSAT TT=1.135	UNSAT TT=0.563	UNSAT TT=0.294
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.018	UNSAT TT=0.086	No data	No data	UNSAT TT=0.043	UNSAT TT=0.018	UNSAT TT=0.018	UNSAT TT=0.018	UNSAT TT=1.073	UNSAT TT=0.573	UNSAT TT=0.422
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.033	UNSAT TT=0.05	No data	No data	UNSAT TT=0.277	UNSAT TT=0.033	UNSAT TT=0.033	UNSAT TT=0.033	UNSAT TT=1.795	UNSAT TT=5.413	UNSAT TT=0.945
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.028	UNSAT TT=0.062	No data	No data	UNSAT TT=0.19	UNSAT TT=0.032	UNSAT TT=0.03	UNSAT TT=0.028	UNSAT TT=2.634	UNSAT TT=2.735	UNSAT TT=0.667
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.044	UNSAT TT=0.044	No data	No data	UNSAT TT=0.116	UNSAT TT=0.069	UNSAT TT=0.084	UNSAT TT=0.086	UNSAT TT=2.484	UNSAT TT=1.104	UNSAT TT=0.673
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.044	UNSAT TT=0.044	No data	No data	UNSAT TT=0.115	UNSAT TT=0.068	UNSAT TT=0.085	UNSAT TT=0.084	UNSAT TT=2.404	UNSAT TT=1.103	UNSAT TT=0.777
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n38-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.045	UNSAT TT=0.045	No data	No data	UNSAT TT=0.115	UNSAT TT=0.068	UNSAT TT=0.084	UNSAT TT=0.085	UNSAT TT=2.425	UNSAT TT=1.106	UNSAT TT=0.751
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.026	UNSAT TT=0.075	No data	No data	UNSAT TT=0.145	UNSAT TT=0.028	UNSAT TT=0.026	UNSAT TT=0.027	UNSAT TT=1.573	UNSAT TT=0.926	UNSAT TT=0.253
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.024	UNSAT TT=0.036	No data	No data	UNSAT TT=0.182	UNSAT TT=0.024	UNSAT TT=0.026	UNSAT TT=0.027	UNSAT TT=1.575	UNSAT TT=0.934	UNSAT TT=0.339
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.047	UNSAT TT=0.278	No data	No data	UNSAT TT=0.204	UNSAT TT=0.056	UNSAT TT=0.047	UNSAT TT=0.051	UNSAT TT=1.613	UNSAT TT=0.685	UNSAT TT=1.095
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.056	UNSAT TT=0.086	No data	No data	UNSAT TT=0.205	UNSAT TT=0.056	UNSAT TT=0.066	UNSAT TT=0.066	UNSAT TT=2.774	UNSAT TT=1.735	UNSAT TT=1.063
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.05	UNSAT TT=0.072	No data	No data	UNSAT TT=0.097	UNSAT TT=0.05	UNSAT TT=0.062	UNSAT TT=0.071	UNSAT TT=2.763	UNSAT TT=1.675	UNSAT TT=0.774
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.076	UNSAT TT=0.245	No data	No data	UNSAT TT=0.076	UNSAT TT=0.078	UNSAT TT=0.085	UNSAT TT=0.087	UNSAT TT=2.993	UNSAT TT=2.562	UNSAT TT=0.592
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.078	UNSAT TT=0.13	No data	No data	UNSAT TT=0.12	UNSAT TT=0.078	UNSAT TT=0.112	UNSAT TT=0.113	UNSAT TT=2.663	UNSAT TT=9.784	UNSAT TT=1.809
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n40-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.078	UNSAT TT=0.14	No data	No data	UNSAT TT=0.119	UNSAT TT=0.078	UNSAT TT=0.085	UNSAT TT=0.084	UNSAT TT=2.854	UNSAT TT=2.515	UNSAT TT=1.042
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.058	UNSAT TT=0.072	No data	No data	UNSAT TT=0.108	UNSAT TT=0.064	UNSAT TT=0.06	UNSAT TT=0.058	UNSAT TT=2.914	UNSAT TT=1.113	UNSAT TT=1.119
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.052	UNSAT TT=0.052	No data	No data	UNSAT TT=0.109	UNSAT TT=0.064	UNSAT TT=0.058	UNSAT TT=0.058	UNSAT TT=2.294	UNSAT TT=1.083	UNSAT TT=0.532
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.048	UNSAT TT=0.073	No data	No data	UNSAT TT=0.109	UNSAT TT=0.07	UNSAT TT=0.048	UNSAT TT=0.049	UNSAT TT=1.684	UNSAT TT=1.043	UNSAT TT=0.904
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.053	No data	No data	UNSAT TT=0.101	UNSAT TT=0.049	UNSAT TT=0.013	UNSAT TT=0.014	UNSAT TT=1.092	UNSAT TT=0.504	UNSAT TT=0.369
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.015	UNSAT TT=0.04	No data	No data	UNSAT TT=0.13	UNSAT TT=0.048	UNSAT TT=0.015	UNSAT TT=0.015	UNSAT TT=1.123	UNSAT TT=0.535	UNSAT TT=0.35
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.015	UNSAT TT=0.042	No data	No data	UNSAT TT=0.135	UNSAT TT=0.049	UNSAT TT=0.015	UNSAT TT=0.015	UNSAT TT=1.104	UNSAT TT=0.534	UNSAT TT=0.393
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.02	UNSAT TT=0.025	No data	No data	UNSAT TT=0.107	UNSAT TT=0.037	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=2.074	UNSAT TT=1.054	UNSAT TT=0.719
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n42-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.024	UNSAT TT=0.024	No data	No data	UNSAT TT=0.126	UNSAT TT=0.034	UNSAT TT=0.027	UNSAT TT=0.027	UNSAT TT=2.124	UNSAT TT=1.074	UNSAT TT=0.599
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.019	UNSAT TT=0.041	No data	No data	UNSAT TT=0.044	UNSAT TT=0.019	UNSAT TT=0.025	UNSAT TT=0.02	UNSAT TT=1.964	UNSAT TT=4.752	UNSAT TT=0.39
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.013	UNSAT TT=0.057	No data	No data	UNSAT TT=0.088	UNSAT TT=0.013	UNSAT TT=0.02	UNSAT TT=0.02	UNSAT TT=1.684	UNSAT TT=2.453	UNSAT TT=0.673
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.014	UNSAT TT=0.036	No data	No data	UNSAT TT=0.242	UNSAT TT=0.014	UNSAT TT=0.022	UNSAT TT=0.023	UNSAT TT=2.184	UNSAT TT=8.473	UNSAT TT=0.295
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.015	UNSAT TT=0.036	No data	No data	UNSAT TT=0.173	UNSAT TT=0.015	UNSAT TT=0.025	UNSAT TT=0.026	UNSAT TT=2.845	UNSAT TT=4.293	UNSAT TT=0.36
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.047	UNSAT TT=0.065	No data	No data	UNSAT TT=0.295	UNSAT TT=0.07	UNSAT TT=0.047	UNSAT TT=0.047	UNSAT TT=2.813	UNSAT TT=1.524	UNSAT TT=0.785
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.047	UNSAT TT=0.058	No data	No data	UNSAT TT=0.26	UNSAT TT=0.078	UNSAT TT=0.047	UNSAT TT=0.047	UNSAT TT=2.954	UNSAT TT=1.523	UNSAT TT=1.272
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n44-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.048	UNSAT TT=0.058	No data	No data	UNSAT TT=0.295	UNSAT TT=0.078	UNSAT TT=0.048	UNSAT TT=0.048	UNSAT TT=2.664	UNSAT TT=1.504	UNSAT TT=0.543
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.158	UNSAT TT=0.158	No data	No data	UNSAT TT=0.716	UNSAT TT=0.529	UNSAT TT=0.224	UNSAT TT=0.225	UNSAT TT=3.205	UNSAT TT=12.972	UNSAT TT=2.755
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.275	UNSAT TT=0.31	No data	No data	UNSAT TT=0.666	UNSAT TT=0.324	UNSAT TT=0.275	UNSAT TT=0.275	UNSAT TT=3.134	UNSAT TT=6.725	UNSAT TT=2.213
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.245	UNSAT TT=0.245	No data	No data	UNSAT TT=0.669	UNSAT TT=0.323	UNSAT TT=0.274	UNSAT TT=0.275	UNSAT TT=3.552	UNSAT TT=7.114	UNSAT TT=2.962
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.048	UNSAT TT=0.068	No data	No data	UNSAT TT=0.283	UNSAT TT=0.057	UNSAT TT=0.048	UNSAT TT=0.053	UNSAT TT=1.314	UNSAT TT=1.165	UNSAT TT=0.731
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.056	UNSAT TT=0.069	No data	No data	UNSAT TT=0.124	UNSAT TT=0.056	UNSAT TT=0.061	UNSAT TT=0.062	UNSAT TT=1.695	UNSAT TT=1.695	UNSAT TT=0.755
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.046	UNSAT TT=0.08	No data	No data	UNSAT TT=0.454	UNSAT TT=0.07	UNSAT TT=0.046	UNSAT TT=0.048	UNSAT TT=2.113	UNSAT TT=0.706	UNSAT TT=1.114
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.064	UNSAT TT=0.065	No data	No data	UNSAT TT=0.454	UNSAT TT=0.07	UNSAT TT=0.065	UNSAT TT=0.064	UNSAT TT=2.135	UNSAT TT=1.205	UNSAT TT=0.84
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n46-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.047	UNSAT TT=0.063	No data	No data	UNSAT TT=0.454	UNSAT TT=0.072	UNSAT TT=0.047	UNSAT TT=0.047	UNSAT TT=2.843	UNSAT TT=0.694	UNSAT TT=1.173
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.035	UNSAT TT=0.062	No data	No data	UNSAT TT=0.608	UNSAT TT=0.035	UNSAT TT=0.072	UNSAT TT=0.073	UNSAT TT=3.792	UNSAT TT=1283.27	UNSAT TT=1.351
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.039	UNSAT TT=0.077	No data	No data	UNSAT TT=0.617	UNSAT TT=0.039	UNSAT TT=0.074	UNSAT TT=0.073	UNSAT TT=3.054	UNSAT TT=1253.77	UNSAT TT=1.236
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.037	UNSAT TT=0.08	No data	No data	UNSAT TT=0.609	UNSAT TT=0.037	UNSAT TT=0.067	UNSAT TT=0.062	UNSAT TT=3.323	UNSAT TT=1257.39	UNSAT TT=1.587
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.163	UNSAT TT=0.401	No data	No data	UNSAT TT=1.619	UNSAT TT=0.41	UNSAT TT=0.163	UNSAT TT=0.165	UNSAT TT=5.003	UNSAT TT=293.58	UNSAT TT=5.065
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.149	UNSAT TT=0.65	No data	No data	UNSAT TT=1.548	UNSAT TT=0.216	UNSAT TT=0.149	UNSAT TT=0.151	UNSAT TT=5.233	UNSAT TT=18.602	UNSAT TT=3.402
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.149	UNSAT TT=0.496	No data	No data	UNSAT TT=1.549	UNSAT TT=0.217	UNSAT TT=0.149	UNSAT TT=0.16	UNSAT TT=7.523	UNSAT TT=17.824	UNSAT TT=3.389
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.152	UNSAT TT=0.163	No data	No data	UNSAT TT=1.429	UNSAT TT=0.152	UNSAT TT=0.248	UNSAT TT=0.248	UNSAT TT=3.064	UNSAT TT=1.152	UNSAT TT=3.255
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n48-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.151	UNSAT TT=0.173	No data	No data	UNSAT TT=1.434	UNSAT TT=0.151	UNSAT TT=0.249	UNSAT TT=0.249	UNSAT TT=3.093	UNSAT TT=1.153	UNSAT TT=2.55
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.058	UNSAT TT=0.397	No data	No data	UNSAT TT=0.472	UNSAT TT=0.203	UNSAT TT=0.058	UNSAT TT=0.059	UNSAT TT=2.684	UNSAT TT=1.224	UNSAT TT=1.905
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.08	UNSAT TT=0.167	No data	No data	UNSAT TT=0.643	UNSAT TT=0.107	UNSAT TT=0.081	UNSAT TT=0.08	UNSAT TT=2.824	UNSAT TT=1.516	UNSAT TT=2.384
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.079	UNSAT TT=0.382	No data	No data	UNSAT TT=0.649	UNSAT TT=0.11	UNSAT TT=0.081	UNSAT TT=0.079	UNSAT TT=3.005	UNSAT TT=1.545	UNSAT TT=1.83
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.037	UNSAT TT=0.144	No data	No data	UNSAT TT=0.675	UNSAT TT=0.037	UNSAT TT=0.064	UNSAT TT=0.065	UNSAT TT=2.034	UNSAT TT=15.791	UNSAT TT=1.051
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.064	UNSAT TT=0.111	No data	No data	UNSAT TT=0.774	UNSAT TT=0.087	UNSAT TT=0.064	UNSAT TT=0.064	UNSAT TT=2.055	UNSAT TT=15.652	UNSAT TT=1.966
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.037	UNSAT TT=0.3	No data	No data	UNSAT TT=0.68	UNSAT TT=0.037	UNSAT TT=0.063	UNSAT TT=0.065	UNSAT TT=2.934	UNSAT TT=15.982	UNSAT TT=1.146
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n50-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.047	UNSAT TT=0.054	No data	No data	UNSAT TT=0.304	UNSAT TT=0.073	UNSAT TT=0.047	UNSAT TT=0.047	UNSAT TT=3.243	UNSAT TT=0.995	UNSAT TT=1.096
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.199	UNSAT TT=0.501	No data	No data	UNSAT TT=0.853	UNSAT TT=0.418	UNSAT TT=0.199	UNSAT TT=0.199	UNSAT TT=2.334	UNSAT TT=5.382	UNSAT TT=3.482
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.169	UNSAT TT=0.169	No data	No data	UNSAT TT=0.719	UNSAT TT=0.331	UNSAT TT=0.175	UNSAT TT=0.177	UNSAT TT=2.074	UNSAT TT=5.453	UNSAT TT=1.545
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.169	UNSAT TT=0.169	No data	No data	UNSAT TT=0.719	UNSAT TT=0.331	UNSAT TT=0.176	UNSAT TT=0.178	UNSAT TT=2.424	UNSAT TT=5.702	UNSAT TT=3.792
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.423	UNSAT TT=6.214	No data	No data	UNSAT TT=7.774	UNSAT TT=0.423	UNSAT TT=0.54	UNSAT TT=0.539	UNSAT TT=7.933	UNSAT TT=11.4	UNSAT TT=8.938
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.208	UNSAT TT=1.493	No data	No data	UNSAT TT=3.841	UNSAT TT=0.208	UNSAT TT=0.474	UNSAT TT=0.473	UNSAT TT=10.053	UNSAT TT=10.802	UNSAT TT=10.561
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.207	UNSAT TT=1.256	No data	No data	UNSAT TT=3.866	UNSAT TT=0.207	UNSAT TT=0.477	UNSAT TT=0.475	UNSAT TT=13.072	UNSAT TT=11.232	UNSAT TT=12.245
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.038	UNSAT TT=0.12	No data	No data	UNSAT TT=0.679	UNSAT TT=0.061	UNSAT TT=0.038	UNSAT TT=0.039	UNSAT TT=1.774	UNSAT TT=4.703	UNSAT TT=1.21
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.028	UNSAT TT=0.061	No data	No data	UNSAT TT=0.555	UNSAT TT=0.079	UNSAT TT=0.028	UNSAT TT=0.028	UNSAT TT=1.273	UNSAT TT=0.634	UNSAT TT=1.21
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n52-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.04	UNSAT TT=0.089	No data	No data	UNSAT TT=0.806	UNSAT TT=0.143	UNSAT TT=0.04	UNSAT TT=0.04	UNSAT TT=1.724	UNSAT TT=4.713	UNSAT TT=1.146
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n54-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.284	UNSAT TT=0.384	No data	No data	UNSAT TT=2.758	UNSAT TT=1.22	UNSAT TT=0.284	UNSAT TT=0.284	UNSAT TT=11.001	UNSAT TT=150.91	UNSAT TT=4.663
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n54-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.008	UNSAT TT=0.065	No data	No data	UNSAT TT=0.088	UNSAT TT=0.019	UNSAT TT=0.009	UNSAT TT=0.008	UNSAT TT=1.723	UNSAT TT=6.982	UNSAT TT=0.346
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n54-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.024	UNSAT TT=0.06	No data	No data	UNSAT TT=0.06	UNSAT TT=0.024	UNSAT TT=0.025	UNSAT TT=0.024	UNSAT TT=1.207	UNSAT TT=0.614	UNSAT TT=0.5
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n54-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.008	UNSAT TT=0.061	No data	No data	UNSAT TT=0.085	UNSAT TT=0.025	UNSAT TT=0.009	UNSAT TT=0.008	UNSAT TT=1.434	UNSAT TT=7.093	UNSAT TT=0.307
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n54-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.188	UNSAT TT=0.241	No data	No data	UNSAT TT=1.588	UNSAT TT=0.188	UNSAT TT=0.221	UNSAT TT=0.234	UNSAT TT=3.043	UNSAT TT=1.216	UNSAT TT=2.821
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.494	UNSAT TT=1.048	No data	No data	UNSAT TT=5.584	UNSAT TT=0.494	UNSAT TT=0.721	UNSAT TT=0.723	UNSAT TT=6.374	UNSAT TT=14.67	UNSAT TT=10.122
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.493	UNSAT TT=1	No data	No data	UNSAT TT=9.677	UNSAT TT=0.493	UNSAT TT=0.722	UNSAT TT=0.723	UNSAT TT=7.243	UNSAT TT=14.742	UNSAT TT=8.569
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.37	UNSAT TT=1.084	No data	No data	UNSAT TT=3.727	UNSAT TT=0.712	UNSAT TT=0.37	UNSAT TT=0.371	UNSAT TT=6.242	UNSAT TT=11.422	UNSAT TT=8.993
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.322	UNSAT TT=0.466	No data	No data	UNSAT TT=1.991	UNSAT TT=1.852	UNSAT TT=0.323	UNSAT TT=0.322	UNSAT TT=4	UNSAT TT=5.083	UNSAT TT=7.944
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.31	UNSAT TT=0.465	No data	No data	UNSAT TT=4.532	UNSAT TT=0.998	UNSAT TT=0.31	UNSAT TT=0.311	UNSAT TT=4.874	UNSAT TT=22.18	UNSAT TT=4.796
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.336	UNSAT TT=2.569	No data	No data	UNSAT TT=8.108	UNSAT TT=5.101	UNSAT TT=0.336	UNSAT TT=0.336	UNSAT TT=5.623	UNSAT TT=124.35	UNSAT TT=9.743
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n56-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.455	UNSAT TT=0.99	No data	No data	UNSAT TT=3.678	UNSAT TT=5.056	UNSAT TT=0.455	UNSAT TT=0.456	UNSAT TT=5.644	UNSAT TT=132.15	UNSAT TT=6.879
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.099	UNSAT TT=0.608	No data	No data	UNSAT TT=0.854	UNSAT TT=0.412	UNSAT TT=0.099	UNSAT TT=0.099	UNSAT TT=4.951	UNSAT TT=4.204	UNSAT TT=5.354
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.11	UNSAT TT=0.311	No data	No data	UNSAT TT=0.859	UNSAT TT=0.412	UNSAT TT=0.11	UNSAT TT=0.11	UNSAT TT=3.314	UNSAT TT=4.023	UNSAT TT=5.192
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.368	UNSAT TT=0.368	No data	No data	UNSAT TT=3.578	UNSAT TT=0.486	UNSAT TT=0.521	UNSAT TT=0.523	UNSAT TT=4.053	UNSAT TT=4.063	UNSAT TT=7.17
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.163	UNSAT TT=2.145	No data	No data	UNSAT TT=9.767	UNSAT TT=1.452	UNSAT TT=1.163	UNSAT TT=1.168	UNSAT TT=8.484	UNSAT TT=8.573	UNSAT TT=21.796
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.061	UNSAT TT=5.303	No data	No data	UNSAT TT=8.309	UNSAT TT=1.358	UNSAT TT=1.061	UNSAT TT=1.129	UNSAT TT=8.783	UNSAT TT=8.673	UNSAT TT=14.865
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.206	UNSAT TT=0.373	No data	No data	UNSAT TT=1.786	UNSAT TT=0.206	UNSAT TT=0.359	UNSAT TT=0.36	UNSAT TT=11.021	UNSAT TT=13.553	UNSAT TT=4.428
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n58-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.124	UNSAT TT=0.489	No data	No data	UNSAT TT=1.774	UNSAT TT=0.206	UNSAT TT=0.124	UNSAT TT=0.124	UNSAT TT=6.084	UNSAT TT=106.001	UNSAT TT=5.985
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.164	UNSAT TT=0.164	No data	No data	UNSAT TT=1.626	UNSAT TT=0.269	UNSAT TT=0.233	UNSAT TT=0.232	UNSAT TT=5.823	UNSAT TT=7.813	UNSAT TT=2.49
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.151	UNSAT TT=0.151	No data	No data	UNSAT TT=1.563	UNSAT TT=0.242	UNSAT TT=0.215	UNSAT TT=0.217	UNSAT TT=6.482	UNSAT TT=16.82	UNSAT TT=3.37
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.333	UNSAT TT=0.849	No data	No data	UNSAT TT=4.175	UNSAT TT=0.333	UNSAT TT=0.668	UNSAT TT=0.667	UNSAT TT=6.99	UNSAT TT=399.833	UNSAT TT=17.721
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.331	UNSAT TT=0.687	No data	No data	UNSAT TT=3.679	UNSAT TT=0.331	UNSAT TT=0.668	UNSAT TT=0.668	UNSAT TT=6.132	UNSAT TT=384.526	UNSAT TT=4.705
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.297	UNSAT TT=0.297	No data	No data	UNSAT TT=3.69	UNSAT TT=0.332	UNSAT TT=0.669	UNSAT TT=0.681	UNSAT TT=8.854	UNSAT TT=375.43	UNSAT TT=13.232
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.441	UNSAT TT=6.532	No data	No data	UNSAT TT=7.923	UNSAT TT=2.002	UNSAT TT=0.444	UNSAT TT=0.441	UNSAT TT=18.682	UNSAT TT=49.061	UNSAT TT=17.586
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n60-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.442	UNSAT TT=1.149	No data	No data	UNSAT TT=7.962	UNSAT TT=1.998	UNSAT TT=0.442	UNSAT TT=0.443	UNSAT TT=9.441	UNSAT TT=52.1	UNSAT TT=12.333
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n62-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.208	UNSAT TT=0.249	No data	No data	UNSAT TT=6.441	UNSAT TT=0.208	UNSAT TT=0.223	UNSAT TT=0.223	UNSAT TT=4.512	UNSAT TT=15.12	UNSAT TT=7.935
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n62-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.852	UNSAT TT=0.852	No data	No data	UNSAT TT=2.757	UNSAT TT=1.474	UNSAT TT=1.277	UNSAT TT=1.276	UNSAT TT=8.203	UNSAT TT=21.77	UNSAT TT=9.43
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n62-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.641	UNSAT TT=1.049	No data	No data	UNSAT TT=3.849	UNSAT TT=0.641	UNSAT TT=2.037	UNSAT TT=2.033	UNSAT TT=6.753	UNSAT TT=10.083	UNSAT TT=9.088
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n62-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.243	UNSAT TT=4.618	No data	No data	UNSAT TT=11.038	UNSAT TT=0.624	UNSAT TT=0.243	UNSAT TT=0.257	UNSAT TT=6.803	UNSAT TT=21.221	UNSAT TT=14.941
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n62-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.329	UNSAT TT=1.975	No data	No data	UNSAT TT=13.244	UNSAT TT=1.393	UNSAT TT=0.329	UNSAT TT=0.329	UNSAT TT=16.882	UNSAT TT=22.231	UNSAT TT=9.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n62-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.242	UNSAT TT=1.043	No data	No data	UNSAT TT=11.08	UNSAT TT=0.626	UNSAT TT=0.243	UNSAT TT=0.242	UNSAT TT=16.271	UNSAT TT=21.282	UNSAT TT=19.081
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.231	UNSAT TT=0.816	No data	No data	UNSAT TT=4.752	UNSAT TT=0.231	UNSAT TT=1.25	UNSAT TT=1.255	UNSAT TT=5.363	UNSAT TT=26.96	UNSAT TT=5.806
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.259	UNSAT TT=0.259	No data	No data	UNSAT TT=1.394	UNSAT TT=0.657	UNSAT TT=0.631	UNSAT TT=0.634	UNSAT TT=5.573	UNSAT TT=56.4	UNSAT TT=5.475
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.162	UNSAT TT=0.162	No data	No data	UNSAT TT=3.519	UNSAT TT=0.232	UNSAT TT=0.631	UNSAT TT=0.637	UNSAT TT=5.643	UNSAT TT=56.2	UNSAT TT=5.411
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.155	UNSAT TT=0.629	No data	No data	UNSAT TT=9.001	UNSAT TT=0.612	UNSAT TT=0.155	UNSAT TT=0.156	UNSAT TT=4.23	UNSAT TT=12.203	UNSAT TT=4.839
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.24	UNSAT TT=0.24	No data	No data	UNSAT TT=7.267	UNSAT TT=1.032	UNSAT TT=0.247	UNSAT TT=0.248	UNSAT TT=8.11	UNSAT TT=3.522	UNSAT TT=4.391
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.466	UNSAT TT=2.043	No data	No data	UNSAT TT=3.51	UNSAT TT=0.771	UNSAT TT=0.466	UNSAT TT=0.47	UNSAT TT=5.382	UNSAT TT=9.403	UNSAT TT=9.32
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n64-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.415	UNSAT TT=0.673	No data	No data	UNSAT TT=3.515	UNSAT TT=0.77	UNSAT TT=0.415	UNSAT TT=0.417	UNSAT TT=4.415	UNSAT TT=3.623	UNSAT TT=6.348
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n66-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.161	UNSAT TT=0.827	No data	No data	UNSAT TT=1.565	UNSAT TT=0.539	UNSAT TT=0.161	UNSAT TT=0.162	UNSAT TT=3.673	UNSAT TT=1.146	UNSAT TT=3.456
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n66-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.174	UNSAT TT=0.346	No data	No data	UNSAT TT=1.593	UNSAT TT=0.537	UNSAT TT=0.174	UNSAT TT=0.175	UNSAT TT=5.452	UNSAT TT=2.395	UNSAT TT=6.873
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n66-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.376	UNSAT TT=3.539	No data	No data	UNSAT TT=18.706	UNSAT TT=0.581	UNSAT TT=0.376	UNSAT TT=0.376	UNSAT TT=6.334	UNSAT TT=64.305	UNSAT TT=24.612
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n66-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.296	UNSAT TT=4.139	No data	No data	UNSAT TT=12.771	UNSAT TT=1.042	UNSAT TT=0.296	UNSAT TT=0.298	UNSAT TT=8.983	UNSAT TT=32.078	UNSAT TT=36.715
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n66-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.677	UNSAT TT=11.462	No data	No data	UNSAT TT=18.565	UNSAT TT=3.74	UNSAT TT=1.677	UNSAT TT=1.735	UNSAT TT=18.63	UNSAT TT=247.23	UNSAT TT=54.972
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n66-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.621	UNSAT TT=8.079	No data	No data	UNSAT TT=19.669	UNSAT TT=14.681	UNSAT TT=1.621	UNSAT TT=1.636	UNSAT TT=13.272	UNSAT TT=425.3	UNSAT TT=51.558
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.894	UNSAT TT=3.528	No data	No data	UNSAT TT=10.075	UNSAT TT=0.894	UNSAT TT=1.049	UNSAT TT=1.056	UNSAT TT=6.093	UNSAT TT=50.917	UNSAT TT=24.271
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.593	UNSAT TT=0.794	No data	No data	UNSAT TT=9.388	UNSAT TT=10.174	UNSAT TT=0.593	UNSAT TT=0.631	UNSAT TT=7.791	UNSAT TT=63.104	UNSAT TT=23.36
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.575	UNSAT TT=1.099	No data	No data	UNSAT TT=11.575	UNSAT TT=0.969	UNSAT TT=0.576	UNSAT TT=0.575	UNSAT TT=8.172	? (TO) TT=1800.04	UNSAT TT=37.682
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.617	UNSAT TT=2.801	No data	No data	UNSAT TT=15.739	UNSAT TT=3.149	UNSAT TT=0.617	UNSAT TT=0.617	UNSAT TT=12.083	UNSAT TT=97.75	UNSAT TT=29.276
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.02	UNSAT TT=1.805	No data	No data	UNSAT TT=20.492	UNSAT TT=1.207	UNSAT TT=1.02	UNSAT TT=1.022	UNSAT TT=7.144	? (TO) TT=1800.62	UNSAT TT=27.74
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.284	UNSAT TT=96.349	No data	No data	UNSAT TT=48.816	UNSAT TT=3.021	UNSAT TT=2.284	UNSAT TT=2.29	UNSAT TT=21.321	? (TO) TT=1800.09	UNSAT TT=53.299
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.291	UNSAT TT=346.326	No data	No data	UNSAT TT=48.932	UNSAT TT=3.036	UNSAT TT=2.291	UNSAT TT=2.292	UNSAT TT=22.02	? (TO) TT=1800.75	UNSAT TT=58.701
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n68-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.259	UNSAT TT=18.091	No data	No data	UNSAT TT=51.738	UNSAT TT=3.031	UNSAT TT=2.259	UNSAT TT=2.261	UNSAT TT=22.082	? (TO) TT=1800.02	UNSAT TT=54.251
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.503	UNSAT TT=1.532	No data	No data	UNSAT TT=24.301	UNSAT TT=1.899	UNSAT TT=0.503	UNSAT TT=0.504	UNSAT TT=15.303	? (TO) TT=1800.67	UNSAT TT=36.448
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.476	UNSAT TT=0.476	No data	No data	UNSAT TT=24.495	UNSAT TT=1.905	UNSAT TT=0.503	UNSAT TT=0.502	UNSAT TT=4.812	? (TO) TT=1800	UNSAT TT=19.212
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.481	UNSAT TT=0.481	No data	No data	UNSAT TT=24.29	UNSAT TT=1.896	UNSAT TT=0.502	UNSAT TT=0.504	UNSAT TT=9.262	? (TO) TT=1800.45	UNSAT TT=14.661
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.554	UNSAT TT=2.641	No data	No data	UNSAT TT=39.031	UNSAT TT=1.554	UNSAT TT=2.793	UNSAT TT=2.784	UNSAT TT=18.291	UNSAT TT=20.1	UNSAT TT=14.822
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.589	UNSAT TT=2.845	No data	No data	UNSAT TT=39.131	UNSAT TT=1.589	UNSAT TT=2.776	UNSAT TT=2.78	UNSAT TT=11.323	UNSAT TT=20.931	UNSAT TT=49.505
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.06	UNSAT TT=1.06	No data	No data	UNSAT TT=39.369	UNSAT TT=1.556	UNSAT TT=2.78	UNSAT TT=2.939	UNSAT TT=10.722	UNSAT TT=20.121	UNSAT TT=58.903
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.223	UNSAT TT=0.739	No data	No data	UNSAT TT=3.844	UNSAT TT=0.336	UNSAT TT=0.223	UNSAT TT=0.223	UNSAT TT=4.452	UNSAT TT=44.84	UNSAT TT=5.266
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.224	UNSAT TT=0.878	No data	No data	UNSAT TT=3.855	UNSAT TT=0.334	UNSAT TT=0.224	UNSAT TT=0.224	UNSAT TT=29.71	UNSAT TT=45.4	UNSAT TT=6.207
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n70-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.281	UNSAT TT=2.88	No data	No data	UNSAT TT=3.583	UNSAT TT=0.335	UNSAT TT=0.281	UNSAT TT=0.283	UNSAT TT=5.01	UNSAT TT=96.8	UNSAT TT=5.2
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.895	UNSAT TT=2.523	No data	No data	UNSAT TT=26.588	UNSAT TT=4.078	UNSAT TT=0.895	UNSAT TT=0.9	UNSAT TT=8.703	UNSAT TT=55.286	UNSAT TT=26.461
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.894	UNSAT TT=3.608	No data	No data	UNSAT TT=25.26	UNSAT TT=4.088	UNSAT TT=0.894	UNSAT TT=0.898	UNSAT TT=19.651	UNSAT TT=57.435	UNSAT TT=19.445
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.896	UNSAT TT=34.425	No data	No data	UNSAT TT=28.036	UNSAT TT=4.132	UNSAT TT=0.896	UNSAT TT=0.897	UNSAT TT=19.289	UNSAT TT=54.236	UNSAT TT=46.864
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.091	UNSAT TT=18.933	No data	No data	UNSAT TT=73.182	UNSAT TT=5.714	UNSAT TT=3.091	UNSAT TT=3.103	UNSAT TT=43.437	UNSAT TT=48.016	UNSAT TT=153.677
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.099	UNSAT TT=17.369	No data	No data	UNSAT TT=79.286	UNSAT TT=5.723	UNSAT TT=3.101	UNSAT TT=3.099	UNSAT TT=16.182	UNSAT TT=46.77	UNSAT TT=92.984
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.458	UNSAT TT=1.458	No data	No data	UNSAT TT=7.58	UNSAT TT=2.738	UNSAT TT=2.217	UNSAT TT=2.224	UNSAT TT=6.752	UNSAT TT=7.663	UNSAT TT=13.414
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n72-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.193	UNSAT TT=1.193	No data	No data	UNSAT TT=10.547	UNSAT TT=2.376	UNSAT TT=1.801	UNSAT TT=1.8	UNSAT TT=6.722	UNSAT TT=6.151	UNSAT TT=13.345
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.911	UNSAT TT=7.134	No data	No data	UNSAT TT=19.397	UNSAT TT=38.968	UNSAT TT=0.911	UNSAT TT=0.912	UNSAT TT=23.072	UNSAT TT=164.74	UNSAT TT=28.035
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.491	UNSAT TT=16.921	No data	No data	UNSAT TT=20.828	UNSAT TT=21.993	UNSAT TT=1.491	UNSAT TT=1.491	UNSAT TT=11.583	UNSAT TT=300.008	UNSAT TT=38.62
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.88	UNSAT TT=10.187	No data	No data	UNSAT TT=18.103	UNSAT TT=20.453	UNSAT TT=0.88	UNSAT TT=0.881	UNSAT TT=19.501	UNSAT TT=256.4	UNSAT TT=16.651
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.381	UNSAT TT=51.191	No data	No data	UNSAT TT=244.614	UNSAT TT=13.386	UNSAT TT=5.441	UNSAT TT=5.381	UNSAT TT=80.923	UNSAT TT=379.39	UNSAT TT=193.538
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.418	UNSAT TT=34.608	No data	No data	UNSAT TT=65.852	UNSAT TT=3.732	UNSAT TT=1.424	UNSAT TT=1.418	UNSAT TT=33.929	UNSAT TT=200.18	UNSAT TT=51.852
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.684	UNSAT TT=20.903	No data	No data	UNSAT TT=48.197	UNSAT TT=2.481	UNSAT TT=0.685	UNSAT TT=0.684	UNSAT TT=36.868	UNSAT TT=1690.09	UNSAT TT=86.637
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n74-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.854	UNSAT TT=16.546	No data	No data	UNSAT TT=48.579	UNSAT TT=2.486	UNSAT TT=0.858	UNSAT TT=0.854	UNSAT TT=16.542	UNSAT TT=10.223	UNSAT TT=75.522
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=4.643	UNSAT TT=124.132	No data	No data	UNSAT TT=292.618	UNSAT TT=24.114	UNSAT TT=4.659	UNSAT TT=4.643	UNSAT TT=37.629	UNSAT TT=150.341	UNSAT TT=316.185
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.352	UNSAT TT=37.724	No data	No data	UNSAT TT=293.48	UNSAT TT=24.104	UNSAT TT=6.352	UNSAT TT=6.386	UNSAT TT=52.438	UNSAT TT=187.03	UNSAT TT=392.639
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=39.109	UNSAT TT=56.022	No data	No data	UNSAT TT=647.351	UNSAT TT=90.681	UNSAT TT=39.121	UNSAT TT=39.109	UNSAT TT=587.424	UNSAT TT=1278.19	UNSAT TT=820.041
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=21.188	UNSAT TT=235.284	No data	No data	UNSAT TT=591.232	UNSAT TT=368.385	UNSAT TT=21.188	UNSAT TT=21.395	UNSAT TT=382.875	? (TO) TT=1800.09	UNSAT TT=1046.03
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.153	UNSAT TT=58.851	No data	No data	UNSAT TT=649.482	UNSAT TT=989.618	UNSAT TT=5.153	UNSAT TT=5.178	UNSAT TT=969.186	UNSAT TT=1167.9	UNSAT TT=691.625
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.509	UNSAT TT=5.053	No data	No data	UNSAT TT=165.745	UNSAT TT=24.2	UNSAT TT=2.509	UNSAT TT=2.511	UNSAT TT=191.135	UNSAT TT=227.76	UNSAT TT=118.442
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n76-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.514	UNSAT TT=7.776	No data	No data	UNSAT TT=70.106	UNSAT TT=5.9	UNSAT TT=2.514	UNSAT TT=2.65	UNSAT TT=16.133	UNSAT TT=154.101	UNSAT TT=195.228
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.622	UNSAT TT=13.989	No data	No data	UNSAT TT=45.689	UNSAT TT=4.258	UNSAT TT=1.622	UNSAT TT=1.63	UNSAT TT=25.471	UNSAT TT=108.507	UNSAT TT=83.665
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.621	UNSAT TT=8.854	No data	No data	UNSAT TT=19.308	UNSAT TT=4.357	UNSAT TT=1.621	UNSAT TT=1.627	UNSAT TT=21.741	UNSAT TT=73.96	UNSAT TT=113.595
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.705	UNSAT TT=27.361	No data	No data	UNSAT TT=45.717	UNSAT TT=6.214	UNSAT TT=1.705	UNSAT TT=1.706	UNSAT TT=15.353	UNSAT TT=16.014	UNSAT TT=46.555
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.33	UNSAT TT=15.144	No data	No data	UNSAT TT=168.05	UNSAT TT=20.697	UNSAT TT=3.33	UNSAT TT=3.335	UNSAT TT=157.54	UNSAT TT=221.3	UNSAT TT=250.952
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=4.521	UNSAT TT=36.658	No data	No data	UNSAT TT=225.482	UNSAT TT=24.401	UNSAT TT=4.521	UNSAT TT=4.54	UNSAT TT=824.621	UNSAT TT=162.658	UNSAT TT=124.968
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.321	UNSAT TT=19.375	No data	No data	UNSAT TT=167.856	UNSAT TT=20.73	UNSAT TT=3.349	UNSAT TT=3.321	UNSAT TT=26.879	UNSAT TT=218.421	UNSAT TT=202.829
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.135	UNSAT TT=56.107	No data	No data	UNSAT TT=428.319	UNSAT TT=16.736	UNSAT TT=3.135	UNSAT TT=3.147	? (TO) TT=1800.38	UNSAT TT=704.267	UNSAT TT=656.219
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n78-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.145	UNSAT TT=45.693	No data	No data	UNSAT TT=427.47	UNSAT TT=16.648	UNSAT TT=3.149	UNSAT TT=3.145	UNSAT TT=559.37	UNSAT TT=715.94	UNSAT TT=395.983
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n80-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.62	UNSAT TT=9.713	No data	No data	UNSAT TT=250.76	UNSAT TT=10.255	UNSAT TT=2.62	UNSAT TT=2.628	UNSAT TT=40.847	UNSAT TT=411.08	UNSAT TT=221.281
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n80-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.49	UNSAT TT=78.893	No data	No data	UNSAT TT=157.312	UNSAT TT=31.444	UNSAT TT=6.49	UNSAT TT=6.499	UNSAT TT=59.845	UNSAT TT=822.169	UNSAT TT=158.072
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n80-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.577	UNSAT TT=17.095	No data	No data	UNSAT TT=166.437	UNSAT TT=2.577	UNSAT TT=4.322	UNSAT TT=4.335	UNSAT TT=81.441	UNSAT TT=314.24	UNSAT TT=212.634
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n80-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=8.465	UNSAT TT=43.017	No data	No data	UNSAT TT=698.772	UNSAT TT=493.919	UNSAT TT=8.519	UNSAT TT=8.465	UNSAT TT=892.688	? (TO) TT=1800.78	UNSAT TT=562.672
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n80-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=10.311	UNSAT TT=93.559	No data	No data	UNSAT TT=1198.37	UNSAT TT=75.152	UNSAT TT=10.366	UNSAT TT=10.311	UNSAT TT=254.544	UNSAT TT=760.918	UNSAT TT=514.258
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n80-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.37	UNSAT TT=54.589	No data	No data	UNSAT TT=1273.38	UNSAT TT=17.064	UNSAT TT=6.435	UNSAT TT=6.37	UNSAT TT=170.957	UNSAT TT=1133.88	UNSAT TT=579.521
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n82-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.4	UNSAT TT=27.683	No data	No data	UNSAT TT=540.239	UNSAT TT=17.294	UNSAT TT=3.4	UNSAT TT=3.408	UNSAT TT=995.571	? (TO) TT=1800.06	UNSAT TT=281.814
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n82-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=3.348	UNSAT TT=46.371	No data	No data	UNSAT TT=321.237	UNSAT TT=62.672	UNSAT TT=3.351	UNSAT TT=3.348	UNSAT TT=601.803	? (TO) TT=1800.08	UNSAT TT=353
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n82-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.13	UNSAT TT=4.93	No data	No data	UNSAT TT=43.93	UNSAT TT=4.553	UNSAT TT=1.13	UNSAT TT=1.135	UNSAT TT=63.215	UNSAT TT=1699.02	UNSAT TT=58.387
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n82-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=0.965	UNSAT TT=2.519	No data	No data	UNSAT TT=47.545	UNSAT TT=4.275	UNSAT TT=0.965	UNSAT TT=0.965	UNSAT TT=68.853	UNSAT TT=1263.52	UNSAT TT=52.092
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n82-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=4.704	UNSAT TT=91.487	No data	No data	UNSAT TT=239.769	UNSAT TT=16.508	UNSAT TT=4.705	UNSAT TT=4.704	UNSAT TT=467.193	? (TO) TT=1800.82	UNSAT TT=387.996
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n82-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.593	UNSAT TT=40.931	No data	No data	UNSAT TT=228.132	UNSAT TT=60.183	UNSAT TT=5.593	UNSAT TT=5.595	UNSAT TT=915.014	UNSAT TT=716.616	UNSAT TT=215.445
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.242	UNSAT TT=6.771	No data	No data	UNSAT TT=105.612	UNSAT TT=5.43	UNSAT TT=1.244	UNSAT TT=1.242	UNSAT TT=12.052	UNSAT TT=268.55	UNSAT TT=235.607
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=1.242	UNSAT TT=9.193	No data	No data	UNSAT TT=74.683	UNSAT TT=5.441	UNSAT TT=1.242	UNSAT TT=1.243	UNSAT TT=57.625	UNSAT TT=272.11	UNSAT TT=170.972
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=12.429	UNSAT TT=81.805	No data	No data	UNSAT TT=1111.39	UNSAT TT=56.099	UNSAT TT=12.429	UNSAT TT=12.451	UNSAT TT=600.562	? (TO) TT=1800.66	UNSAT TT=1141.3
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=14.049	UNSAT TT=367.438	No data	No data	UNSAT TT=929.382	UNSAT TT=190.594	UNSAT TT=14.049	UNSAT TT=14.14	UNSAT TT=198.275	? (TO) TT=1800.54	UNSAT TT=945.859
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=20.927	UNSAT TT=114.678	No data	No data	UNSAT TT=1223.63	UNSAT TT=267.97	UNSAT TT=20.927	UNSAT TT=21.01	UNSAT TT=132.584	? (TO) TT=1800.04	UNSAT TT=1324.22
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.16	UNSAT TT=37.646	No data	No data	UNSAT TT=567.367	UNSAT TT=1214.4	UNSAT TT=6.16	UNSAT TT=6.519	UNSAT TT=112.766	? (TO) TT=1800.66	UNSAT TT=635.474
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=10.718	UNSAT TT=48.667	No data	No data	UNSAT TT=528.634	UNSAT TT=31.852	UNSAT TT=10.718	UNSAT TT=10.75	UNSAT TT=83.192	UNSAT TT=175.5	UNSAT TT=1022.49
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n84-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.354	UNSAT TT=42.951	No data	No data	UNSAT TT=498.387	UNSAT TT=81.402	UNSAT TT=5.354	UNSAT TT=5.364	UNSAT TT=317.167	UNSAT TT=262.06	UNSAT TT=865.948
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n86-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.57	UNSAT TT=117.822	No data	No data	? (TO) TT=1800.03	UNSAT TT=92.898	UNSAT TT=6.57	UNSAT TT=6.889	UNSAT TT=374.096	? (TO) TT=1800.03	UNSAT TT=1251.43
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n86-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=8.685	UNSAT TT=96.58	No data	No data	? (TO) TT=1800.03	UNSAT TT=56.985	UNSAT TT=8.685	UNSAT TT=8.728	UNSAT TT=997.502	? (TO) TT=1800.68	UNSAT TT=1031.6
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n86-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=5.755	UNSAT TT=102.341	No data	No data	UNSAT TT=629.71	UNSAT TT=180.507	UNSAT TT=5.755	UNSAT TT=5.781	UNSAT TT=168.028	UNSAT TT=1262.7	UNSAT TT=643.912
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n86-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=7.252	UNSAT TT=43.128	No data	No data	UNSAT TT=237.303	UNSAT TT=13.283	UNSAT TT=7.252	UNSAT TT=7.268	UNSAT TT=284.853	? (TO) TT=1800.01	UNSAT TT=366.191
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n86-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=7.255	UNSAT TT=14.684	No data	No data	UNSAT TT=154.921	UNSAT TT=36.778	UNSAT TT=7.255	UNSAT TT=7.31	UNSAT TT=456.625	? (TO) TT=1800.83	UNSAT TT=539.597
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n88-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.596	UNSAT TT=20.099	No data	No data	UNSAT TT=1297.91	UNSAT TT=38.706	UNSAT TT=6.604	UNSAT TT=6.596	UNSAT TT=118.356	UNSAT TT=1505.44	UNSAT TT=343.056
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n88-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=19.323	UNSAT TT=30.49	No data	No data	UNSAT TT=1329.69	UNSAT TT=56.277	UNSAT TT=19.323	UNSAT TT=19.346	UNSAT TT=145.873	UNSAT TT=910.356	UNSAT TT=508.399
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n88-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=18.414	UNSAT TT=112.848	No data	No data	UNSAT TT=571.231	UNSAT TT=184.3	UNSAT TT=18.451	UNSAT TT=18.414	UNSAT TT=147.992	UNSAT TT=874.62	UNSAT TT=540.444
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n88-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=20.635	UNSAT TT=41.886	No data	No data	UNSAT TT=252.572	UNSAT TT=156.705	UNSAT TT=20.635	UNSAT TT=20.655	UNSAT TT=207.911	UNSAT TT=158.941	UNSAT TT=457.024
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n90-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.405	UNSAT TT=11.149	No data	No data	UNSAT TT=247.865	UNSAT TT=21.851	UNSAT TT=2.405	UNSAT TT=2.412	UNSAT TT=16.062	UNSAT TT=1084.9	UNSAT TT=485.308
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n90-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=8.489	UNSAT TT=29.755	No data	No data	UNSAT TT=245.337	UNSAT TT=179.37	UNSAT TT=8.489	UNSAT TT=8.499	UNSAT TT=359.14	? (TO) TT=1800.62	UNSAT TT=530.236
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n90-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=8.498	UNSAT TT=42.45	No data	No data	UNSAT TT=140.219	UNSAT TT=46.302	UNSAT TT=8.503	UNSAT TT=8.498	UNSAT TT=31.309	? (TO) TT=1800.02	UNSAT TT=789.675
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n90-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=16.996	UNSAT TT=247.215	No data	No data	UNSAT TT=260.955	UNSAT TT=45.071	UNSAT TT=17.03	UNSAT TT=16.996	UNSAT TT=219.753	UNSAT TT=771.01	UNSAT TT=869.034
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n90-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=16.938	UNSAT TT=242.293	No data	No data	UNSAT TT=376.703	UNSAT TT=23.002	UNSAT TT=16.938	UNSAT TT=16.975	UNSAT TT=229.319	UNSAT TT=767.16	UNSAT TT=863.018
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n90-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=11.826	UNSAT TT=116.137	No data	No data	UNSAT TT=1053.93	UNSAT TT=11.826	UNSAT TT=22.995	UNSAT TT=23.027	UNSAT TT=712.627	? (TO) TT=1800.64	UNSAT TT=1252
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n92-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.277	UNSAT TT=65.985	No data	No data	UNSAT TT=393.358	UNSAT TT=10.673	UNSAT TT=2.281	UNSAT TT=2.277	UNSAT TT=73.602	UNSAT TT=911.984	UNSAT TT=524.833
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n92-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=2.021	UNSAT TT=72.11	No data	No data	UNSAT TT=622.235	UNSAT TT=9.246	UNSAT TT=2.03	UNSAT TT=2.021	UNSAT TT=113.458	UNSAT TT=746.61	UNSAT TT=619.54
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n92-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=12.663	UNSAT TT=629.233	No data	No data	UNSAT TT=1425.8	UNSAT TT=115.418	UNSAT TT=12.665	UNSAT TT=12.663	UNSAT TT=261.974	UNSAT TT=655.472	UNSAT TT=1466.19
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n92-d3-i3-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=27.992	UNSAT TT=52.983	No data	No data	? (TO) TT=1800.02	UNSAT TT=52.435	UNSAT TT=27.992	UNSAT TT=28.12	UNSAT TT=120.966	UNSAT TT=559.808	UNSAT TT=1196.08
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n92-d3-i3-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=37.275	UNSAT TT=107.918	No data	No data	UNSAT TT=1314.16	UNSAT TT=92.883	UNSAT TT=37.323	UNSAT TT=37.275	UNSAT TT=236.178	? (TO) TT=1800.63	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n94-d3-i1-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=8.297	UNSAT TT=38.472	No data	No data	? (TO) TT=1800.03	UNSAT TT=38.529	UNSAT TT=8.325	UNSAT TT=8.297	UNSAT TT=343.39	UNSAT TT=325.454	UNSAT TT=1775.32
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n94-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.533	UNSAT TT=97.127	No data	No data	UNSAT TT=1279.03	UNSAT TT=68.947	UNSAT TT=6.533	UNSAT TT=6.549	UNSAT TT=174.417	UNSAT TT=481.09	UNSAT TT=1197.45
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n94-d3-i2-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=10.563	UNSAT TT=119.188	No data	No data	UNSAT TT=659.388	UNSAT TT=397.684	UNSAT TT=10.563	UNSAT TT=10.563	UNSAT TT=254.237	? (TO) TT=1800.68	UNSAT TT=738.074
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n94-d3-i2-r1.cnf.gz-plain.pb.metafix.opb	UNSAT TT=15.85	UNSAT TT=110.019	No data	No data	UNSAT TT=662.015	UNSAT TT=403.771	UNSAT TT=15.85	UNSAT TT=15.919	UNSAT TT=290.869	UNSAT TT=113.35	UNSAT TT=721.676
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n94-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=6.119	UNSAT TT=118.273	No data	No data	UNSAT TT=659.997	UNSAT TT=398.195	UNSAT TT=6.137	UNSAT TT=6.119	UNSAT TT=80.92	? (TO) TT=1800.73	UNSAT TT=661.968
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n96-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	UNSAT TT=10.645	UNSAT TT=75.785	No data	No data	? (TO) TT=1800.03	UNSAT TT=402.418	UNSAT TT=10.645	UNSAT TT=10.66	UNSAT TT=738.314	UNSAT TT=367.828	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/DEC-SMALLINT-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/ normalized-tseitin-regular-n96-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT TT=33.574	UNSAT TT=191.73	No data	No data	UNSAT TT=1150.61	UNSAT TT=60.545	UNSAT TT=33.574	UNSAT TT=33.574	UNSAT TT=525.174	? (TO) TT=1800.85	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern40-40.lin.opb	SAT f=-15954 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-15954 TT=1800.11 T1=1800.4	SAT (TO) f=0 TT=1800.12 T1=1800.4	No data	No data	SAT (TO) f=-14742 TT=1800.4 T1=901.9	SAT (TO) f=-14911 TT=1800.24 T1=1739.25	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern45-23.lin.opb	SAT f=-21016 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-21016 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=-12385 TT=1800.35 T1=932.76	No Cert. TT=1800.07	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern45-34.lin.opb	SAT f=-18063 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-18063 TT=1800.01 T1=1800.3	SAT (TO) f=0 TT=1800.07 T1=1800.3	No data	No data	SAT (TO) f=-13187 TT=1800.67 T1=927.48	No Cert. TT=1800.03	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern45-45.lin.opb	SAT f=-26484 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-26484 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.16 T1=1800.4	No data	No data	SAT (TO) f=-23410 TT=1800.28 T1=956.2	SAT (TO) f=-23735 TT=1800.02 T1=1730.42	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern50-25.lin.opb	SAT f=-30412 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=-30412 TT=1800.13 T1=1800.4	SAT (TO) f=0 TT=1800.09 T1=1800.3	No data	No data	SAT (TO) f=-14895 TT=1800.06 T1=891.02	SAT (TO) f=-16420 TT=1800.09 T1=1619.32	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern50-38.lin.opb	SAT f=-25180 TT=1800.09 T1=1800.5	No data	No data	No data	SAT (TO) f=-25180 TT=1800.09 T1=1800.5	SAT (TO) f=0 TT=1800.19 T1=1800.4	No data	No data	SAT (TO) f=-17968 TT=1800.54 T1=928.8	SAT (TO) f=-20067 TT=1801.16 T1=1616.68	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern50-50.lin.opb	SAT f=-19950 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-19950 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.12 T1=1800.3	No data	No data	SAT (TO) f=-16901 TT=1800.07 T1=817.09	SAT (TO) f=-17118 TT=1800.28 T1=1525.04	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern55-28.lin.opb	SAT f=-46719 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-46719 TT=1800.11 T1=1800.4	SAT (TO) f=0 TT=1800.07 T1=1800.3	No data	No data	SAT (TO) f=-19193 TT=1800.46 T1=938.58	SAT (TO) f=-21895 TT=1800.04 T1=1461.57	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern55-41.lin.opb	SAT f=-82163 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=-82163 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.28 T1=1800.3	No data	No data	SAT (TO) f=-45392 TT=1800.46 T1=935.41	SAT (TO) f=-51428 TT=1800.09 T1=1304.89	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern55-55.lin.opb	SAT f=-56529 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-56529 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.34 T1=1800.3	No data	No data	SAT (TO) f=-43356 TT=1800.31 T1=972.27	SAT (TO) f=-45874 TT=1800.74 T1=1258.04	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern60-30.lin.opb	SAT f=-31856 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-31856 TT=1800.09 T1=1800.4	SAT (TO) f=0 TT=1800.21 T1=1800.3	No data	No data	SAT (TO) f=-11331 TT=1800.29 T1=808.47	No Cert. TT=1800.72	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern60-45.lin.opb	SAT f=-114288 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=-114288 TT=1800.05 T1=1800.4	SAT (TO) f=0 TT=1800.42 T1=1800.4	No data	No data	SAT (TO) f=-53320 TT=1800.11 T1=662.51	SAT (TO) f=-64139 TT=1800.08 T1=1463.47	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern60-60.lin.opb	SAT f=-83949 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=-83949 TT=1800.12 T1=1800.4	SAT (TO) f=0 TT=1800.52 T1=1800.4	No data	No data	? (TO) TT=1804.43	SAT (TO) f=-61956 TT=1800.59 T1=1581.98	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-cardqp_inlp.lin.opb	SAT f=830514833470 TT=1800.04 T1=9.38	No data	No data	No data	SAT (TO) f=1138165245729 TT=1800.02 T1=1800.3	SAT (TO) f=920603516934 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=834301707282 TT=1800.39 T1=830.43	SAT (TO) f=830514833470 TT=1800.04 T1=9.38	? (MO) TT=229.465
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-crossdock_15x8.lin.opb	SAT f=16087 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=16087 TT=1800.07 T1=1800.4	SAT (TO) f=18002 TT=1800.06 T1=1800.4	No data	No data	SAT (TO) f=16266 TT=1800.14 T1=0.97	SAT (TO) f=16186 TT=1800.03 T1=1610.21	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay60.lin.opb	SAT f=1681498 TT=1800.2 T1=1516.71	No data	No data	No data	SAT (TO) f=2001841 TT=1800.05 T1=1800.5	SAT f=2306839 TT=594.557 T1=594.14	No data	No data	SAT (TO) f=1682383 TT=1800.84 T1=1683.43	SAT (TO) f=1681498 TT=1800.2 T1=1516.71	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay70.lin.opb	SAT f=1907393 TT=1800.38 T1=1588.95	No data	No data	No data	SAT (TO) f=2223662 TT=1800.13 T1=1800.5	SAT (MO) f=2605924 TT=760.192 T1=759.8	No data	No data	SAT (TO) f=1907393 TT=1800.38 T1=1588.95	No Cert. TT=1038.39	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay75.lin.opb	SAT f=2669211 TT=1800.07 T1=10.15	No data	No data	No data	SAT (TO) f=3145596 TT=1800.11 T1=1800.5	SAT (MO) f=3944708 TT=1566.33 T1=1566.1	No data	No data	SAT (TO) f=2669211 TT=1800.07 T1=10.15	No Cert. TT=604.092	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay80.lin.opb	SAT f=4790857 TT=1800.83 T1=1697.98	No data	No data	No data	SAT (TO) f=5780747 TT=1800.08 T1=1800.4	SAT (MO) f=6184739 TT=1012.6 T1=1012.3	No data	No data	SAT (TO) f=4790857 TT=1800.83 T1=1697.98	No Cert. TT=348.43	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-0044-1601.lin.opb	OPT f=-954077 TT=0.733 T1=0.08	No data	No data	No data	OPT f=-954077 TT=326.131 T1=326.17	OPT f=-954077 TT=8.155 T1=8.14	No data	No data	OPT f=-954077 TT=1.683 T1=3.67	OPT f=-954077 TT=0.733 T1=0.49	OPT f=-954077 TT=0.948 T1=0.08
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-0055-0062.lin.opb	OPT f=-1484348 TT=10.263 T1=2.45	No data	No data	No data	OPT f=-1484348 TT=794.03 T1=794.15	OPT f=-1484348 TT=17.226 T1=17.2	No data	No data	OPT f=-1484348 TT=26.773 T1=14.64	OPT f=-1484348 TT=10.263 T1=2.45	OPT f=-1484348 TT=130.935 T1=60.51
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-0066-0066.lin.opb	OPT f=-2865560 TT=52.218 T1=52.17	No data	No data	No data	OPT f=-2865560 TT=1041.16 T1=1041.32	OPT f=-2865560 TT=52.218 T1=52.17	No data	No data	SAT (TO) f=-2496488 TT=1800.87 T1=1.72	SAT (TO) f=-2496488 TT=1800.61 T1=0.23	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-0077-0077.lin.opb	OPT f=-3282435 TT=81.807 T1=81.74	No data	No data	No data	SAT (TO) f=-1800958 TT=1800.02 T1=1800.3	OPT f=-3282435 TT=81.807 T1=81.74	No data	No data	SAT (TO) f=-2976766 TT=1800.08 T1=2.24	SAT (TO) f=-2950773 TT=1800.08 T1=0.85	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-0088-0088.lin.opb	OPT f=-5935341 TT=1477.41 T1=1477.57	No data	No data	No data	SAT (TO) f=-3663064 TT=1800.03 T1=1800.3	OPT f=-5935341 TT=1477.41 T1=1477.57	No data	No data	SAT (TO) f=-5285000 TT=1800.03 T1=12.32	? (TO) TT=1802.03	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-0099-9211.lin.opb	SAT f=-5060105 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-2331750 TT=1800.02 T1=1800.3	SAT (TO) f=-5060105 TT=1800.08 T1=1800.4	No data	No data	SAT (TO) f=-4254832 TT=1800.68 T1=3.78	SAT (TO) f=-4287109 TT=1800.02 T1=1.15	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2g-1010-0824.lin.opb	OPT f=-7024864 TT=491.171 T1=491.06	No data	No data	No data	SAT (TO) f=-1834425 TT=1800.03 T1=1800.3	OPT f=-7024864 TT=491.171 T1=491.06	No data	No data	SAT (TO) f=-6046909 TT=1800.59 T1=13.85	SAT (TO) f=-6046909 TT=1800 T1=2.49	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3g-0234-0234.lin.opb	OPT f=-1952753 TT=38.588 T1=38.57	No data	No data	No data	SAT (TO) f=-1850578 TT=1800.01 T1=1800.3	OPT f=-1952753 TT=38.588 T1=38.57	No data	No data	OPT f=-1952753 TT=397.255 T1=180.86	OPT f=-1952753 TT=146.253 T1=70.72	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3g-0244-0244.lin.opb	OPT f=-2725383 TT=111.424 T1=111.38	No data	No data	No data	? (TO) TT=1800.02	OPT f=-2725383 TT=111.424 T1=111.38	No data	No data	SAT (TO) f=-2396398 TT=1800.02 T1=23.24	SAT (TO) f=-2414467 TT=1800.11 T1=1.29	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3g-0333-0333.lin.opb	OPT f=-1882389 TT=63.029 T1=13.75	No data	No data	No data	SAT (TO) f=-1348640 TT=1800.02 T1=1800.3	OPT f=-1882389 TT=63.029 T1=62.98	No data	No data	SAT (TO) f=-1882389 TT=1800.17 T1=13.75	SAT (TO) f=-1882389 TT=1800.01 T1=38.55	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3g-0334-0334.lin.opb	SAT f=-3410696 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-1812983 TT=1800.02 T1=1800.3	SAT (TO) f=-3410696 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=-2911848 TT=1800.16 T1=3.26	SAT (TO) f=-2863952 TT=1800 T1=2.05	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3g-0344-0344.lin.opb	SAT f=-5301516 TT=1800.1 T1=1800.4	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=-5301516 TT=1800.1 T1=1800.4	No data	No data	SAT (TO) f=-4810249 TT=1800.04 T1=4.27	SAT (TO) f=-4576984 TT=1803.31 T1=0.52	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3g-0444-0444.lin.opb	SAT f=-7410770 TT=1800.09 T1=1800.4	No data	No data	No data	? (TO) TT=1800.03	SAT (TO) f=-7410770 TT=1800.09 T1=1800.4	No data	No data	SAT (TO) f=-6251985 TT=1800.65 T1=4.49	SAT (TO) f=-6194804 TT=1800.05 T1=0.26	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb302035.lin.opb	SAT f=4211459 TT=1800.5 T1=8.13	No data	No data	No data	SAT (TO) f=8751206 TT=1800.04 T1=1800.3	? (TO) TT=1800.04	No data	No data	SAT (TO) f=4215155 TT=1801.08 T1=16.27	SAT (TO) f=4211459 TT=1800.5 T1=8.13	? (TO) TT=1800.14
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb302055.lin.opb	SAT f=4372559 TT=1800.15 T1=8.16	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=8228611 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=4372559 TT=1800.15 T1=629.12	SAT (TO) f=4372559 TT=1800.29 T1=8.16	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb302075.lin.opb	SAT f=4644489 TT=1800.14 T1=5.51	No data	No data	No data	? (TO) TT=1800.02	SAT (TO) f=8361552 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=4644489 TT=1800.14 T1=11.6	SAT (TO) f=4644489 TT=1800.83 T1=5.51	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb302095.lin.opb	SAT f=6507792 TT=1800.1 T1=14.84	No data	No data	No data	SAT (TO) f=9289243 TT=1800.11 T1=1800.5	SAT (TO) f=8817507 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=6507792 TT=1800.1 T1=14.84	SAT (TO) f=7243800 TT=1801.03 T1=1413.82	? (TO) TT=1800.12
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb351535.lin.opb	SAT f=5590266 TT=1800.06 T1=7.05	No data	No data	No data	SAT (TO) f=10400405 TT=1800.09 T1=1800.4	SAT (TO) f=11248559 TT=1800.05 T1=1800.3	No data	No data	SAT (TO) f=5599936 TT=1800.02 T1=961.93	SAT (TO) f=5590266 TT=1800.06 T1=7.05	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb351555.lin.opb	SAT f=5239782 TT=1800.09 T1=3.11	No data	No data	No data	SAT (TO) f=10755911 TT=1800.03 T1=1800.3	SAT (TO) f=11424423 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=5239782 TT=1800.11 T1=5.91	SAT (TO) f=5239782 TT=1800.09 T1=3.11	? (TO) TT=1800.16
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb351575.lin.opb	SAT f=6792554 TT=1800.89 T1=18.54	No data	No data	No data	SAT (TO) f=11462323 TT=1800.07 T1=1800.4	? (TO) TT=1800.03	No data	No data	SAT (TO) f=6792554 TT=1800.89 T1=18.54	SAT (TO) f=6902668 TT=1800.08 T1=4.31	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-pb351595.lin.opb	SAT f=7304887 TT=1800.11 T1=285.03	No data	No data	No data	SAT (TO) f=11884420 TT=1800.03 T1=1800.3	SAT (TO) f=12380578 TT=1800.04 T1=1800.3	No data	No data	SAT (TO) f=7304887 TT=1800.11 T1=285.03	SAT (TO) f=7362086 TT=1800.01 T1=6.64	? (TO) TT=1800.22
PB15eval/normalized-PB15eval/ OPT-BIGINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-qap.lin.opb	SAT f=209959 TT=1800.03 T1=5.82	No data	No data	No data	SAT (TO) f=228216 TT=1800.03 T1=1800.3	SAT (TO) f=249024 TT=1800.33 T1=1800.4	No data	No data	SAT (TO) f=210980 TT=1800.64 T1=256.12	SAT (TO) f=209959 TT=1800.03 T1=5.82	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm100p-opt.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.61	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm90p-opt.opb.negationfix.opb	SAT f=119 TT=1800.49 T1=1137.11	No data	No data	No data	? (TO) TT=1800.16	? (TO) TT=1800.08	No data	No data	SAT (TO) f=124 TT=1800.3 T1=704.21	SAT (TO) f=119 TT=1800.49 T1=1137.11	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm95p-opt.opb.negationfix.opb	SAT f=126 TT=1800.19 T1=826.72	No data	No data	No data	? (TO) TT=1800.12	? (TO) TT=1800.1	No data	No data	SAT (TO) f=126 TT=1800.19 T1=826.72	SAT (TO) f=127 TT=1800.96 T1=1515.29	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm98p-opt.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	No data	No data	? (TO) TT=1801.07	? (TO) TT=1800.71	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm99p-opt.opb.negationfix.opb		No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern40-40.opb	SAT f=-15954 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-15954 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-14742 TT=1800.38 T1=922.55	SAT (TO) f=-14832 TT=1800.03 T1=1752.22	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern45-23.opb	SAT f=-21016 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-21016 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-12385 TT=1800.06 T1=908.06	SAT (TO) f=-13535 TT=1800.01 T1=1767.62	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern45-34.opb	SAT f=-18063 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-18063 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-13187 TT=1800.23 T1=918.12	SAT (TO) f=-14590 TT=1800.07 T1=1765.84	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern45-45.opb	SAT f=-26484 TT=1800.1 T1=1800.5	No data	No data	No data	SAT (TO) f=-26484 TT=1800.1 T1=1800.5	No data	No data	No data	SAT (TO) f=-23412 TT=1800.24 T1=952.67	SAT (TO) f=-23731 TT=1800.02 T1=1433.19	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern50-25.opb	SAT f=-30412 TT=1800.03 T1=1800.4	No data	No data	No data	SAT (TO) f=-30412 TT=1800.03 T1=1800.4	No data	No data	No data	SAT (TO) f=-14895 TT=1800.36 T1=881.13	SAT (TO) f=-16683 TT=1800.6 T1=1766.04	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern50-38.opb	SAT f=-25180 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=-25180 TT=1800.06 T1=1800.4	No data	No data	No data	SAT (TO) f=-18054 TT=1800.07 T1=921.85	SAT (TO) f=-19845 TT=1800.05 T1=1530.02	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern50-50.opb	SAT f=-19950 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-19950 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-16901 TT=1800.04 T1=831.14	SAT (TO) f=-17401 TT=1800.98 T1=1776.41	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern55-28.opb	SAT f=-46719 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-46719 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-19193 TT=1800.27 T1=932.83	SAT (TO) f=-21686 TT=1800.03 T1=1432.69	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern55-41.opb	SAT f=-82163 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-82163 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-45635 TT=1800.37 T1=946.38	SAT (TO) f=-51399 TT=1800.08 T1=1701.66	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern55-55.opb	SAT f=-56529 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-56529 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-43356 TT=1800.33 T1=993.06	SAT (TO) f=-46930 TT=1800.76 T1=1163.21	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern60-30.opb	SAT f=-31856 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-31856 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-11331 TT=1800.06 T1=821.05	SAT (TO) f=-12650 TT=1800.01 T1=1727.46	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern60-45.opb	SAT f=-114288 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-114288 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-49825 TT=1800.32 T1=961.21	SAT (TO) f=-64542 TT=1800.46 T1=1573.18	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern60-60.opb	SAT f=-83949 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-83949 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-54902 TT=1800.17 T1=802.86	SAT (TO) f=-63175 TT=1800.07 T1=1574.36	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-cardqp_inlp.opb	SAT f=816688461479 TT=1800.66 T1=423.69	No data	No data	No data	SAT (TO) f=1138165245729 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=816688461479 TT=1800.66 T1=423.69	SAT (TO) f=826410679589 TT=1800.08 T1=108.31	? (MO) TT=228.989
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-crossdock_15x8.opb	SAT f=16087 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=16087 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=16178 TT=1801.59 T1=723.23	SAT (TO) f=16202 TT=1800.03 T1=0.53	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay60.opb	SAT f=1681658 TT=1800.05 T1=1131.63	No data	No data	No data	SAT (TO) f=2001841 TT=1800.14 T1=1800.5	No data	No data	No data	SAT (TO) f=1682418 TT=1800.05 T1=1606.14	SAT (TO) f=1681658 TT=1800.05 T1=1131.63	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay70.opb	SAT f=1906945 TT=1055.92 T1=202.79	No data	No data	No data	SAT (TO) f=2223662 TT=1800.12 T1=1800.5	No data	No data	No data	SAT (TO) f=1907167 TT=1800.43 T1=1659.19	SAT f=1906945 TT=1055.92 T1=202.79	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay75.opb	SAT f=2669211 TT=610.042 T1=3.16	No data	No data	No data	SAT (TO) f=3145596 TT=1800.15 T1=1800.5	No data	No data	No data	SAT (TO) f=2669211 TT=1800.58 T1=10.47	SAT f=2669211 TT=610.042 T1=3.16	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay80.opb	SAT f=4789911 TT=646.217 T1=590.85	No data	No data	No data	SAT (TO) f=5780747 TT=1800.15 T1=1800.5	No data	No data	No data	SAT (TO) f=4790849 TT=1800.12 T1=1613.73	SAT f=4789911 TT=646.217 T1=590.85	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-0044-1601.opb	OPT f=-954077 TT=0.683 T1=0.31	No data	No data	No data	OPT f=-954077 TT=328.888 T1=328.94	No data	No data	No data	OPT f=-954077 TT=2.184 T1=3.66	OPT f=-954077 TT=0.683 T1=0.31	OPT f=-954077 TT=1.483 T1=0.43
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-0055-0062.opb	OPT f=-1484348 TT=10.942 T1=1.38	No data	No data	No data	OPT f=-1484348 TT=788.316 T1=788.44	No data	No data	No data	OPT f=-1484348 TT=25.649 T1=12.7	OPT f=-1484348 TT=10.942 T1=1.38	OPT f=-1484348 TT=131.03 T1=3.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-0066-0066.opb	OPT f=-2865560 TT=1035.79 T1=1035.95	No data	No data	No data	OPT f=-2865560 TT=1035.79 T1=1035.95	No data	No data	No data	SAT (TO) f=-2610196 TT=1800.06 T1=6.2	SAT (TO) f=-2496488 TT=1800.02 T1=0.2	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-0077-0077.opb	SAT f=-3229106 TT=1800.01 T1=225.99	No data	No data	No data	SAT (TO) f=-1800958 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-2996225 TT=1800.62 T1=1.69	SAT (TO) f=-3229106 TT=1800.01 T1=225.99	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-0088-0088.opb	SAT f=-5170311 TT=1800.02 T1=0.4	No data	No data	No data	SAT (TO) f=-3663064 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-5170311 TT=1800.6 T1=2.77	SAT (TO) f=-5170311 TT=1800.02 T1=0.4	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-0099-9211.opb	SAT f=-4287109 TT=1800.69 T1=1.04	No data	No data	No data	SAT (TO) f=-2331750 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-4287109 TT=1800.72 T1=7.77	SAT (TO) f=-4287109 TT=1800.69 T1=1.04	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2g-1010-0824.opb	SAT f=-6046909 TT=1800.04 T1=2.5	No data	No data	No data	SAT (TO) f=-1834425 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-5994097 TT=1800.57 T1=11.8	SAT (TO) f=-6046909 TT=1800.04 T1=2.5	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3g-0234-0234.opb	OPT f=-1952753 TT=137.243 T1=66.65	No data	No data	No data	SAT (TO) f=-1850578 TT=1800.01 T1=1800.3	No data	No data	No data	OPT f=-1952753 TT=389.506 T1=151.26	OPT f=-1952753 TT=137.243 T1=66.65	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3g-0244-0244.opb	SAT f=-2521044 TT=1800.02 T1=12.64	No data	No data	No data	SAT (TO) f=-1615633 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-2414467 TT=1800.18 T1=889.28	SAT (TO) f=-2521044 TT=1800.02 T1=12.64	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3g-0333-0333.opb	SAT f=-1882389 TT=1800 T1=247.15	No data	No data	No data	SAT (TO) f=-1348640 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-1882389 TT=1800.52 T1=493.05	SAT (TO) f=-1882389 TT=1800 T1=247.15	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3g-0334-0334.opb	SAT f=-2953024 TT=1800.64 T1=3.2	No data	No data	No data	SAT (TO) f=-1812983 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-2953024 TT=1800.64 T1=3.2	SAT (TO) f=-2863952 TT=1800.03 T1=0.21	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3g-0344-0344.opb	SAT f=-4947487 TT=1800.12 T1=4.25	No data	No data	No data	SAT (TO) f=-2413925 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-4947487 TT=1800.12 T1=4.25	SAT (TO) f=-4576984 TT=1800.07 T1=0.48	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3g-0444-0444.opb	SAT f=-6194804 TT=1800.04 T1=0.22	No data	No data	No data	SAT (TO) f=-3692302 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-6194804 TT=1800.62 T1=0.73	SAT (TO) f=-6194804 TT=1800.04 T1=0.22	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb302035.opb	SAT f=4211459 TT=1800.61 T1=7.91	No data	No data	No data	SAT (TO) f=8751206 TT=1800.04 T1=1800.3	No data	No data	No data	SAT (TO) f=4215155 TT=1800.04 T1=16.34	SAT (TO) f=4211459 TT=1800.61 T1=7.91	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb302055.opb	SAT f=4372559 TT=1800.56 T1=7.3	No data	No data	No data	SAT (TO) f=8755941 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=4372559 TT=1800.56 T1=632.35	SAT (TO) f=4372559 TT=1800.66 T1=7.3	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb302075.opb	SAT f=4628361 TT=1800.08 T1=726.63	No data	No data	No data	SAT (TO) f=7848561 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=4644489 TT=1800.71 T1=12.5	SAT (TO) f=4628361 TT=1800.08 T1=726.63	? (TO) TT=1800.14
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb302095.opb	SAT f=6656449 TT=1800.76 T1=11.63	No data	No data	No data	? (TO) TT=1800.02	No data	No data	No data	SAT (TO) f=6656449 TT=1800.76 T1=11.63	SAT (TO) f=7155970 TT=1800.07 T1=1205.95	? (TO) TT=1800.16
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb351535.opb	SAT f=5590266 TT=1800.48 T1=6.03	No data	No data	No data	SAT (TO) f=10400405 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=5599936 TT=1800.61 T1=980.2	SAT (TO) f=5590266 TT=1800.48 T1=6.03	? (TO) TT=1800.23
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb351555.opb	SAT f=5239782 TT=1800.02 T1=2.68	No data	No data	No data	SAT (TO) f=10755911 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=5239782 TT=1800.02 T1=5.57	SAT (TO) f=5239782 TT=1800.74 T1=2.68	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb351575.opb	SAT f=6785589 TT=1800.7 T1=648.78	No data	No data	No data	SAT (TO) f=11462323 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=6785589 TT=1800.7 T1=648.78	SAT (TO) f=6792554 TT=1800.68 T1=7.03	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-BIGINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-pb351595.opb	SAT f=7328208 TT=1800.55 T1=3.93	No data	No data	No data	SAT (TO) f=11884420 TT=1800.04 T1=1800.3	No data	No data	No data	SAT (TO) f=7328208 TT=1800.55 T1=3.93	SAT (TO) f=7405964 TT=1800.07 T1=50.48	? (TO) TT=1800.21
PB15eval/normalized-PB15eval/OPT-BIGINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-qap.opb	SAT f=210318 TT=1800.6 T1=264.93	No data	No data	No data	SAT (TO) f=228216 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=210318 TT=1800.6 T1=264.93	SAT (TO) f=212944 TT=1800.03 T1=1538.58	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_000.opb.metafix.opb	OPT f=45 TT=0.014 T1=0.01	No data	OPT f=45 TT=0.026 T1=0.02	OPT f=45 TT=0.014 T1=0.01	OPT f=45 TT=0.019 T1=0.01	OPT f=45 TT=0.036 T1=0.03	OPT f=45 TT=0.02 T1=0.02	OPT f=45 TT=0.014 T1=0.01	OPT f=45 TT=0.244 T1=0.65	OPT f=45 TT=0.203 T1=0.14	OPT f=45 TT=0.052 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_001.opb.metafix.opb	OPT f=52 TT=0.359 T1=0.01	No data	OPT f=52 TT=0.689 T1=0.69	OPT f=52 TT=0.371 T1=0.37	OPT f=52 TT=0.359 T1=0.35	OPT f=52 TT=0.828 T1=0.82	OPT f=52 TT=1.547 T1=1.54	OPT f=52 TT=0.869 T1=0.87	OPT f=52 TT=3.275 T1=0.67	OPT f=52 TT=0.725 T1=0.16	OPT f=52 TT=1.132 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_002.opb.metafix.opb	OPT f=42 TT=0.027 T1=0.01	No data	OPT f=42 TT=0.052 T1=0.05	OPT f=42 TT=0.027 T1=0.02	OPT f=42 TT=0.033 T1=0.03	OPT f=42 TT=0.061 T1=0.06	OPT f=42 TT=0.265 T1=0.26	OPT f=42 TT=0.078 T1=0.07	OPT f=42 TT=0.853 T1=0.65	OPT f=42 TT=0.444 T1=0.14	OPT f=42 TT=0.094 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_003.opb.metafix.opb	OPT f=50 TT=0.014 T1=0.01	No data	OPT f=50 TT=0.028 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.02 T1=0.02	OPT f=50 TT=0.046 T1=0.04	OPT f=50 TT=0.042 T1=0.04	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.394 T1=0.65	OPT f=50 TT=0.234 T1=0.15	OPT f=50 TT=0.063 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_004.opb.metafix.opb	OPT f=51 TT=0.021 T1=0.01	No data	OPT f=51 TT=0.201 T1=0.2	OPT f=51 TT=0.021 T1=0.02	OPT f=51 TT=0.231 T1=0.22	OPT f=51 TT=0.565 T1=0.56	OPT f=51 TT=1.508 T1=1.5	OPT f=51 TT=0.507 T1=0.5	OPT f=51 TT=1.843 T1=0.66	OPT f=51 TT=0.624 T1=0.14	OPT f=51 TT=1.202 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_005.opb.metafix.opb	OPT f=48 TT=0.13 T1=0.01	No data	OPT f=48 TT=0.186 T1=0.18	OPT f=48 TT=0.13 T1=0.13	OPT f=48 TT=0.13 T1=0.12	OPT f=48 TT=0.324 T1=0.32	OPT f=48 TT=1.108 T1=1.1	OPT f=48 TT=0.233 T1=0.23	OPT f=48 TT=1.594 T1=0.66	OPT f=48 TT=0.574 T1=0.14	OPT f=48 TT=0.362 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_006.opb.metafix.opb	OPT f=40 TT=0.442 T1=0.01	No data	OPT f=40 TT=1.294 T1=1.29	OPT f=40 TT=0.542 T1=0.54	OPT f=40 TT=0.442 T1=0.44	OPT f=40 TT=0.995 T1=0.99	OPT f=40 TT=2.436 T1=2.44	OPT f=40 TT=1.157 T1=1.15	OPT f=40 TT=3.532 T1=0.65	OPT f=40 TT=0.784 T1=0.16	OPT f=40 TT=1.319 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_007.opb.metafix.opb	OPT f=47 TT=0.015 T1=0.01	No data	OPT f=47 TT=0.025 T1=0.02	OPT f=47 TT=0.015 T1=0.01	OPT f=47 TT=0.02 T1=0.02	OPT f=47 TT=0.039 T1=0.03	OPT f=47 TT=0.015 T1=0.01	OPT f=47 TT=0.015 T1=0.01	OPT f=47 TT=0.314 T1=0.65	OPT f=47 TT=0.225 T1=0.15	OPT f=47 TT=0.056 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_008.opb.metafix.opb	OPT f=50 TT=0.199 T1=0.01	No data	OPT f=50 TT=0.446 T1=0.44	OPT f=50 TT=0.547 T1=0.54	OPT f=50 TT=0.199 T1=0.19	OPT f=50 TT=0.739 T1=0.73	OPT f=50 TT=2.586 T1=2.58	OPT f=50 TT=0.385 T1=0.38	OPT f=50 TT=1.804 T1=0.65	OPT f=50 TT=0.614 T1=0.14	OPT f=50 TT=1.441 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_10x10_009.opb.metafix.opb	OPT f=53 TT=0.008 T1=0	No data	OPT f=53 TT=0.024 T1=0.02	OPT f=53 TT=0.015 T1=0.01	OPT f=53 TT=0.015 T1=0.01	OPT f=53 TT=0.023 T1=0.02	OPT f=53 TT=0.008 T1=0	OPT f=53 TT=0.009 T1=0	OPT f=53 TT=0.194 T1=0.65	OPT f=53 TT=0.185 T1=0.14	OPT f=53 TT=0.063 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_000.opb.metafix.opb	OPT f=66 TT=10.103 T1=0.02	No data	OPT f=66 TT=157.431 T1=157.45	OPT f=66 TT=102.027 T1=102.04	OPT f=66 TT=19.284 T1=19.28	OPT f=66 TT=92.072 T1=92.08	OPT f=66 TT=109.941 T1=109.95	OPT f=66 TT=16.144 T1=16.14	OPT f=66 TT=20.133 T1=0.68	OPT f=66 TT=10.103 T1=0.31	OPT f=66 TT=40.844 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_001.opb.metafix.opb	OPT f=70 TT=5.566 T1=0.23	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=70 TT=1800.02 T1=1800.3	OPT f=70 TT=43.721 T1=43.72	OPT f=70 TT=564.797 T1=564.88	OPT f=70 TT=5.566 T1=5.56	SAT (TO) f=70 TT=1800.06 T1=0.66	SAT (TO) f=70 TT=1800.05 T1=0.23	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_002.opb.metafix.opb	OPT f=70 TT=0.03 T1=0.02	No data	? (TO) TT=1800.02	OPT f=70 TT=0.03 T1=0.02	SAT (TO) f=70 TT=1800.02 T1=1800.3	OPT f=70 TT=467.587 T1=467.66	OPT f=70 TT=1007.01 T1=1007.16	OPT f=70 TT=1044.27 T1=1044.43	SAT (TO) f=70 TT=1800.08 T1=0.74	OPT f=70 TT=1536.28 T1=0.18	OPT f=70 TT=1193.07 T1=0.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_003.opb.metafix.opb	OPT f=70 TT=3.164 T1=0.15	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=70 TT=1800.02 T1=1800.3	OPT f=70 TT=3.164 T1=3.16	OPT f=70 TT=1016.83 T1=1016.98	OPT f=70 TT=23.251 T1=23.25	SAT (TO) f=70 TT=1800.58 T1=0.94	SAT (TO) f=70 TT=1800.08 T1=0.15	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_004.opb.metafix.opb	OPT f=61 TT=15.772 T1=0.03	No data	OPT f=61 TT=196.724 T1=196.75	OPT f=61 TT=273.888 T1=273.93	OPT f=61 TT=24.512 T1=24.51	OPT f=61 TT=40.039 T1=40.04	OPT f=61 TT=109.815 T1=109.83	OPT f=61 TT=25.618 T1=25.62	OPT f=61 TT=33.639 T1=0.66	OPT f=61 TT=15.772 T1=0.15	OPT f=61 TT=34.445 T1=0.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_005.opb.metafix.opb	OPT f=72 TT=504.612 T1=0.08	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=72 TT=1298.74 T1=1298.94	OPT f=72 TT=561.819 T1=561.9	OPT f=72 TT=1307.06 T1=1307.26	OPT f=72 TT=504.612 T1=504.69	OPT f=72 TT=1303.89 T1=0.66	OPT f=72 TT=628.85 T1=0.18	OPT f=72 TT=752.301 T1=0.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_006.opb.metafix.opb	OPT f=74 TT=0.025 T1=0.02	No data	OPT f=74 TT=0.099 T1=0.09	OPT f=74 TT=0.025 T1=0.02	OPT f=74 TT=0.05 T1=0.04	OPT f=74 TT=0.101 T1=0.1	OPT f=74 TT=0.445 T1=0.44	OPT f=74 TT=0.111 T1=0.11	OPT f=74 TT=0.824 T1=0.66	OPT f=74 TT=0.444 T1=0.22	OPT f=74 TT=0.174 T1=0.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_007.opb.metafix.opb	OPT f=80 TT=1.406 T1=0.02	No data	OPT f=80 TT=2.918 T1=2.91	OPT f=80 TT=1.677 T1=1.67	OPT f=80 TT=1.406 T1=1.4	OPT f=80 TT=4.541 T1=4.54	OPT f=80 TT=11.606 T1=11.6	OPT f=80 TT=1.408 T1=1.4	OPT f=80 TT=4.243 T1=0.68	OPT f=80 TT=1.455 T1=0.17	OPT f=80 TT=2.724 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_008.opb.metafix.opb	OPT f=72 TT=7.639 T1=0.2	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=72 TT=38.639 T1=38.64	OPT f=72 TT=17.237 T1=17.24	SAT (TO) f=72 TT=1800.02 T1=1800.3	OPT f=72 TT=7.639 T1=7.63	OPT f=72 TT=17.552 T1=0.66	SAT (TO) f=72 TT=1800.54 T1=0.2	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_12x12_009.opb.metafix.opb	OPT f=70 TT=0.948 T1=0.03	No data	OPT f=70 TT=2.159 T1=2.15	OPT f=70 TT=1.189 T1=1.18	OPT f=70 TT=0.948 T1=0.94	OPT f=70 TT=2.736 T1=2.73	OPT f=70 TT=10.471 T1=10.47	OPT f=70 TT=2.525 T1=2.52	OPT f=70 TT=4.193 T1=0.66	OPT f=70 TT=1.573 T1=0.17	OPT f=70 TT=4.157 T1=0.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_000.opb.metafix.opb	OPT f=95 TT=77.22 T1=0.16	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=95 TT=1800.02 T1=1800.3	OPT f=95 TT=77.22 T1=77.23	SAT (TO) f=95 TT=1800.02 T1=1800.3	OPT f=95 TT=314.518 T1=314.56	SAT (TO) f=95 TT=1800.64 T1=0.67	SAT (TO) f=95 TT=1800 T1=0.16	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_001.opb.metafix.opb	OPT f=88 TT=21.782 T1=0.69	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=88 TT=1800.02 T1=1800.3	OPT f=88 TT=21.782 T1=21.78	SAT (TO) f=88 TT=1800.02 T1=1800.3	OPT f=88 TT=58.297 T1=58.3	SAT (TO) f=88 TT=1800.11 T1=0.69	SAT (TO) f=88 TT=1800.37 T1=1.15	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_002.opb.metafix.opb	OPT f=100 TT=883.371 T1=0.17	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=100 TT=1800.02 T1=1800.3	OPT f=100 TT=883.371 T1=883.5	SAT (TO) f=100 TT=1800.02 T1=1800.3	SAT (TO) f=100 TT=1800.02 T1=1800.3	SAT (TO) f=100 TT=1800.73 T1=0.68	SAT (TO) f=100 TT=1800.04 T1=0.17	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_003.opb.metafix.opb	OPT f=88 TT=20.862 T1=0.18	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=88 TT=1800.01 T1=1800.3	OPT f=88 TT=20.862 T1=20.86	SAT (TO) f=88 TT=1800.02 T1=1800.3	OPT f=88 TT=232.801 T1=232.83	SAT (TO) f=88 TT=1800.64 T1=0.68	SAT (TO) f=88 TT=1800.09 T1=0.18	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_004.opb.metafix.opb	OPT f=96 TT=129.92 T1=0.31	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=96 TT=1800.01 T1=1800.3	OPT f=96 TT=129.92 T1=129.94	SAT (TO) f=96 TT=1800.02 T1=1800.3	SAT (TO) f=96 TT=1800.02 T1=1800.3	SAT (TO) f=96 TT=1800.19 T1=0.68	SAT (TO) f=96 TT=1800.57 T1=0.31	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_005.opb.metafix.opb	OPT f=110 TT=2.686 T1=0.2	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=110 TT=1800.02 T1=1800.3	OPT f=110 TT=2.686 T1=2.68	SAT (TO) f=110 TT=1800.02 T1=1800.3	SAT (TO) f=110 TT=1800.01 T1=1800.3	SAT (TO) f=110 TT=1800.9 T1=0.72	SAT (TO) f=110 TT=1800.04 T1=0.2	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_006.opb.metafix.opb	SAT f=95 TT=1800.02 T1=0.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=95 TT=1800.02 T1=1800.3	SAT (TO) f=95 TT=1800.02 T1=1800.3	SAT (TO) f=95 TT=1800.02 T1=1800.3	SAT (TO) f=95 TT=1800.03 T1=1800.3	SAT (TO) f=95 TT=1800.69 T1=0.68	SAT (TO) f=95 TT=1800.78 T1=0.3	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_007.opb.metafix.opb	SAT f=96 TT=1800.02 T1=0.67	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=96 TT=1800.02 T1=1800.3	SAT (TO) f=96 TT=1800.02 T1=1800.3	SAT (TO) f=96 TT=1800.02 T1=1800.3	SAT (TO) f=96 TT=1800.02 T1=1800.3	SAT (TO) f=96 TT=1800.1 T1=0.67	SAT (TO) f=96 TT=1800.08 T1=1.52	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_008.opb.metafix.opb	OPT f=85 TT=20.443 T1=0.39	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=85 TT=1800.01 T1=1800.3	OPT f=85 TT=20.443 T1=20.44	SAT (TO) f=85 TT=1800.08 T1=1800.6	SAT (TO) f=85 TT=1800.03 T1=1799.5	SAT (TO) f=85 TT=1800.69 T1=0.67	SAT (TO) f=85 TT=1800.09 T1=0.39	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_14x14_009.opb.metafix.opb	OPT f=100 TT=468.762 T1=0.31	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=100 TT=1800.02 T1=1800.3	OPT f=100 TT=468.762 T1=468.83	SAT (TO) f=100 TT=1800.02 T1=1800.3	SAT (TO) f=100 TT=1800.02 T1=1800.3	SAT (TO) f=100 TT=1800.05 T1=0.67	SAT (TO) f=100 TT=1800.1 T1=0.31	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_000.opb.metafix.opb	OPT f=120 TT=3.838 T1=0.68	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=120 TT=1800.02 T1=1800.3	OPT f=120 TT=3.838 T1=3.83	SAT (TO) f=120 TT=1800.01 T1=1800.3	OPT f=120 TT=24.384 T1=24.38	SAT (TO) f=120 TT=1800.17 T1=0.68	SAT (TO) f=120 TT=1800.57 T1=0.72	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_001.opb.metafix.opb	OPT f=125 TT=180.714 T1=1.18	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=125 TT=1800.02 T1=1800.3	OPT f=125 TT=180.714 T1=180.74	SAT (TO) f=125 TT=1800.03 T1=1800.3	SAT (TO) f=125 TT=1800.02 T1=1800.3	SAT (TO) f=125 TT=1800.94 T1=1.18	SAT (TO) f=125 TT=1800.7 T1=1.41	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_002.opb.metafix.opb	OPT f=115 TT=23.689 T1=0.29	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=115 TT=1800.02 T1=1800.3	OPT f=115 TT=23.689 T1=23.69	SAT (TO) f=115 TT=1800.02 T1=1800.3	OPT f=115 TT=161.871 T1=161.89	SAT (TO) f=115 TT=1800.7 T1=0.68	SAT (TO) f=115 TT=1800.02 T1=0.29	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_003.opb.metafix.opb	OPT f=131 TT=66.336 T1=0.21	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=131 TT=1800.02 T1=1800.3	OPT f=131 TT=66.336 T1=66.34	SAT (TO) f=131 TT=1800.02 T1=1800.3	SAT (TO) f=131 TT=1800.02 T1=1800.3	SAT (TO) f=131 TT=1800.66 T1=1.69	SAT (TO) f=131 TT=1800.06 T1=0.21	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_004.opb.metafix.opb	SAT f=135 TT=1800.02 T1=0.38	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=135 TT=1800.02 T1=1800.3	SAT (TO) f=135 TT=1800.02 T1=1800.3	SAT (TO) f=135 TT=1800.02 T1=1800.3	SAT (TO) f=135 TT=1800.02 T1=1800.3	SAT (TO) f=135 TT=1801.02 T1=0.71	SAT (TO) f=135 TT=1800.02 T1=0.38	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_005.opb.metafix.opb	OPT f=125 TT=8.622 T1=0.53	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=125 TT=1800.03 T1=1800.3	OPT f=125 TT=8.622 T1=8.62	SAT (TO) f=125 TT=1800.02 T1=1800.3	OPT f=125 TT=38.535 T1=38.54	SAT (TO) f=125 TT=1800.59 T1=0.68	SAT (TO) f=125 TT=1800.04 T1=0.53	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_006.opb.metafix.opb	OPT f=115 TT=137.328 T1=0.31	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=115 TT=1800.02 T1=1800.3	OPT f=115 TT=143.862 T1=143.89	SAT (TO) f=115 TT=1800.02 T1=1800.3	OPT f=115 TT=137.328 T1=137.35	SAT (TO) f=115 TT=1800.55 T1=0.68	SAT (TO) f=115 TT=1800.01 T1=0.31	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_007.opb.metafix.opb	OPT f=130 TT=69.274 T1=0.33	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=130 TT=1800.02 T1=1800.3	OPT f=130 TT=69.274 T1=69.28	SAT (TO) f=130 TT=1800.01 T1=1800.3	SAT (TO) f=130 TT=1800.02 T1=1800.3	SAT (TO) f=130 TT=1800.87 T1=0.75	SAT (TO) f=130 TT=1800.83 T1=0.33	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_008.opb.metafix.opb	OPT f=129 TT=20.935 T1=0.25	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=129 TT=1800.03 T1=1800.3	OPT f=129 TT=20.935 T1=20.93	SAT (TO) f=129 TT=1800.02 T1=1800.3	OPT f=129 TT=59.886 T1=59.89	SAT (TO) f=129 TT=1800.17 T1=0.68	SAT (TO) f=129 TT=1800.02 T1=0.25	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_16x16_009.opb.metafix.opb	OPT f=115 TT=9.798 T1=0.28	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=115 TT=1800.02 T1=1800.3	OPT f=115 TT=9.798 T1=9.79	SAT (TO) f=115 TT=1800.02 T1=1800.3	OPT f=115 TT=56.998 T1=57.03	SAT (TO) f=115 TT=1800.84 T1=1.19	SAT (TO) f=115 TT=1800.21 T1=0.28	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_000.opb.metafix.opb	OPT f=16 TT=0.001 T1=0	No data	OPT f=16 TT=0.021 T1=0.02	OPT f=16 TT=0.014 T1=0.01	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.001 T1=0	OPT f=16 TT=0.184 T1=0.65	OPT f=16 TT=0.176 T1=0.13	OPT f=16 TT=0.014 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_001.opb.metafix.opb	OPT f=17 TT=0.001 T1=0	No data	OPT f=17 TT=0.022 T1=0.02	OPT f=17 TT=0.014 T1=0.01	OPT f=17 TT=0.002 T1=0	OPT f=17 TT=0.002 T1=0	OPT f=17 TT=0.002 T1=0	OPT f=17 TT=0.001 T1=0	OPT f=17 TT=0.185 T1=0.64	OPT f=17 TT=0.164 T1=0.12	OPT f=17 TT=0.017 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_002.opb.metafix.opb	OPT f=14 TT=0.001 T1=0	No data	OPT f=14 TT=0.022 T1=0.02	OPT f=14 TT=0.013 T1=0.01	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.002 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.002 T1=0	OPT f=14 TT=0.184 T1=0.64	OPT f=14 TT=0.164 T1=0.13	OPT f=14 TT=0.018 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_003.opb.metafix.opb	OPT f=19 TT=0.001 T1=0	No data	OPT f=19 TT=0.022 T1=0.02	OPT f=19 TT=0.015 T1=0.01	OPT f=19 TT=0.001 T1=0	OPT f=19 TT=0.002 T1=0	OPT f=19 TT=0.002 T1=0	OPT f=19 TT=0.002 T1=0	OPT f=19 TT=0.183 T1=0.64	OPT f=19 TT=0.166 T1=0.14	OPT f=19 TT=0.016 T1=0.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_004.opb.metafix.opb	OPT f=23 TT=0.001 T1=0	No data	OPT f=23 TT=0.022 T1=0.02	OPT f=23 TT=0.012 T1=0.01	OPT f=23 TT=0.001 T1=0	OPT f=23 TT=0.002 T1=0	OPT f=23 TT=0.001 T1=0	OPT f=23 TT=0.001 T1=0	OPT f=23 TT=0.184 T1=0.65	OPT f=23 TT=0.164 T1=0.12	OPT f=23 TT=0.014 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_005.opb.metafix.opb	OPT f=14 TT=0.001 T1=0	No data	OPT f=14 TT=0.023 T1=0.02	OPT f=14 TT=0.013 T1=0.01	OPT f=14 TT=0.002 T1=0	OPT f=14 TT=0.002 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.001 T1=0	OPT f=14 TT=0.183 T1=0.64	OPT f=14 TT=0.175 T1=0.14	OPT f=14 TT=0.017 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_006.opb.metafix.opb	OPT f=16 TT=0.001 T1=0	No data	OPT f=16 TT=0.022 T1=0.02	OPT f=16 TT=0.013 T1=0.01	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.003 T1=0.02	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.001 T1=0	OPT f=16 TT=0.184 T1=0.64	OPT f=16 TT=0.173 T1=0.14	OPT f=16 TT=0.017 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_007.opb.metafix.opb	OPT f=17 TT=0.001 T1=0	No data	OPT f=17 TT=0.022 T1=0.02	OPT f=17 TT=0.013 T1=0.01	OPT f=17 TT=0.002 T1=0	OPT f=17 TT=0.002 T1=0	OPT f=17 TT=0.001 T1=0	OPT f=17 TT=0.001 T1=0	OPT f=17 TT=0.184 T1=0.64	OPT f=17 TT=0.164 T1=0.13	OPT f=17 TT=0.017 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_008.opb.metafix.opb	OPT f=16 TT=0.001 T1=0	No data	OPT f=16 TT=0.021 T1=0.02	OPT f=16 TT=0.013 T1=0.01	OPT f=16 TT=0.001 T1=0	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.001 T1=0	OPT f=16 TT=0.002 T1=0	OPT f=16 TT=0.183 T1=0.7	OPT f=16 TT=0.163 T1=0.13	OPT f=16 TT=0.016 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_6x6_009.opb.metafix.opb	OPT f=18 TT=0.001 T1=0	No data	OPT f=18 TT=0.022 T1=0.02	OPT f=18 TT=0.013 T1=0.04	OPT f=18 TT=0.001 T1=0	OPT f=18 TT=0.002 T1=0	OPT f=18 TT=0.001 T1=0	OPT f=18 TT=0.001 T1=0	OPT f=18 TT=0.194 T1=0.64	OPT f=18 TT=0.164 T1=0.12	OPT f=18 TT=0.017 T1=0.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_000.opb.metafix.opb	OPT f=30 TT=0.003 T1=0	No data	OPT f=30 TT=0.022 T1=0.02	OPT f=30 TT=0.012 T1=0.06	OPT f=30 TT=0.003 T1=0	OPT f=30 TT=0.003 T1=0	OPT f=30 TT=0.004 T1=0.01	OPT f=30 TT=0.003 T1=0	OPT f=30 TT=0.184 T1=0.64	OPT f=30 TT=0.173 T1=0.13	OPT f=30 TT=0.018 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_001.opb.metafix.opb	OPT f=28 TT=0.004 T1=0	No data	OPT f=28 TT=0.022 T1=0.02	OPT f=28 TT=0.013 T1=0.01	OPT f=28 TT=0.01 T1=0	OPT f=28 TT=0.019 T1=0.01	OPT f=28 TT=0.004 T1=0	OPT f=28 TT=0.004 T1=0.01	OPT f=28 TT=0.195 T1=0.64	OPT f=28 TT=0.175 T1=0.15	OPT f=28 TT=0.022 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_002.opb.metafix.opb	OPT f=36 TT=0.003 T1=0	No data	OPT f=36 TT=0.022 T1=0.02	OPT f=36 TT=0.015 T1=0.01	OPT f=36 TT=0.009 T1=0.01	OPT f=36 TT=0.021 T1=0.02	OPT f=36 TT=0.005 T1=0	OPT f=36 TT=0.003 T1=0	OPT f=36 TT=0.184 T1=0.64	OPT f=36 TT=0.175 T1=0.14	OPT f=36 TT=0.045 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_003.opb.metafix.opb	OPT f=26 TT=0.006 T1=0	No data	OPT f=26 TT=0.024 T1=0.02	OPT f=26 TT=0.014 T1=0.01	OPT f=26 TT=0.011 T1=0.01	OPT f=26 TT=0.023 T1=0.02	OPT f=26 TT=0.007 T1=0	OPT f=26 TT=0.006 T1=0.01	OPT f=26 TT=0.204 T1=0.64	OPT f=26 TT=0.184 T1=0.15	OPT f=26 TT=0.044 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_004.opb.metafix.opb	OPT f=32 TT=0.002 T1=0	No data	OPT f=32 TT=0.022 T1=0.03	OPT f=32 TT=0.012 T1=0.01	OPT f=32 TT=0.002 T1=0	OPT f=32 TT=0.004 T1=0	OPT f=32 TT=0.002 T1=0	OPT f=32 TT=0.003 T1=0	OPT f=32 TT=0.184 T1=0.64	OPT f=32 TT=0.183 T1=0.14	OPT f=32 TT=0.018 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_005.opb.metafix.opb	OPT f=26 TT=0.003 T1=0	No data	OPT f=26 TT=0.023 T1=0.02	OPT f=26 TT=0.015 T1=0.01	OPT f=26 TT=0.008 T1=0	OPT f=26 TT=0.018 T1=0.01	OPT f=26 TT=0.003 T1=0	OPT f=26 TT=0.004 T1=0	OPT f=26 TT=0.184 T1=0.65	OPT f=26 TT=0.183 T1=0.14	OPT f=26 TT=0.02 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_006.opb.metafix.opb	OPT f=37 TT=0.003 T1=0	No data	OPT f=37 TT=0.022 T1=0.02	OPT f=37 TT=0.013 T1=0.01	OPT f=37 TT=0.009 T1=0	OPT f=37 TT=0.007 T1=0	OPT f=37 TT=0.003 T1=0	OPT f=37 TT=0.003 T1=0	OPT f=37 TT=0.183 T1=0.65	OPT f=37 TT=0.174 T1=0.13	OPT f=37 TT=0.021 T1=0.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_007.opb.metafix.opb	OPT f=30 TT=0.006 T1=0	No data	OPT f=30 TT=0.024 T1=0.02	OPT f=30 TT=0.014 T1=0.01	OPT f=30 TT=0.01 T1=0	OPT f=30 TT=0.02 T1=0.01	OPT f=30 TT=0.006 T1=0	OPT f=30 TT=0.007 T1=0	OPT f=30 TT=0.204 T1=0.64	OPT f=30 TT=0.193 T1=0.14	OPT f=30 TT=0.045 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_008.opb.metafix.opb	OPT f=31 TT=0.004 T1=0	No data	OPT f=31 TT=0.023 T1=0.02	OPT f=31 TT=0.013 T1=0.01	OPT f=31 TT=0.008 T1=0	OPT f=31 TT=0.015 T1=0.01	OPT f=31 TT=0.005 T1=0	OPT f=31 TT=0.004 T1=0	OPT f=31 TT=0.204 T1=0.66	OPT f=31 TT=0.186 T1=0.15	OPT f=31 TT=0.03 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/dt-problems/ normalized-lo_8x8_009.opb.metafix.opb	OPT f=27 TT=0.002 T1=0	No data	OPT f=27 TT=0.022 T1=0.02	OPT f=27 TT=0.012 T1=0.01	OPT f=27 TT=0.003 T1=0	OPT f=27 TT=0.003 T1=0	OPT f=27 TT=0.003 T1=0	OPT f=27 TT=0.002 T1=0	OPT f=27 TT=0.184 T1=0.64	OPT f=27 TT=0.174 T1=0.13	OPT f=27 TT=0.02 T1=0.01
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-aug4.5.opb		No data	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-aug5.5.opb	SAT f=1330 TT=1800.61 T1=1131.41	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT (TO) f=1650 TT=1800.08 T1=1800.4	SAT (TO) f=1380 TT=1800.07 T1=1800.4	SAT (TO) f=2110 TT=1800.08 T1=1801	SAT (TO) f=1450 TT=1800.02 T1=1801.1	SAT (TO) f=1380 TT=1802.38 T1=687.86	SAT (TO) f=1330 TT=1800.61 T1=1131.41	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-aug6.5.opb	SAT f=670 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT (TO) f=950 TT=1800.1 T1=1800.4	SAT (TO) f=890 TT=1800.11 T1=1800.8	SAT (TO) f=910 TT=1800.1 T1=1800.4	SAT (TO) f=670 TT=1800.06 T1=1800.4	SAT (TO) f=890 TT=1800.63 T1=766.43	SAT (TO) f=750 TT=1800.06 T1=1429.15	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-jul4.5.opb	UNSAT TT=2.508	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=2.809	UNSAT TT=13.916	UNSAT TT=2.528	UNSAT TT=2.508	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-jul5.5.opb	OPT f=1890 TT=20.245 T1=20.24	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=1890 TT=124.873 T1=124.92	OPT f=1890 TT=37.056 T1=37.03	OPT f=1890 TT=28.301 T1=28.29	OPT f=1890 TT=20.245 T1=20.24	SAT (TO) f=1890 TT=1801.06 T1=46.05	SAT (TO) f=1890 TT=1800.03 T1=111.92	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-jul6.5.opb	OPT f=790 TT=19.044 T1=19.02	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=790 TT=374.96 T1=375.02	OPT f=790 TT=19.044 T1=19.02	OPT f=790 TT=59.225 T1=59.22	OPT f=790 TT=41.315 T1=41.31	SAT (TO) f=890 TT=1800.75 T1=712.13	SAT (TO) f=790 TT=1800 T1=726.98	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-jun5.5.opb	OPT f=1450 TT=52.895 T1=52.93	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=1650 TT=1800.01 T1=1800.4	OPT f=1450 TT=52.895 T1=52.93	OPT f=1450 TT=137.349 T1=137.36	OPT f=1450 TT=78.669 T1=78.8	SAT (TO) f=1450 TT=1804.59 T1=603.06	SAT (TO) f=1450 TT=1800.06 T1=324.84	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-jun6.5.opb	OPT f=670 TT=34.447 T1=34.42	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=770 TT=1800.07 T1=1799.7	OPT f=670 TT=34.447 T1=34.42	OPT f=670 TT=112.992 T1=113	OPT f=670 TT=107.456 T1=107.46	SAT (TO) f=2110 TT=1800.12 T1=73.81	SAT (TO) f=670 TT=1800.02 T1=1665.94	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-may4.5.opb	OPT f=2110 TT=20.426 T1=9.36	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	OPT f=2110 TT=203.772 T1=203.79	OPT f=2110 TT=38.273 T1=38.37	OPT f=2110 TT=37.412 T1=37.48	OPT f=2110 TT=20.426 T1=21.24	SAT (TO) f=2110 TT=1810.25 T1=111.04	SAT (TO) f=2110 TT=1800.73 T1=9.36	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-may5.5.opb	OPT f=1010 TT=34.639 T1=34.63	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1110 TT=1800.01 T1=1800.3	OPT f=1010 TT=34.639 T1=34.63	OPT f=1010 TT=70.709 T1=70.71	OPT f=1010 TT=58.156 T1=58.15	SAT (TO) f=1010 TT=1818.21 T1=566.34	SAT (TO) f=1010 TT=1800.69 T1=538.27	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-may6.5.opb	OPT f=430 TT=15.455 T1=15.43	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=430 TT=204.385 T1=204.42	OPT f=430 TT=15.455 T1=15.43	OPT f=430 TT=23.407 T1=23.4	OPT f=430 TT=35.625 T1=35.63	SAT (TO) f=850 TT=1800.31 T1=890.59	SAT (TO) f=430 TT=1800.6 T1=1602.45	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-oct4.5.opb	UNSAT TT=2.729	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=3.204	UNSAT TT=14.654	UNSAT TT=2.766	UNSAT TT=2.729	? (TO) TT=1804.85	? (TO) TT=1800.02	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-oct5.5.opb	OPT f=1670 TT=27.581 T1=27.62	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=1670 TT=176.374 T1=176.4	OPT f=1670 TT=38.266 T1=38.24	OPT f=1670 TT=30.907 T1=30.9	OPT f=1670 TT=27.581 T1=27.62	SAT (TO) f=1670 TT=1800.11 T1=304.91	SAT (TO) f=1670 TT=1800.03 T1=147.01	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-oct6.5.opb	OPT f=1010 TT=20.481 T1=20.47	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	OPT f=1010 TT=137.347 T1=137.38	OPT f=1010 TT=23.024 T1=23	OPT f=1010 TT=23.828 T1=23.82	OPT f=1010 TT=20.481 T1=20.47	SAT (TO) f=1010 TT=1800.89 T1=447.28	SAT (TO) f=1010 TT=1800.03 T1=317.66	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-sep4.5.opb	UNSAT TT=3.683	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=3.683	UNSAT TT=24.989	UNSAT TT=14.661	UNSAT TT=14.857	? (TO) TT=1800.88	? (TO) TT=1800.03	? (TO) TT=1800.15
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-sep5.5.opb	SAT f=1230 TT=1800 T1=1593.09	No data	? (TO) TT=1800.13	? (TO) TT=1800.02	SAT (TO) f=1600 TT=1800.09 T1=1800.4	SAT (TO) f=1380 TT=1800.07 T1=1800.4	SAT (TO) f=2110 TT=1800.08 T1=1801.5	SAT (TO) f=1330 TT=1800.06 T1=1800.4	SAT (TO) f=1270 TT=1800.56 T1=881.73	SAT (TO) f=1230 TT=1800 T1=1593.09	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ EmployeeScheduling/normalized-sep6.5.opb	SAT f=550 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=890 TT=1800.1 T1=1800.4	SAT (TO) f=550 TT=1800.09 T1=1800.4	SAT (TO) f=910 TT=1800.07 T1=1800.6	SAT (TO) f=600 TT=1800.11 T1=1799.6	SAT (TO) f=1010 TT=1800.87 T1=668.03	SAT (TO) f=810 TT=1800.03 T1=1536.32	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern20-03.lin.opb	OPT f=-18 TT=0.001 T1=0	No data	OPT f=-18 TT=0.024 T1=0.03	OPT f=-18 TT=0.013 T1=0.01	OPT f=-18 TT=0.005 T1=0	OPT f=-18 TT=0.009 T1=0	OPT f=-18 TT=0.001 T1=0	OPT f=-18 TT=0.002 T1=0	OPT f=-18 TT=0.643 T1=3.14	OPT f=-18 TT=0.744 T1=0.23	OPT f=-18 TT=0.028 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern20-05.lin.opb	OPT f=-104 TT=42.668 T1=0.34	No data	? (TO) TT=1800.02	OPT f=-104 TT=960.763 T1=960.91	OPT f=-104 TT=363.304 T1=363.35	OPT f=-104 TT=451.082 T1=451.14	SAT (TO) f=-104 TT=1800.02 T1=1800.3	OPT f=-104 TT=234.592 T1=234.62	OPT f=-104 TT=108.42 T1=7.74	OPT f=-104 TT=42.668 T1=0.34	OPT f=-104 TT=323.272 T1=6.9
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern20-10.lin.opb	OPT f=-367 TT=196.05 T1=4.59	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-367 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-354 TT=1800.03 T1=1800.3	SAT (TO) f=-363 TT=1800.33 T1=1800.4	OPT f=-367 TT=660.044 T1=34.52	OPT f=-367 TT=196.05 T1=4.59	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern20-15.lin.opb	OPT f=-1490 TT=352.92 T1=23.35	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-1490 TT=1800.03 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-1443 TT=1800.02 T1=1800.3	? TT=82.92	OPT f=-1490 TT=1003.37 T1=65.28	OPT f=-1490 TT=352.92 T1=23.35	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern25-03.lin.opb	OPT f=-23 TT=0.002 T1=0	No data	OPT f=-23 TT=0.023 T1=0.02	OPT f=-23 TT=0.014 T1=0.01	OPT f=-23 TT=0.007 T1=0	OPT f=-23 TT=0.013 T1=0.01	OPT f=-23 TT=0.002 T1=0	OPT f=-23 TT=0.003 T1=0	OPT f=-23 TT=0.714 T1=4.15	OPT f=-23 TT=2.523 T1=1.09	OPT f=-23 TT=0.026 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern25-06.lin.opb	SAT f=-120 TT=1800.02 T1=4.48	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=-120 TT=1800.02 T1=1800.3	SAT (TO) f=-109 TT=1800.01 T1=1800.3	SAT (TO) f=-120 TT=1800.02 T1=1800.3	SAT (TO) f=-120 TT=1800.08 T1=1800.4	SAT (TO) f=-120 TT=1800.05 T1=16.91	SAT (TO) f=-120 TT=1800.07 T1=4.48	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern25-13.lin.opb	SAT f=-2037 TT=1800.07 T1=125.07	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=-2010 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-1973 TT=1800.02 T1=1800.3	? TT=79.128	SAT (TO) f=-2037 TT=1800.07 T1=514.52	SAT (TO) f=-2037 TT=1800.87 T1=125.07	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern25-19.lin.opb	SAT f=-3661 TT=1800.06 T1=1259.43	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=-3641 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.12 T1=1800.4	SAT (TO) f=-3577 TT=1800.02 T1=1800.3	? TT=73.005	SAT (TO) f=-3656 TT=1800.6 T1=515.81	SAT (TO) f=-3661 TT=1800.06 T1=1259.43	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern25-25.lin.opb	SAT f=-2666 TT=1800.47 T1=805.02	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT (TO) f=-2639 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.11 T1=1800.4	SAT (TO) f=-2525 TT=1800.02 T1=1800.3	? TT=75.09	SAT (TO) f=-2666 TT=1800.47 T1=805.02	SAT (TO) f=-2664 TT=1800 T1=130.7	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern30-04.lin.opb	SAT f=-81 TT=1800.02 T1=125.76	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-78 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-80 TT=1800.02 T1=1800.3	SAT (TO) f=-81 TT=1800.02 T1=1800.3	SAT (TO) f=-81 TT=1800.82 T1=125.76	SAT (TO) f=-81 TT=1800.06 T1=457.43	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern30-08.lin.opb	SAT f=-738 TT=1800.04 T1=787.89	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=-726 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-698 TT=1800.02 T1=1800.3	? TT=77.477	SAT (TO) f=-734 TT=1800.55 T1=484.38	SAT (TO) f=-738 TT=1800.04 T1=787.89	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern30-15.lin.opb	SAT f=-3916 TT=1800.05 T1=354.67	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=-3825 TT=1800.01 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-3810 TT=1800.02 T1=1800.3	? TT=83.416	SAT (TO) f=-3916 TT=1800.05 T1=354.67	SAT (TO) f=-3901 TT=1800.08 T1=1683.03	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern30-23.lin.opb	SAT f=-7539 TT=1800.01 T1=1700.18	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=-7435 TT=1800.01 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-7298 TT=1800.02 T1=1800.3	? TT=75.441	SAT (TO) f=-7443 TT=1800.53 T1=817.29	SAT (TO) f=-7539 TT=1800.01 T1=1700.18	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern30-30.lin.opb	SAT f=-2848 TT=1800.08 T1=1513.75	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=-2806 TT=1800.11 T1=1800.4	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-2708 TT=1800.02 T1=1800.3	? TT=79.686	SAT (TO) f=-2765 TT=1800.08 T1=576.5	SAT (TO) f=-2848 TT=1800.08 T1=1513.75	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern35-04.lin.opb	SAT f=-96 TT=1800.01 T1=1268.89	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=-89 TT=1800.03 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-93 TT=1800.02 T1=1800.3	SAT (TO) f=-96 TT=1800.02 T1=1800.3	SAT (TO) f=-94 TT=1800.37 T1=759.09	SAT (TO) f=-96 TT=1800.01 T1=1268.89	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern35-09.lin.opb	SAT f=-1240 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-1240 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.11 T1=1800.4	SAT (TO) f=-1183 TT=1800.02 T1=1800.3	? TT=82.183	SAT (TO) f=-1228 TT=1800.1 T1=364.97	SAT (TO) f=-1234 TT=1800.31 T1=1085.17	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern35-18.lin.opb	SAT f=-3845 TT=1800.47 T1=694.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT (TO) f=-3703 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.11 T1=1800.4	SAT (TO) f=-3754 TT=1800.02 T1=1800.3	? TT=74.915	SAT (TO) f=-3845 TT=1800.47 T1=694.4	No Cert. TT=1800.83	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern35-26.lin.opb	SAT f=-6641 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT (TO) f=-6585 TT=1800.11 T1=1800.4	SAT (TO) f=0 TT=1800.09 T1=1800.7	SAT (TO) f=-6641 TT=1800.02 T1=1800.3	? TT=86.544	SAT (TO) f=-6098 TT=1800.36 T1=936.49	SAT (TO) f=-6429 TT=1800 T1=1630.7	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern40-05.lin.opb	SAT f=-217 TT=1800.09 T1=697.01	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-213 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.09 T1=1800.4	SAT (TO) f=-198 TT=1800.02 T1=1800.3	SAT (TO) f=-217 TT=1800.09 T1=1800.4	SAT (TO) f=-217 TT=1800.64 T1=697.01	SAT (TO) f=-212 TT=1800.76 T1=353.75	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern40-10.lin.opb	SAT f=-1001 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=-1001 TT=1800.11 T1=1800.4	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-968 TT=1800.02 T1=1800.3	? TT=75.006	SAT (TO) f=-996 TT=1800.19 T1=292.54	SAT (TO) f=-844 TT=1801 T1=1670.96	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern40-20.lin.opb	SAT f=-12381 TT=1800.59 T1=922.61	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT (TO) f=-12169 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-12199 TT=1800.11 T1=1800.4	? TT=88.359	SAT (TO) f=-12381 TT=1800.59 T1=922.61	SAT (TO) f=-9697 TT=1800.06 T1=1242.17	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern40-30.lin.opb	SAT f=-11314 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.15	? (TO) TT=1800.03	SAT (TO) f=-10582 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.07 T1=1800.3	SAT (TO) f=-11314 TT=1800.02 T1=1800.3	? TT=89.566	SAT (TO) f=-9475 TT=1800.14 T1=682.06	SAT (TO) f=-9953 TT=1800.08 T1=1433.33	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern45-05.lin.opb	SAT f=-250 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=-235 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-249 TT=1800.02 T1=1800.3	SAT (TO) f=-250 TT=1800.09 T1=1800.4	SAT (TO) f=-238 TT=1800.21 T1=900.97	SAT (TO) f=-230 TT=1800.39 T1=670.77	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern45-11.lin.opb	SAT f=-3092 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=-3092 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.11 T1=1800.4	SAT (TO) f=-2947 TT=1800.02 T1=1800.3	? TT=79.063	SAT (TO) f=-3016 TT=1800.17 T1=285.19	SAT (TO) f=-2487 TT=1800.04 T1=1597.95	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern50-06.lin.opb	SAT f=-270 TT=1800.01 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-270 TT=1800.01 T1=1800.3	SAT (TO) f=0 TT=1800.01 T1=1800.3	SAT (TO) f=-216 TT=1800.01 T1=1800.4	SAT (TO) f=-253 TT=1800.06 T1=1800.4	SAT (TO) f=-242 TT=1800.66 T1=111.22	SAT (TO) f=-207 TT=1800.67 T1=1687.11	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern50-13.lin.opb	SAT f=-5712 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=-5712 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.08 T1=1800.4	SAT (TO) f=-5036 TT=1800.02 T1=1800.3	? TT=78.072	SAT (TO) f=-5531 TT=1800.12 T1=337.74	SAT (TO) f=-2977 TT=1800.02 T1=1310.96	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern55-06.lin.opb	SAT f=-300 TT=1800.07 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=-300 TT=1800.07 T1=1800.4	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-298 TT=1800.02 T1=1800.3	SAT (TO) f=-267 TT=1800.04 T1=1800.4	SAT (TO) f=-261 TT=1800.11 T1=626.82	SAT (TO) f=-202 TT=1800.02 T1=1656.7	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern55-14.lin.opb	SAT f=-3989 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT (TO) f=-3989 TT=1800.08 T1=1800.4	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-3779 TT=1800.02 T1=1800.3	? TT=76.485	SAT (TO) f=-3937 TT=1800.1 T1=319.7	SAT (TO) f=-1841 TT=1800.73 T1=1610.72	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern60-08.lin.opb	SAT f=-1618 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT (TO) f=-1618 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-1599 TT=1800.02 T1=1800.3	? TT=81.626	SAT (TO) f=-1492 TT=1800.74 T1=613.38	SAT (TO) f=-1084 TT=1800.06 T1=1402.86	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-autocorr_bern60-15.lin.opb	SAT f=-10786 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT (TO) f=-10786 TT=1800.05 T1=1800.4	SAT (TO) f=0 TT=1800.08 T1=1800.4	SAT (TO) f=-9976 TT=1800.02 T1=1800.3	? TT=82.875	SAT (TO) f=-9972 TT=1800.4 T1=635.64	No Cert. TT=1800.01	? (TO) TT=1800.01
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-crossdock_15x7.lin.opb	SAT f=14604 TT=1800.59 T1=49.48	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=15406 TT=1800.1 T1=1800.4	SAT (TO) f=16543 TT=1800.08 T1=1800.4	SAT (TO) f=15236 TT=1800.02 T1=1800.3	? TT=73.131	SAT (TO) f=14604 TT=1800.59 T1=49.48	SAT (TO) f=14863 TT=1800 T1=10.82	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-010.lin.opb	OPT f=1 TT=0.004 T1=0	No data	OPT f=1 TT=0.079 T1=0.08	OPT f=1 TT=0.037 T1=0.03	OPT f=1 TT=0.029 T1=0.02	OPT f=1 TT=0.033 T1=0.03	OPT f=1 TT=0.004 T1=0	OPT f=1 TT=0.03 T1=0.03	OPT f=1 TT=1.573 T1=0.7	OPT f=1 TT=0.624 T1=0.21	OPT f=1 TT=0.09 T1=0.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-020.lin.opb	OPT f=11 TT=0.527 T1=0.53	No data	OPT f=11 TT=465.099 T1=465.17	OPT f=11 TT=119.184 T1=119.21	OPT f=11 TT=1.278 T1=1.27	OPT f=11 TT=1.575 T1=1.71	OPT f=11 TT=0.527 T1=0.53	OPT f=11 TT=1.708 T1=1.7	OPT f=11 TT=343.274 T1=32.04	OPT f=11 TT=185.83 T1=1.01	OPT f=11 TT=1009.84 T1=601.74
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-030.lin.opb	OPT f=52 TT=52.208 T1=52.22	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=60 TT=1800.03 T1=1800.3	OPT f=52 TT=1369.95 T1=1370.15	OPT f=52 TT=52.208 T1=52.22	OPT f=52 TT=1144.91 T1=1145.08	SAT (TO) f=56 TT=1800.74 T1=25.34	SAT (TO) f=56 TT=1800 T1=1.05	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-040.lin.opb	SAT f=143 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=211 TT=1800.02 T1=1800.3	SAT (TO) f=207 TT=1800.02 T1=1800.3	SAT (TO) f=143 TT=1800.02 T1=1800.3	SAT (TO) f=170 TT=1800.02 T1=1800.3	SAT (TO) f=178 TT=1800.26 T1=1072.37	SAT (TO) f=190 TT=1800.1 T1=660.5	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-050.lin.opb	SAT f=291 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=293 TT=1800.11 T1=1800.4	SAT (TO) f=353 TT=1800.1 T1=1800.4	SAT (TO) f=436 TT=1800.03 T1=1800.3	SAT (TO) f=291 TT=1800.1 T1=1800.4	SAT (TO) f=345 TT=1800.3 T1=1047.69	SAT (TO) f=327 TT=1801.07 T1=1735.74	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-070.lin.opb	SAT f=741 TT=1800.08 T1=1800.4	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=792 TT=1800.02 T1=1800.3	SAT (TO) f=1013 TT=1800.03 T1=1800.3	SAT (TO) f=810 TT=1800.02 T1=1800.3	SAT (TO) f=741 TT=1800.08 T1=1800.4	SAT (TO) f=767 TT=1800.08 T1=930.31	SAT (TO) f=788 TT=1800.02 T1=1639.67	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross10-090.lin.opb	OPT f=1387 TT=25.998 T1=26	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1501 TT=1800.06 T1=1800.4	SAT (TO) f=1646 TT=1800.02 T1=1800.3	OPT f=1387 TT=25.998 T1=26	SAT (TO) f=1407 TT=1800.11 T1=1800.4	SAT (TO) f=1401 TT=1800.58 T1=51.03	SAT (TO) f=1387 TT=1800.02 T1=1505.57	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross14-019.lin.opb	OPT f=4 TT=4.673 T1=4.67	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=4 TT=146.724 T1=146.74	OPT f=4 TT=189.922 T1=189.95	OPT f=4 TT=4.673 T1=4.67	OPT f=4 TT=120.959 T1=120.97	SAT (TO) f=6 TT=1800.03 T1=14.35	SAT (TO) f=6 TT=1800.64 T1=3.2	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross14-058.lin.opb	SAT f=473 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=494 TT=1800.02 T1=1800.3	SAT (TO) f=692 TT=1800.02 T1=1800.3	SAT (TO) f=639 TT=1800.02 T1=1800.3	SAT (TO) f=473 TT=1800.06 T1=1800.4	SAT (TO) f=511 TT=1800.52 T1=686.45	SAT (TO) f=564 TT=1800.08 T1=824.9	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross14-098.lin.opb	SAT f=1552 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1708 TT=1800.02 T1=1800.3	SAT (TO) f=2143 TT=1800.02 T1=1800.3	SAT (TO) f=1864 TT=1800.02 T1=1800.3	SAT (TO) f=1552 TT=1800.06 T1=1800.4	SAT (TO) f=1721 TT=1800.45 T1=751.29	SAT (TO) f=2078 TT=1800 T1=367.81	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross14-117.lin.opb	SAT f=2331 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=2552 TT=1800.01 T1=1800.3	SAT (TO) f=3011 TT=1800.09 T1=1800.4	SAT (TO) f=2665 TT=1800.02 T1=1800.3	SAT (TO) f=2331 TT=1800.05 T1=1800.4	SAT (TO) f=2570 TT=1800.26 T1=927.59	SAT (TO) f=2727 TT=1800.64 T1=1261.88	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross14-137.lin.opb	SAT f=3240 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=3570 TT=1800.09 T1=1800.4	SAT (TO) f=4129 TT=1800.01 T1=1800.3	SAT (TO) f=3663 TT=1800.02 T1=1800.3	SAT (TO) f=3240 TT=1800.05 T1=1800.4	SAT (TO) f=3615 TT=1800.14 T1=337.98	SAT (TO) f=4061 TT=1800.09 T1=1680.81	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross14-176.lin.opb	SAT f=5989 TT=1800.03 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=6251 TT=1800.1 T1=1800.4	SAT (TO) f=6872 TT=1800.07 T1=1800.5	SAT (TO) f=6437 TT=1800.02 T1=1800.3	SAT (TO) f=5989 TT=1800.03 T1=1800.4	SAT (TO) f=6381 TT=1800.01 T1=982.97	No Cert. TT=1800.07	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross20-040.lin.opb	SAT f=103 TT=1800.1 T1=1800.5	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=157 TT=1800.11 T1=1800.4	SAT (TO) f=377 TT=1800.02 T1=1800.3	SAT (TO) f=258 TT=1800.01 T1=1800.3	SAT (TO) f=103 TT=1800.1 T1=1800.5	SAT (TO) f=216 TT=1800.09 T1=707.13	SAT (TO) f=199 TT=1800.74 T1=1611.95	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross20-080.lin.opb	SAT f=831 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=993 TT=1800.04 T1=1800.5	SAT (TO) f=1457 TT=1800.09 T1=1800.4	SAT (TO) f=1115 TT=1800.02 T1=1800.3	SAT (TO) f=831 TT=1800.1 T1=1800.4	SAT (TO) f=1142 TT=1800.49 T1=236.62	SAT (TO) f=1221 TT=1800.07 T1=1010.67	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross22-048.lin.opb	SAT f=170 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=277 TT=1800.02 T1=1800.3	SAT (TO) f=549 TT=1800.01 T1=1800.3	SAT (TO) f=384 TT=1800.02 T1=1800.3	SAT (TO) f=170 TT=1800.09 T1=1800.4	SAT (TO) f=261 TT=1800.06 T1=34.67	SAT (TO) f=364 TT=1800.05 T1=19.72	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross22-096.lin.opb	SAT f=1342 TT=1800.05 T1=1800.4	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=1568 TT=1800.08 T1=1800.4	SAT (TO) f=2221 TT=1800.11 T1=1800.4	SAT (TO) f=1630 TT=1800.02 T1=1800.3	SAT (TO) f=1342 TT=1800.05 T1=1800.4	SAT (TO) f=1896 TT=1800.48 T1=239.84	SAT (TO) f=2105 TT=1800.65 T1=134.56	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross24-057.lin.opb	SAT f=341 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=474 TT=1800.02 T1=1800.3	SAT (TO) f=741 TT=1800.02 T1=1800.3	SAT (TO) f=525 TT=1800.02 T1=1800.3	SAT (TO) f=341 TT=1800.1 T1=1800.4	SAT (TO) f=561 TT=1800.83 T1=116.32	SAT (TO) f=550 TT=1800.01 T1=1413.82	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-edgecross24-115.lin.opb	SAT f=2102 TT=1800.27 T1=1800.4	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=2393 TT=1800.06 T1=1800.4	SAT (TO) f=3269 TT=1800.09 T1=1800.4	SAT (TO) f=2365 TT=1800.01 T1=1800.3	SAT (TO) f=2102 TT=1800.27 T1=1800.4	SAT (TO) f=2597 TT=1800.58 T1=424.37	SAT (TO) f=3259 TT=1800.04 T1=1379.5	? (TO) TT=1800.06
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay20h.lin.opb	SAT f=16470 TT=1800.66 T1=1666.11	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=17676 TT=1800.09 T1=1800.4	SAT (TO) f=22909 TT=1800.09 T1=1800.4	SAT (TO) f=16691 TT=1800.02 T1=1800.3	? TT=76.373	SAT (TO) f=17162 TT=1800.83 T1=17.11	SAT (TO) f=16470 TT=1800.66 T1=1666.11	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay25.lin.opb	SAT f=5216 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=5307 TT=1800.09 T1=1800.4	SAT (TO) f=6435 TT=1800.07 T1=1800.4	SAT (TO) f=5216 TT=1800.02 T1=1800.3	? TT=76.038	SAT (TO) f=5412 TT=1800.67 T1=72.59	SAT (TO) f=5413 TT=1800.01 T1=10.67	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay30h.lin.opb	SAT f=50985 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=54002 TT=1800.08 T1=1800.5	SAT (TO) f=65126 TT=1800.05 T1=1800.4	SAT (TO) f=50985 TT=1800.02 T1=1800.3	? TT=72.674	SAT (TO) f=55049 TT=1800.46 T1=915.36	No Cert. TT=1800	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay30.lin.opb	SAT f=9772 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT (TO) f=9987 TT=1800.13 T1=1800.4	SAT (TO) f=11400 TT=1800.06 T1=1800.4	SAT (TO) f=9772 TT=1800.02 T1=1800.3	? TT=74.133	SAT (TO) f=10090 TT=1800.96 T1=209.33	SAT (TO) f=10090 TT=1800.05 T1=131.29	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay33.lin.opb	SAT f=72340 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=73008 TT=1800.11 T1=1800.4	SAT (TO) f=86090 TT=1800.05 T1=1800.4	SAT (TO) f=72340 TT=1800.02 T1=1800.3	? TT=78.855	SAT (TO) f=73959 TT=1801.35 T1=709.65	SAT (TO) f=73853 TT=1802.26 T1=990.37	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-faclay35.lin.opb	SAT f=82120 TT=1800.01 T1=1800.4	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=82120 TT=1800.01 T1=1800.4	SAT (TO) f=98871 TT=1800.03 T1=1800.4	SAT (TO) f=83242 TT=1800.02 T1=1800.3	? TT=79.978	SAT (TO) f=84001 TT=1800.1 T1=191.99	SAT (TO) f=84001 TT=1800.57 T1=150.97	? (TO) TT=1800.14
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2pm-0044-0044.lin.opb	OPT f=-13 TT=0.009 T1=0	No data	OPT f=-13 TT=0.317 T1=0.31	OPT f=-13 TT=0.45 T1=0.44	OPT f=-13 TT=0.042 T1=0.04	OPT f=-13 TT=0.035 T1=0.03	OPT f=-13 TT=0.009 T1=0	OPT f=-13 TT=0.011 T1=0.01	OPT f=-13 TT=5.297 T1=2.68	OPT f=-13 TT=1.902 T1=0.72	OPT f=-13 TT=0.814 T1=0.43
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2pm-0055-0055.lin.opb	OPT f=-20 TT=0.046 T1=0.04	No data	OPT f=-20 TT=106.088 T1=106.1	OPT f=-20 TT=255.652 T1=255.69	OPT f=-20 TT=0.145 T1=0.14	OPT f=-20 TT=0.11 T1=0.11	OPT f=-20 TT=0.046 T1=0.04	OPT f=-20 TT=0.106 T1=0.1	OPT f=-20 TT=691.137 T1=97.32	OPT f=-20 TT=337.71 T1=17.99	OPT f=-20 TT=869.282 T1=0.55
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2pm-0066-0066.lin.opb	OPT f=-29 TT=0.122 T1=0.12	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	OPT f=-29 TT=0.25 T1=0.25	OPT f=-29 TT=0.262 T1=0.26	OPT f=-29 TT=0.948 T1=0.94	OPT f=-29 TT=0.122 T1=0.12	SAT (TO) f=-27 TT=1800.59 T1=12.24	SAT (TO) f=-27 TT=1800.64 T1=1465.72	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2pm-0077-0777.lin.opb	OPT f=-40 TT=0.095 T1=0.09	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	OPT f=-40 TT=0.576 T1=0.61	OPT f=-40 TT=0.634 T1=0.63	OPT f=-40 TT=0.095 T1=0.09	OPT f=-40 TT=0.362 T1=0.36	SAT (TO) f=-35 TT=1800.16 T1=28.82	SAT (TO) f=-33 TT=1800.08 T1=0.55	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2pm-0088-0888.lin.opb	OPT f=-55 TT=0.076 T1=0.07	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=-55 TT=0.627 T1=0.62	OPT f=-55 TT=0.505 T1=0.7	OPT f=-55 TT=0.076 T1=0.07	OPT f=-55 TT=0.255 T1=0.25	SAT (TO) f=-48 TT=1800.75 T1=3.28	SAT (TO) f=-48 TT=1800.03 T1=0.78	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_2pm-0099-0999.lin.opb	OPT f=-64 TT=2.083 T1=2.08	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	OPT f=-64 TT=4.398 T1=4.39	OPT f=-64 TT=4.218 T1=4.22	OPT f=-64 TT=16.441 T1=16.44	OPT f=-64 TT=2.083 T1=2.08	SAT (TO) f=-55 TT=1800.74 T1=38.14	SAT (TO) f=-49 TT=1800.07 T1=0.75	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3pm-0234-0234.lin.opb	OPT f=-20 TT=0.218 T1=0.21	No data	? (TO) TT=1800.01	OPT f=-20 TT=425.159 T1=425.22	OPT f=-20 TT=0.218 T1=0.21	OPT f=-20 TT=0.222 T1=0.22	OPT f=-20 TT=0.71 T1=0.71	OPT f=-20 TT=0.221 T1=0.22	OPT f=-20 TT=1142.56 T1=159.55	OPT f=-20 TT=713.076 T1=413.69	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3pm-0244-0244.lin.opb	OPT f=-28 TT=1.171 T1=1.17	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	OPT f=-28 TT=2.809 T1=2.8	OPT f=-28 TT=2.141 T1=2.14	OPT f=-28 TT=18.386 T1=18.38	OPT f=-28 TT=1.171 T1=1.17	SAT (TO) f=-25 TT=1800.66 T1=8.73	SAT (TO) f=-23 TT=1800.67 T1=0.25	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3pm-0333-0333.lin.opb	OPT f=-26 TT=0.844 T1=0.84	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=-26 TT=1.41 T1=1.41	OPT f=-26 TT=1.003 T1=1	OPT f=-26 TT=8.115 T1=8.11	OPT f=-26 TT=0.844 T1=0.84	SAT (TO) f=-23 TT=1800.16 T1=260.04	SAT (TO) f=-23 TT=1800.05 T1=1228.05	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3pm-0334-0334.lin.opb	OPT f=-36 TT=1.92 T1=1.92	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=-36 TT=6.403 T1=6.4	OPT f=-36 TT=6.533 T1=6.53	OPT f=-36 TT=58.994 T1=59	OPT f=-36 TT=1.92 T1=1.92	SAT (TO) f=-31 TT=1800.04 T1=2.75	SAT (TO) f=-31 TT=1800.08 T1=0.32	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3pm-0344-0344.lin.opb	OPT f=-48 TT=45.003 T1=45.01	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	OPT f=-48 TT=542.107 T1=542.18	OPT f=-48 TT=145.485 T1=145.5	SAT (TO) f=0 TT=1800.02 T1=1800.3	OPT f=-48 TT=45.003 T1=45.01	SAT (TO) f=-35 TT=1803.3 T1=12.38	SAT (TO) f=-32 TT=1800.09 T1=0.57	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ minlplib2-pb-0.1.0/opb/ normalized-graphpart_3pm-0444-0444.lin.opb	SAT f=-65 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-65 TT=1800.02 T1=1800.3	SAT (TO) f=-65 TT=1800.03 T1=1800.5	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-65 TT=1800.02 T1=1800.3	SAT (TO) f=-48 TT=1800.66 T1=41.61	SAT (TO) f=-48 TT=1800.08 T1=32.96	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-graphpart_clique-20.lin.opb	OPT f=147 TT=42.95 T1=0.28	No data	? (TO) TT=1800.02	OPT f=147 TT=983.758 T1=983.91	SAT (TO) f=189 TT=1800.02 T1=1800.3	OPT f=147 TT=351.851 T1=352.08	OPT f=147 TT=955.824 T1=955.97	OPT f=147 TT=264.389 T1=264.46	OPT f=147 TT=114.067 T1=0.77	OPT f=147 TT=42.95 T1=0.28	OPT f=147 TT=599.318 T1=599.55
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-graphpart_clique-30.lin.opb	SAT f=495 TT=1800.02 T1=0.43	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=874 TT=1800.02 T1=1800.3	SAT (TO) f=910 TT=1800.1 T1=1800.4	SAT (TO) f=495 TT=1800.02 T1=1800.3	SAT (TO) f=928 TT=1800.05 T1=1800.4	SAT (TO) f=495 TT=1800.17 T1=0.85	SAT (TO) f=495 TT=1800.64 T1=0.43	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-graphpart_clique-40.lin.opb	SAT f=1183 TT=1800.02 T1=0.59	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=2499 TT=1800.11 T1=1800.4	SAT (TO) f=2132 TT=1800.08 T1=1800.4	SAT (TO) f=1183 TT=1800.02 T1=1800.3	? TT=69.823	SAT (TO) f=1183 TT=1800.07 T1=4.81	SAT (TO) f=1183 TT=1800.07 T1=0.59	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-graphpart_clique-50.lin.opb	SAT f=2312 TT=1800.01 T1=0.56	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=5250 TT=1800.01 T1=1800.3	SAT (TO) f=3889 TT=1800.03 T1=1800.4	SAT (TO) f=2312 TT=1800.01 T1=1800.3	? TT=74.084	SAT (TO) f=2312 TT=1800.08 T1=2.5	SAT (TO) f=2312 TT=1800.01 T1=0.56	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-graphpart_clique-60.lin.opb	SAT f=3990 TT=1800.02 T1=0.78	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=9658 TT=1800.1 T1=1800.4	SAT (TO) f=8457 TT=1800.07 T1=1800.4	SAT (TO) f=3990 TT=1800.02 T1=1800.3	? TT=72.532	SAT (TO) f=3990 TT=1800.05 T1=1.54	SAT (TO) f=3990 TT=1800.85 T1=0.78	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-graphpart_clique-70.lin.opb	SAT f=6348 TT=1800 T1=0.83	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=15813 TT=1800.06 T1=1800.4	SAT (TO) f=14109 TT=1800.05 T1=1800.4	SAT (TO) f=6348 TT=1800.02 T1=1800.3	? TT=71.925	SAT (TO) f=6348 TT=1800.07 T1=2.67	SAT (TO) f=6348 TT=1800 T1=0.83	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/ opb/normalized-hmittelman.lin.opb	OPT f=13 TT=0.001 T1=0	No data	OPT f=13 TT=0.022 T1=0.02	OPT f=13 TT=0.013 T1=0.01	OPT f=13 TT=0.003 T1=0	OPT f=13 TT=0.005 T1=0	OPT f=13 TT=0.001 T1=0	OPT f=13 TT=0.002 T1=0	OPT f=13 TT=0.174 T1=1.14	OPT f=13 TT=0.174 T1=0.15	OPT f=13 TT=0.021 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament06.lin.opb	OPT f=-6 TT=0.001 T1=0	No data	OPT f=-6 TT=0.025 T1=0.02	OPT f=-6 TT=0.015 T1=0.01	OPT f=-6 TT=0.008 T1=0	OPT f=-6 TT=0.013 T1=0.25	OPT f=-6 TT=0.001 T1=0.01	OPT f=-6 TT=0.003 T1=0	OPT f=-6 TT=0.765 T1=2.14	OPT f=-6 TT=0.403 T1=0.15	OPT f=-6 TT=0.027 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament08.lin.opb	OPT f=-12 TT=0.003 T1=0	No data	OPT f=-12 TT=0.046 T1=0.04	OPT f=-12 TT=0.049 T1=0.04	OPT f=-12 TT=0.044 T1=0.04	OPT f=-12 TT=0.04 T1=0.04	OPT f=-12 TT=0.003 T1=0	OPT f=-12 TT=0.033 T1=0.03	OPT f=-12 TT=25.57 T1=3.16	OPT f=-12 TT=11.663 T1=1.48	OPT f=-12 TT=42.154 T1=1.22
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament10.lin.opb	OPT f=-22 TT=0.011 T1=0.01	No data	OPT f=-22 TT=4.097 T1=4.09	OPT f=-22 TT=5.788 T1=5.78	OPT f=-22 TT=0.651 T1=0.65	OPT f=-22 TT=0.41 T1=0.41	OPT f=-22 TT=0.011 T1=0.01	OPT f=-22 TT=0.608 T1=0.6	SAT (TO) f=-21 TT=1800.02 T1=35.69	SAT (TO) f=-18 TT=1800.05 T1=181.57	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament12.lin.opb	OPT f=-34 TT=0.01 T1=0.01	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	OPT f=-34 TT=520 T1=520.08	OPT f=-34 TT=209.945 T1=209.97	OPT f=-34 TT=0.01 T1=0.01	OPT f=-34 TT=87.56 T1=87.57	SAT (TO) f=-32 TT=1800.08 T1=191.22	SAT (TO) f=-28 TT=1800.03 T1=12.89	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament16.lin.opb	OPT f=-65 TT=1.602 T1=1.6	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-60 TT=1800.02 T1=1800.3	SAT (TO) f=-58 TT=1800.01 T1=1800.3	OPT f=-65 TT=1.602 T1=1.6	SAT (TO) f=-61 TT=1800.02 T1=1800.3	SAT (TO) f=-49 TT=1800.08 T1=385.23	SAT (TO) f=-43 TT=1800.07 T1=451.47	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament18.lin.opb	OPT f=-80 TT=90.745 T1=90.75	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=-74 TT=1800.02 T1=1800.3	SAT (TO) f=-71 TT=1800.01 T1=1800.3	OPT f=-80 TT=90.745 T1=90.75	SAT (TO) f=-74 TT=1800.03 T1=1800.3	SAT (TO) f=-66 TT=1800.02 T1=196.37	SAT (TO) f=-50 TT=1800.04 T1=0.35	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament20.lin.opb	OPT f=-96 TT=729.564 T1=729.67	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-86 TT=1800.02 T1=1800.3	SAT (TO) f=-88 TT=1800.09 T1=1800.4	OPT f=-96 TT=729.564 T1=729.67	SAT (TO) f=-86 TT=1800.02 T1=1800.3	SAT (TO) f=-71 TT=1800.06 T1=60.58	SAT (TO) f=-65 TT=1800.02 T1=5.49	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament22.lin.opb	SAT f=-107 TT=1800.03 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-85 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-54 TT=1800.01 T1=1800.3	SAT (TO) f=-107 TT=1800.03 T1=1800.3	SAT (TO) f=-87 TT=1800.12 T1=748.35	SAT (TO) f=-77 TT=1800.08 T1=1143.02	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament24.lin.opb	SAT f=-121 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=-107 TT=1800.01 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-65 TT=1800.02 T1=1800.3	SAT (TO) f=-121 TT=1800.11 T1=1800.4	SAT (TO) f=-97 TT=1800.73 T1=132.82	SAT (TO) f=-73 TT=1800.04 T1=436.33	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament26.lin.opb	SAT f=-142 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-122 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800 T1=1800.3	SAT (TO) f=-68 TT=1800.02 T1=1800.3	SAT (TO) f=-142 TT=1800.02 T1=1800.3	SAT (TO) f=-112 TT=1800.08 T1=744.29	SAT (TO) f=-102 TT=1800.78 T1=3.22	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament28.lin.opb	SAT f=-156 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-125 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-75 TT=1800.03 T1=1800.3	SAT (TO) f=-156 TT=1800.02 T1=1800.3	SAT (TO) f=-118 TT=1800.08 T1=436.75	SAT (TO) f=-96 TT=1800.02 T1=491.86	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament30.lin.opb	SAT f=-168 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=-139 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.11 T1=1800.4	SAT (TO) f=-79 TT=1800.02 T1=1800.3	SAT (TO) f=-168 TT=1800.02 T1=1800.3	SAT (TO) f=-146 TT=1800.05 T1=176.04	SAT (TO) f=-109 TT=1800.03 T1=26.49	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament32.lin.opb	SAT f=-187 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=-153 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=-98 TT=1800.02 T1=1800.3	SAT (TO) f=-187 TT=1800.02 T1=1800.3	SAT (TO) f=-149 TT=1800.15 T1=828.13	SAT (TO) f=-126 TT=1800.93 T1=326.97	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament34.lin.opb	SAT f=-221 TT=1800.02 T1=1800.3	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=-195 TT=1800.03 T1=1800.3	SAT (TO) f=0 TT=1800.01 T1=1800.3	SAT (TO) f=-96 TT=1800.02 T1=1800.3	SAT (TO) f=-221 TT=1800.02 T1=1800.3	SAT (TO) f=-178 TT=1800.37 T1=459.67	SAT (TO) f=-147 TT=1800.06 T1=1610.38	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament36.lin.opb	SAT f=-224 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-201 TT=1800.03 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-89 TT=1800.02 T1=1800.3	SAT (TO) f=-224 TT=1800.09 T1=1800.4	SAT (TO) f=-181 TT=1800.04 T1=572.61	SAT (TO) f=-164 TT=1801.08 T1=91.74	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament38.lin.opb	SAT f=-264 TT=1800.06 T1=1800.4	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=-228 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.09 T1=1800.4	SAT (TO) f=-104 TT=1800.02 T1=1800.3	SAT (TO) f=-264 TT=1800.06 T1=1800.4	SAT (TO) f=-212 TT=1800.13 T1=523.92	SAT (TO) f=-174 TT=1802.05 T1=34.22	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament40.lin.opb	SAT f=-287 TT=1800.11 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=-263 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.01 T1=1800.3	SAT (TO) f=-107 TT=1800.02 T1=1800.3	SAT (TO) f=-287 TT=1800.11 T1=1800.4	SAT (TO) f=-237 TT=1800.05 T1=518.55	SAT (TO) f=-186 TT=1800 T1=498.08	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament42.lin.opb	SAT f=-313 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT (TO) f=-296 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-138 TT=1800.01 T1=1800.3	SAT (TO) f=-313 TT=1800.1 T1=1800.4	SAT (TO) f=-265 TT=1800.02 T1=665.56	SAT (TO) f=-224 TT=1801 T1=247.38	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament44.lin.opb	SAT f=-339 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=-307 TT=1800.03 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-150 TT=1800.02 T1=1800.3	SAT (TO) f=-339 TT=1800.1 T1=1800.4	SAT (TO) f=-278 TT=1800.45 T1=562.42	SAT (TO) f=-237 TT=1800 T1=14.53	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament46.lin.opb	SAT f=-381 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-335 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.11 T1=1800.4	SAT (TO) f=-162 TT=1800.02 T1=1800.3	SAT (TO) f=-381 TT=1800.09 T1=1800.4	SAT (TO) f=-310 TT=1800.46 T1=698.88	SAT (TO) f=-249 TT=1800.84 T1=160.98	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament48.lin.opb	SAT f=-434 TT=1800.1 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=-401 TT=1800.1 T1=1800.4	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-204 TT=1800.02 T1=1800.3	SAT (TO) f=-434 TT=1800.1 T1=1800.4	SAT (TO) f=-361 TT=1800.04 T1=691.15	SAT (TO) f=-300 TT=1800.07 T1=356.24	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-LIN/minlplib2-pb-0.1.0/opb/ normalized-sporttournament50.lin.opb	SAT f=-445 TT=1800.09 T1=1800.4	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=-406 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.1 T1=1800.4	SAT (TO) f=-174 TT=1800.02 T1=1800.3	SAT (TO) f=-445 TT=1800.09 T1=1800.4	SAT (TO) f=-380 TT=1800.16 T1=395.33	SAT (TO) f=-293 TT=1800.7 T1=243.88	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm25p-opt.opb.negationfix.opb	SAT f=34 TT=1800.02 T1=12.06	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT (TO) f=84 TT=1800.49 T1=1800.4	? TT=75.235	? TT=75.103	SAT (TO) f=34 TT=1802.52 T1=12.06	SAT (TO) f=34 TT=1800.02 T1=1695.54	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm50p-opt.opb.negationfix.opb	SAT f=66 TT=1800.03 T1=1029.14	No data	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.14	? TT=68.303	? TT=68.077	SAT (TO) f=69 TT=1800.11 T1=284.52	SAT (TO) f=66 TT=1800.03 T1=1029.14	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm75p-opt.opb.negationfix.opb	SAT f=105 TT=1800.69 T1=64.37	No data	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? TT=73.382	? TT=69.814	SAT (TO) f=108 TT=1800.92 T1=25.45	SAT (TO) f=105 TT=1800.69 T1=64.37	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw128/ normalized-hw128-vm85p-opt.opb.negationfix.opb	SAT f=112 TT=1800.09 T1=1579.25	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=69.044	? TT=69.336	SAT (TO) f=116 TT=1800.12 T1=92	SAT (TO) f=112 TT=1800.09 T1=1579.25	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm100p-opt.opb.negationfix.opb		No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.12	? TT=74.777	? TT=74.241	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm25p-opt.opb.negationfix.opb	OPT f=7 TT=0.993 T1=0.98	No data	OPT f=7 TT=0.993 T1=0.98	OPT f=7 TT=4.406 T1=4.4	OPT f=7 TT=89.257 T1=89.27	OPT f=7 TT=63.762 T1=63.71	? TT=81.843	? TT=82.084	OPT f=7 TT=32.038 T1=16.39	OPT f=7 TT=104.37 T1=2.42	OPT f=7 TT=221.15 T1=221.11
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm50p-opt.opb.negationfix.opb	SAT f=16 TT=1800.01 T1=5.03	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT (TO) f=16 TT=1800.06 T1=1800.4	? TT=78.105	? TT=77.313	SAT (TO) f=16 TT=1800.17 T1=5.03	SAT (TO) f=16 TT=1800.01 T1=118.97	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm75p-opt.opb.negationfix.opb	SAT f=24 TT=1800.03 T1=443.63	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT (TO) f=32 TT=1800.04 T1=1800.4	? TT=76.393	? TT=74.914	SAT (TO) f=25 TT=1800.13 T1=233.6	SAT (TO) f=24 TT=1800.03 T1=443.63	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm85p-opt.opb.negationfix.opb	SAT f=28 TT=1800.03 T1=193.41	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.2	? (TO) TT=1800.11	? TT=76.723	? TT=77.249	SAT (TO) f=28 TT=1800.03 T1=193.41	SAT (TO) f=28 TT=1800.09 T1=595.8	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm90p-opt.opb.negationfix.opb	OPT f=29 TT=403.408 T1=400.14	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=76.916	? TT=77.931	SAT (TO) f=30 TT=1800.6 T1=221.99	OPT f=29 TT=403.408 T1=400.14	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm95p-opt.opb.negationfix.opb	OPT f=31 TT=1432.71 T1=715.2	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=77.038	? TT=76.918	OPT f=31 TT=1432.71 T1=715.2	SAT (TO) f=32 TT=1800 T1=6.63	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm98p-opt.opb.negationfix.opb	OPT f=32 TT=101.638 T1=49.69	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.14	? TT=67.706	? TT=66.014	OPT f=32 TT=101.638 T1=49.69	OPT f=32 TT=1092.77 T1=1089.76	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw32/ normalized-hw32-vm99p-opt.opb.negationfix.opb		No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.12	? TT=67.478	? TT=66.342	? (TO) TT=1800.08	? (TO) TT=1800.72	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm100p-opt.opb.negationfix.opb		No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=1736.55	? TT=66.388	? TT=66.955	? (TO) TT=1800	? (TO) TT=1801.02	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm25p-opt.opb.negationfix.opb	OPT f=13 TT=3.541 T1=3.53	No data	OPT f=13 TT=3.541 T1=3.53	OPT f=13 TT=20.161 T1=20.16	? (TO) TT=1800.02	SAT (TO) f=16 TT=1800.15 T1=1800.4	? TT=76.28	? TT=76.769	OPT f=13 TT=534.904 T1=263.11	SAT (TO) f=16 TT=1800 T1=7.14	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm50p-opt.opb.negationfix.opb	SAT f=32 TT=1800.62 T1=1163.13	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT (TO) f=41 TT=1800.16 T1=1800.5	? TT=72.637	? TT=74.012	SAT (TO) f=33 TT=1800.1 T1=264.29	SAT (TO) f=32 TT=1800.62 T1=1163.13	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm75p-opt.opb.negationfix.opb	SAT f=48 TT=1800.17 T1=772.59	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.38	? TT=66.65	? TT=66.293	SAT (TO) f=48 TT=1800.17 T1=772.59	SAT (TO) f=51 TT=1800.02 T1=1550.04	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm85p-opt.opb.negationfix.opb	OPT f=54 TT=1464.16 T1=733.33	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.48	? TT=65.892	? TT=66.787	OPT f=54 TT=1464.16 T1=733.33	SAT (TO) f=55 TT=1800.02 T1=1223.63	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm90p-opt.opb.negationfix.opb	SAT f=60 TT=1800.08 T1=209.29	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.48	? TT=66.225	? TT=66.791	SAT (TO) f=60 TT=1800.14 T1=209.29	SAT (TO) f=60 TT=1800.08 T1=514.78	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm95p-opt.opb.negationfix.opb	SAT f=62 TT=1800.87 T1=69.88	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.48	? TT=66.73	? TT=67.01	? (TO) TT=1800.62	SAT (TO) f=62 TT=1800.87 T1=69.88	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm98p-opt.opb.negationfix.opb	SAT f=64 TT=1800.18 T1=281.47	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.62	? TT=66.97	? TT=67.128	SAT (TO) f=64 TT=1800.18 T1=281.47	? (TO) TT=1800.78	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/OPT-SMALLINT-LIN/ pbfvmc-formulae/hw64/ normalized-hw64-vm99p-opt.opb.negationfix.opb	OPT f=64 TT=229.769 T1=227.42	No data	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.57	? TT=66.463	? TT=66.556	? (TO) TT=1800.03	OPT f=64 TT=229.769 T1=227.42	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern20-03.opb	OPT f=-18 TT=0.005 T1=0	No data	No data	No data	OPT f=-18 TT=0.005 T1=0	No data	No data	No data	OPT f=-18 TT=0.595 T1=3.13	OPT f=-18 TT=0.755 T1=0.22	OPT f=-18 TT=0.025 T1=0.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern20-05.opb	OPT f=-104 TT=39.52 T1=0.33	No data	No data	No data	OPT f=-104 TT=365.816 T1=365.87	No data	No data	No data	OPT f=-104 TT=96 T1=8.21	OPT f=-104 TT=39.52 T1=0.33	OPT f=-104 TT=1097.58 T1=1097.67
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern20-10.opb	OPT f=-367 TT=210.155 T1=4.92	No data	No data	No data	SAT (TO) f=-367 TT=1800.02 T1=1800.3	No data	No data	No data	OPT f=-367 TT=572.076 T1=35.66	OPT f=-367 TT=210.155 T1=4.92	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern20-15.opb	OPT f=-1490 TT=359.76 T1=23.25	No data	No data	No data	SAT (TO) f=-1490 TT=1800.02 T1=1800.3	No data	No data	No data	OPT f=-1490 TT=996.833 T1=65.12	OPT f=-1490 TT=359.76 T1=23.25	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern25-03.opb	OPT f=-23 TT=0.007 T1=0	No data	No data	No data	OPT f=-23 TT=0.007 T1=0	No data	No data	No data	OPT f=-23 TT=0.954 T1=4.14	OPT f=-23 TT=2.434 T1=1.12	OPT f=-23 TT=0.029 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern25-06.opb	SAT f=-120 TT=1800.01 T1=4.49	No data	No data	No data	SAT (TO) f=-120 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-120 TT=1800.06 T1=13.92	SAT (TO) f=-120 TT=1800.78 T1=4.49	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern25-13.opb	SAT f=-2037 TT=1800.06 T1=116.42	No data	No data	No data	SAT (TO) f=-2010 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-2037 TT=1800.09 T1=192.06	SAT (TO) f=-2037 TT=1800.06 T1=116.42	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern25-19.opb	SAT f=-3659 TT=1800.71 T1=1219.72	No data	No data	No data	SAT (TO) f=-3641 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-3649 TT=1800.09 T1=727.47	SAT (TO) f=-3659 TT=1800.71 T1=1219.72	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern25-25.opb	SAT f=-2666 TT=1800.07 T1=779.7	No data	No data	No data	SAT (TO) f=-2639 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-2666 TT=1800.07 T1=779.7	SAT (TO) f=-2664 TT=1800.71 T1=145.59	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern30-04.opb	SAT f=-81 TT=1800.01 T1=74.26	No data	No data	No data	SAT (TO) f=-78 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-81 TT=1800.01 T1=74.26	SAT (TO) f=-81 TT=1800.65 T1=218.5	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern30-08.opb	SAT f=-738 TT=1800.03 T1=601.58	No data	No data	No data	SAT (TO) f=-726 TT=1800.04 T1=1800.4	No data	No data	No data	SAT (TO) f=-738 TT=1800.3 T1=950.18	SAT (TO) f=-738 TT=1800.03 T1=601.58	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern30-15.opb	SAT f=-3919 TT=1800.81 T1=307.8	No data	No data	No data	SAT (TO) f=-3825 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-3919 TT=1800.81 T1=307.8	SAT (TO) f=-3909 TT=1800.05 T1=895	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern30-23.opb	SAT f=-7539 TT=1800.07 T1=1269.57	No data	No data	No data	SAT (TO) f=-7435 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-7435 TT=1800.34 T1=900.36	SAT (TO) f=-7539 TT=1800.07 T1=1269.57	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern30-30.opb	SAT f=-2848 TT=1800.07 T1=1469.62	No data	No data	No data	SAT (TO) f=-2806 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-2765 TT=1800.02 T1=573.21	SAT (TO) f=-2848 TT=1800.07 T1=1469.62	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern35-04.opb	SAT f=-95 TT=1800.06 T1=1182.61	No data	No data	No data	SAT (TO) f=-89 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-94 TT=1800.15 T1=625.82	SAT (TO) f=-95 TT=1800.06 T1=1182.61	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern35-09.opb	SAT f=-1251 TT=1800 T1=1379.57	No data	No data	No data	SAT (TO) f=-1240 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-1236 TT=1800.68 T1=189.37	SAT (TO) f=-1251 TT=1800 T1=1379.57	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern35-18.opb	SAT f=-3848 TT=1800.34 T1=729.03	No data	No data	No data	SAT (TO) f=-3703 TT=1800.09 T1=1800.4	No data	No data	No data	SAT (TO) f=-3848 TT=1800.34 T1=729.03	SAT (TO) f=-3510 TT=1800 T1=1789.18	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern35-26.opb	SAT f=-6585 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-6585 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-6430 TT=1800.32 T1=728.02	SAT (TO) f=-6356 TT=1800.06 T1=1717.95	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern40-05.opb	SAT f=-219 TT=1800.05 T1=854.13	No data	No data	No data	SAT (TO) f=-213 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-219 TT=1800.05 T1=854.13	SAT (TO) f=-208 TT=1800.7 T1=453.98	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern40-10.opb	SAT f=-1001 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-1001 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-987 TT=1800.47 T1=654.96	SAT (TO) f=-843 TT=1800.03 T1=1642.58	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern40-20.opb	SAT f=-12445 TT=1800.43 T1=877.76	No data	No data	No data	SAT (TO) f=-12169 TT=1800.12 T1=1800.4	No data	No data	No data	SAT (TO) f=-12445 TT=1800.43 T1=877.76	SAT (TO) f=-9835 TT=1800.05 T1=1712.69	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern40-30.opb	SAT f=-10582 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-10582 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-9475 TT=1800.18 T1=688.25	SAT (TO) f=-9911 TT=1800.64 T1=1450.46	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern45-05.opb	SAT f=-237 TT=1800.08 T1=134.31	No data	No data	No data	SAT (TO) f=-235 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-237 TT=1800.08 T1=134.31	SAT (TO) f=-236 TT=1800.94 T1=254.96	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern45-11.opb	SAT f=-3092 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-3092 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-3024 TT=1800.07 T1=668.5	SAT (TO) f=-2491 TT=1800.09 T1=1576.82	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern50-06.opb	SAT f=-270 TT=1800.09 T1=1800.5	No data	No data	No data	SAT (TO) f=-270 TT=1800.09 T1=1800.5	No data	No data	No data	SAT (TO) f=-247 TT=1800.19 T1=467.94	SAT (TO) f=-202 TT=1800.08 T1=1626.29	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern50-13.opb	SAT f=-5712 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=-5712 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=-5597 TT=1800.06 T1=467.58	SAT (TO) f=-2993 TT=1800.06 T1=1722.67	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern55-06.opb	SAT f=-300 TT=1800.02 T1=1800.4	No data	No data	No data	SAT (TO) f=-300 TT=1800.02 T1=1800.4	No data	No data	No data	SAT (TO) f=-278 TT=1800.06 T1=149.93	SAT (TO) f=-200 TT=1800.06 T1=1666.81	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern55-14.opb	SAT f=-3989 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-3989 TT=1800.08 T1=1800.4	No data	No data	No data	SAT (TO) f=-3816 TT=1800.54 T1=324.56	SAT (TO) f=-1874 TT=1800.07 T1=1607.21	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern60-08.opb	SAT f=-1618 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-1618 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-1518 TT=1800.65 T1=308.18	SAT (TO) f=-1088 TT=1800.02 T1=1709.87	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-autocorr_bern60-15.opb	SAT f=-10786 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-10786 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-10579 TT=1800.45 T1=681.07	SAT (TO) f=-4419 TT=1800.75 T1=1774.18	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-crossdock_15x7.opb	SAT f=14675 TT=1800.75 T1=1.41	No data	No data	No data	SAT (TO) f=15406 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=14675 TT=1800.75 T1=1.41	SAT (TO) f=14901 TT=1800.08 T1=1.73	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-010.opb	OPT f=1 TT=0.028 T1=0.02	No data	No data	No data	OPT f=1 TT=0.028 T1=0.02	No data	No data	No data	OPT f=1 TT=1.545 T1=0.71	OPT f=1 TT=0.605 T1=0.19	OPT f=1 TT=1.309 T1=0.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-020.opb	OPT f=11 TT=1.278 T1=0.98	No data	No data	No data	OPT f=11 TT=1.278 T1=1.27	No data	No data	No data	OPT f=11 TT=357.68 T1=13.27	OPT f=11 TT=178.15 T1=0.98	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-030.opb	SAT f=55 TT=1801.31 T1=511.35	No data	No data	No data	SAT (TO) f=60 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=55 TT=1801.31 T1=511.35	SAT (TO) f=56 TT=1804.79 T1=1.02	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-040.opb	SAT f=184 TT=1800.32 T1=857.32	No data	No data	No data	SAT (TO) f=211 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=184 TT=1800.32 T1=857.32	SAT (TO) f=184 TT=1800.81 T1=943.99	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-050.opb	SAT f=293 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=293 TT=1800.07 T1=1800.4	No data	No data	No data	SAT (TO) f=335 TT=1800.05 T1=948.78	SAT (TO) f=332 TT=1800.07 T1=1299.44	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-070.opb	SAT f=785 TT=1800 T1=1802	No data	No data	No data	SAT (TO) f=792 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=786 TT=1800.56 T1=258.36	SAT (TO) f=785 TT=1800 T1=1802	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross10-090.opb	SAT f=1387 TT=1800.08 T1=1101.19	No data	No data	No data	SAT (TO) f=1501 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=1396 TT=1800.56 T1=357.53	SAT (TO) f=1387 TT=1800.08 T1=1101.19	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross14-019.opb	OPT f=4 TT=145.013 T1=145.04	No data	No data	No data	OPT f=4 TT=145.013 T1=145.04	No data	No data	No data	SAT (TO) f=6 TT=1800.66 T1=18.34	SAT (TO) f=6 TT=1800.06 T1=0.76	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross14-058.opb	SAT f=494 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=494 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=515 TT=1800.52 T1=759.05	SAT (TO) f=573 TT=1800.07 T1=1533.62	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross14-098.opb	SAT f=1708 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=1708 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=1773 TT=1800.17 T1=916.51	SAT (TO) f=2078 TT=1800.59 T1=366.79	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross14-117.opb	SAT f=2552 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=2552 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=2762 TT=1800.49 T1=800.47	SAT (TO) f=2727 TT=1800.02 T1=1369.55	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross14-137.opb	SAT f=3570 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=3570 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=3679 TT=1800.47 T1=917.93	SAT (TO) f=4061 TT=1800.04 T1=1613.74	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross14-176.opb	SAT f=6251 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=6251 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=6350 TT=1800.06 T1=883.37	SAT (TO) f=6708 TT=1800.08 T1=1765.49	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross20-040.opb	SAT f=157 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=157 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=227 TT=1800.66 T1=37.56	SAT (TO) f=206 TT=1800.98 T1=1275.5	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross20-080.opb	SAT f=993 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=993 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=1224 TT=1800.35 T1=822.64	SAT (TO) f=1204 TT=1800.01 T1=1687.88	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross22-048.opb	SAT f=246 TT=1800.82 T1=128.24	No data	No data	No data	SAT (TO) f=277 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=246 TT=1800.82 T1=128.24	SAT (TO) f=364 TT=1800 T1=20.81	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross22-096.opb	SAT f=1568 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=1568 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=1721 TT=1800.95 T1=833.46	SAT (TO) f=2105 TT=1800.07 T1=174.93	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross24-057.opb	SAT f=474 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=474 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=503 TT=1800.74 T1=235.69	SAT (TO) f=551 TT=1800.03 T1=1162.43	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/ minlplib2-pb-0.1.0/opb/normalized-edgecross24-115.opb	SAT f=2393 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=2393 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=2874 TT=1800.41 T1=814.95	SAT (TO) f=3259 TT=1800.05 T1=1700.99	? (TO) TT=1800.13
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay20h.opb	SAT f=16763 TT=1800.01 T1=112.15	No data	No data	No data	SAT (TO) f=17676 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=16763 TT=1800.77 T1=161.35	SAT (TO) f=16763 TT=1800.01 T1=112.15	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay25.opb	SAT f=5307 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=5307 TT=1800.13 T1=1800.4	No data	No data	No data	SAT (TO) f=5413 TT=1800.05 T1=21.29	SAT (TO) f=5413 TT=1800.43 T1=10.92	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay30h.opb	SAT f=54002 TT=1800.06 T1=1800.5	No data	No data	No data	SAT (TO) f=54002 TT=1800.06 T1=1800.5	No data	No data	No data	SAT (TO) f=55260 TT=1800.54 T1=199.17	SAT (TO) f=55132 TT=1800.07 T1=974.27	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay30.opb	SAT f=9987 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=9987 TT=1800.08 T1=1800.5	No data	No data	No data	SAT (TO) f=10090 TT=1800.19 T1=215.12	SAT (TO) f=10090 TT=1800.72 T1=195.52	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay33.opb	SAT f=73008 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=73008 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=73985 TT=1800.6 T1=91.03	SAT (TO) f=73985 TT=1801.17 T1=67.61	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-faclay35.opb	SAT f=82120 TT=1800.01 T1=1800.5	No data	No data	No data	SAT (TO) f=82120 TT=1800.01 T1=1800.5	No data	No data	No data	SAT (TO) f=84001 TT=1800.11 T1=219.99	SAT (TO) f=84001 TT=1800.1 T1=151.84	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2pm-0044-0044.opb	OPT f=-13 TT=0.043 T1=0.04	No data	No data	No data	OPT f=-13 TT=0.043 T1=0.04	No data	No data	No data	OPT f=-13 TT=5.642 T1=3.16	OPT f=-13 TT=1.786 T1=0.55	OPT f=-13 TT=2.47 T1=0.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2pm-0055-0055.opb	OPT f=-20 TT=0.144 T1=0.14	No data	No data	No data	OPT f=-20 TT=0.144 T1=0.14	No data	No data	No data	OPT f=-20 TT=632.178 T1=32.17	OPT f=-20 TT=361.59 T1=1.86	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2pm-0066-0066.opb	OPT f=-29 TT=0.253 T1=0.25	No data	No data	No data	OPT f=-29 TT=0.253 T1=0.25	No data	No data	No data	SAT (TO) f=-27 TT=1800.65 T1=488.19	SAT (TO) f=-27 TT=1800.05 T1=920.31	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2pm-0077-0777.opb	OPT f=-40 TT=0.578 T1=0.57	No data	No data	No data	OPT f=-40 TT=0.578 T1=0.57	No data	No data	No data	SAT (TO) f=-34 TT=1800.13 T1=7.71	SAT (TO) f=-33 TT=1800.95 T1=0.5	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2pm-0088-0888.opb	OPT f=-55 TT=0.648 T1=0.64	No data	No data	No data	OPT f=-55 TT=0.648 T1=0.64	No data	No data	No data	SAT (TO) f=-48 TT=1800.06 T1=3.22	SAT (TO) f=-48 TT=1800 T1=0.74	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_2pm-0099-0999.opb	OPT f=-64 TT=4.406 T1=4.4	No data	No data	No data	OPT f=-64 TT=4.406 T1=4.4	No data	No data	No data	SAT (TO) f=-51 TT=1800.61 T1=4.24	SAT (TO) f=-49 TT=1800.09 T1=0.54	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3pm-0234-0234.opb	OPT f=-20 TT=0.218 T1=0.21	No data	No data	No data	OPT f=-20 TT=0.218 T1=0.21	No data	No data	No data	OPT f=-20 TT=1254.99 T1=117.68	OPT f=-20 TT=693.99 T1=57.88	? (TO) TT=1800.16
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3pm-0244-0244.opb	OPT f=-28 TT=2.804 T1=2.8	No data	No data	No data	OPT f=-28 TT=2.804 T1=2.8	No data	No data	No data	SAT (TO) f=-23 TT=1800.07 T1=2.69	SAT (TO) f=-23 TT=1800.06 T1=0.21	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3pm-0333-0333.opb	OPT f=-26 TT=1.421 T1=1.41	No data	No data	No data	OPT f=-26 TT=1.421 T1=1.41	No data	No data	No data	SAT (TO) f=-22 TT=1802.57 T1=53.75	SAT (TO) f=-23 TT=1800.06 T1=727.75	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3pm-0334-0334.opb	OPT f=-36 TT=6.416 T1=6.41	No data	No data	No data	OPT f=-36 TT=6.416 T1=6.41	No data	No data	No data	SAT (TO) f=-31 TT=1800.02 T1=2.7	SAT (TO) f=-31 TT=1800.04 T1=0.25	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3pm-0344-0344.opb	OPT f=-48 TT=525.266 T1=525.34	No data	No data	No data	OPT f=-48 TT=525.266 T1=525.34	No data	No data	No data	SAT (TO) f=-34 TT=1800.74 T1=13.22	SAT (TO) f=-32 TT=1800 T1=0.51	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-graphpart_3pm-0444-0444.opb	SAT f=-65 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-65 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-48 TT=1800.18 T1=40.81	SAT (TO) f=-48 TT=1800.02 T1=33.71	? (TO) TT=1800.09
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-graphpart_clique-20.opb	OPT f=147 TT=48.047 T1=0.25	No data	No data	No data	SAT (TO) f=189 TT=1800.02 T1=1800.3	No data	No data	No data	OPT f=147 TT=124.984 T1=0.73	OPT f=147 TT=48.047 T1=0.25	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-graphpart_clique-30.opb	SAT f=495 TT=1800.01 T1=0.38	No data	No data	No data	SAT (TO) f=874 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=495 TT=1800.68 T1=0.8	SAT (TO) f=495 TT=1800.01 T1=0.38	? (TO) TT=1800.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-graphpart_clique-40.opb	SAT f=1183 TT=1800.08 T1=0.5	No data	No data	No data	SAT (TO) f=2499 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=1183 TT=1800.68 T1=1.38	SAT (TO) f=1183 TT=1800.08 T1=0.5	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-graphpart_clique-50.opb	SAT f=2312 TT=1800.02 T1=0.57	No data	No data	No data	SAT (TO) f=5250 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=2312 TT=1800.78 T1=1.45	SAT (TO) f=2312 TT=1800.02 T1=0.57	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-graphpart_clique-60.opb	SAT f=3990 TT=1800.01 T1=0.94	No data	No data	No data	SAT (TO) f=9658 TT=1800.06 T1=1800.5	No data	No data	No data	SAT (TO) f=3990 TT=1800.78 T1=1.53	SAT (TO) f=3990 TT=1800.01 T1=0.94	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/opb/ normalized-graphpart_clique-70.opb	SAT f=6348 TT=1800.71 T1=1.03	No data	No data	No data	SAT (TO) f=15813 TT=1800.05 T1=1800.4	No data	No data	No data	SAT (TO) f=6348 TT=1800.71 T1=2.15	SAT (TO) f=6348 TT=1800.88 T1=1.03	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-hmittelman.opb	OPT f=13 TT=0.004 T1=0	No data	No data	No data	OPT f=13 TT=0.004 T1=0	No data	No data	No data	OPT f=13 TT=0.185 T1=1.13	OPT f=13 TT=0.166 T1=0.14	OPT f=13 TT=0.02 T1=0.01
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament06.opb	OPT f=-6 TT=0.009 T1=0	No data	No data	No data	OPT f=-6 TT=0.009 T1=0	No data	No data	No data	OPT f=-6 TT=0.933 T1=2.14	OPT f=-6 TT=0.394 T1=0.14	OPT f=-6 TT=0.026 T1=0.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament08.opb	OPT f=-12 TT=0.044 T1=0.04	No data	No data	No data	OPT f=-12 TT=0.044 T1=0.04	No data	No data	No data	OPT f=-12 TT=23.679 T1=2.65	OPT f=-12 TT=11.807 T1=1.59	OPT f=-12 TT=176.414 T1=0.27
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament10.opb	OPT f=-22 TT=0.652 T1=0.85	No data	No data	No data	OPT f=-22 TT=0.652 T1=0.85	No data	No data	No data	SAT (TO) f=-21 TT=1800.88 T1=16.7	SAT (TO) f=-18 TT=1800 T1=179.53	? (TO) TT=1800.04
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament12.opb	OPT f=-34 TT=546.057 T1=546.14	No data	No data	No data	OPT f=-34 TT=546.057 T1=546.14	No data	No data	No data	SAT (TO) f=-30 TT=1800.13 T1=123.31	SAT (TO) f=-28 TT=1800.01 T1=12.94	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament16.opb	SAT f=-60 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-60 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-50 TT=1800.56 T1=188.99	SAT (TO) f=-43 TT=1800.01 T1=442.45	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament18.opb	SAT f=-74 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-74 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-66 TT=1800.18 T1=195.27	SAT (TO) f=-50 TT=1800.56 T1=0.34	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament20.opb	SAT f=-86 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-86 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-71 TT=1800.19 T1=93.55	SAT (TO) f=-65 TT=1800.03 T1=5.6	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament22.opb	SAT f=-85 TT=1800.01 T1=322.29	No data	No data	No data	SAT (TO) f=-85 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-85 TT=1800.65 T1=322.29	SAT (TO) f=-77 TT=1800.03 T1=1135.28	? (TO) TT=1800.07
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament24.opb	SAT f=-107 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-107 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-97 TT=1800.67 T1=133.15	SAT (TO) f=-73 TT=1800.87 T1=440.91	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament26.opb	SAT f=-122 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-122 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-111 TT=1801.15 T1=406.73	SAT (TO) f=-102 TT=1800.07 T1=2.99	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament28.opb	SAT f=-127 TT=1800.14 T1=318.99	No data	No data	No data	SAT (TO) f=-125 TT=1800.03 T1=1800.3	No data	No data	No data	SAT (TO) f=-127 TT=1800.14 T1=318.99	SAT (TO) f=-96 TT=1800.02 T1=485.44	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament30.opb	SAT f=-139 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-139 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-136 TT=1800.19 T1=898.84	SAT (TO) f=-109 TT=1800 T1=27.26	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament32.opb	SAT f=-153 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-153 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-150 TT=1800.03 T1=466.12	SAT (TO) f=-126 TT=1804.16 T1=324.59	? (TO) TT=1800.05
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament34.opb	SAT f=-195 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-195 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-178 TT=1800.1 T1=464	SAT (TO) f=-147 TT=1800.06 T1=1607.28	? (TO) TT=1800.03
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament36.opb	SAT f=-201 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-201 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-189 TT=1800.53 T1=403.2	SAT (TO) f=-164 TT=1800.05 T1=92.39	? (TO) TT=1800.11
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament38.opb	SAT f=-228 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-228 TT=1800.01 T1=1800.3	No data	No data	No data	SAT (TO) f=-212 TT=1800.09 T1=519.68	SAT (TO) f=-174 TT=1800.84 T1=33.37	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament40.opb	SAT f=-263 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-263 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-232 TT=1800.13 T1=640.61	SAT (TO) f=-186 TT=1800.09 T1=508.24	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament42.opb	SAT f=-296 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-296 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-285 TT=1800.64 T1=458.9	SAT (TO) f=-224 TT=1800.79 T1=244.81	? (TO) TT=1800.06
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament44.opb	SAT f=-307 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-307 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-278 TT=1800.34 T1=747	SAT (TO) f=-237 TT=1800.07 T1=14.65	? (TO) TT=1800.02
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament46.opb	SAT f=-335 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-335 TT=1800.02 T1=1800.3	No data	No data	No data	SAT (TO) f=-310 TT=1800.13 T1=702.59	SAT (TO) f=-249 TT=1800.89 T1=164.15	? (TO) TT=1800.08
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament48.opb	SAT f=-401 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-401 TT=1800.1 T1=1800.4	No data	No data	No data	SAT (TO) f=-356 TT=1800.8 T1=659.24	SAT (TO) f=-300 TT=1800.07 T1=350.38	? (TO) TT=1800.1
PB15eval/normalized-PB15eval/ OPT-SMALLINT-NLC/minlplib2-pb-0.1.0/ opb/normalized-sporttournament50.opb	SAT f=-406 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-406 TT=1800.11 T1=1800.4	No data	No data	No data	SAT (TO) f=-359 TT=1800.09 T1=645.19	SAT (TO) f=-293 TT=1800 T1=233.64	? (TO) TT=1800.01

Statistics		cdcl-cuttingplanes DEC 2016-05-01 (complete)	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
Number of times the solver is able to give the best known answer		1395	774	749	3086	2745	2268	2358	3203	2748	2260
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		523	80	108	1060	664	871	624	482	470	103