PB'16 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)
cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)
minisatp 2012-10-02 git-d91742b (complete)
NaPS 1.02 (complete)
Open-WBO PB16 (complete)
Open-WBO-LSU PB16 (complete)
Sat4j PB 2.3.6 Res+CP PB16 (complete)
Sat4j PB 2.3.6 Resolution PB16 (complete)
toysat 2016-05-02 (complete)

Bench name	Best results on this instance	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-10teams.opb	SAT f=914 TT=1800.03 T1=1800.3	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=926 TT=1800.01 T1=1800.3	SAT (TO) f=972 TT=1800.11 T1=1800.4	SAT (TO) f=914 TT=1800.03 T1=1800.3	SAT (TO) f=922 TT=1800.07 T1=1800.4	SAT (TO) f=916 TT=1800.87 T1=47.63	SAT (TO) f=916 TT=1800.09 T1=128.78	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-fast0507.opb	SAT f=251 TT=1800.09 T1=1800.4	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=349 TT=1800.12 T1=1800.5	SAT (TO) f=349 TT=1800.1 T1=1800.4	SAT (TO) f=251 TT=1800.09 T1=1800.4	SAT (TO) f=294 TT=1800.06 T1=1800.4	SAT (TO) f=259 TT=1800.05 T1=80.62	SAT (TO) f=259 TT=1800.09 T1=1.37	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-manna81.opb	SAT f=-11615 TT=1800.1 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT (TO) f=-11615 TT=1800.1 T1=1800.4	SAT (TO) f=-10793 TT=1800.06 T1=1800.4	SAT (TO) f=-9792 TT=1800.08 T1=1800.4	SAT (TO) f=-11306 TT=1800.31 T1=1800.4	SAT (TO) f=-11521 TT=1800.12 T1=69.78	SAT (TO) f=-10910 TT=1800.06 T1=20.82	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mzzv11.opb	OPT f=-10859 TT=217.128 T1=217.11	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=-9909 TT=1800.08 T1=1800.4	OPT f=-10859 TT=217.128 T1=217.11	OPT f=-10859 TT=250.064 T1=250.09	? TT=179.48	SAT (TO) f=-10319 TT=1800.05 T1=136.39	OPT f=-10859 TT=336.933 T1=333.31	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-mzzv42z.opb	OPT f=-10270 TT=53.71 T1=53.66	? (TO) TT=1800.1	? (TO) TT=1800.02	OPT f=-10270 TT=456.118 T1=456.2	OPT f=-10270 TT=53.71 T1=53.66	OPT f=-10270 TT=170.322 T1=170.3	? TT=185.58	SAT (TO) f=-10171 TT=1800 T1=177.74	OPT f=-10270 TT=355.05 T1=351.42	OPT f=-10270 TT=65.911 T1=65.84
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-net12.opb	OPT f=214 TT=2.877 T1=2.84	OPT f=214 TT=4.988 T1=4.94	OPT f=214 TT=2.877 T1=2.84	? (TO) TT=1800.05	OPT f=214 TT=954.538 T1=953.92	? (MO) TT=61.054	? (MO) TT=61.599	OPT f=214 TT=17.072 T1=8.32	OPT f=214 TT=7.473 T1=4.58	OPT f=214 TT=40.068 T1=23.42
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-opt1217.opb	SAT f=-16384 TT=1800.75 T1=79.38	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=-12288 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.02 T1=1800.3	SAT (TO) f=0 TT=1800.31 T1=1800.3	? (TO) TT=1800.21	SAT (TO) f=-16384 TT=1800.75 T1=79.38	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-p2756.opb	SAT f=3671 TT=1800.66 T1=156.69	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=151108 TT=1800.05 T1=1800.4	SAT (TO) f=3743 TT=1800.03 T1=1800.4	SAT (TO) f=9372 TT=1800.09 T1=1800.4	? TT=74.482	SAT (TO) f=3671 TT=1800.66 T1=156.69	SAT (TO) f=3719 TT=1800.95 T1=585.32	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-protfold.opb	SAT f=-25 TT=1800.01 T1=1642.99	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=-24 TT=1800.1 T1=1800.4	SAT (TO) f=-14 TT=1800.08 T1=1800.4	SAT (TO) f=-14 TT=1800.03 T1=1800.3	SAT (TO) f=-25 TT=1800.01 T1=1800.3	SAT (TO) f=-21 TT=1800.67 T1=463.44	SAT (TO) f=-25 TT=1800.8 T1=1642.99	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-mps-v2-20-10-seymour.opb	SAT f=448 TT=1800.01 T1=1800.3	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=457 TT=1800.02 T1=1800.3	SAT (TO) f=466 TT=1800.02 T1=1800.3	SAT (TO) f=466 TT=1800.02 T1=1800.3	SAT (TO) f=448 TT=1800.01 T1=1800.3	SAT (TO) f=477 TT=1800.04 T1=230.48	SAT (TO) f=490 TT=1800.06 T1=0.37	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib3/ normalized-mps-v2-20-10-mitre.opb	SAT f=7680 TT=1800.15 T1=6.29	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT (TO) f=9073 TT=1800.08 T1=1800.4	SAT (TO) f=9331 TT=1800.2 T1=1800.4	? TT=61.417	? TT=62.36	SAT (TO) f=7680 TT=1800.15 T1=6.29	SAT (TO) f=7941 TT=1800.04 T1=1.96	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-bm23.opb	OPT f=34 TT=0.171 T1=0.17	OPT f=34 TT=0.294 T1=0.29	OPT f=34 TT=0.171 T1=0.17	OPT f=34 TT=1.184 T1=1.18	OPT f=34 TT=0.486 T1=0.48	OPT f=34 TT=0.527 T1=0.55	OPT f=34 TT=0.773 T1=0.78	OPT f=34 TT=1.305 T1=1.64	OPT f=34 TT=0.644 T1=0.23	OPT f=34 TT=0.986 T1=0.95
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-cracpb1.opb	SAT f=22199 TT=1800.09 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=30188 TT=1800.1 T1=1800.4	SAT (TO) f=44407 TT=1800.09 T1=1800.4	SAT (TO) f=22199 TT=1800.09 T1=1800.4	? TT=76.441	SAT (TO) f=44331 TT=1800.12 T1=10.79	? (TO) TT=1800.9	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-diamond.opb	UNSAT TT=0	UNSAT TT=0.021	UNSAT TT=0.012	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0	UNSAT TT=0.165	UNSAT TT=0.154	UNSAT TT=0.016
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-l152lav.opb	SAT f=5556 TT=1800.47 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT (TO) f=5614 TT=1800.08 T1=1800.4	SAT (TO) f=5561 TT=1800.01 T1=1800.3	SAT (TO) f=5556 TT=1800.47 T1=1800.3	? (TO) TT=1800.07	? (TO) TT=1800.8	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-lp4l.opb	SAT f=3666 TT=1800.12 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=3666 TT=1800.12 T1=1800.4	SAT (TO) f=4551 TT=1800.09 T1=1800.4	SAT (TO) f=4001 TT=1800.08 T1=1800.4	SAT (TO) f=3899 TT=1800.08 T1=1800.4	SAT (TO) f=3792 TT=1800.77 T1=82.11	SAT (TO) f=3958 TT=1800.01 T1=1314.86	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-lseu.opb	OPT f=1120 TT=34.554 T1=8.14	OPT f=1120 TT=85.011 T1=85.02	OPT f=1120 TT=234.073 T1=234.11	OPT f=1120 TT=37.752 T1=37.75	OPT f=1120 TT=34.554 T1=34.55	OPT f=1120 TT=607.395 T1=607.51	OPT f=1120 TT=275.005 T1=275	OPT f=1120 TT=53.026 T1=10.67	OPT f=1120 TT=49.597 T1=8.14	OPT f=1120 TT=113.609 T1=113.57
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-mod008.opb	OPT f=307 TT=1187.4 T1=0.33	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=321 TT=1800.05 T1=1800.4	SAT (TO) f=409 TT=1800.08 T1=1800.4	? TT=99.756	? TT=98.893	OPT f=307 TT=1187.4 T1=1.2	SAT (TO) f=307 TT=1800.9 T1=0.33	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-mod010.opb	SAT f=7984 TT=1800.16 T1=714.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=7984 TT=1800.16 T1=714.05	? (TO) TT=1800.57	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0033.opb	OPT f=3089 TT=0.016 T1=0.01	OPT f=3089 TT=0.048 T1=0.05	OPT f=3089 TT=0.016 T1=0.01	OPT f=3089 TT=0.271 T1=0.27	OPT f=3089 TT=0.207 T1=0.21	OPT f=3089 TT=0.033 T1=0.03	OPT f=3089 TT=0.608 T1=0.6	OPT f=3089 TT=0.723 T1=1.15	OPT f=3089 TT=0.404 T1=0.15	OPT f=3089 TT=0.154 T1=0.15
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0040.opb	OPT f=62027 TT=0.015 T1=0.01	OPT f=62027 TT=0.282 T1=0.28	OPT f=62027 TT=0.075 T1=0.07	OPT f=62027 TT=51.82 T1=51.82	OPT f=62027 TT=1.306 T1=1.3	OPT f=62027 TT=0.015 T1=0.01	? TT=128.93	OPT f=62027 TT=0.815 T1=1.83	OPT f=62027 TT=13.782 T1=0.13	OPT f=62027 TT=19.186 T1=10.37
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0201.opb	OPT f=1523 TT=436.099 T1=0.33	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=1523 TT=544.158 T1=544.24	OPT f=1523 TT=436.099 T1=436.16	OPT f=1523 TT=612.866 T1=612.96	SAT (TO) f=1563 TT=1800.04 T1=1800.4	SAT (TO) f=1523 TT=1800.64 T1=3.72	SAT (TO) f=1523 TT=1800.09 T1=0.33	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-p0548.opb	SAT f=10087 TT=1800.65 T1=3.22	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=44199 TT=1800.02 T1=1800.3	SAT (TO) f=15217 TT=1800.1 T1=1800.4	SAT (TO) f=59642 TT=1800.07 T1=1800.4	? TT=85.08	SAT (TO) f=10087 TT=1800.65 T1=3.22	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-sentoy.opb	OPT f=-7772 TT=2.588 T1=0.54	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=-7502 TT=1800.01 T1=1800.3	OPT f=-7772 TT=69.279 T1=69.27	? TT=74.237	? TT=74.968	OPT f=-7772 TT=4.562 T1=3.7	OPT f=-7772 TT=2.588 T1=0.54	OPT f=-7772 TT=12.606 T1=7.57
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein15.opb	OPT f=9 TT=0.003 T1=0	OPT f=9 TT=0.023 T1=0.02	OPT f=9 TT=0.013 T1=0.01	OPT f=9 TT=0.004 T1=0	OPT f=9 TT=0.006 T1=0	OPT f=9 TT=0.003 T1=0	OPT f=9 TT=0.003 T1=0	OPT f=9 TT=0.374 T1=0.63	OPT f=9 TT=0.263 T1=0.12	OPT f=9 TT=0.049 T1=0.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein27.opb	OPT f=18 TT=0.046 T1=0.04	OPT f=18 TT=0.329 T1=0.32	OPT f=18 TT=0.285 T1=0.28	OPT f=18 TT=0.165 T1=0.16	OPT f=18 TT=0.139 T1=0.13	OPT f=18 TT=0.046 T1=0.04	OPT f=18 TT=0.14 T1=0.14	OPT f=18 TT=5.502 T1=0.65	OPT f=18 TT=2.134 T1=0.13	OPT f=18 TT=2.517 T1=2.46
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein45.opb	OPT f=30 TT=7.583 T1=1.21	OPT f=30 TT=265.117 T1=265.15	OPT f=30 TT=235.005 T1=235.04	OPT f=30 TT=10.397 T1=10.39	OPT f=30 TT=7.583 T1=7.58	OPT f=30 TT=35.292 T1=35.29	OPT f=30 TT=9.199 T1=9.2	OPT f=30 TT=1723.22 T1=2.18	OPT f=30 TT=582.647 T1=1.21	OPT f=30 TT=420.124 T1=420.13
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/MIPLIB/miplib/ normalized-mps-v2-20-10-stein9.opb	OPT f=5 TT=0 T1=0	OPT f=5 TT=0.021 T1=0.02	OPT f=5 TT=0.012 T1=0.01	OPT f=5 TT=0.001 T1=0	OPT f=5 TT=0.001 T1=0	OPT f=5 TT=0 T1=0	OPT f=5 TT=0.001 T1=0	OPT f=5 TT=0.163 T1=0.62	OPT f=5 TT=0.164 T1=0.11	OPT f=5 TT=0.02 T1=0.01
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos10.opb	OPT f=-1135 TT=4.334 T1=2.36	OPT f=-1135 TT=18.457 T1=18.44	OPT f=-1135 TT=13.896 T1=13.89	OPT f=-1135 TT=79.025 T1=79.01	OPT f=-1135 TT=28.36 T1=28.32	OPT f=-1135 TT=92.54 T1=92.53	OPT f=-1135 TT=80.941 T1=80.78	OPT f=-1135 TT=104.858 T1=109.88	OPT f=-1135 TT=4.334 T1=2.36	OPT f=-1135 TT=19.078 T1=19.02
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos16.opb	SAT f=114 TT=1800.01 T1=40.32	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=114 TT=1800.02 T1=1800.3	SAT (TO) f=114 TT=1800.02 T1=1800.3	SAT (TO) f=122 TT=1800.01 T1=1800.3	? (TO) TT=1800.02	SAT (TO) f=114 TT=1800.18 T1=40.32	SAT (TO) f=114 TT=1800.01 T1=370.93	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos18.opb	OPT f=16 TT=0.043 T1=0.04	OPT f=16 TT=0.182 T1=0.18	OPT f=16 TT=0.131 T1=0.13	OPT f=16 TT=0.115 T1=0.11	OPT f=16 TT=0.106 T1=0.1	OPT f=16 TT=0.043 T1=0.04	OPT f=16 TT=0.047 T1=0.04	OPT f=16 TT=3.59 T1=4.46	OPT f=16 TT=1.507 T1=0.51	OPT f=16 TT=0.617 T1=0.24
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/ milp/normalized-mps-v2-20-10-neos19.opb		? (exit code) TT=1.354	? (exit code) TT=0.006	? (TO) TT=1800.31	? (TO) TT=1800.13	? TT=38.082	? TT=38.136	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos1.opb	OPT f=19 TT=3.841 T1=3.83	? (TO) TT=1800.01	? (TO) TT=1800.02	OPT f=19 TT=3.841 T1=3.83	OPT f=19 TT=8.465 T1=8.46	OPT f=19 TT=5.774 T1=5.77	OPT f=19 TT=6.279 T1=6.27	SAT (TO) f=22 TT=1800.8 T1=117.48	SAT (TO) f=22 TT=1800.81 T1=1122.57	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos5.opb	OPT f=15360 TT=465.143 T1=465.21	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=15488 TT=1800.02 T1=1800.3	OPT f=15360 TT=465.143 T1=465.21	SAT (TO) f=16409 TT=1800.03 T1=1800.4	SAT (TO) f=16288 TT=1800.04 T1=1800.4	SAT (TO) f=16430 TT=1800.66 T1=707.18	SAT (TO) f=19713 TT=1800.02 T1=1062.77	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-mps-v2-20-10-neos8.opb	OPT f=-3719 TT=0.899 T1=0.89	OPT f=-3719 TT=0.899 T1=0.89	OPT f=-3719 TT=3.575 T1=3.56	OPT f=-3719 TT=120.375 T1=120.36	OPT f=-3719 TT=27.438 T1=27.39	OPT f=-3719 TT=31.353 T1=31.32	OPT f=-3719 TT=49.49 T1=49.28	OPT f=-3719 TT=6.751 T1=10.13	OPT f=-3719 TT=3.255 T1=1.82	OPT f=-3719 TT=14.989 T1=13.61
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-25fv47.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.27	? TT=143.055	? TT=147.209	? (TO) TT=1800.83	? (TO) TT=1800.65	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-80bau3b.opb	UNSAT TT=0.511	UNSAT TT=0.572	UNSAT TT=0.511	UNSAT TT=3.268	UNSAT TT=3.513	? (MO) TT=64.354	? TT=60.395	UNSAT TT=4.393	UNSAT TT=3.176	UNSAT TT=20.375
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-adlittle.opb	SAT f=12 TT=1800.79 T1=153.44	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=95 TT=1800.08 T1=1800.4	? TT=142.792	? TT=137.031	SAT (TO) f=12 TT=1800.79 T1=153.44	? (TO) TT=1800.84	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-afiro.opb	OPT f=-66 TT=6.932 T1=6.92	OPT f=-66 TT=6.932 T1=6.92	OPT f=-66 TT=1141.65 T1=1141.82	SAT (TO) f=-48 TT=1800.02 T1=1800.3	OPT f=-66 TT=46.055 T1=46.06	? TT=158.976	? TT=150.227	OPT f=-66 TT=1609.84 T1=140.29	SAT (TO) f=-62 TT=1800.05 T1=1178.3	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg2.opb	SAT f=16917 TT=1800.19 T1=233.91	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.14	? TT=152.984	? TT=147.859	SAT (TO) f=16917 TT=1800.19 T1=233.91	SAT (TO) f=22499 TT=1800.04 T1=46.44	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg3.opb	SAT f=975 TT=1800.05 T1=1.17	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=142.914	? TT=154.201	SAT (TO) f=49318 TT=1800.81 T1=25.23	SAT (TO) f=975 TT=1800.05 T1=1.17	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-agg.opb	SAT f=-5638 TT=1800.02 T1=9.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=128.962	? TT=127.287	SAT (TO) f=-5638 TT=1800.02 T1=9.07	SAT (TO) f=751 TT=1800.07 T1=1.43	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bandm.opb	UNSAT TT=0.103	UNSAT TT=0.167	UNSAT TT=0.103	UNSAT TT=6.7	UNSAT TT=80.18	? TT=153.988	? TT=162.486	UNSAT TT=3.544	UNSAT TT=1.415	UNSAT TT=1.156
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-beaconfd.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.13	? TT=138.23	? TT=140.01	? (TO) TT=1800.18	? (TO) TT=1800	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-blend.opb	OPT f=-24 TT=68.247 T1=68.25	OPT f=-24 TT=235.139 T1=235.16	OPT f=-24 TT=68.247 T1=68.25	? (TO) TT=1800.06	SAT (TO) f=-19 TT=1800.09 T1=1800.4	? TT=145.648	? TT=139.537	OPT f=-24 TT=562.188 T1=258.32	? (TO) TT=1800	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl1.opb	UNSAT TT=1.223	UNSAT TT=1.248	UNSAT TT=1.223	UNSAT TT=10.852	UNSAT TT=107.417	? TT=166.262	? TT=156.853	UNSAT TT=2.754	UNSAT TT=2.155	UNSAT TT=3.419
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bnl2.opb	UNSAT TT=2.586	UNSAT TT=2.677	UNSAT TT=2.586	UNSAT TT=67.176	? (TO) TT=1800.41	? TT=139.526	? TT=139.523	UNSAT TT=85.38	UNSAT TT=3.903	UNSAT TT=33.725
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing1.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	? TT=129.306	? TT=128.373	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-boeing2.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=138.725	? TT=137.201	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-bore3d.opb	UNSAT TT=0.036	UNSAT TT=0.05	UNSAT TT=0.036	UNSAT TT=0.329	UNSAT TT=0.543	? TT=131.177	? TT=132.967	UNSAT TT=1.613	UNSAT TT=0.988	UNSAT TT=0.486
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-brandy.opb	UNSAT TT=0.222	UNSAT TT=0.248	UNSAT TT=0.222	? (TO) TT=1800.09	UNSAT TT=279.797	? TT=83.682	? TT=84.986	UNSAT TT=2.335	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-capri.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=129.676	? TT=130.533	? (TO) TT=1800.05	? (TO) TT=1800.59	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-cycle.opb		? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.32	? (MO) TT=106.555	? (MO) TT=107.558	? (TO) TT=1800.03	? (TO) TT=1800.59	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-czprob.opb	UNSAT TT=2.403	UNSAT TT=3.316	UNSAT TT=3.318	UNSAT TT=51.113	UNSAT TT=193.705	? TT=178.757	? TT=177.271	UNSAT TT=3.395	UNSAT TT=2.403	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d2q06c.opb	UNSAT TT=52.644	UNSAT TT=52.644	UNSAT TT=54.733	? (TO) TT=1800.02	? (TO) TT=1800.14	? TT=131.639	? TT=133.21	? (TO) TT=1800.84	? (TO) TT=1800.02	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-d6cube.opb	UNSAT TT=4.31	UNSAT TT=4.93	UNSAT TT=4.31	? (TO) TT=1800.02	Signal TT=319.173	? TT=114.477	? TT=112.789	UNSAT TT=12.261	UNSAT TT=15.551	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen2.opb	UNSAT TT=0.391	UNSAT TT=0.483	UNSAT TT=0.391	? (TO) TT=1800.1	UNSAT TT=91.733	? TT=96.698	? TT=97.186	UNSAT TT=54.905	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-degen3.opb	UNSAT TT=1154.83	UNSAT TT=1154.83	UNSAT TT=1277.7	? (TO) TT=1800.04	? (TO) TT=1800.34	? TT=99.512	? TT=98.082	? (TO) TT=1800.06	? (TO) TT=1800.55	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-dfl001.opb		? (exit code) TT=0.537	? (exit code) TT=0.006	? (TO) TT=1800.17	? (TO) TT=1800.07	? TT=122.023	? TT=123.465	? (TO) TT=1800.72	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-e226.opb	UNSAT TT=0.145	UNSAT TT=0.195	UNSAT TT=0.145	UNSAT TT=7.66	UNSAT TT=102.175	? TT=163.856	? TT=164.165	UNSAT TT=3.984	? (TO) TT=1800.08	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-etamacro.opb	SAT f=9 TT=1800.64 T1=51.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT (TO) f=136 TT=1800.08 T1=1800.4	? TT=138.964	? TT=137.962	SAT (TO) f=9 TT=1800.64 T1=51.11	SAT (TO) f=32 TT=1800.05 T1=19.26	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fffff800.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=98.572	? TT=98.294	? (TO) TT=1800.67	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1d.opb		? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.21	? TT=96.786	? TT=97.488	? (TO) TT=1800	? (TO) TT=1801.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit1p.opb	OPT f=0 TT=1.079 T1=1.06	OPT f=0 TT=4.013 T1=3.99	OPT f=0 TT=1.079 T1=1.06	? (TO) TT=1800.03	? (MO) TT=1568.85	? TT=67.975	? TT=68.271	OPT f=0 TT=4.543 T1=2.51	OPT f=0 TT=2.643 T1=1.42	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2d.opb		? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	Signal TT=215.112	? (MO) TT=70.013	? (MO) TT=70.295	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-fit2p.opb	SAT f=208 TT=1800.36 T1=41.32	? (exit code) TT=0.732	? (exit code) TT=0.006	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=69.141	? TT=69.49	SAT (TO) f=1782 TT=1800.92 T1=56.41	SAT (TO) f=208 TT=1800.36 T1=41.32	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-forplan.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? TT=78.305	? TT=80.221	? (TO) TT=1800.9	? (TO) TT=1800.91	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ganges.opb		? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=61.795	? TT=62.596	? (TO) TT=1800.03	? (TO) TT=1800.65	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-gfrd-pnc.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? TT=140.022	? TT=143.276	? (TO) TT=1800.02	? (TO) TT=1800.64	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbea.opb		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=223.064	? TT=229.849	? (TO) TT=1800.89	? (TO) TT=1800.04	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-greenbeb.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.16	? TT=318.776	? TT=318.522	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow15.opb		? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=76.754	? TT=77.472	? (TO) TT=1800.9	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow22.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=74.315	? TT=75.326	? (TO) TT=1800.84	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-grow7.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.2	? TT=76.18	? TT=75.879	? (TO) TT=1800.79	? (TO) TT=1801.24	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-israel.opb	OPT f=-41 TT=321.257 T1=321.3	OPT f=-41 TT=1571.14 T1=1571.35	OPT f=-41 TT=321.257 T1=321.3	? (TO) TT=1800.03	SAT (TO) f=14 TT=1800.09 T1=1800.5	? TT=157.71	? TT=154.596	OPT f=-41 TT=1643.33 T1=806.1	? (TO) TT=1800.01	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-kb2.opb	OPT f=-293850 TT=0.117 T1=0.12	OPT f=-293850 TT=0.145 T1=0.14	OPT f=-293850 TT=0.117 T1=0.12	OPT f=-293850 TT=98.238 T1=98.25	OPT f=-293850 TT=51.118 T1=51.11	? TT=149.131	? TT=154.173	OPT f=-293850 TT=6.295 T1=4.91	SAT (TO) f=-136357 TT=1800.05 T1=1.79	OPT f=-293850 TT=190.322 T1=190.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-lotfi.opb		? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=163.188	? TT=159.427	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2	? TT=130.08	? TT=128.204	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-maros-r7.opb		? (exit code) TT=0.929	? (exit code) TT=0.005	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=144.815	? TT=149.352	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-modszk1.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.26	? TT=134.075	? TT=135.312	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.03
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-nesm.opb		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.43	? TT=64.202	? TT=64.186	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-perold.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	? (MO) TT=108.104	? (MO) TT=107.988	? (TO) TT=1800.67	? (TO) TT=1800.71	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot4.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=112.48	? TT=112.261	? (TO) TT=1800.65	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot87.opb	UNSAT TT=0.627	UNSAT TT=0.904	UNSAT TT=0.627	UNSAT TT=4.741	UNSAT TT=4.754	? (MO) TT=113.162	? (MO) TT=116.526	UNSAT TT=4.242	UNSAT TT=2.724	UNSAT TT=11.516
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.opb	UNSAT TT=0.248	UNSAT TT=0.482	UNSAT TT=0.248	UNSAT TT=5.396	UNSAT TT=6.038	? TT=136.342	? TT=134.66	UNSAT TT=4.773	UNSAT TT=2.963	UNSAT TT=7.872
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-pilot.we.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=106.127	? TT=104.569	? (TO) TT=1800.8	? (TO) TT=1800.69	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-recipe.opb	SAT f=-122041 TT=1800.33 T1=842.8	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=201.047	? TT=204.697	SAT (TO) f=-122041 TT=1800.33 T1=842.8	SAT (TO) f=-121839 TT=1800.71 T1=0.96	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc105.opb	SAT f=-14 TT=1800.23 T1=869.91	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT (TO) f=0 TT=1800.07 T1=1800.4	? TT=125.11	? TT=124.592	SAT (TO) f=-14 TT=1800.23 T1=869.91	SAT (TO) f=-3 TT=1800.01 T1=908.73	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc205.opb	SAT f=0 TT=1800.08 T1=0.97	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (MO) TT=123.862	? TT=124.592	SAT (TO) f=0 TT=1800.16 T1=0.97	SAT (TO) f=0 TT=1800.08 T1=1273.47	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50a.opb	SAT f=-35 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=-6 TT=1800.02 T1=1800.3	SAT (TO) f=-35 TT=1800.02 T1=1800.3	? TT=123.345	? TT=123.767	SAT (TO) f=-29 TT=1800.52 T1=838.01	SAT (TO) f=-21 TT=1800.06 T1=435.04	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sc50b.opb	OPT f=-45 TT=242.948 T1=242.98	OPT f=-45 TT=242.948 T1=242.98	OPT f=-45 TT=895.616 T1=895.75	SAT (TO) f=-17 TT=1800.02 T1=1800.3	SAT (TO) f=-27 TT=1800.1 T1=1800.4	? TT=123.294	? TT=123.786	SAT (TO) f=-35 TT=1800.72 T1=450.24	SAT (TO) f=-23 TT=1800.58 T1=1586.45	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr25.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=123.764	? TT=123.135	? (TO) TT=1800.69	? (TO) TT=1800.63	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scagr7.opb	SAT f=527 TT=1800.65 T1=106.48	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=124.275	? TT=123.361	SAT (TO) f=527 TT=1800.65 T1=106.48	SAT (TO) f=552 TT=1800.01 T1=70.72	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm1.opb		? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=155.571	? TT=156.397	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm2.opb		? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=142.148	? TT=144.376	? (TO) TT=1800.79	? (TO) TT=1800.01	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scfxm3.opb		? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=137.614	? TT=138.281	? (TO) TT=1800.14	? (TO) TT=1800.58	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scorpion.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=137.105	? TT=129.592	? (TO) TT=1800.13	? (TO) TT=1800.58	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scrs8.opb	UNSAT TT=0.166	UNSAT TT=0.227	UNSAT TT=0.166	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=261.209	? TT=259.487	UNSAT TT=4.322	UNSAT TT=44.477	UNSAT TT=33.895
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd1.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=96.98	? TT=97.645	? (TO) TT=1800.77	? (TO) TT=1800.81	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd6.opb		? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=100.503	? TT=99.177	? (TO) TT=1800.74	? (TO) TT=1800.03	? (TO) TT=1800.15
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-scsd8.opb		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=118.744	? TT=120.584	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap1.opb	SAT f=297 TT=1800.08 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT (TO) f=297 TT=1800.08 T1=1800.4	? TT=143.087	? TT=137.184	SAT (TO) f=846 TT=1800.04 T1=4.57	No Cert. TT=1800.06	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap2.opb	SAT f=653 TT=1800.04 T1=44.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=816 TT=1800.37 T1=1800.4	? TT=135.63	? TT=136.451	SAT (TO) f=653 TT=1800.04 T1=44.05	No Cert. TT=1801.26	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sctap3.opb	SAT f=838 TT=1800.79 T1=5.22	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=2093 TT=1800.44 T1=1800.5	? TT=141.92	? TT=141.946	SAT (TO) f=838 TT=1800.79 T1=5.22	No Cert. TT=1800.04	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-seba.opb	UNSAT TT=0.151	UNSAT TT=0.22	UNSAT TT=0.151	UNSAT TT=4.717	UNSAT TT=219.266	? (MO) TT=115.517	? (MO) TT=111.087	UNSAT TT=2.573	UNSAT TT=11.451	UNSAT TT=61.898
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share1b.opb	UNSAT TT=26.507	UNSAT TT=26.507	UNSAT TT=26.983	? (TO) TT=1800.03	UNSAT TT=318.86	? TT=179.033	? TT=187.413	UNSAT TT=182.196	? (TO) TT=1800.02	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-share2b.opb	OPT f=-52 TT=0.52 T1=0.51	OPT f=-52 TT=0.683 T1=0.68	OPT f=-52 TT=0.52 T1=0.51	? (TO) TT=1800.03	OPT f=-52 TT=180.735 T1=180.74	? TT=107.464	? TT=107.128	OPT f=-52 TT=4.474 T1=4.01	? (TO) TT=1800.06	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-shell.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.18	? (MO) TT=110.808	? (MO) TT=111.087	? (TO) TT=1800.86	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04l.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=103.421	? TT=100.502	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship04s.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=86.07	? TT=88.71	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.2
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08l.opb		? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.22	? TT=105.927	? TT=107.347	? (TO) TT=1800.79	? (TO) TT=1800.01	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship08s.opb		? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=92.338	? TT=89.041	? (TO) TT=1800.72	? (TO) TT=1800.63	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12l.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.32	? TT=86.13	? TT=86.514	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-ship12s.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.51	? TT=99.914	? TT=100.242	? (TO) TT=1800.71	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-sierra.opb		? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.19	? TT=70.453	? TT=72.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stair.opb	UNSAT TT=2.102	UNSAT TT=2.102	UNSAT TT=2.163	? (TO) TT=1800.07	UNSAT TT=1198.35	? TT=133.672	? TT=132.598	UNSAT TT=140.923	UNSAT TT=1650.43	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standata.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=154.456	? TT=151.969	? (TO) TT=1800.63	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-standgub.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=75.756	? TT=75.69	? (TO) TT=1800.18	? (TO) TT=1800.77	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor1.opb	SAT f=-40 TT=1800.02 T1=206.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT (TO) f=4399 TT=1800.07 T1=1800.4	? TT=135.475	? TT=137.552	SAT (TO) f=-40 TT=1800.02 T1=206.02	? (TO) TT=1800.54	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-stocfor2.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.23	? TT=137.3	? TT=136.97	? (TO) TT=1800.72	? (TO) TT=1800.02	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-tuff.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=143.599	? TT=144.997	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-vtp.base.opb	UNSAT TT=5.814	UNSAT TT=13.496	UNSAT TT=13.744	UNSAT TT=108.669	UNSAT TT=59.054	? TT=134.935	? TT=138.653	UNSAT TT=5.814	? (TO) TT=1800.04	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-wood1p.opb	UNSAT TT=193.848	UNSAT TT=198.437	UNSAT TT=193.848	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=72.903	? TT=76.732	? (TO) TT=1800.92	UNSAT TT=1284.91	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/ftp.netlib.org/lp/data/ normalized-reduced-mps-v2-20-10-woodw.opb		? (exit code) TT=0.518	? (exit code) TT=0.006	? (TO) TT=1800.05	? (TO) TT=1800.17	? TT=84.58	? TT=85.71	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-a1c1s1.opb	UNSAT TT=1.45	UNSAT TT=1.592	UNSAT TT=1.45	? (TO) TT=1800.09	UNSAT TT=745.75	? TT=117.609	? TT=116.819	UNSAT TT=8.175	UNSAT TT=3.893	UNSAT TT=214.709
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow30a.opb	SAT f=3405 TT=1800.36 T1=847.63	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=107.26	? TT=107.537	SAT (TO) f=3405 TT=1800.36 T1=847.63	No Cert. TT=1800.99	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-aflow40b.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.17	? (MO) TT=65.343	? (MO) TT=63.659	? (TO) TT=1800.11	? (TO) TT=1800.71	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air04.opb	SAT f=5967 TT=1800.09 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=5967 TT=1800.09 T1=1800.4	SAT (TO) f=5991 TT=1800.06 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.79	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-air05.opb	SAT f=4098 TT=1800.12 T1=1800.4	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=4482 TT=1800.12 T1=1800.4	SAT (TO) f=4609 TT=1800.08 T1=1800.4	SAT (TO) f=4098 TT=1800.12 T1=1800.4	? TT=69.455	SAT (TO) f=5293 TT=1800.48 T1=721.7	SAT (TO) f=5852 TT=1800.67 T1=2.85	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-arki001.opb	UNSAT TT=2.515	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=100.018	? TT=92.396	UNSAT TT=2.515	? (TO) TT=1800.01	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-atlanta-ip.opb	UNSAT TT=0.651	UNSAT TT=0.942	UNSAT TT=0.651	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=85.139	? (MO) TT=83.942	UNSAT TT=8.252	UNSAT TT=5.014	UNSAT TT=46.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-dano3mip.opb		? (exit code) TT=0.911	? (exit code) TT=0.006	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=148.843	? TT=139.689	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-danoint.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=142.231	? TT=137.849	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-fiber.opb	OPT f=4372 TT=1413.34 T1=1413.32	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=195272 TT=1800.09 T1=1800.4	OPT f=4372 TT=1413.34 T1=1413.32	? TT=152.988	? TT=150.847	SAT (TO) f=8209 TT=1800.14 T1=1.81	SAT (TO) f=7552 TT=1800.01 T1=0.46	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-fixnet6.opb		? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=100.805	? (MO) TT=103.289	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-gesa2-o.opb	SAT f=756 TT=1800.06 T1=34.03	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=1018 TT=1800.08 T1=1800.4	SAT (TO) f=1004 TT=1800.05 T1=1800.4	? TT=141.856	? TT=136.556	SAT (TO) f=786 TT=1800.04 T1=12.11	SAT (TO) f=756 TT=1800.06 T1=34.03	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-gesa2.opb	SAT f=738 TT=1800.04 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=1615 TT=1800.05 T1=1800.4	SAT (TO) f=738 TT=1800.04 T1=1800.4	? TT=143.756	? TT=145.155	SAT (TO) f=777 TT=1800.07 T1=2.95	No Cert. TT=1801.22	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1212 TT=1800.92 T1=492.7	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=5736 TT=1800.06 T1=1800.4	SAT (TO) f=1273 TT=1800.06 T1=1800.4	? TT=144.688	? TT=144.858	SAT (TO) f=1212 TT=1800.92 T1=492.7	No Cert. TT=1800.09	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-harp2.opb	SAT f=-8127 TT=1800.71 T1=1.3	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=-7377 TT=1800.02 T1=1800.3	SAT (TO) f=-5841 TT=1800.08 T1=1800.4	? TT=123.805	? TT=120.743	SAT (TO) f=-8127 TT=1800.71 T1=1.3	SAT (TO) f=-7153 TT=1800.09 T1=6.37	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-liu.opb	SAT f=688 TT=1800.61 T1=1375.81	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=137.095	? TT=138.771	SAT (TO) f=768 TT=1800.22 T1=882.69	SAT (TO) f=688 TT=1800.61 T1=1375.81	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare1.opb	SAT f=9 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.02 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	? TT=158.595	? TT=166.508	SAT (TO) f=41 TT=1800.3 T1=871.14	SAT (TO) f=44 TT=1800.06 T1=1605.69	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-markshare2.opb	SAT f=9 TT=1800.02 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	? TT=149	? TT=146.176	SAT (TO) f=29 TT=1800.85 T1=282.1	SAT (TO) f=68 TT=1800.02 T1=0.37	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas74.opb	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.025 T1=0.02	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.093 T1=0.09	OPT f=1 TT=0.051 T1=0.05	? (MO) TT=239.926	? (MO) TT=239.32	OPT f=1 TT=0.365 T1=0.75	OPT f=1 TT=0.344 T1=0.19	OPT f=1 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mas76.opb	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.025 T1=0.02	OPT f=1 TT=0.014 T1=0.01	OPT f=1 TT=0.097 T1=0.09	OPT f=1 TT=0.043 T1=0.04	? (MO) TT=238.243	? (MO) TT=230.73	OPT f=1 TT=0.352 T1=0.71	OPT f=1 TT=0.325 T1=0.22	OPT f=1 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-misc07.opb	OPT f=262858 TT=140.83 T1=17.91	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=262859 TT=1800.02 T1=1800.3	OPT f=262858 TT=784.752 T1=784.86	? TT=130.498	? TT=135.985	OPT f=262858 TT=686.832 T1=44.38	OPT f=262858 TT=140.83 T1=17.91	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-mkc.opb	SAT f=-3323 TT=1800.1 T1=1800.4	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=-3323 TT=1800.1 T1=1800.4	SAT (TO) f=4426 TT=1800.03 T1=1800.4	? TT=91.242	? TT=92.336	SAT (TO) f=-3137 TT=1800.18 T1=572.22	SAT (TO) f=-3121 TT=1800.03 T1=0.56	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-mod011.opb		? (exit code) TT=0.385	? (exit code) TT=0.007	? (TO) TT=1800.03	? (TO) TT=1800.48	? TT=66.209	? TT=66.829	? (TO) TT=1800.78	? (TO) TT=1800.68	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-modglob.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=155.43	? TT=154.355	? (TO) TT=1800.85	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum1.opb	UNSAT TT=0.426	UNSAT TT=0.458	UNSAT TT=0.426	UNSAT TT=2.363	UNSAT TT=2.343	? (MO) TT=416.496	? (MO) TT=385.918	UNSAT TT=4.344	UNSAT TT=2.456	UNSAT TT=4.722
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum2.opb	UNSAT TT=1.573	UNSAT TT=1.913	UNSAT TT=1.573	UNSAT TT=17.015	UNSAT TT=16.979	? (MO) TT=199.839	? (MO) TT=200.91	UNSAT TT=11.662	UNSAT TT=7.033	UNSAT TT=802.808
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-momentum3.opb	SAT f=407422 TT=1800.19 T1=158.45	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=85.413	? (MO) TT=86.557	SAT (TO) f=407422 TT=1800.19 T1=158.45	SAT (TO) f=408052 TT=1800.06 T1=190.01	? (TO) TT=1800.42
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-msc98-ip.opb	UNSAT TT=1373.53	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=78.814	? TT=79.051	UNSAT TT=1373.53	? (TO) TT=1800.58	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-noswot.opb	OPT f=-7 TT=0.024 T1=0.02	OPT f=-7 TT=0.038 T1=0.03	OPT f=-7 TT=0.024 T1=0.02	OPT f=-7 TT=7.142 T1=7.13	OPT f=-7 TT=3.188 T1=3.18	? TT=144.21	? TT=144.393	OPT f=-7 TT=1.324 T1=0.79	SAT (TO) f=-7 TT=1800.58 T1=0.33	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-nsrand-ipx.opb	SAT f=295446 TT=1800.82 T1=701.63	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=520663 TT=1800.1 T1=1800.5	SAT (TO) f=497871 TT=1800.04 T1=1800.7	? TT=81.19	? TT=80.391	SAT (TO) f=295446 TT=1800.82 T1=701.63	SAT (TO) f=524296 TT=1800.05 T1=0.95	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-nw04.opb	SAT f=73 TT=1800.04 T1=1800.3	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT f=96 TT=236.13 T1=235.6	SAT (TO) f=142 TT=1800.05 T1=1800.3	SAT (TO) f=73 TT=1800.04 T1=1800.3	SAT (TO) f=86 TT=1800.19 T1=800.61	No Cert. TT=1800.06	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pk1.opb	SAT f=21 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=21 TT=1800.02 T1=1800.3	SAT (TO) f=33 TT=1800.09 T1=1800.4	? TT=131.466	? TT=133.149	? (TO) TT=1800.64	? (TO) TT=1800.01	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-pp08aCUTS.opb	SAT f=8084 TT=1800.24 T1=880.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=138.508	? (MO) TT=137.953	SAT (TO) f=8084 TT=1800.24 T1=880.08	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-pp08a.opb		? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=130.01	? TT=129.132	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-qiu.opb		? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=208.163	? TT=206.102	? (TO) TT=1800.57	? (TO) TT=1800.66	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-rd-rplusc-21.opb		? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=126.996	? TT=128.184	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.33
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=450588 TT=1800.03 T1=1657.34	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=77.272	? TT=78.156	SAT (TO) f=507933 TT=1800.53 T1=845.8	SAT (TO) f=450588 TT=1800.03 T1=1657.34	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-rout.opb	SAT f=262441 TT=1800.7 T1=195.94	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=262484 TT=1800.01 T1=1800.3	SAT (TO) f=262548 TT=1800.08 T1=1800.4	? TT=115.573	? TT=122.411	SAT (TO) f=262441 TT=1800.7 T1=195.94	SAT (TO) f=262475 TT=1800.09 T1=252.53	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-set1ch.opb	SAT f=1755 TT=1800.02 T1=68.81	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT (TO) f=7008 TT=1800.04 T1=1800.4	? TT=138.194	? TT=138.121	SAT (TO) f=5458 TT=1800.09 T1=9.16	SAT (TO) f=1755 TT=1800.02 T1=68.81	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=52 TT=1800.04 T1=9.22	? (exit code) TT=2.433	? (exit code) TT=0.006	SAT (TO) f=57 TT=1800.15 T1=1800.4	SAT (TO) f=57 TT=1800.16 T1=1800.4	? TT=77.366	? TT=77.799	SAT (TO) f=52 TT=1800.04 T1=9.22	No Cert. TT=1800.79	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-stp3d.opb		? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.73	? (TO) TT=1800.09	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-swath.opb	SAT f=262299 TT=1800.63 T1=371.28	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=72.197	? TT=73.22	SAT (TO) f=262299 TT=1800.63 T1=371.28	SAT (TO) f=266262 TT=1800.08 T1=853.37	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-t1717.opb	SAT f=660 TT=113.085 T1=112.5	? (TO) TT=1800.04	? (TO) TT=1801.29	SAT (TO) f=660 TT=1800.04 T1=1800.4	SAT (MO) f=660 TT=113.085 T1=112.5	SAT (TO) f=664 TT=1800.09 T1=1800.4	SAT (TO) f=664 TT=1800.1 T1=1800.4	SAT (TO) f=1170 TT=1800 T1=13.36	No Cert. TT=1800.09	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab1.opb	SAT f=162257 TT=1800.11 T1=1.88	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=142.282	? TT=137.577	SAT (TO) f=162257 TT=1800.11 T1=1.88	SAT (TO) f=181135 TT=1800.04 T1=0.6	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-timtab2.opb	SAT f=202233 TT=1800.12 T1=1.95	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=128.999	? (MO) TT=130.078	SAT (TO) f=202233 TT=1800.12 T1=1.95	SAT (TO) f=212655 TT=1800.04 T1=1.22	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.06	? TT=137.926	? TT=138.459	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib2003/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1800.96 T1=45.5	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=134.452	? TT=159.149	SAT (TO) f=39649 TT=1800.96 T1=45.5	SAT (TO) f=41696 TT=1801 T1=12.94	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib2003/normalized-reduced-mps-v2-20-10-vpm2.opb	SAT f=66 TT=1800.61 T1=1756.25	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=133.083	? TT=130.007	SAT (TO) f=157 TT=1800.85 T1=2.32	SAT (TO) f=66 TT=1800.61 T1=1756.25	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-blend2.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.79	? (TO) TT=1800.05	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-gesa3_o.opb	SAT f=673 TT=1800.58 T1=97.77	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=862 TT=1800.04 T1=1800.4	SAT (TO) f=936 TT=1800.05 T1=1800.4	? TT=155.665	? TT=152.38	SAT (TO) f=724 TT=1800.1 T1=7.61	SAT (TO) f=673 TT=1800.58 T1=97.77	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gesa3.opb	SAT f=238 TT=1800.12 T1=1800.5	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1462 TT=1800.03 T1=1800.4	SAT (TO) f=238 TT=1800.12 T1=1800.5	? TT=124.353	? TT=122.085	SAT (TO) f=548 TT=1800.19 T1=6.35	SAT (TO) f=548 TT=1800.03 T1=3.15	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-gt2.opb	OPT f=3591 TT=3.122 T1=2.22	? (TO) TT=1800.02	OPT f=3591 TT=1024 T1=1024.16	SAT (TO) f=9457 TT=1800.02 T1=1800.3	SAT (TO) f=4818 TT=1800.09 T1=1800.4	SAT (TO) f=5521 TT=1800.28 T1=1800.4	? TT=110.703	OPT f=3591 TT=3.122 T1=2.22	SAT (TO) f=3591 TT=1800.03 T1=647.87	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib3/normalized-reduced-mps-v2-20-10-qnet1_o.opb	SAT f=209 TT=1800.07 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=1815 TT=1800.1 T1=1800.4	SAT (TO) f=209 TT=1800.07 T1=1800.4	? TT=156.075	? TT=151.649	SAT (TO) f=359 TT=1800.1 T1=1.9	SAT (TO) f=355 TT=1800.65 T1=0.62	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib3/ normalized-reduced-mps-v2-20-10-qnet1.opb	SAT f=316 TT=1800.08 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=1836 TT=1800.08 T1=1800.4	SAT (TO) f=316 TT=1800.08 T1=1800.4	? TT=153.983	? TT=154.123	SAT (TO) f=426 TT=1800.06 T1=0.84	SAT (TO) f=426 TT=1800.09 T1=0.55	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air01.opb	OPT f=1496 TT=1.234 T1=0.52	OPT f=1496 TT=18.549 T1=18.54	OPT f=1496 TT=2.876 T1=2.87	OPT f=1496 TT=1591.61 T1=1591.91	OPT f=1496 TT=41.585 T1=41.48	OPT f=1496 TT=1.234 T1=1.23	OPT f=1496 TT=32.099 T1=31.92	OPT f=1496 TT=5.05 T1=4.78	OPT f=1496 TT=2.142 T1=0.52	OPT f=1496 TT=91.451 T1=91.4
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air02.opb	OPT f=313 TT=209.34 T1=200.17	OPT f=313 TT=912.239 T1=912.41	OPT f=313 TT=1687.85 T1=1688.11	SAT (TO) f=399 TT=1800.04 T1=1800.4	SAT (TO) f=521 TT=1800.18 T1=1800.4	SAT (TO) f=313 TT=1800.04 T1=1800.3	? TT=71.605	SAT (TO) f=340 TT=1800.19 T1=743.65	OPT f=313 TT=209.34 T1=200.17	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air03.opb	SAT f=7962 TT=1800.09 T1=555.93	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=8372 TT=1800.15 T1=1800.4	SAT (TO) f=8804 TT=1800.16 T1=1800.4	SAT (TO) f=25111 TT=1800.03 T1=1800.3	? TT=73.106	SAT (TO) f=7962 TT=1800.09 T1=555.93	No Cert. TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-air06.opb	SAT f=6016 TT=1800.14 T1=1800.4	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT (TO) f=7479 TT=1800.07 T1=1800.4	SAT (TO) f=6016 TT=1800.14 T1=1800.4	SAT (TO) f=7206 TT=1800.02 T1=1800.3	? TT=165.421	SAT (TO) f=7565 TT=1800.18 T1=677.55	SAT (TO) f=7491 TT=1800.05 T1=1144.59	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3a.opb	SAT f=720 TT=1800.08 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=17938 TT=1800.08 T1=1800.4	SAT (TO) f=720 TT=1800.08 T1=1800.4	? TT=130.573	? TT=133.674	SAT (TO) f=815 TT=1800 T1=11.88	SAT (TO) f=1814 TT=1800.01 T1=374.47	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell3b.opb	SAT f=989 TT=1800.18 T1=185.88	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=27699 TT=1800.1 T1=1800.4	SAT (TO) f=998 TT=1800.07 T1=1800.4	? TT=124.932	? TT=129.182	SAT (TO) f=989 TT=1800.18 T1=185.88	SAT (TO) f=1864 TT=1800.09 T1=769.03	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell4.opb	SAT f=1381 TT=1800.45 T1=738.6	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=16765 TT=1800.1 T1=1800.4	SAT (TO) f=1546 TT=1800.09 T1=1800.4	? TT=125.252	? TT=126.184	SAT (TO) f=1381 TT=1800.45 T1=738.6	SAT (TO) f=1664 TT=1800 T1=1739.9	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-bell5.opb	SAT f=788 TT=1800.64 T1=41.78	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2943 TT=1800.09 T1=1800.4	SAT (TO) f=1021 TT=1800.09 T1=1800.4	? TT=120.245	? TT=122.767	SAT (TO) f=956 TT=1800.68 T1=58.31	SAT (TO) f=788 TT=1800.64 T1=41.78	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-dcmulti.opb	SAT f=922 TT=1800.13 T1=265.41	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=122.252	? TT=124.523	SAT (TO) f=922 TT=1800.13 T1=265.41	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-egout.opb	SAT f=117 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=182 TT=1800.02 T1=1800.3	SAT (TO) f=117 TT=1800.1 T1=1800.4	? (MO) TT=448.769	? (MO) TT=469.296	SAT (TO) f=125 TT=1800 T1=548.51	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-enigma.opb	OPT f=0 TT=0.127 T1=0.12	OPT f=0 TT=0.312 T1=0.31	OPT f=0 TT=0.454 T1=0.45	OPT f=0 TT=61.967 T1=61.97	OPT f=0 TT=2.002 T1=2	? TT=142.042	? TT=136.871	OPT f=0 TT=0.984 T1=0.65	OPT f=0 TT=0.505 T1=0.25	OPT f=0 TT=0.127 T1=0.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet3.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (MO) TT=102.24	? (MO) TT=102.781	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-fixnet4.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (MO) TT=104.229	? (MO) TT=104.065	? (TO) TT=1800.71	? (TO) TT=1801.15	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-flugpl.opb	OPT f=91 TT=0.131 T1=0.13	OPT f=91 TT=0.131 T1=0.13	OPT f=91 TT=0.167 T1=0.16	OPT f=91 TT=1.813 T1=1.81	OPT f=91 TT=1.465 T1=1.46	? TT=140.968	? TT=140.325	OPT f=91 TT=4.483 T1=6.69	OPT f=91 TT=629.4 T1=527.63	OPT f=91 TT=408.705 T1=68.84
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-gen.opb	SAT f=551 TT=1800.01 T1=3.65	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=1433 TT=1800.09 T1=1800.4	SAT (TO) f=784 TT=1800.06 T1=1800.4	? TT=135.253	? TT=134.549	SAT (TO) f=551 TT=1800.01 T1=3.65	? (TO) TT=1800.76	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/ miplib/normalized-reduced-mps-v2-20-10-khb05250.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.91	? (TO) TT=1800.06	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc01.opb	OPT f=262288 TT=0.241 T1=0.24	OPT f=262288 TT=0.28 T1=0.28	OPT f=262288 TT=0.241 T1=0.24	OPT f=262288 TT=3.192 T1=3.19	OPT f=262288 TT=5.211 T1=5.21	OPT f=262288 TT=1262.79 T1=1262.89	OPT f=262288 TT=185.679 T1=185.49	OPT f=262288 TT=3.984 T1=2.66	OPT f=262288 TT=1.984 T1=0.77	OPT f=262288 TT=7.698 T1=7.48
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc02.opb	OPT f=262571 TT=0.041 T1=0.04	OPT f=262571 TT=0.055 T1=0.05	OPT f=262571 TT=0.041 T1=0.04	OPT f=262571 TT=1.141 T1=1.14	OPT f=262571 TT=4.246 T1=4.24	OPT f=262571 TT=388.744 T1=388.39	OPT f=262571 TT=178.565 T1=178.04	OPT f=262571 TT=2.885 T1=2.15	OPT f=262571 TT=1.204 T1=0.37	OPT f=262571 TT=2.197 T1=1.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc03.opb	OPT f=262989 TT=4.492 T1=1.92	OPT f=262989 TT=7.418 T1=7.41	OPT f=262989 TT=6.997 T1=7	OPT f=262989 TT=86.474 T1=86.49	OPT f=262989 TT=24.645 T1=24.64	? TT=127.651	? TT=125.476	OPT f=262989 TT=10.701 T1=7.21	OPT f=262989 TT=4.492 T1=1.92	OPT f=262989 TT=27.686 T1=20.53
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc04.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=110.494	? TT=106.196	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc05.opb	UNSAT TT=0.028	UNSAT TT=0.043	UNSAT TT=0.028	UNSAT TT=0.727	UNSAT TT=39.408	? TT=114.376	? TT=115.811	UNSAT TT=18.191	UNSAT TT=5.673	UNSAT TT=129.436
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-misc06.opb		? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? TT=136.412	? TT=143.031	? (TO) TT=1800.68	? (TO) TT=1800.02	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-mod013.opb	OPT f=19 TT=5.998 T1=5.99	? (TO) TT=1800.02	OPT f=19 TT=214.627 T1=214.66	OPT f=19 TT=43.357 T1=43.36	OPT f=19 TT=5.998 T1=5.99	? TT=148.679	? TT=153.705	SAT (TO) f=19 TT=1800.08 T1=66.81	SAT (TO) f=21 TT=1800.9 T1=114.43	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0282.opb	OPT f=104028 TT=0.799 T1=0.49	OPT f=104028 TT=4.239 T1=4.24	OPT f=104028 TT=6.389 T1=6.41	OPT f=104028 TT=704.545 T1=704.65	OPT f=104028 TT=19.928 T1=19.89	OPT f=104028 TT=1297.66 T1=1297.92	? TT=90.841	OPT f=104028 TT=3.014 T1=11.23	OPT f=104028 TT=1.104 T1=0.49	OPT f=104028 TT=0.799 T1=0.53
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p0291.opb	OPT f=7985 TT=0.102 T1=0.1	OPT f=7985 TT=0.11 T1=0.11	OPT f=7985 TT=0.102 T1=0.1	OPT f=7985 TT=27.377 T1=27.36	OPT f=7985 TT=8.976 T1=8.96	OPT f=7985 TT=2.44 T1=2.43	? TT=123.666	OPT f=7985 TT=1.145 T1=5.7	OPT f=7985 TT=0.483 T1=0.24	OPT f=7985 TT=0.275 T1=0.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-p6000.opb	SAT f=-73511 TT=1800.71 T1=173.76	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=70.097	? TT=70.262	SAT (TO) f=-73511 TT=1800.71 T1=173.76	? (TO) TT=1800.06	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-pipex.opb	OPT f=164393 TT=0.25 T1=0.25	OPT f=164393 TT=1.022 T1=1.02	OPT f=164393 TT=0.25 T1=0.25	OPT f=164393 TT=64.922 T1=64.92	OPT f=164393 TT=8.156 T1=8.15	OPT f=164393 TT=75.223 T1=75.23	? TT=129.307	OPT f=164393 TT=6.274 T1=7.66	OPT f=164393 TT=9.372 T1=6.79	OPT f=164393 TT=61.876 T1=49.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-rgn.opb	SAT f=90984 TT=1800.86 T1=31.3	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=129.445	? TT=134.755	SAT (TO) f=90984 TT=1800.86 T1=31.3	SAT (TO) f=102879 TT=1800.72 T1=759.85	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-sample2.opb	OPT f=5 TT=0.114 T1=0.11	OPT f=5 TT=0.114 T1=0.11	OPT f=5 TT=0.431 T1=0.42	OPT f=5 TT=9.156 T1=9.15	OPT f=5 TT=1.263 T1=1.25	? TT=189.335	? TT=191.118	OPT f=5 TT=18.42 T1=10.76	OPT f=5 TT=155.34 T1=153.28	OPT f=5 TT=6.852 T1=6.79
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1al.opb	SAT f=9004 TT=1800.83 T1=57.38	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT (TO) f=10699 TT=1800.06 T1=1800.4	? TT=83.169	? TT=82.992	SAT (TO) f=9004 TT=1800.83 T1=57.38	? (TO) TT=1800.62	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-set1cl.opb	SAT f=2649 TT=1800.04 T1=289.94	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT (TO) f=12465 TT=1800.07 T1=1800.4	? TT=81.43	? TT=82.82	SAT (TO) f=2649 TT=1800.04 T1=289.94	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/MIPLIB/miplib/ normalized-reduced-mps-v2-20-10-vpm1.opb	OPT f=20 TT=67.765 T1=67.71	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.629	? TT=153.479	? (TO) TT=1800.74	? (TO) TT=1800.68	OPT f=20 TT=67.765 T1=67.71
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bal8x12.opb	UNSAT TT=0.032	UNSAT TT=0.047	UNSAT TT=0.032	UNSAT TT=41.496	UNSAT TT=23.977	? TT=142.034	? TT=140.991	UNSAT TT=3.033	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-bk4x3.opb	OPT f=14 TT=0.181 T1=0.18	OPT f=14 TT=0.181 T1=0.18	OPT f=14 TT=0.193 T1=0.19	OPT f=14 TT=5.112 T1=5.11	OPT f=14 TT=1.077 T1=1.07	OPT f=14 TT=151.634 T1=151.35	OPT f=14 TT=259.434 T1=259.13	OPT f=14 TT=552.569 T1=14.2	SAT (TO) f=15 TT=1800.06 T1=19.29	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-gr4x6.opb	UNSAT TT=0.016	UNSAT TT=0.027	UNSAT TT=0.016	UNSAT TT=7.499	UNSAT TT=0.569	? TT=148.972	? TT=159.598	UNSAT TT=1.154	? (TO) TT=1800	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3700.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=141.138	? TT=142.973	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3701.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? TT=141.57	? TT=148.229	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3702.opb		? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=141.251	? TT=143.537	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3703.opb		? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=138.241	? TT=140.204	? (TO) TT=1800.98	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3704.opb		? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? TT=140.591	? TT=147.996	? (TO) TT=1800.72	? (TO) TT=1800.79	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3705.opb		? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=141.298	? TT=144.219	? (TO) TT=1800.02	? (TO) TT=1800.62	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3706.opb		? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=141.792	? TT=145.338	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3707.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=139.199	? TT=144.035	? (TO) TT=1802.21	? (TO) TT=1800.61	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3708.opb		? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=140.82	? TT=144.369	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n3709.opb		? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=141.111	? TT=143.915	? (TO) TT=1800.14	? (TO) TT=1800.75	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370a.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=140.965	? TT=144.116	? (TO) TT=1800.17	? (TO) TT=1800.65	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370b.opb		? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=141.729	? TT=145.616	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370c.opb		? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=140.697	? TT=145.309	? (TO) TT=1800.77	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-n370e.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=147.291	? TT=143.748	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10a.opb	OPT f=20 TT=0.261 T1=0.26	OPT f=20 TT=1.044 T1=1.04	OPT f=20 TT=0.261 T1=0.26	OPT f=20 TT=2.346 T1=2.34	OPT f=20 TT=1.563 T1=1.55	? TT=160.558	? TT=160.033	SAT (TO) f=20 TT=1800.91 T1=0.85	SAT (TO) f=20 TT=1800.03 T1=0.35	OPT f=20 TT=0.307 T1=0.29
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10b.opb	UNSAT TT=0.023	UNSAT TT=0.036	UNSAT TT=0.023	UNSAT TT=5.907	UNSAT TT=14.24	? TT=162.964	? TT=161.446	UNSAT TT=1.974	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x10c.opb	UNSAT TT=0.026	UNSAT TT=0.04	UNSAT TT=0.026	UNSAT TT=5.394	UNSAT TT=9.901	? TT=163.407	? TT=158.649	UNSAT TT=3.033	? (TO) TT=1800.7	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x12.opb	UNSAT TT=0.03	UNSAT TT=0.046	UNSAT TT=0.03	UNSAT TT=19.302	UNSAT TT=20.594	? TT=139.484	? TT=140.85	UNSAT TT=5.613	? (TO) TT=1800.13	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran10x26.opb	UNSAT TT=0.064	UNSAT TT=0.088	UNSAT TT=0.064	UNSAT TT=38.406	UNSAT TT=43.132	? TT=132.604	? TT=133.335	UNSAT TT=4.703	? (TO) TT=1800.03	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x12.opb	UNSAT TT=0.034	UNSAT TT=0.051	UNSAT TT=0.034	UNSAT TT=643.936	UNSAT TT=386.504	? TT=134.085	? TT=139.905	UNSAT TT=5.234	? (TO) TT=1800.09	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran12x21.opb	UNSAT TT=0.062	UNSAT TT=0.083	UNSAT TT=0.062	UNSAT TT=34.867	UNSAT TT=201.639	? TT=154.623	? TT=149.867	UNSAT TT=4.361	? (TO) TT=1800.02	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran13x13.opb	UNSAT TT=0.04	UNSAT TT=0.058	UNSAT TT=0.04	UNSAT TT=1203.33	? (TO) TT=1800.11	? TT=147.873	? TT=154.964	UNSAT TT=6.493	? (TO) TT=1800.66	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran14x18.opb	UNSAT TT=0.064	UNSAT TT=0.085	UNSAT TT=0.064	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=155.32	? TT=153.895	UNSAT TT=8.543	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran16x16.opb	OPT f=35 TT=4.984 T1=4.91	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=35 TT=1800.02 T1=1800.3	OPT f=35 TT=6.705 T1=6.69	? TT=153.376	? TT=165.753	SAT (TO) f=37 TT=1800.84 T1=1.57	SAT (TO) f=37 TT=1800.03 T1=0.61	OPT f=35 TT=4.984 T1=4.91
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran17x17.opb	OPT f=35 TT=5.327 T1=5.25	? (TO) TT=1800	? (TO) TT=1800.03	SAT (TO) f=35 TT=1800.02 T1=1800.3	OPT f=35 TT=8.624 T1=8.59	? TT=132.755	? TT=140.775	SAT (TO) f=36 TT=1800.01 T1=87.13	SAT (TO) f=38 TT=1800.06 T1=0.7	OPT f=35 TT=5.327 T1=5.25
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran4x64.opb	UNSAT TT=0.065	UNSAT TT=0.09	UNSAT TT=0.065	UNSAT TT=1.603	UNSAT TT=0.737	? TT=148.465	? TT=147.092	UNSAT TT=3.703	? (TO) TT=1800.87	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran6x43.opb	UNSAT TT=0.071	UNSAT TT=0.093	UNSAT TT=0.071	UNSAT TT=1.608	UNSAT TT=1.144	? TT=128.651	? TT=132.049	UNSAT TT=3.443	? (TO) TT=1800.92	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/fctp/ normalized-reduced-mps-v2-20-10-ran8x32.opb	UNSAT TT=0.074	UNSAT TT=0.098	UNSAT TT=0.074	UNSAT TT=3.451	UNSAT TT=4.119	? TT=145.285	? TT=143.78	UNSAT TT=4.103	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/lptestset/fome/ normalized-reduced-mps-v2-20-10-fome11.opb		? (exit code) TT=1.074	? (exit code) TT=0.006	? (TO) TT=1800.27	? (TO) TT=1800.1	? TT=125.571	? TT=126.811	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bc1.opb	UNSAT TT=183.597	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? (MO) TT=101.459	? (MO) TT=102.63	UNSAT TT=363.81	UNSAT TT=183.597	UNSAT TT=447.611
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst1.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=129.726	? TT=125.807	? (TO) TT=1800.02	? (TO) TT=1800.7	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-bienst2.opb		? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=132.63	? TT=135.853	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_3.opb		? (exit code) TT=0.941	? (exit code) TT=0.005	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=112.769	? TT=111.572	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_4.opb		? (exit code) TT=0.945	? (exit code) TT=0.005	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=111.52	? TT=110.412	? (TO) TT=1800.7	? (TO) TT=1800.66	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-dano3_5.opb		? (exit code) TT=0.938	? (exit code) TT=0.006	? (TO) TT=1800.02	? (TO) TT=1800.14	? TT=111.393	? TT=111.334	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare1_1.opb	OPT f=0 TT=37.742 T1=37.74	OPT f=0 TT=37.742 T1=37.74	OPT f=0 TT=230.281 T1=230.31	SAT (TO) f=24 TT=1800.02 T1=1800.3	SAT (TO) f=7 TT=1800.01 T1=1800.3	? TT=142.284	? TT=152.27	SAT (TO) f=24 TT=1800.74 T1=1.69	SAT (TO) f=21 TT=1800 T1=1494.93	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-markshare2_1.opb	OPT f=0 TT=55.86 T1=55.86	OPT f=0 TT=55.86 T1=55.86	OPT f=0 TT=420.676 T1=420.75	SAT (TO) f=46 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.02 T1=1800.3	? TT=145.625	? TT=141.762	SAT (TO) f=42 TT=1800.08 T1=875.93	SAT (TO) f=51 TT=1800.03 T1=448.37	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-mkc1.opb	SAT f=-2552 TT=1800.67 T1=1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT (TO) f=1595 TT=1800.28 T1=1800.4	? TT=85.573	? TT=86.437	SAT (TO) f=-2552 TT=1800.67 T1=2.08	SAT (TO) f=-2552 TT=1802.19 T1=1	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos11.opb	UNSAT TT=0.071	UNSAT TT=0.113	UNSAT TT=0.071	UNSAT TT=0.889	UNSAT TT=20.323	? (MO) TT=146.399	? (MO) TT=148.107	UNSAT TT=3.035	UNSAT TT=1.784	UNSAT TT=1.177
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos12.opb	UNSAT TT=0.24	UNSAT TT=0.373	UNSAT TT=0.24	UNSAT TT=3.612	UNSAT TT=53.351	? TT=145.47	? TT=147.52	UNSAT TT=3.594	UNSAT TT=2.432	UNSAT TT=3.803
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos13.opb	SAT f=-18596 TT=1800.04 T1=167.25	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? TT=121.817	? TT=120.651	SAT (TO) f=-18596 TT=1800.04 T1=167.25	? (TO) TT=1800.89	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos14.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=139.976	? TT=140.374	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos15.opb		? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=139.115	? TT=140.65	? (TO) TT=1800.73	? (TO) TT=1800.76	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos17.opb	UNSAT TT=0.073	UNSAT TT=0.112	UNSAT TT=0.073	UNSAT TT=2.863	UNSAT TT=18.24	? TT=137.351	? TT=134.863	UNSAT TT=2.086	UNSAT TT=1.273	UNSAT TT=0.522
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos20.opb	OPT f=-71 TT=53.063 T1=53.07	OPT f=-71 TT=124.471 T1=124.48	OPT f=-71 TT=53.063 T1=53.07	SAT (TO) f=-63 TT=1800.02 T1=1800.3	SAT (TO) f=-68 TT=1800.06 T1=1800.4	? (MO) TT=106.068	? (MO) TT=106.575	SAT (TO) f=-60 TT=1801.03 T1=109.06	SAT (TO) f=-56 TT=1800.08 T1=30.37	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos2.opb	OPT f=3 TT=3.94 T1=3.93	OPT f=3 TT=4.462 T1=4.45	OPT f=3 TT=3.94 T1=3.93	OPT f=3 TT=81.522 T1=81.51	OPT f=3 TT=254.119 T1=254.14	? TT=72.848	? TT=73.663	SAT (TO) f=3 TT=1800.01 T1=31.22	SAT (TO) f=3 TT=1800.04 T1=76.95	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos3.opb	OPT f=2 TT=6.906 T1=6.89	OPT f=2 TT=10.612 T1=10.6	OPT f=2 TT=6.906 T1=6.89	OPT f=2 TT=168.813 T1=168.84	OPT f=2 TT=372.008 T1=371.94	? TT=72.798	? TT=73.412	OPT f=2 TT=195.234 T1=96.84	OPT f=2 TT=555.922 T1=552.51	OPT f=2 TT=312.332 T1=310.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos6.opb	OPT f=0 TT=82.16 T1=82.11	OPT f=0 TT=82.16 T1=82.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=131.055	? TT=131.755	? (TO) TT=1800.12	? (TO) TT=1800.75	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos7.opb	SAT f=43 TT=1800.03 T1=1.74	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=101 TT=1800.07 T1=1800.4	SAT (TO) f=132 TT=1800.08 T1=1800.4	? TT=111.993	? TT=111.635	SAT (TO) f=48 TT=1800.96 T1=1.72	SAT (TO) f=43 TT=1800.03 T1=1.74	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-neos9.opb		? (exit code) TT=1.647	? (exit code) TT=0.006	? (TO) TT=1800.21	? (TO) TT=1800.29	? TT=38.888	? TT=38.594	? (TO) TT=1800.73	? (TO) TT=1800.62	? (TO) TT=1800.38
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-nug08.opb	OPT f=18 TT=6.155 T1=0.96	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=18 TT=1800.04 T1=1800.4	OPT f=18 TT=446.427 T1=446.4	? TT=141.871	? TT=143.133	SAT (TO) f=18 TT=1800.74 T1=1.5	SAT (TO) f=18 TT=1800.08 T1=0.96	OPT f=18 TT=6.155 T1=3.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-qap10.opb	SAT f=29 TT=1800.06 T1=2.02	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=29 TT=1800.08 T1=1800.4	SAT (TO) f=29 TT=1800.12 T1=1800.4	? TT=142.808	? TT=144.062	SAT (TO) f=29 TT=1800.92 T1=2.88	SAT (TO) f=29 TT=1800.06 T1=2.02	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-seymour1.opb	SAT f=106974 TT=1800.16 T1=287.52	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=192220 TT=1800.05 T1=1800.4	SAT (TO) f=126479 TT=1800.17 T1=1800.4	? (MO) TT=79.923	? (MO) TT=80.134	SAT (TO) f=106974 TT=1800.16 T1=287.52	SAT (TO) f=107713 TT=1800.42 T1=1.04	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath1.opb		? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? TT=1352.1	? TT=75.546	? TT=71.64	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath2.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1301.36	? TT=71.78	? TT=71.864	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/milp/ normalized-reduced-mps-v2-20-10-swath3.opb		? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1265.05	? TT=72.448	? TT=72.338	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A1C1S1.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? TT=143.685	? TT=143.465	? (TO) TT=1800.76	? (TO) TT=1800.02	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-A2C1S1.opb	UNSAT TT=875.798	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=875.798	? TT=142.198	? TT=142.154	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B1C1S1.opb	UNSAT TT=275.589	UNSAT TT=1188.27	UNSAT TT=1225.1	? (TO) TT=1800.08	UNSAT TT=275.589	? TT=152.686	? TT=149.697	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-B2C1S1.opb	UNSAT TT=275.909	UNSAT TT=943.417	UNSAT TT=973.663	? (TO) TT=1800.1	UNSAT TT=275.909	? TT=152.153	? TT=150.262	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-berlin_5_8_0.opb	OPT f=2 TT=87.959 T1=87.94	OPT f=2 TT=87.959 T1=87.94	OPT f=2 TT=197.613 T1=197.63	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=93.973	? TT=96.533	SAT (TO) f=40 TT=1800.27 T1=810.53	? (TO) TT=1800	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-bg512142.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=136.692	? TT=141.355	? (TO) TT=1801.05	? (TO) TT=1800.61	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-biella1.opb	UNSAT TT=0.456	UNSAT TT=0.545	UNSAT TT=0.456	? (TO) TT=1800.08	UNSAT TT=1676.99	? TT=117.297	? TT=116.68	UNSAT TT=212.822	? (TO) TT=1801.1	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ar98.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.34	? TT=142.493	? TT=146.345	? (TO) TT=1800.11	? (TO) TT=1800.57	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic97.opb	SAT f=264293 TT=1800.06 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=264293 TT=1800.06 T1=1800.3	? (TO) TT=1800.14	? TT=190.767	? TT=190.103	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ic98.opb		? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.26	? TT=160.666	? TT=158.889	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-blp-ir98.opb	SAT f=264086 TT=1800.14 T1=291.92	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=141.356	? TT=138.579	SAT (TO) f=264086 TT=1800.14 T1=291.92	? (TO) TT=1800.06	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-CMS750_4.opb		? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.29	? (TO) TT=1800.01	? (MO) TT=95.244	? (MO) TT=96.023	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2536-691.opb	SAT f=534 TT=1800.08 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT (TO) f=5863 TT=1800.08 T1=1800.4	SAT (TO) f=635 TT=1800.06 T1=1800.4	SAT (TO) f=651 TT=1800.1 T1=1800.4	SAT (TO) f=534 TT=1800.08 T1=1800.4	SAT (TO) f=581 TT=1800.63 T1=161.2	SAT (TO) f=584 TT=1800.01 T1=1.53	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core2586-950.opb	SAT f=786 TT=1800.09 T1=1800.4	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=3923 TT=1800.06 T1=1800.4	SAT (TO) f=947 TT=1800.12 T1=1800.5	SAT (TO) f=910 TT=1800.01 T1=1800.3	SAT (TO) f=786 TT=1800.09 T1=1800.4	SAT (TO) f=790 TT=1800.6 T1=112.06	SAT (TO) f=792 TT=1800.06 T1=0.59	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4284-1064.opb	SAT f=899 TT=1800.1 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT (TO) f=6152 TT=1800.1 T1=1800.4	SAT (TO) f=1082 TT=1800.07 T1=1800.4	SAT (TO) f=1043 TT=1800.1 T1=1800.4	SAT (TO) f=899 TT=1800.1 T1=1800.4	SAT (TO) f=908 TT=1800.72 T1=123.65	SAT (TO) f=909 TT=1800.72 T1=1.18	? (TO) TT=1800.22
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-core4872-1529.opb	SAT f=1320 TT=1800.43 T1=602.56	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=8401 TT=1800.09 T1=1800.4	SAT (TO) f=1541 TT=1800.11 T1=1800.4	SAT (TO) f=1506 TT=1800.12 T1=1800.4	SAT (TO) f=1506 TT=1800.08 T1=1800.4	SAT (TO) f=1320 TT=1800.43 T1=602.56	SAT (TO) f=1323 TT=1800.1 T1=1.52	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1c.opb		? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=137.975	? TT=137.613	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dc1l.opb	SAT f=26800 TT=1800.96 T1=284.8	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.4	? TT=115.655	? TT=116.54	SAT (TO) f=26800 TT=1800.96 T1=284.8	? (TO) TT=1800.02	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dg012142.opb		? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=139.496	? TT=131.08	? (TO) TT=1800.8	? (TO) TT=1800.07	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-dolom1.opb	UNSAT TT=0.374	UNSAT TT=0.533	UNSAT TT=0.374	UNSAT TT=645.074	UNSAT TT=517.258	? TT=123.7	? TT=124.407	UNSAT TT=5.483	UNSAT TT=45.766	UNSAT TT=158.727
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-glass4.opb	SAT f=1100 TT=1800.05 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=8246 TT=1800.06 T1=1800.4	SAT (TO) f=1100 TT=1800.05 T1=1800.4	? TT=141.887	? TT=139.038	SAT (TO) f=1365 TT=1800.77 T1=579.45	SAT (TO) f=1289 TT=1800.02 T1=494.81	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-NSR8K.opb	UNSAT TT=1.185	UNSAT TT=1.529	UNSAT TT=1.185	? (TO) TT=1800.03	Signal TT=740.926	? (MO) TT=135.913	? (MO) TT=137.629	UNSAT TT=12.212	UNSAT TT=31.297	UNSAT TT=134.964
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-nsrand_ipx.opb	SAT f=393877 TT=1800.56 T1=878.37	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=499109 TT=1800.09 T1=1800.4	SAT (TO) f=505240 TT=1800.06 T1=1800.5	? TT=81.066	? TT=82.105	SAT (TO) f=393877 TT=1800.56 T1=878.37	No Cert. TT=1801.15	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-rail507.opb	SAT f=167 TT=1800.75 T1=212.7	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	Signal TT=3.426	SAT (TO) f=200 TT=1800.11 T1=1800.4	SAT (TO) f=200 TT=1800.14 T1=1800.4	SAT (TO) f=167 TT=1800.75 T1=212.7	No Cert. TT=1800	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-railway_8_1_0.opb	OPT f=147 TT=33.618 T1=33.59	OPT f=147 TT=33.618 T1=33.59	OPT f=147 TT=48.591 T1=48.59	? (TO) TT=1800.04	? (TO) TT=1800.11	? TT=93.897	? TT=96.352	? (TO) TT=1800.92	? (TO) TT=1800.06	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-roll3000.opb	SAT f=261403 TT=1800.01 T1=210.38	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=80.227	? TT=78.308	SAT (TO) f=262172 TT=1800.16 T1=219.74	SAT (TO) f=261403 TT=1800.01 T1=210.38	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-siena1.opb	UNSAT TT=0.411	UNSAT TT=0.612	UNSAT TT=0.411	UNSAT TT=709.349	UNSAT TT=985.152	? TT=115.946	? TT=115.878	UNSAT TT=5.584	UNSAT TT=20.641	UNSAT TT=97.141
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ar.opb	SAT f=1588 TT=1800.15 T1=2.13	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=17543 TT=1800.14 T1=1800.5	SAT (TO) f=3600 TT=1800.14 T1=1800.3	? TT=67.416	? TT=67.633	SAT (TO) f=1588 TT=1800.15 T1=2.13	SAT (TO) f=1602 TT=1800.07 T1=1.37	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp97ic.opb	SAT f=639 TT=1800.12 T1=1.99	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=15473 TT=1800.08 T1=1800.5	SAT (TO) f=1017 TT=1800.1 T1=1800.4	? TT=69.894	? TT=70.475	SAT (TO) f=639 TT=1800.12 T1=1.99	SAT (TO) f=640 TT=1800.92 T1=1.28	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ar.opb	SAT f=1144 TT=1800.01 T1=2.11	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=14268 TT=1800.05 T1=1800.4	SAT (TO) f=1810 TT=1800.17 T1=1800.4	? TT=69.509	? TT=69.654	SAT (TO) f=1144 TT=1800.01 T1=2.11	SAT (TO) f=1147 TT=1800.01 T1=1.69	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-sp98ic.opb	SAT f=712 TT=1800.45 T1=588.98	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT (TO) f=14674 TT=1800.13 T1=1800.5	SAT (TO) f=1071 TT=1800.16 T1=1800.4	? TT=72.698	? TT=72.512	SAT (TO) f=712 TT=1800.45 T1=588.98	SAT (TO) f=715 TT=1800.05 T1=793.36	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-tr12-30.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=124.584	? TT=125.444	? (TO) TT=1800.9	? (TO) TT=1800.58	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-trento1.opb	UNSAT TT=0.753	UNSAT TT=0.848	UNSAT TT=0.753	? (TO) TT=1800.09	? (TO) TT=1800.13	? (MO) TT=78.59	? TT=127.549	UNSAT TT=409.141	? (TO) TT=1800.47	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-UMTS.opb		? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=128.598	? TT=127.109	? (TO) TT=1802.09	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-usAbbrv.8.25_70.opb	OPT f=-5 TT=179.208 T1=179.22	OPT f=-5 TT=192.087 T1=192.08	OPT f=-5 TT=179.208 T1=179.22	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=93.906	? TT=99.028	? (TO) TT=1800.77	? (TO) TT=1800.65	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/ mps-v2-20-10/plato.asu.edu/pub/unibo/ normalized-reduced-mps-v2-20-10-van.opb	SAT f=39649 TT=1800.24 T1=847.98	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=133.147	? TT=127.957	SAT (TO) f=39649 TT=1800.24 T1=847.98	SAT (TO) f=41696 TT=1800.08 T1=52.53	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-maros.opb	OPT f=12 TT=0.014 T1=0.01	OPT f=12 TT=0.022 T1=0.02	OPT f=12 TT=0.014 T1=0.01	OPT f=12 TT=29.509 T1=29.51	OPT f=12 TT=1.272 T1=1.27	OPT f=12 TT=46.27 T1=46.26	OPT f=12 TT=53.905 T1=53.89	OPT f=12 TT=0.324 T1=1.64	SAT (TO) f=14 TT=1800.69 T1=0.14	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-nazareth.opb	OPT f=-174776 TT=0.012 T1=0.01	OPT f=-174776 TT=0.023 T1=0.02	OPT f=-174776 TT=0.012 T1=0.01	OPT f=-174776 TT=0.822 T1=0.82	OPT f=-174776 TT=5.01 T1=5.01	OPT f=-174776 TT=9.487 T1=9.44	OPT f=-174776 TT=13.203 T1=13.13	OPT f=-174776 TT=0.174 T1=0.63	OPT f=-174776 TT=0.165 T1=0.12	OPT f=-174776 TT=0.085 T1=0.08
normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ www.csit.fsu.edu/~burkardt/datasets/mps/ normalized-reduced-mps-v2-20-10-testprob.opb	OPT f=262130 TT=0.014 T1=0.01	OPT f=262130 TT=0.025 T1=0.02	OPT f=262130 TT=0.014 T1=0.01	OPT f=262130 TT=0.122 T1=0.12	OPT f=262130 TT=4.3 T1=4.3	OPT f=262130 TT=22.833 T1=22.79	OPT f=262130 TT=37.33 T1=37.28	OPT f=262130 TT=0.184 T1=0.63	OPT f=262130 TT=0.514 T1=0.12	OPT f=262130 TT=3.391 T1=3.29
normalized-PB06/OPT-SMALLINT/reduced/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-reduced-ws97-3.opb	SAT f=809 TT=1800.1 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=4658 TT=1800.09 T1=1800.4	SAT (TO) f=809 TT=1800.1 T1=1800.4	SAT (TO) f=903 TT=1800.01 T1=1800.3	SAT (TO) f=8058 TT=1800.08 T1=1800.4	SAT (TO) f=837 TT=1800.06 T1=641.35	SAT (TO) f=854 TT=1800.02 T1=0.43	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-1.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.017 T1=0.02	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.264 T1=0.66	OPT f=100 TT=0.222 T1=0.17	OPT f=100 TT=0.066 T1=0.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-2.opb	OPT f=100 TT=0.002 T1=0	OPT f=100 TT=0.023 T1=0.02	OPT f=100 TT=0.014 T1=0.01	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.01 T1=0.01	OPT f=100 TT=0.002 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.284 T1=0.66	OPT f=100 TT=0.225 T1=0.17	OPT f=100 TT=0.026 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-3.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.025 T1=0.02	OPT f=100 TT=0.014 T1=0.01	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.018 T1=0.01	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.345 T1=0.66	OPT f=100 TT=0.273 T1=0.19	OPT f=100 TT=0.037 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-1_6-yes1-4.opb	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.274 T1=0.66	OPT f=100 TT=0.224 T1=0.16	OPT f=100 TT=0.024 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-1.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.024 T1=0.02	OPT f=100 TT=0.014 T1=0.02	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.012 T1=0.01	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.372 T1=0.67	OPT f=100 TT=0.274 T1=0.19	OPT f=100 TT=0.039 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-2.opb	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.026 T1=0.02	OPT f=100 TT=0.016 T1=0.02	OPT f=100 TT=0.014 T1=0.01	OPT f=100 TT=0.013 T1=0.01	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.344 T1=0.67	OPT f=100 TT=0.285 T1=0.19	OPT f=100 TT=0.03 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-3.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.026 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.023 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.424 T1=0.67	OPT f=100 TT=0.263 T1=0.17	OPT f=100 TT=0.023 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-2_0-yes1-4.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.026 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.025 T1=0.02	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.434 T1=0.67	OPT f=100 TT=0.263 T1=0.17	OPT f=100 TT=0.028 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-1.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.008 T1=0	OPT f=100 TT=0.043 T1=0.04	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.693 T1=0.69	OPT f=100 TT=0.463 T1=0.22	OPT f=100 TT=0.046 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-2.opb	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.017 T1=0.01	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.025 T1=0.02	OPT f=100 TT=0.003 T1=0	OPT f=100 TT=0.006 T1=0.01	OPT f=100 TT=0.594 T1=0.68	OPT f=100 TT=0.393 T1=0.23	OPT f=100 TT=0.099 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-3.opb	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.029 T1=0.03	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.04 T1=0.03	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.583 T1=0.68	OPT f=100 TT=0.394 T1=0.2	OPT f=100 TT=0.088 T1=0.03
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-3_4-yes1-4.opb	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.016 T1=0.01	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.022 T1=0.02	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.584 T1=0.68	OPT f=100 TT=0.315 T1=0.2	OPT f=100 TT=0.053 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-1.opb	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.03 T1=0.02	OPT f=100 TT=0.016 T1=0.01	OPT f=100 TT=0.03 T1=0.03	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.394 T1=0.71	OPT f=100 TT=0.334 T1=0.21	OPT f=100 TT=0.054 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-2.opb	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.027 T1=0.02	OPT f=100 TT=0.015 T1=0.01	OPT f=100 TT=0.03 T1=0.02	OPT f=100 TT=0.01 T1=0.01	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.435 T1=0.71	OPT f=100 TT=0.324 T1=0.2	OPT f=100 TT=0.077 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-3.opb	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.032 T1=0.03	OPT f=100 TT=0.017 T1=0.01	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.043 T1=0.04	OPT f=100 TT=0.005 T1=0	OPT f=100 TT=0.007 T1=0	OPT f=100 TT=0.354 T1=0.71	OPT f=100 TT=0.344 T1=0.21	OPT f=100 TT=0.079 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-100-6_0-yes1-4.opb	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.029 T1=0.03	OPT f=100 TT=0.016 T1=0.01	OPT f=100 TT=0.029 T1=0.02	OPT f=100 TT=0.041 T1=0.04	OPT f=100 TT=0.004 T1=0	OPT f=100 TT=0.006 T1=0	OPT f=100 TT=0.343 T1=0.71	OPT f=100 TT=0.294 T1=0.19	OPT f=100 TT=0.137 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-1.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.026 T1=0.02	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.008 T1=0	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.494 T1=0.69	OPT f=200 TT=0.354 T1=0.21	OPT f=200 TT=0.047 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-2.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.028 T1=0.02	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.047 T1=0.04	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.011 T1=0.01	OPT f=200 TT=0.493 T1=0.7	OPT f=200 TT=0.363 T1=0.23	OPT f=200 TT=0.039 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-3.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.031 T1=0.03	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.009 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.515 T1=0.7	OPT f=200 TT=0.383 T1=0.22	OPT f=200 TT=0.063 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-1_6-yes1-4.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.028 T1=0.02	OPT f=200 TT=0.016 T1=0.01	OPT f=200 TT=0.047 T1=0.04	OPT f=200 TT=0.011 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.484 T1=0.71	OPT f=200 TT=0.335 T1=0.21	OPT f=200 TT=0.036 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-1.opb	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.034 T1=0.03	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.053 T1=0.05	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.613 T1=0.7	OPT f=200 TT=0.435 T1=0.25	OPT f=200 TT=0.056 T1=0.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-2.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.028 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.053 T1=0.05	OPT f=200 TT=0.077 T1=0.08	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.784 T1=0.7	OPT f=200 TT=0.594 T1=0.32	OPT f=200 TT=0.138 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-3.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.034 T1=0.03	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.016 T1=0.01	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.535 T1=0.71	OPT f=200 TT=0.385 T1=0.22	OPT f=200 TT=0.061 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-2_0-yes1-4.opb	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.03 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.056 T1=0.05	OPT f=200 TT=0.049 T1=0.04	OPT f=200 TT=0.006 T1=0	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.585 T1=0.73	OPT f=200 TT=0.474 T1=0.25	OPT f=200 TT=0.063 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-1.opb	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.035 T1=0.04	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.063 T1=0.06	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.014 T1=0.01	OPT f=200 TT=0.675 T1=0.72	OPT f=200 TT=0.435 T1=0.25	OPT f=200 TT=0.052 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-2.opb	OPT f=200 TT=0.008 T1=0	OPT f=200 TT=0.03 T1=0.03	OPT f=200 TT=0.02 T1=0.01	OPT f=200 TT=0.062 T1=0.06	OPT f=200 TT=0.093 T1=0.09	OPT f=200 TT=0.008 T1=0	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=0.694 T1=0.72	OPT f=200 TT=0.495 T1=0.27	OPT f=200 TT=0.073 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-3.opb	OPT f=200 TT=0.007 T1=0.01	OPT f=200 TT=0.035 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.056 T1=0.05	OPT f=200 TT=0.054 T1=0.05	OPT f=200 TT=0.007 T1=0.01	OPT f=200 TT=0.013 T1=0.01	OPT f=200 TT=0.545 T1=0.73	OPT f=200 TT=0.614 T1=0.31	OPT f=200 TT=0.101 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-3_4-yes1-4.opb	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.033 T1=0.03	OPT f=200 TT=0.018 T1=0.01	OPT f=200 TT=0.074 T1=0.07	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.007 T1=0	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.534 T1=0.73	OPT f=200 TT=0.384 T1=0.23	OPT f=200 TT=0.081 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-1.opb	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.051 T1=0.05	OPT f=200 TT=0.032 T1=0.03	OPT f=200 TT=0.079 T1=0.07	OPT f=200 TT=0.062 T1=0.06	OPT f=200 TT=0.009 T1=0	OPT f=200 TT=0.015 T1=0.01	OPT f=200 TT=0.984 T1=0.76	OPT f=200 TT=0.573 T1=0.3	OPT f=200 TT=0.071 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-2.opb	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.024 T1=0.02	OPT f=200 TT=0.074 T1=0.07	OPT f=200 TT=0.022 T1=0.02	OPT f=200 TT=0.012 T1=0.01	OPT f=200 TT=0.019 T1=0.01	OPT f=200 TT=1.023 T1=0.77	OPT f=200 TT=0.715 T1=0.32	OPT f=200 TT=0.129 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-3.opb	OPT f=200 TT=0.013 T1=0.01	OPT f=200 TT=0.042 T1=0.04	OPT f=200 TT=0.025 T1=0.02	OPT f=200 TT=0.073 T1=0.07	OPT f=200 TT=0.07 T1=0.07	OPT f=200 TT=0.013 T1=0.01	OPT f=200 TT=0.017 T1=0.01	OPT f=200 TT=1.004 T1=0.76	OPT f=200 TT=0.646 T1=0.33	OPT f=200 TT=0.146 T1=0.07
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-200-6_0-yes1-4.opb	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.043 T1=0.04	OPT f=200 TT=0.031 T1=0.03	OPT f=200 TT=0.024 T1=0.02	OPT f=200 TT=0.022 T1=0.02	OPT f=200 TT=0.01 T1=0.01	OPT f=200 TT=0.015 T1=0.02	OPT f=200 TT=0.935 T1=0.76	OPT f=200 TT=0.653 T1=0.34	OPT f=200 TT=0.129 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-1.opb	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.185 T1=0.64	OPT f=50 TT=0.184 T1=0.14	OPT f=50 TT=0.021 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-2.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.01 T1=0	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.193 T1=0.64	OPT f=50 TT=0.183 T1=0.13	OPT f=50 TT=0.022 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-3.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.194 T1=0.64	OPT f=50 TT=0.184 T1=0.14	OPT f=50 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-1_6-yes1-4.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.027 T1=0.02	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.184 T1=0.64	OPT f=50 TT=0.183 T1=0.14	OPT f=50 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-1.opb	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.233 T1=0.64	OPT f=50 TT=0.193 T1=0.16	OPT f=50 TT=0.025 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-2.opb	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.01 T1=0	OPT f=50 TT=0.011 T1=0.01	OPT f=50 TT=0.001 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.233 T1=0.65	OPT f=50 TT=0.215 T1=0.16	OPT f=50 TT=0.024 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-3.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.244 T1=0.64	OPT f=50 TT=0.205 T1=0.15	OPT f=50 TT=0.023 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-2_0-yes1-4.opb	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.022 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.005 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.004 T1=0	OPT f=50 TT=0.204 T1=0.64	OPT f=50 TT=0.183 T1=0.14	OPT f=50 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-1.opb	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.025 T1=0.02	OPT f=50 TT=0.015 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.01 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.314 T1=0.66	OPT f=50 TT=0.223 T1=0.15	OPT f=50 TT=0.028 T1=0.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-2.opb	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.025 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.015 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.284 T1=0.66	OPT f=50 TT=0.203 T1=0.16	OPT f=50 TT=0.04 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-3.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.011 T1=0.01	OPT f=50 TT=0.004 T1=0	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.286 T1=0.68	OPT f=50 TT=0.224 T1=0.15	OPT f=50 TT=0.049 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-3_4-yes1-4.opb	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.023 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.011 T1=0.01	OPT f=50 TT=0.015 T1=0.02	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.283 T1=0.66	OPT f=50 TT=0.225 T1=0.16	OPT f=50 TT=0.058 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-1.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.244 T1=0.67	OPT f=50 TT=0.244 T1=0.17	OPT f=50 TT=0.063 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-2.opb	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.014 T1=0.01	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.02 T1=0.02	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.233 T1=0.68	OPT f=50 TT=0.233 T1=0.16	OPT f=50 TT=0.027 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-3.opb	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.024 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.017 T1=0.01	OPT f=50 TT=0.002 T1=0	OPT f=50 TT=0.003 T1=0.01	OPT f=50 TT=0.234 T1=0.67	OPT f=50 TT=0.223 T1=0.17	OPT f=50 TT=0.03 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-aim-50-6_0-yes1-4.opb	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.025 T1=0.02	OPT f=50 TT=0.013 T1=0.01	OPT f=50 TT=0.012 T1=0.01	OPT f=50 TT=0.017 T1=0.01	OPT f=50 TT=0.003 T1=0	OPT f=50 TT=0.004 T1=0	OPT f=50 TT=0.243 T1=0.72	OPT f=50 TT=0.233 T1=0.17	OPT f=50 TT=0.045 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf0432-007.opb	UNSAT TT=0.03	UNSAT TT=0.085	UNSAT TT=0.062	UNSAT TT=0.071	UNSAT TT=0.067	UNSAT TT=0.03	UNSAT TT=0.03	UNSAT TT=1.384	UNSAT TT=0.905	UNSAT TT=0.293
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf1355-075.opb	UNSAT TT=0.039	UNSAT TT=0.082	UNSAT TT=0.048	UNSAT TT=0.115	UNSAT TT=0.113	UNSAT TT=0.041	UNSAT TT=0.039	UNSAT TT=2.773	UNSAT TT=0.913	UNSAT TT=0.271
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf1355-638.opb	UNSAT TT=0.04	UNSAT TT=0.081	UNSAT TT=0.047	UNSAT TT=0.115	UNSAT TT=0.112	UNSAT TT=0.04	UNSAT TT=0.041	UNSAT TT=2.523	UNSAT TT=0.823	UNSAT TT=0.288
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-bf2670-001.opb	UNSAT TT=0.021	UNSAT TT=0.059	UNSAT TT=0.031	UNSAT TT=0.06	UNSAT TT=0.059	UNSAT TT=0.021	UNSAT TT=0.021	UNSAT TT=1.204	UNSAT TT=0.664	UNSAT TT=0.127
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-f1000.opb		? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.49	? (TO) TT=1800.71	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-f2000.opb		? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.5	? (TO) TT=1800.55	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-f600.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.16	? (TO) TT=1800.82	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g125.17.opb		? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.25	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g125.18.opb		? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.8	? (TO) TT=1800.09	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g250.15.opb	SAT f=3750 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT (TO) f=3750 TT=1800.05 T1=1800.4	SAT (TO) f=3750 TT=1800.02 T1=1800.3	SAT (TO) f=3750 TT=1800.06 T1=1800.4	? (TO) TT=1800.67	No Cert. TT=1800.01	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-g250.29.opb		? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.8	? (TO) TT=1800.65	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-hanoi4.opb	OPT f=718 TT=0.122 T1=0.12	OPT f=718 TT=0.246 T1=0.24	OPT f=718 TT=0.122 T1=0.12	OPT f=718 TT=0.397 T1=0.39	OPT f=718 TT=0.586 T1=0.57	OPT f=718 TT=2.029 T1=2.02	OPT f=718 TT=0.215 T1=0.21	OPT f=718 TT=4.153 T1=1.39	OPT f=718 TT=1.834 T1=0.43	OPT f=718 TT=9.478 T1=1.19
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-hanoi5.opb	OPT f=1931 TT=0.915 T1=0.91	OPT f=1931 TT=2.188 T1=2.18	OPT f=1931 TT=1.815 T1=1.81	OPT f=1931 TT=2.353 T1=2.35	OPT f=1931 TT=3.038 T1=3.01	OPT f=1931 TT=1.081 T1=1.08	OPT f=1931 TT=0.915 T1=0.91	OPT f=1931 TT=9.403 T1=3.53	OPT f=1931 TT=5.862 T1=4.17	OPT f=1931 TT=226.482 T1=97.24
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16a1.opb	SAT f=1123 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=1430 TT=1800.02 T1=1800.3	SAT (TO) f=1485 TT=1800.09 T1=1800.4	SAT (TO) f=1551 TT=1800.01 T1=1800.3	SAT (TO) f=1123 TT=1800.02 T1=1800.3	SAT (TO) f=1385 TT=1800.13 T1=234.25	SAT (TO) f=1527 TT=1800.08 T1=0.63	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16a2.opb	SAT f=1164 TT=1800.03 T1=1800.3	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT (TO) f=1259 TT=1800.11 T1=1800.4	SAT (TO) f=1588 TT=1800.02 T1=1800.3	SAT (TO) f=1601 TT=1800.02 T1=1800.3	SAT (TO) f=1164 TT=1800.03 T1=1800.3	SAT (TO) f=1398 TT=1800.17 T1=892.56	SAT (TO) f=1548 TT=1800.05 T1=116.1	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16b1.opb	SAT f=1379 TT=1800.09 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT (TO) f=1541 TT=1800.02 T1=1800.3	SAT (TO) f=1727 TT=1800.01 T1=1800.3	SAT (TO) f=1727 TT=1800.02 T1=1800.3	SAT (TO) f=1379 TT=1800.09 T1=1800.4	SAT (TO) f=1596 TT=1800.1 T1=750.74	SAT (TO) f=1661 TT=1800.07 T1=167.63	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16b2.opb	OPT f=1031 TT=1.64 T1=1.57	OPT f=1031 TT=6.457 T1=6.45	OPT f=1031 TT=23.93 T1=23.93	SAT (TO) f=1031 TT=1800.11 T1=1800.4	OPT f=1031 TT=3.921 T1=3.9	OPT f=1031 TT=102.08 T1=102.09	OPT f=1031 TT=1.64 T1=1.64	OPT f=1031 TT=26.732 T1=1.57	SAT (TO) f=1033 TT=1800.02 T1=0.68	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16c1.opb	SAT f=1226 TT=1800.02 T1=1800.3	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT (TO) f=1412 TT=1800.01 T1=1800.3	SAT (TO) f=1478 TT=1800.01 T1=1800.3	SAT (TO) f=1568 TT=1800.11 T1=1800.4	SAT (TO) f=1226 TT=1800.02 T1=1800.3	SAT (TO) f=1335 TT=1800 T1=1.58	SAT (TO) f=1424 TT=1800.71 T1=0.55	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16c2.opb	OPT f=861 TT=1.379 T1=1.38	OPT f=861 TT=3.81 T1=3.8	OPT f=861 TT=46.271 T1=46.27	OPT f=861 TT=1.391 T1=1.38	OPT f=861 TT=2.911 T1=2.89	OPT f=861 TT=35.535 T1=35.53	OPT f=861 TT=1.379 T1=1.38	OPT f=861 TT=14.282 T1=3.53	SAT (TO) f=867 TT=1800.01 T1=0.84	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16d1.opb	SAT f=890 TT=1800.03 T1=1800.3	? (TO) TT=1800.04	? (TO) TT=1800.11	SAT (TO) f=1084 TT=1800.1 T1=1800.4	SAT (TO) f=1230 TT=1800.01 T1=1800.3	SAT (TO) f=1229 TT=1800.02 T1=1800.3	SAT (TO) f=890 TT=1800.03 T1=1800.3	SAT (TO) f=1090 TT=1800.02 T1=2.57	SAT (TO) f=1097 TT=1800.05 T1=0.65	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16d2.opb	OPT f=785 TT=1.075 T1=1.07	OPT f=785 TT=4.705 T1=4.7	OPT f=785 TT=24.544 T1=24.54	OPT f=785 TT=2.238 T1=2.23	OPT f=785 TT=2.852 T1=2.84	OPT f=785 TT=625.999 T1=626.09	OPT f=785 TT=1.075 T1=1.07	OPT f=785 TT=64.654 T1=9.54	SAT (TO) f=802 TT=1800.04 T1=424.88	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16e1.opb	SAT f=1102 TT=1800.02 T1=1800.3	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT (TO) f=1135 TT=1800.02 T1=1800.3	SAT (TO) f=1244 TT=1800.09 T1=1800.4	SAT (TO) f=1234 TT=1800.03 T1=1800.3	SAT (TO) f=1102 TT=1800.02 T1=1800.3	SAT (TO) f=1162 TT=1800.19 T1=864.6	SAT (TO) f=1201 TT=1800.05 T1=20.75	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii16e2.opb	OPT f=520 TT=0.34 T1=0.34	OPT f=520 TT=1.622 T1=1.62	OPT f=520 TT=0.899 T1=0.89	OPT f=520 TT=0.715 T1=0.71	OPT f=520 TT=1.94 T1=1.92	OPT f=520 TT=10.251 T1=10.25	OPT f=520 TT=0.34 T1=0.34	OPT f=520 TT=6.074 T1=2.44	OPT f=520 TT=7.312 T1=0.49	OPT f=520 TT=5.493 T1=5.45
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32a1.opb	OPT f=444 TT=0.323 T1=0.32	OPT f=444 TT=1.542 T1=1.53	OPT f=444 TT=1.7 T1=1.69	OPT f=444 TT=1.172 T1=1.16	OPT f=444 TT=1.163 T1=1.15	OPT f=444 TT=9.917 T1=9.91	OPT f=444 TT=0.323 T1=0.32	OPT f=444 TT=6.392 T1=1.43	OPT f=444 TT=8.023 T1=0.42	OPT f=444 TT=4.13 T1=3.99
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b1.opb	OPT f=191 TT=6.206 T1=6.2	? (TO) TT=1800.01	? (TO) TT=1800.02	OPT f=191 TT=7.765 T1=7.76	OPT f=191 TT=6.206 T1=6.2	OPT f=191 TT=35.059 T1=35.06	OPT f=191 TT=6.385 T1=6.38	SAT (TO) f=191 TT=1800.75 T1=16.34	SAT (TO) f=196 TT=1800.02 T1=0.68	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b2.opb	OPT f=244 TT=1.146 T1=0.67	OPT f=244 TT=21.674 T1=21.67	OPT f=244 TT=4.608 T1=4.6	OPT f=244 TT=1.884 T1=1.88	OPT f=244 TT=2.768 T1=2.76	OPT f=244 TT=4.55 T1=4.55	OPT f=244 TT=1.146 T1=1.14	OPT f=244 TT=4.783 T1=8.35	OPT f=244 TT=2.525 T1=0.67	OPT f=244 TT=8.418 T1=3.13
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b3.opb	OPT f=331 TT=2.776 T1=1.56	OPT f=331 TT=48.399 T1=48.4	OPT f=331 TT=19.26 T1=19.26	OPT f=331 TT=6.548 T1=6.54	OPT f=331 TT=10.614 T1=10.6	OPT f=331 TT=10.632 T1=10.63	OPT f=331 TT=2.776 T1=2.78	OPT f=331 TT=19.08 T1=6.91	OPT f=331 TT=8.483 T1=1.56	OPT f=331 TT=25.839 T1=19.9
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32b4.opb	OPT f=376 TT=0.299 T1=0.3	OPT f=376 TT=10.07 T1=10.06	OPT f=376 TT=1.451 T1=1.44	OPT f=376 TT=1.276 T1=1.27	OPT f=376 TT=1.395 T1=1.39	OPT f=376 TT=2.662 T1=2.66	OPT f=376 TT=0.299 T1=0.3	OPT f=376 TT=3.363 T1=1.41	OPT f=376 TT=1.525 T1=0.4	OPT f=376 TT=4.82 T1=4.76
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c1.opb	OPT f=167 TT=2.738 T1=2.73	? (TO) TT=1800.01	OPT f=167 TT=1580.02 T1=1580.26	OPT f=167 TT=3.679 T1=3.67	OPT f=167 TT=3.656 T1=3.65	OPT f=167 TT=2.738 T1=2.73	OPT f=167 TT=3.395 T1=3.39	SAT (TO) f=168 TT=1800.1 T1=671.85	SAT (TO) f=188 TT=1800.85 T1=3.95	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c2.opb	OPT f=207 TT=30.023 T1=30.02	? (TO) TT=1800.02	? (TO) TT=1800.01	OPT f=207 TT=95.483 T1=95.51	OPT f=207 TT=38.96 T1=38.96	OPT f=207 TT=56.749 T1=56.75	OPT f=207 TT=30.023 T1=30.02	SAT (TO) f=207 TT=1800.07 T1=251.28	SAT (TO) f=215 TT=1800.05 T1=8.77	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c3.opb	OPT f=261 TT=15.686 T1=8.25	OPT f=261 TT=449.796 T1=449.85	OPT f=261 TT=141.498 T1=141.51	OPT f=261 TT=20.825 T1=20.82	OPT f=261 TT=38.439 T1=38.43	OPT f=261 TT=57.62 T1=57.62	OPT f=261 TT=15.686 T1=15.69	OPT f=261 TT=46.555 T1=14.38	OPT f=261 TT=22.29 T1=8.25	OPT f=261 TT=476.361 T1=476.37
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32c4.opb	OPT f=736 TT=0.648 T1=0.57	OPT f=736 TT=10.829 T1=10.82	OPT f=736 TT=9.371 T1=9.37	OPT f=736 TT=2.364 T1=2.35	OPT f=736 TT=3.624 T1=3.6	OPT f=736 TT=16.806 T1=16.8	OPT f=736 TT=0.648 T1=0.64	OPT f=736 TT=8.572 T1=1.61	SAT (TO) f=736 TT=1800.01 T1=0.57	OPT f=736 TT=14.175 T1=10.19
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32d1.opb	SAT f=285 TT=1800.02 T1=1800.3	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=285 TT=1800.02 T1=1800.3	SAT (TO) f=290 TT=1800.02 T1=1800.3	SAT (TO) f=328 TT=1800.03 T1=1800.3	SAT (TO) f=285 TT=1800.02 T1=1800.3	SAT (TO) f=287 TT=1800.9 T1=490.77	SAT (TO) f=294 TT=1800.01 T1=14.01	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32d2.opb	OPT f=372 TT=526.275 T1=5.99	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT (TO) f=372 TT=1800.02 T1=1800.3	SAT (TO) f=372 TT=1800.02 T1=1800.3	SAT (TO) f=404 TT=1800.02 T1=1800.3	OPT f=372 TT=526.275 T1=526.36	SAT (TO) f=372 TT=1800.17 T1=15.93	SAT (TO) f=372 TT=1800.1 T1=5.99	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32d3.opb	OPT f=802 TT=5.541 T1=5.54	OPT f=802 TT=1216.7 T1=1216.9	OPT f=802 TT=238.053 T1=238.09	OPT f=802 TT=46.307 T1=46.32	OPT f=802 TT=13.775 T1=13.76	SAT (TO) f=824 TT=1800.02 T1=1800.3	OPT f=802 TT=5.541 T1=5.54	SAT (TO) f=802 TT=1800.07 T1=20.1	SAT (TO) f=802 TT=1800.04 T1=6.07	OPT f=802 TT=273.675 T1=263.93
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e1.opb	OPT f=162 TT=4.96 T1=4.95	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=162 TT=4.96 T1=4.95	OPT f=162 TT=5.332 T1=5.33	OPT f=162 TT=7.235 T1=7.23	OPT f=162 TT=8.749 T1=8.75	SAT (TO) f=165 TT=1800.12 T1=318.51	SAT (TO) f=163 TT=1800.8 T1=1217.17	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e2.opb	OPT f=235 TT=34.744 T1=2.89	? (TO) TT=1800.02	OPT f=235 TT=601.618 T1=601.72	OPT f=235 TT=58.447 T1=58.46	OPT f=235 TT=65.295 T1=65.3	OPT f=235 TT=63.851 T1=63.85	OPT f=235 TT=34.744 T1=34.74	SAT (TO) f=235 TT=1800.85 T1=5.39	SAT (TO) f=235 TT=1800.02 T1=2.89	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e3.opb	OPT f=310 TT=2.53 T1=2.53	OPT f=310 TT=28.368 T1=28.37	OPT f=310 TT=16.813 T1=16.82	OPT f=310 TT=4.878 T1=4.87	OPT f=310 TT=9.85 T1=9.84	OPT f=310 TT=9.502 T1=9.5	OPT f=310 TT=2.53 T1=2.53	OPT f=310 TT=119.566 T1=11.91	OPT f=310 TT=37.887 T1=6.53	OPT f=310 TT=348.231 T1=85.74
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e4.opb	OPT f=364 TT=4.289 T1=4.29	OPT f=364 TT=166.04 T1=166.05	OPT f=364 TT=25.88 T1=25.88	OPT f=364 TT=8.414 T1=8.41	OPT f=364 TT=19.609 T1=19.6	OPT f=364 TT=12.063 T1=12.06	OPT f=364 TT=4.289 T1=4.29	OPT f=364 TT=1300.73 T1=21.95	OPT f=364 TT=461.19 T1=61.03	OPT f=364 TT=652.962 T1=30.59
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii32e5.opb	OPT f=503 TT=11.776 T1=4.89	OPT f=503 TT=839.979 T1=840.11	OPT f=503 TT=165.926 T1=165.94	OPT f=503 TT=16.159 T1=16.15	OPT f=503 TT=31.719 T1=31.72	OPT f=503 TT=56.661 T1=56.66	OPT f=503 TT=11.776 T1=11.77	OPT f=503 TT=82.043 T1=14.09	OPT f=503 TT=29.279 T1=4.89	OPT f=503 TT=143.25 T1=5.29
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a1.opb	OPT f=54 TT=0.053 T1=0.05	OPT f=54 TT=0.097 T1=0.09	OPT f=54 TT=0.061 T1=0.06	OPT f=54 TT=0.086 T1=0.08	OPT f=54 TT=0.144 T1=0.14	OPT f=54 TT=0.053 T1=0.05	OPT f=54 TT=0.125 T1=0.12	OPT f=54 TT=2.913 T1=5.18	OPT f=54 TT=0.894 T1=0.25	OPT f=54 TT=1.886 T1=1.85
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a2.opb	OPT f=139 TT=1207.3 T1=1207.49	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=139 TT=1800.02 T1=1800.3	SAT (TO) f=155 TT=1800.02 T1=1800.3	OPT f=139 TT=1207.3 T1=1207.49	SAT (TO) f=139 TT=1800.02 T1=1800.3	SAT (TO) f=143 TT=1800.77 T1=3.21	SAT (TO) f=149 TT=1800.68 T1=163.4	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a3.opb	SAT f=191 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=191 TT=1800.02 T1=1800.3	SAT (TO) f=193 TT=1800.02 T1=1800.3	SAT (TO) f=229 TT=1800.02 T1=1800.3	SAT (TO) f=191 TT=1800.02 T1=1800.3	SAT (TO) f=194 TT=1800.59 T1=2.28	SAT (TO) f=217 TT=1800.07 T1=0.25	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8a4.opb	SAT f=283 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=283 TT=1800.02 T1=1800.3	SAT (TO) f=283 TT=1800.02 T1=1800.3	SAT (TO) f=367 TT=1800.02 T1=1800.3	SAT (TO) f=283 TT=1800.02 T1=1800.3	SAT (TO) f=335 TT=1800.1 T1=7.33	SAT (TO) f=313 TT=1800.79 T1=0.31	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b1.opb	OPT f=191 TT=78.476 T1=78.48	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=191 TT=1800.1 T1=1800.4	SAT (TO) f=194 TT=1800.02 T1=1800.3	OPT f=191 TT=78.476 T1=78.48	OPT f=191 TT=392.55 T1=392.61	SAT (TO) f=221 TT=1800.73 T1=0.82	SAT (TO) f=221 TT=1800.08 T1=0.28	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b2.opb	SAT f=379 TT=1800.02 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=379 TT=1800.02 T1=1800.3	SAT (TO) f=381 TT=1800.08 T1=1800.4	SAT (TO) f=430 TT=1800.02 T1=1800.3	SAT (TO) f=379 TT=1800.02 T1=1800.3	SAT (TO) f=411 TT=1800.73 T1=2.37	SAT (TO) f=413 TT=1800.06 T1=0.32	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b3.opb	SAT f=507 TT=1800.02 T1=1800.3	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=507 TT=1800.1 T1=1800.4	SAT (TO) f=508 TT=1800.01 T1=1800.3	SAT (TO) f=594 TT=1800.02 T1=1800.3	SAT (TO) f=507 TT=1800.02 T1=1800.3	SAT (TO) f=551 TT=1800.05 T1=1.89	SAT (TO) f=559 TT=1800.77 T1=0.37	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8b4.opb	SAT f=654 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=716 TT=1800.02 T1=1800.3	SAT (TO) f=656 TT=1800.08 T1=1800.4	SAT (TO) f=926 TT=1800.02 T1=1800.3	SAT (TO) f=654 TT=1800.02 T1=1800.3	SAT (TO) f=718 TT=1800.63 T1=0.91	SAT (TO) f=718 TT=1800.01 T1=0.38	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8c1.opb	SAT f=302 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=302 TT=1800.02 T1=1800.3	SAT (TO) f=315 TT=1800.01 T1=1800.3	SAT (TO) f=315 TT=1800.02 T1=1800.3	SAT (TO) f=302 TT=1800.02 T1=1800.3	SAT (TO) f=315 TT=1800.16 T1=0.84	SAT (TO) f=315 TT=1800.83 T1=0.34	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8c2.opb	SAT f=525 TT=1800.02 T1=1800.3	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=525 TT=1800.11 T1=1800.4	SAT (TO) f=591 TT=1800.09 T1=1800.4	SAT (TO) f=916 TT=1800.01 T1=1800.3	SAT (TO) f=525 TT=1800.02 T1=1800.3	SAT (TO) f=574 TT=1800.02 T1=1.4	SAT (TO) f=574 TT=1800.03 T1=0.42	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8d1.opb	SAT f=343 TT=1800.01 T1=1800.3	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=343 TT=1800.02 T1=1800.3	SAT (TO) f=345 TT=1800.1 T1=1800.4	SAT (TO) f=390 TT=1800.02 T1=1800.3	SAT (TO) f=343 TT=1800.01 T1=1800.3	SAT (TO) f=374 TT=1800.14 T1=2.33	SAT (TO) f=374 TT=1800.06 T1=0.36	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8d2.opb	SAT f=540 TT=1800.01 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=540 TT=1800.01 T1=1800.3	SAT (TO) f=548 TT=1800.1 T1=1800.4	SAT (TO) f=674 TT=1800.02 T1=1800.3	SAT (TO) f=540 TT=1800.02 T1=1800.3	SAT (TO) f=581 TT=1800.67 T1=0.91	SAT (TO) f=581 TT=1800.87 T1=0.38	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8e1.opb	SAT f=343 TT=1800.01 T1=1800.3	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=343 TT=1800.01 T1=1800.3	SAT (TO) f=367 TT=1800.02 T1=1800.3	SAT (TO) f=434 TT=1800.1 T1=1800.4	SAT (TO) f=343 TT=1800.02 T1=1800.3	SAT (TO) f=420 TT=1800.71 T1=0.82	SAT (TO) f=420 TT=1800.09 T1=0.31	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-ii8e2.opb	SAT f=494 TT=1800.02 T1=1800.3	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT (TO) f=494 TT=1800.1 T1=1800.4	SAT (TO) f=506 TT=1800.01 T1=1800.3	SAT (TO) f=808 TT=1800.01 T1=1800.3	SAT (TO) f=494 TT=1800.02 T1=1800.3	SAT (TO) f=521 TT=1800.73 T1=1.93	SAT (TO) f=521 TT=1800.07 T1=0.47	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh12.opb	OPT f=94 TT=0.007 T1=0	OPT f=94 TT=0.032 T1=0.03	OPT f=94 TT=0.019 T1=0.02	OPT f=94 TT=0.054 T1=0.05	OPT f=94 TT=0.045 T1=0.04	OPT f=94 TT=0.007 T1=0	OPT f=94 TT=0.01 T1=0.01	OPT f=94 TT=0.505 T1=1.76	OPT f=94 TT=0.404 T1=0.24	OPT f=94 TT=0.142 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh17.opb	OPT f=95 TT=0.019 T1=0.01	OPT f=95 TT=0.041 T1=0.04	OPT f=95 TT=0.02 T1=0.02	OPT f=95 TT=0.083 T1=0.08	OPT f=95 TT=0.09 T1=0.09	OPT f=95 TT=0.025 T1=0.02	OPT f=95 TT=0.019 T1=0.01	OPT f=95 TT=0.794 T1=2.75	OPT f=95 TT=0.623 T1=0.32	OPT f=95 TT=0.188 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh1.opb	OPT f=92 TT=0.052 T1=0.05	OPT f=92 TT=0.123 T1=0.12	OPT f=92 TT=0.052 T1=0.05	OPT f=92 TT=0.131 T1=0.13	OPT f=92 TT=0.211 T1=0.21	OPT f=92 TT=0.247 T1=0.24	OPT f=92 TT=0.063 T1=0.06	OPT f=92 TT=1.235 T1=3.76	OPT f=92 TT=0.916 T1=0.38	OPT f=92 TT=0.417 T1=0.39
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh201.opb	OPT f=84 TT=11.188 T1=11.19	OPT f=84 TT=91.689 T1=91.7	OPT f=84 TT=16.179 T1=16.18	OPT f=84 TT=26.24 T1=26.24	OPT f=84 TT=11.188 T1=11.19	OPT f=84 TT=51.659 T1=51.66	OPT f=84 TT=11.303 T1=11.3	OPT f=84 TT=21.75 T1=12.26	OPT f=84 TT=14.571 T1=12.02	OPT f=84 TT=102.341 T1=85.23
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh204.opb	OPT f=93 TT=0.024 T1=0.02	OPT f=93 TT=0.061 T1=0.06	OPT f=93 TT=0.035 T1=0.03	OPT f=93 TT=0.066 T1=0.06	OPT f=93 TT=0.127 T1=0.12	OPT f=93 TT=0.087 T1=0.08	OPT f=93 TT=0.024 T1=0.02	OPT f=93 TT=1.156 T1=1.75	OPT f=93 TT=0.727 T1=0.35	OPT f=93 TT=0.231 T1=0.21
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh205.opb	OPT f=94 TT=0.014 T1=0.01	OPT f=94 TT=0.038 T1=0.03	OPT f=94 TT=0.023 T1=0.02	OPT f=94 TT=0.041 T1=0.06	OPT f=94 TT=0.088 T1=0.08	OPT f=94 TT=0.014 T1=0.01	OPT f=94 TT=0.016 T1=0.01	OPT f=94 TT=0.744 T1=3.75	OPT f=94 TT=0.574 T1=0.27	OPT f=94 TT=0.158 T1=0.15
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh207.opb	OPT f=95 TT=0.015 T1=0.01	OPT f=95 TT=0.042 T1=0.04	OPT f=95 TT=0.021 T1=0.02	OPT f=95 TT=0.041 T1=0.04	OPT f=95 TT=0.051 T1=0.05	OPT f=95 TT=0.017 T1=0.02	OPT f=95 TT=0.015 T1=0.01	OPT f=95 TT=0.903 T1=1.26	OPT f=95 TT=0.524 T1=0.28	OPT f=95 TT=0.132 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh209.opb	OPT f=93 TT=0.026 T1=0.02	OPT f=93 TT=0.049 T1=0.04	OPT f=93 TT=0.026 T1=0.02	OPT f=93 TT=0.091 T1=0.09	OPT f=93 TT=0.129 T1=0.12	OPT f=93 TT=0.047 T1=0.04	OPT f=93 TT=0.04 T1=0.04	OPT f=93 TT=0.994 T1=3.3	OPT f=93 TT=0.794 T1=0.29	OPT f=93 TT=0.201 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh210.opb	OPT f=88 TT=0.044 T1=0.04	OPT f=88 TT=0.146 T1=0.14	OPT f=88 TT=0.044 T1=0.04	OPT f=88 TT=0.302 T1=0.3	OPT f=88 TT=0.389 T1=0.38	OPT f=88 TT=0.337 T1=0.33	OPT f=88 TT=0.216 T1=0.21	OPT f=88 TT=2.134 T1=4.76	OPT f=88 TT=0.913 T1=0.41	OPT f=88 TT=1.458 T1=0.34
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh212.opb	OPT f=97 TT=0.013 T1=0.01	OPT f=97 TT=0.045 T1=0.04	OPT f=97 TT=0.024 T1=0.02	OPT f=97 TT=0.058 T1=0.05	OPT f=97 TT=0.069 T1=0.06	OPT f=97 TT=0.015 T1=0.01	OPT f=97 TT=0.013 T1=0.01	OPT f=97 TT=0.887 T1=2.26	OPT f=97 TT=0.645 T1=0.3	OPT f=97 TT=0.195 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh213.opb	OPT f=92 TT=0.012 T1=0.01	OPT f=92 TT=0.037 T1=0.03	OPT f=92 TT=0.022 T1=0.02	OPT f=92 TT=0.077 T1=0.07	OPT f=92 TT=0.092 T1=0.09	OPT f=92 TT=0.012 T1=0.01	OPT f=92 TT=0.021 T1=0.02	OPT f=92 TT=0.724 T1=3.25	OPT f=92 TT=0.584 T1=0.28	OPT f=92 TT=0.214 T1=0.17
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh217.opb	OPT f=89 TT=0.352 T1=0.35	OPT f=89 TT=0.6 T1=0.6	OPT f=89 TT=0.37 T1=0.36	OPT f=89 TT=0.352 T1=0.35	OPT f=89 TT=0.594 T1=0.59	OPT f=89 TT=1.799 T1=1.79	OPT f=89 TT=0.447 T1=0.44	OPT f=89 TT=2.284 T1=4.76	OPT f=89 TT=1.165 T1=0.57	OPT f=89 TT=2.066 T1=1.43
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh218.opb	OPT f=90 TT=0.033 T1=0.03	OPT f=90 TT=0.053 T1=0.05	OPT f=90 TT=0.035 T1=0.03	OPT f=90 TT=0.115 T1=0.11	OPT f=90 TT=0.084 T1=0.08	OPT f=90 TT=0.034 T1=0.03	OPT f=90 TT=0.033 T1=0.03	OPT f=90 TT=0.834 T1=4.26	OPT f=90 TT=0.654 T1=0.33	OPT f=90 TT=0.266 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh220.opb	OPT f=94 TT=0.026 T1=0.02	OPT f=94 TT=0.059 T1=0.05	OPT f=94 TT=0.031 T1=0.03	OPT f=94 TT=0.099 T1=0.09	OPT f=94 TT=0.098 T1=0.09	OPT f=94 TT=0.1 T1=0.1	OPT f=94 TT=0.026 T1=0.02	OPT f=94 TT=1.074 T1=2.76	OPT f=94 TT=0.706 T1=0.34	OPT f=94 TT=0.324 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh301.opb	OPT f=95 TT=0.009 T1=0.01	OPT f=95 TT=0.041 T1=0.04	OPT f=95 TT=0.024 T1=0.02	OPT f=95 TT=0.044 T1=0.04	OPT f=95 TT=0.081 T1=0.08	OPT f=95 TT=0.009 T1=0.01	OPT f=95 TT=0.016 T1=0.01	OPT f=95 TT=0.893 T1=2.28	OPT f=95 TT=0.664 T1=0.32	OPT f=95 TT=0.201 T1=0.28
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-jnh7.opb	OPT f=89 TT=0.017 T1=0.01	OPT f=89 TT=0.04 T1=0.04	OPT f=89 TT=0.024 T1=0.02	OPT f=89 TT=0.171 T1=0.17	OPT f=89 TT=0.081 T1=0.08	OPT f=89 TT=0.017 T1=0.01	OPT f=89 TT=0.04 T1=0.04	OPT f=89 TT=1.033 T1=2.25	OPT f=89 TT=0.683 T1=0.34	OPT f=89 TT=0.238 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-1-c.opb	OPT f=317 TT=0.088 T1=0.08	OPT f=317 TT=1.858 T1=1.85	OPT f=317 TT=0.586 T1=0.58	OPT f=317 TT=0.461 T1=0.46	OPT f=317 TT=1.203 T1=1.2	OPT f=317 TT=0.088 T1=0.08	OPT f=317 TT=0.452 T1=0.45	OPT f=317 TT=3.223 T1=1.28	OPT f=317 TT=1.994 T1=0.83	OPT f=317 TT=2.756 T1=2.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-1.opb	OPT f=1015 TT=0.252 T1=0.25	OPT f=1015 TT=2.448 T1=2.44	OPT f=1015 TT=1.004 T1=1	OPT f=1015 TT=2.06 T1=2.05	OPT f=1015 TT=2.165 T1=2.15	OPT f=1015 TT=0.252 T1=0.25	OPT f=1015 TT=0.484 T1=0.48	OPT f=1015 TT=4.812 T1=0.84	OPT f=1015 TT=2.335 T1=0.47	OPT f=1015 TT=5.933 T1=2.41
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-2-c.opb	OPT f=349 TT=0.058 T1=0.05	OPT f=349 TT=2.057 T1=2.05	OPT f=349 TT=0.853 T1=0.85	OPT f=349 TT=0.751 T1=0.75	OPT f=349 TT=0.848 T1=0.84	OPT f=349 TT=0.058 T1=0.05	OPT f=349 TT=0.574 T1=0.57	OPT f=349 TT=4.314 T1=0.79	OPT f=349 TT=2.137 T1=0.58	OPT f=349 TT=2.373 T1=1.49
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-2.opb	OPT f=1015 TT=0.48 T1=0.48	OPT f=1015 TT=2.392 T1=2.38	OPT f=1015 TT=1.214 T1=1.21	OPT f=1015 TT=3.387 T1=3.38	OPT f=1015 TT=2.658 T1=2.64	OPT f=1015 TT=0.48 T1=0.48	OPT f=1015 TT=0.547 T1=0.54	OPT f=1015 TT=5.042 T1=1.85	OPT f=1015 TT=2.696 T1=1.09	OPT f=1015 TT=19.204 T1=2.98
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-3-c.opb	OPT f=334 TT=0.289 T1=0.29	OPT f=334 TT=1.237 T1=1.23	OPT f=334 TT=0.727 T1=0.72	OPT f=334 TT=0.65 T1=0.64	OPT f=334 TT=0.749 T1=0.74	OPT f=334 TT=0.289 T1=0.29	OPT f=334 TT=0.413 T1=0.41	OPT f=334 TT=4.162 T1=0.78	OPT f=334 TT=1.994 T1=1.05	OPT f=334 TT=2.971 T1=2.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-3.opb	OPT f=1015 TT=0.157 T1=0.15	OPT f=1015 TT=1.9 T1=1.89	OPT f=1015 TT=1.015 T1=1.01	OPT f=1015 TT=1.901 T1=1.89	OPT f=1015 TT=2.827 T1=2.82	OPT f=1015 TT=0.157 T1=0.15	OPT f=1015 TT=0.676 T1=0.67	OPT f=1015 TT=4.86 T1=0.86	OPT f=1015 TT=2.956 T1=0.76	OPT f=1015 TT=6.708 T1=2.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-4-c.opb	OPT f=324 TT=0.03 T1=0.03	OPT f=324 TT=0.67 T1=0.67	OPT f=324 TT=0.294 T1=0.29	OPT f=324 TT=0.235 T1=0.23	OPT f=324 TT=0.443 T1=0.43	OPT f=324 TT=0.03 T1=0.03	OPT f=324 TT=0.211 T1=0.21	OPT f=324 TT=2.603 T1=0.77	OPT f=324 TT=1.234 T1=0.46	OPT f=324 TT=0.639 T1=0.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-4.opb	OPT f=1015 TT=0.088 T1=0.08	OPT f=1015 TT=1.375 T1=1.37	OPT f=1015 TT=0.63 T1=0.62	OPT f=1015 TT=1.442 T1=1.43	OPT f=1015 TT=1.636 T1=1.63	OPT f=1015 TT=0.088 T1=0.08	OPT f=1015 TT=0.356 T1=0.5	OPT f=1015 TT=3.183 T1=1.35	OPT f=1015 TT=1.484 T1=0.81	OPT f=1015 TT=4.988 T1=1.53
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par16-5-c.opb	OPT f=341 TT=0.165 T1=0.16	OPT f=341 TT=3.703 T1=3.7	OPT f=341 TT=0.508 T1=0.5	OPT f=341 TT=0.554 T1=0.55	OPT f=341 TT=1.019 T1=1.01	OPT f=341 TT=0.165 T1=0.16	OPT f=341 TT=0.256 T1=0.25	OPT f=341 TT=3.253 T1=0.77	OPT f=341 TT=1.535 T1=0.93	OPT f=341 TT=1.426 T1=0.66
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par16-5.opb	OPT f=1015 TT=0.064 T1=0.06	OPT f=1015 TT=2.283 T1=2.27	OPT f=1015 TT=0.937 T1=0.93	OPT f=1015 TT=0.731 T1=0.72	OPT f=1015 TT=1.839 T1=1.83	OPT f=1015 TT=0.064 T1=0.06	OPT f=1015 TT=0.512 T1=0.51	OPT f=1015 TT=4.125 T1=0.87	OPT f=1015 TT=1.943 T1=1.28	OPT f=1015 TT=6.104 T1=1.27
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-1-c.opb	OPT f=1315 TT=875.815 T1=875.95	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	OPT f=1315 TT=875.815 T1=875.95	SAT (TO) f=1315 TT=1800.03 T1=1800.3	? (TO) TT=1801.1	? (TO) TT=1800.03	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-1.opb		? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.76	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-2-c.opb		? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.31	? (TO) TT=1800.41	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-2.opb		? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.91	? (TO) TT=1800.03	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-3-c.opb		? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.54	? (TO) TT=1800.62	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-3.opb		? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-4-c.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.81	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-4.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par32-5-c.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1801.19	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par32-5.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-1-c.opb	OPT f=64 TT=0.002 T1=0	OPT f=64 TT=0.027 T1=0.02	OPT f=64 TT=0.013 T1=0.01	OPT f=64 TT=0.014 T1=0.01	OPT f=64 TT=0.02 T1=0.02	OPT f=64 TT=0.002 T1=0	OPT f=64 TT=0.003 T1=0	OPT f=64 TT=0.325 T1=0.67	OPT f=64 TT=0.244 T1=0.17	OPT f=64 TT=0.083 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-1.opb	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.036 T1=0.03	OPT f=350 TT=0.019 T1=0.01	OPT f=350 TT=0.054 T1=0.05	OPT f=350 TT=0.068 T1=0.07	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.022 T1=0.02	OPT f=350 TT=0.653 T1=0.79	OPT f=350 TT=0.444 T1=0.25	OPT f=350 TT=0.062 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-2-c.opb	OPT f=68 TT=0.003 T1=0	OPT f=68 TT=0.025 T1=0.02	OPT f=68 TT=0.013 T1=0.01	OPT f=68 TT=0.013 T1=0.01	OPT f=68 TT=0.032 T1=0.03	OPT f=68 TT=0.003 T1=0	OPT f=68 TT=0.003 T1=0	OPT f=68 TT=0.385 T1=0.7	OPT f=68 TT=0.263 T1=0.16	OPT f=68 TT=0.098 T1=0.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-2.opb	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.032 T1=0.03	OPT f=350 TT=0.019 T1=0.02	OPT f=350 TT=0.055 T1=0.05	OPT f=350 TT=0.068 T1=0.06	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.025 T1=0.02	OPT f=350 TT=0.695 T1=0.78	OPT f=350 TT=0.484 T1=0.25	OPT f=350 TT=0.065 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-3-c.opb	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.03 T1=0.03	OPT f=75 TT=0.015 T1=0.01	OPT f=75 TT=0.02 T1=0.01	OPT f=75 TT=0.019 T1=0.01	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.004 T1=0	OPT f=75 TT=0.365 T1=0.68	OPT f=75 TT=0.264 T1=0.18	OPT f=75 TT=0.114 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-3.opb	OPT f=350 TT=0.013 T1=0.01	OPT f=350 TT=0.034 T1=0.03	OPT f=350 TT=0.02 T1=0.02	OPT f=350 TT=0.054 T1=0.05	OPT f=350 TT=0.058 T1=0.06	OPT f=350 TT=0.013 T1=0.01	OPT f=350 TT=0.022 T1=0.02	OPT f=350 TT=0.664 T1=0.78	OPT f=350 TT=0.483 T1=0.25	OPT f=350 TT=0.063 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-4-c.opb	OPT f=67 TT=0.003 T1=0	OPT f=67 TT=0.028 T1=0.03	OPT f=67 TT=0.013 T1=0.01	OPT f=67 TT=0.015 T1=0.01	OPT f=67 TT=0.014 T1=0.01	OPT f=67 TT=0.003 T1=0	OPT f=67 TT=0.005 T1=0	OPT f=67 TT=0.324 T1=0.69	OPT f=67 TT=0.243 T1=0.16	OPT f=67 TT=0.091 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-4.opb	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.034 T1=0.03	OPT f=350 TT=0.019 T1=0.01	OPT f=350 TT=0.059 T1=0.05	OPT f=350 TT=0.077 T1=0.07	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.023 T1=0.02	OPT f=350 TT=0.594 T1=0.76	OPT f=350 TT=0.415 T1=0.25	OPT f=350 TT=0.438 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-par8-5-c.opb	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.024 T1=0.02	OPT f=75 TT=0.014 T1=0.01	OPT f=75 TT=0.02 T1=0.01	OPT f=75 TT=0.027 T1=0.02	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.003 T1=0	OPT f=75 TT=0.354 T1=0.67	OPT f=75 TT=0.263 T1=0.17	OPT f=75 TT=0.105 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ primes-dimacs-cnf/normalized-par8-5.opb	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.035 T1=0.03	OPT f=350 TT=0.019 T1=0.01	OPT f=350 TT=0.021 T1=0.02	OPT f=350 TT=0.056 T1=0.05	OPT f=350 TT=0.012 T1=0.01	OPT f=350 TT=0.021 T1=0.02	OPT f=350 TT=0.664 T1=0.78	OPT f=350 TT=0.446 T1=0.26	OPT f=350 TT=0.442 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa0432-003.opb	UNSAT TT=0.008	UNSAT TT=0.033	UNSAT TT=0.02	UNSAT TT=0.019	UNSAT TT=0.019	UNSAT TT=0.008	UNSAT TT=0.009	UNSAT TT=0.646	UNSAT TT=0.495	UNSAT TT=0.065
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa2670-130.opb	UNSAT TT=0.023	UNSAT TT=0.063	UNSAT TT=0.036	UNSAT TT=0.06	UNSAT TT=0.059	UNSAT TT=0.023	UNSAT TT=0.023	UNSAT TT=1.474	UNSAT TT=0.833	UNSAT TT=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa2670-141.opb	UNSAT TT=0.02	UNSAT TT=0.057	UNSAT TT=0.038	UNSAT TT=0.044	UNSAT TT=0.045	UNSAT TT=0.02	UNSAT TT=0.02	UNSAT TT=1.014	UNSAT TT=0.835	UNSAT TT=0.192
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa6288-047.opb	UNSAT TT=0.165	UNSAT TT=0.183	UNSAT TT=0.165	UNSAT TT=0.533	UNSAT TT=0.485	UNSAT TT=0.188	UNSAT TT=0.189	UNSAT TT=2.664	UNSAT TT=1.184	UNSAT TT=0.963
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-038.opb	OPT f=1448 TT=0.159 T1=0.15	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT (TO) f=1448 TT=1800.01 T1=1800.3	OPT f=1448 TT=7.194 T1=7.15	OPT f=1448 TT=0.159 T1=0.15	OPT f=1448 TT=1.96 T1=1.95	SAT (TO) f=1448 TT=1800.69 T1=0.88	SAT (TO) f=1448 TT=1800.97 T1=0.47	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-158.opb	OPT f=1327 TT=0.086 T1=0.08	? (TO) TT=1800.14	? (TO) TT=1800.03	SAT (TO) f=1327 TT=1800.02 T1=1800.3	OPT f=1327 TT=4.832 T1=4.8	OPT f=1327 TT=0.086 T1=0.08	OPT f=1327 TT=1.115 T1=1.11	SAT (TO) f=1327 TT=1800.08 T1=0.85	SAT (TO) f=1327 TT=1800.08 T1=0.35	OPT f=1327 TT=6.693 T1=6.69
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-159.opb	OPT f=1327 TT=0.083 T1=0.08	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT (TO) f=1327 TT=1800.03 T1=1800.3	OPT f=1327 TT=4.729 T1=4.7	OPT f=1327 TT=0.083 T1=0.08	OPT f=1327 TT=1.152 T1=1.15	SAT (TO) f=1327 TT=1800.01 T1=0.87	SAT (TO) f=1327 TT=1800.7 T1=0.34	OPT f=1327 TT=6.884 T1=6.87
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/primes-dimacs-cnf/ normalized-ssa7552-160.opb	OPT f=1359 TT=0.091 T1=0.09	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT (TO) f=1359 TT=1800.11 T1=1800.4	OPT f=1359 TT=4.631 T1=4.6	OPT f=1359 TT=0.091 T1=0.09	OPT f=1359 TT=1.308 T1=1.38	SAT (TO) f=1359 TT=1800.07 T1=1.39	SAT (TO) f=1359 TT=1800.09 T1=0.41	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-1pb.opb	OPT f=36 TT=0.011 T1=0.01	OPT f=36 TT=0.031 T1=0.03	OPT f=36 TT=0.016 T1=0.01	OPT f=36 TT=0.062 T1=0.06	OPT f=36 TT=0.121 T1=0.12	OPT f=36 TT=0.011 T1=0.01	OPT f=36 TT=0.02 T1=0.02	OPT f=36 TT=1.115 T1=0.7	OPT f=36 TT=0.503 T1=0.24	OPT f=36 TT=0.134 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-2pb.opb	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.036 T1=0.03	OPT f=36 TT=0.018 T1=0.01	OPT f=36 TT=0.099 T1=0.09	OPT f=36 TT=0.139 T1=0.14	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.014 T1=0.01	OPT f=36 TT=0.874 T1=0.72	OPT f=36 TT=0.603 T1=0.3	OPT f=36 TT=0.136 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-3pb.opb	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.036 T1=0.03	OPT f=36 TT=0.018 T1=0.01	OPT f=36 TT=0.1 T1=0.1	OPT f=36 TT=0.124 T1=0.13	OPT f=36 TT=0.008 T1=0	OPT f=36 TT=0.023 T1=0.02	OPT f=36 TT=1.153 T1=0.71	OPT f=36 TT=0.586 T1=0.29	OPT f=36 TT=0.108 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-4pb.opb	OPT f=36 TT=0.01 T1=0	OPT f=36 TT=0.044 T1=0.04	OPT f=36 TT=0.022 T1=0.02	OPT f=36 TT=0.082 T1=0.08	OPT f=36 TT=0.142 T1=0.14	OPT f=36 TT=0.01 T1=0	OPT f=36 TT=0.018 T1=0.01	OPT f=36 TT=1.194 T1=0.72	OPT f=36 TT=0.615 T1=0.24	OPT f=36 TT=0.102 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s3-3-3-5pb.opb	OPT f=34 TT=0.008 T1=0	OPT f=34 TT=0.041 T1=0.04	OPT f=34 TT=0.032 T1=0.03	OPT f=34 TT=0.083 T1=0.08	OPT f=34 TT=0.158 T1=0.15	OPT f=34 TT=0.008 T1=0	OPT f=34 TT=0.015 T1=0.01	OPT f=34 TT=1.723 T1=1.23	OPT f=34 TT=0.673 T1=0.19	OPT f=34 TT=0.151 T1=0.14
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-10pb.opb	OPT f=70 TT=0.104 T1=0.1	OPT f=70 TT=0.375 T1=0.37	OPT f=70 TT=0.104 T1=0.1	OPT f=70 TT=1.041 T1=1.04	OPT f=70 TT=1.007 T1=1	OPT f=70 TT=0.21 T1=0.21	OPT f=70 TT=0.295 T1=0.29	OPT f=70 TT=4.872 T1=1.33	OPT f=70 TT=1.584 T1=0.66	OPT f=70 TT=1.62 T1=1.56
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-1pb.opb	OPT f=62 TT=0.038 T1=0.03	OPT f=62 TT=15.602 T1=15.6	OPT f=62 TT=7.934 T1=7.93	OPT f=62 TT=3.467 T1=3.46	OPT f=62 TT=2.051 T1=2.04	OPT f=62 TT=0.038 T1=0.03	OPT f=62 TT=0.266 T1=0.26	OPT f=62 TT=188.007 T1=5.84	OPT f=62 TT=536.192 T1=7.92	OPT f=62 TT=7.436 T1=7.38
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-2pb.opb	OPT f=64 TT=0.397 T1=0.39	OPT f=64 TT=6.932 T1=6.93	OPT f=64 TT=1.935 T1=1.93	OPT f=64 TT=11.348 T1=11.34	OPT f=64 TT=3.075 T1=3.07	OPT f=64 TT=0.397 T1=0.39	OPT f=64 TT=1.428 T1=1.42	OPT f=64 TT=227.618 T1=6.83	OPT f=64 TT=82.73 T1=9.66	OPT f=64 TT=1.677 T1=1.62
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-3pb.opb	OPT f=62 TT=0.299 T1=0.29	OPT f=62 TT=13.44 T1=13.44	OPT f=62 TT=8.496 T1=8.5	OPT f=62 TT=4.467 T1=4.46	OPT f=62 TT=2.576 T1=2.57	OPT f=62 TT=0.299 T1=0.29	OPT f=62 TT=0.593 T1=0.59	OPT f=62 TT=155.529 T1=31.31	OPT f=62 TT=84.78 T1=51.64	OPT f=62 TT=21.491 T1=21.39
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-4pb.opb	OPT f=60 TT=0.184 T1=0.18	OPT f=60 TT=12.047 T1=12.04	OPT f=60 TT=15.762 T1=15.76	OPT f=60 TT=9.712 T1=9.7	OPT f=60 TT=2.403 T1=2.43	OPT f=60 TT=0.184 T1=0.18	OPT f=60 TT=0.342 T1=0.34	OPT f=60 TT=951.36 T1=22.82	OPT f=60 TT=405.95 T1=101.34	OPT f=60 TT=8.299 T1=8.24
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-5pb.opb	OPT f=60 TT=0.376 T1=0.37	OPT f=60 TT=10.853 T1=10.85	OPT f=60 TT=19.979 T1=19.98	OPT f=60 TT=6.431 T1=6.43	OPT f=60 TT=0.922 T1=0.91	OPT f=60 TT=0.376 T1=0.37	OPT f=60 TT=0.775 T1=0.77	OPT f=60 TT=258.277 T1=29.87	OPT f=60 TT=116.56 T1=46.04	OPT f=60 TT=11.049 T1=10.99
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-6pb.opb	OPT f=66 TT=0.229 T1=0.22	OPT f=66 TT=4.668 T1=4.66	OPT f=66 TT=1.747 T1=1.74	OPT f=66 TT=4.547 T1=4.54	OPT f=66 TT=2.534 T1=2.53	OPT f=66 TT=0.229 T1=0.22	OPT f=66 TT=0.699 T1=0.82	OPT f=66 TT=47.936 T1=2.8	OPT f=66 TT=11.573 T1=1.66	OPT f=66 TT=61.889 T1=1.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-7pb.opb	OPT f=64 TT=0.405 T1=0.4	OPT f=64 TT=1.779 T1=1.77	OPT f=64 TT=1.871 T1=1.87	OPT f=64 TT=3.663 T1=3.66	OPT f=64 TT=0.924 T1=0.92	OPT f=64 TT=0.405 T1=0.4	OPT f=64 TT=0.845 T1=0.84	OPT f=64 TT=21.091 T1=3.81	OPT f=64 TT=7.793 T1=2.31	OPT f=64 TT=26.579 T1=26.52
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-8pb.opb	OPT f=36 TT=0.021 T1=0.02	OPT f=36 TT=6.463 T1=6.46	OPT f=36 TT=1.937 T1=1.93	OPT f=36 TT=4.712 T1=4.71	OPT f=36 TT=0.341 T1=0.34	OPT f=36 TT=0.021 T1=0.02	OPT f=36 TT=0.134 T1=0.13	OPT f=36 TT=50.916 T1=10.31	OPT f=36 TT=107.82 T1=2.34	OPT f=36 TT=0.234 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/routing/ normalized-s4-4-3-9pb.opb	OPT f=68 TT=0.193 T1=0.19	OPT f=68 TT=2.122 T1=2.12	OPT f=68 TT=1.524 T1=1.52	OPT f=68 TT=14.856 T1=14.85	OPT f=68 TT=1.913 T1=1.9	OPT f=68 TT=0.193 T1=0.19	OPT f=68 TT=0.401 T1=0.4	OPT f=68 TT=10.371 T1=1.32	OPT f=68 TT=4.592 T1=2.1	OPT f=68 TT=130.572 T1=1.21
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-9symml.opb	SAT f=4693 TT=1800.01 T1=1800.3	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=4899 TT=1800.03 T1=1800.4	SAT (TO) f=6227 TT=1800.01 T1=1800.3	SAT (TO) f=4693 TT=1800.01 T1=1800.3	SAT (TO) f=5202 TT=1800.19 T1=1800.4	SAT (TO) f=5498 TT=1800.69 T1=37.87	SAT (TO) f=5962 TT=1800.56 T1=1.56	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-b1.opb	OPT f=128 TT=0.001 T1=0	OPT f=128 TT=0.023 T1=0.02	OPT f=128 TT=0.013 T1=0.01	OPT f=128 TT=0.003 T1=0	OPT f=128 TT=0.029 T1=0.02	OPT f=128 TT=0.002 T1=0	OPT f=128 TT=0.001 T1=0	OPT f=128 TT=0.183 T1=1.8	OPT f=128 TT=0.174 T1=0.14	OPT f=128 TT=0.022 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-C17.opb	OPT f=260 TT=0 T1=0	OPT f=260 TT=0.022 T1=0.02	OPT f=260 TT=0.015 T1=0.01	OPT f=260 TT=0.001 T1=0	OPT f=260 TT=0.008 T1=0.01	OPT f=260 TT=0 T1=0	OPT f=260 TT=0.001 T1=0	OPT f=260 TT=0.174 T1=1.13	OPT f=260 TT=0.175 T1=0.14	OPT f=260 TT=0.022 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-C432.opb	SAT f=4834 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=5635 TT=1800.03 T1=1800.4	SAT (TO) f=7143 TT=1800.1 T1=1800.4	SAT (TO) f=4834 TT=1800.02 T1=1800.3	SAT (TO) f=5552 TT=1800.46 T1=1800.4	SAT (TO) f=6156 TT=1800.14 T1=125.58	SAT (TO) f=6879 TT=1800.02 T1=1181.17	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-c8.opb	OPT f=1194 TT=11.714 T1=11.71	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1302 TT=1800.08 T1=1800.4	SAT (TO) f=1737 TT=1800.02 T1=1800.3	OPT f=1194 TT=11.714 T1=11.71	SAT (TO) f=1221 TT=1800.07 T1=1800.4	SAT (TO) f=1482 TT=1800.16 T1=296.34	SAT (TO) f=1557 TT=1800.75 T1=1163.63	OPT f=1194 TT=178.038 T1=80.91
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-cc.opb	OPT f=1567 TT=0.005 T1=0	OPT f=1567 TT=1.487 T1=1.48	OPT f=1567 TT=3.514 T1=3.51	SAT (TO) f=1588 TT=1800.02 T1=1800.3	SAT (TO) f=1585 TT=1800.02 T1=1800.3	OPT f=1567 TT=0.005 T1=0	SAT (TO) f=1597 TT=1800.1 T1=1800.4	SAT (TO) f=1603 TT=1800.04 T1=26.23	SAT (TO) f=1653 TT=1800.69 T1=9.08	OPT f=1567 TT=8.867 T1=3.27
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-cm42a.opb	OPT f=694 TT=0.068 T1=0.06	OPT f=694 TT=13.552 T1=13.55	OPT f=694 TT=7.441 T1=7.44	OPT f=694 TT=89.508 T1=89.52	OPT f=694 TT=32.095 T1=32.09	OPT f=694 TT=0.068 T1=0.06	OPT f=694 TT=54.005 T1=54.01	SAT (TO) f=694 TT=1800.93 T1=224.73	SAT (TO) f=801 TT=1800.08 T1=1556.84	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-cmb.opb	OPT f=1053 TT=0.406 T1=0.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1187 TT=1800.1 T1=1800.4	SAT (TO) f=1524 TT=1800.02 T1=1800.3	OPT f=1053 TT=0.406 T1=0.4	SAT (TO) f=1101 TT=1800.1 T1=1800.4	SAT (TO) f=1398 TT=1800.53 T1=110.32	SAT (TO) f=1429 TT=1800.66 T1=1215.5	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ synthesis-ptl-cmos-circuits/normalized-mux.opb	OPT f=872 TT=8.669 T1=8.67	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1218 TT=1800.01 T1=1800.3	SAT (TO) f=872 TT=1800.02 T1=1800.3	OPT f=872 TT=8.669 T1=8.67	SAT (TO) f=986 TT=1800.08 T1=1800.4	SAT (TO) f=1232 TT=1800.26 T1=897.9	SAT (TO) f=1473 TT=1800.67 T1=0.39	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/synthesis-ptl-cmos-circuits/ normalized-my_adder.opb	OPT f=4561 TT=0.065 T1=0.06	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=5209 TT=1800.02 T1=1800.4	SAT (TO) f=6071 TT=1800.02 T1=1800.3	OPT f=4561 TT=0.065 T1=0.06	SAT (TO) f=5301 TT=1800.15 T1=1800.4	SAT (TO) f=5246 TT=1800.09 T1=546.42	SAT (TO) f=6092 TT=1800.05 T1=0.28	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ttp/ normalized-circ10_3.opb	SAT f=342 TT=1800.07 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT (TO) f=342 TT=1800.07 T1=1800.4	SAT (TO) f=402 TT=1800.09 T1=1800.4	SAT (TO) f=374 TT=1800.07 T1=1800.4	SAT (TO) f=348 TT=1800.06 T1=1800.4	SAT (TO) f=354 TT=1800.1 T1=3.08	SAT (TO) f=378 TT=1800.02 T1=1.56	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-circ4_3.opb	OPT f=20 TT=0.027 T1=0.02	OPT f=20 TT=0.05 T1=0.04	OPT f=20 TT=0.027 T1=0.02	OPT f=20 TT=0.083 T1=0.08	OPT f=20 TT=0.104 T1=0.1	OPT f=20 TT=0.115 T1=0.11	OPT f=20 TT=0.096 T1=0.09	OPT f=20 TT=1.974 T1=0.74	OPT f=20 TT=0.855 T1=0.24	OPT f=20 TT=0.967 T1=0.21
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-circ6_3.opb	SAT f=64 TT=1800.07 T1=9.37	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=66 TT=1800.02 T1=1800.3	SAT (TO) f=90 TT=1800.02 T1=1800.3	SAT (TO) f=70 TT=1800.02 T1=1800.3	SAT (TO) f=66 TT=1800.02 T1=1800.3	SAT (TO) f=68 TT=1800.14 T1=72.46	SAT (TO) f=64 TT=1800.07 T1=9.37	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-circ8_3.opb	SAT f=154 TT=1800.09 T1=63.43	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=162 TT=1800.11 T1=1800.4	SAT (TO) f=214 TT=1800.11 T1=1800.4	SAT (TO) f=182 TT=1800.09 T1=1800.4	SAT (TO) f=170 TT=1800.1 T1=1800.4	SAT (TO) f=180 TT=1800.19 T1=4.71	SAT (TO) f=154 TT=1800.09 T1=63.43	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ttp/ normalized-data10_3.opb	SAT f=78108 TT=1800.09 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=80122 TT=1800.08 T1=1800.4	SAT (TO) f=91022 TT=1800.08 T1=1800.4	SAT (TO) f=78108 TT=1800.09 T1=1800.4	? TT=103.468	SAT (TO) f=81570 TT=1800.86 T1=3.59	SAT (TO) f=81962 TT=1800.03 T1=3.97	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-data4_3.opb	OPT f=8276 TT=0.148 T1=0.15	OPT f=8276 TT=0.432 T1=0.43	OPT f=8276 TT=0.148 T1=0.15	OPT f=8276 TT=0.874 T1=0.87	OPT f=8276 TT=0.98 T1=0.97	OPT f=8276 TT=0.252 T1=0.25	OPT f=8276 TT=0.364 T1=0.36	OPT f=8276 TT=3.145 T1=2.23	OPT f=8276 TT=0.935 T1=0.34	OPT f=8276 TT=5.258 T1=1.67
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-data6_3.opb	SAT f=24853 TT=1800.02 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=24853 TT=1800.02 T1=1800.3	SAT (TO) f=34145 TT=1800.02 T1=1800.3	SAT (TO) f=25115 TT=1800.02 T1=1800.3	? TT=90.037	SAT (TO) f=25186 TT=1800.01 T1=36.97	SAT (TO) f=25108 TT=1800.65 T1=1.1	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ ttp/normalized-data8_3.opb	SAT f=42718 TT=1800.01 T1=1800.3	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=47019 TT=1800.01 T1=1800.3	SAT (TO) f=57240 TT=1800.09 T1=1800.4	SAT (TO) f=42718 TT=1800.01 T1=1800.3	? TT=84.93	SAT (TO) f=46875 TT=1800 T1=24.76	SAT (TO) f=50012 TT=1800.71 T1=1.06	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/submitted-PB05/ sorensson/garden/normalized-g100x100.opb	SAT f=2932 TT=1800.71 T1=73.78	? (TO) TT=1800.16	? (TO) TT=1800.02	SAT (TO) f=3334 TT=1800.09 T1=1800.4	SAT (TO) f=3334 TT=1800.08 T1=1800.4	SAT (TO) f=3334 TT=1800.02 T1=1800.3	SAT (TO) f=3334 TT=1800.08 T1=1800.4	SAT (TO) f=2932 TT=1800.71 T1=73.78	SAT (TO) f=3334 TT=1800.05 T1=0.58	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g15x15.opb	OPT f=53 TT=24.648 T1=24.65	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=54 TT=1800.01 T1=1800.3	OPT f=53 TT=450.06 T1=450.12	OPT f=53 TT=24.648 T1=24.65	OPT f=53 TT=70.189 T1=70.2	SAT (TO) f=63 TT=1803.88 T1=69.72	SAT (TO) f=71 TT=1800.03 T1=1441.6	? (TO) TT=1800.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g2x2.opb	OPT f=2 TT=0 T1=0	OPT f=2 TT=0.021 T1=0.02	OPT f=2 TT=0.012 T1=0.01	OPT f=2 TT=0.001 T1=0	OPT f=2 TT=0.001 T1=0	OPT f=2 TT=0.002 T1=0	OPT f=2 TT=0 T1=0	OPT f=2 TT=0.163 T1=0.62	OPT f=2 TT=0.154 T1=0.12	OPT f=2 TT=0.018 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g4x4.opb	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.022 T1=0.02	OPT f=4 TT=0.013 T1=0.01	OPT f=4 TT=0.002 T1=0	OPT f=4 TT=0.002 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.001 T1=0	OPT f=4 TT=0.174 T1=1.63	OPT f=4 TT=0.173 T1=0.14	OPT f=4 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g7x7.opb	OPT f=12 TT=0.002 T1=0	OPT f=12 TT=0.035 T1=0.03	OPT f=12 TT=0.023 T1=0.02	OPT f=12 TT=0.022 T1=0.02	OPT f=12 TT=0.023 T1=0.02	OPT f=12 TT=0.002 T1=0	OPT f=12 TT=0.012 T1=0.01	OPT f=12 TT=3.423 T1=3.14	OPT f=12 TT=39.53 T1=16.78	OPT f=12 TT=1.596 T1=1.11
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g9x3.opb	OPT f=7 TT=0.001 T1=0	OPT f=7 TT=0.023 T1=0.02	OPT f=7 TT=0.014 T1=0.01	OPT f=7 TT=0.008 T1=0	OPT f=7 TT=0.006 T1=0	OPT f=7 TT=0.001 T1=0	OPT f=7 TT=0.002 T1=0	OPT f=7 TT=0.184 T1=1.64	OPT f=7 TT=0.533 T1=0.18	OPT f=7 TT=0.023 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB05/sorensson/ garden/normalized-g9x9.opb	OPT f=20 TT=0.009 T1=0.01	OPT f=20 TT=1.176 T1=1.17	OPT f=20 TT=5.585 T1=5.58	OPT f=20 TT=0.308 T1=0.3	OPT f=20 TT=0.23 T1=0.23	OPT f=20 TT=0.009 T1=0.01	OPT f=20 TT=0.143 T1=0.14	SAT (TO) f=20 TT=1800.02 T1=514.77	SAT (TO) f=23 TT=1800.08 T1=37.94	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_10.opb.PB06.opb	SAT f=212 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=215 TT=1800.1 T1=1800.4	SAT (TO) f=238 TT=1800.02 T1=1800.3	SAT (TO) f=469 TT=1800.02 T1=1800.3	SAT (TO) f=212 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.7 T1=331.37	SAT (TO) f=222 TT=1800.02 T1=726.44	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_11.opb.PB06.opb	SAT f=210 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=217 TT=1800.02 T1=1800.3	SAT (TO) f=230 TT=1800.02 T1=1800.3	SAT (TO) f=472 TT=1800.02 T1=1800.3	SAT (TO) f=210 TT=1800.02 T1=1800.3	SAT (TO) f=220 TT=1800.46 T1=244.35	SAT (TO) f=223 TT=1800.78 T1=78.74	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_12.opb.PB06.opb	SAT f=205 TT=1800.1 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=207 TT=1800.02 T1=1800.3	SAT (TO) f=224 TT=1800.08 T1=1800.4	SAT (TO) f=464 TT=1800.02 T1=1800.3	SAT (TO) f=205 TT=1800.1 T1=1800.4	SAT (TO) f=212 TT=1800.04 T1=83.25	SAT (TO) f=215 TT=1800.66 T1=184.07	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_13.opb.PB06.opb	SAT f=214 TT=1800.02 T1=1800.3	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=220 TT=1800.02 T1=1800.3	SAT (TO) f=238 TT=1800.02 T1=1800.3	SAT (TO) f=475 TT=1800.02 T1=1800.3	SAT (TO) f=214 TT=1800.02 T1=1800.3	SAT (TO) f=216 TT=1800.54 T1=372.48	SAT (TO) f=216 TT=1800.09 T1=300.17	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_14.opb.PB06.opb	SAT f=207 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=218 TT=1800.03 T1=1800.3	SAT (TO) f=227 TT=1800.01 T1=1800.3	SAT (TO) f=467 TT=1800.02 T1=1800.3	SAT (TO) f=207 TT=1800.02 T1=1800.3	SAT (TO) f=218 TT=1800.05 T1=468.96	SAT (TO) f=220 TT=1800.69 T1=102.26	? (TO) TT=1800.07
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_15.opb.PB06.opb	SAT f=213 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=219 TT=1800.02 T1=1800.3	SAT (TO) f=237 TT=1800.02 T1=1800.3	SAT (TO) f=472 TT=1800.01 T1=1800.3	SAT (TO) f=213 TT=1800.02 T1=1800.3	SAT (TO) f=218 TT=1800.04 T1=142.94	SAT (TO) f=228 TT=1800.06 T1=592.22	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_16.opb.PB06.opb	SAT f=213 TT=1800.01 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=219 TT=1800.1 T1=1800.4	SAT (TO) f=231 TT=1800.02 T1=1800.3	SAT (TO) f=475 TT=1800.02 T1=1800.3	SAT (TO) f=213 TT=1800.01 T1=1800.3	SAT (TO) f=219 TT=1800.06 T1=450.46	SAT (TO) f=226 TT=1800.78 T1=8.49	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_17.opb.PB06.opb	SAT f=219 TT=1800.03 T1=1800.3	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT (TO) f=224 TT=1800.02 T1=1800.3	SAT (TO) f=249 TT=1800.02 T1=1800.3	SAT (TO) f=480 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.03 T1=1800.3	SAT (TO) f=227 TT=1800.55 T1=774.59	SAT (TO) f=231 TT=1800.73 T1=925.36	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_18.opb.PB06.opb	SAT f=212 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=217 TT=1800.01 T1=1800.3	SAT (TO) f=234 TT=1800.11 T1=1800.4	SAT (TO) f=469 TT=1800.01 T1=1800.3	SAT (TO) f=212 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.04 T1=575.89	SAT (TO) f=222 TT=1800.07 T1=4.06	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_19.opb.PB06.opb	SAT f=204 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT (TO) f=211 TT=1800.01 T1=1800.3	SAT (TO) f=222 TT=1800.02 T1=1800.3	SAT (TO) f=466 TT=1800.02 T1=1800.3	SAT (TO) f=204 TT=1800.02 T1=1800.3	SAT (TO) f=212 TT=1800.7 T1=401.71	SAT (TO) f=220 TT=1800.02 T1=1181.25	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_20.opb.PB06.opb	SAT f=211 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=212 TT=1800.02 T1=1800.3	SAT (TO) f=222 TT=1800.02 T1=1800.3	SAT (TO) f=472 TT=1800.01 T1=1800.3	SAT (TO) f=211 TT=1800.02 T1=1800.3	SAT (TO) f=219 TT=1800.48 T1=597.67	SAT (TO) f=223 TT=1800.09 T1=0.46	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_21.opb.PB06.opb	SAT f=213 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=217 TT=1800.02 T1=1800.3	SAT (TO) f=226 TT=1800.1 T1=1800.4	SAT (TO) f=477 TT=1800.01 T1=1800.3	SAT (TO) f=213 TT=1800.02 T1=1800.3	SAT (TO) f=220 TT=1800.49 T1=702.75	SAT (TO) f=229 TT=1800.02 T1=164.21	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_22.opb.PB06.opb	SAT f=211 TT=1800.02 T1=1800.3	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=213 TT=1800.02 T1=1800.3	SAT (TO) f=232 TT=1800.01 T1=1800.3	SAT (TO) f=469 TT=1800.02 T1=1800.3	SAT (TO) f=211 TT=1800.02 T1=1800.3	SAT (TO) f=216 TT=1800.04 T1=16.31	SAT (TO) f=216 TT=1800.73 T1=31.86	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_23.opb.PB06.opb	SAT f=218 TT=1800.02 T1=1800.3	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT (TO) f=223 TT=1800.1 T1=1800.4	SAT (TO) f=247 TT=1800.02 T1=1800.3	SAT (TO) f=478 TT=1800.02 T1=1800.3	SAT (TO) f=218 TT=1800.02 T1=1800.3	SAT (TO) f=222 TT=1800.03 T1=73.41	SAT (TO) f=229 TT=1800.6 T1=4.22	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_24.opb.PB06.opb	SAT f=216 TT=1800.09 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT (TO) f=223 TT=1800.1 T1=1800.4	SAT (TO) f=238 TT=1800.1 T1=1800.4	SAT (TO) f=474 TT=1800.02 T1=1800.3	SAT (TO) f=216 TT=1800.09 T1=1800.4	SAT (TO) f=219 TT=1800.04 T1=27.79	SAT (TO) f=219 TT=1800.73 T1=523.43	? (TO) TT=1800.02
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_0.opb.PB06.opb	SAT f=1160 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=1200 TT=1800.01 T1=1800.4	SAT (TO) f=1200 TT=1800.02 T1=1800.3	SAT (TO) f=1200 TT=1800.02 T1=1800.3	SAT (TO) f=1160 TT=1800.03 T1=1800.3	SAT (TO) f=1174 TT=1800.04 T1=541.7	SAT (TO) f=1198 TT=1800.06 T1=0.47	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_11.opb.PB06.opb	SAT f=1135 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1175 TT=1800.04 T1=1800.4	SAT (TO) f=1175 TT=1800.03 T1=1800.3	SAT (TO) f=1175 TT=1800.02 T1=1800.3	SAT (TO) f=1135 TT=1800.02 T1=1800.3	SAT (TO) f=1152 TT=1800.02 T1=411.98	SAT (TO) f=1171 TT=1800.73 T1=1286.14	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_12.opb.PB06.opb	SAT f=1145 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=1181 TT=1800.08 T1=1800.4	SAT (TO) f=1181 TT=1800.01 T1=1800.3	SAT (TO) f=1181 TT=1800.02 T1=1800.3	SAT (TO) f=1145 TT=1800.03 T1=1800.3	SAT (TO) f=1164 TT=1800.73 T1=259.34	SAT (TO) f=1180 TT=1800.05 T1=168.59	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_18.opb.PB06.opb	SAT f=1143 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT (TO) f=1198 TT=1800.06 T1=1800.4	SAT (TO) f=1198 TT=1800.1 T1=1800.4	SAT (TO) f=1198 TT=1800.03 T1=1800.3	SAT (TO) f=1143 TT=1800.02 T1=1800.3	SAT (TO) f=1171 TT=1800.36 T1=742.74	SAT (TO) f=1193 TT=1800.64 T1=1221.74	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_1.opb.PB06.opb	SAT f=1152 TT=1800.03 T1=1800.3	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT (TO) f=1189 TT=1800.06 T1=1800.4	SAT (TO) f=1189 TT=1800.02 T1=1800.3	SAT (TO) f=1189 TT=1800.02 T1=1800.3	SAT (TO) f=1152 TT=1800.03 T1=1800.3	SAT (TO) f=1159 TT=1800.04 T1=641.88	SAT (TO) f=1188 TT=1801.2 T1=0.4	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_21.opb.PB06.opb	SAT f=1138 TT=1800.01 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=1171 TT=1800.09 T1=1800.4	SAT (TO) f=1209 TT=1800.01 T1=1800.3	SAT (TO) f=1209 TT=1800.02 T1=1800.3	SAT (TO) f=1138 TT=1800.01 T1=1800.3	SAT (TO) f=1151 TT=1800.14 T1=701.43	SAT (TO) f=1206 TT=1800 T1=4.11	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_2.opb.PB06.opb	SAT f=1146 TT=1800.02 T1=1800.3	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1200 TT=1800.04 T1=1800.4	SAT (TO) f=1200 TT=1800.01 T1=1800.3	SAT (TO) f=1200 TT=1800.02 T1=1800.3	SAT (TO) f=1146 TT=1800.02 T1=1800.3	SAT (TO) f=1169 TT=1800.38 T1=860.77	SAT (TO) f=1199 TT=1800.02 T1=0.79	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_33.opb.PB06.opb	SAT f=1151 TT=1800.02 T1=1800.3	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1190 TT=1800.02 T1=1800.4	SAT (TO) f=1190 TT=1800.02 T1=1800.3	SAT (TO) f=1190 TT=1800.02 T1=1800.3	SAT (TO) f=1151 TT=1800.02 T1=1800.3	SAT (TO) f=1166 TT=1800.39 T1=896.31	SAT (TO) f=1187 TT=1800.64 T1=10.62	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_34.opb.PB06.opb	SAT f=1141 TT=1800.02 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=1170 TT=1800.03 T1=1800.4	SAT (TO) f=1181 TT=1800.11 T1=1800.4	SAT (TO) f=1181 TT=1800.02 T1=1800.3	SAT (TO) f=1141 TT=1800.02 T1=1800.3	SAT (TO) f=1157 TT=1800.3 T1=897.12	SAT (TO) f=1180 TT=1800.02 T1=0.43	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_36.opb.PB06.opb	SAT f=1147 TT=1800.02 T1=1800.3	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT (TO) f=1187 TT=1800.08 T1=1800.4	SAT (TO) f=1204 TT=1800.01 T1=1800.3	SAT (TO) f=1204 TT=1800.02 T1=1800.3	SAT (TO) f=1147 TT=1800.02 T1=1800.3	SAT (TO) f=1175 TT=1800.17 T1=895.7	SAT (TO) f=1204 TT=1800.05 T1=0.33	? (TO) TT=1800.11
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_43.opb.PB06.opb	SAT f=1150 TT=1800.11 T1=1800.4	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT (TO) f=1187 TT=1800.07 T1=1800.4	SAT (TO) f=1199 TT=1800.02 T1=1800.3	SAT (TO) f=1199 TT=1800.02 T1=1800.3	SAT (TO) f=1150 TT=1800.11 T1=1800.4	SAT (TO) f=1163 TT=1800.03 T1=731.03	SAT (TO) f=1198 TT=1800.63 T1=76.71	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_5.opb.PB06.opb	SAT f=1147 TT=1800.02 T1=1800.3	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT (TO) f=1167 TT=1800.07 T1=1800.4	SAT (TO) f=1167 TT=1800.01 T1=1800.3	SAT (TO) f=1167 TT=1800.02 T1=1800.3	SAT (TO) f=1147 TT=1800.02 T1=1800.3	SAT (TO) f=1159 TT=1800.52 T1=388.96	SAT (TO) f=1164 TT=1800.01 T1=7.53	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_6.opb.PB06.opb	SAT f=1148 TT=1800.02 T1=1800.3	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT (TO) f=1211 TT=1800.07 T1=1800.4	SAT (TO) f=1211 TT=1800.11 T1=1800.4	SAT (TO) f=1211 TT=1800.02 T1=1800.3	SAT (TO) f=1148 TT=1800.02 T1=1800.3	SAT (TO) f=1171 TT=1800.15 T1=537.08	SAT (TO) f=1209 TT=1800.8 T1=24.37	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_7.opb.PB06.opb	SAT f=1147 TT=1800.02 T1=1800.3	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT (TO) f=1194 TT=1800.08 T1=1800.4	SAT (TO) f=1194 TT=1800.01 T1=1800.3	SAT (TO) f=1194 TT=1800.02 T1=1800.3	SAT (TO) f=1147 TT=1800.02 T1=1800.3	SAT (TO) f=1168 TT=1800.58 T1=522.55	SAT (TO) f=1194 TT=1800 T1=0.35	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/vtxcov/ normalized-vtxcov_v2000_e4000_8.opb.PB06.opb	SAT f=1156 TT=1800.02 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT (TO) f=1168 TT=1800.09 T1=1800.4	SAT (TO) f=1203 TT=1800.1 T1=1800.4	SAT (TO) f=1203 TT=1800.02 T1=1800.3	SAT (TO) f=1156 TT=1800.02 T1=1800.3	SAT (TO) f=1174 TT=1800.36 T1=764.46	SAT (TO) f=1201 TT=1800.75 T1=0.79	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_0.opb.PB06.opb	SAT f=335 TT=1800.1 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=6152 TT=1800.07 T1=1800.4	SAT (TO) f=3981 TT=1800.15 T1=1800.4	SAT (TO) f=335 TT=1800.1 T1=1800.4	? TT=69.238	SAT (TO) f=873 TT=1800.18 T1=217.28	SAT (TO) f=600 TT=1801.37 T1=3.29	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_10.opb.PB06.opb	SAT f=366 TT=1800.13 T1=1800.5	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT (TO) f=6059 TT=1800.13 T1=1800.4	SAT (TO) f=3554 TT=1800.16 T1=1800.3	SAT (TO) f=366 TT=1800.13 T1=1800.5	? TT=69.553	SAT (TO) f=828 TT=1800.08 T1=14.28	SAT (TO) f=1258 TT=1800.04 T1=4.22	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_11.opb.PB06.opb	SAT f=378 TT=1800.06 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=5918 TT=1800.06 T1=1800.4	SAT (TO) f=4386 TT=1800.13 T1=1800.4	SAT (TO) f=378 TT=1800.06 T1=1800.4	? TT=69.328	SAT (TO) f=658 TT=1800.05 T1=4.35	SAT (TO) f=835 TT=1800.05 T1=3.11	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_12.opb.PB06.opb	SAT f=381 TT=1800.13 T1=1800.4	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT (TO) f=5448 TT=1800.08 T1=1800.4	SAT (TO) f=3947 TT=1800.11 T1=1800.3	SAT (TO) f=381 TT=1800.13 T1=1800.4	? TT=70.218	SAT (TO) f=822 TT=1800.06 T1=45.69	SAT (TO) f=757 TT=1800.72 T1=3.32	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_13.opb.PB06.opb	SAT f=319 TT=1800.08 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT (TO) f=5966 TT=1800.05 T1=1800.4	SAT (TO) f=3650 TT=1800.12 T1=1800.4	SAT (TO) f=319 TT=1800.08 T1=1800.4	? TT=69.505	SAT (TO) f=1319 TT=1800.87 T1=4.66	SAT (TO) f=825 TT=1800.05 T1=2.98	? (TO) TT=1800.05
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_14.opb.PB06.opb	SAT f=332 TT=1800.09 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=5987 TT=1800.06 T1=1800.4	SAT (TO) f=4833 TT=1800.07 T1=1800.4	SAT (TO) f=332 TT=1800.09 T1=1800.4	? TT=68.864	SAT (TO) f=883 TT=1800.06 T1=8.8	SAT (TO) f=794 TT=1800 T1=99.63	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_1.opb.PB06.opb	SAT f=294 TT=1800.14 T1=1800.4	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT (TO) f=6073 TT=1800.16 T1=1800.4	SAT (TO) f=4096 TT=1800.06 T1=1800.4	SAT (TO) f=294 TT=1800.14 T1=1800.4	? TT=68.886	SAT (TO) f=858 TT=1800.08 T1=4.75	SAT (TO) f=809 TT=1800.55 T1=12.57	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_2.opb.PB06.opb	SAT f=416 TT=1800.11 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=5976 TT=1800.12 T1=1800.4	SAT (TO) f=4225 TT=1800.07 T1=1800.4	SAT (TO) f=416 TT=1800.11 T1=1800.4	? TT=68.987	SAT (TO) f=675 TT=1800.03 T1=14.27	SAT (TO) f=1017 TT=1800.04 T1=37.66	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_3.opb.PB06.opb	SAT f=312 TT=1800.03 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=6255 TT=1800.05 T1=1800.4	SAT (TO) f=4117 TT=1800.12 T1=1800.4	SAT (TO) f=312 TT=1800.03 T1=1800.3	? TT=69.112	SAT (TO) f=770 TT=1800.8 T1=6.33	SAT (TO) f=495 TT=1800.07 T1=3.35	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_4.opb.PB06.opb	SAT f=323 TT=1800.07 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=6061 TT=1800.04 T1=1800.4	SAT (TO) f=3693 TT=1800.12 T1=1800.3	SAT (TO) f=323 TT=1800.07 T1=1800.4	? TT=68.754	SAT (TO) f=1147 TT=1800.05 T1=6.56	SAT (TO) f=949 TT=1800.62 T1=296.9	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_5.opb.PB06.opb	SAT f=343 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=6209 TT=1800.12 T1=1800.6	SAT (TO) f=3342 TT=1800.12 T1=1800.3	SAT (TO) f=343 TT=1800.02 T1=1800.3	? TT=69.214	SAT (TO) f=776 TT=1800.82 T1=4.17	SAT (TO) f=851 TT=1800.02 T1=84.72	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_6.opb.PB06.opb	SAT f=375 TT=1800.03 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=6018 TT=1800.09 T1=1800.4	SAT (TO) f=3879 TT=1800.11 T1=1800.4	SAT (TO) f=375 TT=1800.03 T1=1800.3	? TT=69.57	SAT (TO) f=736 TT=1800.11 T1=4.73	SAT (TO) f=618 TT=1800.8 T1=4.03	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_7.opb.PB06.opb	SAT f=296 TT=1800.08 T1=1800.3	? (TO) TT=1800.16	? (TO) TT=1800.03	SAT (TO) f=5729 TT=1800.07 T1=1800.4	SAT (TO) f=4298 TT=1800.1 T1=1800.4	SAT (TO) f=296 TT=1800.08 T1=1800.3	? TT=68.791	SAT (TO) f=922 TT=1800.18 T1=7.07	SAT (TO) f=594 TT=1800.58 T1=3.29	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_8.opb.PB06.opb	SAT f=304 TT=1800.03 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=5718 TT=1800.15 T1=1800.5	SAT (TO) f=3716 TT=1800.17 T1=1800.3	SAT (TO) f=304 TT=1800.03 T1=1800.4	? TT=69.202	SAT (TO) f=977 TT=1800.73 T1=36.86	SAT (TO) f=660 TT=1800.08 T1=3.28	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/liu/wnq/ normalized-wnq_n100_mw99_9.opb.PB06.opb	SAT f=336 TT=1800.16 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT (TO) f=6059 TT=1800.24 T1=1800.4	SAT (TO) f=3751 TT=1800.1 T1=1800.4	SAT (TO) f=336 TT=1800.16 T1=1800.4	? TT=73.79	SAT (TO) f=750 TT=1800.18 T1=5.32	SAT (TO) f=1031 TT=1800.67 T1=4.2	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_10.opb	OPT f=55 TT=467.8 T1=366.23	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=60 TT=1800.09 T1=1800.4	SAT (TO) f=67 TT=1800.06 T1=1800.4	SAT (TO) f=99 TT=1800.11 T1=1800.4	SAT (TO) f=60 TT=1800.07 T1=1800.4	OPT f=55 TT=1267.25 T1=404.18	OPT f=55 TT=467.8 T1=366.23	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_11.opb	SAT f=72 TT=1800.68 T1=858.78	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=89 TT=1800.08 T1=1800.4	SAT (TO) f=100 TT=1800.09 T1=1800.4	SAT (TO) f=182 TT=1800.07 T1=1800.3	SAT (TO) f=84 TT=1800.1 T1=1800.5	SAT (TO) f=76 TT=1800.01 T1=104.64	SAT (TO) f=72 TT=1800.68 T1=858.78	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_12.opb	SAT f=99 TT=1800.03 T1=234.34	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=105 TT=1800.06 T1=1800.4	SAT (TO) f=124 TT=1800.09 T1=1800.4	SAT (TO) f=134 TT=1800.01 T1=1800.4	SAT (TO) f=115 TT=1800.09 T1=1800.5	SAT (TO) f=99 TT=1800.18 T1=234.34	SAT (TO) f=99 TT=1800.03 T1=1756.9	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_13.opb	SAT f=125 TT=1800.59 T1=1387.22	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT (TO) f=195 TT=1800.06 T1=1800.4	SAT (TO) f=149 TT=1800.06 T1=1800.5	SAT (TO) f=126 TT=1800.81 T1=868.95	SAT (TO) f=125 TT=1800.59 T1=1387.22	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_14.opb	SAT f=154 TT=1800.03 T1=1379.22	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT (TO) f=216 TT=1800.04 T1=1800.5	SAT (TO) f=216 TT=1800.09 T1=1800.5	SAT (TO) f=178 TT=1800.12 T1=366.57	SAT (TO) f=154 TT=1800.03 T1=1379.22	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_15.opb	SAT f=197 TT=1800.06 T1=743.74	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT (TO) f=224 TT=1800.14 T1=1800.5	SAT (TO) f=224 TT=1800.14 T1=1800.5	SAT (TO) f=198 TT=1800.12 T1=291.07	SAT (TO) f=197 TT=1800.06 T1=743.74	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_16.opb	SAT f=235 TT=1800.01 T1=469.97	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1801.06	SAT (TO) f=235 TT=1800.01 T1=469.97	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_17.opb	SAT f=282 TT=1800.73 T1=918.82	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.37	? (TO) TT=1800.53	? (TO) TT=1800.89	SAT (TO) f=282 TT=1800.73 T1=918.82	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_18.opb	SAT f=322 TT=1800.92 T1=1480.65	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.24	? (MO) TT=61.906	? (MO) TT=61.698	? (TO) TT=1800.06	SAT (TO) f=322 TT=1800.92 T1=1480.65	? (TO) TT=1800.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_19.opb	SAT f=360 TT=1800.67 T1=1280.32	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.45	? (MO) TT=61.205	? (MO) TT=61.002	? (TO) TT=1800.03	SAT (TO) f=360 TT=1800.67 T1=1280.32	? (TO) TT=1800.09
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_20.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=675.673	? TT=52.533	? TT=55.768	? (TO) TT=1800.09	? (TO) TT=1800.64	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_4.opb	OPT f=6 TT=0.007 T1=0	OPT f=6 TT=0.021 T1=0.02	OPT f=6 TT=0.013 T1=0.01	OPT f=6 TT=0.019 T1=0.01	OPT f=6 TT=0.071 T1=0.07	OPT f=6 TT=0.007 T1=0	OPT f=6 TT=0.008 T1=0	OPT f=6 TT=0.183 T1=0.65	OPT f=6 TT=0.195 T1=0.16	OPT f=6 TT=0.019 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_5.opb	OPT f=11 TT=0.014 T1=0.01	OPT f=11 TT=0.025 T1=0.02	OPT f=11 TT=0.014 T1=0.01	OPT f=11 TT=0.085 T1=0.09	OPT f=11 TT=0.308 T1=0.3	OPT f=11 TT=0.039 T1=0.04	OPT f=11 TT=0.047 T1=0.04	OPT f=11 TT=0.603 T1=0.68	OPT f=11 TT=0.264 T1=0.19	OPT f=11 TT=0.035 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_6.opb	OPT f=17 TT=0.032 T1=0.03	OPT f=17 TT=0.051 T1=0.05	OPT f=17 TT=0.032 T1=0.03	OPT f=17 TT=0.285 T1=0.28	OPT f=17 TT=1.368 T1=1.36	OPT f=17 TT=0.321 T1=0.32	OPT f=17 TT=0.288 T1=0.28	OPT f=17 TT=1.704 T1=1.74	OPT f=17 TT=0.584 T1=0.3	OPT f=17 TT=0.144 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_7.opb	OPT f=25 TT=0.436 T1=0.43	OPT f=25 TT=0.436 T1=0.43	OPT f=25 TT=0.447 T1=0.44	OPT f=25 TT=2.748 T1=2.74	OPT f=25 TT=7.242 T1=7.23	OPT f=25 TT=6.501 T1=6.49	OPT f=25 TT=6.321 T1=6.32	OPT f=25 TT=3.205 T1=4.31	OPT f=25 TT=1.064 T1=0.64	OPT f=25 TT=2.383 T1=1.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_8.opb	OPT f=34 TT=6.205 T1=5.23	OPT f=34 TT=16.09 T1=16.09	OPT f=34 TT=11.392 T1=11.39	OPT f=34 TT=13.338 T1=13.33	OPT f=34 TT=186.245 T1=186.25	OPT f=34 TT=143.192 T1=143.23	OPT f=34 TT=88.946 T1=88.95	OPT f=34 TT=14.472 T1=5.39	OPT f=34 TT=6.205 T1=5.23	OPT f=34 TT=25.233 T1=16.55
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_9.opb	OPT f=44 TT=58.5 T1=54.52	OPT f=44 TT=365.834 T1=365.89	OPT f=44 TT=424.123 T1=424.18	OPT f=44 TT=371.011 T1=371.06	OPT f=44 TT=1138.78 T1=1138.98	SAT (TO) f=96 TT=1800.07 T1=1800.4	OPT f=44 TT=1590.16 T1=1590.39	OPT f=44 TT=128.016 T1=54.52	OPT f=44 TT=58.5 T1=55.75	OPT f=44 TT=544.013 T1=544.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_10.opb	OPT f=55 TT=355.42 T1=127.27	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=60 TT=1800.11 T1=1800.4	SAT (TO) f=73 TT=1800.05 T1=1800.4	SAT (TO) f=96 TT=1800.06 T1=1800.4	? (TO) TT=1800.11	OPT f=55 TT=1794.48 T1=826.29	OPT f=55 TT=355.42 T1=127.27	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_11.opb	SAT f=74 TT=1800.09 T1=1597.89	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=90 TT=1800.07 T1=1800.4	SAT (TO) f=81 TT=1800.09 T1=1800.4	SAT (TO) f=127 TT=1800.1 T1=1800.5	? (TO) TT=1800.04	SAT (TO) f=76 TT=1800.86 T1=732.53	SAT (TO) f=74 TT=1800.09 T1=1597.89	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_12.opb	SAT f=99 TT=1800.66 T1=1565.38	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT (TO) f=108 TT=1800.08 T1=1800.4	SAT (TO) f=160 TT=1800.09 T1=1800.4	SAT (TO) f=157 TT=1800.09 T1=1800.5	? (TO) TT=1800.05	SAT (TO) f=101 TT=1800.92 T1=391.41	SAT (TO) f=99 TT=1800.66 T1=1565.38	? (TO) TT=1800.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_13.opb	SAT f=122 TT=1800.17 T1=752.6	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT (TO) f=164 TT=1800.09 T1=1800.5	? (TO) TT=1800.09	SAT (TO) f=122 TT=1800.17 T1=752.6	SAT (TO) f=128 TT=1800.02 T1=1307.72	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_14.opb	SAT f=151 TT=1800.8 T1=748.49	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT (TO) f=242 TT=1800.13 T1=1800.3	? (TO) TT=1800.12	SAT (TO) f=151 TT=1800.8 T1=748.49	SAT (TO) f=157 TT=1800.69 T1=1551.83	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_15.opb	SAT f=181 TT=1800.02 T1=1370.59	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT (TO) f=224 TT=1800.16 T1=1800.5	? (TO) TT=1800.18	SAT (TO) f=201 TT=1800.17 T1=796.93	SAT (TO) f=181 TT=1800.02 T1=1370.59	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_16.opb	SAT f=233 TT=1800.06 T1=1318.24	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT (TO) f=245 TT=1800.07 T1=1800.4	? (TO) TT=1800.23	? (TO) TT=1800.25	? (TO) TT=1800.26	SAT (TO) f=279 TT=1800.16 T1=249.78	SAT (TO) f=233 TT=1800.06 T1=1318.24	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_17.opb	SAT f=281 TT=1800.59 T1=444.48	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.23	? (MO) TT=63.218	? (MO) TT=62.719	SAT (TO) f=286 TT=1800.02 T1=785.85	SAT (TO) f=281 TT=1800.59 T1=444.48	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_18.opb	SAT f=319 TT=1800.06 T1=597.83	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.34	? (MO) TT=48.114	? (MO) TT=60.009	SAT (TO) f=319 TT=1800.06 T1=597.83	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_19.opb	SAT f=359 TT=1800.07 T1=362.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.55	? (MO) TT=60.288	? (MO) TT=61.114	SAT (TO) f=359 TT=1800.07 T1=362.03	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_20.opb		? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=691.732	? TT=52.528	? TT=52.831	? (TO) TT=1800.03	? (TO) TT=1800.68	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_4.opb	OPT f=6 TT=0.01 T1=0.01	OPT f=6 TT=0.023 T1=0.02	OPT f=6 TT=0.013 T1=0.01	OPT f=6 TT=0.021 T1=0.02	OPT f=6 TT=0.145 T1=0.14	OPT f=6 TT=0.01 T1=0.01	OPT f=6 TT=0.038 T1=0.03	OPT f=6 TT=0.283 T1=1.15	OPT f=6 TT=0.223 T1=0.17	OPT f=6 TT=0.025 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_5.opb	OPT f=11 TT=0.017 T1=0.02	OPT f=11 TT=0.027 T1=0.02	OPT f=11 TT=0.017 T1=0.02	OPT f=11 TT=0.088 T1=0.08	OPT f=11 TT=0.339 T1=0.33	OPT f=11 TT=0.069 T1=0.07	OPT f=11 TT=0.204 T1=0.2	OPT f=11 TT=0.648 T1=1.69	OPT f=11 TT=0.335 T1=0.2	OPT f=11 TT=0.046 T1=0.03
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_6.opb	OPT f=17 TT=0.055 T1=0.05	OPT f=17 TT=0.08 T1=0.07	OPT f=17 TT=0.055 T1=0.05	OPT f=17 TT=0.539 T1=0.53	OPT f=17 TT=1.727 T1=1.72	OPT f=17 TT=0.75 T1=0.74	OPT f=17 TT=1.511 T1=1.51	OPT f=17 TT=2.654 T1=1.76	OPT f=17 TT=0.654 T1=0.32	OPT f=17 TT=0.285 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_7.opb	OPT f=25 TT=0.532 T1=0.53	OPT f=25 TT=0.923 T1=0.92	OPT f=25 TT=0.532 T1=0.53	OPT f=25 TT=3.955 T1=4.05	OPT f=25 TT=11.05 T1=11.04	OPT f=25 TT=13.247 T1=13.25	OPT f=25 TT=16.155 T1=16.15	OPT f=25 TT=4.203 T1=2.31	OPT f=25 TT=1.404 T1=0.84	OPT f=25 TT=2.93 T1=2.87
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_8.opb	OPT f=34 TT=7.254 T1=3.49	OPT f=34 TT=26.795 T1=26.79	OPT f=34 TT=12.294 T1=12.29	OPT f=34 TT=14.806 T1=14.8	OPT f=34 TT=405.621 T1=405.71	OPT f=34 TT=238.428 T1=238.45	OPT f=34 TT=271.932 T1=271.96	OPT f=34 TT=13.131 T1=3.49	OPT f=34 TT=7.254 T1=3.99	OPT f=34 TT=40.858 T1=40.8
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_9.opb	OPT f=44 TT=54.85 T1=31.05	OPT f=44 TT=842.485 T1=842.61	OPT f=44 TT=412.526 T1=412.59	OPT f=44 TT=575.428 T1=575.5	SAT (TO) f=44 TT=1800.09 T1=1800.4	SAT (TO) f=80 TT=1800.07 T1=1800.4	? (TO) TT=1800.07	OPT f=44 TT=113.168 T1=34.05	OPT f=44 TT=54.85 T1=31.05	OPT f=44 TT=738.875 T1=654.67
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.02.opb	OPT f=44 TT=4.98 T1=4.97	OPT f=44 TT=15.029 T1=15.01	OPT f=44 TT=9.158 T1=9.15	OPT f=44 TT=10.012 T1=10	OPT f=44 TT=9.072 T1=9.06	OPT f=44 TT=4.98 T1=4.97	OPT f=44 TT=6.055 T1=6.05	OPT f=44 TT=1329.97 T1=610.86	SAT (TO) f=60 TT=1800.09 T1=9.51	OPT f=44 TT=25.063 T1=24.96
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.07.opb	OPT f=37 TT=4.742 T1=4.73	OPT f=37 TT=9.717 T1=9.7	OPT f=37 TT=11.804 T1=11.79	OPT f=37 TT=8.829 T1=8.81	OPT f=37 TT=9.128 T1=9.12	OPT f=37 TT=4.742 T1=4.73	OPT f=37 TT=5.483 T1=5.47	OPT f=37 TT=639.627 T1=25.97	SAT (TO) f=37 TT=1800.09 T1=18.32	OPT f=37 TT=21.136 T1=21.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.10.opb	OPT f=49 TT=7.151 T1=7.13	OPT f=49 TT=64.39 T1=64.38	OPT f=49 TT=14.17 T1=14.16	OPT f=49 TT=14.069 T1=14.05	OPT f=49 TT=13.667 T1=13.66	OPT f=49 TT=7.151 T1=7.13	OPT f=49 TT=8.632 T1=8.65	SAT (TO) f=50 TT=1800.03 T1=608.83	SAT (TO) f=60 TT=1800.04 T1=43.93	OPT f=49 TT=31.241 T1=28.8
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.11.opb	OPT f=38 TT=5.721 T1=5.71	OPT f=38 TT=363.146 T1=363.19	OPT f=38 TT=147.681 T1=147.7	OPT f=38 TT=12.368 T1=12.36	OPT f=38 TT=9.172 T1=9.17	OPT f=38 TT=5.721 T1=5.71	OPT f=38 TT=8.085 T1=8.07	SAT (TO) f=40 TT=1800.12 T1=748.16	SAT (TO) f=41 TT=1800.76 T1=192.71	OPT f=38 TT=35.261 T1=35.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.12.opb	OPT f=41 TT=5.853 T1=5.84	OPT f=41 TT=11.428 T1=11.42	OPT f=41 TT=8.846 T1=8.84	OPT f=41 TT=10.484 T1=10.47	OPT f=41 TT=10.514 T1=10.51	OPT f=41 TT=5.853 T1=5.84	OPT f=41 TT=6.471 T1=6.45	OPT f=41 TT=93.449 T1=53.55	SAT (TO) f=41 TT=1800.01 T1=1155.54	OPT f=41 TT=21.473 T1=21.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-nonunif-100_100.14.opb	OPT f=42 TT=5.513 T1=5.5	OPT f=42 TT=17.003 T1=16.99	OPT f=42 TT=19.583 T1=19.57	OPT f=42 TT=11.77 T1=11.76	OPT f=42 TT=10.068 T1=10.06	OPT f=42 TT=5.513 T1=5.5	OPT f=42 TT=6.553 T1=6.54	SAT (TO) f=43 TT=1800.73 T1=584.04	SAT (TO) f=51 TT=1800 T1=850.21	OPT f=42 TT=20.74 T1=20.3
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-unif-100_100.00.opb	OPT f=34 TT=2.634 T1=2.63	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=34 TT=7.613 T1=7.61	OPT f=34 TT=6.363 T1=6.36	OPT f=34 TT=2.634 T1=2.63	OPT f=34 TT=2.71 T1=2.7	SAT (TO) f=35 TT=1800.06 T1=344.89	SAT (TO) f=37 TT=1800.04 T1=6.27	? (TO) TT=1800.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/haplotype/ normalized-simp-unif-100_100.08.opb	OPT f=34 TT=2.81 T1=2.8	OPT f=34 TT=79.231 T1=79.25	OPT f=34 TT=12.58 T1=12.57	OPT f=34 TT=5.175 T1=5.17	OPT f=34 TT=4.412 T1=4.41	OPT f=34 TT=2.81 T1=2.8	OPT f=34 TT=2.911 T1=2.9	SAT (TO) f=35 TT=1800.99 T1=205.83	SAT (TO) f=34 TT=1800.06 T1=999.87	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=223.opb	OPT f=101 TT=0.019 T1=0.02	OPT f=101 TT=0.216 T1=0.21	OPT f=101 TT=0.086 T1=0.08	OPT f=101 TT=0.019 T1=0.02	OPT f=101 TT=0.023 T1=0.02	OPT f=101 TT=6.171 T1=6.16	OPT f=101 TT=23.938 T1=23.93	OPT f=101 TT=0.724 T1=0.67	OPT f=101 TT=0.354 T1=0.18	OPT f=101 TT=0.285 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=379.opb	OPT f=101 TT=0.017 T1=0.01	OPT f=101 TT=0.174 T1=0.17	OPT f=101 TT=0.134 T1=0.13	OPT f=101 TT=0.019 T1=0.01	OPT f=101 TT=0.017 T1=0.01	OPT f=101 TT=2.907 T1=2.89	OPT f=101 TT=17.16 T1=17.15	OPT f=101 TT=0.625 T1=0.67	OPT f=101 TT=0.334 T1=0.2	OPT f=101 TT=0.469 T1=0.43
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=409.opb	OPT f=101 TT=0.02 T1=0.01	OPT f=101 TT=0.248 T1=0.24	OPT f=101 TT=0.224 T1=0.22	OPT f=101 TT=0.02 T1=0.01	OPT f=101 TT=0.03 T1=0.03	OPT f=101 TT=5.615 T1=5.6	OPT f=101 TT=21.187 T1=21.18	OPT f=101 TT=0.493 T1=0.66	OPT f=101 TT=0.314 T1=0.19	OPT f=101 TT=0.455 T1=0.41
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=101-Q=457.opb	OPT f=101 TT=0.02 T1=0.02	OPT f=101 TT=0.108 T1=0.1	OPT f=101 TT=0.349 T1=0.34	OPT f=101 TT=0.022 T1=0.02	OPT f=101 TT=0.02 T1=0.02	OPT f=101 TT=4.036 T1=4.03	OPT f=101 TT=19.115 T1=19.11	OPT f=101 TT=0.425 T1=0.66	OPT f=101 TT=0.294 T1=0.18	OPT f=101 TT=0.459 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=107-Q=373.opb	OPT f=107 TT=0.021 T1=0.02	OPT f=107 TT=0.305 T1=0.3	OPT f=107 TT=0.261 T1=0.26	OPT f=107 TT=0.023 T1=0.02	OPT f=107 TT=0.021 T1=0.02	OPT f=107 TT=4.64 T1=4.63	OPT f=107 TT=19.075 T1=19.07	OPT f=107 TT=0.573 T1=0.66	OPT f=107 TT=0.344 T1=0.21	OPT f=107 TT=0.446 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=107-Q=503.opb	OPT f=107 TT=0.018 T1=0.01	OPT f=107 TT=0.078 T1=0.07	OPT f=107 TT=0.055 T1=0.05	OPT f=107 TT=0.019 T1=0.01	OPT f=107 TT=0.018 T1=0.01	OPT f=107 TT=2.715 T1=2.7	OPT f=107 TT=16.592 T1=16.58	OPT f=107 TT=0.273 T1=0.67	OPT f=107 TT=0.204 T1=0.14	OPT f=107 TT=0.578 T1=0.54
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=109-Q=373.opb	OPT f=109 TT=0.02 T1=0.02	OPT f=109 TT=0.351 T1=0.35	OPT f=109 TT=0.312 T1=0.31	OPT f=109 TT=0.02 T1=0.02	OPT f=109 TT=0.023 T1=0.02	OPT f=109 TT=4.566 T1=4.55	OPT f=109 TT=19.801 T1=19.8	OPT f=109 TT=0.564 T1=0.66	OPT f=109 TT=0.324 T1=0.18	OPT f=109 TT=0.428 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=109-Q=419.opb	OPT f=109 TT=0.019 T1=0.02	OPT f=109 TT=0.089 T1=0.08	OPT f=109 TT=0.056 T1=0.05	OPT f=109 TT=0.022 T1=0.02	OPT f=109 TT=0.019 T1=0.02	OPT f=109 TT=5.101 T1=5.09	OPT f=109 TT=19.643 T1=19.64	OPT f=109 TT=0.483 T1=0.67	OPT f=109 TT=0.295 T1=0.16	OPT f=109 TT=0.501 T1=0.46
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=233.opb	OPT f=113 TT=0.019 T1=0.01	OPT f=113 TT=0.199 T1=0.19	OPT f=113 TT=0.077 T1=0.07	OPT f=113 TT=0.019 T1=0.01	OPT f=113 TT=0.028 T1=0.02	OPT f=113 TT=4.639 T1=4.62	OPT f=113 TT=18.194 T1=18.19	OPT f=113 TT=0.705 T1=0.66	OPT f=113 TT=0.354 T1=0.18	OPT f=113 TT=0.318 T1=0.29
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=331.opb	OPT f=113 TT=0.02 T1=0.01	OPT f=113 TT=0.157 T1=0.15	OPT f=113 TT=0.238 T1=0.23	OPT f=113 TT=0.02 T1=0.01	OPT f=113 TT=0.029 T1=0.02	OPT f=113 TT=5.349 T1=5.33	OPT f=113 TT=19.303 T1=19.3	OPT f=113 TT=0.544 T1=0.66	OPT f=113 TT=0.323 T1=0.19	OPT f=113 TT=0.405 T1=0.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=479.opb	OPT f=113 TT=0.02 T1=0.01	OPT f=113 TT=0.04 T1=0.04	OPT f=113 TT=0.024 T1=0.02	OPT f=113 TT=0.02 T1=0.01	OPT f=113 TT=0.023 T1=0.02	OPT f=113 TT=3.554 T1=3.54	OPT f=113 TT=17.145 T1=17.15	OPT f=113 TT=0.444 T1=0.66	OPT f=113 TT=0.265 T1=0.17	OPT f=113 TT=0.643 T1=0.6
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=113-Q=521.opb	UNSAT TT=0.023	UNSAT TT=0.276	UNSAT TT=0.272	UNSAT TT=0.023	UNSAT TT=0.027	UNSAT TT=3.641	UNSAT TT=15.797	UNSAT TT=0.935	UNSAT TT=0.472	UNSAT TT=0.636
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=11-Q=283.opb	OPT f=11 TT=0.013 T1=0.01	OPT f=11 TT=0.043 T1=0.04	OPT f=11 TT=0.031 T1=0.03	OPT f=11 TT=0.017 T1=0.01	OPT f=11 TT=0.013 T1=0.01	OPT f=11 TT=2.274 T1=2.26	OPT f=11 TT=15.949 T1=15.94	OPT f=11 TT=0.404 T1=0.66	OPT f=11 TT=0.224 T1=0.16	OPT f=11 TT=0.104 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=11-Q=53.opb	OPT f=11 TT=0.01 T1=0.01	OPT f=11 TT=0.04 T1=0.04	OPT f=11 TT=0.032 T1=0.03	OPT f=11 TT=0.012 T1=0.01	OPT f=11 TT=0.01 T1=0.01	OPT f=11 TT=1.968 T1=1.95	OPT f=11 TT=14.829 T1=14.82	OPT f=11 TT=0.315 T1=0.67	OPT f=11 TT=0.243 T1=0.16	OPT f=11 TT=0.061 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=137.opb	OPT f=127 TT=0.022 T1=0.02	OPT f=127 TT=0.817 T1=0.81	OPT f=127 TT=0.323 T1=0.32	OPT f=127 TT=0.022 T1=0.02	OPT f=127 TT=0.038 T1=0.03	OPT f=127 TT=5.253 T1=5.24	OPT f=127 TT=24.882 T1=24.87	OPT f=127 TT=0.655 T1=0.66	OPT f=127 TT=0.364 T1=0.18	OPT f=127 TT=0.24 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=149.opb	OPT f=127 TT=0.021 T1=0.02	OPT f=127 TT=0.651 T1=0.65	OPT f=127 TT=0.153 T1=0.15	OPT f=127 TT=0.021 T1=0.02	OPT f=127 TT=0.022 T1=0.02	OPT f=127 TT=4.051 T1=4.03	OPT f=127 TT=21.804 T1=21.8	OPT f=127 TT=0.696 T1=0.66	OPT f=127 TT=0.384 T1=0.19	OPT f=127 TT=0.241 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=211.opb	OPT f=127 TT=0.023 T1=0.02	OPT f=127 TT=0.184 T1=0.18	OPT f=127 TT=0.289 T1=0.28	OPT f=127 TT=0.023 T1=0.02	OPT f=127 TT=0.024 T1=0.02	OPT f=127 TT=3.163 T1=3.15	OPT f=127 TT=20.7 T1=20.69	OPT f=127 TT=0.644 T1=0.66	OPT f=127 TT=0.373 T1=0.19	OPT f=127 TT=0.289 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=359.opb	OPT f=127 TT=0.019 T1=0.02	OPT f=127 TT=0.183 T1=0.18	OPT f=127 TT=0.154 T1=0.15	OPT f=127 TT=0.021 T1=0.02	OPT f=127 TT=0.019 T1=0.02	OPT f=127 TT=4.845 T1=4.83	OPT f=127 TT=20.394 T1=20.38	OPT f=127 TT=0.574 T1=0.66	OPT f=127 TT=0.304 T1=0.16	OPT f=127 TT=0.46 T1=0.43
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=389.opb	OPT f=127 TT=0.023 T1=0.02	OPT f=127 TT=0.41 T1=0.41	OPT f=127 TT=0.396 T1=0.39	OPT f=127 TT=0.023 T1=0.02	OPT f=127 TT=0.029 T1=0.03	OPT f=127 TT=2.242 T1=2.23	OPT f=127 TT=17.846 T1=17.84	OPT f=127 TT=0.455 T1=0.66	OPT f=127 TT=0.274 T1=0.17	OPT f=127 TT=0.641 T1=0.59
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=487.opb	OPT f=127 TT=0.017 T1=0.01	OPT f=127 TT=0.125 T1=0.12	OPT f=127 TT=0.117 T1=0.11	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.017 T1=0.01	OPT f=127 TT=3.081 T1=3.07	OPT f=127 TT=16.401 T1=16.39	OPT f=127 TT=0.304 T1=0.66	OPT f=127 TT=0.224 T1=0.15	OPT f=127 TT=0.62 T1=0.58
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=491.opb	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.236 T1=0.23	OPT f=127 TT=0.22 T1=0.22	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.028 T1=0.02	OPT f=127 TT=3.351 T1=3.34	OPT f=127 TT=15.688 T1=15.68	OPT f=127 TT=0.235 T1=0.66	OPT f=127 TT=0.224 T1=0.15	OPT f=127 TT=0.675 T1=0.63
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=127-Q=499.opb	OPT f=127 TT=0.015 T1=0.01	OPT f=127 TT=0.298 T1=0.29	OPT f=127 TT=0.303 T1=0.3	OPT f=127 TT=0.02 T1=0.01	OPT f=127 TT=0.015 T1=0.01	OPT f=127 TT=3.221 T1=3.21	OPT f=127 TT=16.715 T1=16.71	OPT f=127 TT=0.234 T1=0.66	OPT f=127 TT=0.224 T1=0.15	OPT f=127 TT=0.64 T1=0.59
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=137.opb	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.22 T1=0.22	OPT f=131 TT=0.143 T1=0.14	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.022 T1=0.02	OPT f=131 TT=5.506 T1=5.49	OPT f=131 TT=19.451 T1=19.44	OPT f=131 TT=7.163 T1=1.16	OPT f=131 TT=0.444 T1=0.23	OPT f=131 TT=0.252 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=157.opb	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.26 T1=0.25	OPT f=131 TT=0.14 T1=0.14	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.028 T1=0.02	OPT f=131 TT=4.419 T1=4.4	OPT f=131 TT=17.556 T1=17.55	OPT f=131 TT=0.916 T1=0.66	OPT f=131 TT=0.454 T1=0.23	OPT f=131 TT=0.261 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=163.opb	OPT f=131 TT=0.023 T1=0.02	OPT f=131 TT=0.586 T1=0.58	OPT f=131 TT=0.465 T1=0.46	OPT f=131 TT=0.023 T1=0.02	OPT f=131 TT=0.024 T1=0.02	OPT f=131 TT=4.609 T1=4.6	OPT f=131 TT=19.108 T1=19.1	OPT f=131 TT=14.302 T1=1.16	OPT f=131 TT=0.454 T1=0.24	OPT f=131 TT=0.271 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=131-Q=277.opb	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.834 T1=0.83	OPT f=131 TT=0.844 T1=0.84	OPT f=131 TT=0.021 T1=0.02	OPT f=131 TT=0.027 T1=0.02	OPT f=131 TT=4.017 T1=4	OPT f=131 TT=17.449 T1=17.44	OPT f=131 TT=2.803 T1=0.66	OPT f=131 TT=0.444 T1=0.23	OPT f=131 TT=0.397 T1=0.34
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=139-Q=191.opb	OPT f=139 TT=0.021 T1=0.02	OPT f=139 TT=0.655 T1=0.65	OPT f=139 TT=0.306 T1=0.3	OPT f=139 TT=0.021 T1=0.02	OPT f=139 TT=0.022 T1=0.02	OPT f=139 TT=4.805 T1=4.81	OPT f=139 TT=18.988 T1=18.98	OPT f=139 TT=9.093 T1=6.22	OPT f=139 TT=0.433 T1=0.23	OPT f=139 TT=0.298 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=13-Q=179.opb	OPT f=13 TT=0.014 T1=0.01	OPT f=13 TT=0.044 T1=0.04	OPT f=13 TT=0.026 T1=0.03	OPT f=13 TT=0.016 T1=0.01	OPT f=13 TT=0.014 T1=0.01	OPT f=13 TT=3.75 T1=3.73	OPT f=13 TT=17.968 T1=17.96	OPT f=13 TT=0.412 T1=0.66	OPT f=13 TT=0.234 T1=0.16	OPT f=13 TT=0.06 T1=0.04
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=163.opb	OPT f=149 TT=0.021 T1=0.02	OPT f=149 TT=0.161 T1=0.16	OPT f=149 TT=0.12 T1=0.12	OPT f=149 TT=0.021 T1=0.02	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=5.703 T1=5.69	OPT f=149 TT=19.664 T1=19.66	OPT f=149 TT=0.874 T1=1.16	OPT f=149 TT=0.414 T1=0.22	OPT f=149 TT=0.323 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=167.opb	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.675 T1=0.67	OPT f=149 TT=0.33 T1=0.33	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.029 T1=0.03	OPT f=149 TT=5.57 T1=5.55	OPT f=149 TT=17.536 T1=17.53	OPT f=149 TT=0.965 T1=1.16	OPT f=149 TT=0.445 T1=0.22	OPT f=149 TT=0.319 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=251.opb	OPT f=149 TT=0.02 T1=0.02	OPT f=149 TT=0.141 T1=0.14	OPT f=149 TT=0.078 T1=0.07	OPT f=149 TT=0.02 T1=0.02	OPT f=149 TT=0.03 T1=0.03	OPT f=149 TT=5.399 T1=5.38	OPT f=149 TT=19.034 T1=19.02	OPT f=149 TT=0.643 T1=1.16	OPT f=149 TT=0.364 T1=0.2	OPT f=149 TT=0.418 T1=0.35
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=271.opb	OPT f=149 TT=0.021 T1=0.02	OPT f=149 TT=0.543 T1=0.54	OPT f=149 TT=0.473 T1=0.47	OPT f=149 TT=0.021 T1=0.02	OPT f=149 TT=0.028 T1=0.02	OPT f=149 TT=6.574 T1=6.56	OPT f=149 TT=22.364 T1=22.36	OPT f=149 TT=0.824 T1=0.66	OPT f=149 TT=0.434 T1=0.22	OPT f=149 TT=0.466 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=293.opb	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=0.373 T1=0.37	OPT f=149 TT=0.388 T1=0.38	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=0.024 T1=0.02	OPT f=149 TT=5.319 T1=5.3	OPT f=149 TT=20.113 T1=20.11	OPT f=149 TT=0.854 T1=0.67	OPT f=149 TT=0.414 T1=0.21	OPT f=149 TT=0.438 T1=0.37
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=397.opb	OPT f=149 TT=0.019 T1=0.01	OPT f=149 TT=0.274 T1=0.27	OPT f=149 TT=0.113 T1=0.11	OPT f=149 TT=0.019 T1=0.01	OPT f=149 TT=0.025 T1=0.02	OPT f=149 TT=5.58 T1=5.56	OPT f=149 TT=20.099 T1=20.09	OPT f=149 TT=0.756 T1=0.66	OPT f=149 TT=0.345 T1=0.18	OPT f=149 TT=0.591 T1=0.53
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=409.opb	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.365 T1=0.36	OPT f=149 TT=0.423 T1=0.42	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.025 T1=0.02	OPT f=149 TT=4.424 T1=4.41	OPT f=149 TT=19.277 T1=19.27	OPT f=149 TT=1.584 T1=0.66	OPT f=149 TT=0.394 T1=0.21	OPT f=149 TT=0.63 T1=0.58
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=487.opb	OPT f=149 TT=0.02 T1=0.02	OPT f=149 TT=0.238 T1=0.23	OPT f=149 TT=0.189 T1=0.19	OPT f=149 TT=0.02 T1=0.02	OPT f=149 TT=2.537 T1=2.53	OPT f=149 TT=2.086 T1=2.07	OPT f=149 TT=15.58 T1=15.57	OPT f=149 TT=0.554 T1=0.66	OPT f=149 TT=0.264 T1=0.17	OPT f=149 TT=0.845 T1=0.79
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=149-Q=509.opb	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=0.149 T1=0.15	OPT f=149 TT=0.211 T1=0.21	OPT f=149 TT=0.022 T1=0.02	OPT f=149 TT=2.536 T1=2.53	OPT f=149 TT=3.192 T1=3.18	OPT f=149 TT=16.364 T1=16.36	OPT f=149 TT=0.266 T1=0.66	OPT f=149 TT=0.204 T1=0.15	OPT f=149 TT=0.763 T1=0.72
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=151-Q=167.opb	OPT f=151 TT=0.023 T1=0.02	OPT f=151 TT=0.117 T1=0.11	OPT f=151 TT=0.079 T1=0.07	OPT f=151 TT=0.023 T1=0.02	OPT f=151 TT=0.026 T1=0.02	OPT f=151 TT=6.807 T1=6.8	OPT f=151 TT=19.519 T1=19.51	OPT f=151 TT=0.814 T1=1.16	OPT f=151 TT=0.424 T1=0.22	OPT f=151 TT=0.3 T1=0.24
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=157-Q=163.opb	OPT f=157 TT=0.021 T1=0.02	OPT f=157 TT=1.359 T1=1.35	OPT f=157 TT=0.356 T1=0.35	OPT f=157 TT=0.021 T1=0.02	OPT f=157 TT=0.025 T1=0.02	OPT f=157 TT=6.081 T1=6.07	OPT f=157 TT=19.275 T1=19.28	OPT f=157 TT=0.893 T1=0.66	OPT f=157 TT=0.402 T1=0.21	OPT f=157 TT=0.323 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=157-Q=181.opb	OPT f=157 TT=0.022 T1=0.02	OPT f=157 TT=0.368 T1=0.36	OPT f=157 TT=0.117 T1=0.11	OPT f=157 TT=0.022 T1=0.02	OPT f=157 TT=0.03 T1=0.03	OPT f=157 TT=5.246 T1=5.23	OPT f=157 TT=16.926 T1=16.92	OPT f=157 TT=0.784 T1=1.16	OPT f=157 TT=0.414 T1=0.21	OPT f=157 TT=0.324 T1=0.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=157-Q=373.opb	OPT f=157 TT=0.02 T1=0.01	OPT f=157 TT=0.64 T1=0.64	OPT f=157 TT=0.582 T1=0.58	OPT f=157 TT=0.02 T1=0.01	OPT f=157 TT=0.025 T1=0.02	OPT f=157 TT=4.418 T1=4.4	OPT f=157 TT=18.762 T1=18.77	OPT f=157 TT=0.624 T1=0.66	OPT f=157 TT=0.375 T1=0.22	OPT f=157 TT=0.569 T1=0.53
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=167-Q=173.opb	OPT f=167 TT=0.02 T1=0.02	OPT f=167 TT=0.172 T1=0.17	OPT f=167 TT=0.09 T1=0.09	OPT f=167 TT=0.02 T1=0.02	OPT f=167 TT=0.027 T1=0.02	OPT f=167 TT=5 T1=4.99	OPT f=167 TT=17.406 T1=17.4	OPT f=167 TT=6.813 T1=1.17	OPT f=167 TT=0.444 T1=0.22	OPT f=167 TT=0.358 T1=0.39
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=167-Q=179.opb	OPT f=167 TT=0.023 T1=0.02	OPT f=167 TT=0.252 T1=0.25	OPT f=167 TT=0.181 T1=0.18	OPT f=167 TT=0.023 T1=0.02	OPT f=167 TT=0.026 T1=0.02	OPT f=167 TT=5.569 T1=5.56	OPT f=167 TT=18.137 T1=18.13	OPT f=167 TT=0.746 T1=0.67	OPT f=167 TT=0.454 T1=0.23	OPT f=167 TT=0.344 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=167-Q=347.opb	OPT f=167 TT=0.022 T1=0.02	OPT f=167 TT=0.63 T1=0.63	OPT f=167 TT=0.24 T1=0.24	OPT f=167 TT=0.022 T1=0.02	OPT f=167 TT=0.025 T1=0.02	OPT f=167 TT=4.845 T1=4.83	OPT f=167 TT=19.582 T1=19.57	OPT f=167 TT=0.734 T1=0.66	OPT f=167 TT=0.353 T1=0.18	OPT f=167 TT=0.619 T1=0.56
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=173-Q=173.opb	OPT f=173 TT=0.021 T1=0.02	OPT f=173 TT=0.196 T1=0.19	OPT f=173 TT=0.185 T1=0.18	OPT f=173 TT=0.021 T1=0.02	OPT f=173 TT=0.028 T1=0.02	OPT f=173 TT=5.467 T1=5.45	OPT f=173 TT=18.077 T1=18.07	OPT f=173 TT=0.804 T1=0.66	OPT f=173 TT=0.464 T1=0.24	OPT f=173 TT=0.338 T1=0.29
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=173-Q=191.opb	OPT f=173 TT=0.022 T1=0.02	OPT f=173 TT=0.452 T1=0.45	OPT f=173 TT=0.392 T1=0.39	OPT f=173 TT=0.022 T1=0.02	OPT f=173 TT=0.028 T1=0.02	OPT f=173 TT=4.537 T1=4.52	OPT f=173 TT=20.218 T1=20.21	OPT f=173 TT=0.734 T1=0.66	OPT f=173 TT=0.444 T1=0.21	OPT f=173 TT=0.422 T1=0.39
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=173-Q=211.opb	OPT f=173 TT=0.026 T1=0.02	OPT f=173 TT=0.677 T1=0.67	OPT f=173 TT=0.238 T1=0.23	OPT f=173 TT=0.026 T1=0.02	OPT f=173 TT=0.028 T1=0.02	OPT f=173 TT=5.377 T1=5.37	OPT f=173 TT=18.415 T1=18.41	OPT f=173 TT=0.815 T1=1.17	OPT f=173 TT=0.415 T1=0.22	OPT f=173 TT=0.461 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=179-Q=509.opb	OPT f=179 TT=0.02 T1=0.01	OPT f=179 TT=0.067 T1=0.06	OPT f=179 TT=0.046 T1=0.04	OPT f=179 TT=0.02 T1=0.01	OPT f=179 TT=2.541 T1=2.53	OPT f=179 TT=3.823 T1=3.81	OPT f=179 TT=17.004 T1=16.99	OPT f=179 TT=0.244 T1=0.67	OPT f=179 TT=0.194 T1=0.14	OPT f=179 TT=1.04 T1=0.98
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=17-Q=347.opb	OPT f=17 TT=0.013 T1=0.01	OPT f=17 TT=0.134 T1=0.13	OPT f=17 TT=0.093 T1=0.09	OPT f=17 TT=0.017 T1=0.01	OPT f=17 TT=0.013 T1=0.01	OPT f=17 TT=2.264 T1=2.25	OPT f=17 TT=16.819 T1=16.81	OPT f=17 TT=0.624 T1=0.66	OPT f=17 TT=0.244 T1=0.16	OPT f=17 TT=0.112 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=17-Q=457.opb	OPT f=17 TT=0.015 T1=0.01	OPT f=17 TT=0.077 T1=0.07	OPT f=17 TT=0.099 T1=0.1	OPT f=17 TT=0.015 T1=0.01	OPT f=17 TT=0.018 T1=0.01	OPT f=17 TT=2.239 T1=2.22	OPT f=17 TT=17.277 T1=17.27	OPT f=17 TT=0.215 T1=0.66	OPT f=17 TT=0.194 T1=0.14	OPT f=17 TT=0.117 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=17-Q=487.opb	OPT f=17 TT=0.016 T1=0.01	OPT f=17 TT=0.211 T1=0.21	OPT f=17 TT=0.179 T1=0.17	OPT f=17 TT=0.016 T1=0.01	OPT f=17 TT=0.018 T1=0.01	OPT f=17 TT=3.666 T1=3.65	OPT f=17 TT=17.441 T1=17.43	OPT f=17 TT=0.223 T1=0.66	OPT f=17 TT=0.195 T1=0.14	OPT f=17 TT=0.099 T1=0.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=251.opb	OPT f=191 TT=0.023 T1=0.02	OPT f=191 TT=0.4 T1=0.39	OPT f=191 TT=0.135 T1=0.13	OPT f=191 TT=0.023 T1=0.02	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=3.336 T1=3.32	OPT f=191 TT=20.776 T1=20.77	OPT f=191 TT=0.884 T1=0.67	OPT f=191 TT=0.445 T1=0.23	OPT f=191 TT=0.506 T1=0.44
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=389.opb	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=0.146 T1=0.14	OPT f=191 TT=0.065 T1=0.06	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=2.536 T1=2.53	OPT f=191 TT=4.635 T1=4.62	OPT f=191 TT=18.254 T1=18.24	OPT f=191 TT=0.605 T1=0.67	OPT f=191 TT=0.304 T1=0.16	OPT f=191 TT=0.905 T1=0.84
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=449.opb	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=0.072 T1=0.07	OPT f=191 TT=0.05 T1=0.05	OPT f=191 TT=0.024 T1=0.02	OPT f=191 TT=2.539 T1=2.54	OPT f=191 TT=3.434 T1=3.42	OPT f=191 TT=17.014 T1=17.01	OPT f=191 TT=0.434 T1=0.66	OPT f=191 TT=0.232 T1=0.15	OPT f=191 TT=0.985 T1=0.92
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=191-Q=509.opb	OPT f=191 TT=0.021 T1=0.02	OPT f=191 TT=0.579 T1=0.57	OPT f=191 TT=0.57 T1=0.57	OPT f=191 TT=0.021 T1=0.02	OPT f=191 TT=2.535 T1=2.53	OPT f=191 TT=4.071 T1=4.06	OPT f=191 TT=16.792 T1=16.78	OPT f=191 TT=0.214 T1=0.66	OPT f=191 TT=0.195 T1=0.14	OPT f=191 TT=1.103 T1=1.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=197-Q=479.opb	OPT f=197 TT=0.019 T1=0.01	OPT f=197 TT=0.136 T1=0.13	OPT f=197 TT=0.346 T1=0.34	OPT f=197 TT=0.019 T1=0.01	OPT f=197 TT=2.535 T1=2.53	OPT f=197 TT=5.181 T1=5.17	OPT f=197 TT=18.528 T1=18.52	OPT f=197 TT=0.383 T1=0.66	OPT f=197 TT=0.355 T1=0.2	OPT f=197 TT=1.1 T1=1.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=211-Q=347.opb	OPT f=211 TT=0.028 T1=0.03	OPT f=211 TT=0.139 T1=0.13	OPT f=211 TT=0.078 T1=0.07	OPT f=211 TT=0.028 T1=0.03	OPT f=211 TT=2.541 T1=2.54	OPT f=211 TT=6.237 T1=6.22	OPT f=211 TT=18.968 T1=18.96	OPT f=211 TT=0.784 T1=0.66	OPT f=211 TT=0.393 T1=0.19	OPT f=211 TT=0.716 T1=0.67
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=211-Q=479.opb	OPT f=211 TT=0.022 T1=0.02	OPT f=211 TT=0.151 T1=0.15	OPT f=211 TT=0.149 T1=0.15	OPT f=211 TT=0.022 T1=0.02	OPT f=211 TT=2.546 T1=2.54	OPT f=211 TT=2.706 T1=2.69	OPT f=211 TT=15.331 T1=15.32	OPT f=211 TT=0.855 T1=0.67	OPT f=211 TT=0.254 T1=0.16	OPT f=211 TT=1.074 T1=1.01
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=263.opb	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=0.73 T1=0.73	OPT f=223 TT=0.644 T1=0.64	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=0.029 T1=0.02	OPT f=223 TT=4.771 T1=4.76	OPT f=223 TT=18.784 T1=18.78	OPT f=223 TT=0.644 T1=0.66	OPT f=223 TT=0.414 T1=0.19	OPT f=223 TT=0.59 T1=0.55
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=307.opb	OPT f=223 TT=0.022 T1=0.02	OPT f=223 TT=0.2 T1=0.2	OPT f=223 TT=0.191 T1=0.19	OPT f=223 TT=0.022 T1=0.02	OPT f=223 TT=2.537 T1=2.53	OPT f=223 TT=5.121 T1=5.11	OPT f=223 TT=17.854 T1=17.84	OPT f=223 TT=0.664 T1=0.66	OPT f=223 TT=0.394 T1=0.23	OPT f=223 TT=0.707 T1=0.73
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=347.opb	OPT f=223 TT=0.023 T1=0.02	OPT f=223 TT=0.491 T1=0.48	OPT f=223 TT=0.489 T1=0.48	OPT f=223 TT=0.023 T1=0.02	OPT f=223 TT=2.536 T1=2.53	OPT f=223 TT=6.351 T1=6.34	OPT f=223 TT=18.483 T1=18.48	OPT f=223 TT=0.794 T1=0.66	OPT f=223 TT=0.384 T1=0.2	OPT f=223 TT=0.82 T1=0.76
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=379.opb	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=0.455 T1=0.45	OPT f=223 TT=0.271 T1=0.27	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=2.549 T1=2.54	OPT f=223 TT=5.091 T1=5.14	OPT f=223 TT=19.209 T1=19.2	OPT f=223 TT=0.713 T1=0.67	OPT f=223 TT=0.384 T1=0.21	OPT f=223 TT=0.903 T1=0.84
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=383.opb	OPT f=223 TT=0.027 T1=0.02	OPT f=223 TT=0.519 T1=0.52	OPT f=223 TT=0.305 T1=0.3	OPT f=223 TT=0.027 T1=0.02	OPT f=223 TT=2.541 T1=2.54	OPT f=223 TT=4.732 T1=4.72	OPT f=223 TT=17.756 T1=17.75	OPT f=223 TT=1.746 T1=0.67	OPT f=223 TT=0.354 T1=0.18	OPT f=223 TT=0.832 T1=0.77
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=421.opb	OPT f=223 TT=0.023 T1=0.02	OPT f=223 TT=0.175 T1=0.17	OPT f=223 TT=0.175 T1=0.17	OPT f=223 TT=0.023 T1=0.02	OPT f=223 TT=2.539 T1=2.53	OPT f=223 TT=4.14 T1=4.12	OPT f=223 TT=16.282 T1=16.28	OPT f=223 TT=0.545 T1=0.66	OPT f=223 TT=0.354 T1=0.19	OPT f=223 TT=1.069 T1=1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=431.opb	OPT f=223 TT=0.022 T1=0.02	OPT f=223 TT=0.133 T1=0.13	OPT f=223 TT=0.144 T1=0.14	OPT f=223 TT=0.022 T1=0.02	OPT f=223 TT=2.541 T1=2.54	OPT f=223 TT=6.524 T1=6.51	OPT f=223 TT=19.64 T1=19.63	OPT f=223 TT=0.605 T1=0.66	OPT f=223 TT=0.354 T1=0.2	OPT f=223 TT=0.921 T1=0.86
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=223-Q=499.opb	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=0.238 T1=0.23	OPT f=223 TT=0.35 T1=0.35	OPT f=223 TT=0.024 T1=0.02	OPT f=223 TT=2.539 T1=2.53	OPT f=223 TT=2.535 T1=2.52	OPT f=223 TT=15.833 T1=15.82	OPT f=223 TT=0.283 T1=0.66	OPT f=223 TT=0.224 T1=0.15	OPT f=223 TT=1.14 T1=1.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=227-Q=383.opb	OPT f=227 TT=0.022 T1=0.02	OPT f=227 TT=0.182 T1=0.18	OPT f=227 TT=0.065 T1=0.06	OPT f=227 TT=0.022 T1=0.02	OPT f=227 TT=2.537 T1=2.53	OPT f=227 TT=5.022 T1=5.03	OPT f=227 TT=19.061 T1=19.05	OPT f=227 TT=0.643 T1=0.66	OPT f=227 TT=0.365 T1=0.2	OPT f=227 TT=0.912 T1=0.83
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=229-Q=239.opb	OPT f=229 TT=0.021 T1=0.02	OPT f=229 TT=0.219 T1=0.22	OPT f=229 TT=0.176 T1=0.17	OPT f=229 TT=0.023 T1=0.02	OPT f=229 TT=0.021 T1=0.02	OPT f=229 TT=5.011 T1=5	OPT f=229 TT=22.418 T1=22.41	OPT f=229 TT=0.725 T1=1.16	OPT f=229 TT=0.426 T1=0.19	OPT f=229 TT=0.681 T1=0.65
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=229-Q=307.opb	OPT f=229 TT=0.022 T1=0.02	OPT f=229 TT=0.375 T1=0.37	OPT f=229 TT=0.448 T1=0.44	OPT f=229 TT=0.022 T1=0.02	OPT f=229 TT=2.539 T1=2.53	OPT f=229 TT=6.3 T1=6.29	OPT f=229 TT=19.802 T1=19.79	OPT f=229 TT=0.784 T1=0.66	OPT f=229 TT=0.405 T1=0.2	OPT f=229 TT=0.832 T1=0.77
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=233-Q=347.opb	OPT f=233 TT=0.02 T1=0.01	OPT f=233 TT=0.901 T1=0.9	OPT f=233 TT=0.918 T1=0.91	OPT f=233 TT=0.02 T1=0.01	OPT f=233 TT=2.535 T1=2.53	OPT f=233 TT=5.68 T1=5.66	OPT f=233 TT=18.299 T1=18.3	OPT f=233 TT=0.753 T1=0.66	OPT f=233 TT=0.394 T1=0.21	OPT f=233 TT=0.945 T1=0.87
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=239-Q=373.opb	OPT f=239 TT=0.025 T1=0.02	OPT f=239 TT=0.22 T1=0.22	OPT f=239 TT=0.116 T1=0.11	OPT f=239 TT=0.025 T1=0.02	OPT f=239 TT=2.541 T1=2.54	OPT f=239 TT=4.713 T1=4.8	OPT f=239 TT=18.567 T1=18.56	OPT f=239 TT=0.623 T1=0.66	OPT f=239 TT=0.374 T1=0.21	OPT f=239 TT=1.062 T1=1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=239-Q=487.opb	OPT f=239 TT=0.023 T1=0.02	OPT f=239 TT=0.061 T1=0.06	OPT f=239 TT=0.064 T1=0.06	OPT f=239 TT=0.023 T1=0.02	OPT f=239 TT=2.54 T1=2.53	OPT f=239 TT=3.512 T1=3.5	OPT f=239 TT=15.964 T1=15.96	OPT f=239 TT=0.614 T1=0.66	OPT f=239 TT=0.235 T1=0.16	OPT f=239 TT=1.142 T1=1.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=23-Q=293.opb	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=0.056 T1=0.05	OPT f=23 TT=0.109 T1=0.11	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=2.513 T1=2.5	OPT f=23 TT=17.429 T1=17.42	OPT f=23 TT=0.354 T1=0.66	OPT f=23 TT=0.255 T1=0.16	OPT f=23 TT=0.155 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=23-Q=379.opb	OPT f=23 TT=0.014 T1=0.01	OPT f=23 TT=0.045 T1=0.04	OPT f=23 TT=0.135 T1=0.14	OPT f=23 TT=0.019 T1=0.01	OPT f=23 TT=0.014 T1=0.01	OPT f=23 TT=2.766 T1=2.75	OPT f=23 TT=19.53 T1=19.52	OPT f=23 TT=0.293 T1=0.68	OPT f=23 TT=0.225 T1=0.15	OPT f=23 TT=0.154 T1=0.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=23-Q=521.opb	UNSAT TT=0.02	UNSAT TT=0.316	UNSAT TT=0.309	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=4.104	UNSAT TT=18.625	UNSAT TT=0.884	UNSAT TT=0.474	UNSAT TT=0.212
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=277.opb	OPT f=251 TT=0.027 T1=0.03	OPT f=251 TT=0.228 T1=0.22	OPT f=251 TT=0.192 T1=0.19	OPT f=251 TT=0.027 T1=0.03	OPT f=251 TT=2.535 T1=2.53	OPT f=251 TT=6.23 T1=6.22	OPT f=251 TT=22.834 T1=22.82	OPT f=251 TT=0.704 T1=0.66	OPT f=251 TT=0.394 T1=0.19	OPT f=251 TT=0.807 T1=0.73
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=307.opb	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=0.437 T1=0.43	OPT f=251 TT=0.303 T1=0.3	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=2.534 T1=2.53	OPT f=251 TT=6.55 T1=6.54	OPT f=251 TT=18.66 T1=18.65	OPT f=251 TT=0.733 T1=0.66	OPT f=251 TT=0.414 T1=0.22	OPT f=251 TT=0.76 T1=0.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=331.opb	OPT f=251 TT=0.024 T1=0.02	OPT f=251 TT=0.486 T1=0.48	OPT f=251 TT=0.196 T1=0.19	OPT f=251 TT=0.024 T1=0.02	OPT f=251 TT=2.537 T1=2.53	OPT f=251 TT=5.4 T1=5.5	OPT f=251 TT=18.411 T1=18.4	OPT f=251 TT=0.733 T1=0.66	OPT f=251 TT=0.384 T1=0.2	OPT f=251 TT=0.862 T1=0.78
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=379.opb	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=0.366 T1=0.36	OPT f=251 TT=0.278 T1=0.27	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=2.539 T1=2.53	OPT f=251 TT=6.76 T1=6.74	OPT f=251 TT=20.196 T1=20.19	OPT f=251 TT=0.643 T1=0.66	OPT f=251 TT=0.344 T1=0.18	OPT f=251 TT=0.962 T1=0.9
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=251-Q=419.opb	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=0.103 T1=0.1	OPT f=251 TT=0.041 T1=0.04	OPT f=251 TT=0.023 T1=0.02	OPT f=251 TT=2.538 T1=2.53	OPT f=251 TT=4.238 T1=4.22	OPT f=251 TT=18.269 T1=18.26	OPT f=251 TT=0.543 T1=0.66	OPT f=251 TT=0.333 T1=0.19	OPT f=251 TT=1.053 T1=0.98
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=257-Q=331.opb	OPT f=257 TT=0.021 T1=0.02	OPT f=257 TT=0.881 T1=0.88	OPT f=257 TT=0.525 T1=0.52	OPT f=257 TT=0.021 T1=0.02	OPT f=257 TT=2.537 T1=2.53	OPT f=257 TT=5.327 T1=5.31	OPT f=257 TT=19.274 T1=19.27	OPT f=257 TT=2.603 T1=0.66	OPT f=257 TT=0.395 T1=0.21	OPT f=257 TT=1.008 T1=0.9
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=257-Q=449.opb	OPT f=257 TT=0.019 T1=0.01	OPT f=257 TT=0.065 T1=0.06	OPT f=257 TT=0.106 T1=0.1	OPT f=257 TT=0.019 T1=0.01	OPT f=257 TT=2.54 T1=2.54	OPT f=257 TT=3.289 T1=3.27	OPT f=257 TT=17.148 T1=17.14	OPT f=257 TT=0.554 T1=1.16	OPT f=257 TT=0.345 T1=0.19	OPT f=257 TT=1.081 T1=1.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=257-Q=503.opb	OPT f=257 TT=0.019 T1=0.01	OPT f=257 TT=0.169 T1=0.17	OPT f=257 TT=0.022 T1=0.02	OPT f=257 TT=0.019 T1=0.01	OPT f=257 TT=2.534 T1=2.53	OPT f=257 TT=2.855 T1=2.84	OPT f=257 TT=16.714 T1=16.7	OPT f=257 TT=0.694 T1=1.16	OPT f=257 TT=0.314 T1=0.18	OPT f=257 TT=1.295 T1=1.34
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=263-Q=307.opb	OPT f=263 TT=0.022 T1=0.02	OPT f=263 TT=0.257 T1=0.25	OPT f=263 TT=0.285 T1=0.28	OPT f=263 TT=0.022 T1=0.02	OPT f=263 TT=2.54 T1=2.54	OPT f=263 TT=6.582 T1=6.57	OPT f=263 TT=20.319 T1=20.31	OPT f=263 TT=2.694 T1=0.66	OPT f=263 TT=0.485 T1=0.25	OPT f=263 TT=0.834 T1=0.74
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=263-Q=367.opb	OPT f=263 TT=0.02 T1=0.02	OPT f=263 TT=0.238 T1=0.23	OPT f=263 TT=0.253 T1=0.25	OPT f=263 TT=0.02 T1=0.02	OPT f=263 TT=2.537 T1=2.53	OPT f=263 TT=6.841 T1=6.83	OPT f=263 TT=22.29 T1=22.28	OPT f=263 TT=0.835 T1=0.67	OPT f=263 TT=0.453 T1=0.23	OPT f=263 TT=0.954 T1=0.86
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=269-Q=359.opb	OPT f=269 TT=0.02 T1=0.02	OPT f=269 TT=0.512 T1=0.51	OPT f=269 TT=0.252 T1=0.25	OPT f=269 TT=0.02 T1=0.02	OPT f=269 TT=2.538 T1=2.53	OPT f=269 TT=4.553 T1=4.54	OPT f=269 TT=18.095 T1=18.09	OPT f=269 TT=1.715 T1=1.16	OPT f=269 TT=0.445 T1=0.23	OPT f=269 TT=1.088 T1=1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=269-Q=431.opb	OPT f=269 TT=0.019 T1=0.01	OPT f=269 TT=0.462 T1=0.46	OPT f=269 TT=0.567 T1=0.56	OPT f=269 TT=0.019 T1=0.01	OPT f=269 TT=2.535 T1=2.53	OPT f=269 TT=3.995 T1=3.98	OPT f=269 TT=17.915 T1=17.92	OPT f=269 TT=0.647 T1=1.16	OPT f=269 TT=0.405 T1=0.21	OPT f=269 TT=1.237 T1=1.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=269-Q=433.opb	OPT f=269 TT=0.022 T1=0.02	OPT f=269 TT=0.354 T1=0.35	OPT f=269 TT=0.102 T1=0.1	OPT f=269 TT=0.022 T1=0.02	OPT f=269 TT=2.531 T1=2.53	OPT f=269 TT=3.725 T1=3.71	OPT f=269 TT=18.769 T1=18.76	OPT f=269 TT=0.765 T1=0.67	OPT f=269 TT=0.334 T1=0.19	OPT f=269 TT=1.139 T1=1.07
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=281-Q=331.opb	OPT f=281 TT=0.02 T1=0.02	OPT f=281 TT=0.45 T1=0.45	OPT f=281 TT=0.322 T1=0.32	OPT f=281 TT=0.02 T1=0.02	OPT f=281 TT=2.538 T1=2.53	OPT f=281 TT=5.259 T1=5.24	OPT f=281 TT=19.077 T1=19.08	OPT f=281 TT=0.784 T1=0.66	OPT f=281 TT=0.395 T1=0.22	OPT f=281 TT=1.08 T1=0.99
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=281-Q=499.opb	OPT f=281 TT=0.018 T1=0.02	OPT f=281 TT=0.07 T1=0.07	OPT f=281 TT=0.066 T1=0.06	OPT f=281 TT=0.018 T1=0.02	OPT f=281 TT=2.535 T1=2.53	OPT f=281 TT=1.798 T1=1.78	OPT f=281 TT=14.255 T1=14.25	OPT f=281 TT=0.435 T1=0.67	OPT f=281 TT=0.224 T1=0.15	OPT f=281 TT=1.283 T1=1.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=283-Q=293.opb	OPT f=283 TT=0.024 T1=0.02	OPT f=283 TT=0.733 T1=0.73	OPT f=283 TT=0.466 T1=0.46	OPT f=283 TT=0.024 T1=0.02	OPT f=283 TT=2.55 T1=2.55	OPT f=283 TT=5.079 T1=5.06	OPT f=283 TT=18.28 T1=18.27	OPT f=283 TT=3.215 T1=1.16	OPT f=283 TT=0.464 T1=0.24	OPT f=283 TT=0.98 T1=0.88
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=293-Q=307.opb	OPT f=293 TT=0.021 T1=0.02	OPT f=293 TT=0.416 T1=0.41	OPT f=293 TT=0.231 T1=0.23	OPT f=293 TT=0.021 T1=0.02	OPT f=293 TT=2.553 T1=2.55	OPT f=293 TT=5.693 T1=5.68	OPT f=293 TT=19.666 T1=19.66	OPT f=293 TT=0.825 T1=1.16	OPT f=293 TT=0.404 T1=0.21	OPT f=293 TT=1.043 T1=0.99
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=163.opb	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.115 T1=0.11	OPT f=29 TT=0.054 T1=0.05	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.016 T1=0.02	OPT f=29 TT=2.661 T1=2.65	OPT f=29 TT=18.585 T1=18.58	OPT f=29 TT=0.414 T1=0.66	OPT f=29 TT=0.274 T1=0.16	OPT f=29 TT=0.086 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=277.opb	OPT f=29 TT=0.017 T1=0.01	OPT f=29 TT=0.158 T1=0.15	OPT f=29 TT=0.079 T1=0.07	OPT f=29 TT=0.02 T1=0.01	OPT f=29 TT=0.017 T1=0.01	OPT f=29 TT=2.421 T1=2.41	OPT f=29 TT=17.31 T1=17.31	OPT f=29 TT=0.434 T1=0.66	OPT f=29 TT=0.294 T1=0.17	OPT f=29 TT=0.133 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=331.opb	OPT f=29 TT=0.019 T1=0.01	OPT f=29 TT=0.217 T1=0.21	OPT f=29 TT=0.189 T1=0.2	OPT f=29 TT=0.019 T1=0.01	OPT f=29 TT=0.019 T1=0.02	OPT f=29 TT=4.2 T1=4.19	OPT f=29 TT=18.503 T1=18.5	OPT f=29 TT=0.434 T1=0.66	OPT f=29 TT=0.254 T1=0.16	OPT f=29 TT=0.156 T1=0.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=409.opb	OPT f=29 TT=0.017 T1=0.01	OPT f=29 TT=0.069 T1=0.07	OPT f=29 TT=0.052 T1=0.05	OPT f=29 TT=0.017 T1=0.01	OPT f=29 TT=0.018 T1=0.02	OPT f=29 TT=2.448 T1=2.43	OPT f=29 TT=16.626 T1=16.62	OPT f=29 TT=0.545 T1=0.66	OPT f=29 TT=0.222 T1=0.16	OPT f=29 TT=0.127 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=479.opb	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.169 T1=0.16	OPT f=29 TT=0.141 T1=0.14	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.019 T1=0.02	OPT f=29 TT=3.037 T1=3.02	OPT f=29 TT=17.996 T1=18	OPT f=29 TT=0.254 T1=0.67	OPT f=29 TT=0.194 T1=0.15	OPT f=29 TT=0.202 T1=0.19
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=521.opb	UNSAT TT=0.02	UNSAT TT=0.227	UNSAT TT=0.219	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=3.469	UNSAT TT=17.611	UNSAT TT=0.875	UNSAT TT=0.444	UNSAT TT=0.219
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=29-Q=71.opb	OPT f=29 TT=0.014 T1=0.01	OPT f=29 TT=0.125 T1=0.12	OPT f=29 TT=0.101 T1=0.1	OPT f=29 TT=0.016 T1=0.01	OPT f=29 TT=0.014 T1=0.01	OPT f=29 TT=3.052 T1=3.03	OPT f=29 TT=17.781 T1=17.77	OPT f=29 TT=0.534 T1=0.66	OPT f=29 TT=0.274 T1=0.16	OPT f=29 TT=0.065 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=307.opb	OPT f=307 TT=0.022 T1=0.02	OPT f=307 TT=0.099 T1=0.09	OPT f=307 TT=0.077 T1=0.07	OPT f=307 TT=0.022 T1=0.02	OPT f=307 TT=2.544 T1=2.54	OPT f=307 TT=5.813 T1=5.8	OPT f=307 TT=22.498 T1=22.49	OPT f=307 TT=0.865 T1=0.66	OPT f=307 TT=0.494 T1=0.25	OPT f=307 TT=0.949 T1=0.85
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=317.opb	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=0.957 T1=0.95	OPT f=307 TT=0.717 T1=0.71	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.547 T1=2.54	OPT f=307 TT=4.78 T1=4.77	OPT f=307 TT=17.403 T1=17.39	OPT f=307 TT=0.904 T1=0.68	OPT f=307 TT=0.474 T1=0.24	OPT f=307 TT=1.102 T1=1.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=331.opb	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=0.22 T1=0.21	OPT f=307 TT=0.076 T1=0.07	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.539 T1=2.53	OPT f=307 TT=4.128 T1=4.11	OPT f=307 TT=16.358 T1=16.35	OPT f=307 TT=0.684 T1=0.66	OPT f=307 TT=0.404 T1=0.21	OPT f=307 TT=0.999 T1=0.9
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=347.opb	OPT f=307 TT=0.026 T1=0.02	OPT f=307 TT=0.828 T1=0.82	OPT f=307 TT=0.81 T1=0.81	OPT f=307 TT=0.026 T1=0.02	OPT f=307 TT=2.536 T1=2.53	OPT f=307 TT=4.017 T1=4	OPT f=307 TT=17.7 T1=17.69	OPT f=307 TT=0.905 T1=1.19	OPT f=307 TT=0.434 T1=0.23	OPT f=307 TT=1.034 T1=0.94
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=367.opb	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=0.838 T1=0.84	OPT f=307 TT=0.252 T1=0.25	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.539 T1=2.53	OPT f=307 TT=3.907 T1=3.89	OPT f=307 TT=19.846 T1=19.84	OPT f=307 TT=0.784 T1=1.16	OPT f=307 TT=0.456 T1=0.23	OPT f=307 TT=1.155 T1=1.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=431.opb	OPT f=307 TT=0.023 T1=0.02	OPT f=307 TT=0.167 T1=0.16	OPT f=307 TT=0.163 T1=0.16	OPT f=307 TT=0.023 T1=0.02	OPT f=307 TT=2.548 T1=2.54	OPT f=307 TT=2.248 T1=2.23	OPT f=307 TT=15.76 T1=15.76	OPT f=307 TT=1.384 T1=0.66	OPT f=307 TT=0.305 T1=0.18	OPT f=307 TT=1.221 T1=1.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=307-Q=449.opb	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=0.4 T1=0.4	OPT f=307 TT=0.276 T1=0.27	OPT f=307 TT=0.021 T1=0.02	OPT f=307 TT=2.536 T1=2.53	OPT f=307 TT=2.306 T1=2.29	OPT f=307 TT=16.299 T1=16.29	OPT f=307 TT=0.544 T1=0.66	OPT f=307 TT=0.292 T1=0.17	OPT f=307 TT=1.303 T1=1.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=313-Q=503.opb	OPT f=313 TT=0.019 T1=0.01	OPT f=313 TT=0.153 T1=0.15	OPT f=313 TT=0.116 T1=0.11	OPT f=313 TT=0.019 T1=0.01	OPT f=313 TT=2.541 T1=2.53	OPT f=313 TT=1.94 T1=1.93	OPT f=313 TT=14.968 T1=14.96	OPT f=313 TT=0.393 T1=0.66	OPT f=313 TT=0.224 T1=0.16	OPT f=313 TT=1.268 T1=1.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=317-Q=389.opb	OPT f=317 TT=0.021 T1=0.02	OPT f=317 TT=0.399 T1=0.39	OPT f=317 TT=0.213 T1=0.21	OPT f=317 TT=0.021 T1=0.02	OPT f=317 TT=2.539 T1=2.53	OPT f=317 TT=3.161 T1=3.15	OPT f=317 TT=18.172 T1=18.16	OPT f=317 TT=0.743 T1=1.16	OPT f=317 TT=0.374 T1=0.21	OPT f=317 TT=1.156 T1=1.07
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=31-Q=439.opb	OPT f=31 TT=0.022 T1=0.02	OPT f=31 TT=0.122 T1=0.12	OPT f=31 TT=0.099 T1=0.09	OPT f=31 TT=0.022 T1=0.02	OPT f=31 TT=0.024 T1=0.02	OPT f=31 TT=4.175 T1=4.16	OPT f=31 TT=17.966 T1=17.96	OPT f=31 TT=0.315 T1=0.66	OPT f=31 TT=0.225 T1=0.15	OPT f=31 TT=0.136 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=331.opb	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=0.366 T1=0.36	OPT f=331 TT=0.159 T1=0.15	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=2.542 T1=2.54	OPT f=331 TT=4.345 T1=4.33	OPT f=331 TT=19.956 T1=19.95	OPT f=331 TT=0.844 T1=0.66	OPT f=331 TT=0.404 T1=0.21	OPT f=331 TT=1.106 T1=1.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=347.opb	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=0.729 T1=0.73	OPT f=331 TT=0.64 T1=0.63	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=2.54 T1=2.53	OPT f=331 TT=4.268 T1=4.25	OPT f=331 TT=19.869 T1=19.87	OPT f=331 TT=0.825 T1=1.16	OPT f=331 TT=0.453 T1=0.21	OPT f=331 TT=1.119 T1=1.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=359.opb	OPT f=331 TT=0.022 T1=0.02	OPT f=331 TT=0.42 T1=0.41	OPT f=331 TT=0.305 T1=0.3	OPT f=331 TT=0.022 T1=0.02	OPT f=331 TT=2.539 T1=2.53	OPT f=331 TT=2.839 T1=2.82	OPT f=331 TT=16.253 T1=16.24	OPT f=331 TT=0.763 T1=1.17	OPT f=331 TT=0.444 T1=0.22	OPT f=331 TT=1.179 T1=1.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=379.opb	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=0.171 T1=0.17	OPT f=331 TT=0.136 T1=0.13	OPT f=331 TT=0.023 T1=0.02	OPT f=331 TT=2.538 T1=2.53	OPT f=331 TT=3.356 T1=3.34	OPT f=331 TT=15.759 T1=15.75	OPT f=331 TT=0.744 T1=1.16	OPT f=331 TT=0.474 T1=0.24	OPT f=331 TT=1.191 T1=1.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=389.opb	OPT f=331 TT=0.022 T1=0.02	OPT f=331 TT=0.4 T1=0.4	OPT f=331 TT=0.354 T1=0.35	OPT f=331 TT=0.022 T1=0.02	OPT f=331 TT=2.536 T1=2.53	OPT f=331 TT=4.598 T1=4.58	OPT f=331 TT=19.442 T1=19.43	OPT f=331 TT=1.775 T1=1.17	OPT f=331 TT=0.473 T1=0.24	OPT f=331 TT=1.331 T1=1.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=331-Q=479.opb	OPT f=331 TT=0.021 T1=0.02	OPT f=331 TT=0.067 T1=0.06	OPT f=331 TT=0.031 T1=0.03	OPT f=331 TT=0.021 T1=0.02	OPT f=331 TT=2.533 T1=2.53	OPT f=331 TT=2.085 T1=2.07	OPT f=331 TT=14.639 T1=14.63	OPT f=331 TT=0.604 T1=0.66	OPT f=331 TT=0.324 T1=0.18	OPT f=331 TT=1.197 T1=1.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=379.opb	OPT f=347 TT=0.022 T1=0.02	OPT f=347 TT=0.126 T1=0.12	OPT f=347 TT=0.06 T1=0.06	OPT f=347 TT=0.022 T1=0.02	OPT f=347 TT=2.542 T1=2.54	OPT f=347 TT=2.564 T1=2.55	OPT f=347 TT=16.577 T1=16.57	OPT f=347 TT=1.863 T1=0.67	OPT f=347 TT=0.354 T1=0.21	OPT f=347 TT=1.222 T1=1.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=419.opb	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=0.187 T1=0.18	OPT f=347 TT=0.154 T1=0.15	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=2.543 T1=2.54	OPT f=347 TT=3.073 T1=3.06	OPT f=347 TT=16.15 T1=16.14	OPT f=347 TT=0.633 T1=0.66	OPT f=347 TT=0.344 T1=0.2	OPT f=347 TT=1.175 T1=1.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=421.opb	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=0.077 T1=0.07	OPT f=347 TT=0.053 T1=0.05	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=2.539 T1=2.53	OPT f=347 TT=2.482 T1=2.47	OPT f=347 TT=15.881 T1=15.87	OPT f=347 TT=0.715 T1=0.66	OPT f=347 TT=0.334 T1=0.19	OPT f=347 TT=1.299 T1=1.23
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=431.opb	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=0.181 T1=0.18	OPT f=347 TT=0.132 T1=0.13	OPT f=347 TT=0.023 T1=0.02	OPT f=347 TT=2.538 T1=2.54	OPT f=347 TT=2.415 T1=2.4	OPT f=347 TT=15.81 T1=15.8	OPT f=347 TT=0.583 T1=0.66	OPT f=347 TT=0.344 T1=0.19	OPT f=347 TT=1.214 T1=1.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=439.opb	OPT f=347 TT=0.02 T1=0.01	OPT f=347 TT=0.283 T1=0.28	OPT f=347 TT=0.243 T1=0.24	OPT f=347 TT=0.02 T1=0.01	OPT f=347 TT=2.537 T1=2.53	OPT f=347 TT=2.236 T1=2.22	OPT f=347 TT=15.604 T1=15.59	OPT f=347 TT=0.564 T1=0.66	OPT f=347 TT=0.335 T1=0.18	OPT f=347 TT=1.213 T1=1.15
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=347-Q=487.opb	OPT f=347 TT=0.022 T1=0.02	OPT f=347 TT=0.071 T1=0.07	OPT f=347 TT=0.04 T1=0.04	OPT f=347 TT=0.022 T1=0.02	OPT f=347 TT=2.534 T1=2.53	OPT f=347 TT=2.321 T1=2.31	OPT f=347 TT=15.778 T1=15.77	OPT f=347 TT=0.764 T1=0.66	OPT f=347 TT=0.235 T1=0.16	OPT f=347 TT=0.969 T1=1.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=353-Q=479.opb	OPT f=353 TT=0.018 T1=0.01	OPT f=353 TT=0.054 T1=0.05	OPT f=353 TT=0.026 T1=0.02	OPT f=353 TT=0.018 T1=0.01	OPT f=353 TT=2.536 T1=2.53	OPT f=353 TT=2.431 T1=2.42	OPT f=353 TT=15.515 T1=15.5	OPT f=353 TT=0.494 T1=0.66	OPT f=353 TT=0.274 T1=0.17	OPT f=353 TT=1.064 T1=1.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=359-Q=379.opb	OPT f=359 TT=0.023 T1=0.02	OPT f=359 TT=0.267 T1=0.26	OPT f=359 TT=0.179 T1=0.18	OPT f=359 TT=0.023 T1=0.02	OPT f=359 TT=2.541 T1=2.54	OPT f=359 TT=2.829 T1=2.81	OPT f=359 TT=16.803 T1=16.8	OPT f=359 TT=0.694 T1=1.16	OPT f=359 TT=0.375 T1=0.21	OPT f=359 TT=1.232 T1=1.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=367-Q=389.opb	OPT f=367 TT=0.022 T1=0.02	OPT f=367 TT=0.241 T1=0.24	OPT f=367 TT=0.105 T1=0.1	OPT f=367 TT=0.022 T1=0.02	OPT f=367 TT=2.54 T1=2.53	OPT f=367 TT=2.613 T1=2.6	OPT f=367 TT=15.796 T1=15.78	OPT f=367 TT=0.664 T1=0.66	OPT f=367 TT=0.382 T1=0.21	OPT f=367 TT=1.317 T1=1.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=379-Q=397.opb	OPT f=379 TT=0.022 T1=0.02	OPT f=379 TT=0.199 T1=0.19	OPT f=379 TT=0.107 T1=0.1	OPT f=379 TT=0.022 T1=0.02	OPT f=379 TT=2.536 T1=2.53	OPT f=379 TT=2.623 T1=2.61	OPT f=379 TT=16.666 T1=16.65	OPT f=379 TT=0.615 T1=0.67	OPT f=379 TT=0.354 T1=0.18	OPT f=379 TT=1.295 T1=1.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=379-Q=431.opb	OPT f=379 TT=0.022 T1=0.02	OPT f=379 TT=0.316 T1=0.31	OPT f=379 TT=0.163 T1=0.16	OPT f=379 TT=0.022 T1=0.02	OPT f=379 TT=2.551 T1=2.55	OPT f=379 TT=3.408 T1=3.39	OPT f=379 TT=17.177 T1=17.16	OPT f=379 TT=0.634 T1=0.66	OPT f=379 TT=0.325 T1=0.2	OPT f=379 TT=1.204 T1=1.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=379-Q=521.opb	UNSAT TT=0.017	UNSAT TT=0.089	UNSAT TT=0.083	UNSAT TT=0.019	UNSAT TT=0.017	UNSAT TT=2.031	UNSAT TT=10.976	UNSAT TT=0.764	UNSAT TT=0.374	UNSAT TT=0.714
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=37-Q=107.opb	OPT f=37 TT=0.015 T1=0.01	OPT f=37 TT=0.074 T1=0.07	OPT f=37 TT=0.042 T1=0.04	OPT f=37 TT=0.016 T1=0.01	OPT f=37 TT=0.015 T1=0.01	OPT f=37 TT=3.002 T1=2.99	OPT f=37 TT=16.75 T1=16.74	OPT f=37 TT=0.524 T1=0.66	OPT f=37 TT=0.274 T1=0.17	OPT f=37 TT=0.1 T1=0.08
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=37-Q=443.opb	OPT f=37 TT=0.015 T1=0.01	OPT f=37 TT=0.33 T1=0.33	OPT f=37 TT=0.105 T1=0.1	OPT f=37 TT=0.019 T1=0.01	OPT f=37 TT=0.015 T1=0.01	OPT f=37 TT=5.125 T1=5.11	OPT f=37 TT=19.827 T1=19.82	OPT f=37 TT=0.314 T1=0.66	OPT f=37 TT=0.224 T1=0.15	OPT f=37 TT=0.248 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=383-Q=509.opb	OPT f=383 TT=0.019 T1=0.01	OPT f=383 TT=0.076 T1=0.07	OPT f=383 TT=0.078 T1=0.07	OPT f=383 TT=0.019 T1=0.01	OPT f=383 TT=2.53 T1=2.52	OPT f=383 TT=2.232 T1=2.22	OPT f=383 TT=15.583 T1=15.57	OPT f=383 TT=0.215 T1=0.66	OPT f=383 TT=0.193 T1=0.15	OPT f=383 TT=0.708 T1=0.66
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=383-Q=521.opb	UNSAT TT=0.019	UNSAT TT=0.128	UNSAT TT=0.127	UNSAT TT=0.019	UNSAT TT=0.021	UNSAT TT=2.177	UNSAT TT=10.934	UNSAT TT=0.824	UNSAT TT=0.375	UNSAT TT=0.715
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=389-Q=433.opb	OPT f=389 TT=0.021 T1=0.02	OPT f=389 TT=0.165 T1=0.16	OPT f=389 TT=0.102 T1=0.1	OPT f=389 TT=0.021 T1=0.02	OPT f=389 TT=2.542 T1=2.54	OPT f=389 TT=2.627 T1=2.61	OPT f=389 TT=15.065 T1=15.05	OPT f=389 TT=0.694 T1=1.17	OPT f=389 TT=0.354 T1=0.19	OPT f=389 TT=0.987 T1=0.91
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=397-Q=449.opb	OPT f=397 TT=0.019 T1=0.01	OPT f=397 TT=0.111 T1=0.11	OPT f=397 TT=0.103 T1=0.1	OPT f=397 TT=0.019 T1=0.01	OPT f=397 TT=2.536 T1=2.53	OPT f=397 TT=2.296 T1=2.28	OPT f=397 TT=14.75 T1=14.74	OPT f=397 TT=1.833 T1=1.16	OPT f=397 TT=0.334 T1=0.19	OPT f=397 TT=0.975 T1=0.91
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=397-Q=521.opb	UNSAT TT=0.017	UNSAT TT=0.124	UNSAT TT=0.119	UNSAT TT=0.018	UNSAT TT=0.017	UNSAT TT=1.893	UNSAT TT=10.739	UNSAT TT=0.653	UNSAT TT=0.353	UNSAT TT=0.647
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=409-Q=499.opb	OPT f=409 TT=0.016 T1=0.01	OPT f=409 TT=0.044 T1=0.04	OPT f=409 TT=0.027 T1=0.02	OPT f=409 TT=0.019 T1=0.01	OPT f=409 TT=0.016 T1=0.01	OPT f=409 TT=1.942 T1=1.93	OPT f=409 TT=14.948 T1=14.94	OPT f=409 TT=0.345 T1=0.66	OPT f=409 TT=0.233 T1=0.16	OPT f=409 TT=0.711 T1=0.66
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=409-Q=509.opb	OPT f=409 TT=0.016 T1=0.01	OPT f=409 TT=0.056 T1=0.05	OPT f=409 TT=0.022 T1=0.02	OPT f=409 TT=0.017 T1=0.01	OPT f=409 TT=0.016 T1=0.01	OPT f=409 TT=1.778 T1=1.76	OPT f=409 TT=14.729 T1=14.72	OPT f=409 TT=0.256 T1=0.66	OPT f=409 TT=0.204 T1=0.15	OPT f=409 TT=0.616 T1=0.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=41-Q=347.opb	OPT f=41 TT=0.019 T1=0.01	OPT f=41 TT=0.24 T1=0.24	OPT f=41 TT=0.232 T1=0.23	OPT f=41 TT=0.019 T1=0.01	OPT f=41 TT=0.021 T1=0.02	OPT f=41 TT=3.194 T1=3.18	OPT f=41 TT=18.845 T1=18.84	OPT f=41 TT=0.554 T1=0.66	OPT f=41 TT=0.294 T1=0.17	OPT f=41 TT=0.234 T1=0.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=421-Q=449.opb	OPT f=421 TT=0.02 T1=0.01	OPT f=421 TT=0.092 T1=0.09	OPT f=421 TT=0.077 T1=0.07	OPT f=421 TT=0.02 T1=0.01	OPT f=421 TT=2.54 T1=2.54	OPT f=421 TT=2.526 T1=2.51	OPT f=421 TT=14.999 T1=14.99	OPT f=421 TT=0.803 T1=1.17	OPT f=421 TT=0.436 T1=0.23	OPT f=421 TT=0.734 T1=0.66
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=421-Q=487.opb	OPT f=421 TT=0.017 T1=0.01	OPT f=421 TT=0.104 T1=0.1	OPT f=421 TT=0.065 T1=0.06	OPT f=421 TT=0.02 T1=0.02	OPT f=421 TT=0.017 T1=0.01	OPT f=421 TT=1.787 T1=1.77	OPT f=421 TT=14.284 T1=14.28	OPT f=421 TT=1.504 T1=0.66	OPT f=421 TT=0.295 T1=0.18	OPT f=421 TT=0.695 T1=0.65
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=431-Q=503.opb	OPT f=431 TT=0.017 T1=0.01	OPT f=431 TT=0.059 T1=0.06	OPT f=431 TT=0.046 T1=0.04	OPT f=431 TT=0.02 T1=0.01	OPT f=431 TT=0.017 T1=0.01	OPT f=431 TT=1.74 T1=1.72	OPT f=431 TT=14.348 T1=14.34	OPT f=431 TT=0.494 T1=0.66	OPT f=431 TT=0.225 T1=0.15	OPT f=431 TT=0.438 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=439-Q=509.opb	OPT f=439 TT=0.018 T1=0.01	OPT f=439 TT=0.086 T1=0.08	OPT f=439 TT=0.062 T1=0.06	OPT f=439 TT=0.019 T1=0.01	OPT f=439 TT=0.018 T1=0.01	OPT f=439 TT=1.818 T1=1.8	OPT f=439 TT=14.218 T1=14.21	OPT f=439 TT=0.244 T1=0.66	OPT f=439 TT=0.194 T1=0.15	OPT f=439 TT=0.4 T1=0.37
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=43-Q=227.opb	OPT f=43 TT=0.02 T1=0.02	OPT f=43 TT=0.164 T1=0.16	OPT f=43 TT=0.059 T1=0.06	OPT f=43 TT=0.02 T1=0.02	OPT f=43 TT=0.021 T1=0.02	OPT f=43 TT=3.174 T1=3.16	OPT f=43 TT=17.543 T1=17.54	OPT f=43 TT=0.594 T1=0.66	OPT f=43 TT=0.334 T1=0.18	OPT f=43 TT=0.159 T1=0.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=443-Q=487.opb	OPT f=443 TT=0.018 T1=0.01	OPT f=443 TT=0.044 T1=0.04	OPT f=443 TT=0.032 T1=0.03	OPT f=443 TT=0.018 T1=0.01	OPT f=443 TT=0.018 T1=0.01	OPT f=443 TT=1.801 T1=1.78	OPT f=443 TT=14.211 T1=14.2	OPT f=443 TT=0.413 T1=0.66	OPT f=443 TT=0.242 T1=0.17	OPT f=443 TT=0.457 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=449-Q=479.opb	OPT f=449 TT=0.018 T1=0.01	OPT f=449 TT=0.084 T1=0.08	OPT f=449 TT=0.077 T1=0.07	OPT f=449 TT=0.018 T1=0.01	OPT f=449 TT=0.018 T1=0.01	OPT f=449 TT=1.81 T1=1.79	OPT f=449 TT=14.863 T1=14.85	OPT f=449 TT=1.664 T1=1.16	OPT f=449 TT=0.305 T1=0.18	OPT f=449 TT=0.513 T1=0.48
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=197.opb	OPT f=47 TT=0.019 T1=0.01	OPT f=47 TT=0.116 T1=0.11	OPT f=47 TT=0.106 T1=0.1	OPT f=47 TT=0.021 T1=0.02	OPT f=47 TT=0.019 T1=0.01	OPT f=47 TT=5.664 T1=5.65	OPT f=47 TT=19.372 T1=19.36	OPT f=47 TT=0.535 T1=0.66	OPT f=47 TT=0.323 T1=0.19	OPT f=47 TT=0.15 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=421.opb	OPT f=47 TT=0.021 T1=0.02	OPT f=47 TT=0.214 T1=0.21	OPT f=47 TT=0.192 T1=0.19	OPT f=47 TT=0.021 T1=0.02	OPT f=47 TT=0.027 T1=0.02	OPT f=47 TT=2.987 T1=2.97	OPT f=47 TT=17.698 T1=17.69	OPT f=47 TT=0.463 T1=0.66	OPT f=47 TT=0.274 T1=0.17	OPT f=47 TT=0.258 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=487.opb	OPT f=47 TT=0.02 T1=0.02	OPT f=47 TT=0.059 T1=0.06	OPT f=47 TT=0.202 T1=0.2	OPT f=47 TT=0.02 T1=0.02	OPT f=47 TT=0.025 T1=0.02	OPT f=47 TT=3.276 T1=3.26	OPT f=47 TT=17.285 T1=17.28	OPT f=47 TT=0.345 T1=0.66	OPT f=47 TT=0.233 T1=0.17	OPT f=47 TT=0.261 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=47-Q=71.opb	OPT f=47 TT=0.018 T1=0.01	OPT f=47 TT=0.095 T1=0.09	OPT f=47 TT=0.063 T1=0.06	OPT f=47 TT=0.018 T1=0.01	OPT f=47 TT=0.019 T1=0.01	OPT f=47 TT=3.044 T1=3.03	OPT f=47 TT=17.557 T1=17.55	OPT f=47 TT=0.585 T1=1.02	OPT f=47 TT=0.324 T1=0.19	OPT f=47 TT=0.081 T1=0.06
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=487-Q=499.opb	OPT f=487 TT=0.016 T1=0.01	OPT f=487 TT=0.041 T1=0.04	OPT f=487 TT=0.024 T1=0.02	OPT f=487 TT=0.018 T1=0.01	OPT f=487 TT=0.016 T1=0.01	OPT f=487 TT=1.676 T1=1.66	OPT f=487 TT=14.5 T1=14.49	OPT f=487 TT=0.394 T1=1.16	OPT f=487 TT=0.245 T1=0.16	OPT f=487 TT=0.185 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=487-Q=503.opb	OPT f=487 TT=0.016 T1=0.01	OPT f=487 TT=0.035 T1=0.03	OPT f=487 TT=0.024 T1=0.02	OPT f=487 TT=0.019 T1=0.01	OPT f=487 TT=0.016 T1=0.01	OPT f=487 TT=1.653 T1=1.64	OPT f=487 TT=14.271 T1=14.26	OPT f=487 TT=0.303 T1=0.66	OPT f=487 TT=0.224 T1=0.15	OPT f=487 TT=0.146 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=127.opb	OPT f=53 TT=0.017 T1=0.01	OPT f=53 TT=0.148 T1=0.14	OPT f=53 TT=0.108 T1=0.1	OPT f=53 TT=0.017 T1=0.01	OPT f=53 TT=0.02 T1=0.02	OPT f=53 TT=3.265 T1=3.25	OPT f=53 TT=17.3 T1=17.29	OPT f=53 TT=2.683 T1=0.68	OPT f=53 TT=0.304 T1=0.17	OPT f=53 TT=0.145 T1=0.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=151.opb	OPT f=53 TT=0.017 T1=0.01	OPT f=53 TT=0.081 T1=0.08	OPT f=53 TT=0.065 T1=0.06	OPT f=53 TT=0.018 T1=0.01	OPT f=53 TT=0.017 T1=0.01	OPT f=53 TT=3.278 T1=3.26	OPT f=53 TT=18.019 T1=18.01	OPT f=53 TT=0.535 T1=0.66	OPT f=53 TT=0.324 T1=0.18	OPT f=53 TT=0.153 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=191.opb	OPT f=53 TT=0.018 T1=0.01	OPT f=53 TT=0.16 T1=0.15	OPT f=53 TT=0.118 T1=0.11	OPT f=53 TT=0.018 T1=0.01	OPT f=53 TT=0.019 T1=0.01	OPT f=53 TT=4.959 T1=4.94	OPT f=53 TT=20.169 T1=20.16	OPT f=53 TT=2.124 T1=0.66	OPT f=53 TT=0.305 T1=0.18	OPT f=53 TT=0.155 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=53-Q=97.opb	OPT f=53 TT=0.02 T1=0.02	OPT f=53 TT=0.193 T1=0.19	OPT f=53 TT=0.067 T1=0.06	OPT f=53 TT=0.02 T1=0.02	OPT f=53 TT=0.024 T1=0.02	OPT f=53 TT=3.096 T1=3.08	OPT f=53 TT=17.309 T1=17.3	OPT f=53 TT=0.585 T1=0.66	OPT f=53 TT=0.334 T1=0.19	OPT f=53 TT=0.093 T1=0.06
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=131.opb	OPT f=59 TT=0.019 T1=0.02	OPT f=59 TT=0.144 T1=0.14	OPT f=59 TT=0.114 T1=0.11	OPT f=59 TT=0.02 T1=0.02	OPT f=59 TT=0.019 T1=0.02	OPT f=59 TT=3.096 T1=3.08	OPT f=59 TT=17.466 T1=17.46	OPT f=59 TT=0.615 T1=0.66	OPT f=59 TT=0.324 T1=0.19	OPT f=59 TT=0.121 T1=0.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=307.opb	OPT f=59 TT=0.023 T1=0.02	OPT f=59 TT=0.102 T1=0.1	OPT f=59 TT=0.078 T1=0.07	OPT f=59 TT=0.023 T1=0.02	OPT f=59 TT=0.024 T1=0.02	OPT f=59 TT=3.885 T1=3.87	OPT f=59 TT=19.45 T1=19.44	OPT f=59 TT=0.495 T1=0.66	OPT f=59 TT=0.275 T1=0.17	OPT f=59 TT=0.193 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=337.opb	OPT f=59 TT=0.021 T1=0.02	OPT f=59 TT=0.337 T1=0.33	OPT f=59 TT=0.267 T1=0.26	OPT f=59 TT=0.026 T1=0.02	OPT f=59 TT=0.021 T1=0.02	OPT f=59 TT=3.619 T1=3.61	OPT f=59 TT=17.6 T1=17.59	OPT f=59 TT=2.054 T1=0.66	OPT f=59 TT=0.324 T1=0.19	OPT f=59 TT=0.267 T1=0.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=419.opb	OPT f=59 TT=0.022 T1=0.02	OPT f=59 TT=0.049 T1=0.04	OPT f=59 TT=0.031 T1=0.03	OPT f=59 TT=0.022 T1=0.02	OPT f=59 TT=0.025 T1=0.02	OPT f=59 TT=2.804 T1=2.79	OPT f=59 TT=16.642 T1=16.63	OPT f=59 TT=0.384 T1=0.67	OPT f=59 TT=0.244 T1=0.16	OPT f=59 TT=0.272 T1=0.25
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=59-Q=431.opb	OPT f=59 TT=0.022 T1=0.02	OPT f=59 TT=0.048 T1=0.04	OPT f=59 TT=0.026 T1=0.02	OPT f=59 TT=0.022 T1=0.02	OPT f=59 TT=0.027 T1=0.02	OPT f=59 TT=3.392 T1=3.38	OPT f=59 TT=18.48 T1=18.47	OPT f=59 TT=1.214 T1=0.66	OPT f=59 TT=0.234 T1=0.16	OPT f=59 TT=0.262 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=5-Q=317.opb	OPT f=5 TT=0.013 T1=0.01	OPT f=5 TT=0.098 T1=0.09	OPT f=5 TT=0.079 T1=0.07	OPT f=5 TT=0.013 T1=0.01	OPT f=5 TT=0.013 T1=0.01	OPT f=5 TT=2.064 T1=2.05	OPT f=5 TT=15.816 T1=15.81	OPT f=5 TT=0.224 T1=0.66	OPT f=5 TT=0.204 T1=0.15	OPT f=5 TT=0.078 T1=0.07
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=61-Q=163.opb	OPT f=61 TT=0.018 T1=0.01	OPT f=61 TT=0.09 T1=0.09	OPT f=61 TT=0.052 T1=0.05	OPT f=61 TT=0.019 T1=0.01	OPT f=61 TT=0.018 T1=0.01	OPT f=61 TT=4.009 T1=3.99	OPT f=61 TT=21.09 T1=21.08	OPT f=61 TT=0.575 T1=0.66	OPT f=61 TT=0.324 T1=0.18	OPT f=61 TT=0.178 T1=0.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=61-Q=307.opb	OPT f=61 TT=0.019 T1=0.01	OPT f=61 TT=0.54 T1=0.54	OPT f=61 TT=0.471 T1=0.47	OPT f=61 TT=0.019 T1=0.01	OPT f=61 TT=0.022 T1=0.02	OPT f=61 TT=3.934 T1=3.92	OPT f=61 TT=18.814 T1=18.81	OPT f=61 TT=0.504 T1=0.66	OPT f=61 TT=0.274 T1=0.17	OPT f=61 TT=0.21 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=61-Q=419.opb	OPT f=61 TT=0.02 T1=0.02	OPT f=61 TT=0.165 T1=0.16	OPT f=61 TT=0.172 T1=0.17	OPT f=61 TT=0.02 T1=0.02	OPT f=61 TT=0.028 T1=0.02	OPT f=61 TT=3.407 T1=3.39	OPT f=61 TT=17.45 T1=17.44	OPT f=61 TT=0.494 T1=0.66	OPT f=61 TT=0.262 T1=0.17	OPT f=61 TT=0.306 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=67-Q=191.opb	OPT f=67 TT=0.017 T1=0.01	OPT f=67 TT=0.136 T1=0.13	OPT f=67 TT=0.111 T1=0.11	OPT f=67 TT=0.02 T1=0.02	OPT f=67 TT=0.017 T1=0.01	OPT f=67 TT=5.083 T1=5.07	OPT f=67 TT=20.314 T1=20.31	OPT f=67 TT=0.644 T1=0.66	OPT f=67 TT=0.354 T1=0.2	OPT f=67 TT=0.159 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=67-Q=223.opb	OPT f=67 TT=0.017 T1=0.01	OPT f=67 TT=0.193 T1=0.19	OPT f=67 TT=0.095 T1=0.09	OPT f=67 TT=0.022 T1=0.02	OPT f=67 TT=0.017 T1=0.01	OPT f=67 TT=5.315 T1=5.3	OPT f=67 TT=20.32 T1=20.32	OPT f=67 TT=2.858 T1=0.67	OPT f=67 TT=0.314 T1=0.19	OPT f=67 TT=0.206 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=71-Q=409.opb	OPT f=71 TT=0.018 T1=0.01	OPT f=71 TT=0.112 T1=0.11	OPT f=71 TT=0.185 T1=0.18	OPT f=71 TT=0.022 T1=0.02	OPT f=71 TT=0.018 T1=0.01	OPT f=71 TT=3.056 T1=3.04	OPT f=71 TT=17.048 T1=17.04	OPT f=71 TT=0.604 T1=0.66	OPT f=71 TT=0.324 T1=0.19	OPT f=71 TT=0.359 T1=0.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=71-Q=461.opb	OPT f=71 TT=0.018 T1=0.01	OPT f=71 TT=0.257 T1=0.25	OPT f=71 TT=0.344 T1=0.34	OPT f=71 TT=0.021 T1=0.02	OPT f=71 TT=0.018 T1=0.01	OPT f=71 TT=4.344 T1=4.33	OPT f=71 TT=17.671 T1=17.67	OPT f=71 TT=0.414 T1=0.67	OPT f=71 TT=0.224 T1=0.15	OPT f=71 TT=0.343 T1=0.31
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=71-Q=491.opb	OPT f=71 TT=0.024 T1=0.02	OPT f=71 TT=0.385 T1=0.38	OPT f=71 TT=0.35 T1=0.35	OPT f=71 TT=0.024 T1=0.02	OPT f=71 TT=0.027 T1=0.02	OPT f=71 TT=3.281 T1=3.27	OPT f=71 TT=18.063 T1=18.05	OPT f=71 TT=0.354 T1=0.66	OPT f=71 TT=0.213 T1=0.14	OPT f=71 TT=0.324 T1=0.3
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=73-Q=449.opb	OPT f=73 TT=0.02 T1=0.02	OPT f=73 TT=0.152 T1=0.15	OPT f=73 TT=0.152 T1=0.15	OPT f=73 TT=0.02 T1=0.08	OPT f=73 TT=0.021 T1=0.02	OPT f=73 TT=4.736 T1=4.72	OPT f=73 TT=18.765 T1=18.76	OPT f=73 TT=0.523 T1=0.66	OPT f=73 TT=0.242 T1=0.16	OPT f=73 TT=0.286 T1=0.26
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=137.opb	OPT f=79 TT=0.02 T1=0.02	OPT f=79 TT=0.685 T1=0.68	OPT f=79 TT=0.377 T1=0.37	OPT f=79 TT=0.02 T1=0.02	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=3.979 T1=3.96	OPT f=79 TT=19.088 T1=19.08	OPT f=79 TT=0.774 T1=0.66	OPT f=79 TT=0.333 T1=0.19	OPT f=79 TT=0.16 T1=0.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=173.opb	OPT f=79 TT=0.019 T1=0.02	OPT f=79 TT=0.194 T1=0.19	OPT f=79 TT=0.16 T1=0.16	OPT f=79 TT=0.021 T1=0.02	OPT f=79 TT=0.019 T1=0.02	OPT f=79 TT=5.725 T1=5.71	OPT f=79 TT=20.407 T1=20.4	OPT f=79 TT=7.423 T1=0.67	OPT f=79 TT=0.354 T1=0.2	OPT f=79 TT=0.208 T1=0.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=257.opb	OPT f=79 TT=0.02 T1=0.02	OPT f=79 TT=0.213 T1=0.21	OPT f=79 TT=0.172 T1=0.17	OPT f=79 TT=0.02 T1=0.02	OPT f=79 TT=0.022 T1=0.02	OPT f=79 TT=4.648 T1=4.63	OPT f=79 TT=19.627 T1=19.62	OPT f=79 TT=0.766 T1=0.66	OPT f=79 TT=0.374 T1=0.2	OPT f=79 TT=0.27 T1=0.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=79-Q=331.opb	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=0.16 T1=0.16	OPT f=79 TT=0.148 T1=0.14	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=0.023 T1=0.02	OPT f=79 TT=5.177 T1=5.16	OPT f=79 TT=20.474 T1=20.46	OPT f=79 TT=2.605 T1=0.66	OPT f=79 TT=0.354 T1=0.2	OPT f=79 TT=0.273 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=7-Q=179.opb	OPT f=7 TT=0.013 T1=0.01	OPT f=7 TT=0.053 T1=0.05	OPT f=7 TT=0.036 T1=0.03	OPT f=7 TT=0.014 T1=0.01	OPT f=7 TT=0.013 T1=0.01	OPT f=7 TT=2.162 T1=2.15	OPT f=7 TT=16.08 T1=16.07	OPT f=7 TT=0.302 T1=0.66	OPT f=7 TT=0.224 T1=0.15	OPT f=7 TT=0.052 T1=0.04
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=7-Q=223.opb	OPT f=7 TT=0.012 T1=0.01	OPT f=7 TT=0.052 T1=0.05	OPT f=7 TT=0.022 T1=0.02	OPT f=7 TT=0.013 T1=0.01	OPT f=7 TT=0.012 T1=0.01	OPT f=7 TT=2.412 T1=2.4	OPT f=7 TT=16.343 T1=16.33	OPT f=7 TT=0.404 T1=0.66	OPT f=7 TT=0.214 T1=0.15	OPT f=7 TT=0.059 T1=0.05
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=7-Q=31.opb	OPT f=1 TT=0.008 T1=0	OPT f=1 TT=0.033 T1=0.03	OPT f=1 TT=0.019 T1=0.01	OPT f=1 TT=0.008 T1=0	OPT f=1 TT=0.047 T1=0.04	OPT f=1 TT=1.559 T1=1.55	OPT f=1 TT=13.827 T1=13.82	OPT f=1 TT=0.214 T1=0.66	OPT f=1 TT=0.205 T1=0.14	OPT f=1 TT=0.026 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=197.opb	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.303 T1=0.3	OPT f=83 TT=0.199 T1=0.2	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.026 T1=0.02	OPT f=83 TT=3.651 T1=3.63	OPT f=83 TT=17.2 T1=17.19	OPT f=83 TT=0.625 T1=0.67	OPT f=83 TT=0.353 T1=0.2	OPT f=83 TT=0.235 T1=0.2
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=271.opb	OPT f=83 TT=0.018 T1=0.01	OPT f=83 TT=0.135 T1=0.13	OPT f=83 TT=0.137 T1=0.13	OPT f=83 TT=0.023 T1=0.02	OPT f=83 TT=0.018 T1=0.01	OPT f=83 TT=4.694 T1=4.68	OPT f=83 TT=18.101 T1=18.1	OPT f=83 TT=0.793 T1=0.66	OPT f=83 TT=0.313 T1=0.18	OPT f=83 TT=0.263 T1=0.24
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=367.opb	OPT f=83 TT=0.021 T1=0.02	OPT f=83 TT=0.236 T1=0.23	OPT f=83 TT=0.241 T1=0.24	OPT f=83 TT=0.024 T1=0.02	OPT f=83 TT=0.021 T1=0.02	OPT f=83 TT=3.386 T1=3.37	OPT f=83 TT=17.641 T1=17.64	OPT f=83 TT=0.613 T1=0.66	OPT f=83 TT=0.323 T1=0.18	OPT f=83 TT=0.348 T1=0.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=449.opb	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.05 T1=0.05	OPT f=83 TT=0.034 T1=0.03	OPT f=83 TT=0.022 T1=0.02	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=4.111 T1=4.1	OPT f=83 TT=18.056 T1=18.05	OPT f=83 TT=0.483 T1=0.66	OPT f=83 TT=0.264 T1=0.16	OPT f=83 TT=0.403 T1=0.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=83-Q=89.opb	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.17 T1=0.17	OPT f=83 TT=0.088 T1=0.08	OPT f=83 TT=0.019 T1=0.01	OPT f=83 TT=0.021 T1=0.02	OPT f=83 TT=3.865 T1=3.85	OPT f=83 TT=18.082 T1=18.07	OPT f=83 TT=0.684 T1=0.66	OPT f=83 TT=0.373 T1=0.2	OPT f=83 TT=0.149 T1=0.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=211.opb	OPT f=89 TT=0.02 T1=0.01	OPT f=89 TT=0.178 T1=0.17	OPT f=89 TT=0.128 T1=0.13	OPT f=89 TT=0.02 T1=0.01	OPT f=89 TT=0.023 T1=0.02	OPT f=89 TT=3.887 T1=3.88	OPT f=89 TT=18.358 T1=18.35	OPT f=89 TT=0.724 T1=0.66	OPT f=89 TT=0.365 T1=0.19	OPT f=89 TT=0.269 T1=0.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=263.opb	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.176 T1=0.17	OPT f=89 TT=0.105 T1=0.1	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=4.777 T1=4.76	OPT f=89 TT=19.201 T1=19.19	OPT f=89 TT=0.784 T1=0.66	OPT f=89 TT=0.384 T1=0.2	OPT f=89 TT=0.25 T1=0.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=293.opb	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.13 T1=0.13	OPT f=89 TT=0.067 T1=0.06	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.023 T1=0.02	OPT f=89 TT=5.191 T1=5.18	OPT f=89 TT=20.358 T1=20.35	OPT f=89 TT=0.774 T1=0.67	OPT f=89 TT=0.335 T1=0.18	OPT f=89 TT=0.305 T1=0.28
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=317.opb	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=0.226 T1=0.22	OPT f=89 TT=0.156 T1=0.15	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=0.027 T1=0.02	OPT f=89 TT=3.477 T1=3.46	OPT f=89 TT=17.867 T1=17.86	OPT f=89 TT=2.005 T1=0.67	OPT f=89 TT=0.333 T1=0.18	OPT f=89 TT=0.307 T1=0.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=347.opb	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=0.166 T1=0.16	OPT f=89 TT=0.158 T1=0.15	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=0.027 T1=0.02	OPT f=89 TT=4.106 T1=4.09	OPT f=89 TT=18.992 T1=18.99	OPT f=89 TT=0.514 T1=0.67	OPT f=89 TT=0.344 T1=0.2	OPT f=89 TT=0.382 T1=0.35
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=431.opb	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.682 T1=0.68	OPT f=89 TT=0.651 T1=0.65	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=2.851 T1=2.84	OPT f=89 TT=17.059 T1=17.06	OPT f=89 TT=1.165 T1=0.68	OPT f=89 TT=0.264 T1=0.17	OPT f=89 TT=0.436 T1=0.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=89-Q=487.opb	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.186 T1=0.18	OPT f=89 TT=0.167 T1=0.16	OPT f=89 TT=0.02 T1=0.02	OPT f=89 TT=0.021 T1=0.02	OPT f=89 TT=3.664 T1=3.65	OPT f=89 TT=18.968 T1=18.97	OPT f=89 TT=0.495 T1=0.66	OPT f=89 TT=0.235 T1=0.16	OPT f=89 TT=0.464 T1=0.43
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=331.opb	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.539 T1=0.53	OPT f=97 TT=0.253 T1=0.25	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.02 T1=0.02	OPT f=97 TT=4.304 T1=4.29	OPT f=97 TT=20.579 T1=20.58	OPT f=97 TT=0.506 T1=0.66	OPT f=97 TT=0.342 T1=0.18	OPT f=97 TT=0.358 T1=0.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=457.opb	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.141 T1=0.14	OPT f=97 TT=0.1 T1=0.1	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.022 T1=0.02	OPT f=97 TT=2.964 T1=2.95	OPT f=97 TT=16.789 T1=16.78	OPT f=97 TT=0.794 T1=0.67	OPT f=97 TT=0.314 T1=0.19	OPT f=97 TT=0.452 T1=0.42
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=479.opb	OPT f=97 TT=0.02 T1=0.01	OPT f=97 TT=0.291 T1=0.29	OPT f=97 TT=0.241 T1=0.24	OPT f=97 TT=0.02 T1=0.01	OPT f=97 TT=0.024 T1=0.02	OPT f=97 TT=6.507 T1=6.49	OPT f=97 TT=20.794 T1=20.79	OPT f=97 TT=0.664 T1=0.66	OPT f=97 TT=0.264 T1=0.17	OPT f=97 TT=0.561 T1=0.52
normalized-PB06/OPT-SMALLINT/ submitted-PB06/roussel/factor/ normalized-factor-size=9-P=97-Q=509.opb	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.189 T1=0.18	OPT f=97 TT=0.155 T1=0.15	OPT f=97 TT=0.019 T1=0.01	OPT f=97 TT=0.019 T1=0.02	OPT f=97 TT=1.834 T1=1.82	OPT f=97 TT=17.203 T1=17.2	OPT f=97 TT=0.225 T1=0.66	OPT f=97 TT=0.195 T1=0.14	OPT f=97 TT=0.557 T1=0.52
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ss97-2.opb	SAT f=939 TT=1800.07 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=12910 TT=1800.07 T1=1800.4	SAT (TO) f=939 TT=1800.07 T1=1800.4	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=1415 TT=1800.12 T1=3.14	SAT (TO) f=2622 TT=1800.99 T1=15.8	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ss97-4.opb	OPT f=813 TT=8.147 T1=8.12	? (TO) TT=1800.06	? (TO) TT=1800.02	OPT f=813 TT=72.865 T1=72.86	OPT f=813 TT=8.147 T1=8.12	OPT f=813 TT=24.91 T1=24.91	OPT f=813 TT=302.427 T1=302.47	SAT (TO) f=814 TT=1800.18 T1=643.98	SAT (TO) f=834 TT=1800.05 T1=0.46	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ss97-6.opb	OPT f=304 TT=0.011 T1=0.01	OPT f=304 TT=0.036 T1=0.03	OPT f=304 TT=0.236 T1=0.23	OPT f=304 TT=0.462 T1=0.46	OPT f=304 TT=0.237 T1=0.23	OPT f=304 TT=0.011 T1=0.01	OPT f=304 TT=0.067 T1=0.06	OPT f=304 TT=1.004 T1=1.17	SAT (TO) f=305 TT=1800.61 T1=0.18	OPT f=304 TT=0.549 T1=0.47
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ course-ass/normalized-ws97-5.opb	OPT f=2642 TT=24.6 T1=11.28	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2642 TT=1800.02 T1=1800.3	OPT f=2642 TT=763.001 T1=763.12	SAT (TO) f=10229 TT=1800.02 T1=1800.3	SAT (TO) f=2642 TT=1800.09 T1=1800.4	OPT f=2642 TT=24.6 T1=11.28	SAT (TO) f=2652 TT=1800.02 T1=151.75	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:10:4.5:0.5:100.opb	SAT f=6 TT=1800.02 T1=264.96	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=6 TT=1800.03 T1=1800.3	SAT (TO) f=29 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.02 T1=1800.3	SAT (TO) f=6 TT=1800.02 T1=1800.3	SAT (TO) f=6 TT=1800.62 T1=264.96	SAT (TO) f=12 TT=1800.03 T1=0.2	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:10:4.5:0.95:100.opb	SAT f=2 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=2 TT=1800.02 T1=1800.3	SAT (TO) f=25 TT=1800.02 T1=1800.3	SAT (TO) f=16 TT=1800.01 T1=1800.3	SAT (TO) f=4 TT=1800.02 T1=1800.3	SAT (TO) f=3 TT=1800.08 T1=1.74	SAT (TO) f=5 TT=1800.74 T1=0.23	? (TO) TT=1800.1
Bench name	Best results	cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:10:4.5:0.95:98.opb	SAT f=5 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=5 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.01 T1=1800.3	SAT (TO) f=9 TT=1800.02 T1=1800.3	SAT (TO) f=6 TT=1800.01 T1=1800.3	SAT (TO) f=6 TT=1800.74 T1=1.73	SAT (TO) f=8 TT=1800.03 T1=0.2	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:20:4.5:0.5:100.opb	SAT f=11 TT=1800.02 T1=1800.3	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=11 TT=1800.02 T1=1800.3	SAT (TO) f=47 TT=1800.02 T1=1800.3	SAT (TO) f=331 TT=1800.02 T1=1800.3	SAT (TO) f=20 TT=1800.01 T1=1800.3	SAT (TO) f=16 TT=1800.09 T1=11.28	SAT (TO) f=19 TT=1800.84 T1=0.25	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:20:4.5:0.95:100.opb	SAT f=13 TT=1800.03 T1=3.31	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=87 TT=1800.02 T1=1800.3	SAT (TO) f=60 TT=1800.01 T1=1800.3	SAT (TO) f=305 TT=1800.02 T1=1800.3	SAT (TO) f=34 TT=1800.01 T1=1800.3	SAT (TO) f=13 TT=1800.03 T1=3.31	SAT (TO) f=17 TT=1800 T1=0.26	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-10:20:4.5:0.95:98.opb	SAT f=21 TT=1800.01 T1=7.8	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT (TO) f=84 TT=1800.01 T1=1800.3	SAT (TO) f=75 TT=1800.02 T1=1800.3	SAT (TO) f=296 TT=1800.02 T1=1800.3	SAT (TO) f=38 TT=1800.02 T1=1800.3	SAT (TO) f=21 TT=1800.01 T1=7.8	SAT (TO) f=25 TT=1800.04 T1=0.26	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:30:4.5:0.5:100.opb	SAT f=51 TT=1800.84 T1=0.46	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT (TO) f=837 TT=1800.12 T1=1800.4	SAT (TO) f=456 TT=1800.06 T1=1800.4	SAT (TO) f=1673 TT=1800.02 T1=1800.3	SAT (TO) f=262 TT=1800.07 T1=1800.4	SAT (TO) f=51 TT=1801.44 T1=0.92	SAT (TO) f=51 TT=1800.84 T1=0.46	? (TO) TT=1800.01
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:30:4.5:0.95:100.opb	SAT f=69 TT=1800.06 T1=0.43	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT (TO) f=895 TT=1800.07 T1=1800.4	SAT (TO) f=317 TT=1800.08 T1=1800.4	SAT (TO) f=1469 TT=1800.02 T1=1800.3	SAT (TO) f=370 TT=1800.05 T1=1800.4	SAT (TO) f=69 TT=1800.68 T1=0.93	SAT (TO) f=69 TT=1800.06 T1=0.43	? (TO) TT=1800.02
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:30:4.5:0.95:98.opb	SAT f=87 TT=1800.05 T1=8.49	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT (TO) f=830 TT=1800.02 T1=1800.3	SAT (TO) f=404 TT=1800.09 T1=1800.4	SAT (TO) f=1435 TT=1800.02 T1=1800.3	SAT (TO) f=351 TT=1800.07 T1=1800.4	SAT (TO) f=87 TT=1800.05 T1=8.49	SAT (TO) f=88 TT=1800.09 T1=0.43	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:70:4.5:0.5:100.opb	SAT f=143 TT=1800.15 T1=354.54	? (TO) TT=1800.14	? (TO) TT=1800.04	SAT (TO) f=2274 TT=1800.09 T1=1800.4	SAT (TO) f=1058 TT=1800.04 T1=1800.4	SAT (TO) f=3750 TT=1800.02 T1=1800.3	? TT=78.268	SAT (TO) f=143 TT=1800.15 T1=354.54	SAT (TO) f=146 TT=1800.93 T1=0.63	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:70:4.5:0.95:100.opb	SAT f=135 TT=1800.06 T1=0.63	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=1846 TT=1800.08 T1=1800.4	SAT (TO) f=895 TT=1800.06 T1=1800.4	SAT (TO) f=3171 TT=1800.02 T1=1800.3	? TT=79.859	SAT (TO) f=135 TT=1800.06 T1=1.22	SAT (TO) f=135 TT=1800.7 T1=0.63	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.ps.uni-sb.de/~walser/benchmarks/ radar/normalized-30:70:4.5:0.95:98.opb	SAT f=203 TT=1800.7 T1=0.62	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT (TO) f=2304 TT=1800.09 T1=1800.4	SAT (TO) f=1329 TT=1800.07 T1=1800.4	SAT (TO) f=3379 TT=1800.1 T1=1800.4	? TT=79.398	SAT (TO) f=203 TT=1800.7 T1=1.23	SAT (TO) f=203 TT=1800.72 T1=0.62	? (TO) TT=1800.01

Statistics		cdcl-cuttingplanes OPT binary search 2016-05-01 (complete)	cdcl-cuttingplanes OPT linear search 2016-05-01 (complete)	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Open-WBO PB16 (complete)	Open-WBO-LSU PB16 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
Number of times the solver is able to give the best known answer		443	446	446	463	413	435	496	428	401
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		16	76	175	84	152	98	73	49	6