PB'10 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Industrial, subsubcategory Logic Synthesis

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Industrial, subsubcategory Logic Synthesis

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 Card (complete)
bsolo 3.2 Cl (complete)
pb_cplex 2010-06-29 (complete)
PB/CT 0.1 (complete)
PB/CT 0.1 fixed (complete)
PBPASSolver 2010-06-13 (complete)
SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)
SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
SAT4J PB Resolution 2.2.0 2010-05-26 (complete)
SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)
SCIPnone SCIP 1.2.1.2 without any LP solver (complete)
SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
wbo 1.4b (complete)
wbo 1.4b (fixed) (complete)

Bench name	Best results on this instance	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-5xp1.b.opb	OPT f=12 TT=0.94 T1=0.93	OPT f=12 TT=27.534 T1=24.39	OPT f=12 TT=26.648 T1=23.86	OPT f=12 TT=0.94 T1=0.93	SAT (TO) f=14 TT=1800.1 T1=14.19	SAT (TO) f=14 TT=1800.05 T1=14.44	? (TO) TT=1800.01	OPT f=12 TT=1561.93 T1=711.98	? (TO) TT=1803.5	SAT (TO) f=13 TT=1800.26 T1=299.09	SAT (TO) f=13 TT=1800.08 T1=1.96	SAT (TO) f=15 TT=1800.09 T1=24.79	SAT (TO) f=13 TT=1800.12 T1=2.46	OPT f=12 TT=28.283 T1=27.02	? (MO) TT=1448.23	? (MO) TT=1451.74
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-9sym.b.opb	OPT f=5 TT=0.501 T1=0.47	OPT f=5 TT=0.502 T1=0.47	OPT f=5 TT=0.501 T1=0.47	OPT f=5 TT=0.664 T1=0.64	OPT f=5 TT=123.18 T1=71.99	OPT f=5 TT=122.676 T1=71.7	? (TO) TT=1800.1	OPT f=5 TT=6.21 T1=1.33	OPT f=5 TT=22.828 T1=5.93	OPT f=5 TT=11.629 T1=1.93	OPT f=5 TT=15.894 T1=15.88	OPT f=5 TT=28.288 T1=0.79	OPT f=5 TT=26.73 T1=26.72	OPT f=5 TT=25.234 T1=25.23	OPT f=5 TT=472.548 T1=472.61	OPT f=5 TT=472.018 T1=472.08
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-alu4.b.opb	OPT f=50 TT=9.24 T1=3.77	SAT f=52 TT=1798.09 T1=190.21	SAT f=52 TT=1798.02 T1=1317.98	OPT f=50 TT=9.24 T1=5.89	SAT (TO) f=57 TT=1800.1 T1=106.62	SAT (TO) f=57 TT=1800.11 T1=107.86	? (TO) TT=1800.06	SAT (TO) f=55 TT=1800.22 T1=322.24	SAT (TO) f=57 TT=1800.58 T1=271.51	SAT (TO) f=57 TT=1800.25 T1=123.87	SAT (TO) f=50 TT=1800.09 T1=3.77	SAT (TO) f=64 TT=1800.12 T1=1611.84	SAT (TO) f=52 TT=1800.1 T1=8.51	OPT f=50 TT=19.812 T1=19.39	? (MO) TT=1312.34	? (MO) TT=1229.77
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-apex4.a.opb	OPT f=776 TT=5.573 T1=5.54	SAT f=793 TT=1798.01 T1=314.25	SAT f=792 TT=1798.02 T1=1340.3	OPT f=776 TT=5.573 T1=5.54	SAT (TO) f=823 TT=1800.13 T1=1388.06	SAT (TO) f=823 TT=1800.12 T1=1356.51	? (TO) TT=1800.03	SAT (TO) f=829 TT=1800.35 T1=1247.15	SAT (TO) f=829 TT=1800.39 T1=7.88	SAT (TO) f=829 TT=1800.27 T1=3.99	OPT f=776 TT=5.732 T1=5.63	SAT (TO) f=848 TT=1801.42 T1=6.78	OPT f=776 TT=6.083 T1=5.99	OPT f=776 TT=10.13 T1=10.01	? (MO) TT=869.374	? (MO) TT=744.184
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-bench1.pi.opb	OPT f=121 TT=2.804 T1=2.62	OPT f=121 TT=818.289 T1=814.89	OPT f=121 TT=849.55 T1=846.47	OPT f=121 TT=7.712 T1=7.58	SAT (TO) f=185 TT=1800.12 T1=0.47	SAT (TO) f=185 TT=1800.11 T1=0.45	? (TO) TT=1800	SAT (TO) f=165 TT=1800.33 T1=1073.09	SAT (TO) f=168 TT=1800.74 T1=69.39	SAT (TO) f=173 TT=1800.16 T1=1.03	SAT (TO) f=122 TT=1800.15 T1=2.23	SAT (TO) f=165 TT=1800.06 T1=5.84	OPT f=121 TT=2.914 T1=2.71	OPT f=121 TT=2.804 T1=2.62	? (MO) TT=1308.7	? (MO) TT=1235.42
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-clip.b.opb	OPT f=15 TT=0.371 T1=0.36	OPT f=15 TT=1.914 T1=1.16	OPT f=15 TT=1.894 T1=1.16	OPT f=15 TT=0.371 T1=0.36	SAT (TO) f=16 TT=1800.03 T1=1507.58	SAT (TO) f=16 TT=1800.07 T1=1516.18	? (TO) TT=1800	OPT f=15 TT=115.693 T1=25.37	OPT f=15 TT=575.294 T1=63.08	SAT (TO) f=16 TT=1800.23 T1=381.97	OPT f=15 TT=1.205 T1=1.18	SAT (TO) f=15 TT=1800.08 T1=1521.17	SAT (TO) f=16 TT=1800.03 T1=2.12	OPT f=15 TT=3.793 T1=3.77	OPT f=15 TT=199.293 T1=199.31	OPT f=15 TT=199.308 T1=199.33
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-count.b.opb	OPT f=24 TT=0.385 T1=0.38	OPT f=24 TT=1.031 T1=1.02	OPT f=24 TT=1.039 T1=1.03	OPT f=24 TT=0.385 T1=0.38	SAT (TO) f=26 TT=1800.06 T1=13.74	SAT (TO) f=26 TT=1800.11 T1=13.7	? (TO) TT=1800.09	SAT (TO) f=24 TT=1800.25 T1=542.66	? (TO) TT=1803.55	SAT (TO) f=26 TT=1800.2 T1=532.64	SAT (TO) f=25 TT=1800.11 T1=0.53	SAT (TO) f=33 TT=1800.12 T1=0.25	OPT f=24 TT=1.332 T1=1.3	OPT f=24 TT=1.365 T1=1.33	OPT f=24 TT=331.88 T1=331.95	OPT f=24 TT=323.248 T1=323.29
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-e64.b.opb	OPT f=47 TT=1.281 T1=1.19	SAT f=60 TT=1798.04 T1=18.62	SAT f=60 TT=1798.01 T1=18.62	OPT f=47 TT=1.281 T1=1.19	SAT (TO) f=61 TT=1800.07 T1=469.95	SAT (TO) f=61 TT=1800.09 T1=478.11	? (TO) TT=1800.08	SAT (TO) f=64 TT=1800.3 T1=34.68	? (TO) TT=1803.2	SAT (TO) f=61 TT=1800.17 T1=188.53	SAT (TO) f=51 TT=1800.07 T1=8.41	SAT (TO) f=63 TT=1800.04 T1=0.37	SAT (TO) f=51 TT=1800.13 T1=7.73	SAT f=53 TT=1789.23 T1=7.47	? (MO) TT=1607.91	? (MO) TT=1499.9
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-ex5.pi.opb	OPT f=65 TT=11.005 T1=8.24	SAT (TO) f=66 TT=1800.03 T1=16.73	SAT f=66 TT=1799.74 T1=16.78	OPT f=65 TT=11.005 T1=8.24	SAT (TO) f=94 TT=1800.11 T1=0.44	SAT (TO) f=94 TT=1800.11 T1=0.43	? (TO) TT=1800.01	SAT (TO) f=79 TT=1800.4 T1=275.11	SAT (TO) f=79 TT=1802.81 T1=869.47	SAT (TO) f=83 TT=1800.25 T1=1.21	SAT (TO) f=66 TT=1800.1 T1=3.35	SAT (TO) f=80 TT=1800.14 T1=20.18	SAT (TO) f=66 TT=1800.11 T1=3.72	SAT f=66 TT=1789.52 T1=3.16	? (MO) TT=1456.99	? (MO) TT=1456.6
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-exam.pi.opb	OPT f=63 TT=6.918 T1=5.36	SAT f=69 TT=1799.08 T1=338.26	SAT f=69 TT=1798.57 T1=342.46	OPT f=63 TT=6.918 T1=6.87	SAT (TO) f=105 TT=1800.09 T1=0.55	SAT (TO) f=105 TT=1800.06 T1=0.53	? (TO) TT=1800.01	SAT (TO) f=82 TT=1800.38 T1=1015.77	SAT (TO) f=87 TT=1800.42 T1=20.15	SAT (TO) f=89 TT=1800.39 T1=1.14	OPT f=63 TT=9.76 T1=7.04	SAT (TO) f=87 TT=1800.17 T1=6.11	OPT f=63 TT=13.117 T1=5.48	OPT f=63 TT=12.691 T1=5.36	? (MO) TT=1356.79	? (MO) TT=1362.4
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-f51m.b.opb	OPT f=18 TT=0.635 T1=0.58	OPT f=18 TT=23.423 T1=20.73	OPT f=18 TT=14.672 T1=12.75	OPT f=18 TT=0.635 T1=0.58	SAT (TO) f=20 TT=1800.03 T1=3.43	SAT (TO) f=20 TT=1800.11 T1=3.2	? (TO) TT=1800.04	SAT (TO) f=18 TT=1800.2 T1=3	? (TO) TT=1803.25	SAT (TO) f=19 TT=1800.22 T1=295.43	SAT (TO) f=19 TT=1800.04 T1=1.57	SAT (TO) f=22 TT=1800.07 T1=308.84	OPT f=18 TT=4.403 T1=2.13	OPT f=18 TT=2.598 T1=1.41	? (MO) TT=1494.12	? (MO) TT=1405.67
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-jac3.opb	OPT f=15 TT=0.706 T1=0.66	OPT f=15 TT=1.942 T1=1.76	OPT f=15 TT=1.917 T1=1.73	OPT f=15 TT=1.951 T1=1.94	SAT (TO) f=18 TT=1800.02 T1=293.97	SAT (TO) f=18 TT=1800.03 T1=293.13	? (TO) TT=1800.1	SAT (TO) f=15 TT=1800.27 T1=22.07	OPT f=15 TT=305.278 T1=118.14	SAT (TO) f=18 TT=1800.22 T1=763	SAT (TO) f=16 TT=1800.13 T1=1.58	SAT (TO) f=22 TT=1800.1 T1=70.41	SAT (TO) f=16 TT=1800.55 T1=0.6	OPT f=15 TT=0.706 T1=0.66	OPT f=15 TT=196.091 T1=196.1	OPT f=15 TT=196.026 T1=196.03
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-max1024.pi.opb	OPT f=259 TT=3.598 T1=2.8	SAT f=264 TT=1798.04 T1=612.89	SAT f=264 TT=1798.03 T1=951.32	OPT f=259 TT=3.598 T1=2.8	SAT (TO) f=306 TT=1800.07 T1=527.09	SAT (TO) f=306 TT=1800.06 T1=524.67	? (TO) TT=1800.06	SAT (TO) f=295 TT=1800.24 T1=988.8	SAT (TO) f=295 TT=1801.78 T1=106.33	SAT (TO) f=301 TT=1800.19 T1=0.67	SAT (TO) f=260 TT=1800.09 T1=16.76	SAT (TO) f=299 TT=1800.12 T1=21.46	SAT (TO) f=261 TT=1800.04 T1=12.62	OPT f=259 TT=33.982 T1=32.85	? (MO) TT=971.326	? (MO) TT=879.838
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-prom2.pi.opb	OPT f=287 TT=1.058 T1=1.02	SAT (TO) f=303 TT=1800.1 T1=1714.45	SAT f=303 TT=1798.09 T1=1712.26	OPT f=287 TT=2.251 T1=2.24	SAT (TO) f=449 TT=1800.09 T1=0.45	SAT (TO) f=449 TT=1800.07 T1=0.43	? (TO) TT=1800.1	SAT (TO) f=430 TT=1800.3 T1=1565.09	SAT (TO) f=431 TT=1800.57 T1=902.36	SAT (TO) f=436 TT=1800.3 T1=1.05	OPT f=287 TT=1.058 T1=1.02	SAT (TO) f=436 TT=1800.13 T1=2.11	OPT f=287 TT=1.754 T1=1.72	OPT f=287 TT=1.18 T1=1.15	? (MO) TT=1142.88	? (MO) TT=1084.86
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-rot.b.opb	OPT f=115 TT=2.537 T1=2.48	SAT f=127 TT=1798.01 T1=874.75	SAT f=133 TT=1798.02 T1=27.18	OPT f=115 TT=2.537 T1=2.48	SAT (TO) f=142 TT=1800.05 T1=369.13	SAT (TO) f=142 TT=1800.09 T1=371	? (TO) TT=1800.06	SAT (TO) f=153 TT=1800.32 T1=9.29	SAT (TO) f=143 TT=1802.64 T1=807.2	SAT (TO) f=143 TT=1800.17 T1=557.29	SAT (TO) f=117 TT=1800.09 T1=10.71	SAT (TO) f=153 TT=1800.05 T1=1.78	SAT (TO) f=118 TT=1801.26 T1=9.62	OPT f=115 TT=159.694 T1=159.7	? (MO) TT=1059.59	? (MO) TT=1150.28
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/ logic-synthesis/normalized-sao2.b.opb	OPT f=25 TT=0.675 T1=0.57	OPT f=25 TT=358.763 T1=358.86	OPT f=25 TT=405.896 T1=406.02	OPT f=25 TT=0.675 T1=0.57	SAT (TO) f=28 TT=1800.04 T1=505.04	SAT (TO) f=28 TT=1800.02 T1=505.24	? (TO) TT=1800.03	OPT f=25 TT=1187.99 T1=1081.17	? (TO) TT=1803.31	SAT (TO) f=28 TT=1800.15 T1=557.6	OPT f=25 TT=2.471 T1=2.45	SAT (TO) f=33 TT=1800.07 T1=129.15	OPT f=25 TT=3.354 T1=3.34	OPT f=25 TT=4.189 T1=4.17	OPT f=25 TT=184.334 T1=184.36	OPT f=25 TT=184.412 T1=184.44
normalized-PB06/OPT-SMALLINT/ submitted-PB05/manquinho/logic-synthesis/ normalized-test4.pi.opb	SAT f=110 TT=1800.22 T1=366.94	SAT f=155 TT=1799.07 T1=1611.78	SAT f=155 TT=1798.6 T1=1612.43	? (TO) TT=1800.11	SAT (TO) f=173 TT=1800.09 T1=1.34	SAT (TO) f=173 TT=1800.05 T1=1.31	? (TO) TT=1800.06	SAT (TO) f=173 TT=1800.33 T1=111.2	SAT (TO) f=171 TT=1800.4 T1=48.88	SAT (TO) f=173 TT=1800.24 T1=847.86	SAT (TO) f=114 TT=1800.24 T1=376.63	SAT (TO) f=170 TT=1800.13 T1=12.02	SAT (TO) f=110 TT=1800.22 T1=366.94	SAT f=114 TT=1789.25 T1=314.91	? (MO) TT=1192.19	? (MO) TT=1192.96
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-addm4.r.opb	OPT f=165 TT=0.496 T1=0.48	OPT f=165 TT=6.31 T1=1.93	OPT f=165 TT=5.876 T1=1.8	OPT f=165 TT=0.523 T1=0.52	SAT (TO) f=197 TT=1800.11 T1=0.14	SAT (TO) f=197 TT=1800.11 T1=0.13	? (TO) TT=1800.01	SAT (TO) f=182 TT=1800.27 T1=1513.68	SAT (TO) f=187 TT=1802.24 T1=1072.22	SAT (TO) f=196 TT=1800.27 T1=1.44	OPT f=165 TT=0.496 T1=0.48	SAT (TO) f=192 TT=1800.05 T1=7.05	OPT f=165 TT=1.072 T1=1.05	OPT f=165 TT=1.795 T1=1.76	? (MO) TT=1339.45	? (MO) TT=1247.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-alu2.b.opb	OPT f=60 TT=2.974 T1=2.85	SAT f=65 TT=1798.04 T1=343.54	SAT f=63 TT=1798.01 T1=482.92	OPT f=60 TT=2.974 T1=2.85	SAT (TO) f=71 TT=1800.08 T1=114.86	SAT (TO) f=71 TT=1800.06 T1=114.84	? (TO) TT=1800.01	SAT (TO) f=78 TT=1800.31 T1=1023.37	SAT (TO) f=69 TT=1800.69 T1=687.83	SAT (TO) f=69 TT=1800.21 T1=827.79	SAT (TO) f=61 TT=1800.09 T1=9.91	SAT (TO) f=79 TT=1800.08 T1=599.71	SAT (TO) f=61 TT=1800.12 T1=13.21	OPT f=60 TT=188.901 T1=10.18	? (MO) TT=1233.66	? (MO) TT=1233.35
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-apex6.b.opb	OPT f=136 TT=94.929 T1=65.3	SAT f=156 TT=1798.02 T1=987.99	SAT f=158 TT=1798.07 T1=256.06	OPT f=136 TT=94.929 T1=65.3	SAT (TO) f=158 TT=1800.12 T1=222.24	SAT (TO) f=158 TT=1800.03 T1=221.32	? (MO) TT=15.69	SAT (TO) f=165 TT=1800.28 T1=1289.56	SAT (TO) f=159 TT=1800.92 T1=238.69	SAT (TO) f=160 TT=1800.37 T1=524.5	SAT (TO) f=138 TT=1800.25 T1=26.77	SAT (TO) f=173 TT=1800.04 T1=49.65	SAT (TO) f=138 TT=1800.25 T1=14.27	OPT f=136 TT=247.471 T1=246.67	? (MO) TT=1309.95	? (MO) TT=1358.25
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-apex7.b.opb	OPT f=37 TT=4.864 T1=4.4	SAT f=40 TT=1798.27 T1=1340.46	SAT f=43 TT=1798.01 T1=381.5	OPT f=37 TT=4.864 T1=4.4	SAT (TO) f=44 TT=1800.1 T1=1193	SAT (TO) f=44 TT=1800.06 T1=1128.67	? (TO) TT=1800.09	SAT (TO) f=41 TT=1800.03 T1=459.06	? (TO) TT=1803.45	SAT (TO) f=44 TT=1800.17 T1=451.98	SAT (TO) f=39 TT=1800.1 T1=13.65	SAT (TO) f=53 TT=1800.05 T1=0.89	SAT (TO) f=37 TT=1800.15 T1=12.82	OPT f=37 TT=68.075 T1=66.35	? (MO) TT=1002.6	? (MO) TT=1076.64
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-bbara.r.opb	OPT f=7 TT=0.004 T1=0	OPT f=7 TT=0.004 T1=0	OPT f=7 TT=0.004 T1=0	OPT f=7 TT=0.018 T1=0.01	OPT f=7 TT=0.06 T1=0	OPT f=7 TT=0.06 T1=0	OPT f=7 TT=273.784 T1=178.16	OPT f=7 TT=0.356 T1=0.26	OPT f=7 TT=0.411 T1=1.29	OPT f=7 TT=0.688 T1=0.26	OPT f=7 TT=0.034 T1=0.02	OPT f=7 TT=0.091 T1=0.02	OPT f=7 TT=0.033 T1=0.02	OPT f=7 TT=0.032 T1=0.02	OPT f=7 TT=0.014 T1=0	OPT f=7 TT=0.014 T1=0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-bench1.r.opb	OPT f=121 TT=2.722 T1=1.98	OPT f=121 TT=310.797 T1=308.22	OPT f=121 TT=311.961 T1=309.34	OPT f=121 TT=6.576 T1=6.55	SAT (TO) f=197 TT=1800.09 T1=0.48	SAT (TO) f=197 TT=1800.03 T1=0.46	? (TO) TT=1800.04	SAT (TO) f=166 TT=1800.57 T1=1761.19	SAT (TO) f=175 TT=1800.47 T1=158.84	SAT (TO) f=181 TT=1800.24 T1=1.14	SAT (TO) f=122 TT=1800.12 T1=2.22	SAT (TO) f=178 TT=1800.08 T1=5.6	OPT f=121 TT=2.838 T1=2.02	OPT f=121 TT=2.722 T1=1.98	? (MO) TT=1173.51	? (MO) TT=1174.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-bw.b.opb	OPT f=24 TT=119.812 T1=82.42	SAT f=36 TT=1798.15 T1=4.03	SAT f=35 TT=1798.02 T1=1315.64	OPT f=24 TT=119.812 T1=82.42	SAT (TO) f=33 TT=1800.05 T1=570.94	SAT (TO) f=33 TT=1800.05 T1=565.75	? (MO) TT=15.99	SAT (TO) f=38 TT=1800.29 T1=541.59	SAT (TO) f=34 TT=1800.47 T1=296.72	SAT (TO) f=33 TT=1800.24 T1=479.18	SAT (TO) f=34 TT=1800.27 T1=8.47	SAT (TO) f=50 TT=1800.2 T1=3.11	SAT (TO) f=35 TT=1800.23 T1=9.76	OPT f=24 TT=283.499 T1=280.81	? (MO) TT=1241.49	? (MO) TT=1252.89
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C499.a.opb	OPT f=64 TT=8.997 T1=8.99	SAT f=82 TT=1798.01 T1=0.81	SAT f=80 TT=1798.01 T1=1791.56	OPT f=64 TT=8.997 T1=8.99	SAT (TO) f=81 TT=1800.05 T1=1419.22	SAT (TO) f=81 TT=1800.03 T1=1398.38	? (TO) TT=1800.06	SAT (TO) f=77 TT=1800.29 T1=1504.4	SAT (TO) f=77 TT=1803.37 T1=116.39	SAT (TO) f=83 TT=1800.16 T1=1.3	SAT (TO) f=76 TT=1800.35 T1=36.21	SAT (TO) f=83 TT=1800.06 T1=7.07	SAT (TO) f=78 TT=1800.1 T1=20.67	OPT f=64 TT=299.257 T1=214.6	? (MO) TT=1256.27	? (MO) TT=1179.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C499.b.opb	SAT f=53 TT=1801.27 T1=105.41	SAT f=71 TT=1798.13 T1=1724.94	SAT f=73 TT=1798.08 T1=833.44	? (TO) TT=1800.18	SAT (TO) f=71 TT=1800.09 T1=227.45	SAT (TO) f=71 TT=1800.05 T1=234.32	? (MO) TT=16.8	SAT (TO) f=73 TT=1800.29 T1=275.85	SAT (TO) f=73 TT=1800.52 T1=364.61	SAT (TO) f=71 TT=1800.29 T1=870.93	SAT (TO) f=54 TT=1800.96 T1=91.44	SAT (TO) f=84 TT=1800.44 T1=174.07	SAT (TO) f=53 TT=1801.27 T1=105.41	SAT f=55 TT=1790.84 T1=96.32	? (TO) TT=1800.16	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C880.a.opb	OPT f=87 TT=0.192 T1=0.19	OPT f=87 TT=0.787 T1=0.45	OPT f=87 TT=0.783 T1=0.44	OPT f=87 TT=0.192 T1=0.19	SAT (TO) f=89 TT=1800.01 T1=574.71	SAT (TO) f=89 TT=1800.11 T1=610.58	? (TO) TT=1800.04	OPT f=87 TT=21.708 T1=5.42	OPT f=87 TT=87.585 T1=27.65	SAT (TO) f=92 TT=1800.27 T1=3.42	OPT f=87 TT=0.256 T1=0.24	SAT (TO) f=97 TT=1800.12 T1=0.21	OPT f=87 TT=0.401 T1=0.38	OPT f=87 TT=0.464 T1=0.45	OPT f=87 TT=184.786 T1=184.78	OPT f=87 TT=184.563 T1=184.56
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-C880.b.opb	OPT f=63 TT=0.651 T1=0.65	SAT f=68 TT=1798.06 T1=167.32	SAT f=67 TT=1798.01 T1=1369.61	OPT f=63 TT=0.651 T1=0.65	SAT (TO) f=76 TT=1800.02 T1=672.47	SAT (TO) f=76 TT=1800.05 T1=631	? (TO) TT=1800.07	SAT (TO) f=76 TT=1800.21 T1=1551.47	SAT (TO) f=74 TT=1801.61 T1=907.5	SAT (TO) f=76 TT=1800.25 T1=55.36	SAT (TO) f=64 TT=1800.13 T1=8	SAT (TO) f=83 TT=1800.11 T1=0.7	OPT f=63 TT=6.382 T1=6.35	OPT f=63 TT=4.476 T1=4.44	OPT f=63 TT=1029.06 T1=1029.25	OPT f=63 TT=1027.25 T1=1027.37
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-des.a.opb	OPT f=942 TT=15.944 T1=15.88	SAT f=1005 TT=1798.06 T1=4.78	SAT f=1005 TT=1798.06 T1=4.8	OPT f=942 TT=15.944 T1=15.88	SAT (TO) f=1029 TT=1800.11 T1=1372.17	SAT (TO) f=1029 TT=1800.06 T1=1362.47	? (MO) TT=38.58	SAT (TO) f=1009 TT=1800.33 T1=96.27	SAT (TO) f=1013 TT=1800.51 T1=4.91	SAT (TO) f=1013 TT=1800.43 T1=2.35	SAT (TO) f=951 TT=1801.04 T1=39.01	SAT (TO) f=1062 TT=1801.38 T1=14.67	SAT (TO) f=943 TT=1802.06 T1=50.63	SAT f=942 TT=1789.71 T1=428.36	? (MO) TT=1690.39	? (MO) TT=1292.93
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-dk512x.r.opb	OPT f=6 TT=0.048 T1=0.01	OPT f=6 TT=0.098 T1=0.01	OPT f=6 TT=0.103 T1=0.01	OPT f=6 TT=0.048 T1=0.04	OPT f=6 TT=2.256 T1=0.01	OPT f=6 TT=2.251 T1=0.01	? (TO) TT=1800.03	OPT f=6 TT=1.916 T1=0.42	OPT f=6 TT=2.783 T1=2.43	OPT f=6 TT=3.337 T1=0.85	OPT f=6 TT=0.082 T1=0.03	OPT f=6 TT=2.99 T1=0.62	OPT f=6 TT=0.064 T1=0.03	OPT f=6 TT=0.06 T1=0.03	OPT f=6 TT=2.635 T1=0.06	OPT f=6 TT=2.465 T1=0.06
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-duke2.b.opb	OPT f=70 TT=6.124 T1=5.86	SAT f=75 TT=1798.01 T1=1023.39	SAT f=76 TT=1798.06 T1=483.4	OPT f=70 TT=6.124 T1=5.86	SAT (TO) f=83 TT=1800.05 T1=1111.25	SAT (TO) f=83 TT=1800.04 T1=1100.38	? (MO) TT=561.36	SAT (TO) f=95 TT=1800.36 T1=559.34	? (TO) TT=1803.33	SAT (TO) f=84 TT=1800.25 T1=1437.61	OPT f=70 TT=13.378 T1=13.28	SAT (TO) f=97 TT=1800.86 T1=1.55	OPT f=70 TT=9.848 T1=9.76	OPT f=70 TT=70.56 T1=70.49	? (MO) TT=1236.81	? (MO) TT=1234.88
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex1010.pi.opb	SAT f=268 TT=1800.35 T1=1617.58	SAT (TO) f=423 TT=1800.04 T1=52.8	SAT f=423 TT=1798.09 T1=55.85	? (TO) TT=1800.03	SAT (TO) f=460 TT=1800.12 T1=3	SAT (TO) f=460 TT=1800.15 T1=2.89	? (MO) TT=50.28	SAT (TO) f=441 TT=1800.47 T1=814.56	SAT (TO) f=441 TT=1800.63 T1=688.81	SAT (TO) f=442 TT=1800.48 T1=4.06	SAT (TO) f=271 TT=1800.37 T1=1037.53	SAT (TO) f=427 TT=1800.28 T1=215.31	SAT (TO) f=268 TT=1800.35 T1=1617.58	SAT f=272 TT=1789.76 T1=1159.44	? (MO) TT=1624.54	? (MO) TT=1329.52
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex4inp.r.opb	OPT f=5 TT=0.353 T1=0.19	OPT f=5 TT=2.107 T1=0.34	OPT f=5 TT=2.066 T1=0.33	OPT f=5 TT=0.5 T1=0.49	SAT (TO) f=5 TT=1800.06 T1=3.28	SAT (TO) f=5 TT=1800.11 T1=3.31	? (TO) TT=1800.04	OPT f=5 TT=5.471 T1=1.11	OPT f=5 TT=6.117 T1=5.74	OPT f=5 TT=1654.2 T1=2.12	OPT f=5 TT=0.668 T1=0.65	OPT f=5 TT=462.913 T1=0.41	OPT f=5 TT=0.367 T1=0.2	OPT f=5 TT=0.353 T1=0.19	? (MO) TT=1511.6	? (MO) TT=1469.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex5inp.r.opb	OPT f=4 TT=0.01 T1=0	OPT f=4 TT=0.01 T1=0.01	OPT f=4 TT=0.01 T1=0	OPT f=4 TT=0.016 T1=0.01	OPT f=4 TT=0.124 T1=0	OPT f=4 TT=0.116 T1=0	? (TO) TT=1800.04	OPT f=4 TT=0.393 T1=0.29	OPT f=4 TT=0.493 T1=2.3	OPT f=4 TT=0.889 T1=0.29	OPT f=4 TT=0.084 T1=0.07	OPT f=4 TT=0.141 T1=0.03	OPT f=4 TT=0.035 T1=0.02	OPT f=4 TT=0.034 T1=0.02	OPT f=4 TT=0.051 T1=0	OPT f=4 TT=0.05 T1=0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-ex5.r.opb	OPT f=37 TT=14.688 T1=10.54	SAT f=39 TT=1798.27 T1=1090.67	SAT (TO) f=39 TT=1800.11 T1=1107.39	OPT f=37 TT=14.688 T1=10.54	SAT (TO) f=68 TT=1800.09 T1=0.43	SAT (TO) f=68 TT=1800.13 T1=0.41	? (TO) TT=1800.02	SAT (TO) f=55 TT=1800.27 T1=130.4	SAT (TO) f=55 TT=1801.42 T1=921.82	SAT (TO) f=59 TT=1800.29 T1=1.65	SAT (TO) f=38 TT=1800.11 T1=3.07	SAT (TO) f=52 TT=1800.1 T1=941.16	SAT (TO) f=38 TT=1800.09 T1=3.3	SAT f=38 TT=1789.65 T1=3.79	? (MO) TT=1269.42	? (MO) TT=1277.4
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ex6inp.r.opb	OPT f=4 TT=0.043 T1=0.01	OPT f=4 TT=0.166 T1=0.03	OPT f=4 TT=0.157 T1=0.03	OPT f=4 TT=0.043 T1=0.04	OPT f=4 TT=2.697 T1=0.01	OPT f=4 TT=2.712 T1=0.01	? (TO) TT=1800.05	OPT f=4 TT=0.795 T1=0.38	OPT f=4 TT=1.296 T1=2.36	OPT f=4 TT=2.408 T1=0.58	OPT f=4 TT=0.143 T1=0.03	OPT f=4 TT=1.872 T1=0.03	OPT f=4 TT=0.121 T1=0.03	OPT f=4 TT=0.121 T1=0.07	OPT f=4 TT=0.952 T1=0	OPT f=4 TT=0.951 T1=0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-exps.r.opb	OPT f=76 TT=0.04 T1=0.03	OPT f=76 TT=0.04 T1=0.03	OPT f=76 TT=0.04 T1=0.03	OPT f=76 TT=0.186 T1=0.18	SAT (TO) f=95 TT=1800.06 T1=400.58	SAT (TO) f=95 TT=1800.09 T1=403.72	? (TO) TT=1800.1	SAT (TO) f=82 TT=1800.23 T1=1528.83	SAT (TO) f=85 TT=1801.63 T1=928.24	SAT (TO) f=94 TT=1800.14 T1=48.58	OPT f=76 TT=0.103 T1=0.09	SAT (TO) f=84 TT=1800.09 T1=59.7	OPT f=76 TT=0.193 T1=0.18	OPT f=76 TT=0.143 T1=0.13	OPT f=76 TT=184.31 T1=184.32	OPT f=76 TT=184.345 T1=184.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-fout.r.opb	OPT f=38 TT=0.107 T1=0.1	OPT f=38 TT=0.342 T1=0.34	OPT f=38 TT=0.343 T1=0.33	OPT f=38 TT=0.107 T1=0.1	SAT (TO) f=47 TT=1800.04 T1=1254.43	SAT (TO) f=47 TT=1800.05 T1=1268.33	? (TO) TT=1800.08	SAT (TO) f=40 TT=1800.21 T1=1131.88	? (TO) TT=1803.09	SAT (TO) f=50 TT=1800.24 T1=0.49	OPT f=38 TT=0.965 T1=0.94	SAT (TO) f=43 TT=1800.12 T1=51.05	OPT f=38 TT=0.248 T1=0.23	OPT f=38 TT=1.533 T1=1.51	? (MO) TT=1484.31	? (MO) TT=1473.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-lin.rom.r.opb	OPT f=120 TT=0.494 T1=0.49	OPT f=120 TT=3.993 T1=3.99	OPT f=120 TT=3.992 T1=3.98	OPT f=120 TT=0.494 T1=0.49	SAT (TO) f=173 TT=1800.05 T1=0.15	SAT (TO) f=173 TT=1800.08 T1=0.15	? (TO) TT=1800.02	SAT (TO) f=159 TT=1801.71 T1=966.3	SAT (TO) f=165 TT=1802.23 T1=639.98	SAT (TO) f=177 TT=1800.29 T1=0.73	OPT f=120 TT=0.576 T1=0.56	SAT (TO) f=179 TT=1800.09 T1=0.34	OPT f=120 TT=0.906 T1=0.89	OPT f=120 TT=0.648 T1=0.63	? (MO) TT=1240.84	? (MO) TT=1336.48
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_10_10.r.opb	OPT f=12 TT=1.172 T1=0.73	OPT f=12 TT=26.305 T1=18.99	OPT f=12 TT=40.249 T1=31.96	OPT f=12 TT=1.172 T1=0.73	SAT (TO) f=13 TT=1800.05 T1=984.33	SAT (TO) f=13 TT=1800.03 T1=986.07	? (TO) TT=1800.11	SAT (TO) f=14 TT=1800.18 T1=7.11	SAT (TO) f=13 TT=1803.21 T1=15.57	SAT (TO) f=13 TT=1800.19 T1=1036.7	SAT (TO) f=13 TT=1800.04 T1=128.36	SAT (TO) f=13 TT=1800.02 T1=506.18	SAT (TO) f=13 TT=1800.04 T1=128.72	SAT f=13 TT=1789.58 T1=101.04	? (TO) TT=1800.22	? (TO) TT=1800.21
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_10_15.r.opb	OPT f=10 TT=0.329 T1=0.25	OPT f=10 TT=55.703 T1=55.46	OPT f=10 TT=55.503 T1=55.24	OPT f=10 TT=0.329 T1=0.25	SAT (TO) f=12 TT=1800.08 T1=10.68	SAT (TO) f=12 TT=1800.08 T1=10.67	? (TO) TT=1800.1	SAT (TO) f=12 TT=1800.36 T1=70.99	SAT (TO) f=12 TT=1802.57 T1=6.47	SAT (TO) f=12 TT=1800.17 T1=1.7	SAT (TO) f=11 TT=1800.08 T1=289.99	SAT (TO) f=11 TT=1800.1 T1=248.51	SAT (TO) f=11 TT=1800.11 T1=290.22	SAT f=11 TT=1789.54 T1=227.69	? (TO) TT=1800.2	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_10_30.r.opb	OPT f=8 TT=0.189 T1=0.16	OPT f=8 TT=2.91 T1=2.1	OPT f=8 TT=2.893 T1=2.08	OPT f=8 TT=0.189 T1=0.16	SAT (TO) f=9 TT=1800.05 T1=31.94	SAT (TO) f=9 TT=1800.03 T1=31.94	? (TO) TT=1800.01	SAT (TO) f=9 TT=1800.25 T1=3.65	SAT (TO) f=9 TT=1803.27 T1=49.02	SAT (TO) f=8 TT=1800.22 T1=332.31	SAT (TO) f=8 TT=1800.12 T1=0.97	SAT (TO) f=8 TT=1800.1 T1=523.98	SAT (TO) f=9 TT=1800.1 T1=0.76	SAT f=9 TT=1789.52 T1=0.74	? (TO) TT=1800.25	? (TO) TT=1800.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_30_30.r.opb	OPT f=5 TT=8.24 T1=4.82	OPT f=5 TT=88.503 T1=86.17	OPT f=5 TT=85.049 T1=82.61	OPT f=5 TT=8.24 T1=4.82	SAT (TO) f=6 TT=1800.09 T1=0.3	SAT (TO) f=6 TT=1800.06 T1=0.32	? (TO) TT=1800.08	SAT (TO) f=6 TT=1800.15 T1=2.7	OPT f=5 TT=874.613 T1=10.55	OPT f=5 TT=1324.45 T1=1241.05	OPT f=5 TT=250.153 T1=32.54	OPT f=5 TT=504.955 T1=297.08	OPT f=5 TT=258.45 T1=31.87	OPT f=5 TT=207.459 T1=25.37	? (TO) TT=1800.16	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_50_50.r.opb	OPT f=4 TT=1.593 T1=0.03	OPT f=4 TT=20.937 T1=0.94	OPT f=4 TT=22.021 T1=1	OPT f=4 TT=1.593 T1=0.97	OPT f=4 TT=126.96 T1=0.03	OPT f=4 TT=127.816 T1=0.03	? (TO) TT=1800.11	OPT f=4 TT=135.585 T1=1.46	OPT f=4 TT=153.289 T1=3.55	OPT f=4 TT=57.421 T1=0.85	OPT f=4 TT=24.251 T1=0.74	OPT f=4 TT=24.11 T1=0.09	OPT f=4 TT=26.25 T1=1.08	OPT f=4 TT=21.939 T1=1.01	OPT f=4 TT=36.228 T1=0.03	OPT f=4 TT=34.064 T1=0.03
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_70_70.r.opb	OPT f=3 TT=0.57 T1=0.04	OPT f=3 TT=1.364 T1=0.04	OPT f=3 TT=1.358 T1=0.04	OPT f=3 TT=0.57 T1=0.47	OPT f=3 TT=1.688 T1=0.04	OPT f=3 TT=1.684 T1=0.04	? (TO) TT=1800	OPT f=3 TT=5.1 T1=0.6	OPT f=3 TT=5.555 T1=1.64	OPT f=3 TT=2.667 T1=0.6	OPT f=3 TT=1.426 T1=0.72	OPT f=3 TT=0.756 T1=0.05	OPT f=3 TT=1.579 T1=0.87	OPT f=3 TT=1.401 T1=0.82	OPT f=3 TT=1.093 T1=0	OPT f=3 TT=1.087 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_100_90_90.r.opb	OPT f=2 TT=0.073 T1=0.04	OPT f=2 TT=0.077 T1=0.07	OPT f=2 TT=0.077 T1=0.07	OPT f=2 TT=0.282 T1=0.28	OPT f=2 TT=0.108 T1=0.04	OPT f=2 TT=0.116 T1=0.04	? (TO) TT=1800.09	OPT f=2 TT=1.116 T1=0.61	OPT f=2 TT=1.288 T1=1.66	OPT f=2 TT=1.173 T1=0.61	OPT f=2 TT=0.103 T1=0.09	OPT f=2 TT=0.073 T1=0.05	OPT f=2 TT=0.151 T1=0.14	OPT f=2 TT=0.145 T1=0.13	OPT f=2 TT=0.04 T1=0.01	OPT f=2 TT=0.044 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_10.r.opb	OPT f=21 TT=0.696 T1=0.46	OPT f=21 TT=105.454 T1=104.59	OPT f=21 TT=137.186 T1=136.98	OPT f=21 TT=0.696 T1=0.46	SAT (TO) f=31 TT=1800.05 T1=0.03	SAT (TO) f=31 TT=1800.1 T1=0.02	? (TO) TT=1800.05	SAT (TO) f=27 TT=1800.22 T1=2.54	? (TO) TT=1803.51	SAT (TO) f=30 TT=1800.22 T1=978.44	SAT (TO) f=22 TT=1800.02 T1=1.27	SAT (TO) f=26 TT=1800.11 T1=5.61	SAT (TO) f=22 TT=1800.05 T1=1.3	SAT f=22 TT=1789.62 T1=1.35	? (MO) TT=1787.79	? (MO) TT=1777.68
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_14.r.opb	OPT f=19 TT=0.676 T1=0.45	OPT f=19 TT=139.766 T1=107.94	OPT f=19 TT=138.101 T1=106.52	OPT f=19 TT=0.676 T1=0.45	SAT (TO) f=29 TT=1800.02 T1=1364.54	SAT (TO) f=29 TT=1800.05 T1=1365.76	? (TO) TT=1800.09	SAT (TO) f=24 TT=1800.2 T1=314.09	No Cert. TT=1803.19	SAT (TO) f=27 TT=1800.19 T1=1715.44	SAT (TO) f=19 TT=1800.04 T1=1.69	SAT (TO) f=23 TT=1800.13 T1=10.11	SAT (TO) f=19 TT=1800.02 T1=1.35	SAT f=19 TT=1789.35 T1=1.31	? (MO) TT=1719.72	? (TO) TT=1800.28
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_15.r.opb	OPT f=19 TT=7.041 T1=2.53	OPT f=19 TT=261.649 T1=54.06	OPT f=19 TT=331.385 T1=38.3	OPT f=19 TT=7.041 T1=4.22	SAT (TO) f=28 TT=1800.02 T1=634.63	SAT (TO) f=28 TT=1800.09 T1=640.51	? (TO) TT=1800.05	SAT (TO) f=26 TT=1800.38 T1=9.24	? (TO) TT=1803.29	SAT (TO) f=29 TT=1800.24 T1=52.28	SAT (TO) f=19 TT=1800.04 T1=2.53	SAT (TO) f=22 TT=1800.08 T1=0.97	SAT (TO) f=20 TT=1800.07 T1=1.52	SAT f=20 TT=1789.56 T1=1.48	? (MO) TT=1735.91	? (MO) TT=1725.44
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_300_10_20.r.opb	OPT f=17 TT=6.558 T1=1.68	OPT f=17 TT=409.175 T1=359.39	OPT f=17 TT=377.813 T1=326.02	OPT f=17 TT=6.558 T1=3.97	SAT (TO) f=26 TT=1800.06 T1=1767.94	SAT (TO) f=26 TT=1800.02 T1=1782.87	? (TO) TT=1800.08	SAT (TO) f=21 TT=1800.16 T1=311.4	? (TO) TT=1803.28	SAT (TO) f=25 TT=1800.25 T1=20.32	SAT (TO) f=19 TT=1800.11 T1=1.83	SAT (TO) f=21 TT=1800.02 T1=0.07	SAT (TO) f=17 TT=1800.07 T1=1.68	SAT f=17 TT=1789.34 T1=1.75	? (MO) TT=1672.33	? (MO) TT=1662.76
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_10_10.r.opb	OPT f=8 TT=0.608 T1=0.12	OPT f=8 TT=3.904 T1=0.12	OPT f=8 TT=3.785 T1=0.12	OPT f=8 TT=0.608 T1=0.37	OPT f=8 TT=1010.98 T1=18.26	OPT f=8 TT=1012.84 T1=18.22	? (TO) TT=1800.08	SAT (TO) f=8 TT=1800.27 T1=15.44	OPT f=8 TT=418.517 T1=5.59	OPT f=8 TT=183.477 T1=2.39	OPT f=8 TT=245.867 T1=0.85	OPT f=8 TT=273.932 T1=0.67	OPT f=8 TT=261.122 T1=0.94	OPT f=8 TT=197.513 T1=0.81	Wrong UNSAT TT=1522.23	Wrong UNSAT TT=1551.57
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_20_20.r.opb	OPT f=5 TT=0.72 T1=0.01	OPT f=5 TT=2.627 T1=0.17	OPT f=5 TT=2.683 T1=0.17	OPT f=5 TT=0.72 T1=0.51	OPT f=5 TT=61.888 T1=0.01	OPT f=5 TT=61.276 T1=0.01	? (TO) TT=1800.08	OPT f=5 TT=25.418 T1=0.77	OPT f=5 TT=27.34 T1=3.41	OPT f=5 TT=12.963 T1=0.63	OPT f=5 TT=13.526 T1=0.07	OPT f=5 TT=13.55 T1=0.05	OPT f=5 TT=12.801 T1=0.08	OPT f=5 TT=10.672 T1=0.08	OPT f=5 TT=11.954 T1=0.01	OPT f=5 TT=12.59 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_30_30.r.opb	OPT f=3 TT=0.171 T1=0.01	OPT f=3 TT=0.547 T1=0.23	OPT f=3 TT=0.543 T1=0.23	OPT f=3 TT=0.229 T1=0.19	OPT f=3 TT=0.171 T1=0.02	OPT f=3 TT=0.171 T1=0.01	? (TO) TT=1800.04	OPT f=3 TT=1.968 T1=0.57	OPT f=3 TT=2.005 T1=2.51	OPT f=3 TT=2.032 T1=0.85	OPT f=3 TT=0.648 T1=0.48	OPT f=3 TT=0.212 T1=0.04	OPT f=3 TT=1.197 T1=1.02	OPT f=3 TT=1.115 T1=0.97	OPT f=3 TT=0.087 T1=0.02	OPT f=3 TT=0.087 T1=0.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m100_50_40_40.r.opb	OPT f=2 TT=0.051 T1=0.03	OPT f=2 TT=0.145 T1=0.13	OPT f=2 TT=0.146 T1=0.13	OPT f=2 TT=0.09 T1=0.08	OPT f=2 TT=0.051 T1=0.04	OPT f=2 TT=0.051 T1=0.04	? (TO) TT=1800.06	OPT f=2 TT=0.886 T1=0.51	OPT f=2 TT=1.321 T1=2.52	OPT f=2 TT=0.931 T1=0.48	OPT f=2 TT=0.399 T1=0.39	OPT f=2 TT=0.052 T1=0.03	OPT f=2 TT=0.553 T1=0.54	OPT f=2 TT=0.524 T1=0.51	OPT f=2 TT=0.009 T1=0	OPT f=2 TT=0.01 T1=0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m200_500_10_10.r.opb	OPT f=39 TT=1719.32 T1=921.61	SAT f=47 TT=1798.03 T1=394.23	SAT f=47 TT=1798.15 T1=1058.82	OPT f=39 TT=1719.32 T1=921.61	SAT (TO) f=63 TT=1800.1 T1=645.01	SAT (TO) f=63 TT=1800.07 T1=648.02	? (TO) TT=1800.04	SAT (TO) f=54 TT=1801.06 T1=3.02	SAT (TO) f=51 TT=1803.03 T1=12.69	SAT (TO) f=60 TT=1800.17 T1=0.45	SAT (TO) f=42 TT=1800.07 T1=7.82	SAT (TO) f=50 TT=1800.03 T1=117.85	SAT (TO) f=43 TT=1800.04 T1=8.81	SAT f=43 TT=1789.48 T1=8.51	? (MO) TT=1448.85	? (MO) TT=1528.63
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-m4.r.opb	OPT f=90 TT=0.348 T1=0.34	OPT f=90 TT=0.652 T1=0.58	OPT f=90 TT=0.653 T1=0.57	OPT f=90 TT=0.348 T1=0.34	SAT (TO) f=111 TT=1800.03 T1=86.75	SAT (TO) f=111 TT=1800.06 T1=93.07	? (TO) TT=1800.02	SAT (TO) f=104 TT=1800.35 T1=771.71	? (TO) TT=1803.14	SAT (TO) f=113 TT=1800.23 T1=562.08	OPT f=90 TT=0.712 T1=0.69	SAT (TO) f=109 TT=1800.06 T1=101.99	OPT f=90 TT=1.041 T1=1.02	OPT f=90 TT=16.602 T1=16.58	? (MO) TT=1287.73	? (MO) TT=1145.79
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_10_10.r.opb	OPT f=8 TT=0.039 T1=0.03	OPT f=8 TT=0.077 T1=0.07	OPT f=8 TT=0.077 T1=0.07	OPT f=8 TT=0.039 T1=0.03	SAT (TO) f=9 TT=1800.11 T1=576.33	SAT (TO) f=9 TT=1800.08 T1=579.48	? (TO) TT=1800.05	OPT f=8 TT=998.121 T1=13.55	? (TO) TT=1803.23	SAT (TO) f=9 TT=1800.19 T1=34.31	OPT f=8 TT=0.351 T1=0.33	SAT (TO) f=9 TT=1800.05 T1=6.06	OPT f=8 TT=0.405 T1=0.39	OPT f=8 TT=0.392 T1=0.37	? (TO) TT=1800.18	? (TO) TT=1800.19
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_10_15.r.opb	OPT f=8 TT=0.079 T1=0.07	OPT f=8 TT=1.143 T1=0.98	OPT f=8 TT=1.123 T1=0.96	OPT f=8 TT=0.079 T1=0.07	SAT (TO) f=8 TT=1800.06 T1=581.97	SAT (TO) f=8 TT=1800.11 T1=543.04	? (TO) TT=1800.02	SAT (TO) f=8 TT=1800.23 T1=515.68	SAT (TO) f=8 TT=1801.94 T1=116.72	SAT (TO) f=8 TT=1800.21 T1=470.99	SAT (TO) f=8 TT=1800.07 T1=1.82	SAT (TO) f=8 TT=1800.07 T1=3.33	OPT f=8 TT=1.129 T1=0.53	OPT f=8 TT=1.014 T1=0.48	? (TO) TT=1800.18	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_30_30.r.opb	OPT f=4 TT=0.084 T1=0.08	OPT f=4 TT=2.534 T1=2.34	OPT f=4 TT=2.501 T1=2.31	OPT f=4 TT=0.084 T1=0.08	OPT f=4 TT=161.431 T1=137.18	OPT f=4 TT=162.483 T1=137.96	? (TO) TT=1800.01	OPT f=4 TT=253.767 T1=154.5	OPT f=4 TT=35.624 T1=13.67	OPT f=4 TT=339.989 T1=337.21	OPT f=4 TT=0.344 T1=0.28	OPT f=4 TT=17.62 T1=4.59	OPT f=4 TT=0.279 T1=0.23	OPT f=4 TT=0.29 T1=0.23	OPT f=4 TT=723.354 T1=723.53	OPT f=4 TT=714.535 T1=714.76
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_50_50.r.opb	OPT f=3 TT=0.12 T1=0.05	OPT f=3 TT=0.486 T1=0.11	OPT f=3 TT=0.486 T1=0.11	OPT f=3 TT=0.12 T1=0.11	OPT f=3 TT=2.003 T1=0.18	OPT f=3 TT=2.028 T1=0.18	? (TO) TT=1800.05	OPT f=3 TT=3.094 T1=0.91	OPT f=3 TT=4.14 T1=2.76	OPT f=3 TT=2.267 T1=0.82	OPT f=3 TT=0.648 T1=0.05	OPT f=3 TT=0.987 T1=0.05	OPT f=3 TT=0.714 T1=0.05	OPT f=3 TT=0.741 T1=0.06	OPT f=3 TT=1.208 T1=0.3	OPT f=3 TT=1.212 T1=0.3
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_70_70.r.opb	OPT f=2 TT=0.082 T1=0.06	OPT f=2 TT=0.32 T1=0.31	OPT f=2 TT=0.32 T1=0.31	OPT f=2 TT=0.101 T1=0.09	OPT f=2 TT=0.108 T1=0.07	OPT f=2 TT=0.108 T1=0.07	? (TO) TT=1800.03	OPT f=2 TT=1.183 T1=0.58	OPT f=2 TT=1.653 T1=3.51	OPT f=2 TT=1.271 T1=0.56	OPT f=2 TT=0.102 T1=0.08	OPT f=2 TT=0.082 T1=0.06	OPT f=2 TT=0.113 T1=0.09	OPT f=2 TT=0.103 T1=0.08	OPT f=2 TT=0.025 T1=0.01	OPT f=2 TT=0.025 T1=0.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-m50_100_90_90.r.opb	OPT f=2 TT=0.058 T1=0.02	OPT f=2 TT=0.067 T1=0.06	OPT f=2 TT=0.067 T1=0.06	OPT f=2 TT=0.146 T1=0.14	OPT f=2 TT=0.092 T1=0.02	OPT f=2 TT=0.091 T1=0.02	? (TO) TT=1800.02	OPT f=2 TT=0.895 T1=0.5	OPT f=2 TT=1.075 T1=1.49	OPT f=2 TT=1.062 T1=0.63	OPT f=2 TT=0.072 T1=0.06	OPT f=2 TT=0.058 T1=0.04	OPT f=2 TT=0.079 T1=0.07	OPT f=2 TT=0.081 T1=0.07	OPT f=2 TT=0.033 T1=0	OPT f=2 TT=0.033 T1=0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-maincont.r.opb	OPT f=7 TT=0.041 T1=0.03	OPT f=7 TT=0.111 T1=0.03	OPT f=7 TT=0.105 T1=0.03	OPT f=7 TT=0.041 T1=0.04	OPT f=7 TT=148.09 T1=0.09	OPT f=7 TT=147.946 T1=0.09	? (TO) TT=1800.07	OPT f=7 TT=1.778 T1=0.48	OPT f=7 TT=1.934 T1=3.46	OPT f=7 TT=46.828 T1=1.39	OPT f=7 TT=0.152 T1=0.13	OPT f=7 TT=106.886 T1=0.03	OPT f=7 TT=0.156 T1=0.14	OPT f=7 TT=0.15 T1=0.13	OPT f=7 TT=71.768 T1=0.75	OPT f=7 TT=72.452 T1=0.75
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-max1024.r.opb	OPT f=245 TT=2.835 T1=2.37	SAT f=251 TT=1798.13 T1=1372.75	SAT f=249 TT=1798.13 T1=1790.93	OPT f=245 TT=2.835 T1=2.37	SAT (TO) f=289 TT=1800.05 T1=1713.47	SAT (TO) f=289 TT=1800.03 T1=1693.79	? (TO) TT=1800.06	SAT (TO) f=289 TT=1800.27 T1=1438.41	SAT (TO) f=291 TT=1801.05 T1=815.61	SAT (TO) f=296 TT=1800.19 T1=858.8	SAT (TO) f=247 TT=1800.12 T1=16.95	SAT (TO) f=292 TT=1800.13 T1=153.53	SAT (TO) f=247 TT=1800.09 T1=13.33	OPT f=245 TT=59.576 T1=59.56	? (MO) TT=1086.23	? (MO) TT=999.576
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-max512.r.opb	OPT f=113 TT=0.132 T1=0.13	OPT f=113 TT=0.154 T1=0.14	OPT f=113 TT=0.155 T1=0.14	OPT f=113 TT=0.132 T1=0.13	SAT (TO) f=131 TT=1800.06 T1=156.47	SAT (TO) f=131 TT=1800.02 T1=169.19	? (TO) TT=1800.06	SAT (TO) f=123 TT=1800.34 T1=1488.66	SAT (TO) f=124 TT=1801.01 T1=767.48	SAT (TO) f=133 TT=1800.24 T1=232.28	OPT f=113 TT=0.566 T1=0.55	SAT (TO) f=137 TT=1800.07 T1=32.57	OPT f=113 TT=0.666 T1=0.65	OPT f=113 TT=5.887 T1=5.87	? (MO) TT=1088.93	? (MO) TT=1209.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-mlp4.r.opb	OPT f=109 TT=0.223 T1=0.22	OPT f=109 TT=23.304 T1=23.27	OPT f=109 TT=21.986 T1=21.94	OPT f=109 TT=0.223 T1=0.22	SAT (TO) f=126 TT=1800.07 T1=1340.57	SAT (TO) f=126 TT=1800.04 T1=1344.56	? (TO) TT=1800.06	SAT (TO) f=120 TT=1800.29 T1=1209.49	? (TO) TT=1803.1	SAT (TO) f=129 TT=1800.25 T1=145.46	OPT f=109 TT=1.577 T1=1.55	SAT (TO) f=122 TT=1800.04 T1=20.11	SAT (TO) f=111 TT=1800.1 T1=2.04	OPT f=109 TT=0.678 T1=0.65	? (MO) TT=1056.28	? (MO) TT=1166.48
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-opus.r.opb	OPT f=5 TT=0.021 T1=0.02	OPT f=5 TT=0.021 T1=0.02	OPT f=5 TT=0.021 T1=0.02	OPT f=5 TT=0.031 T1=0.03	OPT f=5 TT=0.257 T1=0.04	OPT f=5 TT=0.259 T1=0.04	? (TO) TT=1800.05	OPT f=5 TT=0.489 T1=0.41	OPT f=5 TT=0.938 T1=2.37	OPT f=5 TT=1.154 T1=0.57	OPT f=5 TT=0.04 T1=0.03	OPT f=5 TT=0.232 T1=0.03	OPT f=5 TT=0.04 T1=0.03	OPT f=5 TT=0.039 T1=0.03	OPT f=5 TT=0.149 T1=0	OPT f=5 TT=0.15 T1=0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-pdc.r.opb	OPT f=94 TT=21.084 T1=20.62	OPT f=94 TT=68.041 T1=68.02	OPT f=94 TT=67.944 T1=67.93	OPT f=94 TT=105.145 T1=104.6	SAT (TO) f=263 TT=1800.13 T1=4.46	SAT (TO) f=263 TT=1800.08 T1=4.4	? (MO) TT=15.88	SAT (TO) f=147 TT=1800.47 T1=1330.65	SAT (TO) f=148 TT=1800.74 T1=253.2	SAT (TO) f=150 TT=1800.6 T1=3.47	OPT f=94 TT=21.084 T1=20.62	SAT (TO) f=145 TT=1800.39 T1=124.65	OPT f=94 TT=54.788 T1=54.33	OPT f=94 TT=37.787 T1=37.34	? (TO) TT=1800.15	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-prom2.r.opb	OPT f=278 TT=0.99 T1=0.96	OPT f=278 TT=1537.72 T1=1530.86	OPT f=278 TT=1538.56 T1=1531.65	OPT f=278 TT=2.336 T1=2.33	SAT (TO) f=439 TT=1800.12 T1=1711.65	SAT (TO) f=439 TT=1800.12 T1=1708.77	? (TO) TT=1800.04	SAT (TO) f=424 TT=1800.37 T1=1510.82	SAT (TO) f=412 TT=1800.38 T1=887.88	SAT (TO) f=425 TT=1800.17 T1=1.66	OPT f=278 TT=0.99 T1=0.96	SAT (TO) f=441 TT=1800.08 T1=272.42	OPT f=278 TT=1.55 T1=1.52	OPT f=278 TT=1.602 T1=1.57	? (MO) TT=1026.82	? (MO) TT=1058.02
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-rd73.b.opb	OPT f=4 TT=0.286 T1=0.28	OPT f=4 TT=0.516 T1=0.5	OPT f=4 TT=0.513 T1=0.49	OPT f=4 TT=0.286 T1=0.28	OPT f=4 TT=2.514 T1=0.78	OPT f=4 TT=2.528 T1=0.78	? (TO) TT=1800.01	OPT f=4 TT=2.742 T1=1.27	OPT f=4 TT=5.216 T1=4.81	OPT f=4 TT=3.422 T1=1.8	OPT f=4 TT=4.006 T1=3.99	OPT f=4 TT=6.539 T1=4.2	OPT f=4 TT=0.887 T1=0.86	OPT f=4 TT=0.882 T1=0.86	OPT f=4 TT=5.107 T1=0.03	OPT f=4 TT=5.094 T1=0.03
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ logic_synthesis/normalized-rd84.b.opb	OPT f=5 TT=57.341 T1=40.83	SAT f=7 TT=1798.02 T1=11.85	SAT f=7 TT=1798.01 T1=12.47	OPT f=5 TT=57.341 T1=40.83	SAT (TO) f=6 TT=1800.04 T1=173.26	SAT (TO) f=6 TT=1800.11 T1=173.3	? (MO) TT=15.68	OPT f=5 TT=259.262 T1=66.01	OPT f=5 TT=506.578 T1=71.53	OPT f=5 TT=425.313 T1=99.42	SAT (TO) f=6 TT=1800.12 T1=2.26	SAT (TO) f=7 TT=1800.09 T1=48.19	SAT (TO) f=6 TT=1800.21 T1=1.88	SAT f=6 TT=1789.61 T1=1.77	OPT f=5 TT=233.194 T1=233.24	OPT f=5 TT=236.522 T1=236.55
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-ricks.r.opb	OPT f=5 TT=0.71 T1=0.63	OPT f=5 TT=0.714 T1=0.71	OPT f=5 TT=0.71 T1=0.7	OPT f=5 TT=0.779 T1=0.77	OPT f=5 TT=890.534 T1=398.76	OPT f=5 TT=896.464 T1=401.03	? (TO) TT=1800.07	OPT f=5 TT=2.526 T1=1.2	OPT f=5 TT=6 T1=3.7	OPT f=5 TT=121.445 T1=32.99	OPT f=5 TT=0.863 T1=0.85	OPT f=5 TT=30.571 T1=0.63	OPT f=5 TT=2.005 T1=1.99	OPT f=5 TT=1.811 T1=1.8	? (MO) TT=1108.01	? (MO) TT=1233.08
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-saucier.r.opb	OPT f=6 TT=1336.36 T1=65.43	SAT f=8 TT=1798.34 T1=221.97	SAT f=7 TT=1798.06 T1=1478.8	OPT f=6 TT=1336.36 T1=1106.71	SAT (TO) f=7 TT=1800.1 T1=108.23	SAT (TO) f=7 TT=1800.05 T1=126.19	? (MO) TT=14.29	SAT (TO) f=8 TT=1800.33 T1=1589.55	SAT (TO) f=7 TT=1800.48 T1=163.8	SAT (TO) f=8 TT=1800.31 T1=37.4	SAT (TO) f=7 TT=1800.56 T1=4.55	SAT (TO) f=7 TT=1800.37 T1=47.97	SAT (TO) f=6 TT=1800.54 T1=65.43	SAT f=6 TT=1789.88 T1=827.04	? (TO) TT=1800.01	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/logic_synthesis/ normalized-test1.r.opb	OPT f=110 TT=0.345 T1=0.32	OPT f=110 TT=1.407 T1=1.37	OPT f=110 TT=1.405 T1=1.37	OPT f=110 TT=1.22 T1=1.21	SAT (TO) f=159 TT=1800.04 T1=0.22	SAT (TO) f=159 TT=1800.11 T1=0.22	? (TO) TT=1800.03	SAT (TO) f=135 TT=1800.33 T1=934.53	SAT (TO) f=136 TT=1801.63 T1=354.57	SAT (TO) f=149 TT=1800.23 T1=0.75	OPT f=110 TT=0.345 T1=0.32	SAT (TO) f=147 TT=1800.06 T1=0.75	OPT f=110 TT=0.413 T1=0.39	OPT f=110 TT=0.376 T1=0.35	? (MO) TT=1247.1	? (MO) TT=1285.17

Statistics		bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
Number of times the solver is able to give the best known answer		50	50	71	0	20	0	26	26	23	40	22	47	57	0	0
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		4	4	51	0	2	0	0	0	0	5	3	3	4	0	0