PB'10 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Random

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Random

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 Card (complete)
bsolo 3.2 Cl (complete)
pb_cplex 2010-06-29 (complete)
PB/CT 0.1 (complete)
PB/CT 0.1 fixed (complete)
PBPASSolver 2010-06-13 (complete)
SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)
SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
SAT4J PB Resolution 2.2.0 2010-05-26 (complete)
SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)
SCIPnone SCIP 1.2.1.2 without any LP solver (complete)
SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
wbo 1.4b (complete)
wbo 1.4b (fixed) (complete)

Bench name	Best results on this instance	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_1.opb	UNSAT TT=117.186	UNSAT TT=332.245	UNSAT TT=245.761	UNSAT TT=117.186	UNSAT TT=0.553	UNSAT TT=1334.97	? (TO) TT=1800.04	? (TO) TT=1800.23	UNSAT TT=361.733	UNSAT TT=171.417	UNSAT TT=785.06	? (TO) TT=1800.75	UNSAT TT=1103.3	UNSAT TT=1027.24	UNSAT TT=578.289	UNSAT TT=553.477
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_2.opb	UNSAT TT=77.429	UNSAT TT=140.553	UNSAT TT=104.703	UNSAT TT=77.429	UNSAT TT=1.695	UNSAT TT=640.966	? (TO) TT=1800.04	? (TO) TT=1800.22	UNSAT TT=197.113	UNSAT TT=98.575	UNSAT TT=391.537	? (TO) TT=1800.7	UNSAT TT=430.762	UNSAT TT=436.259	UNSAT TT=324.559	UNSAT TT=305.62
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_3.opb	UNSAT TT=70.744	UNSAT TT=820.993	UNSAT TT=566.194	UNSAT TT=70.744	UNSAT TT=19.107	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.34	UNSAT TT=611.97	UNSAT TT=304.871	UNSAT TT=387.449	? (TO) TT=1801.82	UNSAT TT=899.644	UNSAT TT=913.524	UNSAT TT=1335.07	UNSAT TT=1244.43
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_4.opb	UNSAT TT=109.139	UNSAT TT=203.369	UNSAT TT=128.473	UNSAT TT=109.139	UNSAT TT=578.258	UNSAT TT=637.727	Wrong Cert. TT=111.256	? (TO) TT=1800.25	UNSAT TT=229.85	UNSAT TT=111.34	UNSAT TT=292.371	? (TO) TT=1800.7	UNSAT TT=275.78	UNSAT TT=263.403	UNSAT TT=332.631	UNSAT TT=330.619
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_1.opb		? TT=1798	? TT=1798	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1801.29	? (TO) TT=1800.18	? (TO) TT=1801.48	? (TO) TT=1802.14	? (TO) TT=1801.53	? TT=1790.9	? (TO) TT=1800.1	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_2.opb		? TT=1798.1	? TT=1798	? (TO) TT=1800.04	UNSAT TT=95.076	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.28	? (TO) TT=1803.94	? (TO) TT=1800.23	? (TO) TT=1801.73	? (TO) TT=1802.16	? (TO) TT=1801.48	? TT=1790.89	? (TO) TT=1800.17	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_3.opb	OPT f=0 TT=364.143 T1=364.2	? TT=1798	? TT=1798	? (TO) TT=1800.03	Wrong UNSAT TT=103.284	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.36	? (TO) TT=1800.17	OPT f=0 TT=364.143 T1=364.2	? (TO) TT=1802.18	? (TO) TT=1801.51	? TT=1790.98	? (TO) TT=1800.09	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_4.opb		? TT=1798	? TT=1798	? (TO) TT=1800.15	UNSAT TT=20.613	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1801.33	? (TO) TT=1800.23	? (TO) TT=1801.71	? (TO) TT=1802.16	? (TO) TT=1801.56	? TT=1790.86	? (TO) TT=1800.09	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_1.opb		? TT=1798	? TT=1798	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.41	? (TO) TT=1800.19	? (TO) TT=1802.07	? (TO) TT=1802.18	? (TO) TT=1802.09	? TT=1792.27	? (TO) TT=1800.13	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_2.opb		? TT=1798	? TT=1798	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.21	? (TO) TT=1800.57	? (TO) TT=1800.2	? (TO) TT=1802.07	? (TO) TT=1802.2	? (TO) TT=1802.13	? TT=1792.07	? (TO) TT=1800.19	? (TO) TT=1800.1
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_3.opb		? TT=1798	? TT=1798	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.48	? (TO) TT=1800.17	? (TO) TT=1802.14	? (TO) TT=1802.22	? (TO) TT=1802.08	? TT=1792.5	? (TO) TT=1800.15	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_4.opb		? TT=1798.01	? TT=1798	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.23	? (TO) TT=1800.15	? (TO) TT=1802.05	? (TO) TT=1802.16	? (TO) TT=1802.1	? TT=1793.41	? (TO) TT=1800.09	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_1.opb		? TT=1798	? TT=1798	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.32	? (TO) TT=1800.15	? (TO) TT=1802.09	? (TO) TT=1802.19	? (TO) TT=1802.12	? TT=1793.22	? (TO) TT=1800.15	? (TO) TT=1800.19
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_2.opb		? TT=1798	? TT=1798	? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.49	? (TO) TT=1800.24	? (TO) TT=1802.09	? (TO) TT=1802.15	? (TO) TT=1802.09	? TT=1794.66	? (TO) TT=1800.14	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_3.opb		? TT=1798	? TT=1798	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.41	? (TO) TT=1800.21	? (TO) TT=1802.08	? (TO) TT=1802.18	? (TO) TT=1802.15	? TT=1793.36	? (TO) TT=1800.17	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_4.opb		? TT=1798	? TT=1798	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.31	? (TO) TT=1800.18	? (TO) TT=1802.13	? (TO) TT=1802.19	? (TO) TT=1802.13	? TT=1794.56	? (TO) TT=1800.14	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_1.opb		? TT=1798	? TT=1798	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1801.92	? (TO) TT=1800.18	? (TO) TT=1802.11	? (TO) TT=1802.18	? (TO) TT=1802.11	? TT=1794.56	? (TO) TT=1800.03	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_2.opb		? TT=1798	? TT=1798	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.81	? (TO) TT=1800.13	? (TO) TT=1802.13	? (TO) TT=1802.15	? (TO) TT=1802.16	? TT=1794.97	? (TO) TT=1800.18	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_3.opb		? TT=1798.14	? TT=1798	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.61	? (TO) TT=1800.33	? (TO) TT=1800.26	? (TO) TT=1802.13	? (TO) TT=1802.15	? (TO) TT=1802.13	? TT=1794.34	? (TO) TT=1800.14	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_4.opb		? TT=1798.58	? TT=1798	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.46	? (TO) TT=1800.17	? (TO) TT=1802.13	? (TO) TT=1802.18	? (TO) TT=1802.11	? TT=1794.09	? (TO) TT=1800.15	? (TO) TT=1800.03
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_1.opb	OPT f=2 TT=182.966 T1=3.5	OPT f=2 TT=513.41 T1=59.47	OPT f=2 TT=330.253 T1=30.4	OPT f=2 TT=344.345 T1=277.06	SAT (TO) f=2 TT=1800.1 T1=72.05	SAT (TO) f=2 TT=1800.07 T1=3.5	? (TO) TT=1800.04	SAT (TO) f=19 TT=1800.31 T1=1682.52	OPT f=2 TT=410.656 T1=88.02	OPT f=2 TT=182.966 T1=68.13	OPT f=2 TT=776.922 T1=4.2	SAT (TO) f=3 TT=1801.06 T1=74.01	OPT f=2 TT=566.931 T1=6.07	OPT f=2 TT=472.483 T1=5.07	? (TO) TT=1800.12	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_2.opb	OPT f=1 TT=113.9 T1=11.5	OPT f=1 TT=207.504 T1=11.5	OPT f=1 TT=182.882 T1=53.59	OPT f=1 TT=193.015 T1=155.4	OPT f=1 TT=1500.35 T1=42.26	OPT f=1 TT=1543.88 T1=36.76	? (TO) TT=1800.03	SAT (TO) f=210 TT=1800.3 T1=1663.02	OPT f=1 TT=221.67 T1=54.73	OPT f=1 TT=113.9 T1=40.64	OPT f=1 TT=1769.08 T1=49.77	SAT (TO) f=3 TT=1800.79 T1=59.07	OPT f=1 TT=946.26 T1=45.54	OPT f=1 TT=917.928 T1=42.14	Signal TT=182.798	Wrong UNSAT TT=428.804
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_3.opb	OPT f=2 TT=269.719 T1=26.19	OPT f=2 TT=1215.19 T1=89.2	OPT f=2 TT=1235.87 T1=77.23	OPT f=2 TT=392.809 T1=316.21	SAT (TO) f=2 TT=1800.11 T1=44.32	SAT (TO) f=2 TT=1800.09 T1=200.79	? (TO) TT=1800.01	SAT (TO) f=336 TT=1800.26 T1=1018.66	OPT f=2 TT=770.908 T1=65.68	OPT f=2 TT=366.273 T1=52.29	OPT f=2 TT=683.437 T1=168.05	SAT (TO) f=4 TT=1800.87 T1=622.61	OPT f=2 TT=285.95 T1=27.28	OPT f=2 TT=269.719 T1=26.19	? (TO) TT=1800.11	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_4.opb	OPT f=1 TT=130.767 T1=9.44	OPT f=1 TT=418.496 T1=55.47	OPT f=1 TT=242.423 T1=166.12	OPT f=1 TT=367.987 T1=295.32	OPT f=1 TT=1531.9 T1=14.16	OPT f=1 TT=1583.92 T1=9.44	? (TO) TT=1800.02	SAT (TO) f=112 TT=1800.26 T1=1240.82	OPT f=1 TT=273.809 T1=41.44	OPT f=1 TT=130.767 T1=24.13	OPT f=1 TT=1757.18 T1=229.92	SAT (TO) f=2 TT=1800.68 T1=49.98	SAT (TO) f=1 TT=1800.11 T1=33.52	SAT f=1 TT=1789.71 T1=30.86	OPT f=1 TT=905.989 T1=906.27	OPT f=1 TT=891.111 T1=891.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_1.opb	SAT f=2 TT=1800.03 T1=295.58	SAT f=4 TT=1798 T1=169.86	SAT f=3 TT=1798 T1=11.37	? (TO) TT=1800.07	SAT (TO) f=1 TT=1800.06 T1=1215.28	SAT (TO) f=2 TT=1800.03 T1=295.58	? (TO) TT=1800.07	SAT (TO) f=446 TT=1800.24 T1=1128.66	? (TO) TT=1803.76	SAT (TO) f=3 TT=1800.21 T1=1034.51	SAT (TO) f=3 TT=1800.61 T1=221.04	SAT (TO) f=62 TT=1802.13 T1=1782.28	SAT (TO) f=3 TT=1800.83 T1=186.57	SAT f=3 TT=1790.38 T1=166.73	? (TO) TT=1800.11	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_2.opb	SAT f=2 TT=1789.82 T1=499.59	SAT f=4 TT=1797.89 T1=956.58	SAT f=2 TT=1798.07 T1=499.59	? (TO) TT=1800.04	SAT (TO) f=3 TT=1800.1 T1=671.01	SAT (TO) f=4 TT=1800.02 T1=641.54	? (TO) TT=1800.05	SAT (TO) f=358 TT=1800.13 T1=1368.22	? (TO) TT=1803.71	SAT (TO) f=3 TT=1800.19 T1=376.38	SAT (TO) f=3 TT=1800.12 T1=682.18	SAT (TO) f=18 TT=1802.14 T1=1742.88	SAT (TO) f=2 TT=1800.27 T1=1125.76	SAT f=2 TT=1789.82 T1=1001.96	? (TO) TT=1800.1	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_3.opb	OPT f=0 TT=1563.97 T1=1294.27	SAT f=3 TT=1798 T1=1459.41	SAT f=2 TT=1798 T1=1341.68	OPT f=0 TT=1563.97 T1=1294.27	SAT (TO) f=2 TT=1800.05 T1=258.84	SAT (TO) f=2 TT=1800.04 T1=749.66	? (TO) TT=1800.04	SAT (TO) f=272 TT=1800.18 T1=1441.62	SAT (TO) f=2 TT=1800.52 T1=776.8	SAT (TO) f=2 TT=1800.24 T1=731.07	SAT (TO) f=2 TT=1800.23 T1=11.76	SAT (TO) f=36 TT=1801.75 T1=1692.07	SAT (TO) f=3 TT=1800.2 T1=56.61	SAT f=3 TT=1789.53 T1=50.9	? (TO) TT=1800.1	? (TO) TT=1800.19
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_4.opb	SAT f=2 TT=1789.64 T1=90.93	SAT f=3 TT=1798 T1=1184.17	SAT f=3 TT=1798 T1=1355.77	? (TO) TT=1800.08	SAT (TO) f=4 TT=1800.08 T1=885.46	SAT (TO) f=4 TT=1800.03 T1=1756.86	? (TO) TT=1800.06	SAT (TO) f=553 TT=1800.16 T1=1425.35	? (TO) TT=1803.91	SAT (TO) f=4 TT=1800.18 T1=2.92	SAT (TO) f=4 TT=1800.71 T1=39.64	SAT (TO) f=27 TT=1802.15 T1=1077.87	SAT (TO) f=2 TT=1800.11 T1=93.84	SAT f=2 TT=1789.64 T1=90.93	? (TO) TT=1800.12	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_1.opb	SAT f=5 TT=1790.14 T1=285.43	SAT f=13 TT=1798 T1=1133.34	SAT f=9 TT=1798 T1=773.47	? (TO) TT=1800.11	SAT (TO) f=10 TT=1800.07 T1=612.56	SAT (TO) f=6 TT=1800.04 T1=910.97	? (TO) TT=1800.02	SAT (TO) f=508 TT=1800.16 T1=1144.17	? (TO) TT=1803.8	SAT (TO) f=8 TT=1800.2 T1=1570.68	SAT (TO) f=6 TT=1800.4 T1=105.12	SAT (TO) f=59 TT=1802.18 T1=1165.32	SAT (TO) f=5 TT=1800.78 T1=314.02	SAT f=5 TT=1790.14 T1=285.43	? (TO) TT=1800.02	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_2.opb	SAT f=6 TT=1800.56 T1=1252.53	SAT f=10 TT=1798 T1=289.59	SAT f=10 TT=1798 T1=120.6	? (TO) TT=1800.03	SAT (TO) f=7 TT=1800.03 T1=779.93	SAT (TO) f=7 TT=1800.09 T1=361.5	? (TO) TT=1800.08	SAT (TO) f=522 TT=1800.17 T1=1097.16	SAT (TO) f=9 TT=1800.72 T1=88.79	SAT (TO) f=9 TT=1800.22 T1=72.48	SAT (TO) f=6 TT=1800.56 T1=1252.53	SAT (TO) f=92 TT=1802.15 T1=1418.61	SAT (TO) f=7 TT=1801.42 T1=1183.59	SAT f=7 TT=1790.84 T1=1003.2	? (TO) TT=1800.16	? (TO) TT=1800.18
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_3.opb	SAT f=5 TT=1800.1 T1=430.22	SAT f=12 TT=1798 T1=944.29	SAT f=10 TT=1798 T1=1139.08	? (TO) TT=1800.16	SAT (TO) f=8 TT=1800.09 T1=871.92	SAT (TO) f=5 TT=1800.1 T1=430.22	? (TO) TT=1800.09	SAT (TO) f=681 TT=1800.23 T1=1753.76	SAT (TO) f=8 TT=1800.37 T1=343.69	SAT (TO) f=5 TT=1800.26 T1=1462.31	SAT (TO) f=8 TT=1801.49 T1=586.81	SAT (TO) f=71 TT=1802.19 T1=1490.1	SAT (TO) f=8 TT=1801.97 T1=780.13	SAT f=8 TT=1791.19 T1=701.43	? (TO) TT=1800.19	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_4.opb	SAT f=5 TT=1790.56 T1=792.84	SAT f=7 TT=1798 T1=179.44	SAT f=11 TT=1798 T1=1642.9	? (TO) TT=1800.1	SAT (TO) f=9 TT=1800.07 T1=361.08	SAT (TO) f=10 TT=1800.06 T1=203.96	? (TO) TT=1800	SAT (TO) f=721 TT=1800.26 T1=1257.31	SAT (TO) f=5 TT=1800.79 T1=925.29	SAT (TO) f=5 TT=1800.23 T1=817.58	SAT (TO) f=7 TT=1801.47 T1=1697.08	SAT (TO) f=33 TT=1802.2 T1=809.57	SAT (TO) f=5 TT=1801.08 T1=879.09	SAT f=5 TT=1790.56 T1=792.84	? (TO) TT=1800.13	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_1.opb	SAT f=10 TT=1801.33 T1=748.41	SAT f=39 TT=1798 T1=1756.85	SAT f=34 TT=1798.36 T1=234.12	? (TO) TT=1800.02	SAT (TO) f=25 TT=1800.08 T1=818.32	SAT (TO) f=21 TT=1800.05 T1=1281.39	? (TO) TT=1800.03	SAT (TO) f=1007 TT=1800.17 T1=1009.66	SAT (TO) f=21 TT=1800.6 T1=306.28	SAT (TO) f=22 TT=1800.23 T1=1400.67	SAT (TO) f=10 TT=1801.33 T1=748.41	SAT (TO) f=1226 TT=1802.15 T1=572.98	SAT (TO) f=12 TT=1802.02 T1=1778.69	SAT f=12 TT=1791.23 T1=1727.29	? (TO) TT=1800.17	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_2.opb	SAT f=14 TT=1792.37 T1=91.71	SAT f=80 TT=1798 T1=1727.4	SAT f=82 TT=1798 T1=30.23	? (TO) TT=1800.12	SAT (TO) f=25 TT=1800.07 T1=1407.74	SAT (TO) f=25 TT=1800.11 T1=1565.39	? (TO) TT=1800.03	SAT (TO) f=876 TT=1800.18 T1=1515.3	SAT (TO) f=20 TT=1800.88 T1=474.32	SAT (TO) f=20 TT=1800.15 T1=412.8	SAT (TO) f=14 TT=1802.06 T1=1160.48	SAT (TO) f=1119 TT=1802.16 T1=600.19	SAT (TO) f=14 TT=1802.12 T1=99.82	SAT f=14 TT=1792.37 T1=91.71	? (TO) TT=1800.14	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_3.opb	SAT f=10 TT=1791.09 T1=1289.43	SAT f=72 TT=1798 T1=42.44	SAT f=40 TT=1798 T1=1244.18	? (TO) TT=1800.07	SAT (TO) f=26 TT=1800.04 T1=1663.07	SAT (TO) f=30 TT=1800.09 T1=1117.01	? (TO) TT=1800.02	SAT (TO) f=891 TT=1800.15 T1=816.8	SAT (TO) f=24 TT=1800.45 T1=535.6	SAT (TO) f=18 TT=1800.22 T1=238.08	SAT (TO) f=13 TT=1801.96 T1=912.58	SAT (TO) f=1103 TT=1802.14 T1=525.16	SAT (TO) f=10 TT=1801.81 T1=1399.58	SAT f=10 TT=1791.09 T1=1289.43	? (TO) TT=1800.17	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_4.opb	SAT f=12 TT=1791.86 T1=1256.21	SAT f=94 TT=1798 T1=111.7	SAT f=24 TT=1798 T1=815.94	? (TO) TT=1800.09	SAT (TO) f=29 TT=1800.03 T1=1622.26	SAT (TO) f=21 TT=1800.08 T1=1035.71	? (TO) TT=1800.08	SAT (TO) f=1120 TT=1800.21 T1=602.1	SAT (TO) f=23 TT=1800.4 T1=97.85	SAT (TO) f=21 TT=1800.14 T1=1593.46	SAT (TO) f=15 TT=1802.15 T1=1722.52	SAT (TO) f=36 TT=1802.19 T1=1563.01	SAT (TO) f=12 TT=1802.1 T1=1291.42	SAT f=12 TT=1791.86 T1=1256.21	? (TO) TT=1800.16	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_1.opb	SAT f=17 TT=1792.56 T1=1486.64	SAT f=99 TT=1798 T1=753.25	SAT f=92 TT=1797.89 T1=543	? (TO) TT=1800.01	SAT (TO) f=41 TT=1800.1 T1=1331.68	SAT (TO) f=44 TT=1800.04 T1=1601.34	? (TO) TT=1800.09	SAT (TO) f=2070 TT=1800.09 T1=1620.96	SAT (TO) f=73 TT=1800.43 T1=742.9	SAT (TO) f=37 TT=1800.18 T1=1672.73	SAT (TO) f=19 TT=1802.13 T1=1696.88	SAT (TO) f=1336 TT=1802.19 T1=685.66	SAT (TO) f=17 TT=1802.15 T1=1616.63	SAT f=17 TT=1792.56 T1=1486.64	? (TO) TT=1800.19	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_2.opb	SAT f=15 TT=1791.89 T1=1014.11	SAT f=190 TT=1798 T1=44.97	SAT f=184 TT=1798 T1=15.42	? (TO) TT=1800.13	SAT (TO) f=48 TT=1800.05 T1=318.92	SAT (TO) f=42 TT=1800.05 T1=1748.26	? (TO) TT=1800.07	SAT (TO) f=1498 TT=1800.09 T1=598.29	SAT (TO) f=53 TT=1800.52 T1=100.24	SAT (TO) f=44 TT=1800.2 T1=1465.42	SAT (TO) f=23 TT=1802.07 T1=897.18	SAT (TO) f=177 TT=1802.18 T1=1310.73	SAT (TO) f=15 TT=1802.13 T1=1095.56	SAT f=15 TT=1791.89 T1=1014.11	? (TO) TT=1800.19	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_3.opb	SAT f=16 TT=1791.86 T1=1666.64	SAT f=160 TT=1798 T1=1330.92	SAT f=86 TT=1798 T1=1752.42	? (TO) TT=1800.09	SAT (TO) f=49 TT=1800.05 T1=1430.49	SAT (TO) f=48 TT=1800.06 T1=1413.01	? (TO) TT=1800.01	SAT (TO) f=1473 TT=1800.41 T1=1137.96	SAT (TO) f=167 TT=1800.52 T1=498.53	SAT (TO) f=68 TT=1800.21 T1=929.91	SAT (TO) f=19 TT=1802.08 T1=862.81	? (TO) TT=1802.19	SAT (TO) f=17 TT=1802.16 T1=545.29	SAT f=16 TT=1791.86 T1=1666.64	? (TO) TT=1800.14	? (TO) TT=1800.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_4.opb	SAT f=26 TT=1793.29 T1=1688.28	SAT f=113 TT=1798 T1=1504.23	SAT f=99 TT=1798 T1=1541.59	? (TO) TT=1800.04	SAT (TO) f=51 TT=1800.03 T1=1470.95	SAT (TO) f=41 TT=1800.12 T1=1416.71	? (TO) TT=1800.03	SAT (TO) f=1543 TT=1800.14 T1=1283.2	SAT (TO) f=72 TT=1800.26 T1=880.98	SAT (TO) f=44 TT=1800.21 T1=1340.79	SAT (TO) f=28 TT=1802.11 T1=1308.31	SAT (TO) f=286 TT=1802.16 T1=714.57	SAT (TO) f=27 TT=1802.16 T1=1404.27	SAT f=26 TT=1793.29 T1=1688.28	? (TO) TT=1800.24	? (TO) TT=1800.16
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-1.opb	SAT f=-28 TT=1789.79 T1=1373.56	SAT f=-25 TT=1798.02 T1=207.8	SAT f=-25 TT=1798.02 T1=124.05	? (TO) TT=1800.12	SAT (TO) f=-27 TT=1800.03 T1=717.18	SAT (TO) f=-27 TT=1800.04 T1=725.03	? (TO) TT=1800.03	SAT (TO) f=-25 TT=1800.24 T1=126.86	SAT (TO) f=-26 TT=1800.8 T1=24.77	SAT (TO) f=-26 TT=1800.17 T1=16.79	SAT (TO) f=-24 TT=1800.18 T1=527.01	SAT (TO) f=-24 TT=1800.15 T1=155.57	SAT (TO) f=-24 TT=1800.14 T1=432.95	SAT f=-28 TT=1789.79 T1=1373.56	Wrong Opt. f=-19 TT=181.121 T1=181.15	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-2.opb	SAT f=-29 TT=1789.47 T1=1227.28	SAT f=-25 TT=1798.02 T1=753.46	SAT f=-25 TT=1798.03 T1=213.24	? (TO) TT=1800.16	SAT (TO) f=-27 TT=1800.08 T1=768.56	SAT (TO) f=-27 TT=1800.08 T1=765.17	? (TO) TT=1800.05	SAT (TO) f=-25 TT=1800.22 T1=44.54	SAT (TO) f=-26 TT=1800.49 T1=121.43	SAT (TO) f=-26 TT=1800.19 T1=65.2	SAT (TO) f=-24 TT=1800.11 T1=477.15	SAT (TO) f=-23 TT=1800.15 T1=163.28	SAT (TO) f=-23 TT=1800.18 T1=26.31	SAT f=-29 TT=1789.47 T1=1227.28	Wrong Opt. f=-17 TT=180.966 T1=181.01	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-3.opb	SAT f=-29 TT=1789.65 T1=1045.87	SAT f=-26 TT=1798.02 T1=6.49	SAT f=-25 TT=1798.02 T1=0.3	? (TO) TT=1800.05	SAT (TO) f=-27 TT=1800.02 T1=82.64	SAT (TO) f=-27 TT=1800.04 T1=84.1	? (TO) TT=1800.06	SAT (TO) f=-24 TT=1800.19 T1=1.97	SAT (TO) f=-26 TT=1800.48 T1=95.02	SAT (TO) f=-26 TT=1800.26 T1=146.54	SAT (TO) f=-25 TT=1800.2 T1=103.25	SAT (TO) f=-25 TT=1800.14 T1=331.42	SAT (TO) f=-24 TT=1800.16 T1=553.27	SAT f=-29 TT=1789.65 T1=1045.87	Wrong Opt. f=-17 TT=180.858 T1=180.88	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-4.opb	SAT f=-29 TT=1789.61 T1=1214.63	SAT f=-26 TT=1798.02 T1=202.09	SAT f=-26 TT=1798.02 T1=1696.83	? (TO) TT=1800.06	SAT (TO) f=-27 TT=1800.03 T1=914.61	SAT (TO) f=-27 TT=1800.09 T1=919.08	? (TO) TT=1800.03	SAT (TO) f=-25 TT=1800.19 T1=428.12	SAT (TO) f=-26 TT=1800.3 T1=12.55	SAT (TO) f=-26 TT=1800.19 T1=66.46	SAT (TO) f=-24 TT=1800.14 T1=1089.43	SAT (TO) f=-26 TT=1800.12 T1=1243.87	SAT (TO) f=-25 TT=1800.16 T1=152.79	SAT f=-29 TT=1789.61 T1=1214.63	Wrong Opt. f=-18 TT=180.981 T1=181	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-5.opb	SAT f=-28 TT=1789.74 T1=873.02	SAT f=-24 TT=1798.02 T1=1.01	SAT f=-25 TT=1798.02 T1=735.67	? (TO) TT=1800.13	SAT (TO) f=-27 TT=1800.09 T1=1605.26	SAT (TO) f=-27 TT=1800.09 T1=1585.33	? (TO) TT=1800.04	SAT (TO) f=-25 TT=1800.2 T1=1699.3	SAT (TO) f=-26 TT=1800.42 T1=14.65	SAT (TO) f=-26 TT=1800.22 T1=6.85	SAT (TO) f=-25 TT=1800.19 T1=207.33	SAT (TO) f=-24 TT=1800.14 T1=2.54	SAT (TO) f=-24 TT=1800.17 T1=270.65	SAT f=-28 TT=1789.74 T1=873.02	Wrong Opt. f=-17 TT=181.115 T1=181.13	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-1.opb	SAT f=-32 TT=1789.87 T1=1293.77	SAT f=-29 TT=1798.04 T1=836.61	SAT f=-29 TT=1798.04 T1=31.63	? (TO) TT=1800.04	SAT (TO) f=-30 TT=1800.05 T1=233.06	SAT (TO) f=-30 TT=1800.13 T1=232.32	? (TO) TT=1800	SAT (TO) f=-28 TT=1800.2 T1=1.55	SAT (TO) f=-29 TT=1802.9 T1=20.65	SAT (TO) f=-30 TT=1800.16 T1=697.44	SAT (TO) f=-26 TT=1800.2 T1=66.47	SAT (TO) f=-27 TT=1800.13 T1=36.46	SAT (TO) f=-26 TT=1800.19 T1=147.85	SAT f=-32 TT=1789.87 T1=1293.77	Wrong Opt. f=-18 TT=180.95 T1=180.96	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-2.opb	SAT f=-31 TT=1789.68 T1=1221.04	SAT f=-28 TT=1798.06 T1=382.41	SAT f=-30 TT=1798.04 T1=649.27	? (TO) TT=1800.04	SAT (TO) f=-30 TT=1800.12 T1=17.93	SAT (TO) f=-30 TT=1800.1 T1=17.8	? (TO) TT=1800.03	SAT (TO) f=-28 TT=1800.3 T1=16.37	SAT (TO) f=-29 TT=1800.57 T1=154.12	SAT (TO) f=-29 TT=1800.22 T1=7.97	SAT (TO) f=-27 TT=1800.23 T1=483.19	SAT (TO) f=-26 TT=1800.15 T1=217.37	SAT (TO) f=-26 TT=1800.16 T1=441.49	SAT f=-31 TT=1789.68 T1=1221.04	Wrong Opt. f=-18 TT=180.87 T1=180.89	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-3.opb	SAT f=-32 TT=1789.91 T1=1017.34	SAT f=-29 TT=1798.04 T1=9.37	SAT f=-29 TT=1798.05 T1=4.44	? (TO) TT=1800.1	SAT (TO) f=-31 TT=1800.08 T1=1544.7	SAT (TO) f=-31 TT=1800.1 T1=1533.27	? (TO) TT=1800.01	SAT (TO) f=-29 TT=1800.27 T1=219.72	SAT (TO) f=-30 TT=1800.43 T1=102.88	SAT (TO) f=-30 TT=1800.25 T1=82.98	SAT (TO) f=-26 TT=1800.24 T1=48.54	SAT (TO) f=-27 TT=1800.1 T1=23.42	SAT (TO) f=-26 TT=1800.22 T1=110.22	SAT f=-32 TT=1789.91 T1=1017.34	Wrong Opt. f=-18 TT=180.843 T1=180.86	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-4.opb	SAT f=-33 TT=1789.88 T1=1724.27	SAT f=-29 TT=1798.04 T1=1664.58	SAT f=-30 TT=1798.04 T1=316.94	? (TO) TT=1800.08	SAT (TO) f=-30 TT=1800.1 T1=33.91	SAT (TO) f=-30 TT=1800.13 T1=33.95	? (TO) TT=1800.03	SAT (TO) f=-28 TT=1800.2 T1=365.62	SAT (TO) f=-30 TT=1800.53 T1=755.51	SAT (TO) f=-30 TT=1800.27 T1=592.28	SAT (TO) f=-27 TT=1800.21 T1=960.57	SAT (TO) f=-26 TT=1800.17 T1=187.11	SAT (TO) f=-29 TT=1800.16 T1=240.31	SAT f=-33 TT=1789.88 T1=1724.27	Wrong Opt. f=-20 TT=180.834 T1=180.88	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-5.opb	SAT f=-33 TT=1789.78 T1=1091.69	SAT f=-29 TT=1798.04 T1=10.4	SAT f=-30 TT=1798.04 T1=1242.71	? (TO) TT=1800.04	SAT (TO) f=-30 TT=1800.08 T1=226.36	SAT (TO) f=-30 TT=1800.11 T1=215.37	? (MO) TT=1787.31	SAT (TO) f=-28 TT=1800.28 T1=361.07	SAT (TO) f=-29 TT=1800.48 T1=15.64	SAT (TO) f=-29 TT=1800.24 T1=8.05	SAT (TO) f=-29 TT=1800.19 T1=1309.24	SAT (TO) f=-28 TT=1800.15 T1=5.57	SAT (TO) f=-27 TT=1800.24 T1=347.18	SAT f=-33 TT=1789.78 T1=1091.69	Wrong Opt. f=-19 TT=180.74 T1=180.76	? (TO) TT=1800.09
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-1.opb	SAT f=-36 TT=1789.94 T1=1687.36	SAT f=-32 TT=1798.07 T1=606.47	SAT f=-32 TT=1798.09 T1=260.74	? (TO) TT=1800.13	SAT (TO) f=-34 TT=1800.05 T1=227.87	SAT (TO) f=-34 TT=1800.06 T1=215.35	? (MO) TT=27.49	SAT (TO) f=-33 TT=1800.27 T1=26.2	SAT (TO) f=-34 TT=1800.52 T1=857.16	SAT (TO) f=-34 TT=1800.28 T1=1262.45	SAT (TO) f=-30 TT=1800.29 T1=1393.09	SAT (TO) f=-29 TT=1800.21 T1=1387.64	SAT (TO) f=-31 TT=1800.28 T1=458.68	SAT f=-36 TT=1789.94 T1=1687.36	Wrong Opt. f=-19 TT=180.834 T1=180.87	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-2.opb	SAT f=-35 TT=1789.56 T1=943.85	SAT f=-32 TT=1798.06 T1=4.31	SAT f=-32 TT=1798.07 T1=2.22	? (TO) TT=1800.12	SAT (TO) f=-35 TT=1800.06 T1=925.48	SAT (TO) f=-35 TT=1800.08 T1=943.85	? (MO) TT=27.62	SAT (TO) f=-31 TT=1800.25 T1=6.16	SAT (TO) f=-34 TT=1800.62 T1=183.69	SAT (TO) f=-34 TT=1800.32 T1=149.76	SAT (TO) f=-30 TT=1800.31 T1=1766.51	SAT (TO) f=-29 TT=1800.16 T1=1704.84	SAT (TO) f=-29 TT=1800.32 T1=564.32	SAT f=-35 TT=1789.56 T1=1372.88	Wrong Opt. f=-17 TT=180.689 T1=180.74	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-3.opb	SAT f=-35 TT=1800.04 T1=379.24	SAT f=-32 TT=1798.06 T1=11.68	SAT f=-32 TT=1798.06 T1=5.55	? (TO) TT=1800.04	SAT (TO) f=-35 TT=1800.1 T1=374.14	SAT (TO) f=-35 TT=1800.04 T1=379.24	? (MO) TT=28.77	SAT (TO) f=-32 TT=1800.23 T1=1088.52	SAT (TO) f=-33 TT=1800.35 T1=37.08	SAT (TO) f=-33 TT=1800.3 T1=24.07	SAT (TO) f=-31 TT=1800.29 T1=1180.8	SAT (TO) f=-28 TT=1800.24 T1=23.27	SAT (TO) f=-30 TT=1800.26 T1=169.42	SAT f=-34 TT=1790.12 T1=1264.42	Wrong Opt. f=-18 TT=180.811 T1=180.83	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-4.opb	SAT f=-35 TT=1789.94 T1=898.87	SAT f=-32 TT=1798.06 T1=1117.15	SAT f=-32 TT=1798.06 T1=177.6	? (TO) TT=1800.12	SAT (TO) f=-34 TT=1800.04 T1=63.49	SAT (TO) f=-34 TT=1800.06 T1=62.45	? (MO) TT=25.47	SAT (TO) f=-32 TT=1800.23 T1=191.01	SAT (TO) f=-34 TT=1800.52 T1=887.46	SAT (TO) f=-33 TT=1800.34 T1=69.96	SAT (TO) f=-30 TT=1800.28 T1=6.73	SAT (TO) f=-31 TT=1800.23 T1=356.62	SAT (TO) f=-33 TT=1800.28 T1=850.86	SAT f=-35 TT=1789.94 T1=898.87	Wrong Opt. f=-18 TT=180.65 T1=180.69	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-5.opb	SAT f=-35 TT=1789.63 T1=836.93	SAT f=-32 TT=1798.06 T1=130.1	SAT f=-33 TT=1798.05 T1=1558.47	? (TO) TT=1800.06	SAT (TO) f=-34 TT=1800.08 T1=257.27	SAT (TO) f=-34 TT=1800.06 T1=247.54	? (MO) TT=26.09	SAT (TO) f=-33 TT=1800.25 T1=1704.21	SAT (TO) f=-33 TT=1800.46 T1=18.81	SAT (TO) f=-33 TT=1800.38 T1=11.12	SAT (TO) f=-31 TT=1800.25 T1=5.95	SAT (TO) f=-32 TT=1800.15 T1=218.47	SAT (TO) f=-31 TT=1800.3 T1=6.65	SAT f=-35 TT=1789.63 T1=836.93	Wrong Opt. f=-19 TT=180.637 T1=180.67	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-1.opb	SAT f=-38 TT=1789.96 T1=1036.17	SAT f=-36 TT=1798.09 T1=268.62	SAT f=-35 TT=1798.11 T1=189.04	? (TO) TT=1800.01	SAT (TO) f=-37 TT=1800.13 T1=9.74	SAT (TO) f=-37 TT=1800.05 T1=9.49	? (MO) TT=12.89	SAT (TO) f=-35 TT=1800.25 T1=297.75	SAT (TO) f=-37 TT=1800.41 T1=54.43	SAT (TO) f=-37 TT=1800.34 T1=81.49	SAT (TO) f=-33 TT=1800.38 T1=199.87	SAT (TO) f=-35 TT=1800.28 T1=1210.91	SAT (TO) f=-33 TT=1800.3 T1=409.58	SAT f=-38 TT=1789.96 T1=1036.17	Wrong Opt. f=-20 TT=180.712 T1=180.75	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-2.opb	SAT f=-38 TT=1789.82 T1=1021.06	SAT f=-35 TT=1798.11 T1=6.33	SAT f=-36 TT=1798.14 T1=49.96	? (TO) TT=1800.04	SAT (TO) f=-38 TT=1800.06 T1=1698.35	SAT (TO) f=-38 TT=1800.08 T1=1607.54	? (MO) TT=12.49	SAT (TO) f=-35 TT=1800.3 T1=22.74	SAT (TO) f=-37 TT=1800.46 T1=149.75	SAT (TO) f=-37 TT=1800.45 T1=1672.81	SAT (TO) f=-33 TT=1800.34 T1=389.86	SAT (TO) f=-35 TT=1800.27 T1=6.54	SAT (TO) f=-33 TT=1800.34 T1=299.47	SAT f=-38 TT=1789.82 T1=1021.06	Wrong Opt. f=-17 TT=180.688 T1=180.71	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-3.opb	SAT f=-38 TT=1789.9 T1=88.11	SAT f=-36 TT=1798.09 T1=344.86	SAT f=-36 TT=1798.09 T1=266.8	? (TO) TT=1800	SAT (TO) f=-38 TT=1800.05 T1=86.33	SAT (TO) f=-38 TT=1800.05 T1=88.11	? (MO) TT=12.89	SAT (TO) f=-36 TT=1800.27 T1=958.07	SAT (TO) f=-36 TT=1800.58 T1=36.46	SAT (TO) f=-38 TT=1800.4 T1=500.97	SAT (TO) f=-34 TT=1800.32 T1=573.01	SAT (TO) f=-33 TT=1800.24 T1=31.11	SAT (TO) f=-32 TT=1800.3 T1=10.03	SAT f=-38 TT=1789.9 T1=1278.75	Wrong Opt. f=-20 TT=180.772 T1=180.81	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-4.opb	SAT f=-40 TT=1789.87 T1=1739.89	SAT f=-36 TT=1798.08 T1=1476.37	SAT f=-35 TT=1798.1 T1=1.64	? (TO) TT=1800.14	SAT (TO) f=-38 TT=1800.14 T1=434.2	SAT (TO) f=-38 TT=1800.11 T1=424.74	? (MO) TT=12.99	SAT (TO) f=-35 TT=1800.19 T1=2.11	? (TO) TT=1802.59	SAT (TO) f=-37 TT=1800.37 T1=106.15	SAT (TO) f=-33 TT=1800.3 T1=508.01	SAT (TO) f=-34 TT=1800.21 T1=122.51	SAT (TO) f=-33 TT=1800.33 T1=536.23	SAT f=-40 TT=1789.87 T1=1739.89	Wrong Opt. f=-18 TT=180.912 T1=180.94	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-5.opb	SAT f=-38 TT=1789.88 T1=1596.19	SAT f=-35 TT=1798.09 T1=13.62	SAT f=-36 TT=1798.11 T1=17.89	? (TO) TT=1800.01	SAT (TO) f=-37 TT=1800.13 T1=77.8	SAT (TO) f=-37 TT=1800.14 T1=79.74	? (MO) TT=13.38	SAT (TO) f=-35 TT=1800.27 T1=224.16	SAT (TO) f=-36 TT=1800.67 T1=421.39	SAT (TO) f=-37 TT=1800.44 T1=894.39	SAT (TO) f=-33 TT=1800.35 T1=9.93	SAT (TO) f=-33 TT=1800.19 T1=1678.64	SAT (TO) f=-33 TT=1800.34 T1=10.7	SAT f=-38 TT=1789.88 T1=1596.19	Wrong Opt. f=-17 TT=180.743 T1=180.78	? (TO) TT=1800.16
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-1.opb	SAT f=-41 TT=1800.06 T1=175.9	SAT f=-40 TT=1798.11 T1=84.21	SAT f=-40 TT=1798.12 T1=890.61	? (TO) TT=1800.04	SAT (TO) f=-41 TT=1800.06 T1=213.01	SAT (TO) f=-41 TT=1800.06 T1=212.67	? (MO) TT=12.89	SAT (TO) f=-38 TT=1800.31 T1=4.76	SAT (TO) f=-41 TT=1800.54 T1=175.9	SAT (TO) f=-40 TT=1800.31 T1=140.08	SAT (TO) f=-37 TT=1800.41 T1=1179.37	SAT (TO) f=-37 TT=1800.28 T1=116.06	SAT (TO) f=-40 TT=1800.46 T1=891.17	SAT f=-39 TT=1790.28 T1=1668.71	Wrong Opt. f=-20 TT=180.912 T1=180.92	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-2.opb	SAT f=-43 TT=1789.96 T1=1686.32	SAT f=-38 TT=1798.12 T1=12.54	SAT f=-40 TT=1798.11 T1=194.62	? (TO) TT=1800.02	SAT (TO) f=-41 TT=1800.06 T1=191.71	SAT (TO) f=-41 TT=1800.06 T1=188.35	? (MO) TT=13	SAT (TO) f=-39 TT=1800.3 T1=246.52	SAT (TO) f=-40 TT=1800.46 T1=20.54	SAT (TO) f=-40 TT=1800.28 T1=28.12	SAT (TO) f=-35 TT=1800.46 T1=1052.99	SAT (TO) f=-33 TT=1800.33 T1=600.37	SAT (TO) f=-37 TT=1800.41 T1=711.63	SAT f=-43 TT=1789.96 T1=1686.32	Wrong Opt. f=-18 TT=180.647 T1=180.69	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-3.opb	SAT f=-42 TT=1789.9 T1=1458.4	SAT f=-40 TT=1798.11 T1=280.76	SAT f=-39 TT=1798.13 T1=253.53	? (TO) TT=1800.08	SAT (TO) f=-41 TT=1800.16 T1=43.28	SAT (TO) f=-41 TT=1800.12 T1=41.9	? (MO) TT=12.98	SAT (TO) f=-39 TT=1800.3 T1=70.72	SAT (TO) f=-40 TT=1800.48 T1=32.1	SAT (TO) f=-40 TT=1800.45 T1=74.54	SAT (TO) f=-36 TT=1800.44 T1=16.01	SAT (TO) f=-38 TT=1800.26 T1=1757.63	SAT (TO) f=-40 TT=1800.43 T1=1357.42	SAT f=-42 TT=1789.9 T1=1458.4	Wrong Opt. f=-17 TT=180.609 T1=180.64	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-4.opb	SAT f=-42 TT=1800.09 T1=563.02	SAT f=-40 TT=1798.1 T1=434.1	SAT (TO) f=-39 TT=1800.03 T1=13.92	SAT f=-37 TT=1798.69 T1=1799.17	SAT (TO) f=-42 TT=1800.14 T1=568.21	SAT (TO) f=-42 TT=1800.09 T1=563.02	? (MO) TT=12.89	SAT (TO) f=-39 TT=1800.32 T1=108	SAT (TO) f=-40 TT=1800.48 T1=112.31	SAT (TO) f=-41 TT=1800.39 T1=1188.34	SAT (TO) f=-36 TT=1800.41 T1=13.42	SAT (TO) f=-37 TT=1800.29 T1=333.45	SAT (TO) f=-36 TT=1800.43 T1=19.9	SAT f=-41 TT=1790.08 T1=1727.4	Wrong Opt. f=-20 TT=180.845 T1=180.86	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-5.opb	SAT f=-42 TT=1789.95 T1=1557.36	SAT f=-39 TT=1798.12 T1=1721.12	SAT f=-39 TT=1798.1 T1=23.67	? (TO) TT=1800.19	SAT (TO) f=-41 TT=1800.11 T1=437.61	SAT (TO) f=-41 TT=1800.09 T1=436.89	? (MO) TT=12.49	SAT (TO) f=-39 TT=1800.4 T1=64.46	SAT (TO) f=-40 TT=1800.45 T1=36.45	SAT (TO) f=-40 TT=1800.33 T1=25.35	SAT (TO) f=-37 TT=1800.47 T1=1340.03	SAT (TO) f=-36 TT=1800.25 T1=4.46	SAT (TO) f=-38 TT=1800.45 T1=532.05	SAT f=-42 TT=1789.95 T1=1557.36	Wrong Opt. f=-19 TT=180.783 T1=180.81	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-1.opb	SAT f=-44 TT=1790.11 T1=214	SAT f=-41 TT=1798.11 T1=3.72	SAT f=-41 TT=1798.11 T1=3.43	SAT f=-42 TT=1798.73 T1=1799.19	SAT (TO) f=-44 TT=1800.13 T1=218.93	SAT (TO) f=-44 TT=1800.15 T1=214	? (MO) TT=12.98	SAT (TO) f=-40 TT=1800.27 T1=637.86	SAT (TO) f=-43 TT=1800.47 T1=764.53	SAT (TO) f=-43 TT=1800.5 T1=621.6	SAT (TO) f=-40 TT=1800.5 T1=1376.7	SAT (TO) f=-40 TT=1800.36 T1=999.81	SAT (TO) f=-37 TT=1800.46 T1=547.45	SAT f=-44 TT=1790.11 T1=1655.15	Wrong Opt. f=-20 TT=180.735 T1=180.75	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-2.opb	SAT f=-44 TT=1800.16 T1=583.78	SAT f=-41 TT=1798.11 T1=50	SAT f=-41 TT=1798.11 T1=36.37	SAT f=-37 TT=1798.57 T1=1799.15	SAT (TO) f=-44 TT=1800.08 T1=601.8	SAT (TO) f=-44 TT=1800.16 T1=583.78	? (MO) TT=12.48	SAT (TO) f=-41 TT=1800.23 T1=6.98	SAT (TO) f=-42 TT=1800.57 T1=18.93	SAT (TO) f=-42 TT=1800.3 T1=12.89	SAT (TO) f=-38 TT=1800.49 T1=20.99	SAT (TO) f=-38 TT=1800.36 T1=32.24	SAT (TO) f=-39 TT=1800.44 T1=999.22	SAT f=-40 TT=1790.23 T1=1749.05	Wrong Opt. f=-19 TT=180.709 T1=180.76	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-3.opb	SAT f=-43 TT=1792.77 T1=50.05	SAT f=-42 TT=1798.11 T1=1070.84	SAT f=-42 TT=1798.11 T1=1119.82	SAT f=-40 TT=1798.66 T1=1799.2	SAT (TO) f=-43 TT=1800.08 T1=51.7	SAT (TO) f=-43 TT=1800.09 T1=50.05	? (MO) TT=12.99	SAT (TO) f=-42 TT=1800.28 T1=85.7	SAT (TO) f=-42 TT=1800.32 T1=32.71	SAT (TO) f=-43 TT=1800.37 T1=1726.69	SAT (TO) f=-40 TT=1800.48 T1=652.28	SAT (TO) f=-36 TT=1800.28 T1=646.89	SAT (TO) f=-38 TT=1800.53 T1=1285.43	SAT f=-43 TT=1792.77 T1=1544.4	Wrong Opt. f=-18 TT=180.765 T1=180.79	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-4.opb	SAT f=-43 TT=1800.1 T1=529.07	SAT f=-40 TT=1798.12 T1=20.13	SAT f=-41 TT=1798.11 T1=1379.86	SAT f=-40 TT=1798.64 T1=1799.21	SAT (TO) f=-43 TT=1800.09 T1=538.11	SAT (TO) f=-43 TT=1800.1 T1=529.07	? (MO) TT=12.88	SAT (TO) f=-40 TT=1800.24 T1=121.81	SAT (TO) f=-42 TT=1800.68 T1=46.31	SAT (TO) f=-41 TT=1800.43 T1=30.94	SAT (TO) f=-38 TT=1800.53 T1=20.28	SAT (TO) f=-37 TT=1800.32 T1=86.01	SAT (TO) f=-39 TT=1800.49 T1=1561.56	SAT f=-42 TT=1789.95 T1=1628.26	Wrong Opt. f=-22 TT=180.935 T1=180.95	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-5.opb	SAT f=-44 TT=1800.09 T1=1148.24	SAT f=-41 TT=1798.11 T1=713.95	SAT f=-41 TT=1798.11 T1=677.61	SAT f=-37 TT=1798.76 T1=1799.21	SAT (TO) f=-44 TT=1800.13 T1=1148.57	SAT (TO) f=-44 TT=1800.09 T1=1148.24	? (MO) TT=12.98	SAT (TO) f=-40 TT=1800.5 T1=293.74	SAT (TO) f=-42 TT=1800.44 T1=75.81	SAT (TO) f=-42 TT=1800.37 T1=50.05	SAT (TO) f=-38 TT=1800.47 T1=19.9	SAT (TO) f=-37 TT=1800.29 T1=289.22	SAT (TO) f=-38 TT=1800.49 T1=23.06	SAT f=-38 TT=1792.2 T1=25.05	Wrong Opt. f=-21 TT=180.83 T1=180.85	? (TO) TT=1800.07
Bench name	Best results	bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-1.opb	SAT f=-45 TT=1800.17 T1=225.42	SAT f=-43 TT=1798.11 T1=163.8	SAT f=-44 TT=1798.11 T1=1315.1	SAT f=-39 TT=1798.84 T1=1799.29	SAT (TO) f=-45 TT=1800.18 T1=230.55	SAT (TO) f=-45 TT=1800.17 T1=225.42	? (MO) TT=13.1	SAT (TO) f=-43 TT=1800.36 T1=255.03	SAT (TO) f=-44 TT=1800.53 T1=20.84	SAT (TO) f=-45 TT=1800.48 T1=1264.48	SAT (TO) f=-41 TT=1800.57 T1=25.98	SAT (TO) f=-38 TT=1800.32 T1=1138.38	SAT (TO) f=-41 TT=1800.6 T1=27.93	SAT f=-41 TT=1790.72 T1=28.95	Wrong Opt. f=-20 TT=180.815 T1=180.84	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-2.opb	SAT f=-45 TT=1800.05 T1=4.21	SAT f=-44 TT=1798.1 T1=9.78	SAT f=-42 TT=1798.12 T1=4.76	SAT f=-39 TT=1798.77 T1=1799.22	SAT (TO) f=-45 TT=1800.18 T1=4.65	SAT (TO) f=-45 TT=1800.05 T1=4.21	? (MO) TT=13.09	SAT (TO) f=-42 TT=1800.36 T1=46.53	SAT (TO) f=-44 TT=1800.54 T1=138.6	SAT (TO) f=-44 TT=1800.36 T1=107.27	SAT (TO) f=-39 TT=1800.52 T1=1225.17	SAT (TO) f=-38 TT=1800.33 T1=69.92	SAT (TO) f=-38 TT=1800.59 T1=25.04	SAT f=-38 TT=1792.13 T1=27.77	Wrong Opt. f=-20 TT=180.807 T1=180.84	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-3.opb	SAT f=-46 TT=1790.22 T1=446.82	SAT f=-44 TT=1798.12 T1=1110.81	SAT f=-45 TT=1798.11 T1=459.55	SAT f=-34 TT=1798.94 T1=1799.31	SAT (TO) f=-46 TT=1800.14 T1=451.07	SAT (TO) f=-46 TT=1800.12 T1=446.82	? (MO) TT=13.7	SAT (TO) f=-44 TT=1800.53 T1=909.17	SAT (TO) f=-44 TT=1800.54 T1=25.76	SAT (TO) f=-44 TT=1800.41 T1=16.18	SAT (TO) f=-42 TT=1800.54 T1=20.22	SAT (TO) f=-39 TT=1800.34 T1=1562.53	SAT (TO) f=-42 TT=1800.52 T1=25.06	SAT f=-46 TT=1790.22 T1=1784.93	Wrong Opt. f=-19 TT=180.735 T1=180.76	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-4.opb	SAT f=-45 TT=1800.14 T1=83.94	SAT f=-43 TT=1798.11 T1=4.05	SAT (TO) f=-45 TT=1800.2 T1=381.72	SAT f=-39 TT=1798.64 T1=1799.22	SAT (TO) f=-45 TT=1800.17 T1=276.89	SAT (TO) f=-45 TT=1800.14 T1=275.06	? (MO) TT=12.5	SAT (TO) f=-43 TT=1800.24 T1=295.74	SAT (TO) f=-45 TT=1800.48 T1=117.83	SAT (TO) f=-45 TT=1800.39 T1=83.94	SAT (TO) f=-42 TT=1800.6 T1=1380.29	SAT (TO) f=-42 TT=1800.38 T1=797.55	SAT (TO) f=-42 TT=1800.6 T1=1424.36	SAT f=-43 TT=1790.61 T1=1347.86	Wrong Opt. f=-20 TT=180.857 T1=180.89	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-5.opb	SAT f=-45 TT=1800.09 T1=105.28	SAT (TO) f=-44 TT=1800.17 T1=1086.99	SAT f=-43 TT=1798.2 T1=8.87	SAT f=-40 TT=1798.73 T1=1799.17	SAT (TO) f=-45 TT=1800.14 T1=261.98	SAT (TO) f=-45 TT=1800.09 T1=259.27	? (MO) TT=13.3	SAT (TO) f=-42 TT=1800.36 T1=42.14	SAT (TO) f=-45 TT=1800.72 T1=132.69	SAT (TO) f=-45 TT=1800.36 T1=105.28	SAT (TO) f=-40 TT=1800.59 T1=23.57	SAT (TO) f=-39 TT=1800.32 T1=1229.3	SAT (TO) f=-41 TT=1800.57 T1=909.08	SAT f=-41 TT=1790.38 T1=1643.57	Wrong Opt. f=-20 TT=180.886 T1=180.92	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-1.opb	SAT f=-48 TT=1800.1 T1=1372.18	SAT f=-46 TT=1798.11 T1=1243.53	SAT f=-46 TT=1798.12 T1=1434.77	SAT f=-42 TT=1798.71 T1=1799.23	SAT (TO) f=-48 TT=1800.14 T1=1370.99	SAT (TO) f=-48 TT=1800.1 T1=1372.18	? (MO) TT=13.02	SAT (TO) f=-45 TT=1800.27 T1=584.21	SAT (TO) f=-47 TT=1800.81 T1=36.2	SAT (TO) f=-47 TT=1800.36 T1=23.96	SAT (TO) f=-43 TT=1800.64 T1=29.8	SAT (TO) f=-43 TT=1800.4 T1=1575.98	SAT (TO) f=-43 TT=1800.6 T1=29.6	SAT f=-43 TT=1795.2 T1=32.4	Wrong Opt. f=-18 TT=180.812 T1=180.83	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-2.opb	SAT f=-48 TT=1800.18 T1=833.89	SAT f=-45 TT=1798.11 T1=26.24	SAT f=-47 TT=1798.11 T1=742.92	SAT f=-40 TT=1799.62 T1=1800.02	SAT (TO) f=-48 TT=1800.13 T1=826.62	SAT (TO) f=-48 TT=1800.18 T1=833.89	? (MO) TT=12.89	SAT (TO) f=-45 TT=1800.22 T1=345.98	SAT (TO) f=-46 TT=1800.64 T1=46.9	SAT (TO) f=-46 TT=1800.41 T1=32.63	SAT (TO) f=-40 TT=1800.61 T1=29.16	SAT (TO) f=-41 TT=1800.41 T1=494.23	SAT (TO) f=-43 TT=1800.67 T1=963.79	SAT f=-44 TT=1790.75 T1=1618.18	Wrong Opt. f=-21 TT=180.863 T1=180.87	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-3.opb	SAT f=-47 TT=1800.14 T1=130.46	SAT f=-46 TT=1798.11 T1=1625.76	SAT f=-44 TT=1798.24 T1=4.81	? (TO) TT=1800.07	SAT (TO) f=-47 TT=1800.13 T1=128.72	SAT (TO) f=-47 TT=1800.14 T1=130.46	? (MO) TT=12.99	SAT (TO) f=-45 TT=1800.3 T1=557.29	SAT (TO) f=-46 TT=1800.64 T1=37.44	SAT (TO) f=-46 TT=1800.33 T1=24.7	SAT (TO) f=-42 TT=1800.64 T1=948.98	SAT (TO) f=-42 TT=1800.4 T1=1248.02	SAT (TO) f=-41 TT=1800.65 T1=1345.32	SAT f=-37 TT=1793.7 T1=35.47	Wrong Opt. f=-20 TT=180.821 T1=180.85	? (TO) TT=1800.06
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-4.opb	SAT f=-48 TT=1800.08 T1=210.76	SAT f=-45 TT=1798.12 T1=45.26	SAT f=-47 TT=1798.11 T1=1774.11	SAT f=-41 TT=1799.22 T1=1799.63	SAT (TO) f=-48 TT=1800.08 T1=207.64	SAT (TO) f=-48 TT=1800.08 T1=210.76	? (MO) TT=13	SAT (TO) f=-45 TT=1800.39 T1=185.85	SAT (TO) f=-47 TT=1800.72 T1=378.11	SAT (TO) f=-47 TT=1800.4 T1=793.6	? (TO) TT=1802.08	SAT (TO) f=-41 TT=1800.41 T1=1354.95	SAT (TO) f=-45 TT=1800.61 T1=31.08	SAT f=-45 TT=1790.59 T1=33.64	Wrong Opt. f=-20 TT=180.825 T1=180.84	? (TO) TT=1800.05
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-5.opb	SAT f=-48 TT=1800.18 T1=702.86	SAT f=-45 TT=1798.12 T1=14.7	SAT f=-45 TT=1798.12 T1=8.99	SAT f=-44 TT=1798.75 T1=1799.28	SAT (TO) f=-48 TT=1800.13 T1=1241.8	SAT (TO) f=-48 TT=1800.18 T1=1277.1	? (MO) TT=12.49	SAT (TO) f=-46 TT=1800.31 T1=961.29	SAT (TO) f=-46 TT=1800.55 T1=77.79	SAT (TO) f=-48 TT=1800.63 T1=702.86	SAT (TO) f=-43 TT=1800.64 T1=1724.88	SAT (TO) f=-42 TT=1800.39 T1=30.1	SAT (TO) f=-41 TT=1800.66 T1=33.4	SAT f=-44 TT=1790.33 T1=1639.73	Wrong Opt. f=-20 TT=180.814 T1=180.85	? (TO) TT=1800.07

Statistics		bsolo 3.2 Card (complete)	bsolo 3.2 Cl (complete)	pb_cplex 2010-06-29 (complete)	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	PBPASSolver 2010-06-13 (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)	SCIPnone SCIP 1.2.1.2 without any LP solver (complete)	SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	wbo 1.4b (complete)	wbo 1.4b (fixed) (complete)
Number of times the solver is able to give the best known answer		8	10	9	0	28	0	0	12	16	12	0	16	43	0	0
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	1	5	0	17	0	0	3	8	3	0	0	37	0	0