PB'09 competition: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Random

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Random

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.1 (complete)
bsolo 3.1 cl (complete)
bsolo 3.1 pb (complete)
pbclasp 2009-04-24 (complete)
SAT4J Pseudo CP 2.1.1 (complete)
SAT4J Pseudo Resolution 2.1.1 (complete)
SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)
SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
wbo 1.0 (complete)

Bench name	Best results on this instance	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_1.opb	UNSAT TT=16.279	UNSAT TT=378.011	UNSAT TT=242.191	UNSAT TT=65.145	UNSAT TT=16.279	? (TO) TT=1800.21	? (TO) TT=1800.4	UNSAT TT=415.207	UNSAT TT=984.397	UNSAT TT=812.049
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_2.opb	UNSAT TT=8.296	UNSAT TT=178.779	UNSAT TT=111.046	UNSAT TT=79.852	UNSAT TT=8.296	? (TO) TT=1800.32	UNSAT TT=1015.95	UNSAT TT=190.191	UNSAT TT=492.134	UNSAT TT=378.301
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_3.opb	UNSAT TT=26.337	UNSAT TT=849.751	UNSAT TT=574.634	UNSAT TT=149.906	UNSAT TT=26.337	? (TO) TT=1800.33	? (TO) TT=1800.42	UNSAT TT=391.035	UNSAT TT=708.406	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_4_30_4.opb	UNSAT TT=10.212	UNSAT TT=175.22	UNSAT TT=117.47	UNSAT TT=88.857	UNSAT TT=10.212	? (TO) TT=1800.25	UNSAT TT=1320.93	UNSAT TT=162.076	UNSAT TT=228.183	UNSAT TT=512.097
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_1.opb		? TT=1798	? TT=1798	? TT=1798	? (TO) TT=1800.07	? (TO) TT=1800.27	? (TO) TT=1800.44	? (TO) TT=1802.04	? (TO) TT=1801.2	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_2.opb		? TT=1798	? TT=1798	? TT=1798	? (TO) TT=1800.05	? (TO) TT=1800.23	? (TO) TT=1800.48	? (TO) TT=1802.11	? (TO) TT=1801.13	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_3.opb	OPT f=0 TT=663.16 T1=663.35	? TT=1798.01	? TT=1798	OPT f=0 TT=663.16 T1=663.35	OPT f=0 TT=791.015 T1=791.29	? (TO) TT=1800.33	? (TO) TT=1800.43	? (TO) TT=1802.05	? (TO) TT=1801.16	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_5_40_4.opb		? TT=1798	? TT=1798	? TT=1798	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.5	? (TO) TT=1802.08	? (TO) TT=1801.44	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_1.opb		? TT=1798	? TT=1798	? TT=1798.01	? (TO) TT=1800.1	? (TO) TT=1800.21	? (TO) TT=1800.5	? (TO) TT=1802.09	? (TO) TT=1802.16	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_2.opb		? TT=1798	? TT=1798	? TT=1798	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.41	? (TO) TT=1802.15	? (TO) TT=1802.13	? (TO) TT=1800.25
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_3.opb		? TT=1798	? TT=1798	? TT=1798	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.41	? (TO) TT=1802.08	? (TO) TT=1802.15	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_6_50_4.opb		? TT=1798.14	? TT=1798.14	? TT=1798	? (TO) TT=1800.1	? (TO) TT=1800.23	? (TO) TT=1800.47	? (TO) TT=1802.17	? (TO) TT=1802.12	? (TO) TT=1800.28
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_1.opb		? TT=1798	? TT=1798	? TT=1798.01	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.48	? (TO) TT=1802.14	? (TO) TT=1802.13	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_2.opb		? TT=1798	? TT=1798	? TT=1798.01	? (TO) TT=1800.09	? (TO) TT=1800.62	? (TO) TT=1800.46	? (TO) TT=1802.09	? (TO) TT=1802.17	? (TO) TT=1800.26
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_3.opb		? TT=1798	? TT=1798.04	? TT=1798.01	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.41	? (TO) TT=1802.07	? (TO) TT=1802.12	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_7_60_4.opb		? TT=1798	? TT=1798	? TT=1798.01	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.53	? (TO) TT=1802.16	? (TO) TT=1802.22	? (TO) TT=1800.31
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_1.opb		? TT=1798	? TT=1798	? TT=1798.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.49	? (TO) TT=1801.81	? (TO) TT=1802.16	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_2.opb		? TT=1798.01	? TT=1798	? TT=1798	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.5	? (TO) TT=1802.08	? (TO) TT=1802.16	? (TO) TT=1800.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_3.opb		? TT=1798.01	? TT=1798	? TT=1798	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.5	? (TO) TT=1802.09	? (TO) TT=1802.15	? (TO) TT=1800.29
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-market-split_8_70_4.opb		? TT=1798	? TT=1798	? TT=1798	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.58	? (TO) TT=1801.93	? (TO) TT=1802.17	? (TO) TT=1800.27
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_1.opb	OPT f=2 TT=26.176 T1=4.69	OPT f=2 TT=443.655 T1=29.38	OPT f=2 TT=351.126 T1=32.37	OPT f=2 TT=649.987 T1=53.26	OPT f=2 TT=26.176 T1=4.69	SAT (TO) f=110 TT=1800.31 T1=463.94	SAT (TO) f=2 TT=1800.42 T1=210.97	OPT f=2 TT=671.462 T1=267.89	OPT f=2 TT=388.691 T1=77.03	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_2.opb	OPT f=1 TT=12.626 T1=7.19	OPT f=1 TT=262.592 T1=113.71	OPT f=1 TT=181.137 T1=53.07	OPT f=1 TT=270.171 T1=12.43	OPT f=1 TT=12.626 T1=7.85	SAT (TO) f=291 TT=1800.22 T1=1452.92	SAT (TO) f=1 TT=1800.41 T1=812.79	OPT f=1 TT=805.872 T1=181.81	OPT f=1 TT=249.223 T1=7.19	OPT f=1 TT=419.812 T1=419.86
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_3.opb	OPT f=2 TT=47.091 T1=3.84	OPT f=2 TT=1244.46 T1=79.69	OPT f=2 TT=1211.29 T1=77.04	OPT f=2 TT=597.394 T1=95.16	OPT f=2 TT=47.091 T1=3.84	SAT (TO) f=191 TT=1800.27 T1=97.05	SAT (TO) f=2 TT=1800.4 T1=192.96	OPT f=2 TT=444.473 T1=18.76	OPT f=2 TT=306.333 T1=29.43	? (TO) TT=1800.18
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_4_30_4.opb	OPT f=1 TT=22.047 T1=17.71	OPT f=1 TT=298.954 T1=22.22	OPT f=1 TT=241.622 T1=165.85	OPT f=1 TT=439.788 T1=264.72	OPT f=1 TT=22.047 T1=17.71	SAT (TO) f=142 TT=1800.33 T1=1424.56	SAT (TO) f=1 TT=1800.38 T1=612.87	OPT f=1 TT=722.113 T1=575.33	OPT f=1 TT=442.017 T1=118.3	OPT f=1 TT=786.491 T1=786.63
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_1.opb	OPT f=0 TT=695.946 T1=696.2	SAT f=4 TT=1798.01 T1=848.52	SAT f=3 TT=1798 T1=10.53	SAT f=4 TT=1798 T1=295.03	OPT f=0 TT=695.946 T1=696.2	SAT (TO) f=343 TT=1800.25 T1=1127.98	SAT (TO) f=5 TT=1800.44 T1=1170.24	SAT (TO) f=1 TT=1801.02 T1=1357.4	SAT (TO) f=2 TT=1800.49 T1=120.21	? (TO) TT=1800.22
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_2.opb	SAT f=2 TT=1798 T1=190.18	SAT f=3 TT=1798 T1=1081.86	SAT f=2 TT=1798 T1=498.28	SAT f=2 TT=1798 T1=190.18	SAT (TO) f=2 TT=1800.03 T1=723.55	SAT (TO) f=159 TT=1800.23 T1=1639.89	SAT (TO) f=9 TT=1800.37 T1=1363.71	SAT (TO) f=2 TT=1800.13 T1=362.82	SAT (TO) f=3 TT=1800.95 T1=203.02	? (TO) TT=1800.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_3.opb	SAT f=1 TT=1800.47 T1=268.51	SAT f=3 TT=1798 T1=409.62	SAT f=2 TT=1798 T1=1347.37	SAT f=4 TT=1798 T1=270.52	SAT (TO) f=2 TT=1800.06 T1=210.31	SAT (TO) f=287 TT=1800.18 T1=711.01	SAT (TO) f=8 TT=1800.43 T1=906.81	SAT (TO) f=3 TT=1800.36 T1=679.86	SAT (TO) f=1 TT=1800.47 T1=268.51	? (TO) TT=1800.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_5_40_4.opb	SAT f=2 TT=1800.05 T1=259.9	SAT f=3 TT=1798 T1=1733.3	SAT f=3 TT=1798 T1=1349.51	SAT f=4 TT=1798.01 T1=383.54	SAT (TO) f=2 TT=1800.05 T1=259.9	SAT (TO) f=627 TT=1800.22 T1=500.3	SAT (TO) f=3 TT=1800.61 T1=1712.09	SAT (TO) f=1 TT=1800.15 T1=347.67	SAT (TO) f=2 TT=1800.91 T1=600.07	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_1.opb	SAT f=6 TT=1800.09 T1=1291.85	SAT f=15 TT=1798 T1=636.43	SAT f=9 TT=1798 T1=773.4	SAT f=7 TT=1798.09 T1=1743.72	SAT (TO) f=6 TT=1800.09 T1=1291.85	SAT (TO) f=461 TT=1800.16 T1=679.29	SAT (TO) f=22 TT=1800.43 T1=1622.77	SAT (TO) f=5 TT=1801.11 T1=1285.16	SAT (TO) f=8 TT=1801.37 T1=451.1	? (TO) TT=1800.33
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_2.opb	SAT f=6 TT=1800.13 T1=904.39	SAT f=11 TT=1798 T1=354.64	SAT f=10 TT=1798.18 T1=120.45	SAT f=11 TT=1798.01 T1=1454.71	SAT (TO) f=6 TT=1800.13 T1=904.39	SAT (TO) f=240 TT=1800.23 T1=584	SAT (TO) f=14 TT=1800.38 T1=1486.95	SAT (TO) f=6 TT=1800.58 T1=291.59	SAT (TO) f=7 TT=1802.17 T1=89.88	? (TO) TT=1800.28
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_3.opb	SAT f=5 TT=1800.1 T1=1389.72	SAT f=10 TT=1798 T1=1535.87	SAT f=10 TT=1798 T1=1152.23	SAT f=8 TT=1798.01 T1=283.66	SAT (TO) f=5 TT=1800.1 T1=1389.72	SAT (TO) f=243 TT=1800.18 T1=1561.65	SAT (TO) f=16 TT=1800.42 T1=1383.64	SAT (TO) f=5 TT=1800.23 T1=190.86	SAT (TO) f=6 TT=1802.09 T1=255.49	? (TO) TT=1800.29
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_6_50_4.opb	SAT f=8 TT=1800.05 T1=173.05	SAT f=13 TT=1798 T1=711.08	SAT f=9 TT=1798 T1=1727.67	SAT f=10 TT=1798.94 T1=1210.89	SAT (TO) f=8 TT=1800.05 T1=1194.32	SAT (TO) f=481 TT=1800.13 T1=118.32	SAT (TO) f=23 TT=1800.43 T1=1672.15	SAT (TO) f=7 TT=1800.57 T1=1578.27	SAT (TO) f=8 TT=1801.57 T1=173.05	? (TO) TT=1800.29
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_1.opb	SAT f=11 TT=1802.14 T1=1077.27	SAT f=26 TT=1798 T1=1682.43	SAT f=34 TT=1798 T1=233.02	SAT f=22 TT=1798.01 T1=753.24	SAT (TO) f=15 TT=1800.06 T1=1742.18	SAT (TO) f=355 TT=1800.26 T1=1188.73	SAT (TO) f=175 TT=1800.48 T1=1752.61	SAT (TO) f=11 TT=1801.48 T1=1237.3	SAT (TO) f=11 TT=1802.14 T1=1077.27	? (TO) TT=1800.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_2.opb	SAT f=10 TT=1802.12 T1=1098.43	SAT f=28 TT=1798 T1=990.67	SAT f=82 TT=1798 T1=30.16	SAT f=29 TT=1798 T1=1794.33	SAT (TO) f=100 TT=1800.13 T1=1431.7	SAT (TO) f=1010 TT=1800.3 T1=150.28	SAT (TO) f=131 TT=1800.48 T1=313.34	SAT (TO) f=13 TT=1801.87 T1=410.74	SAT (TO) f=10 TT=1802.12 T1=1098.43	? (TO) TT=1800.3
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_3.opb	SAT f=10 TT=1802.13 T1=1254.62	SAT f=140 TT=1798 T1=426.39	SAT f=40 TT=1798 T1=1247.17	SAT f=22 TT=1798 T1=1777.11	SAT (TO) f=14 TT=1800.06 T1=834.6	SAT (TO) f=1199 TT=1800.1 T1=25.2	SAT (TO) f=97 TT=1800.45 T1=1795.16	SAT (TO) f=9 TT=1801.86 T1=1419.07	SAT (TO) f=10 TT=1802.13 T1=1254.62	? (TO) TT=1800.31
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_7_60_4.opb	SAT f=13 TT=1802.15 T1=839.48	SAT f=39 TT=1798 T1=1682.28	SAT f=24 TT=1798 T1=819.35	SAT f=25 TT=1798.09 T1=1669.88	SAT (TO) f=14 TT=1800.12 T1=1772.06	SAT (TO) f=685 TT=1800.16 T1=861.74	SAT (TO) f=50 TT=1800.47 T1=1711.32	SAT (TO) f=11 TT=1802.01 T1=1001.6	SAT (TO) f=13 TT=1802.15 T1=839.48	? (TO) TT=1800.32
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_1.opb	SAT f=17 TT=1802.13 T1=1736	SAT f=75 TT=1798 T1=390.86	SAT f=92 TT=1798 T1=545.04	SAT (TO) f=46 TT=1800.07 T1=1284.21	SAT (TO) f=61 TT=1800.1 T1=1683.74	SAT (TO) f=1535 TT=1800.18 T1=1292.84	SAT (TO) f=387 TT=1800.61 T1=1058.27	SAT (TO) f=17 TT=1802.06 T1=1738	SAT (TO) f=17 TT=1802.13 T1=1736	? (TO) TT=1800.34
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_2.opb	SAT f=15 TT=1802.17 T1=1328.21	SAT f=95 TT=1798 T1=491.21	SAT f=184 TT=1798 T1=15.45	SAT f=63 TT=1798.01 T1=1229.88	SAT (TO) f=71 TT=1800.13 T1=1395.09	SAT (TO) f=1631 TT=1800.2 T1=1014.41	SAT (TO) f=218 TT=1800.47 T1=732.42	SAT (TO) f=19 TT=1802.11 T1=1125.35	SAT (TO) f=15 TT=1802.17 T1=1328.21	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_3.opb	SAT f=19 TT=1802.16 T1=1066	SAT f=99 TT=1798.01 T1=394.2	SAT f=86 TT=1798 T1=1757.02	SAT f=79 TT=1798.01 T1=212.49	SAT (TO) f=150 TT=1800.07 T1=355.63	SAT (TO) f=620 TT=1800.22 T1=1779.24	SAT (TO) f=470 TT=1800.45 T1=1148.3	SAT (TO) f=16 TT=1801.87 T1=1100.07	SAT (TO) f=19 TT=1802.16 T1=1066	? (TO) TT=1800.36
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/market-split/ normalized-opt-market-split_8_70_4.opb	SAT f=23 TT=1802.11 T1=1214.3	SAT f=92 TT=1798 T1=189.79	SAT f=99 TT=1798 T1=1625.56	SAT f=45 TT=1798.01 T1=733.83	SAT (TO) f=287 TT=1800.1 T1=1613.93	SAT (TO) f=813 TT=1800.2 T1=259.54	SAT (TO) f=392 TT=1800.53 T1=1789.92	SAT (TO) f=21 TT=1802.13 T1=1598.73	SAT (TO) f=23 TT=1802.11 T1=1214.3	? (TO) TT=1800.29
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-1.opb	SAT f=-28 TT=1796.4 T1=1498.67	SAT f=-25 TT=1798.03 T1=64.6	SAT f=-25 TT=1798.03 T1=119.95	SAT f=-25 TT=1798.05 T1=97.99	SAT (TO) f=-25 TT=1800.03 T1=211.9	SAT (TO) f=-26 TT=1800.27 T1=472.37	SAT (TO) f=-25 TT=1800.48 T1=3.24	SAT f=-29 TT=1795.25 T1=1206.03	SAT f=-28 TT=1796.4 T1=1498.67	? (TO) TT=1800.29
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-2.opb	SAT f=-28 TT=1796.29 T1=866.4	SAT f=-26 TT=1798.03 T1=1552.64	SAT f=-25 TT=1798.03 T1=206.83	SAT f=-25 TT=1798.02 T1=161.26	SAT (TO) f=-25 TT=1800.08 T1=13.34	SAT (TO) f=-25 TT=1800.25 T1=1406.86	SAT (TO) f=-25 TT=1800.59 T1=255.21	SAT f=-28 TT=1794.96 T1=1289.9	SAT f=-28 TT=1796.29 T1=866.4	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-3.opb	SAT f=-29 TT=1796.65 T1=1511.17	SAT f=-26 TT=1798.03 T1=5.2	SAT f=-25 TT=1798.04 T1=0.27	SAT f=-25 TT=1798.03 T1=82.67	SAT (TO) f=-26 TT=1800.01 T1=176.53	SAT (TO) f=-25 TT=1800.48 T1=292	SAT (TO) f=-25 TT=1800.56 T1=4.25	SAT (TO) f=-28 TT=1800.23 T1=338.13	SAT f=-29 TT=1796.65 T1=1511.17	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-4.opb	SAT f=-29 TT=1796.88 T1=883.54	SAT f=-26 TT=1798.03 T1=113.4	SAT f=-26 TT=1798.03 T1=1644.62	SAT f=-25 TT=1798.12 T1=807.45	SAT (TO) f=-26 TT=1800.03 T1=1090.1	SAT (TO) f=-25 TT=1800.22 T1=108.93	SAT (TO) f=-25 TT=1800.53 T1=103.34	SAT f=-28 TT=1797.85 T1=1117.04	SAT f=-29 TT=1796.88 T1=883.54	? (TO) TT=1800.3
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb30-15-opb/normalized-frb30-15-5.opb	SAT f=-28 TT=1796.11 T1=603.6	SAT f=-25 TT=1798.03 T1=21.53	SAT f=-25 TT=1798.04 T1=715.19	SAT f=-24 TT=1798.07 T1=12.33	SAT (TO) f=-25 TT=1800.05 T1=266.86	SAT (TO) f=-25 TT=1800.3 T1=306.2	SAT (TO) f=-25 TT=1800.48 T1=5.21	SAT f=-28 TT=1798.72 T1=781.43	SAT f=-28 TT=1796.11 T1=603.6	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-1.opb	SAT f=-31 TT=1795.41 T1=627.22	SAT f=-28 TT=1798.06 T1=36.57	SAT f=-29 TT=1798.06 T1=31.83	SAT f=-29 TT=1798.08 T1=689.94	SAT (TO) f=-28 TT=1800.1 T1=0.38	SAT (TO) f=-28 TT=1800.23 T1=2.06	SAT (TO) f=-29 TT=1800.54 T1=13.04	SAT f=-32 TT=1794.3 T1=545.24	SAT f=-31 TT=1795.41 T1=627.22	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-2.opb	SAT f=-32 TT=1795.47 T1=909.41	SAT f=-29 TT=1798.06 T1=107.28	SAT f=-30 TT=1798.06 T1=640.81	SAT f=-28 TT=1798.04 T1=6.08	SAT (TO) f=-27 TT=1800.05 T1=43.83	SAT (TO) f=-27 TT=1800.32 T1=6.77	SAT (TO) f=-29 TT=1800.6 T1=820.61	SAT f=-31 TT=1795.8 T1=261.47	SAT f=-32 TT=1795.47 T1=909.41	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-3.opb	SAT f=-32 TT=1795.72 T1=544.9	SAT f=-29 TT=1798.06 T1=8.19	SAT f=-29 TT=1798.07 T1=4.42	SAT f=-29 TT=1798.12 T1=500.24	SAT (TO) f=-29 TT=1800.08 T1=5.32	SAT (TO) f=-29 TT=1800.22 T1=244.88	SAT (TO) f=-29 TT=1800.45 T1=380.99	SAT f=-33 TT=1794.42 T1=1146.81	SAT f=-32 TT=1795.72 T1=544.9	? (TO) TT=1800.27
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-4.opb	SAT f=-32 TT=1795.38 T1=1571.84	SAT f=-29 TT=1798.05 T1=904.82	SAT f=-30 TT=1798.05 T1=310.48	SAT f=-28 TT=1798.04 T1=0.54	SAT (TO) f=-28 TT=1800.06 T1=54.4	SAT (TO) f=-29 TT=1800.26 T1=146.64	SAT (TO) f=-28 TT=1800.49 T1=3.93	SAT f=-32 TT=1795.29 T1=884.09	SAT f=-32 TT=1795.38 T1=1571.84	? (TO) TT=1800.24
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb35-17-opb/normalized-frb35-17-5.opb	SAT f=-31 TT=1795.64 T1=598.32	SAT f=-29 TT=1798.06 T1=9.1	SAT f=-30 TT=1798.06 T1=1246.28	SAT f=-29 TT=1798.05 T1=1350	SAT (TO) f=-30 TT=1800.04 T1=407.47	SAT (TO) f=-28 TT=1800.31 T1=181.93	SAT (TO) f=-28 TT=1800.53 T1=6.51	SAT f=-31 TT=1795.68 T1=541.35	SAT f=-31 TT=1795.64 T1=598.32	? (TO) TT=1800.18
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-1.opb	SAT f=-35 TT=1795.08 T1=1157.34	SAT f=-31 TT=1798.09 T1=30.39	SAT f=-32 TT=1798.12 T1=250.9	SAT f=-32 TT=1798.14 T1=359.35	SAT (TO) f=-33 TT=1800.09 T1=416.45	SAT (TO) f=-32 TT=1800.32 T1=1.47	SAT (TO) f=-33 TT=1800.56 T1=32.56	SAT f=-35 TT=1793.9 T1=745.66	SAT f=-35 TT=1795.08 T1=1157.34	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-2.opb	SAT f=-35 TT=1795.16 T1=841.94	SAT f=-33 TT=1798.09 T1=1108.82	SAT f=-32 TT=1798.1 T1=2.2	SAT f=-32 TT=1798.06 T1=10.48	SAT (TO) f=-32 TT=1800.05 T1=54.35	SAT (TO) f=-32 TT=1800.3 T1=54.78	SAT (TO) f=-32 TT=1800.46 T1=6.53	SAT f=-36 TT=1794.39 T1=1228.97	SAT f=-35 TT=1795.16 T1=841.94	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-3.opb	SAT f=-35 TT=1795.56 T1=1256.11	SAT f=-33 TT=1798.1 T1=205.33	SAT f=-32 TT=1798.14 T1=5.26	SAT f=-31 TT=1798.06 T1=0.77	SAT (TO) f=-32 TT=1800 T1=1.02	SAT (TO) f=-31 TT=1800.32 T1=16.83	SAT (TO) f=-33 TT=1800.52 T1=934.48	SAT f=-34 TT=1794.84 T1=762.4	SAT f=-35 TT=1795.56 T1=1256.11	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-4.opb	SAT f=-35 TT=1794.8 T1=1281.29	SAT f=-33 TT=1798.08 T1=1445.67	SAT f=-32 TT=1798.1 T1=171.19	SAT f=-32 TT=1798.09 T1=87.25	SAT (TO) f=-32 TT=1800.05 T1=0.39	SAT (TO) f=-31 TT=1800.35 T1=20.11	SAT (TO) f=-32 TT=1800.48 T1=3.44	SAT f=-36 TT=1794.54 T1=962.43	SAT f=-35 TT=1794.8 T1=1281.29	? (TO) TT=1800.23
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb40-19-opb/normalized-frb40-19-5.opb	SAT f=-34 TT=1795.47 T1=1353.43	SAT f=-32 TT=1798.08 T1=572.32	SAT (TO) f=-33 TT=1800.11 T1=1509.82	SAT f=-32 TT=1798.09 T1=87.09	SAT (TO) f=-33 TT=1800.09 T1=328.23	SAT (TO) f=-32 TT=1800.44 T1=4.16	SAT (TO) f=-32 TT=1800.52 T1=11.03	SAT f=-34 TT=1794.2 T1=697.62	SAT f=-34 TT=1795.47 T1=1353.43	? (TO) TT=1800.21
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-1.opb	SAT f=-39 TT=1795.56 T1=1488.6	SAT f=-35 TT=1798.15 T1=109.79	SAT f=-35 TT=1798.14 T1=190.31	SAT f=-35 TT=1798.18 T1=399.39	SAT (TO) f=-35 TT=1800.09 T1=0.98	SAT (TO) f=-36 TT=1800.37 T1=436.34	SAT (TO) f=-34 TT=1800.55 T1=2.07	SAT f=-38 TT=1795.77 T1=1334.19	SAT f=-39 TT=1795.56 T1=1488.6	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-2.opb	SAT f=-38 TT=1795.34 T1=1011.35	SAT f=-37 TT=1798.15 T1=367.72	SAT f=-36 TT=1798.17 T1=47.79	SAT f=-36 TT=1798.31 T1=98.38	SAT (TO) f=-36 TT=1800.05 T1=1390.49	SAT (TO) f=-36 TT=1800.48 T1=898.68	SAT (TO) f=-35 TT=1800.48 T1=145.91	SAT f=-39 TT=1794.13 T1=1009.57	SAT f=-38 TT=1795.34 T1=1011.35	? (TO) TT=1800.18
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-3.opb	SAT f=-38 TT=1795.18 T1=1123.65	SAT f=-36 TT=1798.14 T1=260.55	SAT (TO) f=-36 TT=1800.22 T1=257.2	SAT f=-35 TT=1798.13 T1=423.36	SAT (TO) f=-36 TT=1800.08 T1=171.96	SAT (TO) f=-34 TT=1800.31 T1=8.73	SAT (TO) f=-36 TT=1800.52 T1=87.44	SAT f=-38 TT=1794.01 T1=1093.49	SAT f=-38 TT=1795.18 T1=1123.65	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-4.opb	SAT f=-38 TT=1794.83 T1=1452.79	SAT f=-37 TT=1798.15 T1=449.61	SAT f=-35 TT=1798.15 T1=1.53	SAT f=-35 TT=1798.12 T1=6.81	SAT (TO) f=-36 TT=1800.07 T1=15.48	SAT (TO) f=-35 TT=1800.28 T1=2.01	SAT (TO) f=-37 TT=1800.46 T1=1119.8	SAT f=-38 TT=1794.14 T1=1074.33	SAT f=-38 TT=1794.83 T1=1452.79	? (TO) TT=1800.2
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb45-21-opb/normalized-frb45-21-5.opb	SAT f=-38 TT=1795 T1=1646.43	SAT f=-36 TT=1798.14 T1=455.63	SAT f=-36 TT=1798.16 T1=16.84	SAT f=-37 TT=1798.16 T1=260.45	SAT (TO) f=-35 TT=1800.04 T1=0.5	SAT (TO) f=-35 TT=1800.37 T1=396.22	SAT (TO) f=-35 TT=1800.82 T1=11.53	SAT f=-38 TT=1794.23 T1=1096.84	SAT f=-38 TT=1795 T1=1646.43	? (TO) TT=1800.13
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-1.opb	SAT f=-41 TT=1795.1 T1=1678.25	SAT f=-39 TT=1798.24 T1=4.02	SAT f=-39 TT=1798.23 T1=3.15	SAT f=-39 TT=1798.21 T1=2.54	SAT (TO) f=-40 TT=1800.08 T1=2.87	SAT (TO) f=-39 TT=1800.36 T1=27.05	SAT (TO) f=-40 TT=1800.83 T1=651.57	SAT f=-42 TT=1794.65 T1=865.5	SAT f=-41 TT=1795.1 T1=1678.25	? (TO) TT=1800.16
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-2.opb	SAT f=-41 TT=1800.09 T1=1504.8	SAT f=-39 TT=1798.19 T1=681.14	SAT (TO) f=-40 TT=1800.24 T1=189.14	SAT f=-38 TT=1798.15 T1=308.43	SAT (TO) f=-41 TT=1800.09 T1=1504.8	SAT (TO) f=-38 TT=1800.34 T1=34.93	SAT (TO) f=-39 TT=1800.52 T1=25.83	SAT f=-35 TT=1794.24 T1=791.86	SAT f=-40 TT=1795.05 T1=1658.17	? (TO) TT=1800.19
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-3.opb	SAT f=-42 TT=1794.81 T1=1636.74	SAT f=-39 TT=1798.22 T1=498.03	SAT f=-40 TT=1798.21 T1=1233.63	SAT f=-38 TT=1798.16 T1=2.39	SAT (TO) f=-39 TT=1800.02 T1=142.94	SAT (TO) f=-39 TT=1800.41 T1=15.01	SAT (TO) f=-38 TT=1800.59 T1=25.52	SAT f=-41 TT=1794.88 T1=965.86	SAT f=-42 TT=1794.81 T1=1636.74	? (TO) TT=1800.14
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-4.opb	SAT f=-40 TT=1795.51 T1=29.55	SAT f=-40 TT=1798.23 T1=142.19	SAT f=-39 TT=1798.24 T1=13.53	SAT f=-39 TT=1798.13 T1=229.92	SAT (TO) f=-39 TT=1800.05 T1=0.98	SAT (TO) f=-40 TT=1800.41 T1=695.92	SAT (TO) f=-40 TT=1800.51 T1=29.55	SAT f=-41 TT=1794.33 T1=1578.8	SAT f=-40 TT=1795.51 T1=1572.79	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb50-23-opb/normalized-frb50-23-5.opb	SAT f=-40 TT=1794.61 T1=640.77	SAT f=-39 TT=1798.22 T1=1408.61	SAT f=-40 TT=1798.23 T1=640.77	SAT f=-39 TT=1798.29 T1=164.43	SAT (TO) f=-40 TT=1800.03 T1=1088.91	SAT (TO) f=-38 TT=1800.32 T1=10.85	SAT (TO) f=-38 TT=1800.51 T1=3.94	SAT f=-43 TT=1794.44 T1=1792.09	SAT f=-40 TT=1794.61 T1=1636.05	? (TO) TT=1800.17
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-1.opb	SAT f=-42 TT=1798.21 T1=999.55	SAT (MO) f=-41 TT=1620.1 T1=3.45	SAT (MO) f=-41 TT=1632.76 T1=3.36	SAT f=-42 TT=1798.21 T1=999.55	SAT (TO) f=-42 TT=1800.03 T1=1680.52	SAT (TO) f=-40 TT=1800.42 T1=8.41	SAT (TO) f=-40 TT=1800.52 T1=6.21	SAT f=-37 TT=1794.01 T1=622.49	SAT f=-40 TT=1794.7 T1=1536.36	? (TO) TT=1800.13
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-2.opb	SAT f=-42 TT=1800.41 T1=662.39	SAT f=-42 TT=1798.28 T1=304	SAT (MO) f=-41 TT=1268.56 T1=36.57	SAT f=-41 TT=1798.23 T1=342.95	SAT (TO) f=-41 TT=1800.06 T1=11.99	SAT (TO) f=-42 TT=1800.41 T1=662.39	SAT (TO) f=-41 TT=1800.5 T1=734.88	SAT f=-15 TT=1794.43 T1=1794.68	SAT f=-39 TT=1794.99 T1=1575.02	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-3.opb	SAT f=-43 TT=1800.01 T1=1426.93	SAT (MO) f=-40 TT=1676.35 T1=4.34	SAT f=-41 TT=1798.26 T1=1476.13	SAT f=-41 TT=1798.17 T1=80.17	SAT (TO) f=-43 TT=1800.01 T1=1426.93	SAT (TO) f=-41 TT=1800.42 T1=114.49	SAT (TO) f=-40 TT=1800.49 T1=8.15	SAT f=-42 TT=1794.9 T1=1756.79	SAT f=-42 TT=1794.91 T1=1689.73	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-4.opb	SAT f=-42 TT=1800.49 T1=63.84	SAT f=-40 TT=1798.25 T1=17.64	SAT (MO) f=-40 TT=1208.96 T1=9.71	SAT f=-41 TT=1798.27 T1=883.82	SAT (TO) f=-40 TT=1800.04 T1=0.83	SAT (TO) f=-41 TT=1800.37 T1=1146	SAT (TO) f=-42 TT=1800.49 T1=63.84	SAT f=-36 TT=1794.72 T1=1159.28	SAT f=-39 TT=1797.85 T1=1794.75	? (TO) TT=1800.07
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb53-24-opb/normalized-frb53-24-5.opb	SAT f=-42 TT=1798.27 T1=435.72	SAT f=-41 TT=1798.27 T1=357.89	SAT f=-42 TT=1798.27 T1=801.3	SAT f=-40 TT=1798.17 T1=6.31	SAT (TO) f=-42 TT=1800.03 T1=435.72	SAT (TO) f=-40 TT=1800.37 T1=581.84	SAT (TO) f=-41 TT=1800.51 T1=11.32	SAT f=-36 TT=1794.13 T1=550.87	SAT f=-37 TT=1795.55 T1=590.61	? (TO) TT=1800.17
Bench name	Best results	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-1.opb	SAT f=-45 TT=1800.04 T1=507.87	SAT (MO) f=-43 TT=659.477 T1=143.35	SAT (MO) f=-43 TT=885.678 T1=394.9	SAT f=-42 TT=1798.19 T1=302.15	SAT (TO) f=-45 TT=1800.04 T1=507.87	SAT (TO) f=-42 TT=1800.41 T1=2.24	SAT (TO) f=-42 TT=1800.45 T1=2.17	SAT f=-39 TT=1794.42 T1=723.3	SAT f=-38 TT=1796.08 T1=1702.81	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-2.opb	SAT f=-44 TT=1798.25 T1=179.24	SAT (MO) f=-44 TT=708.779 T1=8.35	SAT (MO) f=-42 TT=705.602 T1=4.69	SAT f=-44 TT=1798.25 T1=294.94	SAT (TO) f=-44 TT=1800.02 T1=179.24	SAT (TO) f=-43 TT=1800.44 T1=341.34	SAT (TO) f=-43 TT=1800.81 T1=729.71	SAT f=-43 TT=1794.56 T1=1592.76	SAT f=-40 TT=1795.31 T1=745.12	? (TO) TT=1800.15
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-3.opb	SAT f=-44 TT=1800.1 T1=1.02	SAT (MO) f=-41 TT=853.686 T1=5.52	SAT (MO) f=-43 TT=467.835 T1=81.63	SAT f=-43 TT=1798.2 T1=1408.65	SAT (TO) f=-44 TT=1800.1 T1=1.02	SAT (TO) f=-43 TT=1800.5 T1=104.93	SAT (TO) f=-43 TT=1800.62 T1=5.44	SAT f=-37 TT=1794.54 T1=945.06	SAT f=-43 TT=1795.66 T1=1583.28	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-4.opb	SAT f=-45 TT=954.461 T1=405.1	SAT (MO) f=-45 TT=798.578 T1=185.43	SAT (MO) f=-45 TT=954.461 T1=405.1	SAT f=-44 TT=1798.22 T1=503.93	SAT (TO) f=-43 TT=1800.02 T1=4.98	SAT (TO) f=-44 TT=1800.49 T1=401.44	SAT (TO) f=-44 TT=1800.6 T1=37.75	SAT f=-39 TT=1795.02 T1=1431.42	SAT f=-39 TT=1797.72 T1=567.88	? (TO) TT=1800.11
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb56-25-opb/normalized-frb56-25-5.opb	SAT f=-43 TT=568.149 T1=8.8	SAT (MO) f=-43 TT=851.043 T1=13.77	SAT (MO) f=-43 TT=568.149 T1=8.8	SAT f=-43 TT=1798.16 T1=349.44	SAT (TO) f=-43 TT=1800.1 T1=570.19	SAT (TO) f=-43 TT=1800.64 T1=1454.29	SAT (TO) f=-43 TT=1800.57 T1=26.57	SAT f=-45 TT=1794.96 T1=1734.55	SAT f=-37 TT=1797.74 T1=704.87	? (TO) TT=1800.09
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-1.opb	SAT f=-46 TT=1800.07 T1=115.87	SAT (MO) f=-45 TT=691.13 T1=103.29	SAT (MO) f=-44 TT=434.165 T1=6.27	SAT f=-45 TT=1798.18 T1=372.64	SAT (TO) f=-46 TT=1800.07 T1=115.87	SAT (TO) f=-45 TT=1800.39 T1=915.41	SAT (TO) f=-46 TT=1800.78 T1=154.78	SAT f=-48 TT=1795 T1=1641.47	SAT f=-39 TT=1797.7 T1=520.94	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-2.opb	SAT f=-46 TT=1798.3 T1=127	SAT (MO) f=-45 TT=674.264 T1=22.04	SAT (MO) f=-45 TT=384.57 T1=12.89	SAT f=-46 TT=1798.3 T1=1778.85	SAT (TO) f=-46 TT=1800.06 T1=127	SAT (TO) f=-45 TT=1800.45 T1=617.93	SAT (TO) f=-45 TT=1800.57 T1=25.46	SAT f=-41 TT=1794.65 T1=690.95	SAT f=-42 TT=1797.93 T1=627.22	? (TO) TT=1800.12
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-3.opb	SAT f=-45 TT=1800.07 T1=1.34	SAT (MO) f=-45 TT=659.968 T1=49.33	SAT (MO) f=-44 TT=431.055 T1=4.59	SAT f=-44 TT=1798.24 T1=4.73	SAT (TO) f=-45 TT=1800.07 T1=1.34	SAT (TO) f=-45 TT=1800.43 T1=326.06	SAT (TO) f=-43 TT=1800.5 T1=2.87	SAT f=-41 TT=1795.06 T1=1288.29	SAT f=-38 TT=1799.36 T1=1033.21	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-4.opb	SAT f=-46 TT=397.164 T1=2.39	SAT (MO) f=-45 TT=627.415 T1=40.01	SAT (MO) f=-46 TT=397.164 T1=89.66	SAT f=-44 TT=1798.3 T1=5.66	SAT (TO) f=-46 TT=1800.06 T1=2.39	SAT (TO) f=-45 TT=1800.5 T1=335.05	SAT (TO) f=-45 TT=1800.59 T1=17.49	SAT f=-41 TT=1794.84 T1=1163.17	SAT f=-43 TT=1796.93 T1=1781.89	? (TO) TT=1800.08
normalized-PB06/OPT-SMALLINT/web/ www.nlsde.buaa.edu.cn/~kexu/ benchmarks/frb59-26-opb/normalized-frb59-26-5.opb	SAT f=-46 TT=1795.23 T1=530.18	SAT (MO) f=-45 TT=596.72 T1=13.18	SAT (MO) f=-45 TT=385.691 T1=8.58	SAT f=-46 TT=1798.4 T1=530.18	SAT (TO) f=-45 TT=1800.03 T1=106.71	SAT (TO) f=-45 TT=1800.44 T1=90.39	SAT (TO) f=-44 TT=1800.55 T1=3.73	SAT f=-44 TT=1796.4 T1=1331.09	SAT f=-46 TT=1795.23 T1=1793.32	? (TO) TT=1800.1

Statistics		bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
Number of times the solver is able to give the best known answer		0	14	15	29	4	6	0	44	5
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	5	5	20	2	2	0	36	0