PB'07 evaluation: results by benchmark

Results by benchmark for category instances containing only clauses (PURE-SAT)

This page displays the results of the different solvers for each benchmark for category instances containing only clauses (PURE-SAT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
absconPseudo 102
bsolo 3.0.16
bsolo 3.0.17
glpPB 0.2
minisat+ 1.14
oree 0.1.2 alpha
PB-clasp 2007-03-23
PB-clasp 2007-04-10
PBS4 2007-03-23
PBS4_v2 2007-03-23
Pueblo 1.4
sat4jPseudoCP 2007-03-23
sat4jPseudoCPClause 2007-03-23
SAT4JPseudoResolution 2007-03-23
wildcat-rnp 2007-03-21
wildcat-skc 2007-03-21

Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-101-100.opb		? (TO) TT=1800.07	? (MO) TT=1203.58	? (MO) TT=1126.25	? (TO) TT=1800.16	? (MO) TT=681.475	? (TO) TT=1800.29	? (TO) TT=1800.02	? (MO) TT=1233.45	Signal TT=4.129	Signal TT=4.068	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.2	? (TO) TT=1800.13	? (TO) TT=1800.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-105-100.opb		? (TO) TT=1800.72	? (MO) TT=817.596	? (MO) TT=762.612	? (TO) TT=1800.18	? (MO) TT=1272.5	? (TO) TT=1800.3	? (TO) TT=1800.06	? (MO) TT=1107.12	Signal TT=4.439	Signal TT=4.431	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.26	? (TO) TT=1800.08	? (TO) TT=1800.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-11-10.opb	UNSAT TT=8.02	? (TO) TT=1800.16	UNSAT TT=304.668	UNSAT TT=322.894	? (TO) TT=1800.05	UNSAT TT=81.055	? (TO) TT=1800.26	UNSAT TT=99.093	UNSAT TT=94.45	UNSAT TT=8.1	UNSAT TT=8.02	UNSAT TT=31.511	? (TO) TT=1800.18	? (TO) TT=1800.21	UNSAT TT=664.935	? (TO) TT=1800.06	? TT=1317.49
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-15-10.opb	UNSAT TT=17.917	? (TO) TT=1800.05	UNSAT TT=357.441	UNSAT TT=356.842	? (TO) TT=1800.03	UNSAT TT=104.269	? (TO) TT=1800.16	UNSAT TT=141.123	UNSAT TT=139.695	UNSAT TT=18.091	UNSAT TT=17.917	UNSAT TT=374.631	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=343.462	? (TO) TT=1800.09	? TT=1636.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-21-20.opb		? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	Signal TT=0.032	Signal TT=0.032	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1801.62	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-25-20.opb		? (TO) TT=1800.11	? TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-31-30.opb		? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-35-30.opb		? (TO) TT=1800.09	? TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-41-40.opb		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1801.28	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-45-40.opb		? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.25	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-51-50.opb		? (TO) TT=1800.1	? (TO) TT=1800.37	? (TO) TT=1800.3	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.43	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-55-50.opb		? (TO) TT=1800.1	? (MO) TT=728.859	? (MO) TT=727.261	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.53	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-61-60.opb		? (TO) TT=1800.11	? (MO) TT=1108.07	? (MO) TT=1104.58	? (TO) TT=1800.11	? (TO) TT=1800.2	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.25	? (TO) TT=1800.19	? (TO) TT=1800.2	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-65-60.opb		? (TO) TT=1800.1	? (MO) TT=1077.45	? (MO) TT=1072.54	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.23	? (TO) TT=1800.1	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-71-70.opb		? (TO) TT=1800.12	? (MO) TT=655.102	? (MO) TT=643.84	? (TO) TT=1800.08	? (TO) TT=1800.31	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.21	? (TO) TT=1800.02	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-75-70.opb		? (TO) TT=1800.15	? (MO) TT=894.079	? (MO) TT=880.958	? (TO) TT=1800.1	? (MO) TT=1427.13	? (TO) TT=1800.42	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.27	? (TO) TT=1800.1	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-81-80.opb		? (TO) TT=1800.12	? (MO) TT=742.868	? (MO) TT=772.082	? (TO) TT=1800.12	? (MO) TT=1277.48	? (TO) TT=1800.25	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.81	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-85-80.opb		? (TO) TT=1800.12	? (MO) TT=545.015	? (MO) TT=526.275	? (TO) TT=1800.04	? (MO) TT=1245.2	? (TO) TT=1800.31	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-91-90.opb		? (TO) TT=1800.11	? (MO) TT=861.187	? (MO) TT=811.048	? (TO) TT=1800.08	? (MO) TT=1186.27	? (TO) TT=1800.79	? (TO) TT=1800.01	? (MO) TT=1355.59	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1800.12
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/roussel/ normalized-pigeon-clauses-95-90.opb		? (TO) TT=1800.07	? (MO) TT=704.217	? (MO) TT=681.519	? (TO) TT=1800.12	? (MO) TT=1456.97	? (TO) TT=1800.24	? (TO) TT=1800.05	? (MO) TT=1580.96	Signal TT=3.287	Signal TT=3.239	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.1
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/jarvisalo/ mod2c-rand3bip-sat-210-3.sat05-2475.reshuffled-07.opb	SAT TT=166.64 T1=166.54	? (TO) TT=1800.09	? TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.13	SAT TT=166.64 T1=166.54	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/jarvisalo/ mod2c-rand3bip-unsat-120-3.sat05-2340.reshuffled-07.opb	UNSAT TT=676.595	? (TO) TT=1800.07	? TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=725.202	? (TO) TT=1800.18	UNSAT TT=676.595	UNSAT TT=911.725	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=1400.11	UNSAT TT=1372.9	UNSAT TT=963.988	? (TO) TT=1800.01	? (TO) TT=1800.03
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/QG/ QG6-dead-dnd001.sat05-2742.reshuffled-07.opb	UNSAT TT=243.868	? (TO) TT=1800.11	? TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=243.868	? (TO) TT=1800.42	UNSAT TT=984.847	UNSAT TT=249.122	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=1725.19	? (TO) TT=1800.16	? (TO) TT=1800.11	UNSAT TT=1687.95	? (TO) TT=1800.03	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/QG/ QG6-gensys-brn007.sat05-2684.reshuffled-07.opb	UNSAT TT=235.972	? (TO) TT=1800.09	? TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.06	UNSAT TT=595.977	? (TO) TT=1800.1	UNSAT TT=1591.99	UNSAT TT=235.972	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/QG/ QG6-gensys-icl004.sat05-2716.reshuffled-07.opb	UNSAT TT=298.384	? (TO) TT=1800.16	? TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=809.722	? (TO) TT=1800.11	UNSAT TT=1732.04	UNSAT TT=298.384	? (TO) TT=1800.13	? (TO) TT=1800.08	UNSAT TT=739.667	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/QG/ QG6-gensys-icl006.sat05-2718.reshuffled-07.opb	UNSAT TT=173.11	? (TO) TT=1800.14	? TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=296.171	? (TO) TT=1800.2	UNSAT TT=1226.81	UNSAT TT=173.11	? (TO) TT=1800.04	? (TO) TT=1800.13	UNSAT TT=1008.25	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.12
normalized-PB07/PURE-SAT/SAT07/crafted/ Difficult/contest05/QG/ QG6-gensys-icl009.sat05-2721.reshuffled-07.opb	UNSAT TT=194.471	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=333.205	? (TO) TT=1800.19	UNSAT TT=1564.21	UNSAT TT=194.471	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.2	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/SAT07/crafted/Difficult/ contest05/sabharwal/ grid-pebbling-unsat-grid-pbl-0300.sat05-1350.sat05-1350.reshuffled-07.opb		? TT=7.646	? TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	Signal TT=4.226	Signal TT=4.244	? (TO) TT=1800.06	? (TO) TT=1800.28	? (TO) TT=1800.26	? (TO) TT=1800.33	? (TO) TT=1800.1	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/SAT07/crafted/Medium/contest05/ jarvisalo/mod2-3cage-unsat-9-12.sat05-2587.reshuffled-07.opb	UNSAT TT=124.513	? (TO) TT=1800.09	UNSAT TT=434.507	UNSAT TT=424.176	? (TO) TT=1800.1	UNSAT TT=144.657	? (TO) TT=1800.19	UNSAT TT=139.354	UNSAT TT=124.513	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=518.998	UNSAT TT=1278.96	UNSAT TT=1284.13	UNSAT TT=270.278	? TT=1757.53	? TT=1230.58
normalized-PB07/PURE-SAT/SAT07/crafted/Medium/contest05/ jarvisalo/mod2-3cage-unsat-9-14.sat05-2589.reshuffled-07.opb	UNSAT TT=119.792	? (TO) TT=1800.1	UNSAT TT=1093.16	UNSAT TT=1062.56	? (TO) TT=1800.13	UNSAT TT=119.792	? (TO) TT=1800.22	UNSAT TT=131.948	UNSAT TT=163.921	? (TO) TT=1800.08	? (TO) TT=1800.11	UNSAT TT=494.541	UNSAT TT=482.706	UNSAT TT=482.682	UNSAT TT=297.22	? TT=1755.89	? TT=1233.11
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2c-rand3bip-sat-190-3.sat05-2445.reshuffled-07.opb	SAT TT=111.483 T1=111.46	? (TO) TT=1800.1	? TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=111.483 T1=111.46	? (TO) TT=1800.07	SAT TT=896.876 T1=896.8	SAT TT=126.552 T1=126.49	SAT TT=113.012 T1=112.96	SAT TT=113.696 T1=113.65	SAT TT=659.739 T1=659.69	? (TO) TT=1800.15	? (TO) TT=1800.12	SAT TT=535.17 T1=535.05	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-1.sat05-2158.reshuffled-07.opb	SAT TT=61.429 T1=61.34	? (TO) TT=1800.08	SAT TT=458.391 T1=458.36	SAT TT=456.53 T1=456.47	? (TO) TT=1800.08	SAT TT=153.975 T1=153.95	? (TO) TT=1800.29	SAT TT=61.429 T1=61.34	SAT TT=203.973 T1=203.93	No Cert. TT=1154.05	No Cert. TT=1158.74	SAT TT=399.381 T1=399.29	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=1762.01
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-2.sat05-2159.reshuffled-07.opb	SAT TT=38.916 T1=38.88	? (TO) TT=1800.07	? TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=38.916 T1=38.88	? (TO) TT=1800.15	SAT TT=78.574 T1=78.47	SAT TT=114.587 T1=114.45	No Cert. TT=135.22	No Cert. TT=135.492	SAT TT=52.625 T1=52.52	? (TO) TT=1800.16	? (TO) TT=1800.23	? (MO) TT=1374.91	? (TO) TT=1800.1	? TT=1757.34
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.opb	SAT TT=277.15 T1=277.06	? (TO) TT=1800.14	SAT TT=1235.14 T1=1235.1	SAT TT=1228.94 T1=1228.85	? (TO) TT=1800.04	SAT TT=277.15 T1=277.06	? (TO) TT=1800.11	SAT TT=617.684 T1=617.62	SAT TT=397.666 T1=397.56	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=570.931 T1=570.89	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.11	? TT=1757.66
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-2.sat05-2174.reshuffled-07.opb	SAT TT=753.958 T1=753.88	? (TO) TT=1800.11	? TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=775.84 T1=775.81	? (TO) TT=1800.32	SAT TT=1480.16 T1=1480.09	SAT TT=753.958 T1=753.88	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1099.3 T1=1099.23	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.05	? TT=1768.22
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.opb	SAT TT=282.705 T1=282.68	? (TO) TT=1800.12	? TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=945.12 T1=945.03	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=282.705 T1=282.68	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=1162.98 T1=1162.96	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.35	? (TO) TT=1800.1	? TT=1762.63
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/jarvisalo/ mod2-rand3bip-sat-240-3.sat05-2205.reshuffled-07.opb	SAT TT=97.713 T1=97.62	? (TO) TT=1800.05	? TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=317.667 T1=317.56	? (TO) TT=1800.45	SAT TT=760.621 T1=760.48	SAT TT=97.713 T1=97.62	SAT TT=1573.36 T1=1573.24	SAT TT=1575.35 T1=1575.24	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.34	? (TO) TT=1800.06	? TT=1776.44
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ gensys-ukn002.sat05-2744.reshuffled-07.opb	UNSAT TT=84.45	? (TO) TT=1800.15	? TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=84.45	? (TO) TT=1800.14	UNSAT TT=1555.48	UNSAT TT=222.612	UNSAT TT=1113.56	UNSAT TT=1076.51	UNSAT TT=1544.53	? (TO) TT=1800.11	? (TO) TT=1800.14	UNSAT TT=1358.32	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ pmg-11-UNSAT.sat05-3939.reshuffled-07.opb	UNSAT TT=1219.97	? (TO) TT=1800.09	? TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.03	UNSAT TT=1346.94	? (TO) TT=1800.04	? (TO) TT=1800.12	UNSAT TT=1219.97	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.08	? TT=1421.23
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG7a-gensys-brn004.sat05-3669.reshuffled-07.opb	SAT TT=140.202 T1=140.13	? (TO) TT=1800.17	SAT TT=1748.1 T1=1748.05	SAT TT=1744.34 T1=1744.31	? (TO) TT=1800.09	SAT TT=365.207 T1=365.1	? (TO) TT=1800.12	SAT TT=1195.19 T1=1195.09	SAT TT=140.202 T1=140.13	No Cert. TT=672.102	No Cert. TT=679.241	SAT TT=430.639 T1=430.58	SAT TT=1483.91 T1=1483.75	SAT TT=1520.14 T1=1520.06	SAT TT=528.511 T1=528.33	? (TO) TT=1800.03	? (TO) TT=1800.11
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG7a-gensys-brn100.sat05-3765.reshuffled-07.opb	SAT TT=63.013 T1=62.92	? (TO) TT=1800.09	SAT TT=99.137 T1=99.04	SAT TT=98.513 T1=98.46	? (TO) TT=1800.08	SAT TT=83.308 T1=83.25	? (TO) TT=1800.12	SAT TT=1559.1 T1=1558.96	SAT TT=63.013 T1=62.92	SAT TT=1290.29 T1=1290.24	SAT TT=1295.25 T1=1295.15	SAT TT=94.075 T1=94	SAT TT=1327.43 T1=1327.27	SAT TT=1324.53 T1=1324.43	SAT TT=376.936 T1=376.79	? (TO) TT=1800.11	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG7a-gensys-ukn001.sat05-3841.reshuffled-07.opb	SAT TT=51.884 T1=51.78	? (TO) TT=1800.15	SAT TT=1777.73 T1=1777.67	SAT TT=1774.44 T1=1774.34	? (TO) TT=1800.11	SAT TT=106.225 T1=106.16	? (TO) TT=1800.41	SAT TT=572.984 T1=572.97	SAT TT=55.346 T1=55.27	No Cert. TT=1235.72	No Cert. TT=1239.51	SAT TT=51.884 T1=51.78	SAT TT=1097.04 T1=1096.94	SAT TT=1062.74 T1=1062.57	SAT TT=302.966 T1=302.82	? (TO) TT=1800.04	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG7a-gensys-ukn005.sat05-3845.reshuffled-07.opb	SAT TT=152.819 T1=152.8	? (TO) TT=1800.14	SAT TT=867.462 T1=867.39	SAT TT=865.758 T1=865.67	? (TO) TT=1800.1	SAT TT=152.819 T1=152.8	? (TO) TT=1800.18	? (TO) TT=1800.06	SAT TT=243.261 T1=243.16	No Cert. TT=1117.51	No Cert. TT=1120.11	SAT TT=233.464 T1=233.4	? (TO) TT=1800.16	? (TO) TT=1800.19	SAT TT=467.067 T1=466.93	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG7-gensys-icl001.sat05-2926.reshuffled-07.opb	UNSAT TT=80.414	? (TO) TT=1800.14	? TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.11	UNSAT TT=80.414	? (TO) TT=1800.31	UNSAT TT=202.625	UNSAT TT=102.582	? (problem) TT=849.295	? (problem) TT=850.351	UNSAT TT=236.579	UNSAT TT=614.01	UNSAT TT=612.023	UNSAT TT=322.338	? (TO) TT=1800.11	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG8-gensys-ukn005.sat05-3584.reshuffled-07.opb	UNSAT TT=274.158	? (TO) TT=1800.1	UNSAT TT=913.201	UNSAT TT=909.671	? (TO) TT=1800.03	UNSAT TT=274.158	? (TO) TT=1801.31	UNSAT TT=1397.06	UNSAT TT=1024.75	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=381.216	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1801.31	? (TO) TT=1800.09	? (TO) TT=1800.03
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG-gensys-brn008.sat05-2685.reshuffled-07.opb	UNSAT TT=211.375	? (TO) TT=1800.14	? TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=584.208	? (TO) TT=1800.26	UNSAT TT=1502.95	UNSAT TT=211.375	UNSAT TT=1288.09	UNSAT TT=1291.2	UNSAT TT=846.455	? (TO) TT=1800.14	? (TO) TT=1800.15	UNSAT TT=1191.97	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/others/ QG-gensys-icl003.sat05-2715.reshuffled-07.opb	UNSAT TT=187.552	? (TO) TT=1800.04	? TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=187.552	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=208.612	UNSAT TT=1267.81	UNSAT TT=1269.15	UNSAT TT=552.046	? (TO) TT=1800.14	? (TO) TT=1800.17	UNSAT TT=1786.27	? (TO) TT=1800.01	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ sat-grid-pbl-0070.sat05-1334.reshuffled-07.opb	SAT TT=9.105 T1=8.93	? (TO) TT=1800.15	SAT TT=55.65 T1=55.55	SAT TT=55.019 T1=54.96	? (TO) TT=1800.04	SAT TT=35.921 T1=35.88	? (TO) TT=1800.19	SAT TT=1175.86 T1=1175.77	SAT TT=164.642 T1=164.52	SAT TT=37.712 T1=37.68	SAT TT=37.99 T1=37.88	SAT TT=11.097 T1=10.99	? (TO) TT=1800.31	? (TO) TT=1800.25	SAT TT=9.105 T1=8.93	SAT TT=1216.7 T1=1216.67	SAT TT=165.556 T1=165.44
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ sat-grid-pbl-0200.sat05-1339.reshuffled-07.opb	SAT TT=24.014 T1=23.88	? TT=7.297	? TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=588.784 T1=588.64	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	Signal TT=1.633	Signal TT=1.701	? (TO) TT=1800.1	? (TO) TT=1800.27	? (TO) TT=1800.32	SAT TT=335.421 T1=335.16	? (TO) TT=1800.06	SAT TT=24.014 T1=23.88
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ sat-pbl-00400.sat05-1322.reshuffled-07.opb	SAT TT=77.543 T1=77.45	? (TO) TT=1800.13	SAT TT=170.188 T1=170.11	SAT TT=167.78 T1=167.75	? (TO) TT=1800.04	SAT TT=446.847 T1=446.77	? (TO) TT=1800.1	SAT TT=939.182 T1=939.08	SAT TT=174.276 T1=174.18	SAT TT=155.097 T1=155.03	SAT TT=155.534 T1=155.45	SAT TT=559.01 T1=558.89	SAT TT=650.913 T1=650.7	SAT TT=651.983 T1=651.79	SAT TT=77.543 T1=77.45	? (TO) TT=1800.09	SAT TT=304.415 T1=304.39
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-grid-pbl-0080.sat05-1344.reshuffled-07.opb	UNSAT TT=956.227	? (TO) TT=1800.13	? TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=956.227	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.3	? (TO) TT=1800.3	? (TO) TT=1800.26	? (TO) TT=1800.07	? TT=1514.46
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-pbl-00070.sat05-1324.reshuffled-07.opb	UNSAT TT=4.529	? (TO) TT=1800.12	? TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=91.316	UNSAT TT=10.996	Signal TT=1166.51	Signal TT=1163.72	? (TO) TT=1800.02	? (TO) TT=1800.28	? (TO) TT=1800.23	UNSAT TT=4.529	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-pbl-00080.sat05-1325.reshuffled-07.opb	UNSAT TT=18.082	? (TO) TT=1800.1	? TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.15	UNSAT TT=119.309	UNSAT TT=35.868	Signal TT=0.311	Signal TT=0.291	? (TO) TT=1800.06	UNSAT TT=676.097	UNSAT TT=685.364	UNSAT TT=18.082	? (TO) TT=1800.01	? (TO) TT=1800.06
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-pbl-00090.sat05-1326.reshuffled-07.opb	UNSAT TT=22.747	? (TO) TT=1800.08	? TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=129.651	UNSAT TT=28.27	? (problem) TT=641.654	? (problem) TT=640.804	? (TO) TT=1800.03	? (TO) TT=1800.23	? (TO) TT=1800.23	UNSAT TT=22.747	? (TO) TT=1800.04	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-pbl-00150.sat05-1328.reshuffled-07.opb	UNSAT TT=559.929	? (TO) TT=1800.12	? TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.19	UNSAT TT=559.929	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.37	? (TO) TT=1800.2	? (TO) TT=1800.29	? (TO) TT=1800.08	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-pbl-00200.sat05-1329.reshuffled-07.opb		? (TO) TT=1800.16	? TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.27	? (TO) TT=1800.27	? (TO) TT=1800.86	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/pebbling/ unsat-pbl-00250.sat05-1330.reshuffled-07.opb		? (TO) TT=1800.14	? TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.29	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.27	? (TO) TT=1800.28	? (TO) TT=1802.65	? (TO) TT=1800.11	? (TO) TT=1800.07
normalized-PB07/PURE-SAT/SAT07/crafted/Medium/ contest05/sabharwal/ counting-clqcolor-unsat-set-b-clqcolor-08-06-07.sat05-1257.reshuffled-07.opb	UNSAT TT=5.935	? (TO) TT=1800.08	UNSAT TT=36.639	UNSAT TT=36.141	? (TO) TT=1800.04	UNSAT TT=15.887	? (TO) TT=1800.63	UNSAT TT=25.352	UNSAT TT=5.935	UNSAT TT=24.567	UNSAT TT=24.826	UNSAT TT=8.846	UNSAT TT=34.95	UNSAT TT=34.727	UNSAT TT=9.371	? (TO) TT=1800.05	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/sabharwal/ counting-easier-fphp-012-010.sat05-1214.reshuffled-07.opb	UNSAT TT=109.315	? (TO) TT=1800.13	UNSAT TT=624.49	UNSAT TT=613.369	? (TO) TT=1800.06	UNSAT TT=109.315	? (TO) TT=1800.17	UNSAT TT=229.466	UNSAT TT=151.756	Signal TT=0.01	Signal TT=0.01	UNSAT TT=154.257	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/sabharwal/ counting-easier-php-012-010.sat05-1172.reshuffled-07.opb	UNSAT TT=35.467	? (TO) TT=1800.03	UNSAT TT=603.202	UNSAT TT=601.696	? (TO) TT=1800.02	UNSAT TT=133.211	? (TO) TT=1800.15	UNSAT TT=207.636	UNSAT TT=187.396	UNSAT TT=35.622	UNSAT TT=35.467	UNSAT TT=212.814	? (TO) TT=1800.15	? (TO) TT=1800.23	? (TO) TT=1800.14	? (TO) TT=1800.1	? TT=1691.63
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/sabharwal/ sat-strips-gripper-10t19.sat05-1143.reshuffled-07.opb	SAT TT=6.245 T1=6.17	? (TO) TT=1800.05	SAT TT=87.557 T1=87.51	SAT TT=90.567 T1=90.46	? (TO) TT=1800.11	SAT TT=8.72 T1=8.69	? (TO) TT=1800.16	SAT TT=13.408 T1=13.33	SAT TT=6.245 T1=6.17	Signal TT=0.431	Signal TT=0.434	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.17	SAT TT=629.833 T1=629.67	? (TO) TT=1800.11	? (TO) TT=1800.03
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/sabharwal/ sat-strips-gripper-12t23.sat05-1144.reshuffled-07.opb	SAT TT=60.372 T1=60.27	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	SAT TT=60.372 T1=60.27	? (TO) TT=1800.29	SAT TT=104.656 T1=104.57	SAT TT=155.768 T1=155.69	No Cert. TT=1629.76	No Cert. TT=1635.87	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1801.25	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/SAT07/crafted/ Medium/contest05/sabharwal/ unsat-logistics-rotate-09t5.sat05-1139.reshuffled-07.opb	UNSAT TT=12.881	? (TO) TT=1800.14	? TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=24.974	? (TO) TT=1800.74	UNSAT TT=101.43	UNSAT TT=25.117	UNSAT TT=13.49	UNSAT TT=12.881	UNSAT TT=40.785	UNSAT TT=266.661	UNSAT TT=270.625	UNSAT TT=473.283	? (TO) TT=1800.03	? (TO) TT=1800.04
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s57-100.opb	UNSAT TT=1.485	UNSAT TT=23.961	UNSAT TT=5.955	UNSAT TT=5.797	UNSAT TT=1695.89	UNSAT TT=3.184	? (TO) TT=1800.51	UNSAT TT=2.755	UNSAT TT=1.485	Signal TT=0.002	Signal TT=0.003	UNSAT TT=5.887	UNSAT TT=10.599	UNSAT TT=20.988	UNSAT TT=10.044	? TT=1508.31	? TT=1009.33
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s61-100.opb	UNSAT TT=1.487	UNSAT TT=57.851	UNSAT TT=14.522	UNSAT TT=14.18	? (TO) TT=1800.02	UNSAT TT=4.87	? (TO) TT=1800.24	UNSAT TT=3.566	UNSAT TT=1.487	UNSAT TT=24.67	UNSAT TT=24.727	UNSAT TT=7.619	UNSAT TT=49.124	UNSAT TT=49.869	UNSAT TT=23.893	? TT=1496.97	? TT=994.648
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s65-100.opb	UNSAT TT=6.755	UNSAT TT=144.637	UNSAT TT=36.45	UNSAT TT=35.779	? (TO) TT=1800.09	UNSAT TT=11.235	? (TO) TT=1800.19	UNSAT TT=10.58	UNSAT TT=6.755	UNSAT TT=234.278	UNSAT TT=235.401	UNSAT TT=22.248	UNSAT TT=271.81	UNSAT TT=270.445	UNSAT TT=120.291	? TT=1501.96	? TT=996.562
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s69-100.opb	UNSAT TT=15.388	UNSAT TT=367.891	UNSAT TT=68.332	UNSAT TT=66.752	? (TO) TT=1800.06	UNSAT TT=21.794	? (TO) TT=1800.27	UNSAT TT=16.27	UNSAT TT=15.388	UNSAT TT=56.532	UNSAT TT=56.763	UNSAT TT=38.732	UNSAT TT=440.396	UNSAT TT=442.159	UNSAT TT=109.587	? TT=1488.54	? TT=994.564
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s73-100.opb	UNSAT TT=37.738	UNSAT TT=830.339	UNSAT TT=191.258	UNSAT TT=187.538	? (TO) TT=1800.02	UNSAT TT=60.914	? (TO) TT=1800.06	UNSAT TT=57.751	UNSAT TT=37.738	UNSAT TT=1327.02	UNSAT TT=1330.15	UNSAT TT=119.835	UNSAT TT=723.09	UNSAT TT=696.6	UNSAT TT=1340.59	? TT=1488.82	? TT=998.833
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s77-100.opb	UNSAT TT=80.789	? (TO) TT=1800.08	UNSAT TT=349.889	UNSAT TT=344.287	? (TO) TT=1800.02	UNSAT TT=94.099	? (TO) TT=1800.19	UNSAT TT=129.949	UNSAT TT=80.789	UNSAT TT=1424.01	UNSAT TT=1426.97	UNSAT TT=136.51	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.09	? TT=1491.63	? TT=995.75
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s81-100.opb	UNSAT TT=134.185	? (TO) TT=1800.15	UNSAT TT=684.766	UNSAT TT=676.859	? (TO) TT=1800.1	UNSAT TT=209.996	? (TO) TT=1800.62	UNSAT TT=254.169	UNSAT TT=134.185	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=512.456	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.16	? TT=1489.34	? TT=986.949
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s85-100.opb	UNSAT TT=343.102	? (TO) TT=1800.04	? TT=1800	? (TO) TT=1800.12	? (TO) TT=1800.08	UNSAT TT=587.972	? (TO) TT=1800.25	UNSAT TT=763.091	UNSAT TT=343.102	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=890.385	? (TO) TT=1800.31	? (TO) TT=1800.18	? (TO) TT=1800.1	? TT=1500.5	? TT=994.421
normalized-PB07/PURE-SAT/ SAT07/crafted/spence/ medium/s89-100.opb	UNSAT TT=589.017	? (TO) TT=1800.11	? TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=598.277	? (TO) TT=1800.5	UNSAT TT=1117.93	UNSAT TT=589.017	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1470.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=1482.7	? TT=989.271
normalized-PB07/PURE-SAT/ SAT07/industrial/anbulagan/ medium-sat/dated-10-13-s.opb	SAT TT=111.386 T1=111.32	? TT=8.142	? (TO) TT=1800.21	SAT TT=324.724 T1=324.51	? (TO) TT=1800.14	SAT TT=776.914 T1=776.71	? (TO) TT=1800.54	SAT TT=143.174 T1=143.12	SAT TT=111.386 T1=111.32	Signal TT=10.016	Signal TT=10.044	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/ SAT07/industrial/anbulagan/ medium-sat/dated-10-17-s.opb	SAT TT=108.01 T1=107.88	? TT=8.709	? (TO) TT=1800.15	? (TO) TT=1800.22	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.36	? (TO) TT=1800.02	SAT TT=108.01 T1=107.88	Signal TT=13.429	Signal TT=13.459	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.16	SAT TT=132.429 T1=131.96	? (TO) TT=1800.09	? (TO) TT=1800.12
normalized-PB07/PURE-SAT/SAT07/ industrial/anbulagan/ medium-sat/partial-5-13-s.opb		? TT=8.222	? (MO) TT=1387.79	? (MO) TT=1386.46	? (TO) TT=1800.12	? (TO) TT=1800.22	? (TO) TT=1800.36	? (TO) TT=1800.09	? (TO) TT=1800.09	Signal TT=10.229	Signal TT=10.28	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.35	? (TO) TT=1800.13	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/ SAT07/industrial/anbulagan/ medium-sat/total-10-17-s.opb	SAT TT=93.732 T1=93.36	? TT=10.148	? (TO) TT=1800.16	? (TO) TT=1800.3	? (TO) TT=1800.15	SAT TT=515.904 T1=515.69	? (TO) TT=1802.13	SAT TT=272.139 T1=271.99	SAT TT=158.346 T1=158.2	SAT TT=93.871 T1=93.47	SAT TT=93.732 T1=93.36	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.17	SAT TT=496.467 T1=496.04	? (TO) TT=1800.14	? (TO) TT=1800.14
normalized-PB07/PURE-SAT/ SAT07/industrial/anbulagan/ medium-sat/total-10-19-s.opb	SAT TT=181.581 T1=181.13	? TT=10.618	? (TO) TT=1800.29	? (TO) TT=1800.25	? (TO) TT=1800.25	? (TO) TT=1800.19	? (TO) TT=1800.81	SAT TT=378.864 T1=378.74	SAT TT=186.936 T1=186.8	SAT TT=182.084 T1=181.73	SAT TT=181.581 T1=181.13	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.78	? (TO) TT=1800.09	? (TO) TT=1800.13
normalized-PB07/PURE-SAT/ SAT07/industrial/anbulagan/ medium-sat/total-5-17-s.opb	SAT TT=393.107 T1=392.79	? TT=9.005	? (TO) TT=1800.14	SAT TT=548.818 T1=548.56	? (TO) TT=1800.21	SAT TT=950.516 T1=950.32	? (TO) TT=1802.14	? (TO) TT=1800.07	SAT TT=541.691 T1=541.6	SAT TT=395.535 T1=395.23	SAT TT=393.107 T1=392.79	SAT TT=1753.42 T1=1753.2	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/ SAT07/industrial/anbulagan/ medium-sat/total-5-19-s.opb	SAT TT=43.872 T1=43.56	? TT=9.071	? (TO) TT=1800.16	SAT TT=317.364 T1=317.19	? (TO) TT=1800.21	? (TO) TT=1800.1	? (TO) TT=1800.56	SAT TT=649.76 T1=649.68	SAT TT=142.141 T1=142	SAT TT=43.872 T1=43.56	SAT TT=43.995 T1=43.68	? (TO) TT=1800.14	SAT TT=1248.43 T1=1248.02	SAT TT=1321.32 T1=1320.78	SAT TT=232.17 T1=231.83	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/SAT07/ industrial/anbulagan/ medium-unsat/dated-10-15-u.opb	UNSAT TT=73.912	? TT=8.287	UNSAT TT=1358.16	UNSAT TT=819.12	? (TO) TT=1800.12	UNSAT TT=73.912	? (TO) TT=1800.58	UNSAT TT=253.262	UNSAT TT=126.814	Signal TT=10.628	Signal TT=10.757	UNSAT TT=1042.14	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=179.973	? (TO) TT=1800.12	? (TO) TT=1800.12
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/ industrial/anbulagan/ medium-unsat/dated-5-11-u.opb	UNSAT TT=362.588	? TT=11.588	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=363.066	? (TO) TT=1800.24	UNSAT TT=961.232	UNSAT TT=362.588	Signal TT=5.472	Signal TT=5.613	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.13	UNSAT TT=1289.85	? (TO) TT=1800.05	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/ industrial/anbulagan/ medium-unsat/total-10-11-u.opb	UNSAT TT=166.609	? TT=8.239	? (TO) TT=1800.22	? (TO) TT=1800.26	? (TO) TT=1800.15	UNSAT TT=166.609	? (TO) TT=1800.68	UNSAT TT=456.287	UNSAT TT=224.897	Signal TT=10.235	Signal TT=10.335	UNSAT TT=1427.04	? (TO) TT=1800.16	? (TO) TT=1800.15	UNSAT TT=375.746	? (TO) TT=1800.1	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/ industrial/anbulagan/ medium-unsat/total-5-11-u.opb	UNSAT TT=70.152	? TT=7.897	UNSAT TT=657.124	UNSAT TT=655.388	? (TO) TT=1800.13	UNSAT TT=70.152	? (TO) TT=1800.52	UNSAT TT=200.237	UNSAT TT=92.65	UNSAT TT=195.942	UNSAT TT=193.862	UNSAT TT=656.659	? (TO) TT=1800.18	? (TO) TT=1800.13	UNSAT TT=116.945	? (TO) TT=1800.11	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/ industrial/anbulagan/ medium-unsat/total-5-13-u.opb	UNSAT TT=141.55	? TT=8.107	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=141.55	? (TO) TT=1802.14	UNSAT TT=469.13	UNSAT TT=169.661	Signal TT=9.79	Signal TT=9.796	UNSAT TT=1147.62	? (TO) TT=1800.21	? (TO) TT=1800.21	UNSAT TT=453.559	? (TO) TT=1800.13	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/ SAT07/industrial/babic/dspam/ dspam_dump_vc1080.opb	UNSAT TT=4.165	? (TO) TT=1800.09	UNSAT TT=4.165	UNSAT TT=4.216	? (TO) TT=1800.1	UNSAT TT=874.093	? (TO) TT=1802.09	UNSAT TT=122.2	UNSAT TT=56.128	Signal TT=5.526	Signal TT=5.577	UNSAT TT=214.724	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.32	? (TO) TT=1800.04	? (TO) TT=1800.13
normalized-PB07/PURE-SAT/ SAT07/industrial/babic/dspam/ dspam_dump_vc1081.opb	UNSAT TT=4.187	? (TO) TT=1800.15	UNSAT TT=4.187	UNSAT TT=4.224	? (TO) TT=1800.05	UNSAT TT=540.041	? (TO) TT=1800.26	UNSAT TT=122.707	UNSAT TT=56.056	Signal TT=5.554	Signal TT=5.21	UNSAT TT=214.832	? (TO) TT=1800.13	? (TO) TT=1800.2	? (TO) TT=1801.14	? (TO) TT=1800.07	? (TO) TT=1800.06
normalized-PB07/PURE-SAT/ SAT07/industrial/babic/dspam/ dspam_dump_vc1093.opb	UNSAT TT=3.439	? (TO) TT=1800.11	UNSAT TT=3.439	UNSAT TT=3.458	? (TO) TT=1800.09	UNSAT TT=107.667	? (TO) TT=1800.15	UNSAT TT=109.321	UNSAT TT=50.423	Signal TT=4.968	Signal TT=4.972	UNSAT TT=87.321	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.28	? (TO) TT=1800.12	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/ SAT07/industrial/babic/dspam/ dspam_dump_vc1103.opb	UNSAT TT=8.155	? (TO) TT=1800.21	UNSAT TT=8.155	UNSAT TT=8.293	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.49	UNSAT TT=222.196	UNSAT TT=136.62	UNSAT TT=220.211	UNSAT TT=220.114	UNSAT TT=1257.74	? (TO) TT=1800.22	? (TO) TT=1800.17	? (TO) TT=1800.29	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/ SAT07/industrial/babic/dspam/ dspam_dump_vc1104.opb	UNSAT TT=8.206	? (TO) TT=1800.21	UNSAT TT=8.206	UNSAT TT=8.296	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.39	UNSAT TT=222.258	UNSAT TT=136.464	UNSAT TT=139.804	UNSAT TT=139.626	UNSAT TT=1252.51	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.73	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/dspam/dspam_dump_vc949.opb	UNSAT TT=4.167	? (TO) TT=1800.12	UNSAT TT=4.167	UNSAT TT=4.242	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1801.46	UNSAT TT=66.371	UNSAT TT=42.68	Signal TT=5.295	Signal TT=5.348	UNSAT TT=97.297	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.65	? (TO) TT=1800.04	? (TO) TT=1800.04
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/dspam/dspam_dump_vc950.opb	UNSAT TT=4.18	? (TO) TT=1800.13	UNSAT TT=4.18	UNSAT TT=4.248	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.31	UNSAT TT=66.21	UNSAT TT=42.527	Signal TT=5.341	Signal TT=5.31	UNSAT TT=96.969	? (TO) TT=1800.21	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/dspam/dspam_dump_vc962.opb	UNSAT TT=2.999	? (TO) TT=1800.16	UNSAT TT=2.999	UNSAT TT=3.124	? (TO) TT=1800.09	UNSAT TT=417.255	? (TO) TT=1800.51	UNSAT TT=66.037	UNSAT TT=37.941	Signal TT=4.757	Signal TT=4.754	UNSAT TT=79.694	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.39	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/dspam/dspam_dump_vc972.opb	UNSAT TT=8.209	? (TO) TT=1800.19	UNSAT TT=8.209	UNSAT TT=8.405	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1802.1	UNSAT TT=169.582	UNSAT TT=108.048	UNSAT TT=1786.36	UNSAT TT=1782.54	UNSAT TT=1195.63	? (TO) TT=1800.09	? (TO) TT=1800.19	UNSAT TT=28.268	? (TO) TT=1800.15	? (TO) TT=1800.15
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/dspam/dspam_dump_vc973.opb	UNSAT TT=8.415	? (TO) TT=1800.12	UNSAT TT=8.415	UNSAT TT=12.788	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1802.09	UNSAT TT=169.621	UNSAT TT=107.488	UNSAT TT=142.682	UNSAT TT=142.767	UNSAT TT=1200.24	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.28	? (TO) TT=1800.09	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc11773.opb	UNSAT TT=36.846	? (TO) TT=1800.17	UNSAT TT=92.474	UNSAT TT=92.796	? (TO) TT=1800.11	UNSAT TT=36.846	UNSAT TT=822.368	UNSAT TT=104.808	UNSAT TT=82.96	Signal TT=10.117	Signal TT=10.129	UNSAT TT=789.232	UNSAT TT=56.077	UNSAT TT=55.496	UNSAT TT=110.021	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc11803.opb	UNSAT TT=29.684	? (TO) TT=1800.2	UNSAT TT=34.031	UNSAT TT=34.12	? (TO) TT=1800.15	UNSAT TT=29.684	UNSAT TT=779.177	UNSAT TT=107.642	UNSAT TT=81.992	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=1062.41	UNSAT TT=337.688	UNSAT TT=323.123	UNSAT TT=135.017	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc11813.opb	UNSAT TT=35.439	? (TO) TT=1800.23	UNSAT TT=123.544	UNSAT TT=123.911	? (TO) TT=1800.18	UNSAT TT=35.439	? (TO) TT=1800.46	UNSAT TT=139.68	UNSAT TT=142.789	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1366.51	UNSAT TT=762.783	UNSAT TT=787.972	UNSAT TT=497.746	? (TO) TT=1800.08	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc11817.opb	UNSAT TT=26.727	? (TO) TT=1800.3	UNSAT TT=92.909	UNSAT TT=93.182	? (TO) TT=1800.14	UNSAT TT=26.727	? (TO) TT=1800.36	UNSAT TT=106.478	UNSAT TT=83.389	Signal TT=10.168	Signal TT=10.206	UNSAT TT=795.362	UNSAT TT=64.554	UNSAT TT=64.895	UNSAT TT=62.335	? (TO) TT=1800.13	? (TO) TT=1800.14
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc11935.opb	UNSAT TT=18.458	? (TO) TT=1800.15	UNSAT TT=18.458	UNSAT TT=18.496	? (TO) TT=1800.16	UNSAT TT=22.759	? (TO) TT=1800.24	UNSAT TT=67.838	UNSAT TT=48.865	Signal TT=7.303	Signal TT=7.35	UNSAT TT=436.492	UNSAT TT=20.995	UNSAT TT=19.606	UNSAT TT=29.97	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc11944.opb	UNSAT TT=18.389	? (TO) TT=1800.21	UNSAT TT=18.389	UNSAT TT=18.504	? (TO) TT=1800.16	UNSAT TT=21.677	? (TO) TT=1800.45	UNSAT TT=67.96	UNSAT TT=48.62	Signal TT=7.237	Signal TT=7.296	UNSAT TT=436.892	UNSAT TT=57.94	UNSAT TT=59.046	UNSAT TT=44.693	? (TO) TT=1800.12	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc12016.opb	UNSAT TT=18.582	? (TO) TT=1800.13	UNSAT TT=33.436	UNSAT TT=35.882	? (TO) TT=1800.07	UNSAT TT=18.582	? (TO) TT=1800.18	UNSAT TT=74.799	UNSAT TT=94.306	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=358.92	UNSAT TT=1322.03	UNSAT TT=1251.89	UNSAT TT=50.156	? (TO) TT=1800.06	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc12062.opb	UNSAT TT=21.944	? (TO) TT=1800.18	UNSAT TT=22.35	UNSAT TT=23.105	? (TO) TT=1800.12	UNSAT TT=21.944	? (TO) TT=1800.31	UNSAT TT=78.221	UNSAT TT=73.72	Signal TT=8.155	Signal TT=8.226	UNSAT TT=547.089	UNSAT TT=58.023	UNSAT TT=56.097	UNSAT TT=44.046	? (TO) TT=1800.08	? (TO) TT=1800.06
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc12070.opb	UNSAT TT=22.889	? (TO) TT=1800.21	UNSAT TT=22.889	UNSAT TT=25.882	? (TO) TT=1800.14	UNSAT TT=36.498	? (TO) TT=1800.3	UNSAT TT=78.592	UNSAT TT=72.451	Signal TT=8.151	Signal TT=8.145	UNSAT TT=540.246	UNSAT TT=62.804	UNSAT TT=63.64	UNSAT TT=50.545	? (TO) TT=1800.06	? (TO) TT=1800.13
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/hsatv17/hsat_vc12072.opb	UNSAT TT=23.145	? (TO) TT=1800.15	UNSAT TT=50.855	UNSAT TT=51.355	? (TO) TT=1800.1	UNSAT TT=49.844	? (TO) TT=1800.25	UNSAT TT=105.011	UNSAT TT=107.181	Signal TT=9.939	Signal TT=9.927	UNSAT TT=762.001	UNSAT TT=26.015	UNSAT TT=26.093	UNSAT TT=23.145	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc1033.opb	SAT TT=31.147 T1=30.78	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=132.589 T1=132.44	SAT TT=312.156 T1=311.98	SAT TT=131.784 T1=131.69	SAT TT=57.679 T1=57.56	Signal TT=4.607	Signal TT=4.958	SAT TT=201.307 T1=201.21	? (TO) TT=1800.18	? (TO) TT=1800.14	SAT TT=31.147 T1=30.78	? (TO) TT=1800.12	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc1044.opb	SAT TT=25.925 T1=25.65	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=83.942 T1=83.81	SAT TT=142.754 T1=142.54	SAT TT=99.303 T1=99.19	SAT TT=55.223 T1=55.1	Signal TT=5.088	Signal TT=5.074	SAT TT=230.765 T1=230.62	SAT TT=26.236 T1=25.97	SAT TT=25.925 T1=25.65	SAT TT=33.031 T1=32.68	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc1130.opb	SAT TT=40.392 T1=39.94	? (TO) TT=1800.15	SAT TT=1344.63 T1=1344.45	SAT TT=1344.08 T1=1343.89	? (TO) TT=1800.11	SAT TT=281.084 T1=280.9	SAT TT=289.511 T1=289.31	SAT TT=176.507 T1=176.44	SAT TT=80.768 T1=80.65	SAT TT=212.368 T1=212.22	SAT TT=212.408 T1=212.22	SAT TT=386.114 T1=385.99	SAT TT=75.415 T1=75.06	SAT TT=72.898 T1=72.61	SAT TT=40.392 T1=39.94	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc1138.opb	SAT TT=31.91 T1=31.01	? (TO) TT=1800.13	SAT TT=117.221 T1=117.05	SAT TT=117.157 T1=116.96	? (TO) TT=1800.12	SAT TT=38.689 T1=38.53	SAT TT=217.573 T1=217.29	SAT TT=123.673 T1=123.57	SAT TT=88.762 T1=88.65	SAT TT=381.816 T1=381.65	SAT TT=382.015 T1=381.79	SAT TT=421.767 T1=421.67	? (TO) TT=1800.15	? (TO) TT=1800.2	SAT TT=31.91 T1=31.01	? (TO) TT=1800.1	? (TO) TT=1800.07
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc1216.opb	UNSAT TT=4.973	? (TO) TT=1800.15	UNSAT TT=27.434	UNSAT TT=29.541	? (TO) TT=1800.1	UNSAT TT=16.206	UNSAT TT=4.973	UNSAT TT=64.832	UNSAT TT=75.487	UNSAT TT=6.148	UNSAT TT=6.138	UNSAT TT=321.354	UNSAT TT=12.121	UNSAT TT=11.043	UNSAT TT=10.58	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc909.opb	SAT TT=24.065 T1=23.62	? (TO) TT=1800.19	SAT TT=83.106 T1=82.97	SAT TT=82.548 T1=82.45	? (TO) TT=1800.11	SAT TT=97.532 T1=97.45	SAT TT=83.936 T1=83.77	SAT TT=73.813 T1=73.71	SAT TT=46.207 T1=46.09	Signal TT=4.642	Signal TT=4.336	SAT TT=88.682 T1=88.6	? (TO) TT=1800.2	? (TO) TT=1800.18	SAT TT=24.065 T1=23.62	? (TO) TT=1800.04	? (TO) TT=1800.04
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc965.opb	UNSAT TT=2.103	UNSAT TT=6.371	UNSAT TT=2.103	UNSAT TT=2.211	? (TO) TT=1800.07	UNSAT TT=11.641	UNSAT TT=3.472	UNSAT TT=41.014	UNSAT TT=28.83	Signal TT=4.81	Signal TT=4.784	UNSAT TT=190.472	UNSAT TT=8.965	UNSAT TT=9.133	UNSAT TT=8.92	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/ SAT07/industrial/ babic/xinetd/itox_vc979.opb	UNSAT TT=3.205	? (TO) TT=1800.15	UNSAT TT=3.205	UNSAT TT=3.402	? (TO) TT=1800.09	UNSAT TT=12.767	UNSAT TT=3.811	UNSAT TT=52.455	UNSAT TT=29.274	Signal TT=4.777	Signal TT=4.809	UNSAT TT=189.305	UNSAT TT=9.283	UNSAT TT=9.278	UNSAT TT=9.101	? (TO) TT=1800.1	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/xinetd/xinetd_vc56687.opb	UNSAT TT=1.779	UNSAT TT=5.602	UNSAT TT=1.779	UNSAT TT=1.818	? (TO) TT=1800.05	UNSAT TT=9.218	UNSAT TT=2.813	UNSAT TT=34.047	UNSAT TT=23.763	Signal TT=3.776	Signal TT=3.773	UNSAT TT=76.205	UNSAT TT=7.774	UNSAT TT=7.489	UNSAT TT=7.673	? (TO) TT=1800.03	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/industrial/ babic/xinetd/xinetd_vc56703.opb	UNSAT TT=1.762	UNSAT TT=5.622	UNSAT TT=1.762	UNSAT TT=1.82	? (TO) TT=1800.1	UNSAT TT=9.212	UNSAT TT=2.816	UNSAT TT=34.17	UNSAT TT=23.858	Signal TT=3.784	Signal TT=3.779	UNSAT TT=75.368	UNSAT TT=7.844	UNSAT TT=7.935	UNSAT TT=7.933	? (TO) TT=1800.07	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-md5-47-3.opb	SAT TT=393.889 T1=393.76	? TT=7.308	? TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=393.889 T1=393.76	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-md5-47-4.opb	SAT TT=555.351 T1=555.01	? TT=7.391	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.11	SAT TT=729.189 T1=729.08	? (TO) TT=1800.19	? (TO) TT=1800.04	SAT TT=1747.69 T1=1747.61	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.2	SAT TT=555.351 T1=555.01	? (TO) TT=1800.1	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-md5-47-5.opb	SAT TT=510.284 T1=510.15	? TT=7.512	? TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.15	SAT TT=1320.23 T1=1320.12	SAT TT=851.731 T1=851.66	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=510.284 T1=510.15	? (TO) TT=1800.19	? (TO) TT=1800.15	SAT TT=789.696 T1=789.38	? (TO) TT=1800.11	? (TO) TT=1800.05
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-sha0-35-2.opb	SAT TT=438.195 T1=437.92	? TT=8.092	SAT TT=1280.04 T1=1279.94	SAT TT=1272.11 T1=1271.94	? (TO) TT=1800.11	SAT TT=601.793 T1=601.7	? (TO) TT=1800.22	? (TO) TT=1800.06	SAT TT=1686.27 T1=1686.22	Signal TT=3.022	Signal TT=3.007	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.19	SAT TT=438.195 T1=437.92	? (TO) TT=1800.1	? (TO) TT=1800.12
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-sha0-35-3.opb	SAT TT=272.244 T1=272.01	? TT=8.079	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=671.835 T1=671.69	? (TO) TT=1800.12	? (TO) TT=1800	SAT TT=1767.96 T1=1767.85	Signal TT=3.023	Signal TT=3.031	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.17	SAT TT=272.244 T1=272.01	? (TO) TT=1800.06	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-sha0-35-4.opb	SAT TT=548.998 T1=548.84	? TT=7.966	SAT TT=1073.1 T1=1072.99	SAT TT=1071.26 T1=1071.13	? (TO) TT=1800.06	SAT TT=548.998 T1=548.84	? (TO) TT=1800.17	? (TO) TT=1800	SAT TT=1247.5 T1=1247.44	Signal TT=3.009	Signal TT=2.833	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.19	SAT TT=905.435 T1=904.99	? (TO) TT=1800.07	? (TO) TT=1800.1
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/ SAT07/industrial/crypto/ mizh-sha0-35-5.opb	SAT TT=157.095 T1=157.02	? TT=7.788	? (TO) TT=1800.13	? (TO) TT=1800.22	? (TO) TT=1800.05	SAT TT=157.095 T1=157.02	? (TO) TT=1800.26	? (TO) TT=1800.09	SAT TT=479.941 T1=479.88	Signal TT=2.997	Signal TT=2.991	SAT TT=409.334 T1=409.28	? (TO) TT=1800.2	? (TO) TT=1800.12	SAT TT=180.671 T1=180.39	? (TO) TT=1800.1	? (TO) TT=1800.12
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-04.opb	UNSAT TT=212.471	? TT=11.605	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=212.471	? (TO) TT=1800.23	? (TO) TT=1800.18	UNSAT TT=1745.41	Signal TT=5.963	Signal TT=5.844	UNSAT TT=961.373	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.1
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-06.opb	UNSAT TT=695.582	? TT=12.215	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=695.582	? (TO) TT=1800.17	UNSAT TT=1741.8	UNSAT TT=912.21	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.16	UNSAT TT=1565.12	? (TO) TT=1800.13	? (TO) TT=1800.06
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-11.opb	SAT TT=836.245 T1=835.56	? (MO) TT=16.94	? (TO) TT=1800.17	? (TO) TT=1800.18	? (exit code) TT=80.877	SAT TT=836.245 T1=835.56	? (TO) TT=1802.21	? (MO) TT=266.205	? (MO) TT=369.12	Signal TT=70.8	Signal TT=66.219	? (TO) TT=1800.16	? (TO) TT=1800.26	? (TO) TT=1800.23	? (TO) TT=1800.36	? (TO) TT=1800.25	? (TO) TT=1800.28
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-15.opb	UNSAT TT=410.228	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.06	UNSAT TT=410.228	? (TO) TT=1800.32	UNSAT TT=913.734	UNSAT TT=529.085	Signal TT=0.923	Signal TT=0.92	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=1172.75	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-16.opb	UNSAT TT=871.177	? TT=10.5	? (TO) TT=1800.31	? (TO) TT=1800.3	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1801.32	? (TO) TT=1800.06	UNSAT TT=871.177	Signal TT=2.337	Signal TT=2.353	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.24	? (TO) TT=1800.1	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-20.opb	UNSAT TT=477.371	? (TO) TT=1800.16	? TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=477.371	? (TO) TT=1800.15	UNSAT TT=1650.42	UNSAT TT=657.933	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.1	UNSAT TT=1037.74	? (TO) TT=1800.07	? (TO) TT=1800.08
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-21.opb	UNSAT TT=634.794	? (TO) TT=1800.1	? TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=716.711	? (TO) TT=1800.13	UNSAT TT=1763.27	UNSAT TT=634.794	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1514.01	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.19	? (TO) TT=1800.07	? TT=1411.17
normalized-PB07/PURE-SAT/ SAT07/industrial/fuhs/ medium/AProVE07-22.opb	UNSAT TT=312.016	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=341.38	? (TO) TT=1800.98	UNSAT TT=541.424	UNSAT TT=312.016	Signal TT=0.641	Signal TT=0.643	UNSAT TT=909.046	? (TO) TT=1800.16	? (TO) TT=1800.15	UNSAT TT=504.101	? (TO) TT=1800.06	? (TO) TT=1800.11
normalized-PB07/ PURE-SAT/SAT07/industrial/ grieu/vmpc_24.opb	SAT TT=32.702 T1=32.57	? (TO) TT=1800.08	? TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.06	SAT TT=96.495 T1=96.46	? (TO) TT=1800.15	SAT TT=202.351 T1=202.24	SAT TT=32.702 T1=32.57	Signal TT=0.617	Signal TT=0.62	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.19	SAT TT=602.483 T1=602.34	? (TO) TT=1800.04	SAT TT=1140.59 T1=1140.57
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/ PURE-SAT/SAT07/industrial/ grieu/vmpc_25.opb	SAT TT=8.143 T1=8.01	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=483.59 T1=483.59	? (TO) TT=1800.37	SAT TT=8.143 T1=8.01	SAT TT=1158.38 T1=1158.32	Signal TT=0.63	Signal TT=0.62	SAT TT=870.28 T1=870.17	? (TO) TT=1800.13	? (TO) TT=1800.18	SAT TT=18.037 T1=17.91	? (TO) TT=1800.11	? (TO) TT=1800.02
normalized-PB07/ PURE-SAT/SAT07/industrial/ grieu/vmpc_26.opb	SAT TT=394.582 T1=394.54	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1381.1 T1=1381.02	? (TO) TT=1800.39	SAT TT=690.665 T1=690.6	SAT TT=394.582 T1=394.54	Signal TT=0.81	Signal TT=0.813	? (TO) TT=1800.07	SAT TT=1759.71 T1=1759.55	SAT TT=1794.13 T1=1794.05	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.07
normalized-PB07/ PURE-SAT/SAT07/industrial/ grieu/vmpc_27.opb	SAT TT=43.74 T1=43.62	? (TO) TT=1800.08	? TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT TT=894.706 T1=894.64	? (TO) TT=1800.13	SAT TT=765.486 T1=765.38	SAT TT=43.74 T1=43.62	No Cert. TT=619.213	No Cert. TT=619.781	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.1
normalized-PB07/ PURE-SAT/SAT07/industrial/ grieu/vmpc_28.opb	SAT TT=612.808 T1=612.68	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.43	? (TO) TT=1800.1	SAT TT=836.879 T1=836.75	SAT TT=661.111 T1=661.01	SAT TT=661.38 T1=661.33	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.1	SAT TT=612.808 T1=612.68	? (TO) TT=1800.02	? (TO) TT=1800.04
normalized-PB07/PURE-SAT/ SAT07/industrial/jarvisalo/ eq.atree.braun.10.unsat.opb	UNSAT TT=863.321	? (TO) TT=1800.15	? TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=863.321	? (TO) TT=1800.75	? (TO) TT=1800.01	UNSAT TT=1053.82	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=1776.09	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.2	? (TO) TT=1800.03	? TT=1235.32
normalized-PB07/PURE-SAT/ SAT07/industrial/ jarvisalo/eq.atree.braun.7.unsat.opb	UNSAT TT=4.414	UNSAT TT=101.698	UNSAT TT=21.882	UNSAT TT=21.777	? (TO) TT=1800.12	UNSAT TT=4.414	? (TO) TT=1800.5	UNSAT TT=11.137	UNSAT TT=4.419	UNSAT TT=11.447	UNSAT TT=11.47	UNSAT TT=7.561	UNSAT TT=56.049	UNSAT TT=56.584	UNSAT TT=7.314	? (TO) TT=1800.05	? TT=1205.95
normalized-PB07/PURE-SAT/ SAT07/industrial/ jarvisalo/eq.atree.braun.8.unsat.opb	UNSAT TT=32.189	? (TO) TT=1800.07	UNSAT TT=255.544	UNSAT TT=252.598	? (TO) TT=1800.08	UNSAT TT=32.189	? (TO) TT=1800.25	UNSAT TT=79.761	UNSAT TT=34.148	UNSAT TT=333.241	UNSAT TT=334.298	UNSAT TT=46.267	UNSAT TT=409.457	UNSAT TT=410.403	UNSAT TT=81.676	? (TO) TT=1800.09	? TT=1206.6
normalized-PB07/PURE-SAT/ SAT07/industrial/ jarvisalo/eq.atree.braun.9.unsat.opb	UNSAT TT=172.32	? (TO) TT=1800.11	UNSAT TT=1564.64	UNSAT TT=1551.26	? (TO) TT=1800.11	UNSAT TT=172.32	? (TO) TT=1800.65	UNSAT TT=525.991	UNSAT TT=210.216	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=340.433	? (TO) TT=1800.16	? (TO) TT=1800.1	UNSAT TT=1271.7	? (TO) TT=1800.02	? TT=1232.02
normalized-PB07/PURE-SAT/ SAT07/industrial/ manolios/manol-pipe-c10nidw_s.opb	UNSAT TT=373.723	? (TO) TT=1800.24	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=1465.4	? (TO) TT=1800.4	? (TO) TT=1800.08	UNSAT TT=603.21	Signal TT=17.537	Signal TT=17.581	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.23	UNSAT TT=373.723	? (TO) TT=1800.13	? (TO) TT=1800.09
normalized-PB07/PURE-SAT/SAT07/industrial/ manolios/manol-pipe-c6nidw_i.opb	UNSAT TT=751.243	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.18	? (TO) TT=1800.08	UNSAT TT=751.243	? (TO) TT=1800.32	? (TO) TT=1800	? (TO) TT=1800.01	Signal TT=3.708	Signal TT=3.709	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.18	? (TO) TT=1800.27	? (TO) TT=1800.04	? (TO) TT=1800.11
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/ SAT07/industrial/ narain/clauses-10.opb	UNSAT TT=385.208	? (MO) TT=20.578	Signal TT=89.604	Signal TT=90.696	? (MO) TT=132.505	? (MO) TT=199.314	? (exit code) TT=75.795	? (MO) TT=249.98	? (MO) TT=629.933	? (problem) TT=147.185	? (problem) TT=147.56	? (TO) TT=1800.26	UNSAT TT=720.146	UNSAT TT=712.679	UNSAT TT=385.208	? (MO) TT=33.75	? (MO) TT=31.531
normalized-PB07/PURE-SAT/ SAT07/industrial/ narain/clauses-2.opb	SAT TT=16.148 T1=16.07	? TT=9.087	SAT TT=266.334 T1=266.21	SAT TT=218.088 T1=218.01	? (TO) TT=1800.11	SAT TT=16.148 T1=16.07	SAT TT=702.368 T1=702.22	SAT TT=61.198 T1=61.13	SAT TT=30.596 T1=30.49	SAT TT=21.032 T1=20.89	SAT TT=21.017 T1=20.89	SAT TT=67.325 T1=67.26	SAT TT=182.389 T1=182.17	SAT TT=174.036 T1=173.69	SAT TT=17.75 T1=17.45	? (TO) TT=1800.09	? TT=936.702
normalized-PB07/PURE-SAT/ SAT07/industrial/ narain/clauses-4.opb	SAT TT=189.053 T1=188.83	? TT=10.814	? TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=189.053 T1=188.83	? (TO) TT=1800.36	SAT TT=591.489 T1=591.38	SAT TT=202.015 T1=201.9	SAT TT=1634.71 T1=1634.44	SAT TT=1625.09 T1=1624.81	SAT TT=1698.36 T1=1698.21	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=724.409 T1=723.93	? (TO) TT=1800.08	? TT=1389.29
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.opb	UNSAT TT=430.112	? TT=15.518	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=430.112	? (TO) TT=1801.28	? (TO) TT=1800.03	UNSAT TT=856.252	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.1	UNSAT TT=993.788	? (TO) TT=1800.11	? (TO) TT=1800.11
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/medium/ blocks-4-ipc5-h22-unknown.opb	UNSAT TT=720.646	? TT=15.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.14	UNSAT TT=720.646	? (TO) TT=1800.72	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.1	? TT=1779.48
normalized-PB07/PURE-SAT/ SAT07/industrial/palacios/ medium/cube-9-h10-unsat.opb	UNSAT TT=57.861	? (TO) TT=1800.34	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.16	UNSAT TT=254.511	? (TO) TT=1802.07	UNSAT TT=111.197	UNSAT TT=57.861	Signal TT=7.183	Signal TT=7.264	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.15	UNSAT TT=67.902	? (TO) TT=1800.13	? (TO) TT=1800.04
normalized-PB07/PURE-SAT/ SAT07/industrial/ palacios/medium/cube-9-h11-sat.opb	SAT TT=77.61 T1=38.42	? TT=21.128	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.16	SAT TT=1229.71 T1=1229.54	? (TO) TT=1800.53	SAT TT=453.303 T1=453.18	SAT TT=89.039 T1=88.94	Signal TT=8.456	Signal TT=8.532	? (TO) TT=1800.12	SAT TT=1328.48 T1=1328.13	SAT TT=1314.45 T1=1314	SAT TT=77.61 T1=38.42	? (TO) TT=1800.1	? (TO) TT=1800.06
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l05-ipc5-h26-unsat.opb	UNSAT TT=159.561	? (TO) TT=1800.31	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.16	UNSAT TT=159.561	? (TO) TT=1800.48	UNSAT TT=1180.56	UNSAT TT=303.699	Signal TT=5.186	Signal TT=5.105	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=678.794	? (TO) TT=1800.07	? TT=1213.35
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l05-ipc5-h27-unknown.opb	UNSAT TT=229.262	? (TO) TT=1800.38	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	UNSAT TT=229.262	? (TO) TT=1800.9	? (TO) TT=1800.04	UNSAT TT=883.329	Signal TT=5.533	Signal TT=5.552	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.19	UNSAT TT=1463.56	? (TO) TT=1800.03	? TT=1219.36
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h28-unknown.opb	UNSAT TT=342.762	? TT=16.65	? (TO) TT=1800.17	? (TO) TT=1800.2	? (TO) TT=1800.15	UNSAT TT=560.759	? (TO) TT=1801.93	UNSAT TT=1570.3	UNSAT TT=599.916	Signal TT=8.307	Signal TT=8.388	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=342.762	? (TO) TT=1800.1	? TT=1299.74
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h29-unknown.opb	UNSAT TT=251.569	? TT=16.428	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	UNSAT TT=251.569	? (TO) TT=1800.35	? (TO) TT=1800.08	UNSAT TT=1487.17	Signal TT=8.817	Signal TT=8.258	UNSAT TT=1684.69	? (TO) TT=1800.16	? (TO) TT=1800.11	UNSAT TT=526.619	? (TO) TT=1800.09	? TT=1303.34
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h30-unknown.opb	UNSAT TT=600.557	? TT=15.937	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.11	UNSAT TT=600.557	? (TO) TT=1800.38	? (TO) TT=1800	UNSAT TT=1561.32	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.1	UNSAT TT=1787.22	? (TO) TT=1800.09	? TT=1305.21
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h31-unknown.opb	UNSAT TT=746.978	? TT=15.495	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=746.978	? (TO) TT=1800.33	? (TO) TT=1800.05	UNSAT TT=1245.38	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.05	? TT=1310.6
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h32-unknown.opb	UNSAT TT=1227.89	? TT=14.74	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.14	UNSAT TT=1227.89	? (TO) TT=1802.14	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.11	? TT=1315.15
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h34-unknown.opb	SAT TT=129.351 T1=129.16	? TT=13.363	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.2	SAT TT=129.351 T1=129.16	? (TO) TT=1800.5	? (TO) TT=1800.08	SAT TT=445.456 T1=445.34	Signal TT=11.582	Signal TT=11.674	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.17	SAT TT=1232.58 T1=1232.18	? (TO) TT=1800.08	? TT=1333.3
normalized-PB07/PURE-SAT/SAT07/ industrial/palacios/uts/ uts-l06-ipc5-h35-unknown.opb	SAT TT=141.067 T1=140.92	? TT=12.802	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.14	SAT TT=141.067 T1=140.92	? (TO) TT=1801.86	? (TO) TT=1800.07	SAT TT=426.517 T1=426.36	Signal TT=12.167	Signal TT=12.169	? (TO) TT=1800.12	SAT TT=462.732 T1=462.36	SAT TT=482.216 T1=481.86	SAT TT=970.283 T1=969.85	? (TO) TT=1800.05	? TT=1337.52
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug10.opb	SAT TT=400.812 T1=400.01	? TT=12.745	? (MO) TT=103.643	? (MO) TT=105.124	? (MO) TT=208.186	? (MO) TT=211.986	? (MO) TT=90.378	? (MO) TT=278.098	? (MO) TT=768.305	Signal TT=216.969	Signal TT=217.614	? (MO) TT=206.532	SAT TT=401.964 T1=401.11	SAT TT=400.812 T1=400.01	SAT TT=543.638 T1=542.84	? (MO) TT=42.478	? (MO) TT=41.783
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug1.opb		? TT=0.255	Signal TT=0.005	Signal TT=0.005	? TT=0.003	No Cert. TT=0.001	? (exit code) TT=0.003	No Cert. TT=0.027	No Cert. TT=0.029	Signal TT=0.002	Signal TT=0	? TT=0.001	? TT=0.224	? TT=0.222	? TT=0.222	? (problem) TT=0.001	? (problem) TT=0.001
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug2.opb	SAT TT=330.103 T1=329.33	? TT=13.061	? (MO) TT=97.457	? (MO) TT=104.802	? (MO) TT=276.995	? (MO) TT=211.518	? (MO) TT=90.434	? (MO) TT=279.906	? (MO) TT=751.998	Signal TT=216.266	Signal TT=216.715	? (MO) TT=208.849	? (TO) TT=1800.31	? (TO) TT=1800.31	SAT TT=330.103 T1=329.33	? (MO) TT=375.898	? (MO) TT=42.79
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug3.opb	SAT TT=343.848 T1=343.05	? TT=12.977	? (MO) TT=103.682	? (MO) TT=105.145	? (MO) TT=208.025	? (MO) TT=211.894	? (MO) TT=90.317	? (MO) TT=278.031	? (MO) TT=764.54	Signal TT=217.423	Signal TT=219.891	? (MO) TT=206.877	SAT TT=1285.11 T1=1284.29	SAT TT=1244.02 T1=1243.22	SAT TT=343.848 T1=343.05	? (MO) TT=42.363	? (MO) TT=42.834
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug4.opb	SAT TT=442.783 T1=441.91	? TT=12.771	? (MO) TT=104.443	? (MO) TT=105.841	? (MO) TT=275.16	? (MO) TT=211.951	? (MO) TT=90.552	? (MO) TT=278.376	? (MO) TT=758.772	Signal TT=217.33	Signal TT=216.884	? (MO) TT=207.035	? (TO) TT=1800.37	? (TO) TT=1800.31	SAT TT=442.783 T1=441.91	? (MO) TT=42.006	? (MO) TT=43.181
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.opb	SAT TT=765.922 T1=765.11	? TT=12.831	? (MO) TT=104.068	? (MO) TT=105.312	? (MO) TT=208.42	? (MO) TT=212.183	? (MO) TT=89.574	? (MO) TT=277.651	? (MO) TT=771.676	Signal TT=216.338	Signal TT=205.486	? (MO) TT=207.892	? (TO) TT=1800.51	? (TO) TT=1800.35	SAT TT=765.922 T1=765.11	? (MO) TT=42.128	? (MO) TT=42.822
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.opb	SAT TT=338.9 T1=338.05	? TT=12.731	? (MO) TT=162.7	? (MO) TT=104.987	? (MO) TT=209.675	? (MO) TT=211.866	? (MO) TT=89.38	? (MO) TT=278.08	? (MO) TT=751.017	Signal TT=217.101	Signal TT=219.315	? (MO) TT=206.023	SAT TT=338.9 T1=338.05	SAT TT=359.224 T1=358.45	SAT TT=396.27 T1=395.5	? (MO) TT=41.948	? (MO) TT=41.735
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug7.opb	SAT TT=390.043 T1=388.86	? TT=12.947	? (MO) TT=104.086	? (MO) TT=105.398	? (MO) TT=208.677	? (MO) TT=211.848	? (MO) TT=89.445	? (MO) TT=277.601	? (MO) TT=752.1	Signal TT=217.705	Signal TT=204.172	? (MO) TT=206.069	SAT TT=393.474 T1=392.63	SAT TT=390.043 T1=388.86	SAT TT=433.28 T1=432.43	? (MO) TT=42.848	? (MO) TT=42.027
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug8.opb	SAT TT=495.463 T1=494.69	? TT=13.202	? (MO) TT=103.53	? (MO) TT=105.479	? (MO) TT=207.879	? (MO) TT=211.408	? (MO) TT=89.432	? (MO) TT=277.378	? (MO) TT=752.07	Signal TT=216.673	Signal TT=217.355	? (MO) TT=206.229	SAT TT=495.463 T1=494.69	SAT TT=522.383 T1=521.56	SAT TT=531.05 T1=530.24	? (MO) TT=42.858	? (MO) TT=42.035
normalized-PB07/PURE-SAT/SAT07/ industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug9.opb	SAT TT=292.89 T1=292.07	? TT=12.918	? (MO) TT=106.123	? (MO) TT=105.12	? (MO) TT=208.851	? (MO) TT=210.891	? (MO) TT=90.339	? (MO) TT=277.888	? (MO) TT=773.82	Signal TT=216.031	Signal TT=216.73	? (MO) TT=206.519	SAT TT=1093.82 T1=1092.65	SAT TT=1153.35 T1=1152.52	SAT TT=292.89 T1=292.07	? (MO) TT=42.892	? (MO) TT=42.614

Some statistics...

	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
Number of times the solver is able to give the best known answer	9	60	63	1	115	13	102	125	35	35	85	47	47	98	1	4
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	9	60	63	1	115	13	102	125	35	35	85	47	47	98	1	4
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	17	0	0	47	1	4	34	1	7	2	2	3	24	0	1
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	13	0	2	11	1	3	2	2	3	17	0	1