SAT 2009 Competition: main competition (phase2): results by benchmark

Results by benchmark for category crafted instances (CRAFTED)

This page displays the results of the different solvers for each benchmark for category crafted instances (CRAFTED)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
clasp 1.2.0-SAT09-32 (complete)
glucose 1.0 (complete)
IUT_BMB_SAT 1.0 (complete)
LySAT c/2009-03-20 (complete)
MiniSat 2.1 (Sat-race'08 Edition) (complete)
MXC 2009-03-10 (complete)
precosat 236 (complete)
SApperloT base (complete)
SAT07 reference solver: minisat SAT 2007 (complete)
SAT07 reference solver: SATzilla CRAFTED (complete)
SATzilla2009_C 2009-03-22 (complete)
VARSAT-industrial 2009-03-22 (complete)

Bench name	Best results on this instance	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Difficult/contest-02-03-04/ contest02-ezfact64_10.sat05-449.reshuffled-07.cnf	SAT TT=2480.93	? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.03	? (TO) TT=5000.08	? (TO) TT=5000.09	SAT TT=2480.93	? (exit code) TT=4999.05	SAT TT=2645.61	? (TO) TT=5000.03
crafted/Difficult/contest-02-03-04/ contest02-Mat26.sat05-457.reshuffled-07.cnf	UNSAT TT=249.137	UNSAT TT=286.262	UNSAT TT=540.24	UNSAT TT=276.216	UNSAT TT=249.137	UNSAT TT=981.846	UNSAT TT=287.49	UNSAT TT=538.052	UNSAT TT=594.593	UNSAT TT=279.372	UNSAT TT=616.347	UNSAT TT=304.851	UNSAT TT=401.383
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf	UNSAT TT=199.967	UNSAT TT=199.967	UNSAT TT=1345.33	UNSAT TT=1608.61	UNSAT TT=2005.24	UNSAT TT=1941.07	UNSAT TT=1215.01	UNSAT TT=558.6	UNSAT TT=1343.49	UNSAT TT=1650.12	UNSAT TT=1305.99	UNSAT TT=1370.3	UNSAT TT=2011.94
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_3-dir.sat05-440.reshuffled-07.cnf	UNSAT TT=334.451	UNSAT TT=334.451	UNSAT TT=2039.55	UNSAT TT=2255.67	UNSAT TT=2197.93	UNSAT TT=2842.47	UNSAT TT=1240.77	UNSAT TT=1109.34	UNSAT TT=1335.34	UNSAT TT=2215.93	UNSAT TT=2227.28	UNSAT TT=2245.35	UNSAT TT=2146.67
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n600-d0.02-s1676244754.sat05-535.reshuffled-07.cnf	UNSAT TT=208.173	UNSAT TT=296.86	UNSAT TT=420.741	UNSAT TT=537.949	UNSAT TT=400.001	UNSAT TT=724.894	UNSAT TT=208.173	UNSAT TT=802.361	UNSAT TT=295.368	UNSAT TT=525.103	? (exit code) TT=4998.9	UNSAT TT=611.096	UNSAT TT=502.556
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n800-d0.04-s362703357.sat05-548.reshuffled-07.cnf	UNSAT TT=255.553	UNSAT TT=410.958	UNSAT TT=996.168	UNSAT TT=1136.35	UNSAT TT=908.322	UNSAT TT=1969.55	UNSAT TT=255.553	UNSAT TT=2343.84	UNSAT TT=564.596	UNSAT TT=1037.4	? (exit code) TT=4998.87	UNSAT TT=1436.12	UNSAT TT=1974.85
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1000-m6860-k4-l4-s1935114289.sat05-523.reshuffled-07.cnf	UNSAT TT=861.916	UNSAT TT=861.916	? (TO) TT=5000.03	UNSAT TT=1590.91	UNSAT TT=1755.91	? (TO) TT=5000.1	? (TO) TT=5000.02	? (TO) TT=5000.06	UNSAT TT=1822.61	UNSAT TT=1672.94	UNSAT TT=2223.33	UNSAT TT=1721.29	UNSAT TT=2089.36
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1100-m7545-k4-l4-s310659001.sat05-524.reshuffled-07.cnf	UNSAT TT=506.672	UNSAT TT=506.672	UNSAT TT=2926.46	UNSAT TT=743.899	UNSAT TT=772.729	UNSAT TT=2566.43	? (TO) TT=5000.03	? (TO) TT=5000.04	UNSAT TT=901.178	UNSAT TT=761.504	UNSAT TT=1199.63	UNSAT TT=841.591	UNSAT TT=668.795
crafted/Difficult/contest05/ jarvisalo/ mod2c-3cage-unsat-10-3.sat05-2568.reshuffled-07.cnf	UNSAT TT=271	UNSAT TT=3385.48	UNSAT TT=2388.53	UNSAT TT=1684.65	UNSAT TT=1753.37	? (TO) TT=5000.07	UNSAT TT=1785.31	? (TO) TT=5000.06	? (TO) TT=5000.02	UNSAT TT=1652.37	? (exit code) TT=4998.39	UNSAT TT=271	UNSAT TT=2257.95
crafted/Difficult/contest05/ jarvisalo/ mod2c-rand3bip-sat-210-3.sat05-2475.reshuffled-07.cnf	SAT TT=67.143	SAT TT=691.715	SAT TT=1324.34	SAT TT=160.727	SAT TT=333.656	SAT TT=461.058	SAT TT=67.143	SAT TT=81.252	SAT TT=447.189	SAT TT=161.731	SAT TT=112.785	SAT TT=182.739	SAT TT=218.964
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Difficult/contest05/ jarvisalo/ mod2c-rand3bip-unsat-120-3.sat05-2340.reshuffled-07.cnf	UNSAT TT=103.567	UNSAT TT=496.374	UNSAT TT=146.901	UNSAT TT=352.028	UNSAT TT=153.313	UNSAT TT=1092.04	UNSAT TT=103.567	UNSAT TT=364.294	UNSAT TT=833.255	UNSAT TT=343.723	? (exit code) TT=4998.37	UNSAT TT=368.333	UNSAT TT=411.024
crafted/Difficult/contest05/ jarvisalo/ mod2-rand3bip-sat-270-1.sat05-2248.reshuffled-07.cnf	SAT TT=0.014	? (TO) TT=5000.07	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.05	? (TO) TT=5000.06	SAT TT=0.014	SAT TT=0.014	? (TO) TT=5000.1
crafted/Difficult/contest05/ jarvisalo/ mod2-rand3bip-sat-270-2.sat05-2249.reshuffled-07.cnf	SAT TT=0.013	SAT TT=1586.11	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.04	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.02	SAT TT=0.013	SAT TT=0.014	? (TO) TT=5000.08
crafted/Difficult/contest05/ jarvisalo/ mod2-rand3bip-sat-280-1.sat05-2263.reshuffled-07.cnf	SAT TT=0.015	SAT TT=560.373	? (TO) TT=5000.08	SAT TT=285.623	? (TO) TT=5000.12	SAT TT=3429.23	SAT TT=3441.79	? (TO) TT=5000.09	SAT TT=551.082	SAT TT=301.908	SAT TT=0.015	SAT TT=0.015	SAT TT=311.564
crafted/Difficult/contest05/ jarvisalo/ mod2-rand3bip-sat-280-2.sat05-2264.reshuffled-07.cnf	SAT TT=0.014	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.08	SAT TT=0.014	SAT TT=0.014	? (TO) TT=5000.07
crafted/Difficult/contest05/ jarvisalo/ mod2-rand3bip-sat-280-3.sat05-2265.reshuffled-07.cnf	SAT TT=0.015	? (TO) TT=5000.02	? (TO) TT=5000.01	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.11	? (TO) TT=5000.06	SAT TT=3782.4	? (TO) TT=5000.02	SAT TT=0.015	SAT TT=0.016	SAT TT=3254.88
crafted/Difficult/contest05/ others/ linvrinv5.sat05-564.reshuffled-07.cnf	UNSAT TT=1704.33	UNSAT TT=1704.33	? (TO) TT=5000.05	UNSAT TT=2220.01	UNSAT TT=2539.77	? (TO) TT=5000.07	UNSAT TT=1762.75	? (TO) TT=5000.1	UNSAT TT=2637.26	UNSAT TT=2617	UNSAT TT=4118.38	UNSAT TT=4591.5	UNSAT TT=2517.05
crafted/Difficult/contest05/ others/ pmg-12-UNSAT.sat05-3940.reshuffled-07.cnf	UNSAT TT=15.305	UNSAT TT=1607.26	? (TO) TT=5000.05	UNSAT TT=2047.04	? (TO) TT=5000.09	? (TO) TT=5000.07	UNSAT TT=2237.2	? (TO) TT=5000.02	? (TO) TT=5000.05	UNSAT TT=2401.86	UNSAT TT=4873.61	UNSAT TT=15.305	UNSAT TT=3850.12
crafted/Difficult/contest05/ others/ pmg-13-UNSAT.sat05-3941.reshuffled-07.cnf	UNSAT TT=16.029	? (TO) TT=5000.12	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.06	? (TO) TT=5000.11	? (exit code) TT=4999.15	UNSAT TT=16.029	? (TO) TT=5000.07
crafted/Difficult/contest05/ others/ pmg-14-UNSAT.sat05-3942.reshuffled-07.cnf	UNSAT TT=16.501	? (TO) TT=5000.11	? (TO) TT=5000.01	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.02	? (exit code) TT=4999.02	UNSAT TT=16.501	? (TO) TT=5000.08
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Difficult/contest05/ others/ sgp_5-5-6.sat05-2675.reshuffled-07.cnf	SAT TT=1182.56	? (TO) TT=5000.13	SAT TT=1182.56	? (TO) TT=5000.07	? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.11	? (TO) TT=5000.1	? (exit code) TT=4998.81	? (exit code) TT=4998.36	? (TO) TT=5000.12
crafted/Difficult/contest05/ others/ sgp_6-6-10.sat05-2670.reshuffled-07.cnf	SAT TT=83.44	? (TO) TT=5000.32	? (TO) TT=5000.01	SAT TT=304.566	SAT TT=83.44	? (TO) TT=5000.23	? (TO) TT=5000.29	? (TO) TT=5000.16	? (TO) TT=5000.17	SAT TT=165.033	? (MO) TT=3582.15	SAT TT=216.382	SAT TT=795.287
crafted/Difficult/contest05/ QG/ QG6-dead-dnd002.sat05-2713.reshuffled-07.cnf	UNSAT TT=38.695	UNSAT TT=60.718	UNSAT TT=251.492	UNSAT TT=38.695	UNSAT TT=170.659	UNSAT TT=98.783	UNSAT TT=139.038	UNSAT TT=126.805	UNSAT TT=1925.32	UNSAT TT=96.237	UNSAT TT=2896.65	UNSAT TT=116.259	UNSAT TT=173.173
crafted/Difficult/contest05/ QG/ QG6-gensys-brn007.sat05-2684.reshuffled-07.cnf	UNSAT TT=55.85	UNSAT TT=55.85	UNSAT TT=238.635	UNSAT TT=90.864	UNSAT TT=139.607	UNSAT TT=135.54	UNSAT TT=181.169	UNSAT TT=141.794	UNSAT TT=270.944	UNSAT TT=66.86	UNSAT TT=1246.28	UNSAT TT=85.761	UNSAT TT=113.606
crafted/Difficult/contest05/ QG/ QG6-gensys-icl001.sat05-2695.reshuffled-07.cnf	UNSAT TT=46.019	UNSAT TT=46.019	UNSAT TT=293.125	UNSAT TT=83.517	UNSAT TT=142.142	UNSAT TT=160.353	UNSAT TT=170.182	UNSAT TT=118.006	UNSAT TT=1194.17	UNSAT TT=89.244	UNSAT TT=1522.08	UNSAT TT=110.934	UNSAT TT=124.899
crafted/Difficult/contest05/ QG/ QG6-gensys-icl004.sat05-2716.reshuffled-07.cnf	UNSAT TT=64.972	UNSAT TT=64.972	UNSAT TT=181.947	UNSAT TT=176.598	UNSAT TT=119.813	UNSAT TT=133.717	UNSAT TT=232.377	UNSAT TT=159.503	UNSAT TT=464.31	UNSAT TT=91.922	UNSAT TT=793.842	UNSAT TT=113.752	UNSAT TT=172.383
crafted/Difficult/contest05/ QG/ QG6-gensys-icl008.sat05-2720.reshuffled-07.cnf	UNSAT TT=44.576	UNSAT TT=61.971	UNSAT TT=2771.49	UNSAT TT=44.576	UNSAT TT=610.36	UNSAT TT=183.48	UNSAT TT=209.615	? (TO) TT=5000.03	UNSAT TT=1674.12	UNSAT TT=66.299	UNSAT TT=2771.89	UNSAT TT=81.776	UNSAT TT=196.213
crafted/Difficult/contest05/ QG/ QG6-gensys-icl009.sat05-2721.reshuffled-07.cnf	UNSAT TT=67.869	UNSAT TT=67.869	UNSAT TT=289.361	UNSAT TT=167.625	UNSAT TT=101.071	UNSAT TT=169.348	UNSAT TT=256.24	UNSAT TT=165.089	UNSAT TT=501.549	UNSAT TT=73.877	UNSAT TT=387.162	UNSAT TT=99.183	UNSAT TT=198.996
crafted/Difficult/contest05/ QG/ QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf	UNSAT TT=101.986	UNSAT TT=101.986	UNSAT TT=200.388	UNSAT TT=128.826	UNSAT TT=264.473	UNSAT TT=369.993	UNSAT TT=505.737	UNSAT TT=165.027	UNSAT TT=1269.17	UNSAT TT=235.419	UNSAT TT=1536.5	UNSAT TT=259.703	UNSAT TT=184.657
crafted/Difficult/contest05/ QG/ QG7-gensys-icl006.sat05-3132.reshuffled-07.cnf	UNSAT TT=324.402	UNSAT TT=324.402	UNSAT TT=1023.17	UNSAT TT=723.32	UNSAT TT=856.162	UNSAT TT=2917.63	UNSAT TT=4162.63	UNSAT TT=2650.98	UNSAT TT=548.313	UNSAT TT=786.459	UNSAT TT=919.034	UNSAT TT=829.037	UNSAT TT=1472.99
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Difficult/contest05/ sabharwal/ counting-easier-php-018-014.sat05-1175.reshuffled-07.cnf	UNSAT TT=36.747	? (TO) TT=5000.08	? (TO) TT=5000.1	? (TO) TT=5000.13	? (TO) TT=5000.1	? (TO) TT=5000.05	? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.07	? (exit code) TT=4999.06	UNSAT TT=36.747	? (TO) TT=5000.02
crafted/Difficult/contest05/ sabharwal/ counting-harder-php-014-013.sat05-1187.reshuffled-07.cnf	UNSAT TT=21.896	? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.06	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.02	? (TO) TT=5000.07	? (TO) TT=5000.11	? (TO) TT=5000.1	? (exit code) TT=4999.24	UNSAT TT=21.896	? (TO) TT=5000.08
crafted/Difficult/contest05/ sabharwal/ counting-harder-php-018-017.sat05-1189.reshuffled-07.cnf	UNSAT TT=359.637	? (TO) TT=5000.07	? (TO) TT=5000	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.03	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.07	? (exit code) TT=4999.06	UNSAT TT=359.637	? (TO) TT=5000.02
crafted/Difficult/contest05/sabharwal/ grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf	SAT TT=1.591	SAT TT=1.849	? (TO) TT=5000.04	SAT TT=3.881	? (TO) TT=5000.08	SAT TT=1.591	SAT TT=1.711	SAT TT=3.145	? (TO) TT=5000.11	SAT TT=1.775	SAT TT=418.709	SAT TT=6.755	SAT TT=2.414
crafted/Difficult/contest05/sabharwal/ grid-pebbling-unsat-grid-pbl-0300.sat05-1350.sat05-1350.reshuffled-07.cnf	UNSAT TT=1.876	UNSAT TT=2.004	UNSAT TT=4.287	UNSAT TT=3.953	UNSAT TT=8.834	UNSAT TT=1.876	UNSAT TT=1.93	UNSAT TT=3.399	? (TO) TT=5000.15	UNSAT TT=1.944	UNSAT TT=337.05	UNSAT TT=6.856	UNSAT TT=2.589
crafted/Difficult/contest05/ sabharwal/ gt-ordering-sat-gt-040.sat05-1297.reshuffled-07.cnf	UNSAT TT=23.021	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.24	? (TO) TT=5000.11	UNSAT TT=149.234	? (TO) TT=5000.08	? (TO) TT=5000.09	UNSAT TT=23.021	UNSAT TT=28.898	? (TO) TT=5000.14
crafted/Difficult/contest05/ sabharwal/ gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf	UNSAT TT=13.615	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.21	? (TO) TT=5000.11	UNSAT TT=13.615	? (TO) TT=5000.1	? (TO) TT=5000.11	UNSAT TT=30.898	UNSAT TT=33.369	? (TO) TT=5000.14
crafted/Difficult/contest05/ sabharwal/ gt-ordering-unsat-gt-060.sat05-1312.reshuffled-07.cnf	UNSAT TT=50.84	? (TO) TT=5000.19	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.03	? (TO) TT=5000.22	? (TO) TT=5000.14	UNSAT TT=1021.24	? (TO) TT=5000.13	? (TO) TT=5000.2	UNSAT TT=50.84	UNSAT TT=81.589	? (TO) TT=5000.16
CRAFTED/edgematching/ all/ em_11_3_4_all.cnf	SAT TT=1.171	SAT TT=161.71	SAT TT=19.536	SAT TT=19.559	SAT TT=198.528	SAT TT=2.462	SAT TT=25.304	SAT TT=32.838	SAT TT=1.171	SAT TT=13.207	SAT TT=151.289	SAT TT=45.473	SAT TT=3778.56
CRAFTED/edgematching/ all/ em_12_2_4_all.cnf	SAT TT=7.711	SAT TT=134.345	SAT TT=26.714	SAT TT=24.82	SAT TT=123.922	SAT TT=23.238	SAT TT=7.711	SAT TT=739.645	SAT TT=87.806	SAT TT=647.046	SAT TT=216.467	? (exit code) TT=4998.49	? (TO) TT=5000.03
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/edgematching/ all/ em_14_7_3_all.cnf	SAT TT=11.027	SAT TT=168.26	SAT TT=41.922	SAT TT=53.722	SAT TT=45.987	SAT TT=11.027	SAT TT=15.235	SAT TT=71.092	SAT TT=11.535	SAT TT=21.504	SAT TT=1878.65	? (exit code) TT=4999.04	? (TO) TT=5000.14
CRAFTED/ edgematching/ all/em_7_3_6_all.cnf	SAT TT=5.358	SAT TT=6.353	SAT TT=5.358	SAT TT=126.383	SAT TT=41.965	SAT TT=31.249	SAT TT=11.926	SAT TT=5.493	SAT TT=22.181	SAT TT=126.622	SAT TT=133.137	SAT TT=76.531	SAT TT=91.024
CRAFTED/ edgematching/ all/em_7_4_8_all.cnf	SAT TT=30.409	SAT TT=30.409	SAT TT=172.996	SAT TT=728.023	SAT TT=335.251	SAT TT=49.188	SAT TT=271.952	SAT TT=367.35	SAT TT=146.662	SAT TT=723.532	? (exit code) TT=4999.26	SAT TT=356.94	SAT TT=139.609
CRAFTED/ edgematching/ all/em_7_4_9_all.cnf	SAT TT=3.01	SAT TT=28.994	SAT TT=3.01	SAT TT=123.603	SAT TT=13.475	SAT TT=7.3	SAT TT=7.152	SAT TT=33.683	SAT TT=15.654	SAT TT=117.912	SAT TT=86.565	SAT TT=24.874	SAT TT=9.723
CRAFTED/ edgematching/ all/em_8_4_5_all.cnf	SAT TT=3.004	SAT TT=3.004	SAT TT=45.819	SAT TT=10.717	SAT TT=13.801	SAT TT=11.345	SAT TT=71.093	SAT TT=57.836	SAT TT=72.198	SAT TT=10.725	SAT TT=77.868	SAT TT=82.185	SAT TT=36.304
CRAFTED/edgematching/ compact/ em_11_3_4_cmp.cnf		? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.13	? (TO) TT=5000.14	? (TO) TT=5000.08	? (TO) TT=5000.07	? (TO) TT=5000.16	? (exit code) TT=4998.72	? (exit code) TT=4998.64	? (TO) TT=5000.11
CRAFTED/edgematching/ compact/ em_12_2_4_cmp.cnf		? (TO) TT=5000.08	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.14	? (TO) TT=5000.11	? (TO) TT=5000.17	? (TO) TT=5000.12	? (TO) TT=5000.15	? (exit code) TT=4999.22	? (exit code) TT=4998.72	? (TO) TT=5000.16
CRAFTED/edgematching/ compact/ em_14_7_3_cmp.cnf		? (TO) TT=5000.15	? (TO) TT=5000.08	? (MO) TT=2771.13	? (MO) TT=2058.98	? (TO) TT=5000.28	? (TO) TT=5000.26	? (TO) TT=5000.17	? (TO) TT=5000.25	? (MO) TT=4709.29	? (exit code) TT=4998.79	? (exit code) TT=4998.37	? (MO) TT=2193.29
CRAFTED/edgematching/ compact/ em_7_3_6_cmp.cnf	SAT TT=741.666	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.03	SAT TT=4358.2	SAT TT=2650.85	SAT TT=2518.44	SAT TT=741.666	? (TO) TT=5000.11	? (exit code) TT=4998.9	SAT TT=3834.1	? (TO) TT=5000.1
CRAFTED/edgematching/ compact/ em_7_4_8_cmp.cnf	SAT TT=2625.93	SAT TT=2625.93	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.08	? (TO) TT=5000.08	? (TO) TT=5000.02	? (exit code) TT=4998.93	? (exit code) TT=4999.06	? (TO) TT=5000.11
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/edgematching/ compact/ em_7_4_9_cmp.cnf	SAT TT=19.633	SAT TT=41.268	SAT TT=83.757	SAT TT=168.023	SAT TT=90.853	SAT TT=36.698	SAT TT=44.55	SAT TT=58.506	SAT TT=43.966	SAT TT=180.305	SAT TT=19.633	SAT TT=118.41	SAT TT=132.291
CRAFTED/edgematching/ compact/ em_8_4_5_cmp.cnf	SAT TT=207.864	? (TO) TT=5000.09	? (TO) TT=5000.01	SAT TT=207.864	SAT TT=231.067	? (TO) TT=5000.12	? (TO) TT=5000.08	? (TO) TT=5000.11	SAT TT=2865.97	SAT TT=216.517	? (exit code) TT=4999.01	? (exit code) TT=4999.14	SAT TT=1173.97
CRAFTED/edgematching/ compact/ em_9_3_5_cmp.cnf		? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000	? (TO) TT=5000.02	? (TO) TT=5000.13	? (TO) TT=5000.14	? (TO) TT=5000.07	? (TO) TT=5000.13	? (TO) TT=5000.13	? TT=4999.33	? (exit code) TT=4998.68	? (TO) TT=5000.09
CRAFTED/edgematching/ explicit/ em_11_3_4_exp.cnf	SAT TT=42.773	SAT TT=1343.81	SAT TT=202.933	SAT TT=2778.74	SAT TT=47.466	SAT TT=53.06	SAT TT=42.773	SAT TT=225.243	SAT TT=136.702	SAT TT=2533.23	SAT TT=718.468	SAT TT=137.478	SAT TT=3803.92
CRAFTED/edgematching/ explicit/ em_12_2_4_exp.cnf	SAT TT=138.534	SAT TT=4672.5	SAT TT=199.995	SAT TT=4144.51	SAT TT=3151.7	SAT TT=138.534	SAT TT=141.623	SAT TT=1166.57	SAT TT=497.123	SAT TT=718.366	SAT TT=1197.73	? (exit code) TT=4998.85	? (TO) TT=5000.04
CRAFTED/edgematching/ explicit/ em_7_3_6_exp.cnf	SAT TT=0.783	SAT TT=7.333	SAT TT=5.642	SAT TT=189.321	SAT TT=39.959	SAT TT=0.783	SAT TT=46.411	SAT TT=35.638	SAT TT=22.547	SAT TT=191.447	SAT TT=54.887	SAT TT=50.079	SAT TT=1.301
CRAFTED/edgematching/ explicit/ em_7_4_8_exp.cnf	SAT TT=33.155	SAT TT=47.344	SAT TT=81.841	SAT TT=368.887	SAT TT=310.368	SAT TT=62.868	SAT TT=188.58	SAT TT=33.155	SAT TT=534.758	SAT TT=383.473	? (exit code) TT=4999.04	SAT TT=297.522	SAT TT=516.925
CRAFTED/edgematching/ explicit/ em_7_4_9_exp.cnf	SAT TT=5.395	SAT TT=30.525	SAT TT=12.513	SAT TT=19.6	SAT TT=20.485	SAT TT=5.395	SAT TT=30.057	SAT TT=34.83	SAT TT=6.915	SAT TT=19.748	SAT TT=52.574	SAT TT=116.42	SAT TT=108.871
CRAFTED/edgematching/ explicit/ em_8_4_5_exp.cnf	SAT TT=14.964	SAT TT=14.964	SAT TT=22.06	SAT TT=73.378	SAT TT=20.064	SAT TT=26.157	SAT TT=90.149	SAT TT=114.184	SAT TT=74.259	SAT TT=73.697	SAT TT=54.298	SAT TT=136.443	SAT TT=178.76
CRAFTED/edgematching/ explicit/ em_9_3_5_exp.cnf	SAT TT=19.19	SAT TT=148.384	SAT TT=51.484	SAT TT=90.841	SAT TT=19.19	SAT TT=184.472	SAT TT=498.609	SAT TT=181.611	SAT TT=73.609	SAT TT=86.172	SAT TT=43.653	SAT TT=275.467	SAT TT=121.366
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/edgematching/ fbcolors/ em_11_3_4_fbc.cnf		? (TO) TT=5000.11	? (TO) TT=5000.02	? (TO) TT=5000.03	? (TO) TT=5000.03	? (TO) TT=5000.12	? (TO) TT=5000.13	? (TO) TT=5000.15	? (TO) TT=5000.13	? (TO) TT=5000.14	? (exit code) TT=4998.77	? (exit code) TT=4998.49	? (TO) TT=5000.19
CRAFTED/edgematching/ fbcolors/ em_12_2_4_fbc.cnf		? (TO) TT=5000.12	? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.19	? (TO) TT=5000.2	? (TO) TT=5000.17	? (TO) TT=5000.16	? (TO) TT=5000.21	? (exit code) TT=4998.52	? (exit code) TT=4998.94	? (TO) TT=5000.22
CRAFTED/edgematching/ fbcolors/ em_14_7_3_fbc.cnf		? (MO) TT=2412.3	? (TO) TT=5000.01	? (MO) TT=1088.74	? (MO) TT=1070.69	? (TO) TT=5000.2	? (TO) TT=5000.32	? (TO) TT=5000.3	? (TO) TT=5000.23	? (MO) TT=1203.42	? (exit code) TT=4999.11	? (exit code) TT=4999.16	? (MO) TT=1265.82
CRAFTED/edgematching/ fbcolors/ em_7_3_6_fbc.cnf	SAT TT=4.677	SAT TT=4.677	SAT TT=2323.7	SAT TT=1589.21	SAT TT=4088.42	? (TO) TT=5000.04	SAT TT=395.497	SAT TT=901.34	SAT TT=3031.56	SAT TT=1623.48	SAT TT=802.585	SAT TT=491.531	? (TO) TT=5000.11
CRAFTED/edgematching/ fbcolors/ em_7_4_8_fbc.cnf	SAT TT=922.193	SAT TT=1743.26	? (TO) TT=5000.01	? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.1	? (TO) TT=5000.04	SAT TT=922.193	SAT TT=1222.09	? (TO) TT=5000.06	? (exit code) TT=4999.11	? (exit code) TT=4998.88	? (TO) TT=5000.04
CRAFTED/edgematching/ fbcolors/ em_7_4_9_fbc.cnf	SAT TT=19.693	SAT TT=24.492	SAT TT=21.181	SAT TT=95.763	SAT TT=36.816	SAT TT=110.066	SAT TT=38.034	SAT TT=67.747	SAT TT=34.608	SAT TT=96.571	? (exit code) TT=4999.2	SAT TT=224.327	SAT TT=19.693
CRAFTED/edgematching/ fbcolors/ em_8_4_5_fbc.cnf	SAT TT=740.849	? (TO) TT=5000.11	? (TO) TT=5000.08	SAT TT=4418.02	SAT TT=3032.62	SAT TT=1964.81	SAT TT=1134.87	? (TO) TT=5000.08	SAT TT=740.849	SAT TT=4545	? (exit code) TT=4998.34	? (exit code) TT=4999.24	? (TO) TT=5000.06
CRAFTED/edgematching/ fbcolors/ em_9_3_5_fbc.cnf		? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.05	? (TO) TT=5000.11	? (TO) TT=5000.16	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.14	? (exit code) TT=4999.27	? (exit code) TT=4998.91	? (TO) TT=5000.12
crafted/Hard/contest02/ ezfact256_1.sat05-464.reshuffled-07.cnf		? (TO) TT=5000.21	? (TO) TT=5000.05	? (MO) TT=3937.37	? (TO) TT=5000.04	? (TO) TT=5000.25	? (TO) TT=5000.23	? (TO) TT=5000.2	? (TO) TT=5000.18	? (MO) TT=4083.08	? (exit code) TT=4998.91	? (MO) TT=4130.27	? (MO) TT=3980.92
crafted/Hard/contest02/ ezfact64_3.sat05-450.reshuffled-07.cnf	SAT TT=823.004	SAT TT=823.004	? (TO) TT=5000.03	SAT TT=1351.71	? (TO) TT=5000.1	SAT TT=1663.25	SAT TT=2127.73	SAT TT=2366.27	SAT TT=4542.65	SAT TT=3105.11	? (exit code) TT=4999.09	SAT TT=3325.78	SAT TT=1328.94
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest02/ hgen2-v500-s1216665065.sat05-467.reshuffled-07.cnf		? (TO) TT=5000.05	? (TO) TT=5000.02	? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.11	? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.02	? (exit code) TT=4999.09	? (exit code) TT=4998.61	? (TO) TT=5000.09
crafted/Hard/contest02/ hgen3-v400-s344840348.sat05-470.reshuffled-07.cnf		? (TO) TT=5000.03	? (TO) TT=5000.01	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.02	? (exit code) TT=4999.19	? (exit code) TT=4998.61	? (TO) TT=5000.04
crafted/Hard/contest02/ hgen3-v400-s553296708.sat05-471.reshuffled-07.cnf		? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.05	? (TO) TT=5000.11	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.09	? (exit code) TT=4999.16	? (exit code) TT=4998.59	? (TO) TT=5000.08
crafted/Hard/contest02/ hgen3-v500-s1349121860.sat05-473.reshuffled-07.cnf		? (TO) TT=5000.04	? (TO) TT=5000.01	? (TO) TT=5000.06	? (TO) TT=5000.11	? (TO) TT=5000.08	? (TO) TT=5000.11	? (TO) TT=5000.03	? (TO) TT=5000.05	? (TO) TT=5000.08	? (exit code) TT=4999.16	? (exit code) TT=4998.65	? (TO) TT=5000.07
crafted/Hard/contest02/ pyhala-braun-unsat-40-4-02.sat05-459.reshuffled-07.cnf	UNSAT TT=1073.97	UNSAT TT=1073.97	UNSAT TT=1976.61	UNSAT TT=1550.17	UNSAT TT=1869.91	UNSAT TT=2087.47	UNSAT TT=2128.27	UNSAT TT=1546.29	UNSAT TT=1416.3	UNSAT TT=1906.73	UNSAT TT=1318.02	UNSAT TT=1093.65	UNSAT TT=3000.23
crafted/Hard/contest03/looksrandom/ hgen6-4-24-n650-03-S528656311.sat05-477.reshuffled-07.cnf		? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.12	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.08	? (TO) TT=5000.05	? (exit code) TT=4999	? (exit code) TT=4998.71	? (TO) TT=5000.05
crafted/Hard/contest03/looksrandom/ hgen7-n390-02-S178568232.sat05-479.reshuffled-07.cnf		? (TO) TT=5000.07	? (TO) TT=5000.08	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.06	? (exit code) TT=4999.16	? (exit code) TT=4998.58	? (TO) TT=5000.07
crafted/Hard/contest03/looksrandom/ hgen8-n320-01-S1432474240.sat05-483.reshuffled-07.cnf		? (TO) TT=5000.1	? (TO) TT=5000.02	? (TO) TT=5000.11	? (TO) TT=5000.02	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.1	? (TO) TT=5000.06	? (TO) TT=5000.03	? (exit code) TT=4998.43	? (exit code) TT=4998.63	? (TO) TT=5000.04
crafted/Hard/contest03/looksrandom/ hgen8-n320-02-S1127428711.sat05-484.reshuffled-07.cnf		? (TO) TT=5000.05	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.02	? (TO) TT=5000.11	? (exit code) TT=4998.46	? (exit code) TT=4998.67	? (TO) TT=5000.07
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-01-S2069048075.sat05-488.reshuffled-07.cnf		? (TO) TT=5000.07	? (TO) TT=5000.01	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.03	? (exit code) TT=4998.98	? (exit code) TT=4998.72	? (TO) TT=5000.12
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-02-S350203913.sat05-486.reshuffled-07.cnf		? (TO) TT=5000.05	? (TO) TT=5000.03	? (TO) TT=5000.13	? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.11	? (TO) TT=5000.1	? (exit code) TT=4998.98	? (exit code) TT=4998.72	? (TO) TT=5000.08
crafted/Hard/contest03/ others/ 999999000001nw.sat05-447.reshuffled-07.cnf	UNSAT TT=979.4	UNSAT TT=979.4	? (TO) TT=5000.08	UNSAT TT=1670.72	UNSAT TT=2707.42	UNSAT TT=1054.38	UNSAT TT=1212.8	UNSAT TT=1716.1	UNSAT TT=1846.64	UNSAT TT=2088.03	? (exit code) TT=4998.98	UNSAT TT=1775.31	UNSAT TT=2061.59
crafted/Hard/contest03/ others/ bqwh.40.reg.520.sat05-433.reshuffled-07.cnf		? (TO) TT=5000.11	? (TO) TT=5000.07	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.13	? (TO) TT=5000.06	? (TO) TT=5000.11	? (TO) TT=5000.06	? (TO) TT=5000.05	? (exit code) TT=4998.87	? (exit code) TT=4998.58	? (TO) TT=5000.1
crafted/Hard/contest03/others/ color-11-3.sat05-445.reshuffled-07.cnf		? (TO) TT=5000.09	? (TO) TT=5000.05	? (TO) TT=5000.13	? (TO) TT=5000.05	? (TO) TT=5000.1	? (TO) TT=5000.03	? (TO) TT=5000.12	? (TO) TT=5000.05	? (TO) TT=5000.04	? (exit code) TT=4998.9	? (exit code) TT=4998.97	? (TO) TT=5000.07
crafted/Hard/contest03/others/ color-18-4.sat05-443.reshuffled-07.cnf		? (TO) TT=5000.12	? (TO) TT=5000.02	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.14	? (TO) TT=5000.06	? (TO) TT=5000.12	? (TO) TT=5000.11	? (TO) TT=5000.08	? (exit code) TT=4999.22	? (exit code) TT=4998.85	? (TO) TT=5000.1
crafted/Hard/contest03/others/ hwb-n28-01-S136611085.sat05-491.reshuffled-07.cnf	UNSAT TT=1582.55	UNSAT TT=2642.62	? (TO) TT=5000.03	UNSAT TT=2785.33	UNSAT TT=2622.09	? (TO) TT=5000.07	UNSAT TT=1582.55	? (TO) TT=5000.06	UNSAT TT=2627.2	UNSAT TT=3546.56	? (exit code) TT=4998.35	UNSAT TT=1764.81	UNSAT TT=3305.27
crafted/Hard/contest03/others/ hwb-n32-01-S1491788039.sat05-497.reshuffled-07.cnf		? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.07	? (exit code) TT=4998.33	? (exit code) TT=4998.49	? (TO) TT=5000.05
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1756632460.sat05-526.reshuffled-07.cnf		? (TO) TT=5000.02	? (TO) TT=5000.07	? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.07	? (exit code) TT=4998.87	? (exit code) TT=4998.68	? (TO) TT=5000.1
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1875077647.sat05-530.reshuffled-07.cnf		? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.13	? (TO) TT=5000.04	? (TO) TT=5000.12	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.05	? (exit code) TT=4998.92	? (exit code) TT=4998.8	? (TO) TT=5000.07
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.02-s1099787414.sat05-542.reshuffled-07.cnf		? (TO) TT=5000.03	? (TO) TT=5000.08	? (TO) TT=5000.12	? (TO) TT=5000.08	? (TO) TT=5000.09	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.07	? (TO) TT=5000.04	? (exit code) TT=4998.85	? (exit code) TT=4998.78	? (TO) TT=5000.09
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d-0.02-s383740539.sat05-534.reshuffled-07.cnf		? (TO) TT=5000.09	? (TO) TT=5000	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.03	? (TO) TT=5000.09	? (exit code) TT=4998.96	? (exit code) TT=4998.79	? (TO) TT=5000.11
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.04-s736572600.sat05-546.reshuffled-07.cnf		? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.13	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.1	? (exit code) TT=4998.91	? (exit code) TT=4998.83	? (TO) TT=5000.02
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s111845174.sat05-536.reshuffled-07.cnf	UNSAT TT=3348.09	? (TO) TT=5000.06	? (TO) TT=5000.08	? (TO) TT=5000.07	? (TO) TT=5000.11	? (TO) TT=5000.08	UNSAT TT=3348.09	? (TO) TT=5000.07	UNSAT TT=4251.18	? (TO) TT=5000.05	? (exit code) TT=4998.88	? (exit code) TT=4999.03	? (TO) TT=5000.09
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s925928766.sat05-538.reshuffled-07.cnf	UNSAT TT=773.277	UNSAT TT=1145.94	UNSAT TT=3810.39	UNSAT TT=1715.39	UNSAT TT=1823.98	? (TO) TT=5000.11	UNSAT TT=773.277	UNSAT TT=2844.99	UNSAT TT=963.206	UNSAT TT=1658.02	? (exit code) TT=4998.95	UNSAT TT=2413.05	? (TO) TT=5000.11
crafted/Hard/contest04/others/ Composite-048BitPrimes-0.sat05-503.reshuffled-07.cnf		? (TO) TT=5000.1	? (TO) TT=5000.02	? (TO) TT=5000.02	? (TO) TT=5000.02	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.06	? (exit code) TT=4999.03	? (exit code) TT=4998.36	? (TO) TT=5000.04
crafted/Hard/contest04/others/ Composite-048BitPrimes-1.sat05-504.reshuffled-07.cnf		? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000.12	? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.08	? (TO) TT=5000.06	? (exit code) TT=4998.57	? (exit code) TT=4998.36	? (TO) TT=5000.03
crafted/Hard/contest04/others/ Composite-064BitPrimes-1.sat05-506.reshuffled-07.cnf		? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.08	? (exit code) TT=4998.79	? (exit code) TT=4998.9	? (TO) TT=5000.08
crafted/Hard/contest04/others/ Composite-096BitPrimes-0.sat05-507.reshuffled-07.cnf		? (TO) TT=5000.12	? (TO) TT=5000.05	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.13	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.09	? (TO) TT=5000.05	? (exit code) TT=4998.66	? (exit code) TT=4998.77	? (TO) TT=5000.13
crafted/Hard/contest04/ others/ CompositeRSA576.sat05-509.reshuffled-07.cnf		? (TO) TT=5000.08	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.13	? (TO) TT=5000.14	? (TO) TT=5000.14	? (TO) TT=5000.11	? (TO) TT=5000.06	? (exit code) TT=4998.72	? (TO) TT=5000.08
crafted/Hard/contest04/ others/ equilarge_l2.sat05-519.reshuffled-07.cnf	UNSAT TT=1838.18	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.02	UNSAT TT=1838.18	UNSAT TT=1858.3	? (TO) TT=5000.11
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest04/ others/ equilarge_l3.sat05-520.reshuffled-07.cnf	UNSAT TT=1387.39	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.04	UNSAT TT=1389.85	UNSAT TT=1387.39	? (TO) TT=5000.02
crafted/Hard/contest04/ others/ equilarge_l4.sat05-521.reshuffled-07.cnf	UNSAT TT=1652.5	? (TO) TT=5000.07	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.07	? (TO) TT=5000.03	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.11	UNSAT TT=1652.5	UNSAT TT=1709.91	? (TO) TT=5000.03
crafted/Hard/contest04/ others/ ramsey.sat05-511.reshuffled-07.cnf		? (TO) TT=5000.06	? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.13	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.09	? (exit code) TT=4998.78	? (exit code) TT=4998.64	? (TO) TT=5000.09
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-16-10-11.sat05-1253.reshuffled-07.cnf		? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.09	? (TO) TT=5000.05	? (TO) TT=5000.13	? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000.11	? (TO) TT=5000.11	? (exit code) TT=4998.82	? (exit code) TT=4998.48	? (TO) TT=5000.1
crafted/Hard/contest05/counting-clq/ unsat-set-b-clqcolor-16-11-14.sat05-1261.reshuffled-07.cnf		? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.01	? (TO) TT=5000.08	? (TO) TT=5000.13	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.04	? (TO) TT=5000.09	? (exit code) TT=4998.61	? (exit code) TT=4999.05	? (TO) TT=5000.04
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-10-07-09.sat05-1282.reshuffled-07.cnf	UNSAT TT=344.237	UNSAT TT=344.237	? (TO) TT=5000.05	UNSAT TT=3340.97	? (TO) TT=5000.05	UNSAT TT=4463.72	UNSAT TT=4440.42	? (TO) TT=5000.09	? (TO) TT=5000.08	UNSAT TT=3549.93	UNSAT TT=3092.89	UNSAT TT=3288.5	UNSAT TT=3777.53
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-25-18-23.sat05-1287.reshuffled-07.cnf		? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.15	? (TO) TT=5000.11	? (TO) TT=5000.19	? (TO) TT=5000.05	? (TO) TT=5000.13	? (TO) TT=5000.09	? (exit code) TT=4998.69	? (TO) TT=5000.1
crafted/Hard/contest05/ counting-php/ easier-fphp-035-029.sat05-1221.reshuffled-07.cnf		? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.15	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.05	? (TO) TT=5000.07	? (exit code) TT=4999.09	? (MO) TT=2612.61	? (TO) TT=5000.11
crafted/Hard/contest05/ others/ eulcbip-8-UNSAT.sat05-3937.reshuffled-07.cnf		? (TO) TT=5000.01	? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.05	? (TO) TT=5000.02	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.07	? (exit code) TT=4998.21	? (exit code) TT=4998.53	? (TO) TT=5000.06
crafted/Hard/contest05/others/ linvrinv8.sat05-567.reshuffled-07.cnf		? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.08	? (exit code) TT=4999.03	? (exit code) TT=4999.1	? (TO) TT=5000.05
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest05/others/ linvrinv9.sat05-568.reshuffled-07.cnf		? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.05	? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.08	? (exit code) TT=4999.04	? (exit code) TT=4998.7	? (TO) TT=5000.11
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-1.sat05-2488.reshuffled-07.cnf	SAT TT=105.892	SAT TT=1810.61	SAT TT=1632.92	SAT TT=671.571	SAT TT=716.524	SAT TT=105.892	SAT TT=744.74	SAT TT=955.944	SAT TT=1032.87	SAT TT=676.177	SAT TT=1165.45	SAT TT=711.775	SAT TT=352.799
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-2.sat05-2489.reshuffled-07.cnf	SAT TT=13.217	SAT TT=2844.73	SAT TT=2227.97	SAT TT=97.65	SAT TT=1243.94	SAT TT=2075.76	SAT TT=13.217	SAT TT=96.347	SAT TT=2241.14	SAT TT=105.006	SAT TT=2265.63	SAT TT=117.395	SAT TT=2812.8
crafted/Hard/contest05/others/ sgp_5-6-8.sat05-2669.reshuffled-07.cnf		? (TO) TT=5000.25	? (TO) TT=5000.02	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.24	? (TO) TT=5000.25	? (TO) TT=5000.16	? (TO) TT=5000.15	? (TO) TT=5000.19	? (exit code) TT=4998.65	? (exit code) TT=4998.7	? (TO) TT=5000.29
crafted/Hard/contest05/others/ sgp_9-8-8.sat05-2674.reshuffled-07.cnf		? (MO) TT=1827.91	? (TO) TT=5000.06	? (MO) TT=4326.68	? (TO) TT=5000.07	? (TO) TT=5000.22	? (TO) TT=5000.26	? (TO) TT=5000.2	? (TO) TT=5000.16	? (TO) TT=5000.28	? (TO) TT=5000.06	? (exit code) TT=4999.16	? (TO) TT=5000.15
crafted/Hard/contest05/others/ strips-gripper-18t35.sat05-1147.reshuffled-07.cnf	SAT TT=19.418	? (TO) TT=5000.11	SAT TT=326.569	? (TO) TT=5000.05	? (TO) TT=5000.09	SAT TT=19.418	SAT TT=49.649	SAT TT=277.416	SAT TT=319.06	SAT TT=2720.51	? (exit code) TT=4999.18	SAT TT=90.888	SAT TT=1862.7
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-all.used-as.sat04-986.sat05-4198.reshuffled-07.cnf		? (TO) TT=5000.16	? (TO) TT=5000.01	? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.21	? (TO) TT=5000.16	? (TO) TT=5000.15	? (TO) TT=5000.16	? (TO) TT=5000.14	? (TO) TT=5000.12	? (exit code) TT=4998.71	? (TO) TT=5000.12
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l1.used-as.sat04-893.sat05-4187.reshuffled-07.cnf		? (TO) TT=5000.18	? (TO) TT=5000.08	? (TO) TT=5000.1	? (TO) TT=5000.02	? (TO) TT=5000.13	? (TO) TT=5000.17	? (TO) TT=5000.12	? (TO) TT=5000.15	? (TO) TT=5000.13	? (TO) TT=5000.13	? (exit code) TT=4998.4	? (TO) TT=5000.11
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_m3.used-as.sat04-900.sat05-4186.reshuffled-07.cnf		? (TO) TT=5000.15	? (TO) TT=5000	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.18	? (TO) TT=5000.09	? (TO) TT=5000.11	? (TO) TT=5000.11	? (TO) TT=5000.06	? (exit code) TT=4998.6	? (exit code) TT=4998.36	? (TO) TT=5000.05
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-FIFO.used-as.sat04-991.sat05-4192.reshuffled-07.cnf		? (TO) TT=5000.22	? (TO) TT=5000.01	? (TO) TT=5000.08	? (TO) TT=5000.09	? (TO) TT=5000.2	? (TO) TT=5000.13	? (TO) TT=5000.16	? (TO) TT=5000.17	? (TO) TT=5000.09	? (TO) TT=5000.15	? (exit code) TT=4998.62	? (TO) TT=5000.15
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-gigamax.used-as.sat04-984.sat05-4194.reshuffled-07.cnf	UNSAT TT=95.507	UNSAT TT=1373.78	UNSAT TT=266.908	UNSAT TT=490.055	UNSAT TT=1027.32	UNSAT TT=95.507	UNSAT TT=102.324	UNSAT TT=156.2	UNSAT TT=642.478	UNSAT TT=439.034	UNSAT TT=717.596	UNSAT TT=200.815	UNSAT TT=883.565
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-luckySeven.used-as.sat04-990.sat05-4196.reshuffled-07.cnf	UNSAT TT=280.604	UNSAT TT=2052.9	UNSAT TT=767.762	UNSAT TT=1887.05	UNSAT TT=1881.23	UNSAT TT=300.787	UNSAT TT=284.559	UNSAT TT=280.604	UNSAT TT=1308.68	UNSAT TT=1836.49	? (exit code) TT=4999.17	? (exit code) TT=4998.86	UNSAT TT=4297.27
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-myciel6-cn.used-as.sat04-319.sat05-4201.reshuffled-07.cnf		? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.18	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.16	? (TO) TT=5000.16	? (exit code) TT=4998.33	? (exit code) TT=4998.9	? (TO) TT=5000.1
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-philo.used-as.sat04-988.sat05-4195.reshuffled-07.cnf		? (TO) TT=5000.15	? (TO) TT=5000.01	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.15	? (TO) TT=5000.16	? (TO) TT=5000.15	? (TO) TT=5000.17	? (TO) TT=5000.08	? (exit code) TT=4998.91	? (exit code) TT=4998.56	? (TO) TT=5000.14
crafted/Hard/contest05/QG/ QG7a-gensys-icl004.sat05-3825.reshuffled-07.cnf	UNSAT TT=78.563	UNSAT TT=78.563	UNSAT TT=489.112	UNSAT TT=197.481	UNSAT TT=1019.41	UNSAT TT=309.561	UNSAT TT=1268.47	UNSAT TT=716.038	UNSAT TT=3736.49	UNSAT TT=252.826	UNSAT TT=3883.69	UNSAT TT=270.951	UNSAT TT=250.629
crafted/Hard/contest05/QG/ QG7a-gensys-ukn002.sat05-3842.reshuffled-07.cnf	UNSAT TT=1499.75	UNSAT TT=1499.75	? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.11	? (TO) TT=5000.08	? (exit code) TT=4999.11	? (exit code) TT=4998.61	? (TO) TT=5000.03
crafted/Hard/contest05/QG/ QG7a-gensys-ukn009.sat05-3849.reshuffled-07.cnf	UNSAT TT=2533.34	UNSAT TT=2533.34	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.04	? (TO) TT=5000.07	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.02	? (TO) TT=5000.02	? (exit code) TT=4998.43	? (exit code) TT=4999.07	? (TO) TT=5000.04
crafted/Hard/contest05/ QG/ QG7-dead-dnd001.sat05-3419.reshuffled-07.cnf	UNSAT TT=471.192	UNSAT TT=471.192	? (TO) TT=5000.05	UNSAT TT=1086.43	UNSAT TT=907.528	? (TO) TT=5000.03	? (TO) TT=5000.07	UNSAT TT=3404.05	UNSAT TT=1673.73	UNSAT TT=2550.51	UNSAT TT=2498.64	UNSAT TT=1485.83	UNSAT TT=1309.31
crafted/Hard/contest05/ QG/ QG7-dead-dnd005.sat05-3111.reshuffled-07.cnf	UNSAT TT=418.918	UNSAT TT=569.034	? (TO) TT=5000.11	UNSAT TT=513.155	UNSAT TT=737.429	UNSAT TT=1623.24	UNSAT TT=2868.83	? (TO) TT=5000.11	UNSAT TT=639.866	UNSAT TT=418.918	UNSAT TT=776.379	UNSAT TT=880.466	UNSAT TT=604.537
crafted/Hard/contest05/QG/ QG7-gensys-icl100.sat05-3226.reshuffled-07.cnf	UNSAT TT=1178.69	UNSAT TT=1178.69	? (TO) TT=5000.04	UNSAT TT=4483.44	UNSAT TT=4589.47	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.08	UNSAT TT=2284.06	UNSAT TT=3967.18	? TT=4999.32	UNSAT TT=4345.92	UNSAT TT=4663.04
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Hard/contest05/QG/ QG7-gensys-ukn003.sat05-3346.reshuffled-07.cnf	UNSAT TT=612.297	UNSAT TT=612.297	? (TO) TT=5000.09	UNSAT TT=2223.54	UNSAT TT=2128.49	? (TO) TT=5000.06	? (TO) TT=5000.08	? (TO) TT=5000.04	UNSAT TT=1914.94	UNSAT TT=2442.83	UNSAT TT=2332.63	UNSAT TT=2564.82	UNSAT TT=2709.21
crafted/Medium/contest05/ jarvisalo/ mod2-3cage-unsat-9-12.sat05-2587.reshuffled-07.cnf	UNSAT TT=0.002	UNSAT TT=243.22	UNSAT TT=207.009	UNSAT TT=92.944	UNSAT TT=97.535	UNSAT TT=525.22	UNSAT TT=104.836	UNSAT TT=241.258	UNSAT TT=145.273	UNSAT TT=96.58	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=106.654
crafted/Medium/contest05/ jarvisalo/ mod2-3cage-unsat-9-14.sat05-2589.reshuffled-07.cnf	UNSAT TT=0.002	UNSAT TT=169.901	UNSAT TT=238.955	UNSAT TT=135.441	UNSAT TT=67.714	UNSAT TT=321.671	UNSAT TT=57.094	UNSAT TT=151.317	UNSAT TT=136.965	UNSAT TT=131.603	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=119.356
crafted/Medium/contest05/jarvisalo/ mod2c-rand3bip-sat-190-3.sat05-2445.reshuffled-07.cnf	SAT TT=3.788	SAT TT=105.319	SAT TT=497.291	SAT TT=21.541	SAT TT=16.709	SAT TT=46.985	SAT TT=26.72	SAT TT=67.108	SAT TT=31.443	SAT TT=21.638	SAT TT=533.526	SAT TT=37.038	SAT TT=3.788
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-2.sat05-2159.reshuffled-07.cnf	SAT TT=0.009	SAT TT=39.621	SAT TT=85.322	SAT TT=74.503	SAT TT=6.739	SAT TT=12.869	SAT TT=42.106	SAT TT=61.592	SAT TT=81.597	SAT TT=73.504	SAT TT=0.009	SAT TT=0.009	SAT TT=51.708
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf	SAT TT=0.01	SAT TT=182.326	SAT TT=389.58	SAT TT=256.557	SAT TT=231.969	SAT TT=422.79	SAT TT=13.475	SAT TT=96.088	SAT TT=139.888	SAT TT=270.385	SAT TT=0.01	SAT TT=0.011	SAT TT=86.824
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf	SAT TT=0.011	SAT TT=321.26	SAT TT=1083.32	SAT TT=174.134	SAT TT=425.579	SAT TT=458.25	SAT TT=104.394	SAT TT=525.734	SAT TT=805.12	SAT TT=171.819	SAT TT=0.011	SAT TT=0.011	SAT TT=586.371
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-250-3.sat05-2220.reshuffled-07.cnf	SAT TT=0.013	SAT TT=977.901	SAT TT=3515.96	SAT TT=2702.48	SAT TT=459.742	SAT TT=1155.05	SAT TT=871.674	SAT TT=1236.13	SAT TT=2369.23	SAT TT=2667.69	SAT TT=0.013	SAT TT=0.013	SAT TT=1117.66
crafted/Medium/contest05/others/ pmg-11-UNSAT.sat05-3939.reshuffled-07.cnf	UNSAT TT=15.23	UNSAT TT=350.792	? (TO) TT=5000.02	UNSAT TT=430.02	UNSAT TT=887.27	UNSAT TT=2161.6	UNSAT TT=442.829	UNSAT TT=2536.18	UNSAT TT=787.509	UNSAT TT=521.052	UNSAT TT=968.865	UNSAT TT=15.23	UNSAT TT=559.376
crafted/Medium/contest05/ others/ QG7a-gensys-brn004.sat05-3669.reshuffled-07.cnf	SAT TT=2.002	SAT TT=2.002	SAT TT=36.517	SAT TT=9.084	SAT TT=12.883	SAT TT=2.666	SAT TT=2.762	SAT TT=60.209	SAT TT=237.829	SAT TT=2.76	SAT TT=111.57	SAT TT=6.71	SAT TT=11.689
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Medium/contest05/ others/ QG7a-gensys-ukn001.sat05-3841.reshuffled-07.cnf	SAT TT=2.475	SAT TT=3.218	SAT TT=37.033	SAT TT=4.873	SAT TT=30.359	SAT TT=3.983	SAT TT=4.315	SAT TT=52.79	SAT TT=62.386	SAT TT=2.475	SAT TT=84.635	SAT TT=6.412	SAT TT=4.129
crafted/Medium/contest05/ others/ QG7a-gensys-ukn005.sat05-3845.reshuffled-07.cnf	SAT TT=1.762	SAT TT=3.857	SAT TT=84.399	SAT TT=4.455	SAT TT=26.239	SAT TT=2.403	SAT TT=3.173	SAT TT=22.363	SAT TT=89.139	SAT TT=1.762	SAT TT=149.325	SAT TT=7.851	SAT TT=10.356
crafted/Medium/contest05/ others/ QG7-gensys-icl001.sat05-2926.reshuffled-07.cnf	UNSAT TT=27.983	UNSAT TT=27.983	UNSAT TT=50.587	UNSAT TT=40.274	UNSAT TT=37.338	UNSAT TT=47.455	UNSAT TT=93.13	UNSAT TT=57.137	UNSAT TT=37.334	UNSAT TT=48.132	UNSAT TT=62.506	UNSAT TT=122.429	UNSAT TT=42.468
crafted/Medium/contest05/ others/ QG8-gensys-ukn005.sat05-3584.reshuffled-07.cnf	UNSAT TT=34.751	UNSAT TT=183.235	UNSAT TT=149.959	UNSAT TT=58.359	UNSAT TT=207.099	UNSAT TT=68.593	UNSAT TT=59.276	UNSAT TT=34.751	UNSAT TT=202.185	UNSAT TT=152.967	UNSAT TT=76.796	UNSAT TT=179.915	UNSAT TT=175.8
crafted/Medium/contest05/ others/ QG-gensys-brn008.sat05-2685.reshuffled-07.cnf	UNSAT TT=58.446	UNSAT TT=68.369	UNSAT TT=96.837	UNSAT TT=93.039	UNSAT TT=58.446	UNSAT TT=134.984	UNSAT TT=213.242	UNSAT TT=80.07	UNSAT TT=167.098	UNSAT TT=102.184	UNSAT TT=189.295	UNSAT TT=122.114	UNSAT TT=137.743
crafted/Medium/contest05/ others/ QG-gensys-icl003.sat05-2715.reshuffled-07.cnf	UNSAT TT=70.563	UNSAT TT=102.476	UNSAT TT=87.366	UNSAT TT=92.587	UNSAT TT=77.411	UNSAT TT=142.205	UNSAT TT=193.379	UNSAT TT=70.563	UNSAT TT=201.171	UNSAT TT=84.177	UNSAT TT=136.273	UNSAT TT=103.673	UNSAT TT=134.727
crafted/Medium/contest05/ pebbling/ unsat-grid-pbl-0080.sat05-1344.reshuffled-07.cnf	UNSAT TT=0.068	UNSAT TT=0.068	UNSAT TT=0.455	UNSAT TT=0.228	UNSAT TT=1.322	UNSAT TT=0.071	UNSAT TT=0.07	UNSAT TT=0.131	? (TO) TT=5000.09	UNSAT TT=0.081	UNSAT TT=1.357	UNSAT TT=1.271	UNSAT TT=0.105
crafted/Medium/contest05/ pebbling/ unsat-pbl-00080.sat05-1325.reshuffled-07.cnf	UNSAT TT=0.188	UNSAT TT=0.188	UNSAT TT=20.937	UNSAT TT=0.666	UNSAT TT=38.19	UNSAT TT=0.534	UNSAT TT=0.488	UNSAT TT=0.361	UNSAT TT=165.391	UNSAT TT=0.536	UNSAT TT=15.999	UNSAT TT=5.479	UNSAT TT=0.697
crafted/Medium/contest05/ pebbling/ unsat-pbl-00090.sat05-1326.reshuffled-07.cnf	UNSAT TT=0.129	UNSAT TT=0.129	UNSAT TT=1.001	UNSAT TT=0.373	UNSAT TT=1806.77	UNSAT TT=0.242	UNSAT TT=0.253	UNSAT TT=0.335	UNSAT TT=333.97	UNSAT TT=0.266	? (exit code) TT=4998.92	UNSAT TT=5.237	UNSAT TT=0.329
crafted/Medium/contest05/sabharwal/ counting-clqcolor-unsat-set-b-clqcolor-08-06-07.sat05-1257.reshuffled-07.cnf	UNSAT TT=5.918	UNSAT TT=7.668	UNSAT TT=12.35	UNSAT TT=11.54	UNSAT TT=10.915	UNSAT TT=19.032	UNSAT TT=21.517	UNSAT TT=11.546	UNSAT TT=36.311	UNSAT TT=11.58	UNSAT TT=19.996	UNSAT TT=25.45	UNSAT TT=5.918
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
crafted/Medium/contest05/sabharwal/ counting-easier-php-012-010.sat05-1172.reshuffled-07.cnf	UNSAT TT=16.58	UNSAT TT=93.108	UNSAT TT=694.102	UNSAT TT=138.769	UNSAT TT=271.849	UNSAT TT=863.941	UNSAT TT=1225.18	UNSAT TT=2164.82	UNSAT TT=288.847	UNSAT TT=147.226	UNSAT TT=170.099	UNSAT TT=16.58	UNSAT TT=144.956
crafted/Medium/contest05/sabharwal/ sat-strips-gripper-12t23.sat05-1144.reshuffled-07.cnf	SAT TT=2.491	SAT TT=8.842	SAT TT=4.824	SAT TT=6.328	SAT TT=3.305	SAT TT=2.491	SAT TT=2.852	SAT TT=5.73	SAT TT=14.444	SAT TT=34.977	SAT TT=44.293	SAT TT=7.433	SAT TT=13.873
CRAFTED/modcircuits/ mod3_4vars_6gates.cnf	UNSAT TT=192.799	UNSAT TT=421.596	UNSAT TT=632.817	UNSAT TT=691.028	UNSAT TT=1599.7	UNSAT TT=876.112	UNSAT TT=192.799	UNSAT TT=587.329	UNSAT TT=433.747	UNSAT TT=719.128	? (exit code) TT=4998.39	UNSAT TT=1551.18	UNSAT TT=981.811
CRAFTED/modcircuits/ mod3block_2vars_10gates_u2_autoenc.cnf		? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.01	? (TO) TT=5000.14	? (TO) TT=5000.06	? (TO) TT=5000.11	? (TO) TT=5000.11	? (TO) TT=5000.07	? (exit code) TT=4998.93	? (exit code) TT=4999.27	? (TO) TT=5000.05
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	SAT TT=139.369	? (TO) TT=5000.07	? (TO) TT=5000.08	SAT TT=139.369	? (TO) TT=5000.08	SAT TT=4698.07	SAT TT=2161.01	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.05	? (exit code) TT=4998.68	? (exit code) TT=4998.9	? (TO) TT=5000.11
CRAFTED/modcircuits/ mod3block_2vars_9gates_u2_autoenc.cnf		? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.02	? (TO) TT=5000.07	? (TO) TT=5000.05	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.12	? (TO) TT=5000.08	? (exit code) TT=4998.37	? (exit code) TT=4999.14	? (TO) TT=5000.09
CRAFTED/modcircuits/ mod3block_3vars_9gates_restr.cnf	SAT TT=1.238	SAT TT=26.023	SAT TT=126.959	SAT TT=10.676	SAT TT=3777.58	SAT TT=7.277	SAT TT=6.058	SAT TT=62.745	SAT TT=146.003	SAT TT=5.409	SAT TT=2196.54	SAT TT=20.824	SAT TT=1.238
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2.cnf		? (TO) TT=5000.1	? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.05	? (TO) TT=5000.07	? (TO) TT=5000.09	? (exit code) TT=4998.64	? (exit code) TT=4998.68	? (TO) TT=5000.13
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2_restricted.cnf		? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.09	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.05	? (exit code) TT=4998.72	? (exit code) TT=4998.78	? (TO) TT=5000.02
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2.cnf		? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.16	? (TO) TT=5000.11	? (TO) TT=5000.09	? (exit code) TT=4999.06	? (exit code) TT=4999.27	? (TO) TT=5000.1
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2_restricted.cnf		? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.01	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.09	? (exit code) TT=4998.6	? (exit code) TT=4999.24	? (TO) TT=5000.11
CRAFTED/modcircuits/ mod4block_2vars_10gates_u2_autoenc.cnf	SAT TT=9.385	? (TO) TT=5000.12	? (TO) TT=5000.03	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.11	SAT TT=531.142	SAT TT=498.996	? (TO) TT=5000.08	SAT TT=9.385	? (exit code) TT=4999.07	? (exit code) TT=4998.8	? (TO) TT=5000.07
CRAFTED/modcircuits/ mod4block_2vars_11gates_u2_autoenc.cnf	SAT TT=16.843	SAT TT=16.843	? (TO) TT=5000	SAT TT=156.323	SAT TT=3661.85	SAT TT=1144.9	SAT TT=2017.39	SAT TT=1888.31	SAT TT=101.724	SAT TT=391.787	? (exit code) TT=4998.74	? (exit code) TT=4998.54	SAT TT=24.415
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2_autoenc.cnf		? (TO) TT=5000.06	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.11	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.07	? (exit code) TT=4999.08	? (exit code) TT=4998.75	? (TO) TT=5000.04
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	UNSAT TT=2000.83	UNSAT TT=3574.72	UNSAT TT=2000.83	? (TO) TT=5000.09	? (TO) TT=5000.12	? (TO) TT=5000.04	? (TO) TT=5000.11	? (TO) TT=5000.07	UNSAT TT=4187.45	? (TO) TT=5000.07	? (exit code) TT=4998.44	? (exit code) TT=4998.51	UNSAT TT=4558.88
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2_autoenc.cnf		? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.02	? (exit code) TT=4998.53	? (exit code) TT=4998.59	? (TO) TT=5000.05
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2.cnf		? (TO) TT=5000.12	? (TO) TT=5000.1	? (TO) TT=5000.11	? (TO) TT=5000.01	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.03	? (exit code) TT=4999.08	? (exit code) TT=4998.92	? (TO) TT=5000.04
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	UNSAT TT=4109.89	UNSAT TT=4109.89	? (TO) TT=5000.01	? (TO) TT=5000.1	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.06	? (exit code) TT=4998.8	? (exit code) TT=4998.33	? (TO) TT=5000.11
CRAFTED/modcircuits/ mod5block_1var_7gates.cnf	SAT TT=0.385	SAT TT=0.385	SAT TT=1.04	SAT TT=2.029	SAT TT=2.904	SAT TT=1.141	SAT TT=1.349	SAT TT=4.601	SAT TT=8.958	SAT TT=1.688	SAT TT=16.96	SAT TT=6.978	SAT TT=11.941
CRAFTED/modcircuits/ mod5block_2vars_12gates.cnf		? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.01	? (TO) TT=5000.11	? (TO) TT=5000.04	? (TO) TT=5000.11	? (TO) TT=5000.06	? (TO) TT=5000.09	? (exit code) TT=4999.07	? (exit code) TT=4998.45	? (TO) TT=5000.08
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/modcircuits/ owp_4vars_5gates.cnf	UNSAT TT=0.098	UNSAT TT=0.098	UNSAT TT=0.377	UNSAT TT=0.287	UNSAT TT=0.383	UNSAT TT=0.189	UNSAT TT=0.185	UNSAT TT=0.186	UNSAT TT=0.135	UNSAT TT=0.246	UNSAT TT=2.143	UNSAT TT=2.204	UNSAT TT=0.312
CRAFTED/parity-games/ instance_n2_i2_pp.cnf	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.005	UNSAT TT=0.001	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.001
CRAFTED/parity-games/ instance_n2_i3_pp.cnf	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.006	UNSAT TT=0.002	UNSAT TT=0.006	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.001	UNSAT TT=0.001	UNSAT TT=0	UNSAT TT=0.002	UNSAT TT=0.002	UNSAT TT=0.002
CRAFTED/parity-games/ instance_n3_i3_pp_ci_ce.cnf	SAT TT=0.005	SAT TT=0.01	SAT TT=0.022	SAT TT=0.04	SAT TT=0.023	SAT TT=0.009	SAT TT=0.009	SAT TT=0.019	SAT TT=0.005	SAT TT=0.011	SAT TT=0.037	SAT TT=0.038	SAT TT=0.013
CRAFTED/parity-games/ instance_n3_i3_pp.cnf	SAT TT=0.004	SAT TT=0.012	SAT TT=0.023	SAT TT=0.041	SAT TT=0.021	SAT TT=0.011	SAT TT=0.013	SAT TT=0.025	SAT TT=0.004	SAT TT=0.013	SAT TT=5.2	SAT TT=5.013	SAT TT=0.017
CRAFTED/parity-games/ instance_n3_i4_pp_ci_ce.cnf	UNSAT TT=0.008	UNSAT TT=0.014	UNSAT TT=0.028	UNSAT TT=0.052	UNSAT TT=0.027	UNSAT TT=0.012	UNSAT TT=0.013	UNSAT TT=0.028	UNSAT TT=0.008	UNSAT TT=0.012	UNSAT TT=0.034	UNSAT TT=0.034	UNSAT TT=0.018
CRAFTED/parity-games/ instance_n4_i4_pp_ci_ce.cnf	SAT TT=0.013	SAT TT=0.034	SAT TT=0.083	SAT TT=0.175	SAT TT=0.132	SAT TT=0.037	SAT TT=0.061	SAT TT=0.125	SAT TT=0.013	SAT TT=0.056	SAT TT=11.21	SAT TT=5.096	SAT TT=0.047
CRAFTED/parity-games/ instance_n4_i4_pp.cnf	SAT TT=0.042	SAT TT=0.052	SAT TT=0.064	SAT TT=0.159	SAT TT=0.105	SAT TT=0.042	SAT TT=0.048	SAT TT=0.101	SAT TT=0.064	SAT TT=0.085	SAT TT=1.502	SAT TT=1.399	SAT TT=0.073
CRAFTED/parity-games/ instance_n4_i5_pp.cnf	UNSAT TT=0.284	UNSAT TT=0.658	UNSAT TT=0.626	UNSAT TT=0.58	UNSAT TT=0.521	UNSAT TT=0.284	UNSAT TT=0.357	UNSAT TT=0.483	UNSAT TT=0.552	UNSAT TT=0.433	UNSAT TT=11.397	UNSAT TT=5.53	UNSAT TT=0.55
CRAFTED/parity-games/ instance_n5_i5_pp.cnf	SAT TT=0.151	SAT TT=0.22	SAT TT=0.445	SAT TT=0.645	SAT TT=0.736	SAT TT=0.328	SAT TT=0.364	SAT TT=0.357	SAT TT=0.151	SAT TT=0.369	SAT TT=11.315	SAT TT=5.814	SAT TT=0.646
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/parity-games/ instance_n5_i6_pp_ci_ce.cnf	UNSAT TT=1.729	UNSAT TT=1.912	UNSAT TT=1.729	UNSAT TT=1.894	UNSAT TT=2.9	UNSAT TT=1.901	UNSAT TT=2.615	UNSAT TT=2.484	UNSAT TT=2.542	UNSAT TT=1.958	UNSAT TT=15.772	UNSAT TT=7.664	UNSAT TT=4.463
CRAFTED/parity-games/ instance_n5_i6_pp.cnf	SAT TT=0.314	SAT TT=6.402	SAT TT=19.641	SAT TT=19.314	SAT TT=8.259	SAT TT=0.314	SAT TT=8.65	SAT TT=2.571	SAT TT=0.386	SAT TT=10.867	SAT TT=13.209	SAT TT=5.477	SAT TT=9.935
CRAFTED/parity-games/ instance_n6_i6_pp_ci_ce.cnf	SAT TT=1.607	SAT TT=10.22	SAT TT=2.243	SAT TT=1.676	SAT TT=40.584	SAT TT=36.435	SAT TT=1.607	SAT TT=2.542	SAT TT=54.295	SAT TT=32.306	SAT TT=20.709	SAT TT=7.428	SAT TT=56.528
CRAFTED/parity-games/ instance_n6_i6_pp.cnf	SAT TT=0.92	SAT TT=1.234	SAT TT=1.566	SAT TT=4.512	SAT TT=2.297	SAT TT=1.918	SAT TT=6.316	SAT TT=1.855	SAT TT=0.92	SAT TT=1.579	SAT TT=12.807	SAT TT=6.873	SAT TT=5.231
CRAFTED/parity-games/ instance_n6_i7_pp_ci_ce.cnf	UNSAT TT=84.539	UNSAT TT=125.084	UNSAT TT=148.965	UNSAT TT=202.034	UNSAT TT=205.142	UNSAT TT=84.539	UNSAT TT=138.772	UNSAT TT=148.603	UNSAT TT=138.019	UNSAT TT=162.052	UNSAT TT=218.633	UNSAT TT=236.507	UNSAT TT=215.668
CRAFTED/parity-games/ instance_n6_i7_pp.cnf	SAT TT=1.073	SAT TT=32.47	SAT TT=38.928	SAT TT=8.231	SAT TT=1.073	SAT TT=17.191	SAT TT=5.947	SAT TT=5.984	SAT TT=2.726	SAT TT=33.235	SAT TT=22.366	SAT TT=53.769	SAT TT=14.166
CRAFTED/parity-games/ instance_n7_i7_pp_ci_ce.cnf	SAT TT=8.214	SAT TT=73.002	SAT TT=298.746	SAT TT=10.213	? (TO) TT=5000.04	SAT TT=156.345	SAT TT=53.257	SAT TT=8.214	SAT TT=2189.9	SAT TT=1496.96	SAT TT=32.036	SAT TT=2837.06	SAT TT=505.324
CRAFTED/parity-games/ instance_n7_i7_pp.cnf	SAT TT=7.783	SAT TT=22.283	SAT TT=14.248	SAT TT=9.956	SAT TT=27.269	SAT TT=13.348	SAT TT=15.245	SAT TT=11.294	SAT TT=42.58	SAT TT=7.783	SAT TT=32.161	SAT TT=29.609	SAT TT=49.068
CRAFTED/parity-games/ instance_n7_i8_pp_ci_ce.cnf		? (TO) TT=5000.11	? (TO) TT=5000.01	? (TO) TT=5000.01	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.12	? (exit code) TT=4998.71	? (exit code) TT=4998.59	? (TO) TT=5000.11
CRAFTED/parity-games/ instance_n7_i8_pp.cnf	SAT TT=17.658	SAT TT=31.55	SAT TT=188.542	SAT TT=1041.9	SAT TT=40.812	SAT TT=75.969	SAT TT=22.345	SAT TT=42.765	SAT TT=179.836	SAT TT=210.789	SAT TT=162.463	SAT TT=237.968	SAT TT=17.658
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	SAT TT=70.723	SAT TT=4416.82	SAT TT=761.961	SAT TT=2038.29	? (TO) TT=5000.06	SAT TT=70.723	? (TO) TT=5000.09	SAT TT=203.503	? (TO) TT=5000.1	? (TO) TT=5000.13	SAT TT=185.08	? (exit code) TT=4998.87	SAT TT=76.041
CRAFTED/parity-games/ instance_n8_i8_pp.cnf	SAT TT=38.778	SAT TT=783.429	SAT TT=73.41	SAT TT=48.704	SAT TT=2266.66	SAT TT=63.656	SAT TT=616.594	SAT TT=81.072	SAT TT=140.426	SAT TT=396.792	SAT TT=38.778	SAT TT=3622.63	SAT TT=766.54
CRAFTED/parity-games/ instance_n8_i9_pp_ci_ce.cnf		? (TO) TT=5000.07	? (TO) TT=5000.01	? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.12	? (TO) TT=5000.12	? (TO) TT=5000.05	? (TO) TT=5000.05	? (TO) TT=5000.06	? (exit code) TT=4998.67	? (exit code) TT=4998.69	? (TO) TT=5000.07
CRAFTED/parity-games/ instance_n8_i9_pp.cnf	SAT TT=41.099	SAT TT=1632.74	SAT TT=1121.36	SAT TT=2513.14	SAT TT=55.823	SAT TT=41.099	SAT TT=1302.07	SAT TT=803.538	SAT TT=859.07	SAT TT=671.03	SAT TT=231.26	SAT TT=421.125	SAT TT=118.985
CRAFTED/parity-games/ instance_n9_i9_pp_ci_ce.cnf	SAT TT=524.284	? (TO) TT=5000.16	SAT TT=1040.29	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.12	? (TO) TT=5000.14	SAT TT=524.284	? (TO) TT=5000.15	? (TO) TT=5000.17	? (exit code) TT=4998.63	? (exit code) TT=4998.61	? (TO) TT=5000.15
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	SAT TT=100.144	SAT TT=3428.67	SAT TT=2821.88	SAT TT=215.347	? (TO) TT=5000.08	SAT TT=1945.35	SAT TT=788.902	? (TO) TT=5000.16	SAT TT=4334.24	SAT TT=1992.93	SAT TT=100.144	SAT TT=3996.2	? (TO) TT=5000.14
CRAFTED/ ramseycube/ Q32inK09.cnf	UNSAT TT=17.572	UNSAT TT=25.145	UNSAT TT=34.594	UNSAT TT=46.484	UNSAT TT=46.908	UNSAT TT=112.609	UNSAT TT=17.572	UNSAT TT=40.703	UNSAT TT=33.301	UNSAT TT=45.675	UNSAT TT=2041.5	? (exit code) TT=4998.52	UNSAT TT=47.539
CRAFTED/ ramseycube/ Q32inK10.cnf	UNSAT TT=31.692	UNSAT TT=44.756	UNSAT TT=43.516	UNSAT TT=159.684	UNSAT TT=173.573	UNSAT TT=210.173	UNSAT TT=31.692	UNSAT TT=92.882	UNSAT TT=67.519	UNSAT TT=146.131	? (exit code) TT=4999.22	UNSAT TT=185.114	UNSAT TT=239.088
CRAFTED/ ramseycube/ Q32inK11.cnf	UNSAT TT=92.891	UNSAT TT=232.343	UNSAT TT=92.891	UNSAT TT=1119.93	UNSAT TT=816.218	UNSAT TT=1106.84	UNSAT TT=592.077	UNSAT TT=143.359	UNSAT TT=222.849	UNSAT TT=1077.96	? (exit code) TT=4998.71	UNSAT TT=3396.25	UNSAT TT=1368.43
CRAFTED/ ramseycube/ Q3inK08.cnf	SAT TT=0.003	SAT TT=0.026	SAT TT=0.018	SAT TT=0.071	SAT TT=0.016	SAT TT=0.051	SAT TT=0.052	SAT TT=0.186	SAT TT=0.003	SAT TT=0.053	SAT TT=5.009	SAT TT=5.048	SAT TT=0.061
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/ ramseycube/ Q3inK09.cnf	SAT TT=0.025	SAT TT=1.274	SAT TT=0.105	SAT TT=5.748	SAT TT=0.113	SAT TT=2.341	SAT TT=6.125	SAT TT=0.808	SAT TT=0.025	SAT TT=6.86	SAT TT=5.059	SAT TT=14.962	SAT TT=6.381
CRAFTED/ ramseycube/ Q3inK10.cnf	SAT TT=0.126	SAT TT=51.609	SAT TT=0.506	SAT TT=133.026	SAT TT=0.539	SAT TT=108.084	SAT TT=134.802	SAT TT=8.854	SAT TT=0.126	SAT TT=135.145	SAT TT=5.305	SAT TT=19.094	SAT TT=196.929
CRAFTED/ ramseycube/ Q3inK11.cnf	SAT TT=0.563	SAT TT=672.354	SAT TT=1.88	SAT TT=2104.95	SAT TT=2.071	SAT TT=1867.36	SAT TT=2134.02	SAT TT=117.137	SAT TT=0.563	SAT TT=2117.85	SAT TT=6.023	SAT TT=28.823	SAT TT=2572.52
CRAFTED/ ramseycube/ Q3inK12.cnf	SAT TT=4.331	? (TO) TT=5000.11	SAT TT=197.942	? (TO) TT=5000.05	SAT TT=7.017	? (TO) TT=5000.1	? (TO) TT=5000.1	SAT TT=724.727	SAT TT=4.331	? (TO) TT=5000.07	SAT TT=8.073	SAT TT=68.203	? (TO) TT=5000.11
CRAFTED/ ramseycube/ Q3inK13.cnf		? (TO) TT=5000.11	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.15	? (TO) TT=5000.09	? (TO) TT=5000.17	? (TO) TT=5000.15	? (TO) TT=5000.09	? (exit code) TT=4999.17	? (TO) TT=5000.16
CRAFTED/rbsat/crafted/ forced/ rbsat-v1150c84314gyes1.cnf		? (TO) TT=5000.13	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.13	? (TO) TT=5000.1	? TT=4999.29	? (exit code) TT=4998.32	? (TO) TT=5000.11
CRAFTED/rbsat/crafted/ forced/ rbsat-v1150c84314gyes2.cnf		? (TO) TT=5000.05	? (TO) TT=5000.03	? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.06	? (TO) TT=5000.12	? (exit code) TT=4998.72	? (exit code) TT=4998.48	? (TO) TT=5000.13
CRAFTED/rbsat/crafted/ forced/ rbsat-v1560c133795gyes9.cnf		? (TO) TT=5000.11	? (TO) TT=5000.03	? (TO) TT=5000.03	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.12	? (TO) TT=5000.13	? (TO) TT=5000.11	? (TO) TT=5000.11	? TT=4999.62	? (exit code) TT=4998.44	? (TO) TT=5000.11
CRAFTED/rbsat/crafted/ forced/ rbsat-v1820c171155gyes6.cnf		? (TO) TT=5000.05	? (TO) TT=5000.08	? (TO) TT=5000.03	? (TO) TT=5000.05	? (TO) TT=5000.17	? (TO) TT=5000.08	? (TO) TT=5000.14	? (TO) TT=5000.1	? (TO) TT=5000.15	? (exit code) TT=4998.99	? (exit code) TT=4998.98	? (TO) TT=5000.09
CRAFTED/rbsat/crafted/ forced/ rbsat-v2640c305320gyes8.cnf		? (TO) TT=5000.06	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.01	? (TO) TT=5000.19	? (TO) TT=5000.18	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.21	? TT=4999.91	? (exit code) TT=4998.35	? (TO) TT=5000.14
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/rbsat/crafted/ forced/ rbsat-v760c43649gyes1.cnf	SAT TT=681.698	SAT TT=4974.36	? (TO) TT=5000.02	? (TO) TT=5000.07	SAT TT=681.698	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.12	? (TO) TT=5000.02	? (TO) TT=5000.1	SAT TT=1034.31	SAT TT=1112.23	SAT TT=4469.77
CRAFTED/rbsat/crafted/ forced/ rbsat-v945c61409gyes2.cnf	SAT TT=2166.24	? (TO) TT=5000.08	SAT TT=2166.24	? (TO) TT=5000	? (TO) TT=5000.01	? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.11	? TT=4999.27	? (exit code) TT=4998.99	SAT TT=2659.82
CRAFTED/rbsat/crafted/ forced/ rbsat-v945c61409gyes8.cnf		? (TO) TT=5000.05	? (TO) TT=5000.01	? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.11	? (TO) TT=5000.07	? (TO) TT=5000.04	? (exit code) TT=4998.67	? (exit code) TT=4999.21	? (TO) TT=5000.13
CRAFTED/rbsat/crafted/ unforced/ rbsat-v1375c111739g2.cnf		? (TO) TT=5000.12	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.12	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.1	? (TO) TT=5000.08	? TT=4999.57	? (exit code) TT=4999.09	? (TO) TT=5000.15
CRAFTED/rbsat/crafted/ unforced/ rbsat-v1375c111739g6.cnf		? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.11	? (TO) TT=5000.04	? (TO) TT=5000.03	? (TO) TT=5000.12	? (TO) TT=5000.09	? (exit code) TT=4998.97	? (exit code) TT=4998.97	? (TO) TT=5000.09
CRAFTED/rbsat/crafted/ unforced/ rbsat-v1820c171155g4.cnf		? (TO) TT=5000.05	? (TO) TT=5000.02	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.09	? (TO) TT=5000.06	? (TO) TT=5000.06	? (TO) TT=5000.13	? (TO) TT=5000.09	? (exit code) TT=4999.06	? (exit code) TT=4998.92	? (TO) TT=5000.08
CRAFTED/rbsat/crafted/ unforced/ rbsat-v2400c266431g5.cnf		? (TO) TT=5000.1	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.18	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.12	? (TO) TT=5000.18	? TT=4999.93	? (exit code) TT=4999.12	? (TO) TT=5000.18
CRAFTED/rbsat/crafted/ unforced/ rbsat-v2640c305320g4.cnf		? (TO) TT=5000.06	? (TO) TT=5000.08	? (TO) TT=5000.05	? (TO) TT=5000	? (TO) TT=5000.15	? (TO) TT=5000.13	? (TO) TT=5000.15	? (TO) TT=5000.14	? (TO) TT=5000.13	? (TO) TT=5000.05	? (exit code) TT=4999.3	? (TO) TT=5000.21
CRAFTED/rbsat/random/ forced/ rbsat-v1150c84314gyes3.cnf		? (TO) TT=5000.11	? (TO) TT=5000.08	? (TO) TT=5000.01	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.11	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.09	? (exit code) TT=4999.14	? (exit code) TT=4998.4	? (TO) TT=5000.13
CRAFTED/rbsat/random/ forced/ rbsat-v2100c215164gyes2.cnf		? (TO) TT=5000.05	? (TO) TT=5000.05	? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.11	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.13	? (TO) TT=5000.11	? TT=4999.55	? (exit code) TT=4999.27	? (TO) TT=5000.19
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/rbsat/random/ forced/ rbsat-v760c43649gyes10.cnf	SAT TT=6.917	SAT TT=23.991	SAT TT=40.106	SAT TT=7.412	SAT TT=221.797	SAT TT=13.594	SAT TT=39.522	SAT TT=158.014	SAT TT=124.797	SAT TT=6.917	SAT TT=51.833	SAT TT=490.046	SAT TT=61.677
CRAFTED/rbsat/random/ forced/ rbsat-v760c43649gyes1.cnf	SAT TT=43.78	SAT TT=79.824	SAT TT=357.184	SAT TT=3814.51	SAT TT=845.08	SAT TT=57.488	SAT TT=1048.75	SAT TT=258.268	SAT TT=1246.2	SAT TT=3782.43	SAT TT=43.78	SAT TT=99.235	SAT TT=396.77
CRAFTED/rbsat/random/ forced/ rbsat-v760c43649gyes4.cnf	SAT TT=5.615	SAT TT=121.27	SAT TT=112.947	SAT TT=367.322	SAT TT=163.093	SAT TT=96.771	SAT TT=8.624	SAT TT=55.971	SAT TT=165.571	SAT TT=367.512	SAT TT=5.615	SAT TT=238.898	SAT TT=621.609
CRAFTED/rbsat/random/ forced/ rbsat-v760c43649gyes6.cnf	SAT TT=27.795	SAT TT=27.795	SAT TT=29.279	SAT TT=658.931	SAT TT=739.014	SAT TT=395.787	SAT TT=211.906	SAT TT=817.263	SAT TT=749.155	SAT TT=658.133	SAT TT=179.903	SAT TT=703.033	SAT TT=2984.83
CRAFTED/rbsat/random/ forced/ rbsat-v945c61409gyes4.cnf	SAT TT=87.629	SAT TT=87.629	SAT TT=806.497	? (TO) TT=5000.05	? (TO) TT=5000.03	? (TO) TT=5000.08	SAT TT=2443.09	SAT TT=1810.32	SAT TT=3735.76	? (TO) TT=5000.07	SAT TT=784.956	? (exit code) TT=4999.07	? (TO) TT=5000.1
CRAFTED/rbsat/random/ forced/ rbsat-v945c61409gyes9.cnf	SAT TT=326.019	SAT TT=326.019	SAT TT=2212.86	SAT TT=2407.11	? (TO) TT=5000.06	SAT TT=4840.22	SAT TT=986.954	SAT TT=2512.4	SAT TT=2880.91	SAT TT=2382.31	SAT TT=409.227	SAT TT=2496.22	SAT TT=1260.57
CRAFTED/rbsat/random/ unforced/ rbsat-v1150c84314g2.cnf		? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.08	? (TO) TT=5000.05	? (TO) TT=5000.07	? (TO) TT=5000.1	? (TO) TT=5000.12	? (TO) TT=5000.07	? (TO) TT=5000.1	? (exit code) TT=4999.24	? (exit code) TT=4998.29	? (TO) TT=5000.06
CRAFTED/rbsat/random/ unforced/ rbsat-v1820c171155g3.cnf		? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.04	? (TO) TT=5000.1	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.05	? (TO) TT=5000.14	? (TO) TT=5000.13	? (exit code) TT=4999.14	? (exit code) TT=4998.73	? (TO) TT=5000.07
CRAFTED/rbsat/random/ unforced/ rbsat-v2640c305320g2.cnf		? (TO) TT=5000.11	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.01	? (TO) TT=5000.22	? (TO) TT=5000.12	? (TO) TT=5000.06	? (TO) TT=5000.07	? (TO) TT=5000.14	? TT=4999.55	? (exit code) TT=4999.07	? (TO) TT=5000.2
CRAFTED/rbsat/random/ unforced/ rbsat-v2640c305320g6.cnf		? (TO) TT=5000.13	? (TO) TT=5000.03	? (TO) TT=5000.01	? (TO) TT=5000.02	? (TO) TT=5000.14	? (TO) TT=5000.12	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.16	? TT=4999.79	? (exit code) TT=4999.1	? (TO) TT=5000.13
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/rbsat/random/ unforced/ rbsat-v760c43649g10.cnf	SAT TT=12.466	SAT TT=41.245	SAT TT=374.306	SAT TT=337.284	SAT TT=1351.16	SAT TT=184.044	SAT TT=168.645	SAT TT=2502.27	SAT TT=12.466	SAT TT=340.64	SAT TT=63.672	SAT TT=2452.02	SAT TT=1213.5
CRAFTED/rbsat/random/ unforced/ rbsat-v760c43649g1.cnf	SAT TT=4.694	SAT TT=117.566	SAT TT=4.694	SAT TT=865.771	SAT TT=1385.61	SAT TT=136.726	SAT TT=242.642	SAT TT=83.152	SAT TT=768.035	SAT TT=853.686	SAT TT=153.836	SAT TT=1667.51	SAT TT=1000.57
CRAFTED/rbsat/random/ unforced/ rbsat-v760c43649g4.cnf	UNSAT TT=351.007	UNSAT TT=351.007	UNSAT TT=1530.52	UNSAT TT=4872.6	UNSAT TT=3328.11	UNSAT TT=2321.63	UNSAT TT=836.602	UNSAT TT=2920.22	UNSAT TT=1848.67	UNSAT TT=4822.16	UNSAT TT=456.264	UNSAT TT=495.936	UNSAT TT=4636.07
CRAFTED/rbsat/random/ unforced/ rbsat-v760c43649g8.cnf	SAT TT=19.098	SAT TT=58.528	SAT TT=149.35	SAT TT=1152.52	SAT TT=916.759	SAT TT=44.062	SAT TT=19.098	SAT TT=68.452	SAT TT=730.567	SAT TT=1150.62	SAT TT=31.985	SAT TT=209.28	SAT TT=1205.62
CRAFTED/rbsat/random/ unforced/ rbsat-v945c61409g10.cnf	SAT TT=147.336	SAT TT=150.424	SAT TT=901.454	SAT TT=560.148	SAT TT=1250.11	SAT TT=2112.2	SAT TT=1719.93	SAT TT=147.336	SAT TT=2606.39	SAT TT=557.716	SAT TT=311.5	? (exit code) TT=4999.11	SAT TT=2313.92
CRAFTED/sgen/sat/ sgen1-sat-140-100.cnf	SAT TT=1.607	SAT TT=49.601	SAT TT=74.04	SAT TT=1.607	SAT TT=66.9	SAT TT=19.664	SAT TT=38.586	SAT TT=264.014	SAT TT=34.736	SAT TT=1.738	? (exit code) TT=4998.66	SAT TT=7.758	SAT TT=153.344
CRAFTED/sgen/sat/ sgen1-sat-160-100.cnf	SAT TT=6.017	SAT TT=517.73	SAT TT=1741	SAT TT=120.4	SAT TT=282.728	SAT TT=95.594	SAT TT=202.791	SAT TT=20.107	SAT TT=205.558	SAT TT=125.218	SAT TT=6.017	? (exit code) TT=4998.55	SAT TT=14.887
CRAFTED/sgen/sat/ sgen1-sat-180-100.cnf	SAT TT=6.38	SAT TT=480.583	? (TO) TT=5000.09	SAT TT=797.499	SAT TT=743.62	SAT TT=1890.6	SAT TT=341.088	SAT TT=2040.17	SAT TT=13.912	SAT TT=780.556	SAT TT=6.38	? (exit code) TT=4998.75	? (TO) TT=5000.08
CRAFTED/sgen/sat/ sgen1-sat-200-100.cnf	SAT TT=57.744	SAT TT=2890.6	? (TO) TT=5000.01	SAT TT=1491.33	? (TO) TT=5000.1	? (TO) TT=5000.04	SAT TT=57.744	? (TO) TT=5000.05	SAT TT=1366.02	SAT TT=1572.37	? (exit code) TT=4998.61	? (exit code) TT=4998.72	SAT TT=3405.2
CRAFTED/sgen/sat/ sgen1-sat-220-100.cnf	SAT TT=716.582	? (TO) TT=5000.02	SAT TT=3286.53	SAT TT=716.582	SAT TT=1435.2	? (TO) TT=5000.06	SAT TT=3514.22	? (TO) TT=5000.11	? (TO) TT=5000.08	SAT TT=751.454	? (exit code) TT=4998.51	? (exit code) TT=4998.76	? (TO) TT=5000.05
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/sgen/sat/ sgen1-sat-230-100.cnf		? (TO) TT=5000.02	? (TO) TT=5000.04	? (TO) TT=5000.11	? (TO) TT=5000.1	? (TO) TT=5000.11	? (TO) TT=5000.06	? (TO) TT=5000.02	? (TO) TT=5000.1	? (TO) TT=5000.02	? (exit code) TT=4998.53	? (exit code) TT=4998.74	? (TO) TT=5000.02
CRAFTED/sgen/sat/ sgen1-sat-240-100.cnf		? (TO) TT=5000.02	? (TO) TT=5000.05	? (TO) TT=5000.12	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.07	? (exit code) TT=4998.5	? (exit code) TT=4998.79	? (TO) TT=5000.07
CRAFTED/sgen/sat/ sgen1-sat-250-100.cnf		? (TO) TT=5000.07	? (TO) TT=5000.02	? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.03	? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.06	? (exit code) TT=4998.43	? (exit code) TT=4998.72	? (TO) TT=5000.02
CRAFTED/sgen/sat/ sgen1-sat-260-100.cnf		? (TO) TT=5000.03	? (TO) TT=5000.03	? (TO) TT=5000.11	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.06	? (exit code) TT=4998.51	? (exit code) TT=4998.71	? (TO) TT=5000.04
CRAFTED/sgen/sat/ sgen1-sat-270-100.cnf		? (TO) TT=5000.04	? (TO) TT=5000	? (TO) TT=5000.11	? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.12	? (TO) TT=5000.11	? (TO) TT=5000.08	? (TO) TT=5000.1	? (exit code) TT=4998.44	? (exit code) TT=4998.74	? (TO) TT=5000.1
CRAFTED/sgen/sat/ sgen1-sat-280-100.cnf		? (TO) TT=5000.1	? (TO) TT=5000.01	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.02	? (TO) TT=5000.02	? (TO) TT=5000.11	? (exit code) TT=4998.44	? (exit code) TT=4998.71	? (TO) TT=5000.06
CRAFTED/sgen/sat/ sgen1-sat-290-100.cnf		? (TO) TT=5000.02	? (TO) TT=5000.03	? (TO) TT=5000.13	? (TO) TT=5000.03	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.01	? (TO) TT=5000.07	? (exit code) TT=4998.44	? (exit code) TT=4998.72	? (TO) TT=5000.06
CRAFTED/sgen/sat/ sgen1-sat-300-100.cnf		? (TO) TT=5000.09	? (TO) TT=5000.03	? (TO) TT=5000.07	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.02	? (TO) TT=5000.09	? (exit code) TT=4998.39	? (exit code) TT=4998.79	? (TO) TT=5000.06
CRAFTED/sgen/ unsat/ sgen1-unsat-103-100.cnf	UNSAT TT=1129.75	? (TO) TT=5000.07	? (TO) TT=5000.1	? (TO) TT=5000.03	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.07	? (exit code) TT=4998.5	UNSAT TT=1129.75	? (TO) TT=5000.08
CRAFTED/sgen/ unsat/ sgen1-unsat-109-100.cnf	UNSAT TT=4045.49	? (TO) TT=5000.03	? (TO) TT=5000.03	? (TO) TT=5000.1	? (TO) TT=5000.06	? (TO) TT=5000.08	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.08	? (TO) TT=5000.1	? (exit code) TT=4998.47	UNSAT TT=4045.49	? (TO) TT=5000.05
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/sgen/ unsat/ sgen1-unsat-115-100.cnf	UNSAT TT=2410.92	? (TO) TT=5000.04	? (TO) TT=5000.01	? (TO) TT=5000.1	? (TO) TT=5000.06	? (TO) TT=5000.02	? (TO) TT=5000.11	? (TO) TT=5000.03	? (TO) TT=5000.05	? (TO) TT=5000.06	? (exit code) TT=4998.54	UNSAT TT=2410.92	? (TO) TT=5000.08
CRAFTED/sgen/ unsat/ sgen1-unsat-121-100.cnf		? (TO) TT=5000.1	? (TO) TT=5000.04	? (TO) TT=5000.05	? (TO) TT=5000.11	? (TO) TT=5000.1	? (TO) TT=5000.06	? (TO) TT=5000.1	? (TO) TT=5000.06	? (TO) TT=5000.11	? (exit code) TT=4998.65	? (exit code) TT=4998.65	? (TO) TT=5000.04
CRAFTED/sgen/ unsat/ sgen1-unsat-127-100.cnf		? (TO) TT=5000.02	? (TO) TT=5000.04	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.03	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.08	? (TO) TT=5000.05	? (exit code) TT=4998.72	? (exit code) TT=4998.73	? (TO) TT=5000.05
CRAFTED/sgen/ unsat/ sgen1-unsat-133-100.cnf		? (TO) TT=5000.05	? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.02	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.09	? (exit code) TT=4998.72	? (exit code) TT=4998.79	? (TO) TT=5000.02
CRAFTED/sgen/ unsat/ sgen1-unsat-139-100.cnf		? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.08	? (TO) TT=5000.08	? (TO) TT=5000.06	? (TO) TT=5000.03	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.02	? (exit code) TT=4998.89	? (exit code) TT=4998.92	? (TO) TT=5000.09
CRAFTED/sgen/ unsat/ sgen1-unsat-145-100.cnf		? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.09	? (TO) TT=5000.1	? (TO) TT=5000.04	? (TO) TT=5000.05	? (TO) TT=5000.04	? (TO) TT=5000.02	? (TO) TT=5000.02	? (exit code) TT=4998.77	? (exit code) TT=4998.94	? (TO) TT=5000.07
CRAFTED/sgen/ unsat/ sgen1-unsat-151-100.cnf		? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.05	? (TO) TT=5000.06	? (TO) TT=5000.09	? (TO) TT=5000.07	? (TO) TT=5000.09	? (TO) TT=5000.08	? (exit code) TT=4998.73	? (exit code) TT=4999.08	? (TO) TT=5000.02
CRAFTED/sgen/ unsat/ sgen1-unsat-61-100.cnf	UNSAT TT=1.107	UNSAT TT=1.179	UNSAT TT=5.35	UNSAT TT=3.158	UNSAT TT=3.113	UNSAT TT=10.009	UNSAT TT=1.107	UNSAT TT=2.629	UNSAT TT=2.493	UNSAT TT=2.864	UNSAT TT=3.069	UNSAT TT=3.07	UNSAT TT=2.244
CRAFTED/sgen/ unsat/ sgen1-unsat-73-100.cnf	UNSAT TT=17.246	UNSAT TT=21.481	UNSAT TT=55.203	UNSAT TT=19.239	UNSAT TT=28.632	UNSAT TT=89.318	UNSAT TT=17.246	UNSAT TT=32.79	UNSAT TT=25.044	UNSAT TT=17.628	UNSAT TT=27.963	UNSAT TT=18.425	UNSAT TT=28.339
CRAFTED/sgen/ unsat/ sgen1-unsat-85-100.cnf	UNSAT TT=60.158	UNSAT TT=205.206	UNSAT TT=3130.41	UNSAT TT=302.162	UNSAT TT=287.84	UNSAT TT=1064.18	UNSAT TT=531.764	UNSAT TT=1455.66	UNSAT TT=312.151	UNSAT TT=278.852	UNSAT TT=305.394	UNSAT TT=60.158	UNSAT TT=329.651
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/sgen/ unsat/ sgen1-unsat-97-100.cnf	UNSAT TT=118.832	UNSAT TT=1625.19	? (TO) TT=5000.02	UNSAT TT=1846.73	UNSAT TT=1333.98	? (TO) TT=5000.06	? (TO) TT=5000.04	? (TO) TT=5000.04	UNSAT TT=2359.49	UNSAT TT=1720.57	UNSAT TT=1826.87	UNSAT TT=118.832	UNSAT TT=2668.78
CRAFTED/sgi/ new-difficult-20-152-18-95.cnf	SAT TT=12.22	SAT TT=83.582	SAT TT=12.22	SAT TT=28.596	SAT TT=30.999	SAT TT=54.635	SAT TT=16.517	SAT TT=179.815	SAT TT=88.06	SAT TT=29.736	SAT TT=12.858	? (exit code) TT=4998.98	SAT TT=43.2
CRAFTED/sgi/ new-difficult-21-168-19-90.cnf	SAT TT=371.47	SAT TT=371.47	SAT TT=2160.95	? (TO) TT=5000.06	? (TO) TT=5000.05	SAT TT=2387.26	SAT TT=4237.86	SAT TT=2860.32	SAT TT=1807.26	? (TO) TT=5000.06	? (exit code) TT=4998.71	? (exit code) TT=4999.15	? (TO) TT=5000.06
CRAFTED/sgi/ new-difficult-22-173-20-80.cnf	SAT TT=67.935	SAT TT=123.819	SAT TT=536.723	SAT TT=178.236	SAT TT=429.605	SAT TT=384.545	SAT TT=265.738	SAT TT=569.392	SAT TT=440.178	SAT TT=185.456	SAT TT=153.711	? (exit code) TT=4998.46	SAT TT=67.935
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	SAT TT=618.445	SAT TT=2377.17	? (TO) TT=5000.07	? (TO) TT=5000.05	SAT TT=4103.58	? (TO) TT=5000.04	? (TO) TT=5000.09	SAT TT=618.445	SAT TT=2406.19	? (TO) TT=5000.1	? (exit code) TT=4998.46	? (exit code) TT=4998.68	SAT TT=4177.98
CRAFTED/sgi/ new-difficult-24-193-22-70.cnf	SAT TT=22.437	SAT TT=22.437	SAT TT=351.524	SAT TT=1952.17	SAT TT=2077.12	SAT TT=2088.52	SAT TT=618.89	SAT TT=1008.71	SAT TT=102.63	SAT TT=1981.34	SAT TT=4914.56	SAT TT=4800.98	SAT TT=1096.21
CRAFTED/sgi/ new-difficult-26-243-24-70.cnf	SAT TT=4440.72	SAT TT=4440.72	? (TO) TT=5000.03	? (TO) TT=5000.01	? (TO) TT=5000.02	? (TO) TT=5000.07	? (TO) TT=5000.03	? (TO) TT=5000.05	? (TO) TT=5000.09	? (TO) TT=5000.12	? (exit code) TT=4998.92	? (exit code) TT=4998.28	? (TO) TT=5000.05
CRAFTED/sgi/ new-difficult-28-302-26-75.cnf		? (TO) TT=5000.04	? (TO) TT=5000.08	? (TO) TT=5000.02	? (TO) TT=5000.1	? (TO) TT=5000.1	? (TO) TT=5000.08	? (TO) TT=5000.11	? (TO) TT=5000.12	? (TO) TT=5000.09	? (exit code) TT=4998.52	? (exit code) TT=4999.21	? (TO) TT=5000.05
CRAFTED/sgi/ satsgi-n17himBHm20-p0-q146.cnf	SAT TT=0.004	SAT TT=0.023	SAT TT=0.027	SAT TT=0.125	SAT TT=0.026	SAT TT=0.023	SAT TT=0.029	SAT TT=0.073	SAT TT=0.004	SAT TT=0.033	SAT TT=5.009	SAT TT=9.919	SAT TT=0.036
CRAFTED/sgi/ satsgi-n18himBHm21-p0-q167.cnf	SAT TT=0.004	SAT TT=0.025	SAT TT=0.029	SAT TT=0.145	SAT TT=0.03	SAT TT=0.016	SAT TT=0.035	SAT TT=0.088	SAT TT=0.004	SAT TT=0.038	SAT TT=5.011	SAT TT=9.924	SAT TT=0.042
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/sgi/ satsgi-n19himBHm22-p0-q181.cnf	SAT TT=0.005	SAT TT=0.029	SAT TT=0.034	SAT TT=0.171	SAT TT=0.036	SAT TT=0.019	SAT TT=0.041	SAT TT=0.104	SAT TT=0.005	SAT TT=0.049	SAT TT=5.011	SAT TT=5.041	SAT TT=0.052
CRAFTED/sgi/ satsgi-n22himBHm24-p0-q209.cnf	SAT TT=0.006	SAT TT=0.045	SAT TT=0.046	SAT TT=0.258	SAT TT=0.051	SAT TT=0.033	SAT TT=0.075	SAT TT=0.16	SAT TT=0.006	SAT TT=0.086	SAT TT=5.017	SAT TT=5.075	SAT TT=0.083
CRAFTED/sgi/ satsgi-n22himBHm25-p0-q229.cnf	SAT TT=0.007	SAT TT=0.047	SAT TT=0.048	SAT TT=0.269	SAT TT=0.053	SAT TT=0.031	SAT TT=0.075	SAT TT=0.174	SAT TT=0.007	SAT TT=0.092	SAT TT=5.017	SAT TT=5.073	SAT TT=0.086
CRAFTED/sgi/ satsgi-n23himBHm25-p0-q219.cnf	SAT TT=0.008	SAT TT=0.051	SAT TT=0.051	SAT TT=0.295	SAT TT=0.057	SAT TT=0.034	SAT TT=0.084	SAT TT=0.186	SAT TT=0.008	SAT TT=0.098	SAT TT=5.018	SAT TT=5.083	SAT TT=0.093
CRAFTED/sgi/ satsgi-n23himBHm26-p0-q248.cnf	SAT TT=0.008	SAT TT=0.054	SAT TT=0.053	SAT TT=0.308	SAT TT=0.061	SAT TT=0.036	SAT TT=0.091	SAT TT=0.204	SAT TT=0.008	SAT TT=0.109	SAT TT=5.019	SAT TT=5.089	SAT TT=0.102
CRAFTED/sgi/ satsgi-n23himBHm27-p0-q251.cnf	SAT TT=0.009	SAT TT=0.057	SAT TT=0.059	SAT TT=0.332	SAT TT=0.065	SAT TT=0.038	SAT TT=0.099	SAT TT=0.223	SAT TT=0.009	SAT TT=0.117	SAT TT=5.018	SAT TT=5.096	SAT TT=0.107
CRAFTED/sgi/ satsgi-n25himBHm27-p0-q251.cnf	SAT TT=0.009	SAT TT=0.069	SAT TT=0.066	SAT TT=0.383	SAT TT=0.075	SAT TT=0.044	SAT TT=0.119	SAT TT=0.253	SAT TT=0.009	SAT TT=0.147	SAT TT=5.022	SAT TT=5.115	SAT TT=0.133
CRAFTED/sgi/ satsgi-n25himBHm29-p0-q290.cnf	SAT TT=0.01	SAT TT=0.075	SAT TT=0.073	SAT TT=0.433	SAT TT=0.084	SAT TT=0.049	SAT TT=0.139	SAT TT=0.305	SAT TT=0.01	SAT TT=0.167	SAT TT=5.024	SAT TT=5.127	SAT TT=0.149
CRAFTED/sgi/ satsgi-n28himBHm30-p0-q333.cnf	SAT TT=0.012	SAT TT=0.082	SAT TT=0.094	SAT TT=0.562	SAT TT=0.105	SAT TT=0.066	SAT TT=0.196	SAT TT=0.379	SAT TT=0.012	SAT TT=0.244	SAT TT=5.03	SAT TT=5.19	SAT TT=0.213
CRAFTED/sgi/ sgi-difficult4.cnf	SAT TT=0.008	SAT TT=0.05	SAT TT=0.056	SAT TT=0.347	SAT TT=0.059	SAT TT=0.041	SAT TT=0.1	SAT TT=0.144	SAT TT=0.008	SAT TT=0.116	SAT TT=5.018	SAT TT=5.101	SAT TT=0.119
Bench name	Best results	clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
CRAFTED/sgi/ sgi-difficult7.cnf	SAT TT=0.014	SAT TT=0.113	SAT TT=0.107	SAT TT=0.755	SAT TT=0.125	SAT TT=0.092	SAT TT=0.281	SAT TT=0.328	SAT TT=0.014	SAT TT=0.35	SAT TT=5.035	SAT TT=5.297	SAT TT=0.325

Statistics		clasp 1.2.0-SAT09-32 (complete)	glucose 1.0 (complete)	IUT_BMB_SAT 1.0 (complete)	LySAT c/2009-03-20 (complete)	MiniSat 2.1 (Sat-race'08 Edition) (complete)	MXC 2009-03-10 (complete)	precosat 236 (complete)	SApperloT base (complete)	SAT07 reference solver: minisat SAT 2007 (complete)	SAT07 reference solver: SATzilla CRAFTED (complete)	SATzilla2009_C 2009-03-22 (complete)	VARSAT-industrial 2009-03-22 (complete)
Number of times the solver is able to give the best known answer		156	135	149	141	137	146	141	149	150	137	155	145
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		42	9	6	6	16	19	10	28	9	22	23	6