SAT 2009 Competition: main competition (phase 1): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/parity-games/ instance_n2_i3_pp.cnf	UNSAT	0.001998	0.006259	1613310
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-12.sat05-2587.reshuffled-07.cnf	UNSAT	0.001999	0.00506802	1726240
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-14.sat05-2589.reshuffled-07.cnf	UNSAT	0.001999	0.00513388	1726293
CRAFTED/parity-games/ instance_n2_i2_pp.cnf	UNSAT	0.001999	0.00542009	1613328
CRAFTED/parity-games/ instance_n3_i4_pp_ci_ce.cnf	UNSAT	0.033994	0.0332861	1613298
crafted/Medium/contest05/pebbling/ unsat-grid-pbl-0080.sat05-1344.reshuffled-07.cnf	UNSAT	1.26581	1.28222	1725551
CRAFTED/modcircuits/ owp_4vars_5gates.cnf	UNSAT	2.28865	2.28937	1594731
CRAFTED/sgen/unsat/ sgen1-unsat-61-100.cnf	UNSAT	3.04554	3.04555	1594649
CRAFTED/parity-games/ instance_n4_i5_pp.cnf	UNSAT	11.3413	11.3504	1613346
crafted/Medium/contest05/pebbling/ unsat-pbl-00080.sat05-1325.reshuffled-07.cnf	UNSAT	13.6559	13.6675	1725498
CRAFTED/parity-games/ instance_n5_i6_pp_ci_ce.cnf	UNSAT	15.8076	15.8158	1613304
crafted/Difficult/contest05/sabharwal/ gt-ordering-sat-gt-040.sat05-1297.reshuffled-07.cnf	UNSAT	17.8623	17.8824	1730321
crafted/Medium/contest05/sabharwal/ counting-clqcolor-unsat-set-b-clqcolor-08-06-07.sat05-1257.reshuffled-07.cnf	UNSAT	20.6819	20.6954	1725339
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf	UNSAT	21.0178	21.0358	1730162
CRAFTED/sgen/unsat/ sgen1-unsat-73-100.cnf	UNSAT	29.2885	29.3048	1594653
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-060.sat05-1312.reshuffled-07.cnf	UNSAT	43.5644	43.6009	1730268
crafted/Medium/contest05/others/ QG7-gensys-icl001.sat05-2926.reshuffled-07.cnf	UNSAT	58.5221	61.1746	1725604
crafted/Medium/contest05/others/ QG8-gensys-ukn005.sat05-3584.reshuffled-07.cnf	UNSAT	76.8073	76.8462	1725975
crafted/Medium/contest05/others/ QG-gensys-icl003.sat05-2715.reshuffled-07.cnf	UNSAT	144.968	145.029	1725816
crafted/Medium/contest05/sabharwal/ counting-easier-php-012-010.sat05-1172.reshuffled-07.cnf	UNSAT	170.047	170.145	1725286
crafted/Medium/contest05/others/ QG-gensys-brn008.sat05-2685.reshuffled-07.cnf	UNSAT	174.27	174.329	1725869
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-gigamax.used-as.sat04-984.sat05-4194.reshuffled-07.cnf	UNSAT	263.068	263.203	1727300
crafted/Difficult/contest05/QG/ QG6-gensys-icl004.sat05-2716.reshuffled-07.cnf	UNSAT	270.485	270.612	1730056
CRAFTED/sgen/unsat/ sgen1-unsat-85-100.cnf	UNSAT	285.495	288.283	1594645
crafted/Difficult/contest05/sabharwal/ grid-pebbling-unsat-grid-pbl-0300.sat05-1350.sat05-1350.reshuffled-07.cnf	UNSAT	332.408	332.636	1730374
crafted/Difficult/contest05/QG/ QG6-gensys-icl009.sat05-2721.reshuffled-07.cnf	UNSAT	402.124	397.421	1729897
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g4.cnf	UNSAT	488.64	488.811	1594949
crafted/Difficult/contest-02-03-04/ contest02-Mat26.sat05-457.reshuffled-07.cnf	UNSAT	576.649	576.823	1731646
crafted/Hard/contest05/QG/ QG7-dead-dnd005.sat05-3111.reshuffled-07.cnf	UNSAT	775.789	776.122	1727724
crafted/Difficult/contest05/QG/ QG7-gensys-icl006.sat05-3132.reshuffled-07.cnf	UNSAT	865.805	866.236	1729738
crafted/Medium/contest05/others/ pmg-11-UNSAT.sat05-3939.reshuffled-07.cnf	UNSAT	1036.15	1036.51	1725922
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1100-m7545-k4-l4-s310659001.sat05-524.reshuffled-07.cnf	UNSAT	1194.71	1195.36	1731381

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-2.sat05-2159.reshuffled-07.cnf	SAT	0.008997	0.00933092	1726134
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf	SAT	0.010997	0.0107419	1726028
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf	SAT	0.011997	0.0112901	1726081
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-250-3.sat05-2220.reshuffled-07.cnf	SAT	0.012997	0.0136139	1726346
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-3.sat05-2265.reshuffled-07.cnf	SAT	0.014996	0.0145839	1731063
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-2.sat05-2264.reshuffled-07.cnf	SAT	0.014997	0.0157181	1730957
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-1.sat05-2248.reshuffled-07.cnf	SAT	0.014997	0.014626	1731222
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-1.sat05-2263.reshuffled-07.cnf	SAT	0.014997	0.0146711	1730904
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-2.sat05-2249.reshuffled-07.cnf	SAT	0.015996	0.0148619	1731010
CRAFTED/parity-games/ instance_n3_i3_pp_ci_ce.cnf	SAT	0.036993	0.037426	1613301
CRAFTED/parity-games/ instance_n4_i4_pp.cnf	SAT	1.41078	1.41161	1613307
CRAFTED/ramseycube/ Q3inK08.cnf	SAT	5.01024	5.01237	1594697
CRAFTED/sgi/ satsgi-n17himBHm20-p0-q146.cnf	SAT	5.01124	5.01382	1594805
CRAFTED/sgi/ satsgi-n18himBHm21-p0-q167.cnf	SAT	5.01124	5.01292	1594849
CRAFTED/sgi/ satsgi-n19himBHm22-p0-q181.cnf	SAT	5.01324	5.02599	1594793
CRAFTED/sgi/ satsgi-n22himBHm24-p0-q209.cnf	SAT	5.01624	5.01875	1594795
CRAFTED/sgi/ satsgi-n22himBHm25-p0-q229.cnf	SAT	5.01624	5.0189	1594889
CRAFTED/sgi/ satsgi-n23himBHm26-p0-q248.cnf	SAT	5.01824	5.02821	1594847
CRAFTED/sgi/ satsgi-n23himBHm25-p0-q219.cnf	SAT	5.01924	5.02173	1594879
CRAFTED/sgi/ sgi-difficult4.cnf	SAT	5.02024	5.0265	1596177
CRAFTED/sgi/ satsgi-n23himBHm27-p0-q251.cnf	SAT	5.02124	5.02393	1594903
CRAFTED/sgi/ satsgi-n25himBHm27-p0-q251.cnf	SAT	5.02124	5.0239	1594839
CRAFTED/sgi/ satsgi-n25himBHm29-p0-q290.cnf	SAT	5.02423	5.02661	1594919
CRAFTED/sgi/ satsgi-n28himBHm30-p0-q333.cnf	SAT	5.03123	5.03366	1594901
CRAFTED/sgi/ sgi-difficult7.cnf	SAT	5.03423	5.04077	1596186
CRAFTED/ramseycube/ Q3inK09.cnf	SAT	5.06323	5.06773	1594683
CRAFTED/parity-games/ instance_n3_i3_pp.cnf	SAT	5.29419	5.29627	1613349
CRAFTED/ramseycube/ Q3inK10.cnf	SAT	5.30619	5.30867	1594691
CRAFTED/sgi/ new-difficult-20-152-18-95.cnf	SAT	5.37218	5.382	1738140
CRAFTED/sgen/sat/ sgen1-sat-160-100.cnf	SAT	5.43417	5.44049	1594669
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g1.cnf	SAT	5.48517	5.49128	1595115
CRAFTED/ramseycube/ Q3inK11.cnf	SAT	6.04908	6.05898	1594701
CRAFTED/sgi/ new-difficult-22-173-20-80.cnf	SAT	7.11992	7.13136	1738299
CRAFTED/sgen/sat/ sgen1-sat-220-100.cnf	SAT	7.29089	7.30129	1594667
CRAFTED/sgen/sat/ sgen1-sat-140-100.cnf	SAT	7.75482	7.77034	1594665
CRAFTED/ramseycube/ Q3inK12.cnf	SAT	8.16676	8.17333	1594693
CRAFTED/parity-games/ instance_n4_i4_pp_ci_ce.cnf	SAT	11.2393	11.2478	1613322
CRAFTED/parity-games/ instance_n5_i5_pp.cnf	SAT	11.3023	11.3116	1613316
CRAFTED/parity-games/ instance_n6_i6_pp.cnf	SAT	12.869	12.8826	1613334
CRAFTED/parity-games/ instance_n5_i6_pp.cnf	SAT	13.261	13.2757	1613325
crafted/Medium/contest05/sabharwal/ sat-strips-gripper-12t23.sat05-1144.reshuffled-07.cnf	SAT	18.2932	18.3114	1725392
CRAFTED/edgematching/ compact/em_7_4_9_cmp.cnf	SAT	19.62	19.6377	1731702
CRAFTED/parity-games/ instance_n6_i6_pp_ci_ce.cnf	SAT	20.6909	20.721	1613352
CRAFTED/parity-games/ instance_n6_i7_pp.cnf	SAT	22.7695	22.7857	1613292
CRAFTED/modcircuits/ mod5block_1var_7gates.cnf	SAT	25.8391	25.8518	1594707
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g8.cnf	SAT	30.8063	30.8309	1595011
CRAFTED/parity-games/ instance_n7_i7_pp.cnf	SAT	31.2013	31.22	1613340
CRAFTED/parity-games/ instance_n7_i7_pp_ci_ce.cnf	SAT	32.1421	32.1637	1613319
CRAFTED/edgematching/ all/em_12_2_4_all.cnf	SAT	33.3859	33.4429	1731750
CRAFTED/parity-games/ instance_n8_i8_pp.cnf	SAT	38.4891	38.5275	1737822
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes1.cnf	SAT	43.5454	43.5719	1595211
CRAFTED/edgematching/ explicit/em_9_3_5_exp.cnf	SAT	43.6934	43.7262	1731729
CRAFTED/rbsat/random/ forced/rbsat-v760c43649gyes10.cnf	SAT	51.9511	51.9806	1595187
CRAFTED/edgematching/ explicit/em_7_3_6_exp.cnf	SAT	53.3979	53.4464	1731744
CRAFTED/edgematching/ explicit/em_8_4_5_exp.cnf	SAT	54.0348	54.0912	1731741
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g10.cnf	SAT	63.6903	63.7391	1595085
CRAFTED/ edgematching/all/em_8_4_5_all.cnf	SAT	74.9746	75.0147	1731747
crafted/Medium/contest05/others/ QG7a-gensys-ukn001.sat05-3841.reshuffled-07.cnf	SAT	80.4058	80.4643	1725710
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	SAT	99.8978	99.9713	1738034
CRAFTED/ edgematching/all/em_7_4_9_all.cnf	SAT	101.513	101.559	1731762
crafted/Medium/contest05/others/ QG7a-gensys-brn004.sat05-3669.reshuffled-07.cnf	SAT	109.89	109.961	1725657
CRAFTED/edgematching/ explicit/em_7_4_9_exp.cnf	SAT	112.563	112.638	1731735
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-sat-210-3.sat05-2475.reshuffled-07.cnf	SAT	112.884	112.923	1731169
CRAFTED/edgematching/ explicit/em_7_4_8_exp.cnf	SAT	130.969	131.053	1731738
CRAFTED/ edgematching/all/em_7_3_6_all.cnf	SAT	133.594	133.636	1731756
crafted/Medium/contest05/others/ QG7a-gensys-ukn005.sat05-3845.reshuffled-07.cnf	SAT	147.112	147.212	1725763
CRAFTED/parity-games/ instance_n7_i8_pp.cnf	SAT	162.848	163.776	1613358
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes6.cnf	SAT	170.812	170.926	1595225
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	SAT	193.404	193.473	1737769
CRAFTED/parity-games/ instance_n8_i9_pp.cnf	SAT	231.878	232.027	1737875
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g10.cnf	SAT	311.285	311.305	1595081
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes4.cnf	SAT	315.757	315.905	1595137
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes9.cnf	SAT	383.175	383.361	1595269
crafted/Difficult/contest05/sabharwal/ grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf	SAT	421.164	421.38	1730215
crafted/Medium/contest05/jarvisalo/ mod2c-rand3bip-sat-190-3.sat05-2445.reshuffled-07.cnf	SAT	533.877	534.021	1726187
CRAFTED/edgematching/ fbcolors/em_7_4_9_fbc.cnf	SAT	573.405	573.572	1731780
CRAFTED/edgematching/ explicit/em_12_2_4_exp.cnf	SAT	762.48	762.735	1731732
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes4.cnf	SAT	783.389	783.826	1595163
CRAFTED/edgematching/ fbcolors/em_7_3_6_fbc.cnf	SAT	802.014	802.375	1731777
CRAFTED/edgematching/ explicit/em_11_3_4_exp.cnf	SAT	978.953	979.464	1731726
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes1.cnf	SAT	1103.22	1103.75	1595571
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-1.sat05-2488.reshuffled-07.cnf	SAT	1167.14	1167.7	1728148

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/edgematching/ compact/em_9_3_5_cmp.cnf	?	1199.84	1200.32	1731711
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2.cnf	?	1199.85	1200.3	1594705
CRAFTED/rbsat/crafted/ forced/rbsat-v1820c171155gyes6.cnf	?	1199.88	1200.52	1595491
crafted/Hard/contest05/QG/ QG7-gensys-icl100.sat05-3226.reshuffled-07.cnf	?	1199.89	1200.47	1727883
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes2.cnf	?	1200.08	1200.6	1595289

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g5.cnf	? (TO)	1200.03	1200.71	1595451
CRAFTED/rbsat/random/unforced/ rbsat-v2640c305320g6.cnf	? (TO)	1200.04	1200.61	1594997
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l1.used-as.sat04-893.sat05-4187.reshuffled-07.cnf	? (TO)	1200.05	1200.33	1727618
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes8.cnf	? (TO)	1200.05	1200.51	1595561
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-philo.used-as.sat04-988.sat05-4195.reshuffled-07.cnf	? (TO)	1200.05	1200.42	1727353
crafted/Hard/contest04/others/ CompositeRSA576.sat05-509.reshuffled-07.cnf	? (TO)	1200.07	1200.43	1726982
crafted/Hard/contest05/others/ sgp_9-8-8.sat05-2674.reshuffled-07.cnf	? (TO)	1200.07	1200.63	1728413
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-all.used-as.sat04-986.sat05-4198.reshuffled-07.cnf	? (TO)	1200.08	1200.43	1727565
CRAFTED/rbsat/crafted/unforced/ rbsat-v1375c111739g6.cnf	? (TO)	1200.09	1201.11	1595423
CRAFTED/ramseycube/ Q3inK13.cnf	? (TO)	1200.09	1200.65	1594687
CRAFTED/rbsat/random/unforced/ rbsat-v2640c305320g2.cnf	? (TO)	1200.1	1200.61	1595055
crafted/Hard/contest04/others/ ramsey.sat05-511.reshuffled-07.cnf	? (TO)	1200.1	1196.01	1726876
CRAFTED/rbsat/crafted/unforced/ rbsat-v2640c305320g4.cnf	? (TO)	1200.12	1203.31	1595431
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-25-18-23.sat05-1287.reshuffled-07.cnf	? (TO)	1200.12	1200.51	1728572
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-FIFO.used-as.sat04-991.sat05-4192.reshuffled-07.cnf	? (TO)	1200.13	1200.54	1727512

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/sgen/unsat/ sgen1-unsat-97-100.cnf	? (exit code)	1198.87	1200.01	1594643
CRAFTED/ramseycube/ Q32inK10.cnf	? (exit code)	1198.87	1199.25	1594695
CRAFTED/edgematching/ fbcolors/em_8_4_5_fbc.cnf	? (exit code)	1198.89	1199.6	1731768
crafted/Hard/contest03/others/ hwb-n32-01-S1491788039.sat05-497.reshuffled-07.cnf	? (exit code)	1198.91	1199.21	1729155
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-unsat-120-3.sat05-2340.reshuffled-07.cnf	? (exit code)	1198.91	1199.27	1731275
crafted/Hard/contest05/others/ eulcbip-8-UNSAT.sat05-3937.reshuffled-07.cnf	? (exit code)	1198.92	1199.52	1728254
crafted/Hard/contest03/others/ hwb-n28-01-S136611085.sat05-491.reshuffled-07.cnf	? (exit code)	1198.92	1199.28	1729314
crafted/Hard/contest04/others/ equilarge_l2.sat05-519.reshuffled-07.cnf	? (exit code)	1198.94	1199.53	1726929
crafted/Hard/contest03/looksrandom/ hgen8-n320-01-S1432474240.sat05-483.reshuffled-07.cnf	? (exit code)	1198.94	1199.41	1729685
CRAFTED/modcircuits/ mod3block_2vars_9gates_u2_autoenc.cnf	? (exit code)	1198.94	1199.57	1594729
CRAFTED/sgen/sat/ sgen1-sat-290-100.cnf	? (exit code)	1198.95	1199.28	1737398
CRAFTED/modcircuits/ mod5block_2vars_12gates.cnf	? (exit code)	1198.96	1199.37	1594713
CRAFTED/modcircuits/ mod3_4vars_6gates.cnf	? (exit code)	1198.96	1199.54	1594723
crafted/Difficult/contest05/jarvisalo/ mod2c-3cage-unsat-10-3.sat05-2568.reshuffled-07.cnf	? (exit code)	1198.97	1199.3	1731116
crafted/Hard/contest05/QG/ QG7a-gensys-ukn009.sat05-3849.reshuffled-07.cnf	? (exit code)	1198.97	1199.37	1727936
crafted/Hard/contest03/looksrandom/ hgen8-n320-02-S1127428711.sat05-484.reshuffled-07.cnf	? (exit code)	1198.98	1199.57	1729526
crafted/Hard/contest05/others/ sgp_5-6-8.sat05-2669.reshuffled-07.cnf	? (exit code)	1198.98	1199.33	1728307
CRAFTED/sgen/sat/ sgen1-sat-300-100.cnf	? (exit code)	1198.99	1199.36	1594675
CRAFTED/sgen/sat/ sgen1-sat-270-100.cnf	? (exit code)	1198.99	1199.48	1737610
crafted/Difficult/contest05/others/ pmg-12-UNSAT.sat05-3940.reshuffled-07.cnf	? (exit code)	1199.01	1199.52	1730639
crafted/Difficult/contest05/QG/ QG6-gensys-icl001.sat05-2695.reshuffled-07.cnf	? (exit code)	1199.01	1199.35	1729950
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2.cnf	? (exit code)	1199.01	1199.69	1594703
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	? (exit code)	1199.04	1199.68	1594733
CRAFTED/sgen/sat/ sgen1-sat-280-100.cnf	? (exit code)	1199.04	1199.48	1594659
CRAFTED/sgen/sat/ sgen1-sat-260-100.cnf	? (exit code)	1199.04	1199.46	1594657
crafted/Hard/contest02/ pyhala-braun-unsat-40-4-02.sat05-459.reshuffled-07.cnf	? (exit code)	1199.05	1199.37	1728996
CRAFTED/sgen/sat/ sgen1-sat-240-100.cnf	? (exit code)	1199.06	1199.43	1594677
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2_restricted.cnf	? (exit code)	1199.06	1199.59	1594727
CRAFTED/sgen/sat/ sgen1-sat-230-100.cnf	? (exit code)	1199.08	1199.59	1737504
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	? (exit code)	1199.09	1199.6	1738352
CRAFTED/sgen/sat/ sgen1-sat-250-100.cnf	? (exit code)	1199.09	1199.69	1737451
crafted/Hard/contest04/others/ Composite-048BitPrimes-1.sat05-504.reshuffled-07.cnf	? (exit code)	1199.12	1199.51	1727141
CRAFTED/sgi/ new-difficult-21-168-19-90.cnf	? (exit code)	1199.13	1199.64	1738193
crafted/Hard/contest05/counting-clq/ unsat-set-b-clqcolor-16-11-14.sat05-1261.reshuffled-07.cnf	? (exit code)	1199.15	1199.66	1728625
CRAFTED/sgen/sat/ sgen1-sat-200-100.cnf	? (exit code)	1199.15	1199.65	1594681
CRAFTED/sgen/unsat/ sgen1-unsat-115-100.cnf	? (exit code)	1199.16	1199.6	1737345
CRAFTED/edgematching/ all/em_14_7_3_all.cnf	? (exit code)	1199.16	1199.6	1731753
CRAFTED/sgen/unsat/ sgen1-unsat-103-100.cnf	? (exit code)	1199.16	1199.52	1737716
CRAFTED/edgematching/ fbcolors/em_12_2_4_fbc.cnf	? (exit code)	1199.18	1199.54	1731786
CRAFTED/sgi/ new-difficult-28-302-26-75.cnf	? (exit code)	1199.18	1199.5	1738405
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	? (exit code)	1199.2	1199.68	1594739
CRAFTED/sgen/sat/ sgen1-sat-180-100.cnf	? (exit code)	1199.21	1199.77	1594663
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes2.cnf	? (exit code)	1199.22	1199.78	1595481
CRAFTED/sgen/unsat/ sgen1-unsat-109-100.cnf	? (exit code)	1199.24	1199.56	1594641
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2_autoenc.cnf	? (exit code)	1199.24	1199.7	1594735
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.04-s736572600.sat05-546.reshuffled-07.cnf	? (exit code)	1199.24	1199.75	1726664
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g2.cnf	? (exit code)	1199.24	1199.64	1595111
crafted/Difficult/contest05/QG/ QG6-gensys-brn007.sat05-2684.reshuffled-07.cnf	? (exit code)	1199.27	1199.75	1729844
crafted/Difficult/contest05/QG/ QG6-gensys-icl008.sat05-2720.reshuffled-07.cnf	? (exit code)	1199.27	1199.7	1730003
CRAFTED/sgen/unsat/ sgen1-unsat-121-100.cnf	? (exit code)	1199.27	1199.81	1594655
CRAFTED/parity-games/ instance_n9_i9_pp_ci_ce.cnf	? (exit code)	1199.29	1199.87	1737928
CRAFTED/sgen/unsat/ sgen1-unsat-133-100.cnf	? (exit code)	1199.3	1199.83	1594647
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-myciel6-cn.used-as.sat04-319.sat05-4201.reshuffled-07.cnf	? (exit code)	1199.3	1199.91	1727406
CRAFTED/modcircuits/ mod4block_2vars_11gates_u2_autoenc.cnf	? (exit code)	1199.3	1199.79	1594719
CRAFTED/ramseycube/ Q32inK11.cnf	? (exit code)	1199.32	1199.82	1594689
CRAFTED/sgen/unsat/ sgen1-unsat-127-100.cnf	? (exit code)	1199.33	1199.74	1737292
CRAFTED/edgematching/ compact/em_11_3_4_cmp.cnf	? (exit code)	1199.33	1199.93	1731714
CRAFTED/rbsat/crafted/forced/ rbsat-v1150c84314gyes2.cnf	? (exit code)	1199.35	1199.81	1595507
CRAFTED/sgen/unsat/ sgen1-unsat-139-100.cnf	? (exit code)	1199.35	1199.72	1737557
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_3-dir.sat05-440.reshuffled-07.cnf	? (exit code)	1199.36	1199.93	1731699
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_m3.used-as.sat04-900.sat05-4186.reshuffled-07.cnf	? (exit code)	1199.37	1199.82	1727459
CRAFTED/parity-games/ instance_n8_i9_pp_ci_ce.cnf	? (exit code)	1199.37	1199.93	1737981
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-10-07-09.sat05-1282.reshuffled-07.cnf	? (exit code)	1199.38	1199.74	1728519
crafted/Difficult/contest05/others/ sgp_5-5-6.sat05-2675.reshuffled-07.cnf	? (exit code)	1199.39	1199.85	1730798
crafted/Hard/contest04/others/ Composite-064BitPrimes-1.sat05-506.reshuffled-07.cnf	? (exit code)	1199.39	1199.85	1726823
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-16-10-11.sat05-1253.reshuffled-07.cnf	? (exit code)	1199.41	1200.07	1728678
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.02-s1099787414.sat05-542.reshuffled-07.cnf	? (exit code)	1199.42	1199.84	1726717
CRAFTED/sgi/ new-difficult-24-193-22-70.cnf	? (exit code)	1199.42	1199.92	1738087
crafted/Difficult/contest05/others/ sgp_6-6-10.sat05-2670.reshuffled-07.cnf	? (exit code)	1199.43	1199.81	1730692
CRAFTED/sgen/unsat/ sgen1-unsat-151-100.cnf	? (exit code)	1199.43	1199.78	1737663
CRAFTED/modcircuits/ mod3block_3vars_9gates_restr.cnf	? (exit code)	1199.44	1199.97	1594737
crafted/Hard/contest03/others/ bqwh.40.reg.520.sat05-433.reshuffled-07.cnf	? (exit code)	1199.44	1200.07	1729261
CRAFTED/parity-games/ instance_n7_i8_pp_ci_ce.cnf	? (exit code)	1199.44	1199.74	1613289
crafted/Hard/contest03/others/ color-11-3.sat05-445.reshuffled-07.cnf	? (exit code)	1199.45	1199.81	1729102
CRAFTED/ramseycube/ Q32inK09.cnf	? (exit code)	1199.45	1200.06	1594699
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1000-m6860-k4-l4-s1935114289.sat05-523.reshuffled-07.cnf	? (exit code)	1199.46	1199.83	1731487
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1875077647.sat05-530.reshuffled-07.cnf	? (exit code)	1199.46	1208.44	1726399
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d-0.02-s383740539.sat05-534.reshuffled-07.cnf	? (exit code)	1199.46	1199.94	1726558
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n800-d0.04-s362703357.sat05-548.reshuffled-07.cnf	? (exit code)	1199.46	1200.06	1731434
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s111845174.sat05-536.reshuffled-07.cnf	? (exit code)	1199.47	1200.02	1726611
crafted/Difficult/contest05/QG/ QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf	? (exit code)	1199.48	1200.1	1729791
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1756632460.sat05-526.reshuffled-07.cnf	? (exit code)	1199.48	1199.8	1726505
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n600-d0.02-s1676244754.sat05-535.reshuffled-07.cnf	? (exit code)	1199.48	1200.05	1731540
CRAFTED/edgematching/ compact/em_7_4_8_cmp.cnf	? (exit code)	1199.48	1200.09	1731720
crafted/Medium/contest05/pebbling/ unsat-pbl-00090.sat05-1326.reshuffled-07.cnf	? (exit code)	1199.49	1199.93	1725445
crafted/Hard/contest02/ ezfact256_1.sat05-464.reshuffled-07.cnf	? (exit code)	1199.49	1199.84	1728731
CRAFTED/rbsat/crafted/ forced/rbsat-v1560c133795gyes9.cnf	? (exit code)	1199.49	1199.98	1595605
CRAFTED/sgen/unsat/ sgen1-unsat-145-100.cnf	? (exit code)	1199.49	1199.83	1594651
CRAFTED/edgematching/ compact/em_7_3_6_cmp.cnf	? (exit code)	1199.5	1199.86	1731705
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2_restricted.cnf	? (exit code)	1199.51	1199.94	1594709
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-2.sat05-2489.reshuffled-07.cnf	? (exit code)	1199.52	1199.89	1728201
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-01-S2069048075.sat05-488.reshuffled-07.cnf	? (exit code)	1199.53	1200.06	1729579
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s925928766.sat05-538.reshuffled-07.cnf	? (exit code)	1199.53	1200.5	1726452
crafted/Hard/contest03/others/ 999999000001nw.sat05-447.reshuffled-07.cnf	? (exit code)	1199.53	1199.86	1729208
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-02-S350203913.sat05-486.reshuffled-07.cnf	? (exit code)	1199.54	1199.88	1729473
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes8.cnf	? (exit code)	1199.55	1200.11	1595541
crafted/Difficult/contest05/others/ pmg-14-UNSAT.sat05-3942.reshuffled-07.cnf	? (exit code)	1199.56	1200.13	1730851
crafted/Hard/contest05/others/ linvrinv8.sat05-567.reshuffled-07.cnf	? (exit code)	1199.57	1200.13	1728095
CRAFTED/edgematching/ compact/em_8_4_5_cmp.cnf	? (exit code)	1199.58	1199.94	1731723
crafted/Hard/contest05/QG/ QG7-dead-dnd001.sat05-3419.reshuffled-07.cnf	? (exit code)	1199.58	1199.97	1727989
CRAFTED/sgi/ new-difficult-26-243-24-70.cnf	? (exit code)	1199.58	1200.19	1738246
crafted/Hard/contest03/others/ color-18-4.sat05-443.reshuffled-07.cnf	? (exit code)	1199.6	1199.61	1729367
crafted/Hard/contest05/QG/ QG7a-gensys-icl004.sat05-3825.reshuffled-07.cnf	? (exit code)	1199.6	1200.14	1727671
CRAFTED/edgematching/ all/em_11_3_4_all.cnf	? (exit code)	1199.6	1200.14	1731759
crafted/Difficult/contest-02-03-04/ contest02-ezfact64_10.sat05-449.reshuffled-07.cnf	? (exit code)	1199.6	1200.14	1731593
crafted/Difficult/contest05/sabharwal/ counting-easier-php-018-014.sat05-1175.reshuffled-07.cnf	? (exit code)	1199.61	1199.9	1730427
crafted/Hard/contest03/looksrandom/ hgen6-4-24-n650-03-S528656311.sat05-477.reshuffled-07.cnf	? (exit code)	1199.61	1200.12	1729632
crafted/Hard/contest05/counting-php/ easier-fphp-035-029.sat05-1221.reshuffled-07.cnf	? (exit code)	1199.62	1200.16	1728042
CRAFTED/edgematching/ compact/em_12_2_4_cmp.cnf	? (exit code)	1199.62	1200	1731708
crafted/Hard/contest05/others/ linvrinv9.sat05-568.reshuffled-07.cnf	? (exit code)	1199.62	1200.09	1728360
crafted/Hard/contest05/QG/ QG7-gensys-ukn003.sat05-3346.reshuffled-07.cnf	? (exit code)	1199.62	1200.17	1727830
CRAFTED/edgematching/ compact/em_14_7_3_cmp.cnf	? (exit code)	1199.63	1206.38	1731717
CRAFTED/modcircuits/ mod4block_2vars_10gates_u2_autoenc.cnf	? (exit code)	1199.64	1200.18	1594721
crafted/Hard/contest02/ ezfact64_3.sat05-450.reshuffled-07.cnf	? (exit code)	1199.64	1200.17	1728943
CRAFTED/rbsat/crafted/unforced/ rbsat-v1375c111739g2.cnf	? (exit code)	1199.64	1202.63	1595455
crafted/Hard/contest05/others/ strips-gripper-18t35.sat05-1147.reshuffled-07.cnf	? (exit code)	1199.64	1200.06	1728466
CRAFTED/rbsat/crafted/unforced/ rbsat-v1820c171155g4.cnf	? (exit code)	1199.64	1203.36	1595435
crafted/Hard/contest04/others/ Composite-096BitPrimes-0.sat05-507.reshuffled-07.cnf	? (exit code)	1199.65	1200.02	1727035
CRAFTED/rbsat/random/unforced/ rbsat-v1820c171155g3.cnf	? (exit code)	1199.66	1200.22	1595023
crafted/Hard/contest02/ hgen2-v500-s1216665065.sat05-467.reshuffled-07.cnf	? (exit code)	1199.66	1200.38	1728784
CRAFTED/modcircuits/ mod3block_2vars_10gates_u2_autoenc.cnf	? (exit code)	1199.66	1200.08	1594715
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2_autoenc.cnf	? (exit code)	1199.67	1200.1	1594717
CRAFTED/parity-games/ instance_n6_i7_pp_ci_ce.cnf	? (exit code)	1199.67	1200.24	1613313
crafted/Difficult/contest05/sabharwal/ counting-harder-php-018-017.sat05-1189.reshuffled-07.cnf	? (exit code)	1199.67	1200.21	1730533
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf	? (exit code)	1199.67	1200.28	1731328
crafted/Difficult/contest05/others/ pmg-13-UNSAT.sat05-3941.reshuffled-07.cnf	? (exit code)	1199.67	1200.26	1730586
CRAFTED/edgematching/ fbcolors/em_7_4_8_fbc.cnf	? (exit code)	1199.68	1200.05	1731783
crafted/Hard/contest04/others/ Composite-048BitPrimes-0.sat05-503.reshuffled-07.cnf	? (exit code)	1199.68	1200.22	1727088
crafted/Hard/contest05/QG/ QG7a-gensys-ukn002.sat05-3842.reshuffled-07.cnf	? (exit code)	1199.68	1200.22	1727777
crafted/Hard/contest02/ hgen3-v500-s1349121860.sat05-473.reshuffled-07.cnf	? (exit code)	1199.69	1200.19	1729049
crafted/Hard/contest04/others/ equilarge_l3.sat05-520.reshuffled-07.cnf	? (exit code)	1199.72	1200.08	1726770
crafted/Hard/contest03/looksrandom/ hgen7-n390-02-S178568232.sat05-479.reshuffled-07.cnf	? (exit code)	1199.72	1200.07	1729420
CRAFTED/rbsat/crafted/forced/ rbsat-v1150c84314gyes1.cnf	? (exit code)	1199.73	1200.25	1595659
crafted/Difficult/contest05/others/ linvrinv5.sat05-564.reshuffled-07.cnf	? (exit code)	1199.73	1200.26	1730745
crafted/Hard/contest04/others/ equilarge_l4.sat05-521.reshuffled-07.cnf	? (exit code)	1199.73	1200.19	1727194
crafted/Hard/contest02/ hgen3-v400-s553296708.sat05-471.reshuffled-07.cnf	? (exit code)	1199.73	1200.18	1728890
crafted/Difficult/contest05/QG/ QG6-dead-dnd002.sat05-2713.reshuffled-07.cnf	? (exit code)	1199.74	1200.18	1730109
CRAFTED/edgematching/ fbcolors/em_14_7_3_fbc.cnf	? (exit code)	1199.74	1203.14	1731774
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2.cnf	? (exit code)	1199.75	1200.21	1594725
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	? (exit code)	1199.77	1200.09	1594711
CRAFTED/edgematching/ fbcolors/em_11_3_4_fbc.cnf	? (exit code)	1199.77	1200.26	1731789
CRAFTED/edgematching/ fbcolors/em_9_3_5_fbc.cnf	? (exit code)	1199.78	1200.14	1731771
crafted/Hard/contest02/ hgen3-v400-s344840348.sat05-470.reshuffled-07.cnf	? (exit code)	1199.78	1200.4	1728837
CRAFTED/ edgematching/all/em_7_4_8_all.cnf	? (exit code)	1199.78	1200.27	1731765
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-luckySeven.used-as.sat04-990.sat05-4196.reshuffled-07.cnf	? (exit code)	1199.79	1200.38	1727247
crafted/Difficult/contest05/sabharwal/ counting-harder-php-014-013.sat05-1187.reshuffled-07.cnf	? (exit code)	1199.8	1200.31	1730480
CRAFTED/rbsat/random/ forced/rbsat-v1150c84314gyes3.cnf	? (exit code)	1199.82	1200.33	1595253

SAT 2009 Competition: main competition (phase 1): benchmarks results per solver

Result page for solver SAT07 reference solver: SATzilla CRAFTED (complete)

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (32 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (82 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (5 runs) [Show/Hide]

Solver timed out (no solution given) (15 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (147 runs) [Show/Hide]