SAT 2009 Competition: main competition (phase2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-12.sat05-2587.reshuffled-07.cnf	UNSAT	0.001998	0.00539992	1784757
CRAFTED/parity-games/ instance_n2_i2_pp.cnf	UNSAT	0.001998	0.00522991	1786161
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-14.sat05-2589.reshuffled-07.cnf	UNSAT	0.001998	0.00508592	1784763
CRAFTED/parity-games/ instance_n2_i3_pp.cnf	UNSAT	0.001999	0.00630907	1786125
CRAFTED/parity-games/ instance_n3_i4_pp_ci_ce.cnf	UNSAT	0.033994	0.033666	1786101
crafted/Medium/contest05/pebbling/ unsat-grid-pbl-0080.sat05-1344.reshuffled-07.cnf	UNSAT	1.35679	1.35813	1784679
CRAFTED/modcircuits/ owp_4vars_5gates.cnf	UNSAT	2.14267	2.14329	1785801
CRAFTED/sgen/unsat/ sgen1-unsat-61-100.cnf	UNSAT	3.06853	3.06902	1785585
CRAFTED/parity-games/ instance_n4_i5_pp.cnf	UNSAT	11.3973	11.4066	1786179
CRAFTED/parity-games/ instance_n5_i6_pp_ci_ce.cnf	UNSAT	15.7716	15.7852	1786113
crafted/Medium/contest05/pebbling/ unsat-pbl-00080.sat05-1325.reshuffled-07.cnf	UNSAT	15.9986	16.1096	1784673
crafted/Medium/contest05/sabharwal/ counting-clqcolor-unsat-set-b-clqcolor-08-06-07.sat05-1257.reshuffled-07.cnf	UNSAT	19.996	20.0435	1784655
crafted/Difficult/contest05/sabharwal/ gt-ordering-sat-gt-040.sat05-1297.reshuffled-07.cnf	UNSAT	23.0205	23.1162	1785219
CRAFTED/sgen/unsat/ sgen1-unsat-73-100.cnf	UNSAT	27.9627	28.0139	1785597
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf	UNSAT	30.8983	30.9099	1785201
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-060.sat05-1312.reshuffled-07.cnf	UNSAT	50.8403	50.8943	1785213
crafted/Medium/contest05/others/ QG7-gensys-icl001.sat05-2926.reshuffled-07.cnf	UNSAT	62.5055	62.5448	1784685
crafted/Medium/contest05/others/ QG8-gensys-ukn005.sat05-3584.reshuffled-07.cnf	UNSAT	76.7963	76.8825	1784727
crafted/Medium/contest05/others/ QG-gensys-icl003.sat05-2715.reshuffled-07.cnf	UNSAT	136.273	136.354	1784709
crafted/Medium/contest05/sabharwal/ counting-easier-php-012-010.sat05-1172.reshuffled-07.cnf	UNSAT	170.099	171.434	1784649
crafted/Medium/contest05/others/ QG-gensys-brn008.sat05-2685.reshuffled-07.cnf	UNSAT	189.295	184.537	1784715
CRAFTED/parity-games/ instance_n6_i7_pp_ci_ce.cnf	UNSAT	218.633	218.74	1786131
CRAFTED/sgen/unsat/ sgen1-unsat-85-100.cnf	UNSAT	305.394	305.496	1785573
crafted/Difficult/contest05/sabharwal/ grid-pebbling-unsat-grid-pbl-0300.sat05-1350.sat05-1350.reshuffled-07.cnf	UNSAT	337.05	337.292	1785225
crafted/Difficult/contest05/QG/ QG6-gensys-icl009.sat05-2721.reshuffled-07.cnf	UNSAT	387.162	387.343	1785171
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g4.cnf	UNSAT	456.264	456.394	1785897
crafted/Difficult/contest-02-03-04/ contest02-Mat26.sat05-457.reshuffled-07.cnf	UNSAT	616.347	616.598	1785369
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-gigamax.used-as.sat04-984.sat05-4194.reshuffled-07.cnf	UNSAT	717.596	718.026	1784877
crafted/Hard/contest05/QG/ QG7-dead-dnd005.sat05-3111.reshuffled-07.cnf	UNSAT	776.379	776.612	1784925
crafted/Difficult/contest05/QG/ QG6-gensys-icl004.sat05-2716.reshuffled-07.cnf	UNSAT	793.842	794.062	1785189
crafted/Difficult/contest05/QG/ QG7-gensys-icl006.sat05-3132.reshuffled-07.cnf	UNSAT	919.034	919.437	1785153
crafted/Medium/contest05/others/ pmg-11-UNSAT.sat05-3939.reshuffled-07.cnf	UNSAT	968.865	969.348	1784721
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1100-m7545-k4-l4-s310659001.sat05-524.reshuffled-07.cnf	UNSAT	1199.63	1200.15	1785339
crafted/Difficult/contest05/QG/ QG6-gensys-brn007.sat05-2684.reshuffled-07.cnf	UNSAT	1246.28	1246.91	1785165
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf	UNSAT	1305.99	1306.71	1785333
crafted/Hard/contest02/ pyhala-braun-unsat-40-4-02.sat05-459.reshuffled-07.cnf	UNSAT	1318.02	1318.79	1785069
crafted/Hard/contest04/others/ equilarge_l3.sat05-520.reshuffled-07.cnf	UNSAT	1389.85	1390.32	1784817
crafted/Difficult/contest05/QG/ QG6-gensys-icl001.sat05-2695.reshuffled-07.cnf	UNSAT	1522.08	1522.8	1785177
crafted/Difficult/contest05/QG/ QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf	UNSAT	1536.5	1537.01	1785159
crafted/Hard/contest04/others/ equilarge_l4.sat05-521.reshuffled-07.cnf	UNSAT	1652.5	1663.2	1784865
CRAFTED/sgen/unsat/ sgen1-unsat-97-100.cnf	UNSAT	1826.87	1827.42	1785567
crafted/Hard/contest04/others/ equilarge_l2.sat05-519.reshuffled-07.cnf	UNSAT	1838.18	1851.24	1784835
CRAFTED/ramseycube/ Q32inK09.cnf	UNSAT	2041.5	2042.4	1785705
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1000-m6860-k4-l4-s1935114289.sat05-523.reshuffled-07.cnf	UNSAT	2223.33	2224.26	1785351
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_3-dir.sat05-440.reshuffled-07.cnf	UNSAT	2227.28	2228.24	1785375
crafted/Hard/contest05/QG/ QG7-gensys-ukn003.sat05-3346.reshuffled-07.cnf	UNSAT	2332.63	2333.75	1784937
crafted/Hard/contest05/QG/ QG7-dead-dnd001.sat05-3419.reshuffled-07.cnf	UNSAT	2498.64	2500.51	1784955
crafted/Difficult/contest05/QG/ QG6-gensys-icl008.sat05-2720.reshuffled-07.cnf	UNSAT	2771.89	2773.15	1785183
crafted/Difficult/contest05/QG/ QG6-dead-dnd002.sat05-2713.reshuffled-07.cnf	UNSAT	2896.65	2897.86	1785195
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-10-07-09.sat05-1282.reshuffled-07.cnf	UNSAT	3092.89	3096.11	1785015
crafted/Hard/contest05/QG/ QG7a-gensys-icl004.sat05-3825.reshuffled-07.cnf	UNSAT	3883.69	3885.37	1784919
crafted/Difficult/contest05/others/ linvrinv5.sat05-564.reshuffled-07.cnf	UNSAT	4118.38	4120.26	1785267
crafted/Difficult/contest05/others/ pmg-12-UNSAT.sat05-3940.reshuffled-07.cnf	UNSAT	4873.61	4876.25	1785255

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-2.sat05-2159.reshuffled-07.cnf	SAT	0.008997	0.00982208	1784745
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf	SAT	0.009997	0.0104341	1784739
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf	SAT	0.010997	0.01059	1784733
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-250-3.sat05-2220.reshuffled-07.cnf	SAT	0.012997	0.0128221	1784769
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-2.sat05-2249.reshuffled-07.cnf	SAT	0.012997	0.0140389	1785297
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-2.sat05-2264.reshuffled-07.cnf	SAT	0.013997	0.014645	1785291
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-1.sat05-2248.reshuffled-07.cnf	SAT	0.013997	0.0173921	1785321
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-3.sat05-2265.reshuffled-07.cnf	SAT	0.014997	0.0155551	1785303
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-1.sat05-2263.reshuffled-07.cnf	SAT	0.014997	0.0146309	1785285
CRAFTED/parity-games/ instance_n3_i3_pp_ci_ce.cnf	SAT	0.036993	0.037563	1786107
CRAFTED/parity-games/ instance_n4_i4_pp.cnf	SAT	1.50177	1.50275	1786119
CRAFTED/sgi/ satsgi-n17himBHm20-p0-q146.cnf	SAT	5.00924	5.02051	1785843
CRAFTED/ramseycube/ Q3inK08.cnf	SAT	5.00924	5.01219	1785699
CRAFTED/sgi/ satsgi-n18himBHm21-p0-q167.cnf	SAT	5.01124	5.01823	1785861
CRAFTED/sgi/ satsgi-n19himBHm22-p0-q181.cnf	SAT	5.01124	5.01563	1785831
CRAFTED/sgi/ satsgi-n22himBHm24-p0-q209.cnf	SAT	5.01724	5.09442	1785837
CRAFTED/sgi/ satsgi-n22himBHm25-p0-q229.cnf	SAT	5.01724	5.02066	1785873
CRAFTED/sgi/ satsgi-n23himBHm27-p0-q251.cnf	SAT	5.01824	5.02128	1785885
CRAFTED/sgi/ satsgi-n23himBHm25-p0-q219.cnf	SAT	5.01824	5.02154	1785867
CRAFTED/sgi/ sgi-difficult4.cnf	SAT	5.01824	5.02737	1786077
CRAFTED/sgi/ satsgi-n23himBHm26-p0-q248.cnf	SAT	5.01924	5.02731	1785855
CRAFTED/sgi/ satsgi-n25himBHm27-p0-q251.cnf	SAT	5.02224	5.02527	1785849
CRAFTED/sgi/ satsgi-n25himBHm29-p0-q290.cnf	SAT	5.02423	5.02781	1785891
CRAFTED/sgi/ satsgi-n28himBHm30-p0-q333.cnf	SAT	5.03023	5.0398	1785879
CRAFTED/sgi/ sgi-difficult7.cnf	SAT	5.03523	5.04399	1786083
CRAFTED/ramseycube/ Q3inK09.cnf	SAT	5.05923	5.06233	1785663
CRAFTED/parity-games/ instance_n3_i3_pp.cnf	SAT	5.20021	5.20739	1786185
CRAFTED/ramseycube/ Q3inK10.cnf	SAT	5.30519	5.37531	1785681
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes4.cnf	SAT	5.61515	5.62801	1785951
CRAFTED/sgen/sat/ sgen1-sat-160-100.cnf	SAT	6.01708	6.07678	1785639
CRAFTED/ramseycube/ Q3inK11.cnf	SAT	6.02308	6.03718	1785711
CRAFTED/sgen/sat/ sgen1-sat-180-100.cnf	SAT	6.38003	6.38785	1785621
CRAFTED/ramseycube/ Q3inK12.cnf	SAT	8.07277	8.13345	1785687
CRAFTED/parity-games/ instance_n4_i4_pp_ci_ce.cnf	SAT	11.2103	11.2187	1786149
CRAFTED/parity-games/ instance_n5_i5_pp.cnf	SAT	11.3153	11.3294	1786137
CRAFTED/parity-games/ instance_n6_i6_pp.cnf	SAT	12.8071	12.8144	1786167
CRAFTED/sgi/ new-difficult-20-152-18-95.cnf	SAT	12.858	6.504	1786299
CRAFTED/parity-games/ instance_n5_i6_pp.cnf	SAT	13.209	13.2223	1786155
CRAFTED/modcircuits/ mod5block_1var_7gates.cnf	SAT	16.9604	16.9803	1785729
CRAFTED/edgematching/ compact/em_7_4_9_cmp.cnf	SAT	19.633	19.6543	1785381
CRAFTED/parity-games/ instance_n6_i6_pp_ci_ce.cnf	SAT	20.7089	20.7313	1786191
CRAFTED/parity-games/ instance_n6_i7_pp.cnf	SAT	22.3656	22.3864	1786095
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g8.cnf	SAT	31.9851	32.0855	1785909
CRAFTED/parity-games/ instance_n7_i7_pp_ci_ce.cnf	SAT	32.0361	32.0591	1786143
CRAFTED/parity-games/ instance_n7_i7_pp.cnf	SAT	32.1611	32.1864	1786173
CRAFTED/parity-games/ instance_n8_i8_pp.cnf	SAT	38.7781	38.8274	1786263
CRAFTED/edgematching/ explicit/em_9_3_5_exp.cnf	SAT	43.6534	43.8064	1785435
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes1.cnf	SAT	43.7803	43.8188	1785969
crafted/Medium/contest05/sabharwal/ sat-strips-gripper-12t23.sat05-1144.reshuffled-07.cnf	SAT	44.2933	44.4195	1784661
CRAFTED/rbsat/random/ forced/rbsat-v760c43649gyes10.cnf	SAT	51.8331	51.8742	1785963
CRAFTED/edgematching/ explicit/em_7_4_9_exp.cnf	SAT	52.574	52.63	1785447
CRAFTED/edgematching/ explicit/em_8_4_5_exp.cnf	SAT	54.2977	54.3397	1785459
CRAFTED/edgematching/ explicit/em_7_3_6_exp.cnf	SAT	54.8867	56.185	1785465
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g10.cnf	SAT	63.6723	63.7197	1785933
CRAFTED/ edgematching/all/em_8_4_5_all.cnf	SAT	77.8682	77.9873	1785471
crafted/Medium/contest05/others/ QG7a-gensys-ukn001.sat05-3841.reshuffled-07.cnf	SAT	84.6351	84.8209	1784697
CRAFTED/ edgematching/all/em_7_4_9_all.cnf	SAT	86.5648	86.6663	1785501
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	SAT	100.144	100.196	1786287
crafted/Medium/contest05/others/ QG7a-gensys-brn004.sat05-3669.reshuffled-07.cnf	SAT	111.57	111.632	1784691
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-sat-210-3.sat05-2475.reshuffled-07.cnf	SAT	112.785	112.819	1785315
CRAFTED/ edgematching/all/em_7_3_6_all.cnf	SAT	133.137	133.25	1785489
crafted/Medium/contest05/others/ QG7a-gensys-ukn005.sat05-3845.reshuffled-07.cnf	SAT	149.325	149.419	1784703
CRAFTED/edgematching/ all/em_11_3_4_all.cnf	SAT	151.289	151.384	1785495
CRAFTED/sgi/ new-difficult-22-173-20-80.cnf	SAT	153.711	153.793	1786317
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g1.cnf	SAT	153.836	153.906	1785945
CRAFTED/parity-games/ instance_n7_i8_pp.cnf	SAT	162.463	162.557	1786197
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes6.cnf	SAT	179.903	179.97	1785975
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	SAT	185.08	185.187	1786257
CRAFTED/edgematching/ all/em_12_2_4_all.cnf	SAT	216.467	216.59	1785477
CRAFTED/parity-games/ instance_n8_i9_pp.cnf	SAT	231.26	231.348	1786269
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g10.cnf	SAT	311.5	311.645	1785927
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes9.cnf	SAT	409.227	409.386	1785987
crafted/Difficult/contest05/sabharwal/ grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf	SAT	418.709	418.903	1785207
crafted/Medium/contest05/jarvisalo/ mod2c-rand3bip-sat-190-3.sat05-2445.reshuffled-07.cnf	SAT	533.526	533.715	1784751
CRAFTED/edgematching/ explicit/em_11_3_4_exp.cnf	SAT	718.468	718.928	1785429
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes4.cnf	SAT	784.956	785.403	1785957
CRAFTED/edgematching/ fbcolors/em_7_3_6_fbc.cnf	SAT	802.585	802.871	1785531
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes1.cnf	SAT	1034.31	1034.73	1786059
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-1.sat05-2488.reshuffled-07.cnf	SAT	1165.45	1165.97	1784973
CRAFTED/edgematching/ explicit/em_12_2_4_exp.cnf	SAT	1197.73	1198.33	1785441
CRAFTED/edgematching/ all/em_14_7_3_all.cnf	SAT	1878.65	1879.36	1785483
CRAFTED/modcircuits/ mod3block_3vars_9gates_restr.cnf	SAT	2196.54	2197.65	1785819
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-2.sat05-2489.reshuffled-07.cnf	SAT	2265.63	2266.77	1784979
CRAFTED/sgi/ new-difficult-24-193-22-70.cnf	SAT	4914.56	4915.68	1786293

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes2.cnf	?	4999.27	5001.5	1786029
CRAFTED/rbsat/crafted/forced/ rbsat-v1150c84314gyes1.cnf	?	4999.29	5000.63	1786071
crafted/Hard/contest05/QG/ QG7-gensys-icl100.sat05-3226.reshuffled-07.cnf	?	4999.32	5001.49	1784943
CRAFTED/edgematching/ compact/em_9_3_5_cmp.cnf	?	4999.33	5001.26	1785399
CRAFTED/rbsat/random/unforced/ rbsat-v2640c305320g2.cnf	?	4999.55	5001.43	1785921
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes2.cnf	?	4999.55	5001.96	1785993
CRAFTED/rbsat/crafted/unforced/ rbsat-v1375c111739g2.cnf	?	4999.57	5001.67	1786023
CRAFTED/rbsat/crafted/ forced/rbsat-v1560c133795gyes9.cnf	?	4999.62	5001.71	1786065
CRAFTED/rbsat/random/unforced/ rbsat-v2640c305320g6.cnf	?	4999.79	5002.39	1785903
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes8.cnf	?	4999.91	5001.91	1786053
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g5.cnf	?	4999.93	5002.31	1786017

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/rbsat/crafted/unforced/ rbsat-v2640c305320g4.cnf	? (TO)	5000.05	5002.91	1786005
crafted/Hard/contest05/others/ sgp_9-8-8.sat05-2674.reshuffled-07.cnf	? (TO)	5000.06	5002.84	1785003
crafted/Hard/contest04/others/ CompositeRSA576.sat05-509.reshuffled-07.cnf	? (TO)	5000.06	5001.53	1784841
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-25-18-23.sat05-1287.reshuffled-07.cnf	? (TO)	5000.09	5002.11	1785021
CRAFTED/ramseycube/ Q3inK13.cnf	? (TO)	5000.09	5002.75	1785669
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-all.used-as.sat04-986.sat05-4198.reshuffled-07.cnf	? (TO)	5000.12	5001.44	1784907
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l1.used-as.sat04-893.sat05-4187.reshuffled-07.cnf	? (TO)	5000.13	5002.13	1784913
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-FIFO.used-as.sat04-991.sat05-4192.reshuffled-07.cnf	? (TO)	5000.15	5002.14	1784901

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Difficult/contest05/others/ sgp_6-6-10.sat05-2670.reshuffled-07.cnf	? (MO)	3582.15	3583.77	1785261

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Hard/contest05/others/ eulcbip-8-UNSAT.sat05-3937.reshuffled-07.cnf	? (exit code)	4998.21	5000.61	1784985
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-myciel6-cn.used-as.sat04-319.sat05-4201.reshuffled-07.cnf	? (exit code)	4998.33	4999.87	1784889
crafted/Hard/contest03/others/ hwb-n32-01-S1491788039.sat05-497.reshuffled-07.cnf	? (exit code)	4998.33	5000.59	1785087
CRAFTED/edgematching/ fbcolors/em_8_4_5_fbc.cnf	? (exit code)	4998.34	5000.74	1785513
crafted/Hard/contest03/others/ hwb-n28-01-S136611085.sat05-491.reshuffled-07.cnf	? (exit code)	4998.35	5001.04	1785105
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-unsat-120-3.sat05-2340.reshuffled-07.cnf	? (exit code)	4998.37	5000.83	1785327
CRAFTED/modcircuits/ mod3block_2vars_9gates_u2_autoenc.cnf	? (exit code)	4998.37	5000.47	1785795
CRAFTED/sgen/sat/ sgen1-sat-300-100.cnf	? (exit code)	4998.39	5000.58	1785645
CRAFTED/modcircuits/ mod3_4vars_6gates.cnf	? (exit code)	4998.39	4999.89	1785777
crafted/Difficult/contest05/jarvisalo/ mod2c-3cage-unsat-10-3.sat05-2568.reshuffled-07.cnf	? (exit code)	4998.39	4999.85	1785309
crafted/Hard/contest05/QG/ QG7a-gensys-ukn009.sat05-3849.reshuffled-07.cnf	? (exit code)	4998.43	4999.8	1784949
CRAFTED/sgen/sat/ sgen1-sat-250-100.cnf	? (exit code)	4998.43	5000.73	1786221
crafted/Hard/contest03/looksrandom/ hgen8-n320-01-S1432474240.sat05-483.reshuffled-07.cnf	? (exit code)	4998.43	5000.31	1785147
CRAFTED/sgen/sat/ sgen1-sat-290-100.cnf	? (exit code)	4998.44	5000.61	1786215
CRAFTED/sgen/sat/ sgen1-sat-280-100.cnf	? (exit code)	4998.44	5000.74	1785615
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	? (exit code)	4998.44	5000.39	1785807
CRAFTED/sgen/sat/ sgen1-sat-270-100.cnf	? (exit code)	4998.44	5000.76	1786239
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	? (exit code)	4998.46	5000.6	1786323
crafted/Hard/contest03/looksrandom/ hgen8-n320-02-S1127428711.sat05-484.reshuffled-07.cnf	? (exit code)	4998.46	5000.82	1785129
CRAFTED/sgen/unsat/ sgen1-unsat-109-100.cnf	? (exit code)	4998.47	5000.89	1785561
CRAFTED/sgen/sat/ sgen1-sat-240-100.cnf	? (exit code)	4998.5	5001.25	1785651
CRAFTED/sgen/unsat/ sgen1-unsat-103-100.cnf	? (exit code)	4998.5	5000.55	1786251
CRAFTED/sgen/sat/ sgen1-sat-220-100.cnf	? (exit code)	4998.51	5000.67	1785633
CRAFTED/sgen/sat/ sgen1-sat-260-100.cnf	? (exit code)	4998.51	5000.75	1785609
CRAFTED/edgematching/ fbcolors/em_12_2_4_fbc.cnf	? (exit code)	4998.52	5000.1	1785549
CRAFTED/sgi/ new-difficult-28-302-26-75.cnf	? (exit code)	4998.52	5001.14	1786329
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2_autoenc.cnf	? (exit code)	4998.53	5000.6	1785813
CRAFTED/sgen/sat/ sgen1-sat-230-100.cnf	? (exit code)	4998.53	5000.84	1786227
CRAFTED/sgen/unsat/ sgen1-unsat-115-100.cnf	? (exit code)	4998.54	5001.01	1786209
crafted/Hard/contest04/others/ Composite-048BitPrimes-1.sat05-504.reshuffled-07.cnf	? (exit code)	4998.57	5000.54	1784859
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2_restricted.cnf	? (exit code)	4998.6	5000.94	1785735
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_m3.used-as.sat04-900.sat05-4186.reshuffled-07.cnf	? (exit code)	4998.6	5000.03	1784895
CRAFTED/sgen/sat/ sgen1-sat-200-100.cnf	? (exit code)	4998.61	5000.74	1785657
crafted/Hard/contest05/counting-clq/ unsat-set-b-clqcolor-16-11-14.sat05-1261.reshuffled-07.cnf	? (exit code)	4998.61	5000.07	1785027
CRAFTED/parity-games/ instance_n9_i9_pp_ci_ce.cnf	? (exit code)	4998.63	5000.95	1786275
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2.cnf	? (exit code)	4998.64	5001.24	1785717
crafted/Hard/contest05/others/ sgp_5-6-8.sat05-2669.reshuffled-07.cnf	? (exit code)	4998.65	5000.22	1784991
CRAFTED/sgen/unsat/ sgen1-unsat-121-100.cnf	? (exit code)	4998.65	5001.1	1785603
CRAFTED/sgen/sat/ sgen1-sat-140-100.cnf	? (exit code)	4998.66	5000.62	1785627
crafted/Hard/contest04/others/ Composite-096BitPrimes-0.sat05-507.reshuffled-07.cnf	? (exit code)	4998.66	5000.89	1784847
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes8.cnf	? (exit code)	4998.67	5001.11	1786047
CRAFTED/parity-games/ instance_n8_i9_pp_ci_ce.cnf	? (exit code)	4998.67	5000.92	1786281
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	? (exit code)	4998.68	5000.47	1785825
CRAFTED/sgi/ new-difficult-21-168-19-90.cnf	? (exit code)	4998.71	5000.51	1786305
CRAFTED/ramseycube/ Q32inK11.cnf	? (exit code)	4998.71	5000.93	1785675
CRAFTED/parity-games/ instance_n7_i8_pp_ci_ce.cnf	? (exit code)	4998.71	5000.69	1786089
CRAFTED/edgematching/ compact/em_11_3_4_cmp.cnf	? (exit code)	4998.72	5000.93	1785405
CRAFTED/rbsat/crafted/forced/ rbsat-v1150c84314gyes2.cnf	? (exit code)	4998.72	5001.04	1786041
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2_restricted.cnf	? (exit code)	4998.72	5000.94	1785789
CRAFTED/sgen/unsat/ sgen1-unsat-127-100.cnf	? (exit code)	4998.72	5000.95	1786203
CRAFTED/sgen/unsat/ sgen1-unsat-133-100.cnf	? (exit code)	4998.72	5001.05	1785579
CRAFTED/sgen/unsat/ sgen1-unsat-151-100.cnf	? (exit code)	4998.73	5000.96	1786245
CRAFTED/modcircuits/ mod4block_2vars_11gates_u2_autoenc.cnf	? (exit code)	4998.74	5001.09	1785765
CRAFTED/edgematching/ fbcolors/em_11_3_4_fbc.cnf	? (exit code)	4998.77	5001.63	1785555
CRAFTED/sgen/unsat/ sgen1-unsat-145-100.cnf	? (exit code)	4998.77	5001.08	1785591
crafted/Hard/contest04/others/ ramsey.sat05-511.reshuffled-07.cnf	? (exit code)	4998.78	5000.94	1784829
crafted/Hard/contest04/others/ Composite-064BitPrimes-1.sat05-506.reshuffled-07.cnf	? (exit code)	4998.79	5000.83	1784823
CRAFTED/edgematching/ compact/em_14_7_3_cmp.cnf	? (exit code)	4998.79	5005.47	1785411
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	? (exit code)	4998.8	5000.34	1785741
crafted/Difficult/contest05/others/ sgp_5-5-6.sat05-2675.reshuffled-07.cnf	? (exit code)	4998.81	5001.19	1785273
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-16-10-11.sat05-1253.reshuffled-07.cnf	? (exit code)	4998.82	5001.15	1785033
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.02-s1099787414.sat05-542.reshuffled-07.cnf	? (exit code)	4998.85	5001.07	1784811
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n800-d0.04-s362703357.sat05-548.reshuffled-07.cnf	? (exit code)	4998.87	5001.07	1785345
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1756632460.sat05-526.reshuffled-07.cnf	? (exit code)	4998.87	5001.11	1784787
crafted/Hard/contest03/others/ bqwh.40.reg.520.sat05-433.reshuffled-07.cnf	? (exit code)	4998.87	5000.92	1785099
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s111845174.sat05-536.reshuffled-07.cnf	? (exit code)	4998.88	5000.36	1784799
CRAFTED/sgen/unsat/ sgen1-unsat-139-100.cnf	? (exit code)	4998.89	5001.34	1786233
CRAFTED/edgematching/ compact/em_7_3_6_cmp.cnf	? (exit code)	4998.9	5000.3	1785387
crafted/Hard/contest03/others/ color-11-3.sat05-445.reshuffled-07.cnf	? (exit code)	4998.9	5000.67	1785081
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n600-d0.02-s1676244754.sat05-535.reshuffled-07.cnf	? (exit code)	4998.9	5000.67	1785357
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.04-s736572600.sat05-546.reshuffled-07.cnf	? (exit code)	4998.91	5000.35	1784805
crafted/Hard/contest02/ ezfact256_1.sat05-464.reshuffled-07.cnf	? (exit code)	4998.91	5000.84	1785039
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-philo.used-as.sat04-988.sat05-4195.reshuffled-07.cnf	? (exit code)	4998.91	5001.2	1784883
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1875077647.sat05-530.reshuffled-07.cnf	? (exit code)	4998.92	5000.52	1784775
crafted/Medium/contest05/pebbling/ unsat-pbl-00090.sat05-1326.reshuffled-07.cnf	? (exit code)	4998.92	5001.09	1784667
CRAFTED/sgi/ new-difficult-26-243-24-70.cnf	? (exit code)	4998.92	5001.04	1786311
CRAFTED/edgematching/ compact/em_7_4_8_cmp.cnf	? (exit code)	4998.93	5000.52	1785417
CRAFTED/modcircuits/ mod3block_2vars_10gates_u2_autoenc.cnf	? (exit code)	4998.93	5001.24	1785753
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s925928766.sat05-538.reshuffled-07.cnf	? (exit code)	4998.95	5001.24	1784781
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d-0.02-s383740539.sat05-534.reshuffled-07.cnf	? (exit code)	4998.96	5000.34	1784793
CRAFTED/rbsat/crafted/unforced/ rbsat-v1375c111739g6.cnf	? (exit code)	4998.97	5001.38	1785999
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-02-S350203913.sat05-486.reshuffled-07.cnf	? (exit code)	4998.98	5001.11	1785123
crafted/Hard/contest03/others/ 999999000001nw.sat05-447.reshuffled-07.cnf	? (exit code)	4998.98	5001.54	1785093
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-01-S2069048075.sat05-488.reshuffled-07.cnf	? (exit code)	4998.98	5000.48	1785135
CRAFTED/rbsat/crafted/ forced/rbsat-v1820c171155gyes6.cnf	? (exit code)	4998.99	5000.32	1786035
crafted/Hard/contest03/looksrandom/ hgen6-4-24-n650-03-S528656311.sat05-477.reshuffled-07.cnf	? (exit code)	4999	5000.96	1785141
CRAFTED/edgematching/ compact/em_8_4_5_cmp.cnf	? (exit code)	4999.01	5001.74	1785423
crafted/Difficult/contest05/others/ pmg-14-UNSAT.sat05-3942.reshuffled-07.cnf	? (exit code)	4999.02	5000.85	1785279
crafted/Hard/contest04/others/ Composite-048BitPrimes-0.sat05-503.reshuffled-07.cnf	? (exit code)	4999.03	5000.5	1784853
crafted/Hard/contest05/others/ linvrinv8.sat05-567.reshuffled-07.cnf	? (exit code)	4999.03	5001.23	1784967
CRAFTED/edgematching/ explicit/em_7_4_8_exp.cnf	? (exit code)	4999.04	5001.33	1785453
crafted/Hard/contest05/others/ linvrinv9.sat05-568.reshuffled-07.cnf	? (exit code)	4999.04	5001.06	1784997
crafted/Difficult/contest-02-03-04/ contest02-ezfact64_10.sat05-449.reshuffled-07.cnf	? (exit code)	4999.05	5000.57	1785363
CRAFTED/rbsat/crafted/unforced/ rbsat-v1820c171155g4.cnf	? (exit code)	4999.06	5000.68	1786011
crafted/Difficult/contest05/sabharwal/ counting-harder-php-018-017.sat05-1189.reshuffled-07.cnf	? (exit code)	4999.06	5000.51	1785243
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2.cnf	? (exit code)	4999.06	5001.68	1785783
crafted/Difficult/contest05/sabharwal/ counting-easier-php-018-014.sat05-1175.reshuffled-07.cnf	? (exit code)	4999.06	5001.28	1785231
CRAFTED/modcircuits/ mod4block_2vars_10gates_u2_autoenc.cnf	? (exit code)	4999.07	5001.36	1785771
CRAFTED/modcircuits/ mod5block_2vars_12gates.cnf	? (exit code)	4999.07	5001.19	1785747
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2.cnf	? (exit code)	4999.08	5001.69	1785723
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2_autoenc.cnf	? (exit code)	4999.08	5000.89	1785759
crafted/Hard/contest02/ hgen2-v500-s1216665065.sat05-467.reshuffled-07.cnf	? (exit code)	4999.09	5000.35	1785045
crafted/Hard/contest02/ ezfact64_3.sat05-450.reshuffled-07.cnf	? (exit code)	4999.09	5000.53	1785063
crafted/Hard/contest05/counting-php/ easier-fphp-035-029.sat05-1221.reshuffled-07.cnf	? (exit code)	4999.09	5001.35	1784961
CRAFTED/edgematching/ fbcolors/em_14_7_3_fbc.cnf	? (exit code)	4999.11	5001.46	1785525
crafted/Hard/contest05/QG/ QG7a-gensys-ukn002.sat05-3842.reshuffled-07.cnf	? (exit code)	4999.11	5001.26	1784931
CRAFTED/edgematching/ fbcolors/em_7_4_8_fbc.cnf	? (exit code)	4999.11	5000.4	1785543
CRAFTED/rbsat/random/ forced/rbsat-v1150c84314gyes3.cnf	? (exit code)	4999.14	5000.97	1785981
CRAFTED/rbsat/random/unforced/ rbsat-v1820c171155g3.cnf	? (exit code)	4999.14	5001.54	1785915
crafted/Difficult/contest05/others/ pmg-13-UNSAT.sat05-3941.reshuffled-07.cnf	? (exit code)	4999.15	5001.11	1785249
crafted/Hard/contest03/looksrandom/ hgen7-n390-02-S178568232.sat05-479.reshuffled-07.cnf	? (exit code)	4999.16	5001.16	1785117
crafted/Hard/contest02/ hgen3-v400-s553296708.sat05-471.reshuffled-07.cnf	? (exit code)	4999.16	5001.16	1785057
crafted/Hard/contest02/ hgen3-v500-s1349121860.sat05-473.reshuffled-07.cnf	? (exit code)	4999.16	5001.79	1785075
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-luckySeven.used-as.sat04-990.sat05-4196.reshuffled-07.cnf	? (exit code)	4999.17	5000.52	1784871
crafted/Hard/contest05/others/ strips-gripper-18t35.sat05-1147.reshuffled-07.cnf	? (exit code)	4999.18	5000.5	1785009
crafted/Hard/contest02/ hgen3-v400-s344840348.sat05-470.reshuffled-07.cnf	? (exit code)	4999.19	5000.9	1785051
CRAFTED/edgematching/ fbcolors/em_7_4_9_fbc.cnf	? (exit code)	4999.2	5001.35	1785537
crafted/Hard/contest03/others/ color-18-4.sat05-443.reshuffled-07.cnf	? (exit code)	4999.22	5000.6	1785111
CRAFTED/edgematching/ compact/em_12_2_4_cmp.cnf	? (exit code)	4999.22	5001.52	1785393
CRAFTED/ramseycube/ Q32inK10.cnf	? (exit code)	4999.22	5001.23	1785693
crafted/Difficult/contest05/sabharwal/ counting-harder-php-014-013.sat05-1187.reshuffled-07.cnf	? (exit code)	4999.24	5002.01	1785237
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g2.cnf	? (exit code)	4999.24	5001.46	1785939
CRAFTED/ edgematching/all/em_7_4_8_all.cnf	? (exit code)	4999.26	5000.84	1785507
CRAFTED/edgematching/ fbcolors/em_9_3_5_fbc.cnf	? (exit code)	4999.27	5001.24	1785519

SAT 2009 Competition: main competition (phase2): benchmarks results per solver

Result page for solver SAT07 reference solver: SATzilla CRAFTED (complete)

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (53 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (84 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (11 runs) [Show/Hide]

Solver timed out (no solution given) (8 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (1 run) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (124 runs) [Show/Hide]