SAT 2009 Competition: main competition (phase2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/parity-games/ instance_n2_i2_pp.cnf	UNSAT	0.003998	0.00574299	1825547
CRAFTED/parity-games/ instance_n2_i3_pp.cnf	UNSAT	0.005998	0.00679011	1825541
CRAFTED/parity-games/ instance_n3_i4_pp_ci_ce.cnf	UNSAT	0.026995	0.0295159	1825537
CRAFTED/modcircuits/ owp_4vars_5gates.cnf	UNSAT	0.382941	0.383365	1825487
CRAFTED/parity-games/ instance_n4_i5_pp.cnf	UNSAT	0.52092	0.522695	1825550
crafted/Medium/contest05/pebbling/ unsat-grid-pbl-0080.sat05-1344.reshuffled-07.cnf	UNSAT	1.3218	1.32873	1824916
CRAFTED/parity-games/ instance_n5_i6_pp_ci_ce.cnf	UNSAT	2.89956	2.90174	1825539
CRAFTED/sgen/unsat/ sgen1-unsat-61-100.cnf	UNSAT	3.11253	3.12049	1825451
crafted/Difficult/contest05/sabharwal/ grid-pebbling-unsat-grid-pbl-0300.sat05-1350.sat05-1350.reshuffled-07.cnf	UNSAT	8.83366	8.84336	1825007
crafted/Medium/contest05/sabharwal/ counting-clqcolor-unsat-set-b-clqcolor-08-06-07.sat05-1257.reshuffled-07.cnf	UNSAT	10.9153	10.9291	1824912
CRAFTED/sgen/unsat/ sgen1-unsat-73-100.cnf	UNSAT	28.6316	28.646	1825453
crafted/Medium/contest05/others/ QG7-gensys-icl001.sat05-2926.reshuffled-07.cnf	UNSAT	37.3383	37.3596	1824917
crafted/Medium/contest05/pebbling/ unsat-pbl-00080.sat05-1325.reshuffled-07.cnf	UNSAT	38.1902	38.2257	1824915
CRAFTED/ramseycube/ Q32inK09.cnf	UNSAT	46.9079	46.9282	1825471
crafted/Medium/contest05/others/ QG-gensys-brn008.sat05-2685.reshuffled-07.cnf	UNSAT	58.4461	58.4885	1824922
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-14.sat05-2589.reshuffled-07.cnf	UNSAT	67.7137	67.7551	1824930
crafted/Medium/contest05/others/ QG-gensys-icl003.sat05-2715.reshuffled-07.cnf	UNSAT	77.4112	77.4596	1824921
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-12.sat05-2587.reshuffled-07.cnf	UNSAT	97.5352	97.5648	1824929
crafted/Difficult/contest05/QG/ QG6-gensys-icl009.sat05-2721.reshuffled-07.cnf	UNSAT	101.071	101.124	1824998
crafted/Difficult/contest05/QG/ QG6-gensys-icl004.sat05-2716.reshuffled-07.cnf	UNSAT	119.813	119.877	1825001
crafted/Difficult/contest05/QG/ QG6-gensys-brn007.sat05-2684.reshuffled-07.cnf	UNSAT	139.607	139.655	1824997
crafted/Difficult/contest05/QG/ QG6-gensys-icl001.sat05-2695.reshuffled-07.cnf	UNSAT	142.142	142.205	1824999
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-unsat-120-3.sat05-2340.reshuffled-07.cnf	UNSAT	153.313	153.392	1825024
crafted/Difficult/contest05/QG/ QG6-dead-dnd002.sat05-2713.reshuffled-07.cnf	UNSAT	170.659	170.745	1825002
CRAFTED/ramseycube/ Q32inK10.cnf	UNSAT	173.573	173.675	1825469
CRAFTED/parity-games/ instance_n6_i7_pp_ci_ce.cnf	UNSAT	205.142	205.228	1825542
crafted/Medium/contest05/others/ QG8-gensys-ukn005.sat05-3584.reshuffled-07.cnf	UNSAT	207.099	207.156	1824924
crafted/Difficult/contest-02-03-04/ contest02-Mat26.sat05-457.reshuffled-07.cnf	UNSAT	249.137	249.209	1825031
crafted/Difficult/contest05/QG/ QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf	UNSAT	264.473	264.592	1824996
crafted/Medium/contest05/sabharwal/ counting-easier-php-012-010.sat05-1172.reshuffled-07.cnf	UNSAT	271.849	271.978	1824911
CRAFTED/sgen/unsat/ sgen1-unsat-85-100.cnf	UNSAT	287.84	287.976	1825449
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n600-d0.02-s1676244754.sat05-535.reshuffled-07.cnf	UNSAT	400.001	400.162	1825029
crafted/Difficult/contest05/QG/ QG6-gensys-icl008.sat05-2720.reshuffled-07.cnf	UNSAT	610.36	610.622	1825000
crafted/Hard/contest05/QG/ QG7-dead-dnd005.sat05-3111.reshuffled-07.cnf	UNSAT	737.429	737.818	1824957
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1100-m7545-k4-l4-s310659001.sat05-524.reshuffled-07.cnf	UNSAT	772.729	773.171	1825026
CRAFTED/ramseycube/ Q32inK11.cnf	UNSAT	816.218	816.465	1825466
crafted/Difficult/contest05/QG/ QG7-gensys-icl006.sat05-3132.reshuffled-07.cnf	UNSAT	856.162	856.585	1824995
crafted/Medium/contest05/others/ pmg-11-UNSAT.sat05-3939.reshuffled-07.cnf	UNSAT	887.27	887.729	1824923
crafted/Hard/contest05/QG/ QG7-dead-dnd001.sat05-3419.reshuffled-07.cnf	UNSAT	907.528	907.775	1824962
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n800-d0.04-s362703357.sat05-548.reshuffled-07.cnf	UNSAT	908.322	908.814	1825027
crafted/Hard/contest05/QG/ QG7a-gensys-icl004.sat05-3825.reshuffled-07.cnf	UNSAT	1019.41	1019.67	1824956
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-gigamax.used-as.sat04-984.sat05-4194.reshuffled-07.cnf	UNSAT	1027.32	1027.71	1824949
CRAFTED/sgen/unsat/ sgen1-unsat-97-100.cnf	UNSAT	1333.98	1334.6	1825448
CRAFTED/modcircuits/ mod3_4vars_6gates.cnf	UNSAT	1599.7	1600.46	1825483
crafted/Difficult/contest05/jarvisalo/ mod2c-3cage-unsat-10-3.sat05-2568.reshuffled-07.cnf	UNSAT	1753.37	1753.89	1825021
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1000-m6860-k4-l4-s1935114289.sat05-523.reshuffled-07.cnf	UNSAT	1755.91	1756.67	1825028
crafted/Medium/contest05/pebbling/ unsat-pbl-00090.sat05-1326.reshuffled-07.cnf	UNSAT	1806.77	1807.69	1824914
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s925928766.sat05-538.reshuffled-07.cnf	UNSAT	1823.98	1824.46	1824933
crafted/Hard/contest02/ pyhala-braun-unsat-40-4-02.sat05-459.reshuffled-07.cnf	UNSAT	1869.91	1870.68	1824981
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-luckySeven.used-as.sat04-990.sat05-4196.reshuffled-07.cnf	UNSAT	1881.23	1881.73	1824948
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf	UNSAT	2005.24	2005.77	1825025
crafted/Hard/contest05/QG/ QG7-gensys-ukn003.sat05-3346.reshuffled-07.cnf	UNSAT	2128.49	2129.44	1824959
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_3-dir.sat05-440.reshuffled-07.cnf	UNSAT	2197.93	2198.89	1825032
crafted/Difficult/contest05/others/ linvrinv5.sat05-564.reshuffled-07.cnf	UNSAT	2539.77	2540.5	1825014
crafted/Hard/contest03/others/ hwb-n28-01-S136611085.sat05-491.reshuffled-07.cnf	UNSAT	2622.09	2623.41	1824987
crafted/Hard/contest03/others/ 999999000001nw.sat05-447.reshuffled-07.cnf	UNSAT	2707.42	2708.21	1824985
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g4.cnf	UNSAT	3328.11	3329.42	1825503
crafted/Hard/contest05/QG/ QG7-gensys-icl100.sat05-3226.reshuffled-07.cnf	UNSAT	4589.47	4590.98	1824960

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/ramseycube/ Q3inK08.cnf	SAT	0.015997	0.018055	1825470
CRAFTED/parity-games/ instance_n3_i3_pp.cnf	SAT	0.020996	0.0225581	1825551
CRAFTED/parity-games/ instance_n3_i3_pp_ci_ce.cnf	SAT	0.022996	0.0233181	1825538
CRAFTED/sgi/ satsgi-n17himBHm20-p0-q146.cnf	SAT	0.025995	0.027815	1825494
CRAFTED/sgi/ satsgi-n18himBHm21-p0-q167.cnf	SAT	0.029995	0.0314401	1825497
CRAFTED/sgi/ satsgi-n19himBHm22-p0-q181.cnf	SAT	0.035993	0.036637	1825492
CRAFTED/sgi/ satsgi-n22himBHm24-p0-q209.cnf	SAT	0.050991	0.051741	1825493
CRAFTED/sgi/ satsgi-n22himBHm25-p0-q229.cnf	SAT	0.052991	0.0541439	1825499
CRAFTED/sgi/ satsgi-n23himBHm25-p0-q219.cnf	SAT	0.056991	0.0591729	1825498
CRAFTED/sgi/ sgi-difficult4.cnf	SAT	0.05899	0.061734	1825533
CRAFTED/sgi/ satsgi-n23himBHm26-p0-q248.cnf	SAT	0.060989	0.0624781	1825496
CRAFTED/sgi/ satsgi-n23himBHm27-p0-q251.cnf	SAT	0.064989	0.0647929	1825501
CRAFTED/sgi/ satsgi-n25himBHm27-p0-q251.cnf	SAT	0.074987	0.076204	1825495
CRAFTED/sgi/ satsgi-n25himBHm29-p0-q290.cnf	SAT	0.083986	0.08403	1825502
CRAFTED/sgi/ satsgi-n28himBHm30-p0-q333.cnf	SAT	0.104983	0.107692	1825500
CRAFTED/parity-games/ instance_n4_i4_pp.cnf	SAT	0.104983	0.105867	1825540
CRAFTED/ramseycube/ Q3inK09.cnf	SAT	0.112982	0.112912	1825464
CRAFTED/sgi/ sgi-difficult7.cnf	SAT	0.12498	0.125225	1825534
CRAFTED/parity-games/ instance_n4_i4_pp_ci_ce.cnf	SAT	0.131979	0.131293	1825545
CRAFTED/ramseycube/ Q3inK10.cnf	SAT	0.538917	0.542508	1825467
CRAFTED/parity-games/ instance_n5_i5_pp.cnf	SAT	0.735887	0.737028	1825543
CRAFTED/parity-games/ instance_n6_i7_pp.cnf	SAT	1.07284	1.07839	1825536
CRAFTED/ramseycube/ Q3inK11.cnf	SAT	2.07069	2.07167	1825472
CRAFTED/parity-games/ instance_n6_i6_pp.cnf	SAT	2.29665	2.30173	1825548
CRAFTED/modcircuits/ mod5block_1var_7gates.cnf	SAT	2.90356	2.91643	1825475
crafted/Medium/contest05/sabharwal/ sat-strips-gripper-12t23.sat05-1144.reshuffled-07.cnf	SAT	3.3045	3.30976	1824913
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-2.sat05-2159.reshuffled-07.cnf	SAT	6.73897	6.74338	1824927
CRAFTED/ramseycube/ Q3inK12.cnf	SAT	7.01693	7.02618	1825468
CRAFTED/parity-games/ instance_n5_i6_pp.cnf	SAT	8.25874	8.26924	1825546
crafted/Medium/contest05/others/ QG7a-gensys-brn004.sat05-3669.reshuffled-07.cnf	SAT	12.883	12.8948	1824918
CRAFTED/ edgematching/all/em_7_4_9_all.cnf	SAT	13.475	13.4881	1825261
CRAFTED/ edgematching/all/em_8_4_5_all.cnf	SAT	13.8009	13.8116	1825256
crafted/Medium/contest05/jarvisalo/ mod2c-rand3bip-sat-190-3.sat05-2445.reshuffled-07.cnf	SAT	16.7085	16.7225	1824928
CRAFTED/edgematching/ explicit/em_9_3_5_exp.cnf	SAT	19.1901	19.2033	1825250
CRAFTED/edgematching/ explicit/em_8_4_5_exp.cnf	SAT	20.0639	20.0809	1825254
CRAFTED/edgematching/ explicit/em_7_4_9_exp.cnf	SAT	20.4849	20.4929	1825252
crafted/Medium/contest05/others/ QG7a-gensys-ukn005.sat05-3845.reshuffled-07.cnf	SAT	26.239	26.2508	1824920
CRAFTED/parity-games/ instance_n7_i7_pp.cnf	SAT	27.2689	27.3019	1825549
crafted/Medium/contest05/others/ QG7a-gensys-ukn001.sat05-3841.reshuffled-07.cnf	SAT	30.3594	30.3734	1824919
CRAFTED/sgi/ new-difficult-20-152-18-95.cnf	SAT	30.9993	31.0166	1825622
CRAFTED/edgematching/ fbcolors/em_7_4_9_fbc.cnf	SAT	36.8164	36.8282	1825267
CRAFTED/edgematching/ explicit/em_7_3_6_exp.cnf	SAT	39.9589	39.9772	1825255
CRAFTED/parity-games/ instance_n6_i6_pp_ci_ce.cnf	SAT	40.5838	40.6149	1825552
CRAFTED/parity-games/ instance_n7_i8_pp.cnf	SAT	40.8118	40.8397	1825553
CRAFTED/ edgematching/all/em_7_3_6_all.cnf	SAT	41.9646	41.9975	1825259
CRAFTED/edgematching/ all/em_14_7_3_all.cnf	SAT	45.987	46.0214	1825258
CRAFTED/edgematching/ explicit/em_11_3_4_exp.cnf	SAT	47.4658	47.4983	1825249
CRAFTED/parity-games/ instance_n8_i9_pp.cnf	SAT	55.8225	55.8644	1825617
CRAFTED/sgen/sat/ sgen1-sat-140-100.cnf	SAT	66.8998	66.9171	1825458
crafted/Difficult/contest05/others/ sgp_6-6-10.sat05-2670.reshuffled-07.cnf	SAT	83.4403	83.4975	1825013
CRAFTED/edgematching/ compact/em_7_4_9_cmp.cnf	SAT	90.8532	90.8882	1825241
CRAFTED/edgematching/ all/em_12_2_4_all.cnf	SAT	123.922	124.005	1825257
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes4.cnf	SAT	163.093	163.179	1825512
CRAFTED/edgematching/ all/em_11_3_4_all.cnf	SAT	198.528	198.617	1825260
CRAFTED/rbsat/random/ forced/rbsat-v760c43649gyes10.cnf	SAT	221.797	221.855	1825514
CRAFTED/edgematching/ compact/em_8_4_5_cmp.cnf	SAT	231.067	231.185	1825248
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf	SAT	231.969	232.027	1824926
CRAFTED/sgen/sat/ sgen1-sat-160-100.cnf	SAT	282.728	282.812	1825460
CRAFTED/edgematching/ explicit/em_7_4_8_exp.cnf	SAT	310.368	310.447	1825253
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-sat-210-3.sat05-2475.reshuffled-07.cnf	SAT	333.656	333.885	1825022
CRAFTED/ edgematching/all/em_7_4_8_all.cnf	SAT	335.251	335.328	1825262
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf	SAT	425.579	425.76	1824925
CRAFTED/sgi/ new-difficult-22-173-20-80.cnf	SAT	429.605	429.97	1825625
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-250-3.sat05-2220.reshuffled-07.cnf	SAT	459.742	459.871	1824931
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes1.cnf	SAT	681.698	681.616	1825530
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-1.sat05-2488.reshuffled-07.cnf	SAT	716.524	716.887	1824965
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes6.cnf	SAT	739.014	739.275	1825516
CRAFTED/sgen/sat/ sgen1-sat-180-100.cnf	SAT	743.62	743.994	1825457
CRAFTED/rbsat/random/forced/ rbsat-v760c43649gyes1.cnf	SAT	845.08	845.509	1825515
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g8.cnf	SAT	916.759	917.175	1825505
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-2.sat05-2489.reshuffled-07.cnf	SAT	1243.94	1244.47	1824966
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g10.cnf	SAT	1250.11	1250.43	1825508
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g10.cnf	SAT	1351.16	1351.52	1825509
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g1.cnf	SAT	1385.61	1386.29	1825511
CRAFTED/sgen/sat/ sgen1-sat-220-100.cnf	SAT	1435.2	1435.71	1825459
CRAFTED/sgi/ new-difficult-24-193-22-70.cnf	SAT	2077.12	2078.29	1825621
CRAFTED/parity-games/ instance_n8_i8_pp.cnf	SAT	2266.66	2267.76	1825616
CRAFTED/edgematching/ fbcolors/em_8_4_5_fbc.cnf	SAT	3032.62	3033.92	1825263
CRAFTED/edgematching/ explicit/em_12_2_4_exp.cnf	SAT	3151.7	3153.12	1825251
CRAFTED/modcircuits/ mod4block_2vars_11gates_u2_autoenc.cnf	SAT	3661.85	3663.28	1825481
CRAFTED/modcircuits/ mod3block_3vars_9gates_restr.cnf	SAT	3777.58	3779.24	1825490
CRAFTED/edgematching/ fbcolors/em_7_3_6_fbc.cnf	SAT	4088.42	4090.46	1825266
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	SAT	4103.58	4104.65	1825626

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/rbsat/crafted/unforced/ rbsat-v2640c305320g4.cnf	? (TO)	5000	5002.21	1825521
CRAFTED/modcircuits/ mod3block_2vars_10gates_u2_autoenc.cnf	? (TO)	5000.01	5002.21	1825479
CRAFTED/rbsat/random/unforced/ rbsat-v2640c305320g2.cnf	? (TO)	5000.01	5001.51	1825507
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2_restricted.cnf	? (TO)	5000.01	5001.41	1825476
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes8.cnf	? (TO)	5000.01	5002.31	1825529
CRAFTED/modcircuits/ mod5block_2vars_12gates.cnf	? (TO)	5000.01	5002.82	1825478
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes2.cnf	? (TO)	5000.01	5001.31	1825525
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2.cnf	? (TO)	5000.01	5001.91	1825474
CRAFTED/sgen/unsat/ sgen1-unsat-127-100.cnf	? (TO)	5000.02	5002.51	1825606
CRAFTED/rbsat/crafted/ forced/rbsat-v1560c133795gyes9.cnf	? (TO)	5000.02	5002.21	1825531
CRAFTED/edgematching/ compact/em_7_4_8_cmp.cnf	? (TO)	5000.02	5001.62	1825247
CRAFTED/rbsat/crafted/forced/ rbsat-v1150c84314gyes2.cnf	? (TO)	5000.02	5001.81	1825527
CRAFTED/modcircuits/ mod4block_2vars_9gates_u2_autoenc.cnf	? (TO)	5000.02	5001.72	1825489
crafted/Hard/contest04/others/ Composite-048BitPrimes-0.sat05-503.reshuffled-07.cnf	? (TO)	5000.02	5001.41	1824945
CRAFTED/rbsat/random/unforced/ rbsat-v2640c305320g6.cnf	? (TO)	5000.02	5002.11	1825504
CRAFTED/sgi/ new-difficult-26-243-24-70.cnf	? (TO)	5000.02	5002.11	1825624
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-25-18-23.sat05-1287.reshuffled-07.cnf	? (TO)	5000.02	5001.41	1824973
CRAFTED/edgematching/ compact/em_9_3_5_cmp.cnf	? (TO)	5000.02	5002.01	1825244
crafted/Hard/contest03/looksrandom/ hgen8-n320-01-S1432474240.sat05-483.reshuffled-07.cnf	? (TO)	5000.02	5002.11	1824994
CRAFTED/ramseycube/ Q3inK13.cnf	? (TO)	5000.02	5002.21	1825465
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l1.used-as.sat04-893.sat05-4187.reshuffled-07.cnf	? (TO)	5000.02	5001.81	1824955
crafted/Difficult/contest05/others/ pmg-13-UNSAT.sat05-3941.reshuffled-07.cnf	? (TO)	5000.02	5002.41	1825011
CRAFTED/edgematching/ fbcolors/em_7_4_8_fbc.cnf	? (TO)	5000.03	5001.82	1825268
CRAFTED/edgematching/ compact/em_7_3_6_cmp.cnf	? (TO)	5000.03	5002.11	1825242
CRAFTED/edgematching/ fbcolors/em_11_3_4_fbc.cnf	? (TO)	5000.03	5001.72	1825270
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-060.sat05-1312.reshuffled-07.cnf	? (TO)	5000.03	5002.61	1825005
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes4.cnf	? (TO)	5000.03	5001.41	1825513
CRAFTED/sgen/sat/ sgen1-sat-290-100.cnf	? (TO)	5000.03	5002.41	1825608
crafted/Difficult/contest-02-03-04/ contest02-ezfact64_10.sat05-449.reshuffled-07.cnf	? (TO)	5000.04	5002.01	1825030
crafted/Hard/contest03/looksrandom/ hgen8-n320-02-S1127428711.sat05-484.reshuffled-07.cnf	? (TO)	5000.04	5002.51	1824991
crafted/Difficult/contest05/sabharwal/ gt-ordering-sat-gt-040.sat05-1297.reshuffled-07.cnf	? (TO)	5000.04	5002.11	1825006
CRAFTED/sgen/sat/ sgen1-sat-260-100.cnf	? (TO)	5000.04	5002.31	1825455
crafted/Hard/contest05/counting-php/ easier-fphp-035-029.sat05-1221.reshuffled-07.cnf	? (TO)	5000.04	5002.21	1824963
CRAFTED/parity-games/ instance_n7_i7_pp_ci_ce.cnf	? (TO)	5000.04	5002.51	1825544
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes8.cnf	? (TO)	5000.04	5001.51	1825528
crafted/Hard/contest04/others/ Composite-096BitPrimes-0.sat05-507.reshuffled-07.cnf	? (TO)	5000.04	5002.82	1824944
crafted/Hard/contest05/QG/ QG7a-gensys-ukn009.sat05-3849.reshuffled-07.cnf	? (TO)	5000.04	5001.51	1824961
crafted/Hard/contest05/others/ linvrinv8.sat05-567.reshuffled-07.cnf	? (TO)	5000.04	5002.21	1824964
crafted/Hard/contest02/ hgen3-v400-s344840348.sat05-470.reshuffled-07.cnf	? (TO)	5000.04	5002.11	1824978
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1875077647.sat05-530.reshuffled-07.cnf	? (TO)	5000.04	5001.31	1824932
crafted/Hard/contest04/others/ Composite-064BitPrimes-1.sat05-506.reshuffled-07.cnf	? (TO)	5000.04	5002.21	1824940
CRAFTED/parity-games/ instance_n9_i9_pp_ci_ce.cnf	? (TO)	5000.04	5002.61	1825618
CRAFTED/edgematching/ compact/em_11_3_4_cmp.cnf	? (TO)	5000.04	5001.72	1825245
crafted/Hard/contest02/ ezfact256_1.sat05-464.reshuffled-07.cnf	? (TO)	5000.04	5001.81	1824976
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2.cnf	? (TO)	5000.04	5002.51	1825473
CRAFTED/sgi/ new-difficult-21-168-19-90.cnf	? (TO)	5000.05	5002.51	1825623
crafted/Hard/contest05/others/ eulcbip-8-UNSAT.sat05-3937.reshuffled-07.cnf	? (TO)	5000.05	5002.31	1824967
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-02-S350203913.sat05-486.reshuffled-07.cnf	? (TO)	5000.05	5001.31	1824990
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-10-07-09.sat05-1282.reshuffled-07.cnf	? (TO)	5000.05	5002.61	1824972
crafted/Difficult/contest05/sabharwal/ counting-harder-php-018-017.sat05-1189.reshuffled-07.cnf	? (TO)	5000.05	5002.41	1825010
crafted/Hard/contest05/others/ linvrinv9.sat05-568.reshuffled-07.cnf	? (TO)	5000.05	5002.21	1824969
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-16-10-11.sat05-1253.reshuffled-07.cnf	? (TO)	5000.05	5002.11	1824975
crafted/Hard/contest03/others/ color-11-3.sat05-445.reshuffled-07.cnf	? (TO)	5000.05	5002.91	1824983
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-1.sat05-2248.reshuffled-07.cnf	? (TO)	5000.05	5002.11	1825023
CRAFTED/edgematching/ fbcolors/em_9_3_5_fbc.cnf	? (TO)	5000.05	5001.31	1825264
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2_autoenc.cnf	? (TO)	5000.05	5002.31	1825480
crafted/Difficult/contest05/others/ sgp_5-5-6.sat05-2675.reshuffled-07.cnf	? (TO)	5000.05	5001.31	1825015
CRAFTED/sgen/unsat/ sgen1-unsat-151-100.cnf	? (TO)	5000.05	5002.11	1825613
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g2.cnf	? (TO)	5000.05	5002.51	1825510
CRAFTED/rbsat/crafted/ forced/rbsat-v1820c171155gyes6.cnf	? (TO)	5000.05	5002.82	1825526
CRAFTED/sgen/sat/ sgen1-sat-270-100.cnf	? (TO)	5000.05	5001.72	1825612
CRAFTED/sgen/unsat/ sgen1-unsat-109-100.cnf	? (TO)	5000.06	5001.31	1825447
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	? (TO)	5000.06	5001.31	1825615
crafted/Hard/contest04/others/ CompositeRSA576.sat05-509.reshuffled-07.cnf	? (TO)	5000.06	5001.41	1824943
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_m3.used-as.sat04-900.sat05-4186.reshuffled-07.cnf	? (TO)	5000.06	5001.91	1824952
CRAFTED/parity-games/ instance_n8_i9_pp_ci_ce.cnf	? (TO)	5000.06	5002.31	1825619
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	? (TO)	5000.06	5002.72	1825477
CRAFTED/rbsat/random/ forced/rbsat-v1150c84314gyes3.cnf	? (TO)	5000.06	5001.31	1825517
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes9.cnf	? (TO)	5000.06	5001.41	1825518
CRAFTED/parity-games/ instance_n7_i8_pp_ci_ce.cnf	? (TO)	5000.06	5001.51	1825535
crafted/Difficult/contest05/sabharwal/ counting-harder-php-014-013.sat05-1187.reshuffled-07.cnf	? (TO)	5000.06	5001.72	1825009
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.04-s736572600.sat05-546.reshuffled-07.cnf	? (TO)	5000.06	5001.91	1824937
CRAFTED/sgen/unsat/ sgen1-unsat-115-100.cnf	? (TO)	5000.06	5002.21	1825607
crafted/Hard/contest03/others/ bqwh.40.reg.520.sat05-433.reshuffled-07.cnf	? (TO)	5000.06	5001.32	1824986
CRAFTED/sgen/unsat/ sgen1-unsat-133-100.cnf	? (TO)	5000.06	5001.31	1825450
crafted/Difficult/contest05/others/ pmg-14-UNSAT.sat05-3942.reshuffled-07.cnf	? (TO)	5000.06	5001.51	1825016
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-all.used-as.sat04-986.sat05-4198.reshuffled-07.cnf	? (TO)	5000.06	5001.31	1824954
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-2.sat05-2264.reshuffled-07.cnf	? (TO)	5000.06	5001.41	1825018
CRAFTED/modcircuits/ mod3block_4vars_11gates_b2_restricted.cnf	? (TO)	5000.07	5002.61	1825485
CRAFTED/sgen/sat/ sgen1-sat-240-100.cnf	? (TO)	5000.07	5001.41	1825462
crafted/Hard/contest05/QG/ QG7a-gensys-ukn002.sat05-3842.reshuffled-07.cnf	? (TO)	5000.07	5002.21	1824958
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf	? (TO)	5000.07	5002.01	1825003
CRAFTED/modcircuits/ mod3block_2vars_9gates_u2_autoenc.cnf	? (TO)	5000.07	5002.61	1825486
CRAFTED/sgen/sat/ sgen1-sat-280-100.cnf	? (TO)	5000.07	5001.62	1825456
CRAFTED/edgematching/ fbcolors/em_12_2_4_fbc.cnf	? (TO)	5000.07	5002.61	1825269
CRAFTED/sgen/sat/ sgen1-sat-300-100.cnf	? (TO)	5000.07	5001.62	1825461
crafted/Hard/contest04/others/ equilarge_l4.sat05-521.reshuffled-07.cnf	? (TO)	5000.07	5002.11	1824947
crafted/Hard/contest05/others/ sgp_9-8-8.sat05-2674.reshuffled-07.cnf	? (TO)	5000.07	5001.72	1824970
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-01-S2069048075.sat05-488.reshuffled-07.cnf	? (TO)	5000.07	5002.11	1824992
crafted/Hard/contest04/others/ Composite-048BitPrimes-1.sat05-504.reshuffled-07.cnf	? (TO)	5000.07	5001.41	1824946
crafted/Hard/contest04/others/ equilarge_l3.sat05-520.reshuffled-07.cnf	? (TO)	5000.07	5001.51	1824939
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.02-s1099787414.sat05-542.reshuffled-07.cnf	? (TO)	5000.08	5002.51	1824938
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d-0.02-s383740539.sat05-534.reshuffled-07.cnf	? (TO)	5000.08	5001.41	1824935
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-philo.used-as.sat04-988.sat05-4195.reshuffled-07.cnf	? (TO)	5000.08	5001.72	1824950
CRAFTED/rbsat/crafted/unforced/ rbsat-v1820c171155g4.cnf	? (TO)	5000.08	5002.21	1825522
crafted/Hard/contest03/looksrandom/ hgen7-n390-02-S178568232.sat05-479.reshuffled-07.cnf	? (TO)	5000.08	5002.82	1824989
crafted/Hard/contest03/others/ color-18-4.sat05-443.reshuffled-07.cnf	? (TO)	5000.08	5002.61	1824988
crafted/Hard/contest05/others/ sgp_5-6-8.sat05-2669.reshuffled-07.cnf	? (TO)	5000.08	5001.72	1824968
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	? (TO)	5000.08	5001.81	1825620
crafted/Hard/contest05/counting-clq/ unsat-set-b-clqcolor-16-11-14.sat05-1261.reshuffled-07.cnf	? (TO)	5000.08	5001.31	1824974
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-3.sat05-2265.reshuffled-07.cnf	? (TO)	5000.08	5002.41	1825020
crafted/Difficult/contest05/sabharwal/ grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf	? (TO)	5000.08	5001.41	1825004
crafted/Hard/contest03/others/ hwb-n32-01-S1491788039.sat05-497.reshuffled-07.cnf	? (TO)	5000.08	5002.51	1824984
CRAFTED/sgen/unsat/ sgen1-unsat-139-100.cnf	? (TO)	5000.08	5001.62	1825611
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	? (TO)	5000.08	5001.81	1825491
CRAFTED/sgen/sat/ sgen1-sat-250-100.cnf	? (TO)	5000.09	5000.31	1825609
crafted/Hard/contest03/looksrandom/ hgen6-4-24-n650-03-S528656311.sat05-477.reshuffled-07.cnf	? (TO)	5000.09	5002.21	1824993
CRAFTED/modcircuits/ mod4block_2vars_10gates_u2_autoenc.cnf	? (TO)	5000.09	5001.41	1825482
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-myciel6-cn.used-as.sat04-319.sat05-4201.reshuffled-07.cnf	? (TO)	5000.09	5002.72	1824951
CRAFTED/modcircuits/ mod3block_4vars_12gates_b2.cnf	? (TO)	5000.09	5001.81	1825484
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1756632460.sat05-526.reshuffled-07.cnf	? (TO)	5000.09	5002.51	1824934
CRAFTED/rbsat/crafted/forced/ rbsat-v1150c84314gyes1.cnf	? (TO)	5000.09	5002.01	1825532
CRAFTED/rbsat/crafted/unforced/ rbsat-v1375c111739g6.cnf	? (TO)	5000.09	5002.72	1825520
crafted/Hard/contest04/others/ equilarge_l2.sat05-519.reshuffled-07.cnf	? (TO)	5000.09	5002.61	1824942
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-FIFO.used-as.sat04-991.sat05-4192.reshuffled-07.cnf	? (TO)	5000.09	4999.52	1824953
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes2.cnf	? (TO)	5000.09	5001.41	1825519
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g5.cnf	? (TO)	5000.09	5002.91	1825523
CRAFTED/rbsat/crafted/unforced/ rbsat-v1375c111739g2.cnf	? (TO)	5000.09	5001.81	1825524
crafted/Hard/contest05/others/ strips-gripper-18t35.sat05-1147.reshuffled-07.cnf	? (TO)	5000.09	5002.51	1824971
CRAFTED/edgematching/ compact/em_12_2_4_cmp.cnf	? (TO)	5000.09	5002.41	1825243
crafted/Hard/contest02/ hgen2-v500-s1216665065.sat05-467.reshuffled-07.cnf	? (TO)	5000.09	5001.31	1824977
crafted/Difficult/contest05/others/ pmg-12-UNSAT.sat05-3940.reshuffled-07.cnf	? (TO)	5000.09	5000.21	1825012
CRAFTED/sgen/unsat/ sgen1-unsat-145-100.cnf	? (TO)	5000.1	5002.31	1825452
CRAFTED/sgen/sat/ sgen1-sat-200-100.cnf	? (TO)	5000.1	5002.21	1825463
CRAFTED/sgi/ new-difficult-28-302-26-75.cnf	? (TO)	5000.1	5002.11	1825627
crafted/Hard/contest02/ ezfact64_3.sat05-450.reshuffled-07.cnf	? (TO)	5000.1	5002.11	1824980
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-2.sat05-2249.reshuffled-07.cnf	? (TO)	5000.1	5002.41	1825019
crafted/Difficult/contest05/sabharwal/ counting-easier-php-018-014.sat05-1175.reshuffled-07.cnf	? (TO)	5000.1	5002.21	1825008
CRAFTED/sgen/sat/ sgen1-sat-230-100.cnf	? (TO)	5000.1	5002.11	1825610
CRAFTED/sgen/unsat/ sgen1-unsat-103-100.cnf	? (TO)	5000.1	5002.41	1825614
CRAFTED/rbsat/random/unforced/ rbsat-v1820c171155g3.cnf	? (TO)	5000.1	5001.41	1825506
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s111845174.sat05-536.reshuffled-07.cnf	? (TO)	5000.11	5002.11	1824936
crafted/Hard/contest02/ hgen3-v400-s553296708.sat05-471.reshuffled-07.cnf	? (TO)	5000.11	5002.61	1824979
crafted/Hard/contest02/ hgen3-v500-s1349121860.sat05-473.reshuffled-07.cnf	? (TO)	5000.11	5002.61	1824982
CRAFTED/sgen/unsat/ sgen1-unsat-121-100.cnf	? (TO)	5000.11	5002.61	1825454
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-1.sat05-2263.reshuffled-07.cnf	? (TO)	5000.12	5002.01	1825017
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	? (TO)	5000.12	5002.11	1825488
crafted/Hard/contest04/others/ ramsey.sat05-511.reshuffled-07.cnf	? (TO)	5000.13	5001.81	1824941

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/edgematching/ fbcolors/em_14_7_3_fbc.cnf	? (MO)	1070.69	1071.01	1825265
CRAFTED/edgematching/ compact/em_14_7_3_cmp.cnf	? (MO)	2058.98	2059.91	1825246

SAT 2009 Competition: main competition (phase2): benchmarks results per solver

Result page for solver LySAT c/2009-03-20 (complete)

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (58 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (83 runs) [Show/Hide]

Solver timed out (no solution given) (138 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (2 runs) [Show/Hide]