SAT 2011 Competition: group-oriented MUS track: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
gmus/nadel/ edn_20403_8.cnf_0.03000000.unsat.gcnf	UNSAT	1.48477	8.01429	3500784
gmus/nadel/ edn_2948_6.cnf_0.12000000.unsat.gcnf	UNSAT	2.73358	7.36658	3500786
gmus/nadel/ edn_9789_2.cnf_0.07000000.unsat.gcnf	UNSAT	2.95455	4.70349	3500814
gmus/nadel/ edn_20403_16.cnf_0.29000000.unsat.gcnf	UNSAT	3.09453	2.42874	3500794
gmus/nadel/ edn_20403_10.cnf_0.03000000.unsat.gcnf	UNSAT	3.19451	2.73698	3500795
gmus/nadel/ edn_2948_8.cnf_0.25000000.unsat.gcnf	UNSAT	3.2445	3.46951	3500809
gmus/nadel/ edn_5371_4.cnf_0.21000000.unsat.gcnf	UNSAT	3.2895	2.84567	3500823
gmus/nadel/ edn_5371_6.cnf_0.30000000.unsat.gcnf	UNSAT	3.42948	5.15611	3500806
gmus/nadel/ edn_24095_8.cnf_0.21000000.unsat.gcnf	UNSAT	3.73543	4.49213	3500783
gmus/nadel/ edn_20259_8.cnf_0.39000000.unsat.gcnf	UNSAT	3.98739	4.27873	3500807
gmus/nadel/ edn_28491_8.cnf_0.39000000.unsat.gcnf	UNSAT	4.01539	3.63038	3500822
gmus/nadel/ edn_22134_8.cnf_0.38000000.unsat.gcnf	UNSAT	4.28335	3.6797	3500824
gmus/nadel/ edn_5371_8.cnf_0.39000000.unsat.gcnf	UNSAT	4.33934	4.19502	3500818
gmus/nadel/ edn_22134_10.cnf_0.47000000.unsat.gcnf	UNSAT	4.49532	4.95118	3500791
gmus/nadel/ edn_28491_10.cnf_0.46000000.unsat.gcnf	UNSAT	4.97124	5.05592	3500782
gmus/nadel/ edn_24095_10.cnf_0.29000000.unsat.gcnf	UNSAT	5.07823	4.80131	3500810
gmus/nadel/ edn_20403_12.cnf_0.08000000.unsat.gcnf	UNSAT	5.20621	4.56089	3500800
gmus/nadel/ edn_22134_12.cnf_0.50000000.unsat.gcnf	UNSAT	5.75312	5.31196	3500819
gmus/nadel/ edn_28491_12.cnf_0.50000000.unsat.gcnf	UNSAT	5.79512	5.35876	3500796
gmus/nadel/ edn_20259_12.cnf_0.50000000.unsat.gcnf	UNSAT	5.87711	5.38441	3500789
gmus/nadel/ edn_20259_14.cnf_0.55000000.unsat.gcnf	UNSAT	6.25105	5.88563	3500803
gmus/nadel/ edn_20403_14.cnf_0.10000000.unsat.gcnf	UNSAT	9.38257	8.82734	3500792
gmus/ belov/3pipe.gcnf	UNSAT	14.3368	13.4161	3500893
gmus/belov/ 2dlx_ca_mc_ex_bp_f_new.gcnf	UNSAT	16.5835	15.6812	3500935
gmus/nadel/ edn_25208_2.cnf_0.08000000.unsat.gcnf	UNSAT	24.8552	24.1583	3500802
gmus/belov/ 3pipe_1_ooo.gcnf	UNSAT	26.9449	25.5605	3500966
gmus/nadel/ edn_25208_4.cnf_0.05000000.unsat.gcnf	UNSAT	33.7789	36.2832	3500781
gmus/belov/ 3pipe_2_ooo.gcnf	UNSAT	37.8902	36.7992	3500843
gmus/belov/ 2dlx_cc_mc_ex_bp_f_new.gcnf	UNSAT	40.8648	39.499	3500930
gmus/belov/ 3pipe_3_ooo.gcnf	UNSAT	43.5184	42.5009	3500862
gmus/nadel/ edn_22134_4.cnf_0.14000000.unsat.gcnf	UNSAT	75.2766	77.8604	3500780
gmus/nadel/ edn_20403_23.cnf_14.27000000.unsat.gcnf	UNSAT	98.47	102.767	3500785
gmus/nadel/ edn_25208_6.cnf_0.20000000.unsat.gcnf	UNSAT	99.5699	98.7572	3500820
gmus/nadel/ edn_24095_4.cnf_0.11000000.unsat.gcnf	UNSAT	101.802	100.615	3500801
gmus/nadel/ edn_25208_8.cnf_0.30000000.unsat.gcnf	UNSAT	110.187	111.328	3500788
gmus/ belov/4pipe.gcnf	UNSAT	111.336	110.039	3500871
gmus/nadel/ edn_20259_6.cnf_0.31000000.unsat.gcnf	UNSAT	160.204	158.803	3500798
gmus/belov/ 4pipe_1_ooo.gcnf	UNSAT	177.911	176.382	3500962
gmus/belov/ pdtvisns3p19.aig.k20.gcnf	UNSAT	207.574	206.307	3500898
gmus/belov/ pdtpmsgoodbakery.aig.k15.gcnf	UNSAT	220.995	219.99	3500860
gmus/belov/ pdtvisns3p16.aig.k25.gcnf	UNSAT	222.209	220.709	3500884
gmus/nadel/ edn_25208_10.cnf_0.58000000.unsat.gcnf	UNSAT	231.04	230.837	3500787
gmus/nadel/ edn_9789_6.cnf_0.31000000.unsat.gcnf	UNSAT	237.512	236.163	3500793
gmus/belov/ pdtvisns3p19.aig.k25.gcnf	UNSAT	249.657	248.223	3500932
gmus/belov/ pdtvisrethersqo1.aig.k25.gcnf	UNSAT	268.084	266.568	3500899
gmus/belov/ pdtvisgigamax0.aig.k20.gcnf	UNSAT	273.738	272.288	3500840
gmus/nadel/ edn_28491_6.cnf_0.31000000.unsat.gcnf	UNSAT	287.24	286.443	3500816
gmus/belov/ pdtvisns3p18.aig.k25.gcnf	UNSAT	289.249	288.376	3500958
gmus/belov/ pdtvisgigamax4.aig.k20.gcnf	UNSAT	295.358	293.123	3500897
gmus/belov/ pdtvisns3p17.aig.k25.gcnf	UNSAT	300.626	298.746	3500887
gmus/belov/ pdtvisgigamax1.aig.k20.gcnf	UNSAT	307.034	305.182	3500885
gmus/belov/ pdtvisgigamax5.aig.k20.gcnf	UNSAT	315.858	313.593	3500895
gmus/belov/ pdtvisgigamax2.aig.k20.gcnf	UNSAT	316.377	313.9	3500839
gmus/belov/ mentorbm1p02.aig.k20.gcnf	UNSAT	320.582	318.152	3500934
gmus/belov/ pdtvisgigamax3.aig.k20.gcnf	UNSAT	329.04	326.259	3500953
gmus/belov/ pdtvispeterson.aig.k25.gcnf	UNSAT	364.551	362.777	3500853
gmus/belov/ pdtvisvsa16a29.aig.k25.gcnf	UNSAT	364.95	363.964	3500944
gmus/nadel/ edn_9789_12.cnf_0.93000000.unsat.gcnf	UNSAT	373.205	373.311	3500776
gmus/belov/ 4pipe_2_ooo.gcnf	UNSAT	376.506	374.975	3500874
gmus/belov/ pdtpmsgigamax.aig.k15.gcnf	UNSAT	383.521	381.474	3500852
gmus/belov/ pdtvisns3p10.aig.k15.gcnf	UNSAT	397.727	397.178	3500951
gmus/belov/ pdtvisgoodbakery0.aig.k15.gcnf	UNSAT	415.475	414.457	3500831
gmus/belov/ pdtswvibs16x4p2.aig.k25.gcnf	UNSAT	415.827	413.711	3500837
gmus/belov/ pdtvisbakery0.aig.k15.gcnf	UNSAT	416.452	415.139	3500912
gmus/nadel/ edn_22134_6.cnf_0.31000000.unsat.gcnf	UNSAT	426.967	426.713	3500821
gmus/belov/ pdtvisns2p3.aig.k15.gcnf	UNSAT	428.583	427.206	3500829
gmus/belov/ pdtvistimeout2.aig.k25.gcnf	UNSAT	432.837	431.686	3500832
gmus/belov/ 4pipe_4_ooo.gcnf	UNSAT	471.008	469.015	3500931
gmus/belov/ pj2003.aig.k20.gcnf	UNSAT	476.153	471.386	3500827
gmus/belov/ pdtswvibs8x8p1.aig.k25.gcnf	UNSAT	477.58	475.754	3500851
gmus/belov/ mentorbm1p00.aig.k20.gcnf	UNSAT	491.837	489.414	3500902
gmus/belov/ pdtvisgigamax1.aig.k25.gcnf	UNSAT	507.392	505.062	3500910
gmus/belov/ 4pipe_3_ooo.gcnf	UNSAT	546.173	544.203	3500838
gmus/belov/ pdtvisgigamax2.aig.k25.gcnf	UNSAT	557.493	554.842	3500901
gmus/belov/ pdtpmsvsa16a.aig.k10.gcnf	UNSAT	574.893	573.542	3500918
gmus/belov/ pdtvisgigamax3.aig.k25.gcnf	UNSAT	577.858	575.106	3500833
gmus/belov/ pdtvisns3p09.aig.k10.gcnf	UNSAT	583.538	580.907	3500922
gmus/belov/ pdtswvibs8x8p2.aig.k25.gcnf	UNSAT	596.756	596.02	3500891
gmus/belov/ pdtvisgigamax4.aig.k25.gcnf	UNSAT	606.03	603.256	3500830
gmus/belov/ kenflashp11.aig.k25.gcnf	UNSAT	607.128	604.662	3500861
gmus/belov/ pdtvisgigamax0.aig.k25.gcnf	UNSAT	611.021	608.457	3500866
gmus/nadel/ edn_9789_10.cnf_0.68000000.unsat.gcnf	UNSAT	626.955	625.857	3500817
gmus/nadel/ edn_5371_12.cnf_0.50000000.unsat.gcnf	UNSAT	642.26	640.69	3500790
gmus/belov/ pdtvisgigamax5.aig.k25.gcnf	UNSAT	650.347	646.673	3500947
gmus/belov/ bj08amba4g5.aig.k20.gcnf	UNSAT	699.244	696.589	3500927
gmus/belov/ mentorbm1p02.aig.k25.gcnf	UNSAT	715.452	711.431	3500965
gmus/belov/ pdtvistimeout3.aig.k20.gcnf	UNSAT	716.268	713.181	3500858
gmus/belov/ nusmvguidancep2.aig.k20.gcnf	UNSAT	785.327	783.05	3500955
gmus/nadel/ edn_24095_6.cnf_0.17000000.unsat.gcnf	UNSAT	792.58	790.896	3500812
gmus/nadel/ edn_9789_8.cnf_0.51000000.unsat.gcnf	UNSAT	796.109	796.965	3500811
gmus/belov/ intel005.aig.k20.gcnf	UNSAT	806.239	804.193	3500949
gmus/belov/ pdtvisns3p10.aig.k20.gcnf	UNSAT	857.777	856.442	3500939
gmus/belov/ pdtvisns2p0.aig.k15.gcnf	UNSAT	865.294	862.345	3500857
gmus/belov/ bjrb07amba2andenv.aig.k20.gcnf	UNSAT	869.909	866.715	3500886
gmus/belov/ pdtswvsam6x8p1.aig.k25.gcnf	UNSAT	913.316	911.543	3500876
gmus/belov/ mentorbm1p00.aig.k25.gcnf	UNSAT	1003.74	1000.55	3500878
gmus/belov/ bj08amba5g62.aig.k20.gcnf	UNSAT	1049.34	1046.86	3500940
gmus/belov/ pdtswvsam6x8p2.aig.k25.gcnf	UNSAT	1086.96	1083.6	3500954
gmus/belov/ pdtswvsam4x8p4.aig.k25.gcnf	UNSAT	1110.56	1107.86	3500959
gmus/belov/ nusmvguidancep8.aig.k20.gcnf	UNSAT	1140.54	1137.83	3500971
gmus/belov/ pdtswvsam4x8p2.aig.k25.gcnf	UNSAT	1149.63	1146.33	3500841
gmus/belov/ pdtvisgoodbakery2.aig.k20.gcnf	UNSAT	1167.71	1165.04	3500964
gmus/belov/ pdtswvrod6x8p1.aig.k20.gcnf	UNSAT	1169.5	1165.58	3500850
gmus/belov/ pdtvisbakery0.aig.k20.gcnf	UNSAT	1259.52	1257.67	3500957
gmus/belov/ bj08amba4g5.aig.k25.gcnf	UNSAT	1273.21	1269.6	3500942
gmus/belov/ pdtvistictactoe10.aig.k20.gcnf	UNSAT	1280.85	1276.93	3500906
gmus/belov/ pdtswvsam6x8p3.aig.k25.gcnf	UNSAT	1285.28	1283.61	3500924
gmus/belov/ pdtvisbakery2.aig.k20.gcnf	UNSAT	1304.31	1302.11	3500956
gmus/belov/ bjrb07amba4andenv.aig.k10.gcnf	UNSAT	1318.07	1314.08	3500915
gmus/belov/ bjrb07amba5andenv.aig.k10.gcnf	UNSAT	1409.95	1406.15	3500908
gmus/belov/ pdtvisns3p10.aig.k25.gcnf	UNSAT	1506.35	1505.38	3500928
gmus/belov/ pdtpmsrethersqo.aig.k20.gcnf	UNSAT	1579.6	1576.09	3500828
gmus/belov/ pj2007.aig.k20.gcnf	UNSAT	1679.02	1674.3	3500848
gmus/belov/ pdtvisgoodbakery1.aig.k20.gcnf	UNSAT	1747.11	1743.74	3500909
gmus/belov/ pdtvisbakery1.aig.k20.gcnf	UNSAT	1788.38	1785.31	3500826

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
gmus/belov/ pdtvisvending08.aig.k25.gcnf	No Cert.	675.934	672.484	3500926
gmus/belov/ pdtviscoherence5.aig.k15.gcnf	No Cert.	778.54	775.412	3500968
gmus/belov/ pdtvisvending07.aig.k25.gcnf	No Cert.	796.397	793.681	3500875
gmus/belov/ pdtvissoap2.aig.k15.gcnf	No Cert.	876.042	873.271	3500923
gmus/belov/ viscoherencep2.aig.k20.gcnf	No Cert.	887.32	884.906	3500859
gmus/belov/ pdtvisvending05.aig.k25.gcnf	No Cert.	889.358	886.423	3500867
gmus/belov/ pdtvisvending02.aig.k25.gcnf	No Cert.	932.879	930.059	3500849
gmus/belov/ pdtvistictactoe10.aig.k25.gcnf	No Cert.	964.828	962.468	3500873
gmus/belov/ pdtvistimeout3.aig.k25.gcnf	No Cert.	1040.36	1036.69	3500835
gmus/belov/ nusmvguidancep7.aig.k20.gcnf	No Cert.	1065.81	1062.87	3500863
gmus/belov/ pdtviseisenberg0.aig.k15.gcnf	No Cert.	1124.33	1121.63	3500881
gmus/belov/ pdtvisns3p07.aig.k10.gcnf	No Cert.	1151.31	1147.68	3500969
gmus/belov/ pdtpmsgigamax.aig.k25.gcnf	No Cert.	1232.78	1229.39	3500972
gmus/belov/ nusmvguidancep2.aig.k25.gcnf	No Cert.	1289.81	1286.78	3500937
gmus/belov/ bjrb07amba2andenv.aig.k25.gcnf	No Cert.	1339.82	1335.98	3500948
gmus/belov/ nusmvguidancep7.aig.k25.gcnf	No Cert.	1360.37	1358.42	3500896
gmus/belov/ nusmvguidancep6.aig.k25.gcnf	No Cert.	1384.57	1381.75	3500963
gmus/belov/ pdtswvtms10x8p1.aig.k20.gcnf	No Cert.	1453.28	1450.16	3500943
gmus/belov/ nusmvguidancep8.aig.k25.gcnf	No Cert.	1506.76	1502.92	3500864
gmus/belov/ pdtswvtms14x8p1.aig.k20.gcnf	No Cert.	1644.52	1641.17	3500914
gmus/belov/ pdtvisns2p1.aig.k15.gcnf	No Cert.	1650.25	1646.5	3500960
gmus/belov/ pdtviseisenberg2.aig.k20.gcnf	No Cert.	1656.77	1653.36	3500903
gmus/belov/ pdtswvrod6x8p1.aig.k25.gcnf	No Cert.	1707.11	1703.59	3500911
gmus/belov/ pdtvistimeout0.aig.k10.gcnf	No Cert.	1800.1	1798.38	3500945
gmus/belov/ vis4arbitp1.aig.k25.gcnf	No Cert.	1800.11	1798.65	3500952
gmus/belov/ pj2008.aig.k20.gcnf	No Cert.	1800.13	1794.91	3500854
gmus/nadel/ edn_5371_10.cnf_0.46000000.unsat.gcnf	No Cert.	1800.13	1797.7	3500813
gmus/belov/ pdtpmsgoodbakery.aig.k20.gcnf	No Cert.	1800.14	1797.51	3500879
gmus/nadel/ edn_2948_10.cnf_0.28000000.unsat.gcnf	No Cert.	1800.14	1800.69	3500777
gmus/belov/ pdtvisns3p01.aig.k10.gcnf	No Cert.	1800.14	1798.4	3500856
gmus/belov/ bj08amba5g62.aig.k25.gcnf	No Cert.	1800.15	1796.03	3500855
gmus/belov/ pj2010.aig.k25.gcnf	No Cert.	1800.15	1796.11	3500889
gmus/belov/ pdtvisns2p2.aig.k15.gcnf	No Cert.	1800.15	1798.32	3500869
gmus/belov/ pdtvisns3p02.aig.k10.gcnf	No Cert.	1800.16	1798.48	3500825
gmus/belov/ pdtpmsvsar.aig.k15.gcnf	No Cert.	1800.16	1798.11	3500865
gmus/belov/ pj2010.aig.k20.gcnf	No Cert.	1800.17	1797.83	3500842
gmus/belov/ bj08amba2g3f3.aig.k20.gcnf	No Cert.	1800.18	1797.89	3500844
gmus/belov/ pdtpmseisenberg.aig.k15.gcnf	No Cert.	1800.18	1797.79	3500847
gmus/nadel/ edn_20259_10.cnf_0.48000000.unsat.gcnf	No Cert.	1800.19	1798.1	3500804
gmus/nadel/ edn_24095_19.cnf_2.12000000.unsat.gcnf	No Cert.	1800.2	1797.34	3500778
gmus/belov/ pj2006.aig.k10.gcnf	No Cert.	1800.2	1795.52	3500936
gmus/nadel/ edn_25208_14.cnf_37.38000000.unsat.gcnf	No Cert.	1800.2	1797.33	3500799
gmus/belov/ pdtvisns3p00.aig.k10.gcnf	No Cert.	1800.21	1798.61	3500946
gmus/belov/ intel049.aig.k25.gcnf	No Cert.	1800.21	1797.93	3500868
gmus/belov/ pdtvisns3p09.aig.k15.gcnf	No Cert.	1800.23	1797.73	3500961
gmus/nadel/ edn_9789_21.cnf_46.05000000.unsat.gcnf	No Cert.	1800.23	1796.43	3500805
gmus/belov/ pdtvisns3p04.aig.k10.gcnf	No Cert.	1800.24	1797.07	3500880
gmus/nadel/ edn_2948_14.cnf_0.97000000.unsat.gcnf	No Cert.	1800.24	1797.84	3500808
gmus/belov/ pdtvisns2p3.aig.k20.gcnf	No Cert.	1800.24	1797.82	3500905
gmus/belov/ pdtswvtms14x8p1.aig.k25.gcnf	No Cert.	1800.24	1796.17	3500882
gmus/belov/ pdtvisgoodbakery0.aig.k20.gcnf	No Cert.	1800.24	1796	3500900
gmus/nadel/ edn_24095_17.cnf_4.40000000.unsat.gcnf	No Cert.	1800.25	1796.14	3500797
gmus/belov/ pdtviseisenberg0.aig.k20.gcnf	No Cert.	1800.25	1796.52	3500888
gmus/belov/ pdtvisns3p03.aig.k10.gcnf	No Cert.	1800.26	1798.75	3500919
gmus/belov/ pdtvisns3p08.aig.k10.gcnf	No Cert.	1800.26	1796.91	3500921
gmus/belov/ pdtpmsgigamax.aig.k20.gcnf	No Cert.	1800.26	1796.29	3500894
gmus/belov/ pj2007.aig.k25.gcnf	No Cert.	1800.27	1795.96	3500950
gmus/belov/ viscoherencep3.aig.k15.gcnf	No Cert.	1800.27	1797.1	3500883
gmus/belov/ pdtswvsam6x8p4.aig.k25.gcnf	No Cert.	1800.27	1797.18	3500917
gmus/belov/ pdtvisheap00.aig.k20.gcnf	No Cert.	1800.27	1797.08	3500892
gmus/belov/ pdtvisvending00.aig.k20.gcnf	No Cert.	1800.28	1797.87	3500846
gmus/belov/ pdtvisns3p06.aig.k10.gcnf	No Cert.	1800.28	1796.48	3500920
gmus/belov/ pdtvisgoodbakery0.aig.k25.gcnf	No Cert.	1800.28	1796.04	3500872
gmus/belov/ pdtviscoherence3.aig.k15.gcnf	No Cert.	1800.29	1795.88	3500907
gmus/belov/ pdtviseisenberg1.aig.k20.gcnf	No Cert.	1800.3	1795.94	3500870
gmus/belov/ viscoherencep3.aig.k20.gcnf	No Cert.	1800.3	1796.23	3500904
gmus/belov/ pdtvisns2p0.aig.k20.gcnf	No Cert.	1800.31	1797.14	3500845
gmus/belov/ pdtviscoherence4.aig.k15.gcnf	No Cert.	1800.31	1795.51	3500941
gmus/belov/ pdtpmsheap.aig.k15.gcnf	No Cert.	1800.32	1797.39	3500890
gmus/belov/ pdtviseisenberg2.aig.k15.gcnf	No Cert.	1800.33	1796.69	3500929
gmus/belov/ pdtvisns3p05.aig.k10.gcnf	No Cert.	1800.34	1795.1	3500970
gmus/belov/ pdtswvrod6x8p2.aig.k25.gcnf	No Cert.	1800.35	1796.94	3500916
gmus/belov/ nusmvguidancep5.aig.k20.gcnf	No Cert.	1800.36	1795.77	3500913
gmus/belov/ pdtswvtms12x8p1.aig.k20.gcnf	No Cert.	1800.36	1796.16	3500877
gmus/belov/ pdtvisgoodbakery2.aig.k25.gcnf	No Cert.	1800.38	1795.99	3500836
gmus/belov/ pdtvisvending01.aig.k15.gcnf	No Cert.	1800.39	1797.57	3500834
gmus/belov/ pdtvisns3p08.aig.k15.gcnf	No Cert.	1800.59	1797.9	3500967
gmus/belov/ pdtvisbakery1.aig.k25.gcnf	No Cert.	1800.94	1796.22	3500933

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
gmus/nadel/ edn_2948_4.cnf_0.07000000.unsat.gcnf	Wrong Cert.	3.59245	10.039	3500779
gmus/nadel/ edn_20259_4.cnf_0.21000000.unsat.gcnf	Wrong Cert.	104.658	104.597	3500815

SAT 2011 Competition: group-oriented MUS track: benchmarks results per solver

Result page for solver SAT4J MUS 2.3.0-SNAPSHOT 2011-02-06 (complete)

Category "GMUS" (GMUS)

Solver proved unsatisfiability (UNSATISFIABLE) (115 runs) [Show/Hide]

Solver timed out (no solution given) (1 run) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (1 run) [Show/Hide]

Solver answered SATISFIABLE but gave no complete certificate (78 runs) [Show/Hide]

Solver gave a wrong solution (2 runs) [Show/Hide]