SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3500_3500_30f1.shuffled.cnf	UNSAT	0.096985	0.021987	3439621
crafted/skvortsov/battleship/ battleship-5-8-unsat.cnf	UNSAT	0.249961	0.0534611	3438966
SAT05/crafted/sorge05/QG8/ gensys-ukn007.shuffled-as.sat05-3586.cnf	UNSAT	0.653899	0.145742	3439601
SAT03/handmade/bevan/cnf/ marg3x3add8.shuffled-as.sat03-1449.cnf	UNSAT	0.931858	0.131012	3439371
crafted/skvortsov/battleship/ battleship-6-9-unsat.cnf	UNSAT	1.14282	0.178642	3439006
SAT03/handmade/bevan/cnf/ marg3x3add8ch.shuffled-as.sat03-1448.cnf	UNSAT	2.74358	0.35618	3439376
crafted/skvortsov/ automata-synchronization/crn_11_99_u.cnf	UNSAT	3.22351	0.483507	3438891
SAT05/crafted/sabharwal05/counting/php/unsat/ easier/php-010-008.shuffled-as.sat05-1171.cnf	UNSAT	4.62829	0.59176	3439506
SAT05/crafted/sabharwal05/ordering/gt-ordering/ sat/gt-030.shuffled-as.sat05-1295.cnf	UNSAT	7.66683	0.999605	3439536
crafted/skvortsov/battleship/ battleship-10-10-unsat.cnf	UNSAT	8.71767	1.10582	3438946
SAT05/crafted/sabharwal05/planning/logistics/unsat/ logistics-rotate-07t5.shuffled-as.sat05-1137.cnf	UNSAT	23.9764	3.06038	3439496
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3900_3900_060.shuffled.cnf	UNSAT	29.5125	3.75484	3439626
SAT05/crafted/sorge05/QG6/ dead-dnd002.shuffled-as.sat05-2713.cnf	UNSAT	54.4537	6.84339	3439611
SAT05/crafted/sabharwal05/pebbling/grid-pebbling/unsat/ grid-pbl-0250.shuffled-as.sat05-1349.shuffled-as.sat05-1349.cnf	UNSAT	93.5538	11.9001	3439531
crafted/skvortsov/ automata-synchronization/rnd_100_28_u.cnf	UNSAT	174.031	21.8232	3438886
crafted/skvortsov/ automata-synchronization/rnd_150_29_u.cnf	UNSAT	270.154	33.8846	3438906
SAT02/handmade/chu-min-li/urquhart/ urquhart3_25bis.shuffled.cnf	UNSAT	291.404	36.5421	3439671
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-19_348.cnf	UNSAT	349.853	43.8808	3439121
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-20_381.cnf	UNSAT	359.232	45.1292	3439141
SAT02/handmade/zhang-lintao/ xor-chain/x1_40.shuffled.cnf	UNSAT	748.88	93.9588	3439666
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_401.cnf	UNSAT	1095.99	137.415	3439136
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-12_135.cnf	UNSAT	1123.68	140.802	3439216
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-20_390.cnf	UNSAT	1297.47	162.564	3439146
SAT03/handmade/markstrom/UNSATISFIABLE/ mm-2x2-6-6-s.1.shuffled-as.sat03-1499.cnf	UNSAT	1938.54	242.897	3439366
crafted/skvortsov/battleship/ battleship-11-11-unsat.cnf	UNSAT	2080.57	260.891	3438931
SAT05/crafted/roussel05/visbmc-PHNF/ phnf-size10-exclusive-philo.used-as.sat04-988.shuffled-as.sat05-4195.cnf	UNSAT	2174.06	273.08	3439546
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	UNSAT	3090.75	387.348	3438356
crafted/skvortsov/battleship/ battleship-12-12-unsat.cnf	UNSAT	3558.41	446.022	3438986
SAT05/crafted/sorge05/QG7a/ gensys-icl005.shuffled-as.sat05-3826.cnf	UNSAT	4444.07	556.988	3439566
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-5_528.cnf	UNSAT	5082.44	636.8	3439091
SAT05/crafted/sorge05/QG7/ gensys-icl007.shuffled-as.sat05-3133.cnf	UNSAT	8219.56	1028.71	3439591
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_406.cnf	UNSAT	8545.55	1070.87	3439156
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_1-log.shuffled-as.sat03-107.cnf	UNSAT	9314.29	1166.79	3439261
crafted/skvortsov/ automata-synchronization/crn_20_360_u.cnf	UNSAT	9350.27	1171.12	3438871
SAT05/crafted/sorge05/QG7/ dead-dnd003.shuffled-as.sat05-3109.cnf	UNSAT	9406.44	1176.69	3439596
crafted/skvortsov/battleship/ battleship-7-12-unsat.cnf	UNSAT	11004.7	1378.89	3438976
SAT05/crafted/sorge05/QG7a/ gensys-ukn003.shuffled-as.sat05-3843.cnf	UNSAT	12153.3	1522.82	3439581
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	UNSAT	12413.2	1555.84	3438351
SAT05/crafted/sorge05/QG7a/ gensys-ukn006.shuffled-as.sat05-3846.cnf	UNSAT	13582.8	1701.64	3439571
SAT05/crafted/sorge05/QG7a/ gensys-ukn004.shuffled-as.sat05-3844.cnf	UNSAT	14476.3	1813.11	3439576
SAT05/crafted/sorge05/QG7a/ gensys-ukn009.shuffled-as.sat05-3849.cnf	UNSAT	14974.5	1876.16	3439561
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_445.cnf	UNSAT	19053.1	2386.71	3439161
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-13_160.cnf	UNSAT	23717.1	2970.52	3439186
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_3-log.shuffled-as.sat03-109.cnf	UNSAT	27223	3407.91	3439336
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_5-log.shuffled-as.sat03-111.cnf	UNSAT	28031.9	3512.93	3439276
SAT03/handmade/anton/UNSAT/ SGI_30_70_19_80_8-log.shuffled-as.sat03-143.cnf	UNSAT	33096	4146.65	3439246
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_464.cnf	UNSAT	36681	4597	3439106

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/skvortsov/battleship/ battleship-12-23-sat.cnf	SAT	0.034994	0.015238	3438991
crafted/mosoi/ 289/289-sat-6x19.cnf	SAT	0.052991	0.0225869	3438716
crafted/mosoi/ 289/289-sat-6x20.cnf	SAT	0.052991	0.021159	3438771
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q225-n25-p30-s70617701.cnf	SAT	0.052991	0.022703	3439696
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q255-n25-p30-s39712998.cnf	SAT	0.05499	0.0224291	3439716
crafted/mosoi/289/ 289-sat-6x8.cnf	SAT	0.05799	0.0230281	3438841
crafted/mosoi/ 289/289-sat-11x9.cnf	SAT	0.061989	0.024511	3438851
crafted/skvortsov/battleship/ battleship-11-21-sat.cnf	SAT	0.067989	0.0142859	3439031
CRAFTED/sgi/ satsgi-n26himBHm28-p0-q293.cnf	SAT	0.067989	0.0222431	3438366
crafted/mosoi/289/ 289-sat-5x8.cnf	SAT	0.068988	0.023565	3438806
crafted/mosoi/289/ 289-sat-7x6.cnf	SAT	0.069988	0.0242509	3438801
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q225-n25-p15-s58217873.cnf	SAT	0.071988	0.0286911	3439731
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf	SAT	0.081987	0.0440939	3439676
crafted/skvortsov/battleship/ battleship-8-15-sat.cnf	SAT	0.085986	0.0220709	3438936
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q369.75-n30-p15-s59317012.cnf	SAT	0.089986	0.0372429	3439741
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf	SAT	0.089986	0.0524951	3439726
crafted/mosoi/ 289/289-sat-11x4.cnf	SAT	0.091985	0.0281839	3438831
SAT02/handmade/pehoushek/twentyvars/ 7cnf20_90000_90000_7.shuffled.cnf	SAT	0.098984	0.0254899	3439616
SAT05/crafted/sorge05/QG7/ iso-ukn004.shuffled-as.sat05-3385.cnf	SAT	0.107983	0.0322589	3439586
crafted/skvortsov/battleship/ battleship-10-19-sat.cnf	SAT	0.114982	0.022748	3439016
crafted/skvortsov/battleship/ battleship-7-13-sat.cnf	SAT	0.116981	0.026323	3439021
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q663-n40-p30-s67876261.cnf	SAT	0.128979	0.0748	3439776
crafted/mosoi/ 289/289-sat-14x8.cnf	SAT	0.130979	0.036325	3438766
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q841.5-n45-p30-s84954709.cnf	SAT	0.134978	0.108368	3439746
crafted/mosoi/289/ 289-sat-6x9.cnf	SAT	0.136978	0.033146	3438856
crafted/mosoi/289/ 289-sat-4x8.cnf	SAT	0.137978	0.0331069	3438731
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	SAT	0.140977	0.0364991	3438611
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf	SAT	0.153975	0.051672	3439801
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q585-n40-p30-s19690873.cnf	SAT	0.155975	0.0848049	3439811
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf	SAT	0.156975	0.0612591	3439756
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q663-n40-p15-s72490337.cnf	SAT	0.165974	0.087939	3439781
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q326.25-n30-p15-s44266159.cnf	SAT	0.166974	0.049258	3439786
crafted/mosoi/ 289/289-sat-12x14.cnf	SAT	0.172972	0.0469689	3438821
crafted/skvortsov/battleship/ battleship-9-17-sat.cnf	SAT	0.173972	0.031814	3439036
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf	SAT	0.177972	0.0688429	3439691
crafted/mosoi/ 289/289-sat-11x10.cnf	SAT	0.178972	0.0429621	3438796
CRAFTED/ramseycube/ Q3inK10.cnf	SAT	0.182971	0.113634	3438346
crafted/mosoi/ 289/289-sat-12x15.cnf	SAT	0.18597	0.054307	3438746
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q841.5-n45-p15-s16393788.cnf	SAT	0.196969	0.11144	3439771
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf	SAT	0.198968	0.151273	3439701
crafted/mosoi/ 289/289-sat-9x13.cnf	SAT	0.207967	0.066733	3438781
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q742.5-n45-p30-s17570390.cnf	SAT	0.255961	0.134665	3439721
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q742.5-n45-p15-s28972035.cnf	SAT	0.268958	0.13671	3439711
crafted/mosoi/ 289/289-sat-4x35.cnf	SAT	0.304953	0.0582301	3438736
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q918.75-n50-p15-s98191766.cnf	SAT	0.32195	0.182211	3439806
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q326.25-n30-p30-s48700942.cnf	SAT	0.340947	0.0753059	3439736
SAT05/crafted/sorge05/QG8/ iso-ukn009.shuffled-as.sat05-3632.cnf	SAT	0.340947	0.0672831	3439606
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1504.5-n60-p15-s80450670.cnf	SAT	0.365943	0.292622	3439706
SAT04/handmade/anton/l4k4/ lksat-n900-m6174-k4-l4-s819398222.used-as.sat04-929.cnf	SAT	0.425935	0.0669041	3439416
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf	SAT	0.464928	0.294122	3439761
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf	SAT	0.465928	0.34269	3439751
crafted/skvortsov/battleship/ battleship-17-33-sat.cnf	SAT	0.485925	0.087065	3439011
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1327.5-n60-p30-s52708253.cnf	SAT	0.52092	0.358143	3439681
SAT04/handmade/anton/l5k3/ lksat-n900-m3357-k3-l5-s950595579.used-as.sat04-938.cnf	SAT	0.890863	0.13449	3439411
crafted/skvortsov/battleship/ battleship-16-31-sat.cnf	SAT	0.97885	0.157084	3438926
crafted/skvortsov/battleship/ battleship-10-18-sat.cnf	SAT	1.02084	0.158157	3438956
crafted/skvortsov/battleship/ battleship-24-57-sat.cnf	SAT	1.62475	0.331551	3438941
SAT05/crafted/sorge05/QG7a/ gensys-brn002.shuffled-as.sat05-3935.cnf	SAT	4.21736	0.55916	3439556
crafted/spence/sgen/ sgen3-n120-s12930489-sat.cnf	SAT	4.69329	0.606873	3438686
SAT04/handmade/anton/l5k3/ lksat-n1100-m4103-k3-l5-s558351420.used-as.sat04-934.cnf	SAT	5.56815	0.737732	3439406
crafted/skvortsov/ automata-synchronization/crn_11_100_s.cnf	SAT	11.6172	1.4828	3438876
CRAFTED/ edgematching/all/em_8_4_5_all.cnf	SAT	14.4588	1.85213	3438336
crafted/skvortsov/ automata-synchronization/rnd_100_28_s.cnf	SAT	15.7836	2.00955	3438861
crafted/skvortsov/battleship/ battleship-10-17-sat.cnf	SAT	20.0719	2.5499	3438921
crafted/skvortsov/battleship/ battleship-14-27-sat.cnf	SAT	37.5403	4.74732	3438996
crafted/skvortsov/ automata-synchronization/rnd_150_42_s.cnf	SAT	50.3673	6.3374	3438866
crafted/skvortsov/ automata-synchronization/rnd_100_27_s.cnf	SAT	52.763	6.62402	3438901
crafted/skvortsov/ automata-synchronization/rnd_100_32_s.cnf	SAT	79.9548	10.0316	3438911
crafted/mosoi/289/ 289-unsat-6x30.cnf	SAT	120.932	15.272	3438726
SAT04/handmade/andrew/composite/ Composite-024BitPrimes-1.used-as.sat04-861.cnf	SAT	122.759	15.4221	3439441
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g7.cnf	SAT	131.124	16.519	3438416
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	SAT	160.048	20.2832	3438601
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g4.cnf	SAT	424.393	53.2326	3438381
crafted/spence/sgen/ sgen3-n140-s18527668-sat.cnf	SAT	525.685	65.8865	3438701
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g5.cnf	SAT	530.355	66.4663	3438396
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	SAT	729.747	91.7306	3438606
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-5_527.cnf	SAT	734.979	92.0993	3439076
CRAFTED/edgematching/ compact/em_7_3_6_cmp.cnf	SAT	867.659	108.754	3438321
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_399.cnf	SAT	1018.43	127.604	3439096
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_404.cnf	SAT	3335.3	417.92	3439116
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520.cnf	SAT	3470.66	434.855	3439461
SAT04/handmade/kexu/frb-0.8/ frb45-21-1.used-as.sat04-883.cnf	SAT	3604.46	451.535	3439391
crafted/skvortsov/ automata-synchronization/crn_20_361_s.cnf	SAT	4579.54	574.001	3438896
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes6.cnf	SAT	5204.04	651.706	3438571
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-2.shuffled-as.sat05-2534.cnf	SAT	6173.5	773.454	3439466
crafted/spence/sgen/ sgen3-n160-s40283905-sat.cnf	SAT	6351.99	795.661	3438616
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_443.cnf	SAT	6379.25	799.288	3439151
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-220-3.shuffled-as.sat05-2490.cnf	SAT	7166.1	897.545	3439476
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g7.cnf	SAT	7246.73	907.966	3438391
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-230-3.shuffled-as.sat05-2505.cnf	SAT	7863.9	985.167	3439486
CRAFTED/rbsat/random/ forced/rbsat-v1150c84314gyes1.cnf	SAT	12295.8	1539.75	3438501
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_505.cnf	SAT	12605.7	1579.81	3439166
CRAFTED/rbsat/crafted/unforced/ rbsat-v945c61409g3.cnf	SAT	14202.9	1779.12	3438521
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-1.shuffled-as.sat05-2533.cnf	SAT	16712.8	2093.42	3439491
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q255-n25-p15-s2076598.cnf	SAT	19862	2507.65	3439766
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes5.cnf	SAT	22954.6	2876.82	3438451
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-240-2.shuffled-as.sat05-2519.cnf	SAT	23461.2	2938.61	3439481
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes8.cnf	SAT	23542.7	2950.28	3438566
crafted/skvortsov/battleship/ battleship-14-26-sat.cnf	SAT	24727.4	3098.36	3438971
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_462.cnf	SAT	32863.3	4116.38	3439171
crafted/spence/sgen/ sgen3-n180-s34713902-sat.cnf	SAT	33574.9	4203.94	3438631

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes1.cnf	? (TO)	40000.3	5008.98	3438576
crafted/spence/sgen/ sgen3-n130-s30940966-unsat.cnf	? (TO)	40000.4	5010.24	3438666
crafted/spence/sgen/ sgen3-n140-s20078956-unsat.cnf	? (TO)	40000.4	5010.78	3438676
SAT05/crafted/jarvisalo05/mod2-rand3bip-sat/ mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf	? (TO)	40000.4	5011.34	3439456
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-20_389.cnf	? (TO)	40000.4	5012.06	3439181
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3900_3900_220.shuffled.cnf	? (TO)	40000.4	5009.72	3439636
crafted/mosoi/289/ 289-unsat-6x40.cnf	? (TO)	40000.4	5010.88	3438816
crafted/manthey/sudoku-single-hard/ sudoku_81x81_unknown.cnf	? (TO)	40000.4	5003.79	3439041
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g9.cnf	? (TO)	40000.4	5009.56	3438511
crafted/mosoi/289/ 289-unsat-7x39.cnf	? (TO)	40000.4	5008.08	3438776
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-5-5_34308.cnf	? (TO)	40000.4	5006.82	3439061
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes2.cnf	? (TO)	40000.4	5010.78	3438496
crafted/spence/ hard/s113-100.cnf	? (TO)	40000.4	5010.52	3438316
crafted/skvortsov/battleship/ battleship-14-14-unsat.cnf	? (TO)	40000.4	5010.34	3438951
crafted/skvortsov/battleship/ battleship-13-13-unsat.cnf	? (TO)	40000.4	5012.44	3438961
crafted/spence/sgen/ sgen3-n180-s33098896-unsat.cnf	? (TO)	40000.4	5005.81	3438626
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf	? (TO)	40000.5	5010.12	3439206
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_4300_4300_110.shuffled.cnf	? (TO)	40000.5	5010.6	3439641
SAT03/handmade/anton/UNSAT/ SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf	? (TO)	40000.5	5004.01	3439266
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf	? (TO)	40000.5	5012.57	3439221
SAT03/handmade/anton/UNSAT/ SGI_30_80_28_70_8-dir.shuffled-as.sat03-215.cnf	? (TO)	40000.5	5009.75	3439256
SAT03/handmade/stanion/hwb/ hwb-n32-02-S1478512323.shuffled-as.sat03-1638.cnf	? (TO)	40000.5	5010.83	3439351
SAT04/handmade/connamacher/connm-d-0.02/ connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf	? (TO)	40000.5	5009.68	3439431
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-4_512.cnf	? (TO)	40000.5	5013.07	3439051
SAT04/handmade/marijn/equilarge-l/ equilarge_l4.used-as.sat04-896.cnf	? (TO)	40000.5	5010.29	3439451
SAT03/handmade/gomes/bqwh/ bqwh.60.1152.shuffled-as.sat03-1650.cnf	? (TO)	40000.5	5012.71	3439231
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes5.cnf	? (TO)	40000.5	5012.57	3438541
crafted/spence/sgen/ sgen3-n220-s24359701-sat.cnf	? (TO)	40000.5	5009.81	3438656
SAT05/crafted/sabharwal05/counting/fphp/unsat/ harder/fphp-030-029.shuffled-as.sat05-1234.cnf	? (TO)	40000.5	5011.9	3439521
crafted/spence/sgen/ sgen3-n150-s89334302-unsat.cnf	? (TO)	40000.5	5008.62	3438641
SAT04/handmade/kexu/frb-0.8/ frb59-26-2.used-as.sat04-892.cnf	? (TO)	40000.6	5010.81	3439396
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-6_2072.cnf	? (TO)	40000.6	5013.22	3439046
CRAFTED/rbsat/random/unforced/ rbsat-v2400c266431g10.cnf	? (TO)	40000.6	5011.94	3438376
SAT02/handmade/zhang-lintao/ xor-chain/x1_80.shuffled.cnf	? (TO)	40000.6	5011.42	3439661
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes7.cnf	? (TO)	40000.6	5012.87	3438446
SAT02/handmade/simon/satex-challenges/ par32-3.shuffled.cnf	? (TO)	40000.6	5011.38	3439656
SAT03/handmade/stanion/hwb/ hwb-n28-02-S818962541.shuffled-as.sat03-1628.cnf	? (TO)	40000.6	5011.11	3439346
SAT04/handmade/connamacher/connm-d0.04/ connm-ue-csp-sat-n800-d0.04-s1788334438.used-as.sat04-976.cnf	? (TO)	40000.6	5010.39	3439426
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_507.cnf	? (TO)	40000.6	5012.7	3439111
crafted/mosoi/289/ 289-unsat-21x40.cnf	? (TO)	40000.6	5010.23	3438756
CRAFTED/rbsat/random/forced/ rbsat-v2640c305320gyes10.cnf	? (TO)	40000.6	5010.29	3438491
crafted/spence/sgen/ sgen3-n200-s39840374-sat.cnf	? (TO)	40000.6	5010.85	3438636
CRAFTED/rbsat/crafted/ forced/rbsat-v2400c266431gyes3.cnf	? (TO)	40000.6	5012.12	3438551
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-6_2071.cnf	? (TO)	40000.6	5010.72	3439081
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes10.cnf	? (TO)	40000.6	5012.48	3438556
SAT03/handmade/stanion/hwb/ hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf	? (TO)	40000.7	5011.42	3439356
SAT03/handmade/anton/UNSAT/ SGI_30_60_24_40_2-log.shuffled-as.sat03-119.cnf	? (TO)	40000.7	5011.99	3439236
SAT03/handmade/gomes/bqwh/ bqwh.50.825.shuffled-as.sat03-1648.cnf	? (TO)	40000.7	5010.86	3439226
CRAFTED/rbsat/random/unforced/ rbsat-v2100c215164g4.cnf	? (TO)	40000.7	5010.72	3438421
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g3.cnf	? (TO)	40000.7	5009.79	3438411
crafted/mosoi/289/ 289-unsat-21x14.cnf	? (TO)	40000.7	5012.77	3438761
crafted/mosoi/289/ 289-unsat-5x41.cnf	? (TO)	40000.7	5012.1	3438741
crafted/spence/sgen/ sgen3-n260-s62321009-sat.cnf	? (TO)	40000.7	5010.82	3438691
crafted/spence/sgen/ sgen3-n120-s55656844-unsat.cnf	? (TO)	40000.7	5009.53	3438661
crafted/mosoi/289/ 289-unsat-14x34.cnf	? (TO)	40000.7	5010.07	3438836
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q918.75-n50-p30-s52376212.cnf	? (TO)	40000.7	5009.6	3439686
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535.cnf	? (TO)	40000.7	5009.09	3439471
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes2.cnf	? (TO)	40000.7	5011.65	3438441
SAT03/handmade/stanion/hwb/ hwb-n28-01-S136611085.shuffled-as.sat03-1627.cnf	? (TO)	40000.7	5011.42	3439361
SAT03/handmade/anton/UNSAT/ SGI_30_70_21_60_7-log.shuffled-as.sat03-151.cnf	? (TO)	40000.7	5010.97	3439306
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-18_312.cnf	? (TO)	40000.7	5009.23	3439191
CRAFTED/rbsat/crafted/ forced/rbsat-v1560c133795gyes1.cnf	? (TO)	40000.8	5011.29	3438581
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes5.cnf	? (TO)	40000.8	5008.12	3438476
CRAFTED/rbsat/random/ forced/rbsat-v1820c171155gyes3.cnf	? (TO)	40000.8	5011.31	3438481
SAT05/crafted/sabharwal05/counting/php/unsat/ easier/php-045-035.shuffled-as.sat05-1181.cnf	? (TO)	40000.8	5011.24	3439501
crafted/spence/sgen/ sgen3-n200-s00813792-unsat.cnf	? (TO)	40000.8	5011.52	3438681
crafted/spence/sgen/ sgen3-n240-s78945233-sat.cnf	? (TO)	40000.8	5010.42	3438696
crafted/spence/sgen/ sgen3-n190-s29985700-unsat.cnf	? (TO)	40000.8	5011.52	3438706
SAT04/handmade/hirsch03/ hgen8-n320-01-S1432474240.shuffled-as.sat03-890.used-as.sat04-841.cnf	? (TO)	40000.8	5007.34	3439436
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g7.cnf	? (TO)	40000.8	5010.28	3438526
SAT04/handmade/kexu/frb-0.6/ frb80-14-2.used-as.sat04-880.cnf	? (TO)	40000.8	5011.26	3439386
SAT04/handmade/kexu/frb-0.6/ frb75-13-2.used-as.sat04-878.cnf	? (TO)	40000.8	5009.78	3439381
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_508.cnf	? (TO)	40000.8	5010.06	3439126
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g1.cnf	? (TO)	40000.8	5010.86	3438386
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-20_388.cnf	? (TO)	40000.8	5011.43	3439211
crafted/skvortsov/automata-synchronization/ crn_40_1521_s.cnf	? (TO)	40000.8	5009.5	3438881
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes1.cnf	? (TO)	40000.8	5010.4	3438466
crafted/mosoi/289/ 289-unsat-21x39.cnf	? (TO)	40000.8	5012.73	3438846
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes3.cnf	? (TO)	40000.8	5004.06	3438586
crafted/skvortsov/automata-synchronization/ crn_40_1520_u.cnf	? (TO)	40000.8	5011	3438916
CRAFTED/rbsat/crafted/unforced/ rbsat-v1820c171155g5.cnf	? (TO)	40000.8	5007.36	3438506
crafted/mosoi/289/ 289-unsat-14x38.cnf	? (TO)	40000.8	5007.64	3438826
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g2.cnf	? (TO)	40000.8	5009.56	3438536
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g9.cnf	? (TO)	40000.8	5009.59	3438531
crafted/spence/sgen/ sgen3-n170-s56409011-unsat.cnf	? (TO)	40000.8	5011.45	3438651
SAT05/crafted/sabharwal05/counting/php/unsat/ harder/php-020-019.shuffled-as.sat05-1190.cnf	? (TO)	40000.8	5011.56	3439516
SAT02/handmade/simon/ satex-challenges/f600.shuffled.cnf	? (TO)	40000.9	5010.73	3439646
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes3.cnf	? (TO)	40000.9	5011.55	3438486
CRAFTED/rbsat/random/unforced/ rbsat-v1375c111739g6.cnf	? (TO)	40000.9	5011.41	3438426
crafted/mosoi/289/ 289-unsat-6x34.cnf	? (TO)	40000.9	5012.92	3438711
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_4300_4300_170.shuffled.cnf	? (TO)	40000.9	5009.1	3439631
SAT03/handmade/anton/UNSAT/ SGI_30_60_28_40_7-log.shuffled-as.sat03-127.cnf	? (TO)	40000.9	5011.66	3439301
SAT05/crafted/lynce05/social-golfer-problem/ sgp_5-6-8.shuffled-as.sat05-2669.cnf	? (TO)	40000.9	5013.66	3439541
SAT04/handmade/connamacher/connm-d0.02/ connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf	? (TO)	40000.9	5010.32	3439421
SAT03/handmade/anton/UNSAT/ SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf	? (TO)	40000.9	5011.11	3439251
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes7.cnf	? (TO)	40000.9	5010.75	3438546
CRAFTED/rbsat/random/unforced/ rbsat-v2400c266431g3.cnf	? (TO)	40000.9	5011.07	3438371
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-5_4231.cnf	? (TO)	40000.9	5013.14	3439056
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf	? (TO)	40000.9	5011.86	3439176
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g6.cnf	? (TO)	40000.9	5009.85	3438406
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g7.cnf	? (TO)	40000.9	5010.16	3438436
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes6.cnf	? (TO)	40000.9	5011.05	3438456
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_506.cnf	? (TO)	40001	5011.95	3439131
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes7.cnf	? (TO)	40001	5011.89	3438461
CRAFTED/rbsat/random/unforced/ rbsat-v1375c111739g4.cnf	? (TO)	40001	5010.93	3438431
crafted/mosoi/289/ 289-unsat-21x33.cnf	? (TO)	40001	5010.58	3438751
crafted/spence/sgen/ sgen3-n280-s93756482-sat.cnf	? (TO)	40001	5010.65	3438671
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes10.cnf	? (TO)	40001	5013.19	3438591
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q1041.25-n50-p15-s99099953.cnf	? (TO)	40001	5013.98	3439796
SAT05/crafted/markstrom05/eulcbip/ eulcbip-7-UNSAT.shuffled-as.sat05-3936.cnf	? (TO)	40001	5012.44	3439551
SAT04/handmade/kexu/frb-0.8/ frb59-26-1.used-as.sat04-891.cnf	? (TO)	40001	5013.14	3439401
SAT03/handmade/anton/SAT/ SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf	? (TO)	40001	5006.03	3439341
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-19_349.cnf	? (TO)	40001	5010.02	3439196
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-24_567.cnf	? (TO)	40001	5009.54	3439101
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-5_4232.cnf	? (TO)	40001	5011.85	3439086
crafted/skvortsov/battleship/ battleship-15-29-sat.cnf	? (TO)	40001	5011.41	3439026
crafted/mosoi/289/ 289-unsat-9x32.cnf	? (TO)	40001	5010.49	3438811
CRAFTED/rbsat/crafted/ forced/rbsat-v2100c215164gyes4.cnf	? (TO)	40001.1	5012.22	3438561
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	? (TO)	40001.1	5011.33	3438361
SAT04/handmade/marijn/equilarge-l/ equilarge_l2.used-as.sat04-894.cnf	? (TO)	40001.1	5013.09	3439446
SAT03/handmade/anton/UNSAT/ SGI_30_70_26_60_1-dir.shuffled-as.sat03-167.cnf	? (TO)	40001.1	5009.74	3439281
CRAFTED/rbsat/random/forced/ rbsat-v1375c111739gyes10.cnf	? (TO)	40001.1	5009.52	3438471
SAT03/handmade/anton/UNSAT/ SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf	? (TO)	40001.1	5011.68	3439241
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-15_218.cnf	? (TO)	40001.1	5010.24	3439201
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-5-5_34309.cnf	? (TO)	40001.1	5011.04	3439071
CRAFTED/rbsat/random/unforced/ rbsat-v2100c215164g9.cnf	? (TO)	40001.1	5011.66	3438401
crafted/spence/sgen/ sgen3-n300-s12830984-sat.cnf	? (TO)	40001.1	5010.02	3438621
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-4_511.cnf	? (TO)	40001.1	5010.69	3439066
crafted/skvortsov/battleship/ battleship-16-16-unsat.cnf	? (TO)	40001.1	5008.71	3438981
SAT03/handmade/anton/UNSAT/ SGI_30_60_29_30_6-dir.shuffled-as.sat03-130.cnf	? (TO)	40001.2	5009.68	3439326
SAT03/handmade/anton/UNSAT/ SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf	? (TO)	40001.2	5010.36	3439271
SAT03/handmade/anton/UNSAT/ SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf	? (TO)	40001.2	5011.66	3439331
SAT05/crafted/sabharwal05/counting/php/unsat/ harder/php-040-039.shuffled-as.sat05-1194.cnf	? (TO)	40001.2	5012.16	3439511
crafted/skvortsov/battleship/ battleship-15-15-unsat.cnf	? (TO)	40001.2	5009.13	3439001
SAT05/crafted/sabharwal05/counting/fphp/unsat/ harder/fphp-020-019.shuffled-as.sat05-1232.cnf	? (TO)	40001.2	5012.94	3439526
SAT02/handmade/simon/ satex-challenges/c6288.shuffled.cnf	? (TO)	40001.2	5010.33	3439651
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q585-n40-p15-s54275047.cnf	? (TO)	40001.2	5010.5	3439791
CRAFTED/rbsat/crafted/ forced/rbsat-v2400c266431gyes2.cnf	? (TO)	40001.2	5013.25	3438596
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g6.cnf	? (TO)	40001.2	5012.19	3438516
crafted/mosoi/289/ 289-unsat-17x30.cnf	? (TO)	40001.2	5012.32	3438786
crafted/spence/sgen/ sgen3-n160-s73223945-unsat.cnf	? (TO)	40001.2	5010.65	3438646
SAT03/handmade/anton/UNSAT/ SGI_30_70_29_50_3-dir.shuffled-as.sat03-179.cnf	? (TO)	40001.3	5010.78	3439316
CRAFTED/edgematching/ compact/em_11_3_4_cmp.cnf	? (TO)	40001.3	5013.25	3438331
crafted/mosoi/289/ 289-unsat-13x32.cnf	? (TO)	40001.3	5011.53	3438721
crafted/mosoi/289/ 289-unsat-17x27.cnf	? (TO)	40001.3	5011.67	3438791
CRAFTED/edgematching/ compact/em_12_2_4_cmp.cnf	? (TO)	40001.4	5011.72	3438326
CRAFTED/edgematching/ fbcolors/em_8_4_5_fbc.cnf	? (TO)	40001.4	5011.01	3438341

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT03/handmade/anton/UNSAT/ SGI_30_70_18_80_10-dir.shuffled-as.sat03-140.cnf	? (exit code)	7582.99	951.028	3439286
SAT03/handmade/anton/UNSAT/ SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf	? (exit code)	10723.6	1344.67	3439321
SAT03/handmade/anton/UNSAT/ SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf	? (exit code)	32938.6	4133.36	3439311
SAT03/handmade/anton/UNSAT/ SGI_30_70_20_70_1-dir.shuffled-as.sat03-146.cnf	? (exit code)	39247.8	4919.99	3439296
SAT03/handmade/anton/UNSAT/ SGI_30_70_20_60_10-dir.shuffled-as.sat03-144.cnf	? (exit code)	39508.7	4956.75	3439291

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver SArTagnan 2011-05-15 (fixed) (complete)

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (47 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (101 runs) [Show/Hide]

Solver timed out (no solution given) (147 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (5 runs) [Show/Hide]