SAT 2007 Competition Phase 2: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Medium/contest05/pebbling/ unsat-pbl-00070.sat05-1324.reshuffled-07.cnf	UNSAT	0.327949	0.329929	370079
crafted/Medium/contest05/sabharwal/ counting-easier-php-012-010.sat05-1172.reshuffled-07.cnf	UNSAT	0.416935	0.418034	370042
crafted/Medium/contest05/pebbling/ unsat-pbl-00090.sat05-1326.reshuffled-07.cnf	UNSAT	0.59091	0.59083	370065
crafted/Medium/contest05/pebbling/ unsat-pbl-00080.sat05-1325.reshuffled-07.cnf	UNSAT	0.622904	0.624915	370076
crafted/Medium/contest05/sabharwal/ counting-easier-fphp-012-010.sat05-1214.reshuffled-07.cnf	UNSAT	1.41578	1.41752	370060
crafted/spence/ medium/s57-100.cnf	UNSAT	1.55976	1.56221	370015
crafted/Difficult/contest05/sabharwal/ counting-easier-fphp-014-012.sat05-1215.reshuffled-07.cnf	UNSAT	1.65375	1.65515	370199
crafted/Medium/contest05/pebbling/ unsat-grid-pbl-0080.sat05-1344.reshuffled-07.cnf	UNSAT	2.01069	2.01275	370085
crafted/spence/ medium/s61-100.cnf	UNSAT	3.54446	3.54718	369998
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-12.sat05-2587.reshuffled-07.cnf	UNSAT	3.73943	3.74264	370146
crafted/spence/ medium/s65-100.cnf	UNSAT	3.83542	3.83869	370032
crafted/Medium/contest05/jarvisalo/ mod2-3cage-unsat-9-14.sat05-2589.reshuffled-07.cnf	UNSAT	3.9134	3.91738	370151
crafted/spence/ medium/s69-100.cnf	UNSAT	3.98039	3.98331	370007
crafted/Difficult/contest05/sabharwal/ counting-harder-php-014-013.sat05-1187.reshuffled-07.cnf	UNSAT	6.45502	6.4595	370204
crafted/spence/ medium/s77-100.cnf	UNSAT	16.0036	16.0095	369993
crafted/spence/ medium/s73-100.cnf	UNSAT	17.1624	17.1695	370020
crafted/Medium/contest05/pebbling/ unsat-pbl-00150.sat05-1328.reshuffled-07.cnf	UNSAT	21.7287	21.7369	370082
crafted/Difficult/contest05/sabharwal/ counting-easier-php-018-014.sat05-1175.reshuffled-07.cnf	UNSAT	24.2413	24.2502	370203
crafted/Hard/contest05/counting-php/ easier-fphp-020-015.sat05-1218.reshuffled-07.cnf	UNSAT	36.5084	36.5201	370170
crafted/Hard/contest05/counting-php/ harder-fphp-016-015.sat05-1230.reshuffled-07.cnf	UNSAT	36.6984	36.7104	370169
crafted/spence/ medium/s89-100.cnf	UNSAT	37.9112	37.9259	370024
crafted/spence/ medium/s81-100.cnf	UNSAT	58.6671	58.6823	370003
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-unsat-135-2.sat05-2354.reshuffled-07.cnf	UNSAT	60.4198	60.4371	370218
crafted/spence/ medium/s93-100.cnf	UNSAT	65.668	65.6874	370012
crafted/Medium/contest05/sabharwal/ counting-clqcolor-unsat-set-b-clqcolor-08-06-07.sat05-1257.reshuffled-07.cnf	UNSAT	67.2088	67.2333	370054
crafted/Medium/contest05/pebbling/ unsat-pbl-00250.sat05-1330.reshuffled-07.cnf	UNSAT	110.757	110.799	370088
crafted/spence/ hard/s101-100.cnf	UNSAT	185.469	185.534	370037
crafted/spence/ medium/s85-100.cnf	UNSAT	218.692	218.774	370028
crafted/Medium/contest05/pebbling/ unsat-pbl-00200.sat05-1329.reshuffled-07.cnf	UNSAT	225.643	225.698	370091
crafted/Difficult/contest05/jarvisalo/ mod2c-3cage-unsat-10-2.sat05-2567.reshuffled-07.cnf	UNSAT	246.128	246.213	370213
crafted/Hard/contest05/counting-php/ harder-fphp-018-017.sat05-1231.reshuffled-07.cnf	UNSAT	285.77	285.846	370171
crafted/Difficult/contest05/jarvisalo/ mod2c-3cage-unsat-10-3.sat05-2568.reshuffled-07.cnf	UNSAT	338.762	338.858	370217
crafted/spence/ hard/s97-100.cnf	UNSAT	378.303	378.435	370038
crafted/Difficult/contest05/sabharwal/ counting-harder-php-018-017.sat05-1189.reshuffled-07.cnf	UNSAT	382.522	382.651	370205
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-unsat-120-3.sat05-2340.reshuffled-07.cnf	UNSAT	466.757	467.042	370224
crafted/spence/ hard/s105-100.cnf	UNSAT	1443.06	1443.48	368583
crafted/spence/ hard/s109-100.cnf	UNSAT	1634.04	1634.57	368581
crafted/spence/ hard/s113-100.cnf	UNSAT	2416.61	2417.58	368580
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-10-07-09.sat05-1282.reshuffled-07.cnf	UNSAT	2918.6	2920.73	368669

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Medium/contest05/pebbling/ sat-grid-pbl-0070.sat05-1334.reshuffled-07.cnf	SAT	0.495924	0.741566	370067
crafted/Medium/contest05/pebbling/ sat-grid-pbl-0200.sat05-1339.reshuffled-07.cnf	SAT	30.2444	30.3108	370074
crafted/Difficult/contest05/sabharwal/ grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf	SAT	1834.7	1835.22	368718

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Hard/contest03/others/ 999999000001nw.sat05-447.reshuffled-07.cnf	? (TO)	5000.04	5001.74	368689
crafted/Medium/contest05/others/ QG-gensys-icl003.sat05-2715.reshuffled-07.cnf	? (TO)	5000.06	5001.35	368598
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d-0.02-s405595518.sat05-531.reshuffled-07.cnf	? (TO)	5000.06	5001.61	368617
crafted/Hard/contest05/QG/ QG7-dead-dnd002.sat05-3108.reshuffled-07.cnf	? (TO)	5000.06	5001.45	368645
crafted/Hard/contest03/others/ color-11-3.sat05-445.reshuffled-07.cnf	? (TO)	5000.06	5001.32	368687
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1100-m7545-k4-l4-s310659001.sat05-524.reshuffled-07.cnf	? (TO)	5000.06	5001.65	368737
crafted/Hard/contest03/looksrandom/ hgen8-n320-01-S1432474240.sat05-483.reshuffled-07.cnf	? (TO)	5000.07	5001.35	368705
crafted/Medium/contest05/others/ QG8-gensys-ukn005.sat05-3584.reshuffled-07.cnf	? (TO)	5000.08	5001.46	368601
crafted/Hard/contest05/others/ linvrinv8.sat05-567.reshuffled-07.cnf	? (TO)	5000.08	5001.56	368657
crafted/Hard/contest02/ ezfact64_6.sat05-453.reshuffled-07.cnf	? (TO)	5000.08	5001.47	368681
crafted/Hard/contest03/others/ color-18-4.sat05-443.reshuffled-07.cnf	? (TO)	5000.08	5001.87	368696
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-060.sat05-1312.reshuffled-07.cnf	? (TO)	5000.08	5001.38	368719
crafted/Medium/contest05/sabharwal/ unsat-logistics-rotate-09t5.sat05-1139.reshuffled-07.cnf	? (TO)	5000.09	5001.54	368589
crafted/Hard/contest03/looksrandom/ hgen7-n390-01-S248216171.sat05-478.reshuffled-07.cnf	? (TO)	5000.09	5001.46	368702
crafted/Hard/contest03/others/ mm-2x3-8-8-sb.1.sat05-475.reshuffled-07.cnf	? (TO)	5000.09	5001.56	368695
crafted/Difficult/contest05/QG/ QG6-gensys-icl008.sat05-2720.reshuffled-07.cnf	? (TO)	5000.09	5001.97	368713
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-01-S2069048075.sat05-488.reshuffled-07.cnf	? (TO)	5000.09	5002.04	368701
crafted/Hard/contest03/looksrandom/ hgen8-n320-03-S1572374531.sat05-485.reshuffled-07.cnf	? (TO)	5000.09	5001.78	368704
crafted/Medium/contest05/others/ QG7a-gensys-brn100.sat05-3765.reshuffled-07.cnf	? (TO)	5000.1	5001.79	368596
crafted/Medium/contest05/others/ QG7a-gensys-ukn001.sat05-3841.reshuffled-07.cnf	? (TO)	5000.1	5001.49	368595
crafted/Hard/contest05/QG/ QG7-dead-dnd005.sat05-3111.reshuffled-07.cnf	? (TO)	5000.1	5001.49	368641
crafted/Hard/contest05/QG/ QG7a-gensys-icl009.sat05-3830.reshuffled-07.cnf	? (TO)	5000.1	5001.48	368648
crafted/Hard/contest05/others/ sgp_5-6-8.sat05-2669.reshuffled-07.cnf	? (TO)	5000.1	5001.69	368662
crafted/Hard/contest05/others/ linvrinv9.sat05-568.reshuffled-07.cnf	? (TO)	5000.1	5001.76	368663
crafted/Difficult/contest05/others/ pmg-14-UNSAT.sat05-3942.reshuffled-07.cnf	? (TO)	5000.1	5001.69	368728
crafted/Difficult/contest-02-03-04/ contest02-Mat26.sat05-457.reshuffled-07.cnf	? (TO)	5000.1	5002.36	368742
crafted/Hard/contest04/others/ ramsey.sat05-511.reshuffled-07.cnf	? (TO)	5000.11	5002.15	368622
crafted/Hard/contest05/QG/ QG7a-gensys-ukn002.sat05-3842.reshuffled-07.cnf	? (TO)	5000.11	5001.59	368642
crafted/Hard/contest02/ hgen2-v500-s1216665065.sat05-467.reshuffled-07.cnf	? (TO)	5000.11	5001.65	368679
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-02-S350203913.sat05-486.reshuffled-07.cnf	? (TO)	5000.11	5001.43	368698
crafted/Difficult/contest05/QG/ QG6-gensys-icl009.sat05-2721.reshuffled-07.cnf	? (TO)	5000.11	5001.76	368711
crafted/Difficult/contest-02-03-04/ contest04-lksat-n1000-m6860-k4-l4-s1935114289.sat05-523.reshuffled-07.cnf	? (TO)	5000.11	5001.56	368739
crafted/Hard/contest02/ hgen3-v400-s553296708.sat05-471.reshuffled-07.cnf	? (TO)	5000.12	5001.55	368682
crafted/Hard/contest03/looksrandom/ hgen6-4-24-n650-03-S528656311.sat05-477.reshuffled-07.cnf	? (TO)	5000.12	5002.06	368703
crafted/Difficult/contest05/others/ pmg-13-UNSAT.sat05-3941.reshuffled-07.cnf	? (TO)	5000.12	5001.64	368723
crafted/Medium/contest05/sabharwal/ gt-ordering-sat-gt-030.sat05-1295.reshuffled-07.cnf	? (TO)	5000.13	5001.69	368587
crafted/Hard/contest05/QG/ QG7a-gensys-icl004.sat05-3825.reshuffled-07.cnf	? (TO)	5000.13	5002.89	368640
crafted/Hard/contest04/others/ Composite-048BitPrimes-1.sat05-504.reshuffled-07.cnf	? (TO)	5000.13	5002.17	368627
crafted/Hard/contest03/looksrandom/ hgen7-n390-02-S178568232.sat05-479.reshuffled-07.cnf	? (TO)	5000.13	5001.46	368697
crafted/spence/ hard/s117-100.cnf	? (TO)	5000.14	5002.16	368582
crafted/Hard/contest05/QG/ QG7-gensys-ukn003.sat05-3346.reshuffled-07.cnf	? (TO)	5000.14	5002.27	368643
crafted/Hard/contest05/counting-php/ harder-php-045-044.sat05-1195.reshuffled-07.cnf	? (TO)	5000.14	5001.44	368655
crafted/Hard/contest05/counting-clq/ unsat-set-b-fclqcolor-25-18-23.sat05-1287.reshuffled-07.cnf	? (TO)	5000.14	5001.59	368671
crafted/Hard/contest05/counting-clq/ unsat-set-b-clqcolor-30-20-26.sat05-1264.reshuffled-07.cnf	? (TO)	5000.14	5001.39	368674
crafted/Hard/contest02/ hgen3-v400-s344840348.sat05-470.reshuffled-07.cnf	? (TO)	5000.14	5002.15	368680
crafted/Hard/contest02/ hgen3-v500-s1349121860.sat05-473.reshuffled-07.cnf	? (TO)	5000.14	5001.66	368686
crafted/Difficult/contest05/others/ sgp_5-5-6.sat05-2675.reshuffled-07.cnf	? (TO)	5000.14	5001.5	368727
crafted/Difficult/contest05/sabharwal/ gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf	? (TO)	5000.14	5002.01	368717
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n600-d0.02-s1676244754.sat05-535.reshuffled-07.cnf	? (TO)	5000.14	5003.25	368740
crafted/Difficult/contest-02-03-04/ contest02-ezfact64_10.sat05-449.reshuffled-07.cnf	? (TO)	5000.14	5001.61	368741
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s111845174.sat05-536.reshuffled-07.cnf	? (TO)	5000.15	5001.43	368615
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1756632460.sat05-526.reshuffled-07.cnf	? (TO)	5000.15	5001.69	368612
crafted/Hard/contest05/QG/ QG7-gensys-icl100.sat05-3226.reshuffled-07.cnf	? (TO)	5000.15	5001.65	368644
crafted/Hard/contest05/QG/ QG7a-gensys-ukn009.sat05-3849.reshuffled-07.cnf	? (TO)	5000.15	5001.59	368646
crafted/Hard/contest05/QG/ QG7-dead-dnd001.sat05-3419.reshuffled-07.cnf	? (TO)	5000.15	5001.47	368649
crafted/Hard/contest02/ ezfact64_3.sat05-450.reshuffled-07.cnf	? (TO)	5000.15	5001.59	368683
crafted/Difficult/contest05/QG/ QG6-gensys-icl001.sat05-2695.reshuffled-07.cnf	? (TO)	5000.15	5001.72	368712
crafted/Hard/contest03/looksrandom/ hgen8-n260-03-S722413478.sat05-482.reshuffled-07.cnf	? (TO)	5000.15	5001.57	368706
crafted/Difficult/contest05/QG/ QG6-gensys-brn007.sat05-2684.reshuffled-07.cnf	? (TO)	5000.15	5002.27	368710
crafted/Medium/contest05/sabharwal/ gt-ordering-unsat-gt-030.sat05-1307.reshuffled-07.cnf	? (TO)	5000.15	5001.6	368584
crafted/Medium/contest05/others/ QG7-gensys-icl001.sat05-2926.reshuffled-07.cnf	? (TO)	5000.16	5001.67	368593
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.02-s1099787414.sat05-542.reshuffled-07.cnf	? (TO)	5000.16	5001.5	368619
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.04-s736572600.sat05-546.reshuffled-07.cnf	? (TO)	5000.16	5001.65	368616
crafted/Hard/contest03/others/ bqwh.60.1080.sat05-436.reshuffled-07.cnf	? (TO)	5000.16	5001.59	368693
crafted/Hard/contest03/looksrandom/ hgen8-n320-02-S1127428711.sat05-484.reshuffled-07.cnf	? (TO)	5000.16	5002.06	368699
crafted/Difficult/contest05/sabharwal/ logistics-unsat-logistics-rotate-11t5.sat05-1141.reshuffled-07.cnf	? (TO)	5000.16	5001.58	368720
crafted/Difficult/contest05/QG/ QG7-gensys-icl006.sat05-3132.reshuffled-07.cnf	? (TO)	5000.16	5002.09	368707
crafted/Difficult/contest05/others/ pmg-12-UNSAT.sat05-3940.reshuffled-07.cnf	? (TO)	5000.16	5002.79	368724
crafted/Difficult/contest05/others/ linvrinv5.sat05-564.reshuffled-07.cnf	? (TO)	5000.16	5001.56	368726
crafted/Medium/contest05/sabharwal/ gt-ordering-unsat-gt-025.sat05-1306.reshuffled-07.cnf	? (TO)	5000.17	5001.56	368585
crafted/Medium/contest05/others/ QG7a-gensys-brn004.sat05-3669.reshuffled-07.cnf	? (TO)	5000.17	5001.57	368594
crafted/Medium/contest05/others/ QG7a-gensys-ukn005.sat05-3845.reshuffled-07.cnf	? (TO)	5000.17	5001.47	368597
crafted/Hard/contest04/others/ equilarge_l2.sat05-519.reshuffled-07.cnf	? (TO)	5000.17	5001.58	368623
crafted/Hard/contest05/QG/ QG7a-gensys-icl001.sat05-3822.reshuffled-07.cnf	? (TO)	5000.17	5001.97	368647
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-12-07-08.sat05-1251.reshuffled-07.cnf	? (TO)	5000.17	5001.56	368668
crafted/Hard/contest05/counting-clq/ unsat-set-b-clqcolor-16-11-14.sat05-1261.reshuffled-07.cnf	? (TO)	5000.17	5001.52	368675
crafted/Hard/contest02/ ezfact64_4.sat05-451.reshuffled-07.cnf	? (TO)	5000.17	5001.51	368684
crafted/Difficult/contest05/QG/ QG6-dead-dnd001.sat05-2742.reshuffled-07.cnf	? (TO)	5000.17	5001.98	368708
crafted/Medium/contest05/sabharwal/ gt-ordering-unsat-gt-035.sat05-1308.reshuffled-07.cnf	? (TO)	5000.18	5001.59	368586
crafted/Hard/contest02/ ezfact64_5.sat05-452.reshuffled-07.cnf	? (TO)	5000.18	5001.73	368677
crafted/Hard/contest03/looksrandom/ hidden-k3-s0-r5-n700-03-S1609878926.sat05-487.reshuffled-07.cnf	? (TO)	5000.18	5001.69	368700
crafted/Difficult/contest05/jarvisalo/ mod2c-rand3bip-sat-210-3.sat05-2475.reshuffled-07.cnf	? (TO)	5000.18	5002.44	368733
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d-0.02-s383740539.sat05-534.reshuffled-07.cnf	? (TO)	5000.19	5002.24	368613
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.04-s1788334438.sat05-543.reshuffled-07.cnf	? (TO)	5000.19	5001.6	368618
crafted/Hard/contest04/others/ Composite-096BitPrimes-0.sat05-507.reshuffled-07.cnf	? (TO)	5000.19	5001.63	368625
crafted/Hard/contest04/others/ equilarge_l4.sat05-521.reshuffled-07.cnf	? (TO)	5000.19	5001.99	368629
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-gigamax.used-as.sat04-984.sat05-4194.reshuffled-07.cnf	? (TO)	5000.19	5001.76	368632
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_m3.used-as.sat04-900.sat05-4186.reshuffled-07.cnf	? (TO)	5000.19	5001.56	368636
crafted/Hard/contest05/counting-php/ harder-php-025-024.sat05-1191.reshuffled-07.cnf	? (TO)	5000.19	5001.35	368656
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-30-19-20.sat05-1256.reshuffled-07.cnf	? (TO)	5000.19	5001.81	368673
crafted/Hard/contest03/others/ bqwh.40.reg.520.sat05-433.reshuffled-07.cnf	? (TO)	5000.19	5001.49	368692
crafted/Difficult/contest05/QG/ QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf	? (TO)	5000.19	5000.12	368709
crafted/Difficult/contest05/others/ sgp_6-6-10.sat05-2670.reshuffled-07.cnf	? (TO)	5000.19	5001.58	368725
crafted/Difficult/contest05/QG/ QG6-gensys-icl004.sat05-2716.reshuffled-07.cnf	? (TO)	5000.19	5001.8	368715
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n1200-d0.00-s1875077647.sat05-530.reshuffled-07.cnf	? (TO)	5000.2	5001.71	368610
crafted/Hard/contest05/counting-php/ easier-php-035-029.sat05-1179.reshuffled-07.cnf	? (TO)	5000.2	5001.84	368651
crafted/Hard/contest02/ ezfact256_1.sat05-464.reshuffled-07.cnf	? (TO)	5000.2	5001.73	368678
crafted/Difficult/contest05/QG/ QG6-dead-dnd002.sat05-2713.reshuffled-07.cnf	? (TO)	5000.2	5002	368716
crafted/Medium/contest05/sabharwal/ sat-strips-gripper-12t23.sat05-1144.reshuffled-07.cnf	? (TO)	5000.21	5000.03	368590
crafted/Hard/contest04/others/ Composite-064BitPrimes-1.sat05-506.reshuffled-07.cnf	? (TO)	5000.21	5001.59	368621
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-10-06-07.sat05-1250.reshuffled-07.cnf	? (TO)	5000.21	5001.7	368672
crafted/Hard/contest05/counting-clq/ unsat-set-a-clqcolor-16-10-11.sat05-1253.reshuffled-07.cnf	? (TO)	5000.21	5001.83	368676
crafted/Difficult/contest05/sabharwal/ gt-ordering-sat-gt-040.sat05-1297.reshuffled-07.cnf	? (TO)	5000.21	5001.6	368721
crafted/Medium/contest05/others/ gensys-ukn002.sat05-2744.reshuffled-07.cnf	? (TO)	5000.22	5001.71	368592
crafted/Medium/contest05/others/ QG-gensys-brn008.sat05-2685.reshuffled-07.cnf	? (TO)	5000.22	5001.52	368599
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-2.sat05-2489.reshuffled-07.cnf	? (TO)	5000.22	5002.09	368660
crafted/Difficult/contest-02-03-04/ contest03-hwb-n26-01-S1957858365.sat05-500.reshuffled-07.cnf	? (TO)	5000.22	5002.34	368735
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-luckySeven.used-as.sat04-990.sat05-4196.reshuffled-07.cnf	? (TO)	5000.23	5001.8	368630
crafted/Hard/contest04/others/ equilarge_l5.sat05-522.reshuffled-07.cnf	? (TO)	5000.23	5001.66	368628
crafted/Hard/contest05/others/ strips-gripper-12t22.sat05-1151.reshuffled-07.cnf	? (TO)	5000.23	5001.66	368666
crafted/Difficult/contest05/QG/ QG6-gensys-icl006.sat05-2718.reshuffled-07.cnf	? (TO)	5000.23	5001.66	368714
crafted/Hard/contest05/counting-clq/ unsat-set-a-fclqcolor-20-13-14.sat05-1278.reshuffled-07.cnf	? (TO)	5000.24	5001.67	368670
crafted/Hard/contest03/others/ hwb-n28-02-S818962541.sat05-492.reshuffled-07.cnf	? (TO)	5000.24	5002.03	368691
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-1.sat05-2248.reshuffled-07.cnf	? (TO)	5000.24	5002.18	368734
crafted/Hard/contest04/others/ equilarge_l3.sat05-520.reshuffled-07.cnf	? (TO)	5000.25	5002.18	368620
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-3.sat05-2265.reshuffled-07.cnf	? (TO)	5000.25	5002.35	368732
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_3-dir.sat05-440.reshuffled-07.cnf	? (TO)	5000.25	5002.36	368743
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d0.02-s925928766.sat05-538.reshuffled-07.cnf	? (TO)	5000.26	5001.79	368611
crafted/Hard/contest05/others/ strips-gripper-18t35.sat05-1147.reshuffled-07.cnf	? (TO)	5000.26	5002.04	368665
crafted/Hard/contest05/counting-clq/ unsat-set-a-fclqcolor-10-06-07.sat05-1274.reshuffled-07.cnf	? (TO)	5000.26	5001.82	368667
crafted/Medium/contest05/sabharwal/ sat-strips-gripper-10t19.sat05-1143.reshuffled-07.cnf	? (TO)	5000.27	5001.73	368588
crafted/Hard/contest04/connamacher/ connm-ue-csp-sat-n800-d-0.02-s1542454144.sat05-533.reshuffled-07.cnf	? (TO)	5000.27	5002.08	368614
crafted/Hard/contest05/others/ eulcbip-8-UNSAT.sat05-3937.reshuffled-07.cnf	? (TO)	5000.27	5001.64	368661
crafted/Medium/contest05/jarvisalo/ mod2c-rand3bip-sat-190-3.sat05-2445.reshuffled-07.cnf	? (TO)	5000.28	5001.7	368607
crafted/Hard/contest03/others/ hwb-n28-01-S136611085.sat05-491.reshuffled-07.cnf	? (TO)	5000.29	5001.86	368694
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-2.sat05-2174.reshuffled-07.cnf	? (TO)	5000.3	5001.85	368603
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-1.sat05-2263.reshuffled-07.cnf	? (TO)	5000.3	5001.73	368729
crafted/Difficult/contest-02-03-04/ contest04-connm-ue-csp-sat-n800-d0.04-s362703357.sat05-548.reshuffled-07.cnf	? (TO)	5000.3	5001.62	368738
crafted/Hard/contest05/others/ mod2c-rand3bip-sat-220-1.sat05-2488.reshuffled-07.cnf	? (TO)	5000.31	5001.84	368659
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-280-2.sat05-2264.reshuffled-07.cnf	? (TO)	5000.32	5001.64	368730
crafted/Hard/contest02/ pyhala-braun-unsat-40-4-02.sat05-459.reshuffled-07.cnf	? (TO)	5000.33	5001.83	368685
crafted/Hard/contest03/others/ hwb-n32-01-S1491788039.sat05-497.reshuffled-07.cnf	? (TO)	5000.36	5001.8	368688

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-all.used-as.sat04-986.sat05-4198.reshuffled-07.cnf	? (MO)	137.956	138.002	368638
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-FIFO.used-as.sat04-991.sat05-4192.reshuffled-07.cnf	? (MO)	157.741	157.795	368637
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l2.used-as.sat04-894.sat05-4188.reshuffled-07.cnf	? (MO)	182.897	183.192	368631
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l3.used-as.sat04-895.sat05-4189.reshuffled-07.cnf	? (MO)	182.946	182.989	368634
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-equilarge_l1.used-as.sat04-893.sat05-4187.reshuffled-07.cnf	? (MO)	185.231	185.29	368639
crafted/Hard/contest05/others/ sgp_9-8-8.sat05-2674.reshuffled-07.cnf	? (MO)	365.171	365.673	368664
crafted/Hard/contest04/others/ CompositeRSA576.sat05-509.reshuffled-07.cnf	? (MO)	506.903	507.19	368624
crafted/Hard/contest05/counting-php/ harder-fphp-070-069.sat05-1240.reshuffled-07.cnf	? (MO)	1131.82	1132.19	368652
crafted/Hard/contest05/counting-php/ harder-fphp-035-034.sat05-1235.reshuffled-07.cnf	? (MO)	1802.43	1803.09	368653
crafted/Hard/contest05/others/ linvrinv6.sat05-565.reshuffled-07.cnf	? (MO)	2037.55	2038.19	368658
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-myciel6-cn.used-as.sat04-319.sat05-4201.reshuffled-07.cnf	? (MO)	2060.55	2061.09	368635
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf	? (MO)	2347.55	2348.29	368602
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-250-3.sat05-2220.reshuffled-07.cnf	? (MO)	2586.31	2587.09	368608
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-240-3.sat05-2205.reshuffled-07.cnf	? (MO)	2745.82	2746.59	368609
crafted/Difficult/contest-02-03-04/ contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf	? (MO)	2943.8	2944.69	368736
crafted/Hard/contest05/counting-php/ easier-fphp-035-029.sat05-1221.reshuffled-07.cnf	? (MO)	2960.31	2961.29	368654
crafted/Hard/contest05/counting-php/ harder-fphp-050-049.sat05-1238.reshuffled-07.cnf	? (MO)	2992.99	2993.89	368650
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf	? (MO)	3153.87	3154.69	368604
crafted/Medium/contest05/pebbling/ sat-pbl-00400.sat05-1322.reshuffled-07.cnf	? (MO)	3301.86	3302.79	368591
crafted/Difficult/contest05/sabharwal/ grid-pebbling-unsat-grid-pbl-0300.sat05-1350.sat05-1350.reshuffled-07.cnf	? (MO)	3616.81	3617.69	368722
crafted/Hard/contest04/others/ Composite-048BitPrimes-0.sat05-503.reshuffled-07.cnf	? (MO)	3717.13	3718.49	368626
crafted/Difficult/contest05/jarvisalo/ mod2-rand3bip-sat-270-2.sat05-2249.reshuffled-07.cnf	? (MO)	4439.08	4440.29	368731
crafted/Hard/contest05/phnf/ phnf-size10-exclusive-philo.used-as.sat04-988.sat05-4195.reshuffled-07.cnf	? (MO)	4448.38	4449.8	368633
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-2.sat05-2159.reshuffled-07.cnf	? (MO)	4546.53	4548.09	368606
crafted/Medium/contest05/others/ pmg-11-UNSAT.sat05-3939.reshuffled-07.cnf	? (MO)	4593.86	4595.59	368600
crafted/Medium/contest05/jarvisalo/ mod2-rand3bip-sat-210-1.sat05-2158.reshuffled-07.cnf	? (MO)	4619.55	4621.3	368605
crafted/Hard/contest03/others/ hwb-n26-03-S540351185.sat05-490.reshuffled-07.cnf	? (MO)	4669.93	4671.38	368690

SAT 2007 Competition Phase 2: benchmarks results per solver

Result page for solver TTS 4.0

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (39 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (3 runs) [Show/Hide]

Solver timed out (no solution given) (132 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (27 runs) [Show/Hide]