PB'26 competition: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_4_shuffle/normalized-sumineqArity4pyramidP005.shuf-2.opb	UNSAT	0.029098	0.0902871	4811211
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-lines-v3_shuffle/normalized-grid4_27.shuf-1.opb	UNSAT	0.02958	0.0953869	4811791
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP005.shuf-1.opb	UNSAT	0.030606	0.094811	4811385
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-subsetCardinalitySigma-13-1.cnf.gz-extracted.pb.metafix.opb	UNSAT	0.030888	0.096293	4801312
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-large-v3/normalized-grid6_11.opb	UNSAT	0.031071	0.110575	4811907
PB24/normalized-PB16/DEC-LIN/ quimper/SyncCodes/d_n_k/normalized-2_4_3.opb	UNSAT	0.031184	0.0952379	4809500
PB24/normalized-PB16/DEC-LIN/elffers/ subsetcard/normalized-subsetcard-geq-fixedbandwidth-30.opb	UNSAT	0.031664	0.096276	4802712
PB24/normalized-PB16/DEC-LIN/ quimper/SyncCodes/d_n_k/normalized-2_3_6.opb	UNSAT	0.031933	0.094928	4809471
PB24/normalized-PB16/DEC-LIN/ quimper/SyncCodes/d_n_k/normalized-3_6_4.opb	UNSAT	0.032182	0.09476	4809355
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/diag_spec/normalized-9diag_spec_greater.opb	UNSAT	0.032687	0.0956669	4813705
PB24/normalized-PB16/DEC-LIN/elffers/ subsetcard/normalized-subsetcard-eq-fixedbandwidth-70.opb	UNSAT	0.033048	0.0973209	4802740
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ random4reg_opb_shuffle/normalized-subsetcard-geq-random4reg-75.shuf-2.opb	UNSAT	0.033225	0.088539	4812951
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ random4reg_opb_shuffle/normalized-subsetcard-geq-random4reg-80.shuf-1.opb	UNSAT	0.033639	0.11248	4812980
PB24/normalized-PB24/DEC-LIN/nordstrom/ CombinatorialBenchmarksPBsolvers/domset/domset-fixedrows-r06-tiling/normalized-domset-hexgrid_06_062.opb	UNSAT	0.034217	0.109987	4812168
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/array_comm/normalized-10arraycomm_teq_tvars_less.opb	UNSAT	0.034736	0.139007	4813589
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1111224059.opb	UNSAT	0.035026	0.123448	4798736
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/array_spec/normalized-9array_spec_less.opb	UNSAT	0.035879	0.151363	4813531
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5/normalized-sumineqArity5pyramidP005.opb	UNSAT	0.036509	0.112821	4811269
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ subsetcard/random4reg_opb/normalized-subsetcard-geq-random4reg-65.opb	UNSAT	0.036523	0.149977	4813038
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ random4reg_opb_shuffle/normalized-subsetcard-geq-random4reg-65.shuf-1.opb	UNSAT	0.039559	0.160314	4813009
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v3_shuffle/normalized-grid8_51.shuf-1.opb	UNSAT	0.040836	0.104898	4811849
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP015.shuf-1.opb	UNSAT	0.044117	0.10704	4811414
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/extended-even-colouring/ random_norational_opb/normalized-ec_random_norational_random4reg_split_100.opb	UNSAT	0.045289	0.139013	4812864
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ domset/domset_large/normalized-domset-hexgrid_05_050.opb	UNSAT	0.045613	0.114181	4812342
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ domset/domset_large/normalized-domset-hexgrid_06_047.opb	UNSAT	0.046506	0.110874	4812400
PB24/normalized-PB24/DEC-LIN/nordstrom/ CombinatorialBenchmarksPBsolvers/vertex-cover/larger/vc-lines-v3_shuffle/normalized-grid8_111.shuf-3.opb	UNSAT	0.048408	0.112782	4811646
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ equalities/array_wallace/normalized-10array_wallace_less_teq.opb	UNSAT	0.049663	0.115604	4809819
PB24/normalized-PB06/DEC-LIN/submitted-PB05/aloul/ FPGA_SAT05/normalized-chnl15_16_pb.cnf.cr.opb	UNSAT	0.05411	0.70767	4796860
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v3_shuffle/normalized-grid8_91.shuf-2.opb	UNSAT	0.059643	0.123718	4811878
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ inequalities/OPB/ineq7/normalized-11array_ineq7.opb	UNSAT	0.068828	0.132746	4809616
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_4/normalized-sumineqArity4pyramidP025.opb	UNSAT	0.071258	0.135478	4811472
PB24/normalized-PB15eval/DEC-LIN/SUMINEQ/ normalized-sumineqArity3houseP016.opb	UNSAT	0.07456	0.193224	4808601
PB24/normalized-PB10/DEC-LIN/oliveras/ j60/normalized-j6028_8-unsat.opb	UNSAT	0.074778	0.162732	4799324
PB24/normalized-PB15eval/DEC-LIN/SUMINEQ/ normalized-sumineqArity5houseP016.opb	UNSAT	0.082263	0.19137	4808630
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-11-10.opb	UNSAT	0.089082	0.387682	4807905
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-blast-floppy1-7.ucl.opb	UNSAT	0.111251	0.398666	4796216
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-15-10.opb	UNSAT	0.119233	0.499377	4808021
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ roussel/normalized-pigeon-cardinality-25-20.opb	UNSAT	0.146168	0.529348	4807789
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-nve-large-v1/normalized-grid8_97.opb	UNSAT	0.223835	0.293788	4811820
PB24/normalized-PB06/DEC-LIN/web/ uclid_pb_benchmarks/normalized-blast-tlan3.ucl.opb	UNSAT	0.233277	0.504411	4796384
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ larger/fixedbw_opb_shuffle/normalized-subsetcard-geq-fixedbandwidth-2250.shuf-1.opb	UNSAT	0.966561	1.05109	4813183
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ subsetcard/larger/fixedbw_opb/normalized-subsetcard-geq-fixedbandwidth-3750.opb	UNSAT	1.04118	1.12339	4813154
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ larger/fixedbw_opb_shuffle/normalized-subsetcard-geq-fixedbandwidth-2750.shuf-3.opb	UNSAT	1.06093	1.14539	4813299
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ subsetcard/larger/random4reg_opb/normalized-subsetcard-geq-random4reg-2750.opb	UNSAT	1.19953	1.28533	4813125
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ larger/fixedbw_opb_shuffle/normalized-subsetcard-geq-fixedbandwidth-3500.shuf-3.opb	UNSAT	1.22233	1.31307	4813241
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ subsetcard/larger/random4reg_opb/normalized-subsetcard-eq-random4reg-1500.opb	UNSAT	1.37384	1.46831	4813096
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/subsetcard/ larger/fixedbw_opb_shuffle/normalized-subsetcard-geq-fixedbandwidth-4000.shuf-2.opb	UNSAT	1.38647	1.48183	4813212
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ subsetcard/larger/fixedbw_opb_shuffle/normalized-subsetcard-eq-fixedbandwidth-2250.shuf-1.opb	UNSAT	1.43597	1.5494	4813270
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v011-n3.opb	UNSAT	1.55958	1.68831	4802992
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ ebits/benchmarks/normalized-16ebits_0.opb	UNSAT	1.66691	1.772	4813734
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq10/normalized-10array_ineq10.opb	UNSAT	1.7832	1.87973	4813357
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n28-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	UNSAT	1.80793	1.87724	4801144
PB24/normalized-PB16/DEC-LIN/elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v020-n1.opb	UNSAT	1.89793	1.96581	4802600
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-regular-n12-d4-i1.cnf.gz-plain.pb.metafix.opb	UNSAT	1.93884	2.01491	4801340
PB24/normalized-PB06/DEC-LIN/submitted-PB05/aloul/ FPGA_SAT05/normalized-chnl35_36_pb.cnf.cr.opb	UNSAT	1.97785	2.11638	4796888
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v021-n2.opb	UNSAT	2.17179	2.24181	4802908
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/dec/ normalized-composed_pebbling_php_pyramid_height3_pigeons2_holes1.opb	UNSAT	2.4215	2.4913	4809964
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-stein15inf.0.d.opb	UNSAT	2.42314	2.51049	4810689
PB24/normalized-PB06/DEC-LIN/submitted-PB05/aloul/ FPGA_SAT05/normalized-chnl40_50_pb.cnf.cr.opb	UNSAT	2.48809	2.64718	4796636
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ ebits/zeroth_bit/normalized-26ebits_0.opb	UNSAT	2.52669	2.59767	4809935
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ equalities/array_comm/arraycomm_teq/normalized-11arraycomm_teq_less.opb	UNSAT	2.53609	2.62967	4809761
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ subsetcard/larger/random4reg_opb_shuffle/normalized-subsetcard-eq-random4reg-3500.shuf-1.opb	UNSAT	2.66374	2.77355	4813067
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/array_comm/normalized-12arraycomm_teq_tvars_less.opb	UNSAT	2.76777	2.84729	4813647
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_4_shuffle/normalized-sumineqArity4pyramidP035.shuf-1.opb	UNSAT	2.77914	2.87109	4811240
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_4/normalized-sumineqArity4pyramidP085.opb	UNSAT	2.97268	3.06424	4811501
PB24/normalized-PB15eval/DEC-LIN/ EC_ODD_GRIDS/normalized-ECgrid5x10split.opb	UNSAT	3.01205	3.10074	4801844
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v041-n1.opb	UNSAT	3.05917	3.15149	4803048
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x10split.cnf-extracted.pb.metafix.opb	UNSAT	3.08621	3.17523	4808543
PB24/normalized-PB16/DEC-LIN/elffers/ EC_RANDOM_GRAPHS/normalized-ECrand6reg-v031-n1.opb	UNSAT	3.13893	3.20935	4802628
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/dec/ normalized-composed_pebbling_php_pyramid_height5_pigeons4_holes3.opb	UNSAT	3.2043	3.28723	4810051
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ roussel/normalized-pigeon-cardinality-61-60.opb	UNSAT	3.30035	3.63287	4807731
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_4_shuffle/normalized-sumineqArity4pyramidP055.shuf-2.opb	UNSAT	3.34947	3.42526	4811153
PB24/normalized-PB16/DEC-LIN/elffers/EC_RANDOM_GRAPHS/ normalized-ECrand4regsplit-v060-n1.opb	UNSAT	3.36983	3.45249	4802656
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v051-n3.opb	UNSAT	3.43364	3.52428	4802936
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Hamming-20-10-05-10_c24.opb	UNSAT	3.52651	3.64536	4814517
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ roussel/normalized-pigeon-cardinality-51-50.opb	UNSAT	3.66031	3.94425	4807818
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP045.shuf-3.opb	UNSAT	3.66099	3.7518	4811298
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height15_pigeons14_holes13.opb	UNSAT	3.80787	3.88956	4810138
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x30split.cnf-plain.pb.metafix.opb	UNSAT	3.92341	4.06958	4808340
PB24/normalized-PB16/DEC-LIN/elffers/ EC_RANDOM_GRAPHS/normalized-ECrand6reg-v051-n1.opb	UNSAT	4.05595	4.12831	4802684
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-exit/normalized-phpexit_v1_06_036.opb	UNSAT	4.31069	4.39098	4812603
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x40split.cnf-plain.pb.metafix.opb	UNSAT	4.44819	4.73517	4808166
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v081-n3.opb	UNSAT	4.62035	4.72317	4802964
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height16_pigeons15_holes14.opb	UNSAT	4.83266	4.91361	4810196
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x50split.cnf-plain.pb.metafix.opb	UNSAT	4.91	5.09602	4808398
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-exit/normalized-phpexit_v2_06_036.opb	UNSAT	4.97742	5.08882	4812574
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v041-n2.opb	UNSAT	5.20062	5.3108	4803020
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/dec/ normalized-composed_pebbling_php_pyramid_height6_pigeons5_holes4.opb	UNSAT	5.25137	5.32789	4810283
PB24/normalized-PB15eval/DEC-LIN/ EC_ODD_GRIDS/normalized-ECgrid3x50split.opb	UNSAT	5.35171	5.43158	4801956
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v081-n1.opb	UNSAT	5.45213	5.52936	4802852
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq10/normalized-14array_alg_ineq10.opb	UNSAT	5.48403	5.59399	4813328
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r04_shuffle/normalized-domset-hexgrid_04_037.shuf-3.opb	UNSAT	5.57715	5.67546	4812516
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_4_shuffle/normalized-sumineqArity4pyramidP085.shuf-2.opb	UNSAT	5.6151	5.72196	4811182
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v1_shuffle/normalized-grid4_23.shuf-1.opb	UNSAT	5.69617	5.79447	4811530
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v101-n2.opb	UNSAT	5.76596	5.86147	4802880
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x10split.cnf-plain.pb.metafix.opb	UNSAT	5.88454	6.01203	4808253
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r04_shuffle/normalized-domset-hexgrid_04_038.shuf-1.opb	UNSAT	5.9236	6.0209	4812487
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110975607.opb	UNSAT	6.04088	6.12369	4798624
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1111227861.opb	UNSAT	6.04867	6.1305	4798484
PB24/normalized-PB16/DEC-LIN/elffers/ EC_RANDOM_GRAPHS/normalized-ECrand6reg-v091-n1.opb	UNSAT	6.06266	6.15687	4802572
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110973163.opb	UNSAT	6.09913	6.18138	4798568
PB24/normalized-PB06/DEC-LIN/web/ uclid_pb_benchmarks/normalized-dlx1c.ucl.opb	UNSAT	6.20593	6.70698	4796356
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110968561.opb	UNSAT	6.23625	6.36359	4798792
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1111213868.opb	UNSAT	6.25696	6.33909	4798680
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x60split.cnf-extracted.pb.metafix.opb	UNSAT	6.26486	6.40932	4808224
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat10_8_triangular.opb	UNSAT	6.52886	6.65127	4813908
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x80split.cnf-plain.pb.metafix.opb	UNSAT	6.62743	6.72761	4808572
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat10_9identity_complement.opb	UNSAT	6.7498	6.83978	4813792
PB24/normalized-PB15eval/DEC-LIN/ EC_ODD_GRIDS/normalized-ECgrid3x70split.opb	UNSAT	6.76065	6.85925	4801872
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl.opb	UNSAT	6.8951	7.33448	4796272
PB24/normalized-PB16/DEC-LIN/elffers/ EC_RANDOM_GRAPHS/normalized-ECrand6reg-v111-n1.opb	UNSAT	6.97908	7.06119	4802544
PB24/normalized-PB24/DEC-LIN/nordstrom/ CombinatorialBenchmarksPBsolvers/domset/domset-fixedrows-r08-tiling/normalized-domset-hexgrid_08_057.opb	UNSAT	7.09023	7.1927	4812284
PB24/normalized-PB16/DEC-LIN/elffers/ rand6reg/normalized-rand6reg-v111-n2.opb	UNSAT	7.30585	7.39232	4803076
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat11_9_triangular.opb	UNSAT	7.6908	7.80102	4814082
PB24/normalized-PB06/DEC-LIN/web/ uclid_pb_benchmarks/normalized-dlx1c.rwmem.ucl.opb	UNSAT	7.73123	8.21007	4796020
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/random_large_opb/normalized-ECrand6reg_151.opb	UNSAT	7.85363	7.9478	4810950
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x30split.cnf-extracted.pb.metafix.opb	UNSAT	8.10775	8.27577	4808195
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP095.shuf-3.opb	UNSAT	9.11659	9.23485	4811443
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid3x20split.cnf-extracted.pb.metafix.opb	UNSAT	9.42266	9.60301	4808456
PB24/normalized-PB15eval/DEC-LIN/ EC_ODD_GRIDS/normalized-ECgrid3x90split.opb	UNSAT	9.70905	9.80468	4801900
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900558106.opb	UNSAT	9.74869	9.84985	4798372
PB24/normalized-PB10/DEC-LIN/oliveras/ j90/normalized-j9037_9-unsat.opb	UNSAT	10.2502	10.3418	4799408
PB24/normalized-PB06/DEC-LIN/web/ uclid_pb_benchmarks/normalized-ooo.rf9.ucl.opb	UNSAT	10.3349	10.6784	4796188
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ inequalities/OPB/ineq9/normalized-18array_ineq9.opb	UNSAT	10.6778	10.7712	4809558
PB24/normalized-PB16/DEC-LIN/quimper/ SyncCodes/d_n_k/normalized-4_5_26.opb	UNSAT	11.5588	11.6707	4809413
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ inequalities/OPB/ineq6/normalized-18array_alg_ineq6.opb	UNSAT	12.1727	12.2666	4809587
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset_large_fixedcols_final/normalized-domset-hexgrid-fixedcols_04_075.opb	UNSAT	12.5869	12.6964	4812226
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v2_shuffle/normalized-grid4_49.shuf-3.opb	UNSAT	13.1025	13.2102	4811704
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-41-40.opb	UNSAT	13.1738	13.4699	4807934
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat15_13_triangular.opb	UNSAT	13.2448	13.3668	4813995
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl.opb	UNSAT	13.5516	13.8654	4796104
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-51-50.opb	UNSAT	15.8876	16.2103	4808108
PB24/normalized-PB06/DEC-LIN/web/ uclid_pb_benchmarks/normalized-ooo.tag12.ucl.opb	UNSAT	15.9435	16.5499	4796244
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height21_pigeons20_holes19.opb	UNSAT	16.0332	16.1589	4810080
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat98_identity_complement.opb	UNSAT	16.0575	16.198	4813966
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP115.shuf-1.opb	UNSAT	16.4516	16.5758	4811327
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/grids_large_opb/normalized-ECgrid_split_3_180.opb	UNSAT	16.5667	16.6853	4811037
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ extended-even-colouring/grids_rational_opb/normalized-ec_grid_rational_06_070.opb	UNSAT	16.5714	16.7005	4812893
PB24/normalized-PB16/DEC-LIN/quimper/ SyncCodes/d_n_k/normalized-7_6_19.opb	UNSAT	17.2806	17.4058	4809384
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-71-70.opb	UNSAT	18.0832	18.4179	4807760
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-45-40.opb	UNSAT	19.0543	19.4018	4807876
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/ec-stargrid-04_shuffle/normalized-ec_stargrid_04_018.shuf-3.opb	UNSAT	19.4374	19.5884	4810863
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat16_15_identity_complement.opb	UNSAT	20.5471	20.7137	4813763
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height22_pigeons21_holes20.opb	UNSAT	20.6647	20.7978	4810022
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v2_shuffle/normalized-grid6_51.shuf-1.opb	UNSAT	20.7003	20.8372	4811762
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-lines-v1_shuffle/normalized-grid6_49.shuf-2.opb	UNSAT	21.3136	21.4639	4811588
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/array_comm/normalized-16arraycomm_teq_tvars_less.opb	UNSAT	21.3231	21.4652	4813618
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.3.accl.ucl.opb	UNSAT	21.4271	21.9932	4796160
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP145.shuf-3.opb	UNSAT	21.8101	21.9645	4811356
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v1_shuffle/normalized-grid8_61.shuf-3.opb	UNSAT	22.3933	22.5825	4811559
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/larger/vc-nve-large-v3/normalized-grid6_171.opb	UNSAT	24.4224	24.5843	4811617
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-65-60.opb	UNSAT	26.6157	26.9522	4808050
PB24/normalized-PB16/DEC-LIN/quimper/ SyncCodes/d_n_k/normalized-5_6_19.opb	UNSAT	27.3183	27.4737	4809442
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height23_pigeons22_holes21.opb	UNSAT	28.2813	28.4277	4810312
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ extended-even-colouring/grids_norational_opb/normalized-ec_grid_norational_07_100.opb	UNSAT	28.4392	28.6008	4812748
PB24/normalized-PB15eval/DEC-LIN/3COL/ normalized-3col-left3reg-l070-r069-n1.opb	UNSAT	28.5669	28.8806	4801508
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-exit/normalized-phpexit_v1_06_092.opb	UNSAT	28.7452	28.9113	4812690
PB24/normalized-PB06/DEC-LIN/web/ uclid_pb_benchmarks/normalized-cache.inv12.ucl.opb	UNSAT	29.1267	29.5345	4796132
PB24/normalized-PB15eval/DEC-LIN/3COL-FromCNF/ normalized-3col-left3reg-l070-r069-n1.cnf-extracted.pb.metafix.opb	UNSAT	29.6501	29.9869	4801732
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-FastMatrixMultiplication-mini-2-2-2-05.opb	UNSAT	31.0962	31.2887	4814198
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-exit/normalized-phpexit_v1_06_096.opb	UNSAT	31.4507	31.6061	4812719
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-exit/normalized-phpexit_v1_26_048.opb	UNSAT	32.8545	33.0368	4812632
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ extended-even-colouring/grids_norational_opb/normalized-ec_grid_norational_06_130.opb	UNSAT	33.3454	33.5412	4812806
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat20_19_identity_complement.opb	UNSAT	33.8557	34.058	4814111
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/extended-even-colouring/ random_norational_opb/normalized-ec_random_norational_random8reg_split_350.opb	UNSAT	34.934	35.132	4812835
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ extended-even-colouring/grids_norational_opb/normalized-ec_grid_norational_03_270.opb	UNSAT	38.4776	38.6557	4812777
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq8/normalized-27array_alg_ineq8.opb	UNSAT	39.5453	39.7884	4813386
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900570242.opb	UNSAT	40.3204	40.5656	4798148
PB24/normalized-PB15eval/DEC-LIN/3COL-FromCNF/ normalized-3col-left3reg-l090-r089-n1.cnf-extracted.pb.metafix.opb	UNSAT	40.8078	41.2151	4801704
PB24/normalized-PB16/DEC-LIN/elffers/Instances3col_OPB/ normalized-3col-almost3reg-l045-r044-n1.opb	UNSAT	41.2597	41.4837	4802824
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl.opb	UNSAT	49.1597	49.6127	4796048
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Rlfap-ext-scen-11-f09_c18.opb	UNSAT	50.0825	50.3066	4814372
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ extended-even-colouring/grids_rational_opb/normalized-ec_grid_rational_06_210.opb	UNSAT	50.3584	50.5832	4812922
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-grids-v2_shuffle/normalized-grid8_87.shuf-3.opb	UNSAT	53.2061	53.4131	4811733
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq8/normalized-30array_alg_ineq8.opb	UNSAT	58.4333	58.7194	4813415
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/ec-stargrid-05_shuffle/normalized-ec_stargrid_05_033.shuf-1.opb	UNSAT	59.5149	59.7762	4810921
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x70split.cnf-extracted.pb.metafix.opb	UNSAT	60.5488	60.8457	4808514
PB24/normalized-PB15eval/DEC-LIN/3COL/ normalized-3col-left3reg-l020-r019-n1.opb	UNSAT	61.3728	61.876	4801564
PB24/normalized-PB15eval/DEC-LIN/3COL-FromCNF/ normalized-3col-left3reg-l030-r029-n1.cnf-plain.pb.metafix.opb	UNSAT	61.755	62.2391	4801760
PB24/normalized-PB15eval/DEC-LIN/3COL/ normalized-3col-left3reg-l030-r029-n1.opb	UNSAT	61.923	62.4204	4801648
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900575442.opb	UNSAT	62.1359	62.4597	4798428
PB24/normalized-PB24/DEC-LIN/nordstrom/ MIPLIB01/dec/miplib2/normalized-air02.0.u.opb	UNSAT	63.3388	63.6509	4810805
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height26_pigeons25_holes24.opb	UNSAT	63.5649	63.8055	4810254
PB24/normalized-PB16/DEC-LIN/elffers/Instances3col_OPB/ normalized-3col-almost3reg-l030-r029-n1.opb	UNSAT	63.5941	63.8198	4802768
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-exit/normalized-phpexit_v2_02_096.opb	UNSAT	63.6964	64.0335	4812661
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/larger/vc-lines-v4_shuffle/normalized-grid10_200.shuf-3.opb	UNSAT	65.5664	65.8516	4811675
PB24/normalized-PB15eval/DEC-LIN/3COL/ normalized-3col-left3reg-l090-r089-n1.opb	UNSAT	70.2376	70.7774	4801536
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height27_pigeons26_holes25.opb	UNSAT	79.715	80.0275	4810341
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2010/normalized-neos-859770.0.d.opb	UNSAT	80.0707	80.4204	4810747
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x20split.cnf-plain.pb.metafix.opb	UNSAT	84.929	85.3342	4808311
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl.opb	UNSAT	87.2744	87.9278	4796300
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl.opb	UNSAT	87.8288	88.429	4796076
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900562192.opb	UNSAT	88.1809	88.5199	4798456
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ inequalities/OPB/ineq7/normalized-22array_alg_ineq7.opb	UNSAT	88.5615	88.931	4809674
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-original/normalized-php_350_349.opb	UNSAT	89.2072	89.5529	4812023
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-original/normalized-php_370_369.opb	UNSAT	99.4476	99.8903	4811965
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-original/normalized-php_390_389.opb	UNSAT	107.805	108.262	4811994
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x90split.cnf-extracted.pb.metafix.opb	UNSAT	131.592	132.134	4808369
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/ec-stargrid-06_shuffle/normalized-ec_stargrid_06_045.shuf-1.opb	UNSAT	149.377	150.013	4810892
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ vertex-cover/vc-lines-v2_shuffle/normalized-grid8_63.shuf-1.opb	UNSAT	152.176	152.782	4811936
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900571132.opb	UNSAT	169.927	170.571	4798204
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900571761.opb	UNSAT	173.098	173.811	4798260
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression32_8.opb	UNSAT	178.101	178.705	4809210
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-36.opb	UNSAT	181.331	181.974	4799940
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height30_pigeons29_holes28.opb	UNSAT	194.624	195.25	4810370
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900669797.opb	UNSAT	196.693	197.398	4798064
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/ec-stargrid-04_shuffle/normalized-ec_stargrid_04_042.shuf-3.opb	UNSAT	203.993	204.675	4810834
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-ooo.ex.mem.LsqHdStrong.ucl.opb	UNSAT	216.964	218.05	4795992
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq8/normalized-32array_alg_ineq8.opb	UNSAT	222.582	223.332	4813444
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900667195.opb	UNSAT	240.425	241.348	4798092
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900582300.opb	UNSAT	268.306	269.329	4798288
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ domset/domset_large/normalized-domset-hexgrid_11_076.opb	UNSAT	281.973	282.979	4812371
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-08.opb	UNSAT	287.13	288.134	4800024
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/array_diag/normalized-14array_diag_less.opb	UNSAT	295.811	296.948	4813560
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression64_6.opb	UNSAT	322.082	323.102	4809239
PB24/normalized-PB16/DEC-LIN/elffers/ EC_ODD_GRIDS/normalized-ECgrid5x120split.opb	UNSAT	361.756	362.892	4802460
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq8/normalized-28array_ineq8.opb	UNSAT	405.517	406.817	4813473
PB24/normalized-PB16/DEC-LIN/elffers/ EC_ODD_GRIDS/normalized-ECgrid5x110split.opb	UNSAT	489.074	490.521	4802488
PB24/normalized-PB15eval/DEC-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/normalized-subsetCardinalitySigma-27-2.cnf.gz-plain.pb.metafix.opb	UNSAT	502.044	503.944	4801396
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/ec-stargrid-06/normalized-ec_stargrid_06_084.opb	UNSAT	540.431	542.473	4810979
PB24/normalized-PB15eval/DEC-LIN/ EC_ODD_GRIDS/normalized-ECgrid5x100split.opb	UNSAT	554.829	556.591	4801928
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x80split.cnf-extracted.pb.metafix.opb	UNSAT	665.477	667.532	4808282
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900561288.opb	UNSAT	676.596	679.072	4798232
PB24/normalized-PB16/DEC-LIN/elffers/ EC_ODD_GRIDS/normalized-ECgrid5x130split.opb	UNSAT	902.191	904.88	4802432
PB24/normalized-PB16/DEC-LIN/elffers/ EC_ODD_GRIDS/normalized-ECgrid5x150split.opb	UNSAT	1016.9	1020.35	4802404
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x30split.cnf-plain.pb.metafix.opb	UNSAT	1496.52	1501.37	4808485
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ even-colouring/grids_large_opb/normalized-ECgrid_split_5_050.opb	UNSAT	1506.16	1510.59	4811008
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression64_8.opb	UNSAT	1519.73	1525.81	4809094
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ inequalities/OPB/ineq10/normalized-17array_ineq10.opb	UNSAT	1538.86	1543.47	4809529
PB24/normalized-PB16/DEC-LIN/elffers/Instances3col_OPB/ normalized-3col-almost3reg-l060-r059-n1.opb	UNSAT	1550.94	1556.03	4802796
PB24/normalized-PB15eval/DEC-LIN/ECGRID-FromCNF/ normalized-ECgrid5x70split.cnf-plain.pb.metafix.opb	UNSAT	1558.18	1562.33	4808427
PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/ normalized-ooo.burch_dill.6.accl.ucl.opb	UNSAT	1586.35	1591.6	4796328
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ inequalities/OPB/ineq7/normalized-19array_ineq7.opb	UNSAT	1621.95	1626.99	4809645
PB24/normalized-PB16/DEC-LIN/elffers/ EC_ODD_GRIDS/normalized-ECgrid5x140split.opb	UNSAT	1736.17	1741.88	4802516
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n108-d3-i3-f.cnf.gz-plain.pb.metafix.opb	UNSAT	1913.32	1919.64	4801172
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-81-80.opb	UNSAT	2253.61	2263.19	4807992
PB24/normalized-PB16/DEC-LIN/quimper/ SyncCodes/d_n_k/normalized-5_6_30.opb	UNSAT	2523.3	2531.91	4809326
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-69.opb	UNSAT	2531.47	2539.44	4799996
PB24/normalized-PB10/DEC-LIN/oliveras/ j60/normalized-j6029_4-unsat.opb	UNSAT	3001.21	3010.17	4799296
PB24/normalized-PB15eval/DEC-LIN/3COL-FromCNF/ normalized-3col-almost3reg-l070-r069-n1.cnf-extracted.pb.metafix.opb	UNSAT	3026.57	3035.36	4801676

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PB24/normalized-PB10/DEC-LIN/leberre/opb-paranoid/ misc2010/datasets/caixa/normalized-1096.cudf.paranoid.opb	SAT	0.02877	0.093675	4799716
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110969933.opb	SAT	0.033226	0.120129	4798708
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110974553.opb	SAT	0.034112	0.105257	4798820
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1111226284.opb	SAT	0.03573	0.10467	4798848
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110971766.opb	SAT	0.036547	0.128686	4798512
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110977464.opb	SAT	0.037236	0.0992979	4798596
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110967327.opb	SAT	0.044451	0.14785	4798764
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r04_shuffle/normalized-domset-hexgrid_04_048.shuf-1.opb	SAT	0.045261	0.108322	4812545
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900581321.opb	SAT	0.0474	0.11079	4798316
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900553644.opb	SAT	0.053543	0.129438	4798120
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900669299.opb	SAT	0.059447	0.119611	4798344
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110977266.opb	SAT	0.061989	0.125178	4798540
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1110975678.opb	SAT	0.062093	0.131875	4798876
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/armies/normalized-army8.9ls.opb	SAT	0.065761	0.199276	4797168
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ wnqueen/normalized-t2001.13queen13.1111216188.opb	SAT	0.067809	0.131732	4798652
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900567939.opb	SAT	0.070551	0.183628	4798176
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army9.12ls.opb	SAT	0.072543	0.161864	4797224
PB24/normalized-PB06/DEC-LIN/submitted-PB06/namasivayam/ tsp/normalized-t3002.11tsp11.1900559365.opb	SAT	0.073369	0.136004	4798400
PB24/normalized-PB10/DEC-LIN/oliveras/ j30/normalized-j3042_9-sat.opb	SAT	0.073938	0.169622	4799492
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/armies/normalized-army8.9bt.opb	SAT	0.080519	0.212878	4797392
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r03_shuffle/normalized-domset-hexgrid_03_056.shuf-3.opb	SAT	0.08093	0.143028	4812197
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army10.14ls.opb	SAT	0.098387	0.226974	4797364
PB24/normalized-PB10/DEC-LIN/oliveras/ j30/normalized-j3027_9-sat.opb	SAT	0.098844	0.183146	4799464
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army11.17ls.opb	SAT	0.100956	0.202069	4797252
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-cuww4.opb	SAT	0.101027	0.195321	4799072
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib3/normalized-stein27.0.s.opb	SAT	0.104425	0.168963	4810457
PB24/normalized-PB24/DEC-LIN/nordstrom/ CombinatorialBenchmarksPBsolvers/domset/domset-fixedrows-r08-tiling/normalized-domset-hexgrid_08_052.opb	SAT	0.116039	0.193015	4812313
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army13.24ls.opb	SAT	0.116149	0.237325	4797336
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army9.12bt.opb	SAT	0.125436	0.222594	4797280
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-cuww1.opb	SAT	0.126728	0.213032	4799268
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army11.17bt.opb	SAT	0.154618	0.255382	4797196
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-HyperSudoku-03_c24.opb	SAT	0.167128	0.263671	4814314
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset_large_fixedcols_final/normalized-domset-hexgrid-fixedcols_04_036.opb	SAT	0.175284	0.255353	4812255
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army13.24bt.opb	SAT	0.178071	0.267279	4797308
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga13_11_sat_pb.cnf.cr.opb	SAT	0.236844	0.364483	4796692
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat99_identity_complement.opb	SAT	0.254368	0.339441	4814053
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-FRB-30-15-1_c18.opb	SAT	0.270077	0.364066	4814285
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r06_shuffle/normalized-domset-hexgrid_06_064.shuf-3.opb	SAT	0.272496	0.353302	4812458
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga25_24_sat_pb.cnf.cr.opb	SAT	0.313753	0.444696	4796608
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga30_30_sat_pb.cnf.cr.opb	SAT	0.35614	0.454302	4796664
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r06_shuffle/normalized-domset-hexgrid_06_068.shuf-3.opb	SAT	0.358474	0.433553	4812429
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga30_29_sat_pb.cnf.cr.opb	SAT	0.375462	0.492332	4796720
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/robin/normalized-robin8.opb	SAT	0.377701	0.625693	4797000
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/domset/ domset-fixedrows-r05_shuffle/normalized-domset-hexgrid_05_048.shuf-2.opb	SAT	0.378552	0.442763	4812139
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army10.14bt.opb	SAT	0.420193	0.530968	4797476
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga45_43_sat_pb.cnf.cr.opb	SAT	0.439067	0.560771	4796804
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat11_11_identity_complement.opb	SAT	0.454453	0.527691	4814169
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob6.opb	SAT	0.469354	0.557209	4799100
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga35_35_sat_pb.cnf.cr.opb	SAT	0.509475	0.919549	4796916
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression32_18.opb	SAT	0.529013	0.595263	4809123
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga45_45_sat_pb.cnf.cr.opb	SAT	0.530849	0.649333	4796580
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga45_44_sat_pb.cnf.cr.opb	SAT	0.57228	0.829428	4796972
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K109.opb	SAT	0.578743	0.646326	4800920
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K107.opb	SAT	0.625429	0.695184	4800892
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga35_34_sat_pb.cnf.cr.opb	SAT	0.639969	0.97545	4796944
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga40_39_sat_pb.cnf.cr.opb	SAT	0.716047	0.844142	4796748
PB24/normalized-PB06/DEC-LIN/web/www.ps.uni-sb.de/~walser/ benchmarks/ppp-problems/normalized-ppp:3-13,25,26.opb	SAT	0.761491	0.855859	4796468
PB24/normalized-PB06/DEC-LIN/web/www.ps.uni-sb.de/~walser/ benchmarks/ppp-problems/normalized-ppp:1-12,16.opb	SAT	0.790632	0.939793	4796552
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga30_28_sat_pb.cnf.cr.opb	SAT	0.859515	1.00878	4796832
PB24/normalized-PB06/DEC-LIN/web/www.ps.uni-sb.de/ ~walser/benchmarks/ppp-problems/normalized-ppp:1-13.opb	SAT	0.867845	1.02152	4796412
PB24/normalized-PB06/DEC-LIN/submitted-PB05/ aloul/FPGA_SAT05/normalized-fpga40_38_sat_pb.cnf.cr.opb	SAT	0.88083	1.02939	4796776
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat12_11_triangular.opb	SAT	0.951724	1.03798	4814024
PB24/normalized-PB06/DEC-LIN/web/www.ps.uni-sb.de/~walser/ benchmarks/ppp-problems/normalized-ppp:1,3-13,19.opb	SAT	1.01204	1.09466	4796496
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K108.opb	SAT	1.03301	1.10359	4800752
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army12.21ls.opb	SAT	1.07865	1.18995	4797448
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob8.opb	SAT	1.34223	1.419	4799156
PB24/normalized-PB06/DEC-LIN/web/www.ps.uni-sb.de/~walser/ benchmarks/ppp-problems/normalized-ppp:1-11,19,21.opb	SAT	1.5935	1.72583	4796524
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-cdc7-4-3-2.0.u.opb	SAT	1.60244	1.67602	4810486
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat15_15_identity_complement.opb	SAT	1.63023	1.72977	4813821
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat11_10_triangular.opb	SAT	1.80642	1.90347	4813850
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression64_26.opb	SAT	1.95613	2.02794	4809181
PB24/normalized-PB06/DEC-LIN/web/www.ps.uni-sb.de/~walser/ benchmarks/ppp-problems/normalized-ppp:1-9,16-19.opb	SAT	1.96791	2.13815	4796440
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob4.opb	SAT	2.05852	2.13872	4798960
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-neos-827015.0.u.opb	SAT	2.19809	2.26809	4810602
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathBA/normalized-BeauxArts_K76.opb	SAT	2.30952	2.39826	4801060
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_2.opb.PB06.opb	SAT	2.35258	2.43672	4797560
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat15_14_triangular.opb	SAT	2.36815	2.47253	4813879
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob10.opb	SAT	2.62374	2.69616	4798932
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathBA/normalized-BeauxArts_K73.opb	SAT	3.28663	3.36789	4800948
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_8.opb.PB06.opb	SAT	3.28691	3.38523	4797784
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-cuww2.opb	SAT	3.50887	3.5837	4799016
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_1.opb.PB06.opb	SAT	3.54399	3.64229	4797896
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathBA/normalized-BeauxArts_K75.opb	SAT	3.58959	3.68011	4800976
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-missinghole-random/normalized-php_missinghole_random_190_189.opb	SAT	3.83776	3.92228	4812052
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_3.opb.PB06.opb	SAT	3.97686	4.08957	4797588
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-cuww5.opb	SAT	4.15515	4.24042	4799128
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v30_e350_d15_mw10_9.opb.PB06.opb	SAT	4.40528	4.49763	4797812
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathBA/normalized-BeauxArts_K74.opb	SAT	4.46164	4.53991	4801032
PB25/normalized-PB25/DEC-LIN/koops/ normalized-mat19_19_identity_complement.opb	SAT	5.46994	5.54914	4814140
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw128/normalized-hw128-vm25p-dec.opb.negationfix.opb	SAT	5.9694	6.07653	4802068
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression64_23.opb	SAT	7.4725	7.56354	4809268
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/prestwich/armies/normalized-army12.21bt.opb	SAT	7.72908	7.8894	4797420
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_2.opb.PB06.opb	SAT	8.10283	8.22101	4797504
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/robin/normalized-robin10.opb	SAT	8.361	8.52284	4797084
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K199.opb	SAT	9.53409	9.65397	4800584
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_6.opb.PB06.opb	SAT	10.5928	10.7136	4797700
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_0.opb.PB06.opb	SAT	11.4006	11.5435	4797672
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_9.opb.PB06.opb	SAT	12.3047	12.4504	4797532
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v40_e600_d20_mw10_5.opb.PB06.opb	SAT	12.5976	12.7171	4797868
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-cuww3.opb	SAT	13.709	13.8342	4798904
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-FastMatrixMultiplication-table-3-1-3-09.opb	SAT	14.842	14.9655	4814459
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Soccer-20-25-20-1_c24.opb	SAT	14.992	15.1291	4814401
PB24/normalized-PB11/DEC-LIN/ heinz/normalized-neos-849702.opb	SAT	16.2436	16.3724	4799772
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K94.opb	SAT	18.9043	19.0336	4800864
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw128/normalized-hw128-vm75p-dec.opb.negationfix.opb	SAT	22.1143	22.2656	4802096
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K92.opb	SAT	22.1931	22.3877	4800724
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/robin/normalized-robin12.opb	SAT	24.2241	24.421	4797112
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-109.opb	SAT	24.3411	24.5071	4800052
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw128/normalized-hw128-vm85p-dec.opb.negationfix.opb	SAT	25.9137	26.076	4802152
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_6.opb.PB06.opb	SAT	26.7723	26.9585	4797616
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_9.opb.PB06.opb	SAT	26.8617	27.0418	4797728
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_3.opb.PB06.opb	SAT	26.8682	27.0615	4797840
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob1.opb	SAT	27.9004	28.0525	4799240
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw128/normalized-hw128-vm90p-dec.opb.negationfix.opb	SAT	30.1299	30.2914	4802012
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_5.opb.PB06.opb	SAT	30.4267	30.6073	4797644
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Soccer-28-30-20-1_c24.opb	SAT	31.0475	31.2309	4814575
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K191.opb	SAT	31.3209	31.5154	4800248
PB24/normalized-PB06/DEC-LIN/submitted-PB06/liu/dbst/ normalized-dbst_v50_e1000_d25_mw10_1.opb.PB06.opb	SAT	32.5572	32.7565	4797756
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw128/normalized-hw128-vm95p-dec.opb.negationfix.opb	SAT	32.5732	32.7641	4802124
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw128/normalized-hw128-vm98p-dec.opb.negationfix.opb	SAT	33.3767	33.5879	4801984
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-missinghole/normalized-php_missinghole_410_409.opb	SAT	35.6532	35.8746	4811095
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-missinghole-random/normalized-php_missinghole_random_390_389.opb	SAT	36.0298	36.2245	4812110
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ liu/vdw/normalized-vdw_k3_l5_n550.opb	SAT	37.3378	37.5538	4798008
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Soccer-30-24-20-1_c24.opb	SAT	41.7391	41.9357	4814256
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-missinghole/normalized-php_missinghole_450_449.opb	SAT	56.2258	56.5522	4811124
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-missinghole-random/normalized-php_missinghole_random_480_479.opb	SAT	57.5321	57.8696	4812081
PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/ php-missinghole/normalized-php_missinghole_500_499.opb	SAT	63.0561	63.3352	4811066
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K93.opb	SAT	64.4532	64.7637	4800668
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ liu/vdw/normalized-vdw_k4_l4_n360.opb	SAT	68.5067	68.8055	4797980
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression32_15.opb	SAT	72.498	72.7986	4809297
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ liu/vdw/normalized-vdw_k3_l6_n1500.opb	SAT	77.994	78.3934	4798036
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob2.opb	SAT	82.7828	83.0934	4799212
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K188.opb	SAT	90.0118	90.3556	4800388
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size96-round21-0.opb	SAT	94.789	95.2053	4808978
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw256/normalized-hw256-vm85p-dec.opb.negationfix.opb	SAT	122.998	123.433	4802236
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw256/normalized-hw256-vm95p-dec.opb.negationfix.opb	SAT	136.788	137.284	4802180
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K91.opb	SAT	136.869	137.398	4800808
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K181.opb	SAT	138.671	139.214	4800472
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ liu/vdw/normalized-vdw_k5_l4_n750.opb	SAT	140.767	141.339	4797952
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-162.opb	SAT	163.426	164.098	4800220
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size112-round21-3.opb	SAT	288.686	289.59	4808688
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K95.opb	SAT	412.143	413.647	4800780
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K195.opb	SAT	445.168	446.578	4800416
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-SolitairePattern-dec2-3-3-9.opb	SAT	554.178	555.661	4814604
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw512/normalized-hw512-vm25p-dec.opb.negationfix.opb	SAT	611.757	613.92	4802376
PB24/normalized-PB16/DEC-LIN/quimper/SyncCodes/ d-equals-n_k/normalized-compression32_14.opb	SAT	776.633	778.949	4809152
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-SolitairePattern-table-3-3-7.opb	SAT	941.464	944.615	4814430
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/robin/normalized-robin14.opb	SAT	1058.27	1062.1	4797056
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathBA/normalized-BeauxArts_K69.opb	SAT	1109.59	1113.52	4801004
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size144-round22-1.opb	SAT	1218.32	1222.66	4808804
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob5.opb	SAT	1496.99	1502.23	4799044
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size144-round22-2.opb	SAT	1527.05	1532.36	4808949
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size160-round21-7.opb	SAT	1541.38	1545.87	4808775
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size112-round22-3.opb	SAT	1591.03	1597.69	4808717
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size128-round22-9.opb	SAT	1772.99	1778.24	4808891
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob7.opb	SAT	1861.11	1867.31	4798988
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size160-round22-8.opb	SAT	2514.62	2521.96	4809007
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/robin/normalized-robin16.opb	SAT	3346.8	3358.6	4797140

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-WordSquare-tab2-11-ogd2008_c24.opb	?	2347.84	2353.92	4814488
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-bab2.0.s.opb	?	2443.61	2452.16	4810631
PB24/normalized-PB11/DEC-LIN/ heinz/normalized-neos-820157.opb	?	3581.18	3595.24	4799744
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K147.opb	?	3581.54	3595.51	4800556
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size96-round23-0.opb	?	3581.97	3595.15	4808862
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ prestwich/robin/normalized-robin18.opb	?	3582.18	3595.53	4797028
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ equalities/diag_spec/normalized-25diag_spec_greater.opb	?	3582.2	3595.17	4809848
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ equalities/wallace_spec/normalized-25wallace_spec_greater_tvars.opb	?	3582.23	3595.16	4809877
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size80-round23-5.opb	?	3582.37	3595.15	4808833
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/dec/ miplib2017/normalized-neos-4954274-beardy.0.u.opb	?	3582.38	3595.42	4810660
PB24/normalized-PB15eval/DEC-LIN/3COL/ normalized-3col-almost3reg-l100-r099-n1.opb	?	3582.44	3595.53	4801620
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K82.opb	?	3582.53	3595.22	4800696
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j1206_5-sat.opb	?	3582.65	3595.8	4799548
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-reblock354.0.u.opb	?	3582.79	3595.18	4810515
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j1207_4-sat.opb	?	3582.83	3595.56	4799604
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/equalities/ array_comm/arraycomm_teq_tvars/normalized-29arraycomm_teq_tvars_greater.opb	?	3582.83	3595.21	4809790
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ equalities/array_diag/normalized-19array_diag_less.opb	?	3582.89	3595.13	4809703
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ manquiho/Aardal_1/normalized-prob3.opb	?	3582.99	3595.15	4799184
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/equalities/ array_comm/arraycomm_teq/normalized-17arraycomm_teq_greater.opb	?	3583.02	3595.18	4809732
PB24/normalized-PB15eval/DEC-LIN/3COL-FromCNF/ normalized-3col-almost3reg-l080-r079-n1.cnf-extracted.pb.metafix.opb	?	3583.18	3595.5	4801788
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-133.opb	?	3583.19	3596.22	4799828
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-rail01.0.s.opb	?	3583.2	3596.6	4810573
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-121.opb	?	3583.3	3596.37	4800080
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K141.opb	?	3583.32	3595.48	4800276
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-174.opb	?	3583.47	3597.81	4800108
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ roussel/normalized-pigeon-clauses-105-100.opb	?	3583.5	3596.26	4807847
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-91-90.opb	?	3583.66	3596.45	4808137
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ equalities/array_comm/normalized-23arraycomm_teq_tvars_greater.opb	?	3583.69	3595.18	4813676
PB24/normalized-PB15eval/DEC-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/normalized-subsetCardinalitySigma-58-2.cnf.gz-plain.pb.metafix.opb	?	3583.76	3595.18	4801200
PB24/normalized-PB15eval/DEC-LIN/3COL-FromCNF/ normalized-3col-almost3reg-l100-r099-n1.cnf-extracted.pb.metafix.opb	?	3583.88	3595.53	4801816
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-fixed-bandwidth-38.cnf.gz-plain.pb.metafix.opb	?	3583.95	3595.42	4801424
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n200-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	?	3584.06	3595.58	4801452
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K157.opb	?	3584.08	3595.5	4800360
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n282-d3-i1-f.cnf.gz-plain.pb.metafix.opb	?	3584.1	3595.28	4801116
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-57.opb	?	3584.16	3595.42	4800136
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-81.opb	?	3584.21	3595.35	4800164
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ liu/vdw/normalized-vdw_k6_l3_n170.opb	?	3584.22	3595.34	4797924
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K127.opb	?	3584.23	3595.45	4800500
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K173.opb	?	3584.24	3595.6	4800612
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-169.opb	?	3584.29	3597.33	4799968
PB24/normalized-PB12/DEC-LIN/sroussel/ ShortestPathTate/normalized-TateBritain_K80.opb	?	3584.32	3596.11	4800836
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib3/normalized-seymour.0.u.opb	?	3584.42	3595.18	4810428
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j12052_3-unsat.opb	?	3584.44	3595.56	4799660
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-17.opb	?	3584.47	3595.31	4799856
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size112-round23-8.opb	?	3584.48	3595.16	4809036
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K145.opb	?	3584.49	3595.47	4800304
PB24/normalized-PB24/DEC-LIN/nordstrom/vliew-nonlinear-d139f28/ equalities/wallace_spec/normalized-18wallace_spec_greater_tvars.opb	?	3584.49	3595.15	4809906
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j12026_4-sat.opb	?	3584.56	3595.94	4799520
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Pentominoes-03-40_c24.opb	?	3584.67	3595.38	4814546
PB24/normalized-PB11/DEC-LIN/ heinz/normalized-neos-820146.opb	?	3584.75	3595.16	4799800
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size144-round23-0.opb	?	3584.82	3595.16	4808920
PB25/normalized-PB25/DEC-LIN/ koops/normalized-mat20_18_triangular.opb	?	3584.82	3596.1	4813937
PB24/normalized-PB15eval/DEC-LIN/ ProofComplexity-Extracted-Cardinality-Constraints/ProofComplexity/normalized-subsetCardinalitySigma-33-3.cnf.gz-plain.pb.metafix.opb	?	3584.87	3595.21	4801088
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n272-d3-i1-r1.cnf.gz-plain.pb.metafix.opb	?	3584.99	3595.26	4801256
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size128-round22-8.opb	?	3585.03	3595.19	4808746
PB24/normalized-PB24/DEC-LIN/devriendt/bitvector_multiplication_selection/ inequalities/ineq5/normalized-24array_ineq5.opb	?	3585.03	3595.24	4813502
PB24/normalized-PB06/DEC-LIN/submitted-PB06/ roussel/normalized-pigeon-clauses-101-100.opb	?	3585.05	3596.06	4808079
PB24/normalized-PB15eval/DEC-LIN/3COL/ normalized-3col-almost3reg-l090-r089-n1.opb	?	3585.13	3595.57	4801592
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib3/normalized-fast0507.0.s.opb	?	3585.4	3595.97	4810399
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n226-d3-i2-f.cnf.gz-plain.pb.metafix.opb	?	3585.5	3595.27	4801368
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-125.opb	?	3585.54	3597.24	4799884
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j12056_9-sat.opb	?	3585.95	3598.66	4799632
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n288-d3-i1-r2.cnf.gz-plain.pb.metafix.opb	?	3585.98	3595.27	4801228
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/hw128/ normalized-hw128-vm100p-dec.opb.negationfix.opb	?	3585.98	3597.6	4802040
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-Hamming-30-15-07-14_c24.opb	?	3586.03	3595.25	4814343
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n238-d3-i2-r2.cnf.gz-plain.pb.metafix.opb	?	3586.23	3596.4	4801284
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K170.opb	?	3586.3	3597.11	4800444
PB24/normalized-PB15eval/DEC-LIN/ProofComplexity-Extracted-Cardinality-Constraints/ ProofComplexity/normalized-tseitin-regular-n248-d3-i2-f.cnf.gz-plain.pb.metafix.opb	?	3586.32	3595.64	4801480
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-scpj4scip.0.s.opb	?	3586.76	3597.94	4810544
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K163.opb	?	3586.98	3599.45	4800332
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height44_pigeons43_holes42.opb	?	3588.94	3600.84	4810167
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height42_pigeons41_holes40.opb	?	3589.14	3599.73	4809993
PB24/normalized-PB10/DEC-LIN/oliveras/ j90/normalized-j909_2-unsat.opb	?	3589.56	3600.36	4799380
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height49_pigeons48_holes47.opb	?	3590.2	3603.21	4810109
PB24/normalized-PB24/DEC-LIN/nordstrom/composed_pebbling_php_pyramid/ dec/normalized-composed_pebbling_php_pyramid_height46_pigeons45_holes44.opb	?	3590.68	3600.92	4810225
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j12059_1-sat.opb	?	3592.05	3604.42	4799688
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K136.opb	?	3592.8	3605.24	4800528
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-190.opb	?	3597.22	3610.14	4799912
PB24/normalized-PB10/DEC-LIN/oliveras/ j90/normalized-j9013_8-unsat.opb	?	3599.89	3611.21	4799436

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PB24/normalized-PB10/DEC-LIN/oliveras/ j120/normalized-j12056_2-sat.opb	? (TO)	3600.04	3612.61	4799576
PB24/normalized-PB06/DEC-LIN/ submitted-PB06/roussel/normalized-pigeon-clauses-95-90.opb	? (TO)	3600.05	3613.71	4807963
PB24/normalized-PB11/DEC-LIN/ lopes/normalized-138.opb	? (TO)	3600.08	3612.62	4800192
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size160-round23-9.opb	? (TO)	3600.09	3613.72	4809065
PB24/normalized-PB10/DEC-LIN/oliveras/ j90/normalized-j9025_4-unsat.opb	? (TO)	3600.1	3612.71	4799352
PB24/normalized-PB12/DEC-LIN/ sroussel/ShortestPathNG/normalized-NG_K131.opb	? (TO)	3600.1	3613.13	4800640
PB24/normalized-PB16/DEC-LIN/nossum/ normalized-sha1-size80-round23-9.opb	? (TO)	3600.1	3611.13	4808659
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2010/normalized-tanglegram1.0.s.opb	? (TO)	3600.13	3612.61	4810776

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PB25/normalized-PB25/DEC-LIN/wallon/ normalized-SolitairePattern-table-3-3-9.opb	? (MO)	119.451	119.892	4814227
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw512/normalized-hw512-vm98p-dec.opb.negationfix.opb	? (MO)	227.353	228.261	4802292
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw512/normalized-hw512-vm99p-dec.opb.negationfix.opb	? (MO)	237.701	238.638	4802264
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw512/normalized-hw512-vm90p-dec.opb.negationfix.opb	? (MO)	240.403	241.209	4802320
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/hw256/ normalized-hw256-vm100p-dec.opb.negationfix.opb	? (MO)	644.913	647.278	4802208

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PB24/normalized-PB15eval/DEC-LIN/pbfvmc-formulae/ hw512/normalized-hw512-vm50p-dec.opb.negationfix.opb	? (problem)		740.065	742.417	4802348
PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/ dec/miplib2017/normalized-rmine21.0.u.opb	? (problem)		2055.38	2062.61	4810718

PB'26 competition: benchmarks results per solver

Result page for solver Hybrid-SynLSExact+CASHWMaxSATDisjComS v1 (complete)

Solver command line

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN)

Solver proved unsatisfiability (UNSATISFIABLE) (240 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (158 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (79 runs) [Show/Hide]

Solver timed out (no solution given) (8 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (5 runs) [Show/Hide]

No recognized solution line (2 runs) [Show/Hide]