WARNING: Parallel solvers do not appear in this ranking. Since in this ranking no specific limit is enforced by postprocessing, the PAR2 score of parallel solvers would be computed with their full CPU time. In other words, for parallel solvers, the limit is enforced on wall clock time, with is not the case for sequential solvers. The comparison between sequential and parallel solvers is not fair. Besides, the penalty of 2 times the CPU time limit wouldn't be significant.
This section presents the ranking of the different solvers. Solvers are ranked on the number of solved instances, i.e. where a final answer was given. Ties are broken by considering the minimum total solution time.
Solvers which gave a wrong answer in a category are excluded from the ranking in that category.
The Virtual Best Solver (VBS) is a theoretical construction which returns the best answer provided by one of the submitted solver. It corresponds to the 'Best result' column in the bench per bench view of the results. It can be considered as a meta solver which uses a perfect oracle to guess instantaneously which of the submitted solver will be the most efficient to solve the instance. Another way to look at it is to consider this VBS as a solver which would run all other solvers in parallel, bringing together all the solvers strenghs. This VBS is essentially the same notion as State Of The Art (SOTA) solver defined in "Evaluating general purpose automated theorem proving systems", Artificial Intelligence, Volume 131, Issues 1-2, September 2001, Pages 39-54 Geoff Sutcliffe, Christian Suttner. However, SOTA is a more general notion: the VBS can be seen as the least powerful SOTA solver.
| Rank | Solver | Version | PAR2 score | Number of solved instances | Detail | % of all instances | % of VBS | Cumulated CPU time on solved instances | Median CPU time | Average CPU time per solved instance | Cumulated WC time on solved instances | Median WC time | Average WC time per solved instance | CPU/WC | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Total number of instances in the category: 492 | |||||||||||||||
| Virtual Best Solver (VBS) | - | - | 464 | 183 SAT, 281 UNSAT | 94% | 100% | 82436.19 | 0.10 | 177.66 | - | - | - | - | ||
| 1 | Local-PB | 2026-05-14 | 704,150.2 | 399 | 155 SAT, 244 UNSAT | 81% | 86% | 34550.22 | 0.64 | 86.59 | 34664.43 | 0.64 | 86.88 | 1.00 | |
| 2 | Hybrid-SynLSExact+CASHWMaxSATDisjComS | v1 | 745,046.8 | 398 | 158 SAT, 240 UNSAT | 81% | 86% | 68246.81 | 6.83 | 171.47 | 68510.58 | 6.96 | 172.14 | 1.00 | |
| 3 | roundingsat-satsuma-MIR | 2026-06-11 | 746,148.3 | 393 | 144 SAT, 249 UNSAT | 80% | 85% | 33348.28 | 1.06 | 84.86 | 33484.74 | 1.08 | 85.20 | 1.00 | |
| 4 | roundingsat-satsuma-MIR | 2026-06-11 (cert) | 751,559.5 | 392 | 143 SAT, 5 UNSAT, 244 UNSATC | 80% | 84% | 31559.55 | 1.22 | 80.51 | 32005.39 | 1.31 | 81.65 | 0.99 | |
| 5 | Hybrid-SynLSExact+CASHWMaxSATDisjComS | v2 | 755,223.3 | 397 | 157 SAT, 240 UNSAT | 81% | 86% | 71223.27 | 6.79 | 179.40 | 71497.52 | 6.91 | 180.09 | 1.00 | |
| 6 | Hybrid-SynLSRS+CASHWMaxSATDisjComS | v1 | 765,389.1 | 398 | 159 SAT, 239 UNSAT | 81% | 86% | 88589.11 | 5.61 | 222.59 | 88934.59 | 5.72 | 223.45 | 1.00 | |
| 7 | Hybrid-SynLSRS+CASHWMaxSATDisjComS | v2 | 778,888.3 | 397 | 159 SAT, 238 UNSAT | 81% | 86% | 94888.26 | 4.92 | 239.01 | 95254.32 | 5.18 | 239.94 | 1.00 | |
| 8 | roundingsat-satsuma-liftedcover | 2026-06-11 | 789,325.7 | 389 | 141 SAT, 248 UNSAT | 79% | 84% | 47725.73 | 1.34 | 122.69 | 47912.35 | 1.37 | 123.17 | 1.00 | |
| 9 | roundingsat-satsuma-liftedcover | 2026-06-11 (cert) | 791,936.7 | 389 | 141 SAT, 13 UNSAT, 235 UNSATC | 79% | 84% | 50336.68 | 1.65 | 129.40 | 51916.32 | 2.20 | 133.46 | 0.97 | |
| 10 | cpmpy_ortools (1 core) | 2026-05-18 | 813,228.8 | 383 | 156 SAT, 227 UNSAT | 78% | 83% | 28428.77 | 2.49 | 74.23 | 28752.36 | 3.47 | 75.07 | 0.99 | |
| 11 | roundingsat-satsuma-saturation | 2026-06-11 | 826,064.7 | 383 | 140 SAT, 243 UNSAT | 78% | 83% | 41264.71 | 1.04 | 107.74 | 41412.59 | 1.11 | 108.13 | 1.00 | |
| 12 | SynLSExact | 2026-06-06 | 826,586.4 | 383 | 153 SAT, 230 UNSAT | 78% | 83% | 41786.43 | 6.19 | 109.10 | 41977.61 | 6.34 | 109.60 | 1.00 | |
| 13 | roundingsat-satsuma-saturation | 2026-06-11 (cert) | 832,519.4 | 382 | 139 SAT, 6 UNSAT, 237 UNSATC | 78% | 82% | 40519.43 | 1.21 | 106.07 | 41314.06 | 1.35 | 108.15 | 0.98 | |
| 14 | UWrMaxSat-SCIP | 2.0.4 | 853,709.6 | 383 | 154 SAT, 229 UNSAT | 78% | 83% | 68909.62 | 8.50 | 179.92 | 69146.13 | 8.53 | 180.54 | 1.00 | |
| 15 | SCIP-NaPS | scip-naps-1.00a2 | 871,182.0 | 385 | 159 SAT, 226 UNSAT | 78% | 83% | 100782.04 | 10.57 | 261.77 | 101138.55 | 10.49 | 262.70 | 1.00 | |
| 16 | NaPS | 1.04 | 878,202.9 | 384 | 158 SAT, 226 UNSAT | 78% | 83% | 100602.87 | 11.57 | 261.99 | 100960.81 | 11.64 | 262.92 | 1.00 | |
| 17 | SynLSRS | 2026-06-06 | 882,090.1 | 377 | 149 SAT, 228 UNSAT | 77% | 81% | 54090.15 | 3.99 | 143.48 | 54320.01 | 4.07 | 144.08 | 1.00 | |
| 18 | Exact | 2026-06-14 (cert) | 982,664.2 | 362 | 140 SAT, 6 UNSAT, 216 UNSATC | 74% | 78% | 46664.23 | 0.97 | 128.91 | 47834.23 | 1.01 | 132.14 | 0.98 | |
| 19 | Exact | 2026-06-14 | 1,001,279.4 | 359 | 138 SAT, 221 UNSAT | 73% | 77% | 43679.44 | 0.72 | 121.67 | 43831.60 | 0.72 | 122.09 | 1.00 | |
| 20 | Exact_symbreak | 2026-06-14 | 1,013,752.0 | 357 | 133 SAT, 224 UNSAT | 73% | 77% | 41752.03 | 0.77 | 116.95 | 41893.33 | 0.78 | 117.35 | 1.00 | |
| 21 | Exact_symlocal | 2026-06-14 | 1,024,729.7 | 355 | 134 SAT, 221 UNSAT | 72% | 77% | 38329.72 | 0.68 | 107.97 | 38461.79 | 0.68 | 108.34 | 1.00 | |
| 22 | cpmpy_highs (1 core) | 2026-07-05 | 1,172,469.9 | 336 | 132 SAT, 204 UNSAT | 68% | 72% | 49269.90 | 2.45 | 146.64 | 49590.89 | 3.22 | 147.59 | 0.99 | |
| 23 | AI448PBSolver | 2026-04-26 | 1,187,165.2 | 331 | 120 SAT, 211 UNSAT | 67% | 71% | 27965.20 | 0.28 | 84.49 | 28091.11 | 0.46 | 84.87 | 1.00 | |
| 24 | cpmpy_highs (1 core) | 2026-05-18 | 1,206,841.1 | 330 | 129 SAT, 201 UNSAT | 67% | 71% | 40441.07 | 2.60 | 122.55 | 40154.86 | 3.68 | 121.68 | 1.01 | |
| 25 | exact-printemps (1 core) (incomplete) | 2026-05-18 | 1,215,086.2 | 326 | 140 SAT, 186 UNSAT | 66% | 70% | 19886.16 | 2.52 | 61.00 | 19958.98 | 2.54 | 61.22 | 1.00 | |
| 26 | OR-Tools CP-SAT (1 core) | 2026-05-18 | 1,238,779.4 | 324 | 141 SAT, 183 UNSAT | 66% | 70% | 29179.37 | 0.91 | 90.06 | 29284.18 | 0.91 | 90.38 | 1.00 | |
| 27 | AY | 2026-07-11b | 1,343,662.9 | 315 | 120 SAT, 195 UNSAT | 64% | 68% | 69262.88 | 6.09 | 219.88 | 23329.15 | 2.18 | 74.06 | 2.97 | |
| 28 | Picat(kissat) | 2026-06-19 | 1,385,690.1 | 307 | 150 SAT, 157 UNSAT | 62% | 66% | 53690.06 | 3.32 | 174.89 | 53869.69 | 3.41 | 175.47 | 1.00 | |
| 29 | cpmpy_pindakaas_cadical | 2026-05-18 | 1,484,995.6 | 294 | 131 SAT, 163 UNSAT | 60% | 63% | 59395.63 | 9.24 | 202.03 | 59895.32 | 10.62 | 203.73 | 0.99 | |
| 30 | scip-printemps (1 core) (incomplete) | 2026-06-28 | 1,512,417.4 | 286 | 127 SAT, 159 UNSAT | 58% | 62% | 29217.41 | 0.62 | 102.16 | 29314.80 | 0.64 | 102.50 | 1.00 | |
| 31 | AY-cert | 2026-07-13-certfix (cert) | 1,621,802.6 | 273 | 115 SAT, 158 UNSATC | 55% | 59% | 45002.63 | 1.49 | 164.84 | 44714.93 | 1.60 | 163.79 | 1.01 | |
| 32 | AY | 0.11.0 | 1,712,559.7 | 289 | 112 SAT, 177 UNSAT | 59% | 62% | 250959.70 | 113.86 | 868.37 | 251780.07 | 114.45 | 871.21 | 1.00 | |
| 33 | Sat4j Resolution | 2026-06-10 | 1,739,486.4 | 258 | 115 SAT, 143 UNSAT | 52% | 56% | 54686.43 | 3.05 | 211.96 | 54140.89 | 1.73 | 209.85 | 1.01 | |
| 34 | Sat4j Resolution CERT | 2026-05-20 (cert) | 1,743,730.6 | 258 | 115 SAT, 143 UNSATC | 52% | 56% | 58930.61 | 4.13 | 228.41 | 59291.60 | 2.10 | 229.81 | 0.99 | |
| 35 | Sat4j CuttingPlanes | 2026-06-10 | 2,002,352.2 | 219 | 68 SAT, 151 UNSAT | 45% | 47% | 36752.25 | 4.58 | 167.82 | 35775.46 | 1.92 | 163.36 | 1.03 | |
| 36 | Sat4j CuttingPlanes CERT | 2026-06-10 (cert) | 2,002,704.0 | 219 | 68 SAT, 151 UNSATC | 45% | 47% | 37103.99 | 4.90 | 169.42 | 36142.21 | 2.14 | 165.03 | 1.03 | |
| 37 | PRINTEMPS (1 core) (incomplete) | 2026-05-18 | 2,668,848.9 | 124 | 122 SAT, 2 UNSAT | 25% | 27% | 19248.92 | 1.71 | 155.23 | 19269.24 | 1.70 | 155.40 | 1.00 | |
| Rank | Solver | Version | PAR2 score | Number of solved instances | Detail | % of all instances | % of VBS | Cumulated CPU time on solved instances | Median CPU time | Average CPU time per solved instance | Cumulated WC time on solved instances | Median WC time | Average WC time per solved instance | CPU/WC | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Total number of instances in the category: 10 | |||||||||||||||
| Virtual Best Solver (VBS) | - | - | 10 | 6 SAT, 4 UNSAT | 100% | 100% | 1061.24 | 0.15 | 106.12 | - | - | - | - | ||
| 1 | scip-printemps (1 core) (incomplete) | 2026-06-28 | 15,099.2 | 8 | 6 SAT, 2 UNSAT | 80% | 80% | 699.19 | 0.28 | 87.40 | 701.42 | 0.29 | 87.68 | 1.00 | |
| 2 | exact-printemps (1 core) (incomplete) | 2026-05-18 | 15,254.1 | 8 | 6 SAT, 2 UNSAT | 80% | 80% | 854.12 | 0.10 | 106.76 | 856.95 | 0.15 | 107.12 | 1.00 | |
| 3 | Picat(kissat) | 2026-06-19 | 15,354.1 | 8 | 4 SAT, 4 UNSAT | 80% | 80% | 954.07 | 0.76 | 119.26 | 957.48 | 0.78 | 119.68 | 1.00 | |
| 4 | UWrMaxSat-SCIP | 2.0.4 | 18,131.3 | 8 | 4 SAT, 4 UNSAT | 80% | 80% | 3731.35 | 0.80 | 466.42 | 3743.52 | 0.81 | 467.94 | 1.00 | |
| 5 | UWrMaxSat-SCIP | 2.0.3 | 18,219.5 | 8 | 4 SAT, 4 UNSAT | 80% | 80% | 3819.48 | 0.82 | 477.43 | 3833.97 | 0.83 | 479.25 | 1.00 | |
| 6 | Exact_symbreak | 2026-06-14 | 28,800.4 | 6 | 4 SAT, 2 UNSAT | 60% | 60% | 0.39 | 0.03 | 0.07 | 0.39 | 0.03 | 0.07 | 0.99 | |
| 7 | Exact_symlocal | 2026-06-14 | 28,800.4 | 6 | 4 SAT, 2 UNSAT | 60% | 60% | 0.38 | 0.03 | 0.06 | 0.39 | 0.03 | 0.07 | 0.98 | |
| 8 | Exact | 2026-06-14 | 28,800.4 | 6 | 4 SAT, 2 UNSAT | 60% | 60% | 0.37 | 0.03 | 0.06 | 0.37 | 0.03 | 0.06 | 0.99 | |
| 9 | OR-Tools CP-SAT (1 core) | 2026-05-18 | 28,803.3 | 6 | 4 SAT, 2 UNSAT | 60% | 60% | 3.33 | 0.24 | 0.56 | 3.35 | 0.24 | 0.56 | 0.99 | |
| 10 | AY | 2026-07-11b | 28,835.1 | 6 | 4 SAT, 2 UNSAT | 60% | 60% | 35.11 | 4.17 | 5.85 | 18.34 | 2.16 | 3.06 | 1.91 | |
| 11 | AY | 0.11.0 | 28,855.2 | 6 | 4 SAT, 2 UNSAT | 60% | 60% | 55.16 | 2.48 | 9.19 | 55.57 | 2.52 | 9.26 | 0.99 | |
| 12 | PRINTEMPS (1 core) (incomplete) | 2026-05-18 | 28,956.4 | 6 | 6 SAT | 60% | 60% | 156.39 | 0.77 | 26.07 | 156.55 | 0.67 | 26.09 | 1.00 | |
| 13 | Sat4j Resolution | 2026-06-10 | 50,401.3 | 3 | 1 SAT, 2 UNSAT | 30% | 30% | 1.27 | 0.20 | 0.42 | 0.59 | 0.13 | 0.20 | 2.14 | |
| 14 | Sat4j CuttingPlanes | 2026-06-10 | 72,000.0 | 0 | 0% | 0% | 0.00 | 0.00 | - | 0.00 | 0.00 | - | - | ||
| Rank | Solver | Version | PAR2 score | Number of solved instances | Detail | % of all instances | % of VBS | Cumulated CPU time on solved instances | Median CPU time | Average CPU time per solved instance | Cumulated WC time on solved instances | Median WC time | Average WC time per solved instance | CPU/WC | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Total number of instances in the category: 585 | |||||||||||||||
| Virtual Best Solver (VBS) | - | - | 444 | 425 OPT, 19 UNSAT | 76% | 100% | 296414.90 | 0.47 | 667.60 | - | - | - | - | ||
| 1 | Local-PB | 2026-05-14 | 1,607,474.2 | 369 | 353 OPT, 16 UNSAT | 63% | 83% | 52274.20 | 0.70 | 141.66 | 52448.22 | 0.70 | 142.14 | 1.00 | |
| 2 | UWrMaxSat-SCIP | 2.0.4 | 1,758,090.3 | 348 | 331 OPT, 17 UNSAT | 59% | 78% | 51690.29 | 3.12 | 148.54 | 51859.63 | 3.13 | 149.02 | 1.00 | |
| 3 | SCIP-NaPS | scip-naps-1.00a2 | 1,854,662.9 | 340 | 323 OPT, 17 UNSAT | 58% | 77% | 90662.90 | 3.98 | 266.66 | 90993.14 | 4.33 | 267.63 | 1.00 | |
| 4 | UWrMaxSat-SCIP | 2.0.3 | 1,855,028.5 | 334 | 317 OPT, 17 UNSAT | 57% | 75% | 47828.46 | 2.59 | 143.20 | 47984.73 | 2.60 | 143.67 | 1.00 | |
| 5 | AutoAdaptRoundingSat | 2026-06-08 | 1,894,517.1 | 331 | 317 OPT, 14 UNSAT | 57% | 75% | 65717.08 | 61.13 | 198.54 | 65960.46 | 61.56 | 199.28 | 1.00 | |
| 6 | Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat | v2 | 1,911,915.3 | 354 | 338 OPT, 16 UNSAT | 61% | 80% | 248715.30 | 127.02 | 702.59 | 249586.79 | 127.57 | 705.05 | 1.00 | |
| 7 | WMaxCDCL-S9 | 2026-05-17 | 1,919,247.6 | 333 | 319 OPT, 14 UNSAT | 57% | 75% | 104847.63 | 5.37 | 314.86 | 105213.46 | 5.61 | 315.96 | 1.00 | |
| 8 | Hybrid-CASHWMaxSATDisjComS-AdaptExact | v1 | 1,924,261.2 | 331 | 315 OPT, 16 UNSAT | 57% | 75% | 95461.17 | 2.82 | 288.40 | 95834.33 | 3.11 | 289.53 | 1.00 | |
| 9 | Hybrid-CASHWMaxSATDisjComS-AdaptExact | v2 | 1,926,803.6 | 331 | 315 OPT, 16 UNSAT | 57% | 75% | 98003.61 | 2.83 | 296.08 | 98374.27 | 3.05 | 297.20 | 1.00 | |
| 10 | Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat | v1 | 1,927,025.3 | 351 | 335 OPT, 16 UNSAT | 60% | 79% | 242225.27 | 110.19 | 690.10 | 243065.35 | 110.60 | 692.49 | 1.00 | |
| 11 | Qiuqi (1 core) | 2026-06-15 | 1,928,385.5 | 328 | 313 OPT, 15 UNSAT | 56% | 74% | 77985.53 | 71.21 | 237.76 | 78259.54 | 71.45 | 238.60 | 1.00 | |
| 12 | roundingsat-satsuma-opt | 2026-06-11 | 1,935,528.2 | 322 | 309 OPT, 13 UNSAT | 55% | 73% | 41928.22 | 1.43 | 130.21 | 42077.58 | 1.49 | 130.68 | 1.00 | |
| 13 | roundingsat-opt | 2026-06-11 | 1,944,047.8 | 321 | 308 OPT, 13 UNSAT | 55% | 72% | 43247.80 | 1.07 | 134.73 | 43408.42 | 1.11 | 135.23 | 1.00 | |
| 14 | NaPS | 1.04 | 1,945,753.8 | 323 | 306 OPT, 17 UNSAT | 55% | 73% | 59353.82 | 2.77 | 183.76 | 59574.02 | 2.80 | 184.44 | 1.00 | |
| 15 | roundingsat-satsuma-opt | 2026-06-11 (cert) | 1,954,918.0 | 319 | 11 OPT, 295 OPTC, 13 UNSATC | 55% | 72% | 39718.04 | 1.76 | 124.51 | 41340.59 | 1.84 | 129.59 | 0.96 | |
| 16 | roundingsat-opt | 2026-06-11 (cert) | 1,963,255.1 | 318 | 1 OPT, 304 OPTC, 13 UNSATC | 54% | 72% | 40855.10 | 1.16 | 128.48 | 41943.06 | 1.70 | 131.90 | 0.97 | |
| 17 | Exact | 2026-06-14 | 2,024,347.0 | 311 | 296 OPT, 15 UNSAT | 53% | 70% | 51547.02 | 1.22 | 165.75 | 51723.42 | 1.22 | 166.31 | 1.00 | |
| 18 | Exact_symlocal | 2026-06-14 | 2,033,160.1 | 310 | 295 OPT, 15 UNSAT | 53% | 70% | 53160.07 | 1.44 | 171.48 | 53337.46 | 1.45 | 172.06 | 1.00 | |
| 19 | HitPBO | 2026-06-22 | 2,046,728.9 | 308 | 299 OPT, 9 UNSAT | 53% | 69% | 52328.88 | 1.13 | 169.90 | 52500.28 | 1.15 | 170.46 | 1.00 | |
| 20 | Exact_symbreak | 2026-06-14 | 2,049,355.2 | 307 | 292 OPT, 15 UNSAT | 52% | 69% | 47755.16 | 1.62 | 155.55 | 47918.93 | 1.62 | 156.09 | 1.00 | |
| 21 | AutoAdaptRoundingSat | v2 | 2,052,434.7 | 327 | 313 OPT, 14 UNSAT | 56% | 74% | 194834.69 | 600.70 | 595.82 | 195428.96 | 602.72 | 597.64 | 1.00 | |
| 22 | AdaptExact | 2026-06-08 | 2,060,955.7 | 306 | 291 OPT, 15 UNSAT | 52% | 69% | 52155.74 | 1.80 | 170.44 | 52365.89 | 1.98 | 171.13 | 1.00 | |
| 23 | AdaptExact | v2 | 2,061,389.3 | 306 | 291 OPT, 15 UNSAT | 52% | 69% | 52589.27 | 1.81 | 171.86 | 52811.22 | 1.96 | 172.59 | 1.00 | |
| 24 | Exact | 2026-06-14 (cert) | 2,125,312.2 | 297 | 35 OPT, 247 OPTC, 15 UNSATC | 51% | 67% | 51712.21 | 1.90 | 174.12 | 52886.05 | 2.10 | 178.07 | 0.98 | |
| 25 | cpmpy_ortools (1 core) | 2026-07-14 | 2,172,999.0 | 289 | 276 OPT, 13 UNSAT | 49% | 65% | 41798.99 | 2.08 | 144.63 | 43364.61 | 10.07 | 150.05 | 0.96 | |
| 26 | cpmpy_ortools (1 core) | 2026-05-18 | 2,187,296.7 | 287 | 274 OPT, 13 UNSAT | 49% | 65% | 41696.65 | 2.10 | 145.28 | 42029.76 | 3.13 | 146.45 | 0.99 | |
| 27 | roundingsat-ihs | 2026-06-11 | 2,209,592.6 | 283 | 270 OPT, 13 UNSAT | 48% | 64% | 35192.62 | 1.10 | 124.36 | 35313.06 | 1.16 | 124.78 | 1.00 | |
| 28 | roundingsat-ihs | 2026-06-11 (cert) | 2,214,194.2 | 283 | 1 OPT, 269 OPTC, 1 UNSAT, 12 UNSATC | 48% | 64% | 39794.20 | 1.26 | 140.62 | 42143.42 | 1.37 | 148.92 | 0.94 | |
| 29 | cpmpy_highs (1 core) | 2026-07-05 | 2,281,374.7 | 277 | 266 OPT, 11 UNSAT | 47% | 62% | 63774.72 | 2.64 | 230.23 | 64115.66 | 3.41 | 231.46 | 0.99 | |
| 30 | scip-printemps (1 core) (incomplete) | 2026-06-28 | 2,314,974.4 | 264 | 249 OPT, 15 UNSAT | 45% | 59% | 3774.39 | 0.57 | 14.30 | 3801.74 | 0.81 | 14.40 | 0.99 | |
| 31 | cpmpy_highs (1 core) | 2026-07-14 | 2,321,452.8 | 270 | 259 OPT, 11 UNSAT | 46% | 61% | 53452.84 | 2.60 | 197.97 | 54153.51 | 4.47 | 200.57 | 0.99 | |
| 32 | WMaxCDCL | 2026-05-17 | 2,414,370.4 | 258 | 248 OPT, 10 UNSAT | 44% | 58% | 59970.36 | 6.10 | 232.44 | 60183.78 | 6.15 | 233.27 | 1.00 | |
| 33 | exact-printemps (1 core) (incomplete) | 2026-05-18 | 2,438,733.3 | 247 | 233 OPT, 14 UNSAT | 42% | 56% | 5133.26 | 1.49 | 20.78 | 5152.83 | 1.50 | 20.86 | 1.00 | |
| 34 | HitPBO-PL | 2026-06-22 (cert) | 2,467,609.0 | 248 | 14 OPT, 220 OPTC, 14 UNSATC | 42% | 56% | 41208.96 | 0.83 | 166.17 | 41894.66 | 0.87 | 168.93 | 0.98 | |
| 35 | OR-Tools CP-SAT (1 core) | 2026-05-18 | 2,588,680.5 | 230 | 215 OPT, 15 UNSAT | 39% | 52% | 32680.55 | 0.24 | 142.09 | 32798.43 | 0.24 | 142.60 | 1.00 | |
| 36 | Picat(kissat) | 2026-06-19 | 2,592,555.9 | 235 | 220 OPT, 15 UNSAT | 40% | 53% | 72555.87 | 8.59 | 308.75 | 72779.24 | 8.63 | 309.70 | 1.00 | |
| 37 | AY | 2026-07-11b | 2,632,332.9 | 226 | 214 OPT, 12 UNSAT | 39% | 51% | 47532.90 | 9.58 | 210.32 | 19630.26 | 3.25 | 86.86 | 2.42 | |
| 38 | Sat4j Resolution | 2026-06-10 | 3,131,532.8 | 153 | 141 OPT, 12 UNSAT | 26% | 34% | 21132.78 | 1.49 | 138.12 | 20957.80 | 0.57 | 136.98 | 1.01 | |
| 39 | Sat4j Resolution CERT | 2026-05-20 (cert) | 3,136,626.2 | 152 | 3 OPT, 137 OPTC, 12 UNSATC | 26% | 34% | 19026.21 | 1.69 | 125.17 | 19159.45 | 0.78 | 126.05 | 0.99 | |
| 40 | Sat4j CuttingPlanes | 2026-06-10 | 3,166,250.6 | 148 | 137 OPT, 11 UNSAT | 25% | 33% | 19850.59 | 2.40 | 134.13 | 19378.00 | 0.97 | 130.93 | 1.02 | |
| 41 | Sat4j CuttingPlanes CERT | 2026-06-10 (cert) | 3,166,727.8 | 148 | 137 OPTC, 11 UNSATC | 25% | 33% | 20327.83 | 2.41 | 137.35 | 20034.65 | 1.58 | 135.37 | 1.01 | |
| 42 | AY | 0.11.0 | 3,226,223.9 | 150 | 138 OPT, 12 UNSAT | 26% | 34% | 94223.92 | 7.16 | 628.16 | 94552.08 | 7.20 | 630.35 | 1.00 | |
| 43 | AY-cert | 2026-07-13-certfix (cert) | 4,140,000.3 | 10 | 10 UNSATC | 2% | 2% | 0.32 | 0.04 | 0.03 | 0.47 | 0.05 | 0.05 | 0.67 | |
| 44 | PRINTEMPS (1 core) (incomplete) | 2026-05-18 | 4,140,001.8 | 10 | 10 UNSAT | 2% | 2% | 1.81 | 0.21 | 0.18 | 0.95 | 0.11 | 0.09 | 1.91 | |
| 45 | DivingFalconSolver (1 core) | 2026-06-12 | 4,179,606.0 | 5 | 5 OPT | 1% | 1% | 3606.02 | 1.34 | 721.20 | 3621.92 | 3.36 | 724.38 | 1.00 | |
| Rank | Solver | Version | PAR2 score | Number of solved instances | Detail | % of all instances | % of VBS | Cumulated CPU time on solved instances | Median CPU time | Average CPU time per solved instance | Cumulated WC time on solved instances | Median WC time | Average WC time per solved instance | CPU/WC | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Total number of instances in the category: 64 | |||||||||||||||
| Virtual Best Solver (VBS) | - | - | 36 | 36 OPT | 56% | 100% | 70860.23 | 0.05 | 1968.34 | - | - | - | - | ||
| 1 | UWrMaxSat-SCIP | 2.0.3 | 224,927.6 | 33 | 33 OPT | 52% | 92% | 1727.62 | 0.20 | 52.35 | 1733.22 | 0.20 | 52.52 | 1.00 | |
| 2 | UWrMaxSat-SCIP | 2.0.4 | 224,929.1 | 33 | 33 OPT | 52% | 92% | 1729.05 | 0.20 | 52.40 | 1734.86 | 0.21 | 52.57 | 1.00 | |
| 3 | scip-printemps (1 core) (incomplete) | 2026-06-28 | 244,897.7 | 30 | 30 OPT | 47% | 83% | 97.68 | 0.35 | 3.26 | 98.69 | 0.37 | 3.29 | 0.99 | |
| 4 | OR-Tools CP-SAT (1 core) | 2026-05-18 | 259,274.1 | 28 | 28 OPT | 44% | 78% | 74.09 | 0.05 | 2.65 | 74.38 | 0.05 | 2.66 | 1.00 | |
| 5 | Exact_symlocal | 2026-06-14 | 259,455.4 | 28 | 28 OPT | 44% | 78% | 255.42 | 0.30 | 9.12 | 256.32 | 0.31 | 9.15 | 1.00 | |
| 6 | Exact_symbreak | 2026-06-14 | 259,533.0 | 28 | 28 OPT | 44% | 78% | 333.01 | 0.25 | 11.89 | 334.07 | 0.25 | 11.93 | 1.00 | |
| 7 | Exact | 2026-06-14 | 259,544.3 | 28 | 28 OPT | 44% | 78% | 344.31 | 0.24 | 12.30 | 345.59 | 0.24 | 12.34 | 1.00 | |
| 8 | exact-printemps (1 core) (incomplete) | 2026-05-18 | 259,633.9 | 28 | 28 OPT | 44% | 78% | 433.90 | 0.16 | 15.50 | 435.98 | 0.22 | 15.57 | 1.00 | |
| 9 | Picat(kissat) | 2026-06-19 | 260,816.9 | 28 | 28 OPT | 44% | 78% | 1616.93 | 0.06 | 57.75 | 1622.58 | 0.09 | 57.95 | 1.00 | |
| 10 | Sat4j Resolution | 2026-06-10 | 281,553.3 | 25 | 25 OPT | 39% | 69% | 753.35 | 4.42 | 30.13 | 719.65 | 2.86 | 28.79 | 1.05 | |
| 11 | AY | 0.11.0 | 327,892.3 | 20 | 20 OPT | 31% | 56% | 11092.26 | 720.77 | 554.61 | 11123.54 | 722.70 | 556.18 | 1.00 | |
| 12 | Sat4j CuttingPlanes | 2026-06-10 | 339,778.7 | 17 | 17 OPT | 27% | 47% | 1378.69 | 2.63 | 81.10 | 1331.51 | 0.91 | 78.32 | 1.04 | |
| 13 | AY | 2026-07-11b | 396,235.9 | 10 | 10 OPT | 16% | 28% | 7435.94 | 724.91 | 743.59 | 7461.48 | 727.23 | 746.15 | 1.00 | |
| 14 | PRINTEMPS (1 core) (incomplete) | 2026-05-18 | 460,800.0 | 0 | 0% | 0% | 0.00 | 0.00 | - | 0.00 | 0.00 | - | - | ||