PB'26 competition: ranking of solvers
All selected instances (including those not supported by some solvers)
max WC time for any solver=3601 s

Ranking on final answers (complete solver point of view)

This section presents the ranking of the different solvers. Solvers are ranked on the number of solved instances, i.e. where a final answer was given. Ties are broken by considering the minimum total solution time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

The Virtual Best Solver (VBS) is a theoretical construction which returns the best answer provided by one of the submitted solver. It corresponds to the 'Best result' column in the bench per bench view of the results. It can be considered as a meta solver which uses a perfect oracle to guess instantaneously which of the submitted solver will be the most efficient to solve the instance. Another way to look at it is to consider this VBS as a solver which would run all other solvers in parallel, bringing together all the solvers strenghs. This VBS is essentially the same notion as State Of The Art (SOTA) solver defined in "Evaluating general purpose automated theorem proving systems", Artificial Intelligence, Volume 131, Issues 1-2, September 2001, Pages 39-54 Geoff Sutcliffe, Christian Suttner. However, SOTA is a more general notion: the VBS can be seen as the least powerful SOTA solver.

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN): SAT+UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 492
Virtual Best Solver (VBS)			-	-	464	183 SAT, 281 UNSAT	94%	100%	82436.19	0.10	177.66	-	-	-	-
1	cpmpy_ortools (16 cores)	2026-07-14	890,864.2	419	166 SAT, 253 UNSAT	85%	90%	365264.18	4.97	871.75	26020.23	1.56	62.10	14.04
2	OR-Tools CP-SAT (16 cores)	2026-05-18	952,025.9	418	166 SAT, 252 UNSAT	85%	90%	419225.88	2.44	1002.93	27246.11	0.39	65.18	15.39
3	Local-PB	2026-05-14	704,150.2	399	155 SAT, 244 UNSAT	81%	86%	34550.22	0.64	86.59	34664.43	0.64	86.88	1.00
4	Hybrid-SynLSExact+CASHWMaxSATDisjComS	v1	745,046.8	398	158 SAT, 240 UNSAT	81%	86%	68246.81	6.83	171.47	68510.58	6.96	172.14	1.00
5	Hybrid-SynLSRS+CASHWMaxSATDisjComS	v1	765,389.1	398	159 SAT, 239 UNSAT	81%	86%	88589.11	5.61	222.59	88934.59	5.72	223.45	1.00
6	Hybrid-SynLSExact+CASHWMaxSATDisjComS	v2	755,223.3	397	157 SAT, 240 UNSAT	81%	86%	71223.27	6.79	179.40	71497.52	6.91	180.09	1.00
7	Hybrid-SynLSRS+CASHWMaxSATDisjComS	v2	778,888.3	397	159 SAT, 238 UNSAT	81%	86%	94888.26	4.92	239.01	95254.32	5.18	239.94	1.00
8	roundingsat-satsuma-MIR	2026-06-11	746,148.3	393	144 SAT, 249 UNSAT	80%	85%	33348.28	1.06	84.86	33484.74	1.08	85.20	1.00
9	roundingsat-satsuma-MIR	2026-06-11 (cert)	751,559.5	392	143 SAT, 5 UNSAT, 244 UNSATC	80%	84%	31559.55	1.22	80.51	32005.39	1.31	81.65	0.99
10	roundingsat-satsuma-liftedcover	2026-06-11	789,325.7	389	141 SAT, 248 UNSAT	79%	84%	47725.73	1.34	122.69	47912.35	1.37	123.17	1.00
11	roundingsat-satsuma-liftedcover	2026-06-11 (cert)	799,142.0	387	140 SAT, 12 UNSAT, 235 UNSATC	79%	83%	43142.05	1.57	111.48	44597.79	2.12	115.24	0.97
12	SCIP-NaPS	scip-naps-1.00a2	871,182.0	385	159 SAT, 226 UNSAT	78%	83%	100782.04	10.57	261.77	101138.55	10.49	262.70	1.00
13	NaPS	1.04	878,202.9	384	158 SAT, 226 UNSAT	78%	83%	100602.87	11.57	261.99	100960.81	11.64	262.92	1.00
14	cpmpy_ortools (1 core)	2026-05-18	813,228.8	383	156 SAT, 227 UNSAT	78%	83%	28428.77	2.49	74.23	28752.36	3.47	75.07	0.99
15	roundingsat-satsuma-saturation	2026-06-11	826,064.7	383	140 SAT, 243 UNSAT	78%	83%	41264.71	1.04	107.74	41412.59	1.11	108.13	1.00
16	SynLSExact	2026-06-06	826,586.4	383	153 SAT, 230 UNSAT	78%	83%	41786.43	6.19	109.10	41977.61	6.34	109.60	1.00
17	UWrMaxSat-SCIP	2.0.4	853,709.6	383	154 SAT, 229 UNSAT	78%	83%	68909.62	8.50	179.92	69146.13	8.53	180.54	1.00
18	roundingsat-satsuma-saturation	2026-06-11 (cert)	832,519.4	382	139 SAT, 6 UNSAT, 237 UNSATC	78%	82%	40519.43	1.21	106.07	41314.06	1.35	108.15	0.98
19	SynLSRS	2026-06-06	882,090.1	377	149 SAT, 228 UNSAT	77%	81%	54090.15	3.99	143.48	54320.01	4.07	144.08	1.00
20	Exact	2026-06-14 (cert)	982,664.2	362	140 SAT, 6 UNSAT, 216 UNSATC	74%	78%	46664.23	0.97	128.91	47834.23	1.01	132.14	0.98
21	Exact	2026-06-14	1,001,279.4	359	138 SAT, 221 UNSAT	73%	77%	43679.44	0.72	121.67	43831.60	0.72	122.09	1.00
22	Exact_symbreak	2026-06-14	1,013,752.0	357	133 SAT, 224 UNSAT	73%	77%	41752.03	0.77	116.95	41893.33	0.78	117.35	1.00
23	Exact_symlocal	2026-06-14	1,024,729.7	355	134 SAT, 221 UNSAT	72%	77%	38329.72	0.68	107.97	38461.79	0.68	108.34	1.00
24	cpmpy_highs (1 core)	2026-07-05	1,172,469.9	336	132 SAT, 204 UNSAT	68%	72%	49269.90	2.45	146.64	49590.89	3.22	147.59	0.99
25	cpmpy_highs (16 cores)	2026-07-05	1,200,792.5	334	131 SAT, 203 UNSAT	68%	72%	63192.54	3.65	189.20	54600.21	2.48	163.47	1.16
26	AI448PBSolver	2026-04-26	1,187,165.2	331	120 SAT, 211 UNSAT	67%	71%	27965.20	0.28	84.49	28091.11	0.46	84.87	1.00
27	cpmpy_highs (1 core)	2026-05-18	1,206,841.1	330	129 SAT, 201 UNSAT	67%	71%	40441.07	2.60	122.55	40154.86	3.68	121.68	1.01
28	exact-printemps (16 cores) (incomplete)	2026-05-18	1,270,051.6	327	141 SAT, 186 UNSAT	66%	70%	82051.63	2.47	250.92	24267.49	2.49	74.21	3.38
29	exact-printemps (1 core) (incomplete)	2026-05-18	1,215,086.2	326	140 SAT, 186 UNSAT	66%	70%	19886.16	2.52	61.00	19958.98	2.54	61.22	1.00
30	OR-Tools CP-SAT (1 core)	2026-05-18	1,238,779.4	324	141 SAT, 183 UNSAT	66%	70%	29179.37	0.91	90.06	29284.18	0.91	90.38	1.00
31	AY	2026-07-11b	1,343,662.9	315	120 SAT, 195 UNSAT	64%	68%	69262.88	6.09	219.88	23329.15	2.18	74.06	2.97
32	Picat(kissat)	2026-06-19	1,385,690.1	307	150 SAT, 157 UNSAT	62%	66%	53690.06	3.32	174.89	53869.69	3.41	175.47	1.00
33	cpmpy_pindakaas_cadical	2026-05-18	1,484,995.6	294	131 SAT, 163 UNSAT	60%	63%	59395.63	9.24	202.03	59895.32	10.62	203.73	0.99
34	scip-printemps (16 cores) (incomplete)	2026-06-28	1,490,731.5	293	128 SAT, 165 UNSAT	60%	63%	57931.48	0.87	197.72	25350.77	0.85	86.52	2.29
35	AY	0.11.0	1,712,559.7	289	112 SAT, 177 UNSAT	59%	62%	250959.70	113.86	868.37	251780.07	114.45	871.21	1.00
36	scip-printemps (1 core) (incomplete)	2026-06-28	1,512,417.4	286	127 SAT, 159 UNSAT	58%	62%	29217.41	0.62	102.16	29314.80	0.64	102.50	1.00
37	AY-cert	2026-07-13-certfix (cert)	1,621,802.6	273	115 SAT, 158 UNSATC	55%	59%	45002.63	1.49	164.84	44714.93	1.60	163.79	1.01
38	Sat4j Resolution	2026-06-10	1,739,486.4	258	115 SAT, 143 UNSAT	52%	56%	54686.43	3.05	211.96	54140.89	1.73	209.85	1.01
39	Sat4j Resolution CERT	2026-05-20 (cert)	1,747,376.2	257	114 SAT, 143 UNSATC	52%	55%	55376.20	4.11	215.47	55625.94	2.01	216.44	1.00
40	Sat4j CuttingPlanes	2026-06-10	2,002,352.2	219	68 SAT, 151 UNSAT	45%	47%	36752.25	4.58	167.82	35775.46	1.92	163.36	1.03
41	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	2,002,704.0	219	68 SAT, 151 UNSATC	45%	47%	37103.99	4.90	169.42	36142.21	2.14	165.03	1.03
42	PRINTEMPS (16 cores) (incomplete)	2026-05-18	2,739,431.4	137	135 SAT, 2 UNSAT	28%	30%	183431.41	10.90	1338.92	28859.79	1.82	210.66	6.36
43	PRINTEMPS (1 core) (incomplete)	2026-05-18	2,668,848.9	124	122 SAT, 2 UNSAT	25%	27%	19248.92	1.71	155.23	19269.24	1.70	155.40	1.00

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN): SAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 492
Virtual Best Solver (VBS)			-	-	183	37%	100%	46656.42	0.28	254.95	-	-	-	-
1	cpmpy_ortools (16 cores)	2026-07-14	890,864.2	166	34%	91%	151263.13	12.84	911.22	11952.54	3.65	72.00	12.66
2	OR-Tools CP-SAT (16 cores)	2026-05-18	952,025.9	166	34%	91%	210529.13	5.74	1268.25	13994.44	1.22	84.30	15.04
3	Hybrid-SynLSRS+CASHWMaxSATDisjComS	v1	765,389.1	159	32%	87%	33129.85	2.92	208.36	33256.52	2.99	209.16	1.00
4	Hybrid-SynLSRS+CASHWMaxSATDisjComS	v2	778,888.3	159	32%	87%	33254.99	2.86	209.15	33378.74	2.96	209.93	1.00
5	SCIP-NaPS	scip-naps-1.00a2	871,182.0	159	32%	87%	63884.75	115.80	401.79	64104.53	116.03	403.17	1.00
6	Hybrid-SynLSExact+CASHWMaxSATDisjComS	v1	745,046.8	158	32%	86%	25497.76	3.29	161.38	25596.44	3.38	162.00	1.00
7	NaPS	1.04	878,202.9	158	32%	86%	64868.64	113.14	410.56	65087.72	113.50	411.95	1.00
8	Hybrid-SynLSExact+CASHWMaxSATDisjComS	v2	755,223.3	157	32%	86%	24563.82	3.26	156.46	24659.60	3.35	157.07	1.00
9	cpmpy_ortools (1 core)	2026-05-18	813,228.8	156	32%	85%	18267.11	6.57	117.10	18403.81	6.65	117.97	0.99
10	Local-PB	2026-05-14	704,150.2	155	32%	85%	22509.80	1.44	145.22	22583.24	1.45	145.70	1.00
11	UWrMaxSat-SCIP	2.0.4	853,709.6	154	31%	84%	37802.58	4.96	245.47	37932.77	4.98	246.32	1.00
12	SynLSExact	2026-06-06	826,586.4	153	31%	84%	17487.19	2.35	114.30	17562.60	2.43	114.79	1.00
13	Picat(kissat)	2026-06-19	1,385,690.1	150	30%	82%	34757.88	4.76	231.72	34872.43	4.78	232.48	1.00
14	SynLSRS	2026-06-06	882,090.1	149	30%	81%	11428.01	2.25	76.70	11486.53	2.32	77.09	0.99
15	roundingsat-satsuma-MIR	2026-06-11	746,148.3	144	29%	79%	13595.96	1.57	94.42	13652.62	1.65	94.81	1.00
16	roundingsat-satsuma-MIR	2026-06-11 (cert)	751,559.5	143	29%	78%	10793.53	2.10	75.48	10968.26	2.20	76.70	0.98
17	roundingsat-satsuma-liftedcover	2026-06-11	789,325.7	141	29%	77%	15962.60	2.33	113.21	16024.60	2.41	113.65	1.00
18	OR-Tools CP-SAT (1 core)	2026-05-18	1,238,779.4	141	29%	77%	16060.92	4.37	113.91	16116.40	4.38	114.30	1.00
19	exact-printemps (16 cores) (incomplete)	2026-05-18	1,270,051.6	141	29%	77%	78876.24	7.02	559.41	21082.33	7.05	149.52	3.74
20	roundingsat-satsuma-liftedcover	2026-06-11 (cert)	799,142.0	140	28%	77%	12462.44	2.59	89.02	12904.59	2.63	92.18	0.97
21	roundingsat-satsuma-saturation	2026-06-11	826,064.7	140	28%	77%	12808.81	2.29	91.49	12853.86	2.32	91.81	1.00
22	exact-printemps (1 core) (incomplete)	2026-05-18	1,215,086.2	140	28%	77%	16708.39	7.07	119.35	16766.83	7.15	119.76	1.00
23	Exact	2026-06-14 (cert)	982,664.2	140	28%	77%	29537.32	3.04	210.98	30335.09	3.10	216.68	0.97
24	roundingsat-satsuma-saturation	2026-06-11 (cert)	832,519.4	139	28%	76%	10110.95	2.54	72.74	10317.27	2.57	74.22	0.98
25	Exact	2026-06-14	1,001,279.4	138	28%	75%	29439.11	2.14	213.33	29543.25	2.14	214.08	1.00
26	PRINTEMPS (16 cores) (incomplete)	2026-05-18	2,739,431.4	135	27%	74%	183430.15	10.95	1358.74	28859.45	2.47	213.77	6.36
27	Exact_symlocal	2026-06-14	1,024,729.7	134	27%	73%	18994.55	2.08	141.75	19061.04	2.09	142.25	1.00
28	Exact_symbreak	2026-06-14	1,013,752.0	133	27%	73%	23813.08	2.45	179.05	23892.89	2.46	179.65	1.00
29	cpmpy_highs (1 core)	2026-07-05	1,172,469.9	132	27%	72%	23468.76	5.35	177.79	23634.96	6.11	179.05	0.99
30	cpmpy_pindakaas_cadical	2026-05-18	1,484,995.6	131	27%	72%	28765.59	19.65	219.58	28911.81	19.76	220.70	0.99
31	cpmpy_highs (16 cores)	2026-07-05	1,200,792.5	131	27%	72%	35202.02	8.40	268.72	28917.29	7.25	220.74	1.22
32	cpmpy_highs (1 core)	2026-05-18	1,206,841.1	129	26%	70%	20426.40	6.49	158.34	20398.72	6.85	158.13	1.00
33	scip-printemps (16 cores) (incomplete)	2026-06-28	1,490,731.5	128	26%	70%	55683.97	15.94	435.03	23094.90	16.01	180.43	2.41
34	scip-printemps (1 core) (incomplete)	2026-06-28	1,512,417.4	127	26%	69%	26552.68	5.70	209.08	26636.99	5.73	209.74	1.00
35	PRINTEMPS (1 core) (incomplete)	2026-05-18	2,668,848.9	122	25%	67%	19248.31	1.82	157.77	19268.83	1.82	157.94	1.00
36	AI448PBSolver	2026-04-26	1,187,165.2	120	24%	66%	7848.46	0.28	65.40	7891.33	0.54	65.76	0.99
37	AY	2026-07-11b	1,343,662.9	120	24%	66%	39489.94	27.71	329.08	13300.36	10.03	110.84	2.97
38	Sat4j Resolution	2026-06-10	1,739,486.4	115	23%	63%	23416.36	2.97	203.62	23077.63	1.54	200.68	1.01
39	AY-cert	2026-07-13-certfix (cert)	1,621,802.6	115	23%	63%	37287.25	3.03	324.24	37128.50	3.06	322.86	1.00
40	Sat4j Resolution CERT	2026-05-20 (cert)	1,747,376.2	114	23%	62%	22470.90	3.59	197.11	22339.74	1.60	195.96	1.01
41	AY	0.11.0	1,712,559.7	112	23%	61%	95743.79	114.30	854.86	96067.10	114.80	857.74	1.00
42	Sat4j CuttingPlanes	2026-06-10	2,002,352.2	68	14%	37%	8150.29	5.26	119.86	7882.36	2.88	115.92	1.03
43	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	2,002,704.0	68	14%	37%	8182.24	5.49	120.33	7906.65	2.99	116.27	1.03

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN): UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 492
Virtual Best Solver (VBS)			-	-	281	281 UNSAT	57%	100%	35779.77	0.05	127.33	-	-	-	-
1	cpmpy_ortools (16 cores)	2026-07-14	890,864.2	253	253 UNSAT	51%	90%	214001.05	4.12	845.85	14067.69	1.25	55.60	15.21
2	OR-Tools CP-SAT (16 cores)	2026-05-18	952,025.9	252	252 UNSAT	51%	90%	208696.75	1.76	828.16	13251.67	0.28	52.59	15.75
3	roundingsat-satsuma-MIR	2026-06-11	746,148.3	249	249 UNSAT	51%	89%	19752.32	0.94	79.33	19832.12	0.95	79.65	1.00
4	roundingsat-satsuma-MIR	2026-06-11 (cert)	751,559.5	249	5 UNSAT, 244 UNSATC	51%	89%	20766.01	1.02	83.40	21037.13	1.16	84.49	0.99
5	roundingsat-satsuma-liftedcover	2026-06-11	789,325.7	248	248 UNSAT	50%	88%	31763.12	0.91	128.08	31887.76	0.95	128.58	1.00
6	roundingsat-satsuma-liftedcover	2026-06-11 (cert)	799,142.0	247	12 UNSAT, 235 UNSATC	50%	88%	30679.61	0.97	124.21	31693.20	1.36	128.31	0.97
7	Local-PB	2026-05-14	704,150.2	244	244 UNSAT	50%	87%	12040.42	0.38	49.35	12081.20	0.39	49.51	1.00
8	roundingsat-satsuma-saturation	2026-06-11	826,064.7	243	243 UNSAT	49%	86%	28455.90	0.87	117.10	28558.73	0.90	117.53	1.00
9	roundingsat-satsuma-saturation	2026-06-11 (cert)	832,519.4	243	6 UNSAT, 237 UNSATC	49%	86%	30408.48	0.93	125.14	30996.79	1.08	127.56	0.98
10	Hybrid-SynLSExact+CASHWMaxSATDisjComS	v1	745,046.8	240	240 UNSAT	49%	85%	42749.05	9.73	178.12	42914.14	9.83	178.81	1.00
11	Hybrid-SynLSExact+CASHWMaxSATDisjComS	v2	755,223.3	240	240 UNSAT	49%	85%	46659.45	9.74	194.41	46837.92	9.85	195.16	1.00
12	Hybrid-SynLSRS+CASHWMaxSATDisjComS	v1	765,389.1	239	239 UNSAT	49%	85%	55459.26	6.09	232.05	55678.07	6.62	232.96	1.00
13	Hybrid-SynLSRS+CASHWMaxSATDisjComS	v2	778,888.3	238	238 UNSAT	48%	85%	61633.28	5.97	258.96	61875.58	6.34	259.98	1.00
14	SynLSExact	2026-06-06	826,586.4	230	230 UNSAT	47%	82%	24299.24	7.83	105.65	24415.02	8.05	106.15	1.00
15	UWrMaxSat-SCIP	2.0.4	853,709.6	229	229 UNSAT	47%	81%	31107.04	20.20	135.84	31213.36	20.27	136.30	1.00
16	SynLSRS	2026-06-06	882,090.1	228	228 UNSAT	46%	81%	42662.13	4.88	187.11	42833.47	4.96	187.87	1.00
17	cpmpy_ortools (1 core)	2026-05-18	813,228.8	227	227 UNSAT	46%	81%	10161.66	1.68	44.77	10348.55	2.58	45.59	0.98
18	NaPS	1.04	878,202.9	226	226 UNSAT	46%	80%	35734.23	2.27	158.12	35873.09	2.31	158.73	1.00
19	SCIP-NaPS	scip-naps-1.00a2	871,182.0	226	226 UNSAT	46%	80%	36897.29	1.69	163.26	37034.02	1.62	163.87	1.00
20	Exact_symbreak	2026-06-14	1,013,752.0	224	224 UNSAT	46%	80%	17938.94	0.55	80.08	18000.44	0.55	80.36	1.00
21	Exact	2026-06-14 (cert)	982,664.2	222	6 UNSAT, 216 UNSATC	45%	79%	17126.91	0.67	77.15	17499.14	0.73	78.82	0.98
22	Exact	2026-06-14	1,001,279.4	221	221 UNSAT	45%	79%	14240.33	0.44	64.44	14288.35	0.45	64.65	1.00
23	Exact_symlocal	2026-06-14	1,024,729.7	221	221 UNSAT	45%	79%	19335.17	0.50	87.49	19400.75	0.50	87.79	1.00
24	AI448PBSolver	2026-04-26	1,187,165.2	211	211 UNSAT	43%	75%	20116.74	0.36	95.34	20199.78	0.44	95.73	1.00
25	cpmpy_highs (1 core)	2026-07-05	1,172,469.9	204	204 UNSAT	41%	73%	25801.14	1.67	126.48	25955.94	2.18	127.23	0.99
26	cpmpy_highs (16 cores)	2026-07-05	1,200,792.5	203	203 UNSAT	41%	72%	27990.52	2.54	137.88	25682.91	1.62	126.52	1.09
27	cpmpy_highs (1 core)	2026-05-18	1,206,841.1	201	201 UNSAT	41%	72%	20014.67	1.72	99.58	19756.14	2.96	98.29	1.01
28	AY	2026-07-11b	1,343,662.9	195	195 UNSAT	40%	69%	29772.94	0.36	152.68	10028.79	0.23	51.43	2.97
29	exact-printemps (16 cores) (incomplete)	2026-05-18	1,270,051.6	186	186 UNSAT	38%	66%	3175.38	1.40	17.07	3185.16	1.41	17.12	1.00
30	exact-printemps (1 core) (incomplete)	2026-05-18	1,215,086.2	186	186 UNSAT	38%	66%	3177.78	1.40	17.08	3192.15	1.43	17.16	1.00
31	OR-Tools CP-SAT (1 core)	2026-05-18	1,238,779.4	183	183 UNSAT	37%	65%	13118.45	0.51	71.69	13167.78	0.51	71.96	1.00
32	AY	0.11.0	1,712,559.7	177	177 UNSAT	36%	63%	155215.91	109.40	876.93	155712.97	109.80	879.73	1.00
33	scip-printemps (16 cores) (incomplete)	2026-06-28	1,490,731.5	165	165 UNSAT	34%	59%	2247.51	0.23	13.62	2255.88	0.24	13.67	1.00
34	cpmpy_pindakaas_cadical	2026-05-18	1,484,995.6	163	163 UNSAT	33%	58%	30630.04	4.04	187.91	30983.51	5.71	190.08	0.99
35	scip-printemps (1 core) (incomplete)	2026-06-28	1,512,417.4	159	159 UNSAT	32%	57%	2664.73	0.21	16.76	2677.81	0.23	16.84	1.00
36	AY-cert	2026-07-13-certfix (cert)	1,621,802.6	158	158 UNSATC	32%	56%	7715.37	0.75	48.83	7586.43	0.86	48.02	1.02
37	Picat(kissat)	2026-06-19	1,385,690.1	157	157 UNSAT	32%	56%	18932.18	2.22	120.59	18997.26	2.24	121.00	1.00
38	Sat4j CuttingPlanes	2026-06-10	2,002,352.2	151	151 UNSAT	31%	54%	28601.96	2.77	189.42	27893.10	0.99	184.72	1.03
39	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	2,002,704.0	151	151 UNSATC	31%	54%	28921.75	2.97	191.53	28235.56	1.09	186.99	1.02
40	Sat4j Resolution	2026-06-10	1,739,486.4	143	143 UNSAT	29%	51%	31270.07	3.54	218.67	31063.26	2.13	217.23	1.01
41	Sat4j Resolution CERT	2026-05-20 (cert)	1,747,376.2	143	143 UNSATC	29%	51%	32905.30	4.50	230.11	33286.20	2.57	232.77	0.99
42	PRINTEMPS (1 core) (incomplete)	2026-05-18	2,668,848.9	2	2 UNSAT	0%	1%	0.60	0.30	0.30	0.41	0.21	0.21	1.47
43	PRINTEMPS (16 cores) (incomplete)	2026-05-18	2,739,431.4	2	2 UNSAT	0%	1%	1.26	0.63	0.63	0.34	0.17	0.17	3.71

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC): SAT+UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 10
Virtual Best Solver (VBS)			-	-	10	6 SAT, 4 UNSAT	100%	100%	1061.24	0.15	106.12	-	-	-	-
1	OR-Tools CP-SAT (16 cores)	2026-05-18	37,920.6	10	6 SAT, 4 UNSAT	100%	100%	37920.59	1.74	3792.06	2387.87	1.23	238.79	15.88
2	scip-printemps (1 core) (incomplete)	2026-06-28	15,099.2	8	6 SAT, 2 UNSAT	80%	80%	699.19	0.28	87.40	701.42	0.29	87.68	1.00
3	scip-printemps (16 cores) (incomplete)	2026-06-28	15,223.0	8	6 SAT, 2 UNSAT	80%	80%	823.02	0.31	102.88	631.85	0.32	78.98	1.30
4	exact-printemps (1 core) (incomplete)	2026-05-18	15,254.1	8	6 SAT, 2 UNSAT	80%	80%	854.12	0.10	106.76	856.95	0.15	107.12	1.00
5	exact-printemps (16 cores) (incomplete)	2026-05-18	15,258.2	8	6 SAT, 2 UNSAT	80%	80%	858.25	0.10	107.28	639.31	0.11	79.91	1.34
6	Picat(kissat)	2026-06-19	15,354.1	8	4 SAT, 4 UNSAT	80%	80%	954.07	0.76	119.26	957.48	0.78	119.68	1.00
7	UWrMaxSat-SCIP	2.0.4	18,131.3	8	4 SAT, 4 UNSAT	80%	80%	3731.35	0.80	466.42	3743.52	0.81	467.94	1.00
8	UWrMaxSat-SCIP	2.0.3	18,219.5	8	4 SAT, 4 UNSAT	80%	80%	3819.48	0.82	477.43	3833.97	0.83	479.25	1.00
9	Exact	2026-06-14	28,800.4	6	4 SAT, 2 UNSAT	60%	60%	0.37	0.03	0.06	0.37	0.03	0.06	0.99
10	Exact_symlocal	2026-06-14	28,800.4	6	4 SAT, 2 UNSAT	60%	60%	0.38	0.03	0.06	0.39	0.03	0.07	0.98
11	Exact_symbreak	2026-06-14	28,800.4	6	4 SAT, 2 UNSAT	60%	60%	0.39	0.03	0.07	0.39	0.03	0.07	0.99
12	OR-Tools CP-SAT (1 core)	2026-05-18	28,803.3	6	4 SAT, 2 UNSAT	60%	60%	3.33	0.24	0.56	3.35	0.24	0.56	0.99
13	AY	2026-07-11b	28,835.1	6	4 SAT, 2 UNSAT	60%	60%	35.11	4.17	5.85	18.34	2.16	3.06	1.91
14	AY	0.11.0	28,855.2	6	4 SAT, 2 UNSAT	60%	60%	55.16	2.48	9.19	55.57	2.52	9.26	0.99
15	PRINTEMPS (1 core) (incomplete)	2026-05-18	28,956.4	6	6 SAT	60%	60%	156.39	0.77	26.07	156.55	0.67	26.09	1.00
16	PRINTEMPS (16 cores) (incomplete)	2026-05-18	29,196.1	6	6 SAT	60%	60%	396.06	1.41	66.01	54.57	0.65	9.10	7.26
17	Sat4j Resolution	2026-06-10	50,401.3	3	1 SAT, 2 UNSAT	30%	30%	1.27	0.20	0.42	0.59	0.13	0.20	2.14
18	Sat4j CuttingPlanes	2026-06-10	72,000.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC): SAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 10
Virtual Best Solver (VBS)			-	-	6	60%	100%	110.12	0.15	18.35	-	-	-	-
1	PRINTEMPS (1 core) (incomplete)	2026-05-18	28,956.4	6	60%	100%	156.39	0.77	26.07	156.55	0.67	26.09	1.00
2	OR-Tools CP-SAT (16 cores)	2026-05-18	37,920.6	6	60%	100%	182.08	1.74	30.35	15.92	1.23	2.65	11.43
3	PRINTEMPS (16 cores) (incomplete)	2026-05-18	29,196.1	6	60%	100%	396.06	1.41	66.01	54.57	0.65	9.10	7.26
4	scip-printemps (1 core) (incomplete)	2026-06-28	15,099.2	6	60%	100%	699.16	0.46	116.53	701.36	0.47	116.89	1.00
5	scip-printemps (16 cores) (incomplete)	2026-06-28	15,223.0	6	60%	100%	823.00	0.51	137.17	631.81	0.51	105.30	1.30
6	exact-printemps (1 core) (incomplete)	2026-05-18	15,254.1	6	60%	100%	854.11	0.27	142.35	856.88	0.33	142.81	1.00
7	exact-printemps (16 cores) (incomplete)	2026-05-18	15,258.2	6	60%	100%	858.24	0.27	143.04	639.28	0.28	106.55	1.34
8	Exact	2026-06-14	28,800.4	4	40%	67%	0.36	0.06	0.09	0.37	0.06	0.09	0.99
9	Exact_symlocal	2026-06-14	28,800.4	4	40%	67%	0.38	0.06	0.10	0.39	0.06	0.10	0.99
10	Exact_symbreak	2026-06-14	28,800.4	4	40%	67%	0.39	0.06	0.10	0.39	0.06	0.10	0.99
11	Picat(kissat)	2026-06-19	15,354.1	4	40%	67%	2.93	0.76	0.73	3.00	0.78	0.75	0.98
12	OR-Tools CP-SAT (1 core)	2026-05-18	28,803.3	4	40%	67%	3.33	0.41	0.83	3.35	0.41	0.84	0.99
13	UWrMaxSat-SCIP	2.0.4	18,131.3	4	40%	67%	18.37	0.80	4.59	18.45	0.81	4.61	1.00
14	UWrMaxSat-SCIP	2.0.3	18,219.5	4	40%	67%	18.46	0.82	4.61	18.56	0.83	4.64	0.99
15	AY	2026-07-11b	28,835.1	4	40%	67%	35.09	7.81	8.77	18.22	4.03	4.55	1.93
16	AY	0.11.0	28,855.2	4	40%	67%	55.14	6.38	13.79	55.49	6.43	13.87	0.99
17	Sat4j Resolution	2026-06-10	50,401.3	1	10%	17%	0.88	0.88	0.88	0.34	0.34	0.34	2.55
18	Sat4j CuttingPlanes	2026-06-10	72,000.0	0	0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC): UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 10
Virtual Best Solver (VBS)			-	-	4	4 UNSAT	40%	100%	951.12	214.98	237.78	-	-	-	-
1	Picat(kissat)	2026-06-19	15,354.1	4	4 UNSAT	40%	100%	951.14	214.98	237.79	954.48	215.75	238.62	1.00
2	UWrMaxSat-SCIP	2.0.4	18,131.3	4	4 UNSAT	40%	100%	3712.98	854.40	928.24	3725.07	857.28	931.27	1.00
3	UWrMaxSat-SCIP	2.0.3	18,219.5	4	4 UNSAT	40%	100%	3801.02	917.96	950.25	3815.41	921.18	953.85	1.00
4	OR-Tools CP-SAT (16 cores)	2026-05-18	37,920.6	4	4 UNSAT	40%	100%	37738.51	8703.85	9434.63	2371.95	546.75	592.99	15.91
5	Exact	2026-06-14	28,800.4	2	2 UNSAT	20%	50%	0.00	0.00	0.00	0.00	0.00	0.00	0.91
6	Exact_symlocal	2026-06-14	28,800.4	2	2 UNSAT	20%	50%	0.00	0.00	0.00	0.00	0.00	0.00	0.91
7	Exact_symbreak	2026-06-14	28,800.4	2	2 UNSAT	20%	50%	0.00	0.00	0.00	0.00	0.00	0.00	0.92
8	OR-Tools CP-SAT (1 core)	2026-05-18	28,803.3	2	2 UNSAT	20%	50%	0.01	0.00	0.00	0.01	0.00	0.00	0.93
9	exact-printemps (16 cores) (incomplete)	2026-05-18	15,258.2	2	2 UNSAT	20%	50%	0.01	0.01	0.01	0.03	0.01	0.01	0.41
10	exact-printemps (1 core) (incomplete)	2026-05-18	15,254.1	2	2 UNSAT	20%	50%	0.01	0.01	0.01	0.07	0.04	0.04	0.17
11	AY	0.11.0	28,855.2	2	2 UNSAT	20%	50%	0.02	0.01	0.01	0.09	0.04	0.04	0.18
12	AY	2026-07-11b	28,835.1	2	2 UNSAT	20%	50%	0.02	0.01	0.01	0.13	0.06	0.06	0.17
13	scip-printemps (16 cores) (incomplete)	2026-06-28	15,223.0	2	2 UNSAT	20%	50%	0.03	0.01	0.01	0.04	0.02	0.02	0.62
14	scip-printemps (1 core) (incomplete)	2026-06-28	15,099.2	2	2 UNSAT	20%	50%	0.03	0.01	0.01	0.06	0.03	0.03	0.49
15	Sat4j Resolution	2026-06-10	50,401.3	2	2 UNSAT	20%	50%	0.39	0.20	0.20	0.25	0.12	0.12	1.58
16	Sat4j CuttingPlanes	2026-06-10	72,000.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
17	PRINTEMPS (1 core) (incomplete)	2026-05-18	28,956.4	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
18	PRINTEMPS (16 cores) (incomplete)	2026-05-18	29,196.1	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN): OPT+UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 585
Virtual Best Solver (VBS)			-	-	444	425 OPT, 19 UNSAT	76%	100%	296414.90	0.47	667.60	-	-	-	-
1	cpmpy_ortools (16 cores)	2026-07-14	1,972,367.0	416	398 OPT, 18 UNSAT	71%	94%	755567.00	14.13	1816.27	52942.14	3.59	127.26	14.27
2	OR-Tools CP-SAT (16 cores)	2026-05-18	1,914,847.2	409	390 OPT, 19 UNSAT	70%	92%	647647.16	6.98	1583.49	42397.63	1.17	103.66	15.28
3	Local-PB	2026-05-14	1,607,474.2	369	353 OPT, 16 UNSAT	63%	83%	52274.20	0.70	141.66	52448.22	0.70	142.14	1.00
4	Qiuqi (16 cores)	2026-06-15	2,146,888.3	357	342 OPT, 15 UNSAT	61%	80%	505288.32	12.37	1415.37	38640.61	2.20	108.24	13.08
5	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	1,911,915.3	354	338 OPT, 16 UNSAT	61%	80%	248715.30	127.02	702.59	249586.79	127.57	705.05	1.00
6	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	1,927,025.3	351	335 OPT, 16 UNSAT	60%	79%	242225.27	110.19	690.10	243065.35	110.60	692.49	1.00
7	UWrMaxSat-SCIP	2.0.4	1,758,090.3	348	331 OPT, 17 UNSAT	59%	78%	51690.29	3.12	148.54	51859.63	3.13	149.02	1.00
8	SCIP-NaPS	scip-naps-1.00a2	1,854,662.9	340	323 OPT, 17 UNSAT	58%	77%	90662.90	3.98	266.66	90993.14	4.33	267.63	1.00
9	UWrMaxSat-SCIP	2.0.3	1,855,028.5	334	317 OPT, 17 UNSAT	57%	75%	47828.46	2.59	143.20	47984.73	2.60	143.67	1.00
10	WMaxCDCL-S9	2026-05-17	1,919,247.6	333	319 OPT, 14 UNSAT	57%	75%	104847.63	5.37	314.86	105213.46	5.61	315.96	1.00
11	AutoAdaptRoundingSat	2026-06-08	1,894,517.1	331	317 OPT, 14 UNSAT	57%	75%	65717.08	61.13	198.54	65960.46	61.56	199.28	1.00
12	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	1,924,261.2	331	315 OPT, 16 UNSAT	57%	75%	95461.17	2.82	288.40	95834.33	3.11	289.53	1.00
13	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	1,926,803.6	331	315 OPT, 16 UNSAT	57%	75%	98003.61	2.83	296.08	98374.27	3.05	297.20	1.00
14	Qiuqi (1 core)	2026-06-15	1,928,385.5	328	313 OPT, 15 UNSAT	56%	74%	77985.53	71.21	237.76	78259.54	71.45	238.60	1.00
15	AutoAdaptRoundingSat	v2	2,052,434.7	327	313 OPT, 14 UNSAT	56%	74%	194834.69	600.70	595.82	195428.96	602.72	597.64	1.00
16	NaPS	1.04	1,945,753.8	323	306 OPT, 17 UNSAT	55%	73%	59353.82	2.77	183.76	59574.02	2.80	184.44	1.00
17	roundingsat-satsuma-opt	2026-06-11	1,935,528.2	322	309 OPT, 13 UNSAT	55%	73%	41928.22	1.43	130.21	42077.58	1.49	130.68	1.00
18	roundingsat-opt	2026-06-11	1,944,047.8	321	308 OPT, 13 UNSAT	55%	72%	43247.80	1.07	134.73	43408.42	1.11	135.23	1.00
19	roundingsat-satsuma-opt	2026-06-11 (cert)	1,954,918.0	319	11 OPT, 295 OPTC, 13 UNSATC	55%	72%	39718.04	1.76	124.51	41340.59	1.84	129.59	0.96
20	roundingsat-opt	2026-06-11 (cert)	1,963,255.1	318	1 OPT, 304 OPTC, 13 UNSATC	54%	72%	40855.10	1.16	128.48	41943.06	1.70	131.90	0.97
21	Exact	2026-06-14	2,024,347.0	311	296 OPT, 15 UNSAT	53%	70%	51547.02	1.22	165.75	51723.42	1.22	166.31	1.00
22	Exact_symlocal	2026-06-14	2,033,160.1	310	295 OPT, 15 UNSAT	53%	70%	53160.07	1.44	171.48	53337.46	1.45	172.06	1.00
23	HitPBO	2026-06-22	2,046,728.9	308	299 OPT, 9 UNSAT	53%	69%	52328.88	1.13	169.90	52500.28	1.15	170.46	1.00
24	Exact_symbreak	2026-06-14	2,049,355.2	307	292 OPT, 15 UNSAT	52%	69%	47755.16	1.62	155.55	47918.93	1.62	156.09	1.00
25	AdaptExact	2026-06-08	2,060,955.7	306	291 OPT, 15 UNSAT	52%	69%	52155.74	1.80	170.44	52365.89	1.98	171.13	1.00
26	AdaptExact	v2	2,061,389.3	306	291 OPT, 15 UNSAT	52%	69%	52589.27	1.81	171.86	52811.22	1.96	172.59	1.00
27	Exact	2026-06-14 (cert)	2,125,312.2	297	35 OPT, 247 OPTC, 15 UNSATC	51%	67%	51712.21	1.90	174.12	52886.05	2.10	178.07	0.98
28	cpmpy_ortools (1 core)	2026-07-14	2,172,999.0	289	276 OPT, 13 UNSAT	49%	65%	41798.99	2.08	144.63	43364.61	10.07	150.05	0.96
29	cpmpy_ortools (1 core)	2026-05-18	2,187,296.7	287	274 OPT, 13 UNSAT	49%	65%	41696.65	2.10	145.28	42029.76	3.13	146.45	0.99
30	roundingsat-ihs	2026-06-11	2,209,592.6	283	270 OPT, 13 UNSAT	48%	64%	35192.62	1.10	124.36	35313.06	1.16	124.78	1.00
31	roundingsat-ihs	2026-06-11 (cert)	2,214,194.2	283	1 OPT, 269 OPTC, 1 UNSAT, 12 UNSATC	48%	64%	39794.20	1.26	140.62	42143.42	1.37	148.92	0.94
32	cpmpy_highs (1 core)	2026-07-05	2,281,374.7	277	266 OPT, 11 UNSAT	47%	62%	63774.72	2.64	230.23	64115.66	3.41	231.46	0.99
33	cpmpy_highs (16 cores)	2026-07-05	2,295,143.8	277	266 OPT, 11 UNSAT	47%	62%	77543.77	3.69	279.94	67518.45	2.99	243.75	1.15
34	cpmpy_highs (1 core)	2026-07-14	2,321,452.8	270	259 OPT, 11 UNSAT	46%	61%	53452.84	2.60	197.97	54153.51	4.47	200.57	0.99
35	scip-printemps (1 core) (incomplete)	2026-06-28	2,314,974.4	264	249 OPT, 15 UNSAT	45%	59%	3774.39	0.57	14.30	3801.74	0.81	14.40	0.99
36	scip-printemps (16 cores) (incomplete)	2026-06-28	2,322,475.5	263	248 OPT, 15 UNSAT	45%	59%	4075.48	0.56	15.50	4090.82	0.57	15.55	1.00
37	WMaxCDCL	2026-05-17	2,414,370.4	258	248 OPT, 10 UNSAT	44%	58%	59970.36	6.10	232.44	60183.78	6.15	233.27	1.00
38	exact-printemps (16 cores) (incomplete)	2026-05-18	2,431,778.4	248	234 OPT, 14 UNSAT	42%	56%	5378.36	1.48	21.69	5392.44	1.49	21.74	1.00
39	HitPBO-PL	2026-06-22 (cert)	2,467,609.0	248	14 OPT, 220 OPTC, 14 UNSATC	42%	56%	41208.96	0.83	166.17	41894.66	0.87	168.93	0.98
40	exact-printemps (1 core) (incomplete)	2026-05-18	2,438,733.3	247	233 OPT, 14 UNSAT	42%	56%	5133.26	1.49	20.78	5152.83	1.50	20.86	1.00
41	Picat(kissat)	2026-06-19	2,592,555.9	235	220 OPT, 15 UNSAT	40%	53%	72555.87	8.59	308.75	72779.24	8.63	309.70	1.00
42	OR-Tools CP-SAT (1 core)	2026-05-18	2,588,680.5	230	215 OPT, 15 UNSAT	39%	52%	32680.55	0.24	142.09	32798.43	0.24	142.60	1.00
43	AY	2026-07-11b	2,632,332.9	226	214 OPT, 12 UNSAT	39%	51%	47532.90	9.58	210.32	19630.26	3.25	86.86	2.42
44	Sat4j Resolution	2026-06-10	3,131,532.8	153	141 OPT, 12 UNSAT	26%	34%	21132.78	1.49	138.12	20957.80	0.57	136.98	1.01
45	Sat4j Resolution CERT	2026-05-20 (cert)	3,136,626.2	152	3 OPT, 137 OPTC, 12 UNSATC	26%	34%	19026.21	1.69	125.17	19159.45	0.78	126.05	0.99
46	AY	0.11.0	3,226,223.9	150	138 OPT, 12 UNSAT	26%	34%	94223.92	7.16	628.16	94552.08	7.20	630.35	1.00
47	Sat4j CuttingPlanes	2026-06-10	3,166,250.6	148	137 OPT, 11 UNSAT	25%	33%	19850.59	2.40	134.13	19378.00	0.97	130.93	1.02
48	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	3,166,727.8	148	137 OPTC, 11 UNSATC	25%	33%	20327.83	2.41	137.35	20034.65	1.58	135.37	1.01
49	AY-cert	2026-07-13-certfix (cert)	4,140,000.3	10	10 UNSATC	2%	2%	0.32	0.04	0.03	0.47	0.05	0.05	0.67
50	PRINTEMPS (1 core) (incomplete)	2026-05-18	4,140,001.8	10	10 UNSAT	2%	2%	1.81	0.21	0.18	0.95	0.11	0.09	1.91
51	PRINTEMPS (16 cores) (incomplete)	2026-05-18	4,140,004.0	10	10 UNSAT	2%	2%	4.04	0.46	0.40	0.93	0.11	0.09	4.36
52	DivingFalconSolver (16 cores)	2026-06-12	4,219,700.6	6	6 OPT	1%	1%	50900.65	6.07	8483.44	3284.01	1.71	547.33	15.50
53	DivingFalconSolver (1 core)	2026-06-12	4,183,205.9	4	4 OPT	1%	1%	5.94	0.70	1.49	16.41	3.33	4.10	0.36

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN): OPT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 585
Virtual Best Solver (VBS)			-	-	425	425 OPT	73%	100%	295147.50	0.50	694.46	-	-	-	-
1	cpmpy_ortools (16 cores)	2026-07-14	1,972,367.0	398	398 OPT	68%	94%	737716.17	15.65	1853.56	51790.59	3.78	130.13	14.24
2	OR-Tools CP-SAT (16 cores)	2026-05-18	1,914,847.2	390	390 OPT	67%	92%	592956.14	7.08	1520.40	38958.65	1.28	99.89	15.22
3	Local-PB	2026-05-14	1,607,474.2	353	353 OPT	60%	83%	52243.76	0.71	148.00	52417.66	0.72	148.49	1.00
4	Qiuqi (16 cores)	2026-06-15	2,146,888.3	342	342 OPT	58%	80%	503139.73	13.61	1471.17	38485.33	2.39	112.53	13.07
5	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	1,911,915.3	338	338 OPT	58%	80%	246768.42	240.33	730.08	247632.94	241.26	732.64	1.00
6	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	1,927,025.3	335	335 OPT	57%	79%	240308.48	209.75	717.34	241142.07	210.70	719.83	1.00
7	UWrMaxSat-SCIP	2.0.4	1,758,090.3	331	331 OPT	57%	78%	51181.12	3.78	154.63	51348.59	3.79	155.13	1.00
8	SCIP-NaPS	scip-naps-1.00a2	1,854,662.9	323	323 OPT	55%	76%	89183.98	4.82	276.11	89511.18	4.71	277.12	1.00
9	WMaxCDCL-S9	2026-05-17	1,919,247.6	319	319 OPT	55%	75%	104172.78	6.43	326.56	104535.63	6.51	327.70	1.00
10	UWrMaxSat-SCIP	2.0.3	1,855,028.5	317	317 OPT	54%	75%	47319.38	3.03	149.27	47473.79	3.04	149.76	1.00
11	AutoAdaptRoundingSat	2026-06-08	1,894,517.1	317	317 OPT	54%	75%	65195.55	61.51	205.66	65436.14	61.74	206.42	1.00
12	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	1,924,261.2	315	315 OPT	54%	74%	94429.25	3.39	299.78	94794.98	3.54	300.94	1.00
13	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	1,926,803.6	315	315 OPT	54%	74%	96972.19	3.41	307.85	97337.02	3.48	309.01	1.00
14	Qiuqi (1 core)	2026-06-15	1,928,385.5	313	313 OPT	54%	74%	74909.61	66.10	239.33	75173.91	66.32	240.17	1.00
15	AutoAdaptRoundingSat	v2	2,052,434.7	313	313 OPT	54%	74%	192625.86	600.80	615.42	193212.05	602.82	617.29	1.00
16	roundingsat-satsuma-opt	2026-06-11	1,935,528.2	309	309 OPT	53%	73%	41925.43	1.78	135.68	42073.79	1.80	136.16	1.00
17	roundingsat-opt	2026-06-11	1,944,047.8	308	308 OPT	53%	72%	43244.25	1.28	140.40	43404.49	1.31	140.92	1.00
18	roundingsat-satsuma-opt	2026-06-11 (cert)	1,954,918.0	306	11 OPT, 295 OPTC	52%	72%	39714.89	2.48	129.79	41336.80	2.78	135.09	0.96
19	NaPS	1.04	1,945,753.8	306	306 OPT	52%	72%	56850.69	3.13	185.79	57060.77	3.17	186.47	1.00
20	roundingsat-opt	2026-06-11 (cert)	1,963,255.1	305	1 OPT, 304 OPTC	52%	72%	40851.11	1.76	133.94	41938.69	1.98	137.50	0.97
21	HitPBO	2026-06-22	2,046,728.9	299	299 OPT	51%	70%	48201.81	0.96	161.21	48359.32	1.01	161.74	1.00
22	Exact	2026-06-14	2,024,347.0	296	296 OPT	51%	70%	51530.63	1.65	174.09	51706.96	1.66	174.69	1.00
23	Exact_symlocal	2026-06-14	2,033,160.1	295	295 OPT	50%	69%	53147.29	1.56	180.16	53324.63	1.56	180.76	1.00
24	Exact_symbreak	2026-06-14	2,049,355.2	292	292 OPT	50%	69%	47720.04	1.72	163.42	47883.65	1.73	163.99	1.00
25	AdaptExact	2026-06-08	2,060,955.7	291	291 OPT	50%	68%	52102.36	2.68	179.05	52309.38	2.83	179.76	1.00
26	AdaptExact	v2	2,061,389.3	291	291 OPT	50%	68%	52535.82	2.68	180.54	52755.42	2.85	181.29	1.00
27	Exact	2026-06-14 (cert)	2,125,312.2	282	35 OPT, 247 OPTC	48%	66%	51696.29	3.03	183.32	52867.58	3.12	187.47	0.98
28	cpmpy_ortools (1 core)	2026-07-14	2,172,999.0	276	276 OPT	47%	65%	41776.22	2.22	151.36	43303.46	10.40	156.90	0.96
29	cpmpy_ortools (1 core)	2026-05-18	2,187,296.7	274	274 OPT	47%	64%	41673.79	2.11	152.09	42003.69	3.20	153.30	0.99
30	roundingsat-ihs	2026-06-11	2,209,592.6	270	270 OPT	46%	64%	35189.63	1.48	130.33	35309.90	1.52	130.78	1.00
31	roundingsat-ihs	2026-06-11 (cert)	2,214,194.2	270	1 OPT, 269 OPTC	46%	64%	39790.70	1.67	147.37	42139.50	1.87	156.07	0.94
32	cpmpy_highs (1 core)	2026-07-05	2,281,374.7	266	266 OPT	45%	63%	63521.25	2.48	238.80	63857.97	3.44	240.07	0.99
33	cpmpy_highs (16 cores)	2026-07-05	2,295,143.8	266	266 OPT	45%	63%	77022.93	3.68	289.56	67007.81	3.18	251.91	1.15
34	cpmpy_highs (1 core)	2026-07-14	2,321,452.8	259	259 OPT	44%	61%	53014.90	2.43	204.69	53638.39	4.21	207.10	0.99
35	scip-printemps (1 core) (incomplete)	2026-06-28	2,314,974.4	249	249 OPT	43%	59%	3555.67	0.66	14.28	3581.88	0.87	14.39	0.99
36	scip-printemps (16 cores) (incomplete)	2026-06-28	2,322,475.5	248	248 OPT	42%	58%	3859.08	0.70	15.56	3872.76	0.71	15.62	1.00
37	WMaxCDCL	2026-05-17	2,414,370.4	248	248 OPT	42%	58%	59969.60	6.68	241.81	60182.80	6.75	242.67	1.00
38	exact-printemps (16 cores) (incomplete)	2026-05-18	2,431,778.4	234	234 OPT	40%	55%	5366.95	1.79	22.94	5380.81	1.77	22.99	1.00
39	HitPBO-PL	2026-06-22 (cert)	2,467,609.0	234	14 OPT, 220 OPTC	40%	55%	40465.02	0.98	172.93	41127.20	1.12	175.76	0.98
40	exact-printemps (1 core) (incomplete)	2026-05-18	2,438,733.3	233	233 OPT	40%	55%	5121.84	1.77	21.98	5141.19	1.79	22.07	1.00
41	Picat(kissat)	2026-06-19	2,592,555.9	220	220 OPT	38%	52%	71403.13	10.12	324.56	71623.21	10.16	325.56	1.00
42	OR-Tools CP-SAT (1 core)	2026-05-18	2,588,680.5	215	215 OPT	37%	51%	30767.20	0.26	143.10	30876.17	0.26	143.61	1.00
43	AY	2026-07-11b	2,632,332.9	214	214 OPT	37%	50%	47475.86	11.41	221.85	19610.64	3.88	91.64	2.42
44	Sat4j Resolution	2026-06-10	3,131,532.8	141	141 OPT	24%	33%	21121.99	1.87	149.80	20951.88	0.78	148.59	1.01
45	Sat4j Resolution CERT	2026-05-20 (cert)	3,136,626.2	140	3 OPT, 137 OPTC	24%	33%	19013.31	2.34	135.81	19152.11	0.93	136.80	0.99
46	AY	0.11.0	3,226,223.9	138	138 OPT	24%	32%	94206.62	13.30	682.66	94534.48	13.41	685.03	1.00
47	Sat4j CuttingPlanes	2026-06-10	3,166,250.6	137	137 OPT	23%	32%	19667.14	3.06	143.56	19201.29	1.27	140.16	1.02
48	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	3,166,727.8	137	137 OPTC	23%	32%	20143.45	3.43	147.03	19836.39	4.49	144.79	1.02
49	DivingFalconSolver (16 cores)	2026-06-12	4,219,700.6	6	6 OPT	1%	1%	50900.65	6.07	8483.44	3284.01	1.71	547.33	15.50
50	DivingFalconSolver (1 core)	2026-06-12	4,183,205.9	4	4 OPT	1%	1%	5.94	0.70	1.49	16.41	3.33	4.10	0.36
51	PRINTEMPS (1 core) (incomplete)	2026-05-18	4,140,001.8	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
52	PRINTEMPS (16 cores) (incomplete)	2026-05-18	4,140,004.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
53	AY-cert	2026-07-13-certfix (cert)	4,140,000.3	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN): UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 585
Virtual Best Solver (VBS)			-	-	19	19 UNSAT	3%	100%	1267.40	0.03	66.71	-	-	-	-
1	OR-Tools CP-SAT (16 cores)	2026-05-18	1,914,847.2	19	19 UNSAT	3%	100%	54691.02	0.04	2878.47	3438.98	0.05	181.00	15.90
2	cpmpy_ortools (16 cores)	2026-07-14	1,972,367.0	18	18 UNSAT	3%	95%	17850.83	3.03	991.71	1151.55	2.15	63.97	15.50
3	UWrMaxSat-SCIP	2.0.3	1,855,028.5	17	17 UNSAT	3%	89%	509.07	0.11	29.95	510.94	0.11	30.06	1.00
4	UWrMaxSat-SCIP	2.0.4	1,758,090.3	17	17 UNSAT	3%	89%	509.17	0.10	29.95	511.04	0.11	30.06	1.00
5	SCIP-NaPS	scip-naps-1.00a2	1,854,662.9	17	17 UNSAT	3%	89%	1478.92	0.45	87.00	1481.96	0.34	87.17	1.00
6	NaPS	1.04	1,945,753.8	17	17 UNSAT	3%	89%	2503.13	0.13	147.24	2513.25	0.15	147.84	1.00
7	Local-PB	2026-05-14	1,607,474.2	16	16 UNSAT	3%	84%	30.44	0.04	1.90	30.57	0.04	1.91	1.00
8	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	1,926,803.6	16	16 UNSAT	3%	84%	1031.43	0.14	64.46	1037.25	0.28	64.83	0.99
9	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	1,924,261.2	16	16 UNSAT	3%	84%	1031.92	0.19	64.50	1039.36	0.54	64.96	0.99
10	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	1,927,025.3	16	16 UNSAT	3%	84%	1916.79	0.14	119.80	1923.28	0.25	120.21	1.00
11	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	1,911,915.3	16	16 UNSAT	3%	84%	1946.87	0.15	121.68	1953.86	0.28	122.12	1.00
12	Exact_symlocal	2026-06-14	2,033,160.1	15	15 UNSAT	3%	79%	12.78	0.04	0.85	12.83	0.04	0.86	1.00
13	Exact	2026-06-14 (cert)	2,125,312.2	15	15 UNSATC	3%	79%	15.92	0.04	1.06	18.47	0.22	1.23	0.86
14	Exact	2026-06-14	2,024,347.0	15	15 UNSAT	3%	79%	16.39	0.04	1.09	16.46	0.04	1.10	1.00
15	Exact_symbreak	2026-06-14	2,049,355.2	15	15 UNSAT	3%	79%	35.12	0.04	2.34	35.28	0.04	2.35	1.00
16	AdaptExact	2026-06-08	2,060,955.7	15	15 UNSAT	3%	79%	53.38	0.12	3.56	56.51	0.30	3.77	0.94
17	AdaptExact	v2	2,061,389.3	15	15 UNSAT	3%	79%	53.45	0.12	3.56	55.80	0.27	3.72	0.96
18	scip-printemps (16 cores) (incomplete)	2026-06-28	2,322,475.5	15	15 UNSAT	3%	79%	216.40	0.13	14.43	218.06	0.14	14.54	0.99
19	scip-printemps (1 core) (incomplete)	2026-06-28	2,314,974.4	15	15 UNSAT	3%	79%	218.72	0.14	14.58	219.86	0.15	14.66	0.99
20	Picat(kissat)	2026-06-19	2,592,555.9	15	15 UNSAT	3%	79%	1152.74	0.11	76.85	1156.03	0.12	77.07	1.00
21	OR-Tools CP-SAT (1 core)	2026-05-18	2,588,680.5	15	15 UNSAT	3%	79%	1913.35	0.03	127.56	1922.26	0.03	128.15	1.00
22	Qiuqi (16 cores)	2026-06-15	2,146,888.3	15	15 UNSAT	3%	79%	2148.59	0.05	143.24	155.28	0.03	10.35	13.84
23	Qiuqi (1 core)	2026-06-15	1,928,385.5	15	15 UNSAT	3%	79%	3075.92	149.65	205.06	3085.63	150.03	205.71	1.00
24	exact-printemps (1 core) (incomplete)	2026-05-18	2,438,733.3	14	14 UNSAT	2%	74%	11.42	0.08	0.82	11.65	0.09	0.83	0.98
25	exact-printemps (16 cores) (incomplete)	2026-05-18	2,431,778.4	14	14 UNSAT	2%	74%	11.42	0.08	0.82	11.63	0.10	0.83	0.98
26	AutoAdaptRoundingSat	2026-06-08	1,894,517.1	14	14 UNSAT	2%	74%	521.53	0.12	37.25	524.33	0.21	37.45	0.99
27	WMaxCDCL-S9	2026-05-17	1,919,247.6	14	14 UNSAT	2%	74%	674.86	0.10	48.20	677.83	0.15	48.42	1.00
28	HitPBO-PL	2026-06-22 (cert)	2,467,609.0	14	14 UNSATC	2%	74%	743.95	0.10	53.14	767.46	0.23	54.82	0.97
29	AutoAdaptRoundingSat	v2	2,052,434.7	14	14 UNSAT	2%	74%	2208.83	0.12	157.77	2216.91	0.18	158.35	1.00
30	roundingsat-satsuma-opt	2026-06-11	1,935,528.2	13	13 UNSAT	2%	68%	2.79	0.03	0.21	3.79	0.11	0.29	0.74
31	roundingsat-ihs	2026-06-11	2,209,592.6	13	13 UNSAT	2%	68%	2.99	0.04	0.23	3.16	0.05	0.24	0.95
32	roundingsat-satsuma-opt	2026-06-11 (cert)	1,954,918.0	13	13 UNSATC	2%	68%	3.15	0.04	0.24	3.79	0.06	0.29	0.83
33	roundingsat-ihs	2026-06-11 (cert)	2,214,194.2	13	1 UNSAT, 12 UNSATC	2%	68%	3.50	0.05	0.27	3.91	0.06	0.30	0.89
34	roundingsat-opt	2026-06-11	1,944,047.8	13	13 UNSAT	2%	68%	3.56	0.03	0.27	3.93	0.06	0.30	0.91
35	roundingsat-opt	2026-06-11 (cert)	1,963,255.1	13	13 UNSATC	2%	68%	3.99	0.04	0.31	4.36	0.06	0.34	0.91
36	cpmpy_ortools (1 core)	2026-07-14	2,172,999.0	13	13 UNSAT	2%	68%	22.76	1.93	1.75	61.15	3.52	4.70	0.37
37	cpmpy_ortools (1 core)	2026-05-18	2,187,296.7	13	13 UNSAT	2%	68%	22.86	1.95	1.76	26.07	2.10	2.01	0.88
38	Sat4j Resolution	2026-06-10	3,131,532.8	12	12 UNSAT	2%	63%	10.79	0.57	0.90	5.92	0.23	0.49	1.82
39	Sat4j Resolution CERT	2026-05-20 (cert)	3,136,626.2	12	12 UNSATC	2%	63%	12.89	0.62	1.07	7.35	0.28	0.61	1.75
40	AY	0.11.0	3,226,223.9	12	12 UNSAT	2%	63%	17.30	0.03	1.44	17.59	0.05	1.47	0.98
41	AY	2026-07-11b	2,632,332.9	12	12 UNSAT	2%	63%	57.04	0.16	4.75	19.62	0.09	1.64	2.91
42	Sat4j CuttingPlanes	2026-06-10	3,166,250.6	11	11 UNSAT	2%	58%	183.45	0.87	16.68	176.70	0.34	16.06	1.04
43	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	3,166,727.8	11	11 UNSATC	2%	58%	184.39	0.89	16.76	198.26	0.40	18.02	0.93
44	cpmpy_highs (1 core)	2026-07-05	2,281,374.7	11	11 UNSAT	2%	58%	253.47	3.00	23.04	257.69	3.00	23.43	0.98
45	cpmpy_highs (1 core)	2026-07-14	2,321,452.8	11	11 UNSAT	2%	58%	437.94	3.01	39.81	515.12	14.37	46.83	0.85
46	cpmpy_highs (16 cores)	2026-07-05	2,295,143.8	11	11 UNSAT	2%	58%	520.85	3.96	47.35	510.64	2.98	46.42	1.02
47	AY-cert	2026-07-13-certfix (cert)	4,140,000.3	10	10 UNSATC	2%	53%	0.32	0.04	0.03	0.47	0.05	0.05	0.67
48	WMaxCDCL	2026-05-17	2,414,370.4	10	10 UNSAT	2%	53%	0.75	0.09	0.08	0.98	0.11	0.10	0.77
49	PRINTEMPS (1 core) (incomplete)	2026-05-18	4,140,001.8	10	10 UNSAT	2%	53%	1.81	0.21	0.18	0.95	0.11	0.09	1.91
50	PRINTEMPS (16 cores) (incomplete)	2026-05-18	4,140,004.0	10	10 UNSAT	2%	53%	4.04	0.46	0.40	0.93	0.11	0.09	4.36
51	HitPBO	2026-06-22	2,046,728.9	9	9 UNSAT	2%	47%	4127.07	205.47	458.56	4140.96	206.06	460.11	1.00
52	DivingFalconSolver (1 core)	2026-06-12	4,183,205.9	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
53	DivingFalconSolver (16 cores)	2026-06-12	4,219,700.6	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC): OPT+UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 64
Virtual Best Solver (VBS)			-	-	36	36 OPT	56%	100%	70860.23	0.05	1968.34	-	-	-	-
1	OR-Tools CP-SAT (16 cores)	2026-05-18	318,642.5	36	36 OPT	56%	100%	117042.51	0.21	3251.18	7364.85	0.06	204.58	15.89
2	UWrMaxSat-SCIP	2.0.3	224,927.6	33	33 OPT	52%	92%	1727.62	0.20	52.35	1733.22	0.20	52.52	1.00
3	UWrMaxSat-SCIP	2.0.4	224,929.1	33	33 OPT	52%	92%	1729.05	0.20	52.40	1734.86	0.21	52.57	1.00
4	scip-printemps (16 cores) (incomplete)	2026-06-28	237,813.5	31	31 OPT	48%	86%	213.45	0.44	6.89	214.39	0.45	6.92	1.00
5	scip-printemps (1 core) (incomplete)	2026-06-28	244,897.7	30	30 OPT	47%	83%	97.68	0.35	3.26	98.69	0.37	3.29	0.99
6	OR-Tools CP-SAT (1 core)	2026-05-18	259,274.1	28	28 OPT	44%	78%	74.09	0.05	2.65	74.38	0.05	2.66	1.00
7	Exact_symlocal	2026-06-14	259,455.4	28	28 OPT	44%	78%	255.42	0.30	9.12	256.32	0.31	9.15	1.00
8	Exact_symbreak	2026-06-14	259,533.0	28	28 OPT	44%	78%	333.01	0.25	11.89	334.07	0.25	11.93	1.00
9	Exact	2026-06-14	259,544.3	28	28 OPT	44%	78%	344.31	0.24	12.30	345.59	0.24	12.34	1.00
10	exact-printemps (16 cores) (incomplete)	2026-05-18	259,628.9	28	28 OPT	44%	78%	428.94	0.15	15.32	430.41	0.17	15.37	1.00
11	exact-printemps (1 core) (incomplete)	2026-05-18	259,633.9	28	28 OPT	44%	78%	433.90	0.16	15.50	435.98	0.22	15.57	1.00
12	Picat(kissat)	2026-06-19	260,816.9	28	28 OPT	44%	78%	1616.93	0.06	57.75	1622.58	0.09	57.95	1.00
13	Sat4j Resolution	2026-06-10	281,553.3	25	25 OPT	39%	69%	753.35	4.42	30.13	719.65	2.86	28.79	1.05
14	AY	0.11.0	327,892.3	20	20 OPT	31%	56%	11092.26	720.77	554.61	11123.54	722.70	556.18	1.00
15	Sat4j CuttingPlanes	2026-06-10	339,778.7	17	17 OPT	27%	47%	1378.69	2.63	81.10	1331.51	0.91	78.32	1.04
16	AY	2026-07-11b	396,235.9	10	10 OPT	16%	28%	7435.94	724.91	743.59	7461.48	727.23	746.15	1.00
17	PRINTEMPS (1 core) (incomplete)	2026-05-18	460,800.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
18	PRINTEMPS (16 cores) (incomplete)	2026-05-18	460,800.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC): OPT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 64
Virtual Best Solver (VBS)			-	-	36	36 OPT	56%	100%	70860.23	0.05	1968.34	-	-	-	-
1	OR-Tools CP-SAT (16 cores)	2026-05-18	318,642.5	36	36 OPT	56%	100%	117042.51	0.21	3251.18	7364.85	0.06	204.58	15.89
2	UWrMaxSat-SCIP	2.0.3	224,927.6	33	33 OPT	52%	92%	1727.62	0.20	52.35	1733.22	0.20	52.52	1.00
3	UWrMaxSat-SCIP	2.0.4	224,929.1	33	33 OPT	52%	92%	1729.05	0.20	52.40	1734.86	0.21	52.57	1.00
4	scip-printemps (16 cores) (incomplete)	2026-06-28	237,813.5	31	31 OPT	48%	86%	213.45	0.44	6.89	214.39	0.45	6.92	1.00
5	scip-printemps (1 core) (incomplete)	2026-06-28	244,897.7	30	30 OPT	47%	83%	97.68	0.35	3.26	98.69	0.37	3.29	0.99
6	OR-Tools CP-SAT (1 core)	2026-05-18	259,274.1	28	28 OPT	44%	78%	74.09	0.05	2.65	74.38	0.05	2.66	1.00
7	Exact_symlocal	2026-06-14	259,455.4	28	28 OPT	44%	78%	255.42	0.30	9.12	256.32	0.31	9.15	1.00
8	Exact_symbreak	2026-06-14	259,533.0	28	28 OPT	44%	78%	333.01	0.25	11.89	334.07	0.25	11.93	1.00
9	Exact	2026-06-14	259,544.3	28	28 OPT	44%	78%	344.31	0.24	12.30	345.59	0.24	12.34	1.00
10	exact-printemps (16 cores) (incomplete)	2026-05-18	259,628.9	28	28 OPT	44%	78%	428.94	0.15	15.32	430.41	0.17	15.37	1.00
11	exact-printemps (1 core) (incomplete)	2026-05-18	259,633.9	28	28 OPT	44%	78%	433.90	0.16	15.50	435.98	0.22	15.57	1.00
12	Picat(kissat)	2026-06-19	260,816.9	28	28 OPT	44%	78%	1616.93	0.06	57.75	1622.58	0.09	57.95	1.00
13	Sat4j Resolution	2026-06-10	281,553.3	25	25 OPT	39%	69%	753.35	4.42	30.13	719.65	2.86	28.79	1.05
14	AY	0.11.0	327,892.3	20	20 OPT	31%	56%	11092.26	720.77	554.61	11123.54	722.70	556.18	1.00
15	Sat4j CuttingPlanes	2026-06-10	339,778.7	17	17 OPT	27%	47%	1378.69	2.63	81.10	1331.51	0.91	78.32	1.04
16	AY	2026-07-11b	396,235.9	10	10 OPT	16%	28%	7435.94	724.91	743.59	7461.48	727.23	746.15	1.00
17	PRINTEMPS (1 core) (incomplete)	2026-05-18	460,800.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-
18	PRINTEMPS (16 cores) (incomplete)	2026-05-18	460,800.0	0		0%	0%	0.00	0.00	-	0.00	0.00	-	-

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC): UNSAT answers

Rank	Solver	Version	PAR2 score	Number of solved instances	Detail	% of all instances	% of VBS	Cumulated CPU time on solved instances	Median CPU time	Average CPU time per solved instance	Cumulated WC time on solved instances	Median WC time	Average WC time per solved instance	CPU/WC
Total number of instances in the category: 64
Virtual Best Solver (VBS)			-	-	0		0%	-	0.00	0.00	-	-	-	-	-
1	OR-Tools CP-SAT (1 core)	2026-05-18	259,274.1	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
2	Picat(kissat)	2026-06-19	260,816.9	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
3	Sat4j CuttingPlanes	2026-06-10	339,778.7	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
4	Sat4j Resolution	2026-06-10	281,553.3	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
5	exact-printemps (1 core) (incomplete)	2026-05-18	259,633.9	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
6	AY	0.11.0	327,892.3	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
7	Exact	2026-06-14	259,544.3	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
8	Exact_symlocal	2026-06-14	259,455.4	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
9	Exact_symbreak	2026-06-14	259,533.0	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
10	PRINTEMPS (1 core) (incomplete)	2026-05-18	460,800.0	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
11	UWrMaxSat-SCIP	2.0.3	224,927.6	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
12	scip-printemps (1 core) (incomplete)	2026-06-28	244,897.7	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
13	UWrMaxSat-SCIP	2.0.4	224,929.1	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
14	OR-Tools CP-SAT (16 cores)	2026-05-18	318,642.5	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
15	exact-printemps (16 cores) (incomplete)	2026-05-18	259,628.9	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
16	PRINTEMPS (16 cores) (incomplete)	2026-05-18	460,800.0	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
17	scip-printemps (16 cores) (incomplete)	2026-06-28	237,813.5	0		0%	-	0.00	0.00	-	0.00	0.00	-	-
18	AY	2026-07-11b	396,235.9	0		0%	-	0.00	0.00	-	0.00	0.00	-	-

Ranking on the number of best answers found (incomplete solver point of view)

Number of best answers found with no further time limit

This section presents the ranking of the different solvers. Solvers are ranked on the number of instances for which they were able to find the best solution obtained by one the solvers within the global time limit. Ties are broken using the cumulated T1 time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 585
Virtual Best Solver (VBS)			544	93%	100%
1	Best Known Results	oracle solver	488	83%	90%	0
2	cpmpy_ortools (16 cores)	2026-07-14	416	71%	76%	42532.43
3	OR-Tools CP-SAT (16 cores)	2026-05-18	409	70%	75%	71326.23
4	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	399	68%	73%	402400.26
5	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	394	67%	72%	388683.91
6	Local-PB	2026-05-14	386	66%	71%	110927.84
7	AutoAdaptRoundingSat	v2	380	65%	70%	385972.62
8	AutoAdaptRoundingSat	2026-06-08	373	64%	69%	216955.01
9	Qiuqi (16 cores)	2026-06-15	357	61%	66%	40580.31
10	UWrMaxSat-SCIP	2.0.4	348	59%	64%	46639.97
11	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	343	59%	63%	137018.31
12	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	343	59%	63%	134475.77
13	SCIP-NaPS	scip-naps-1.00a2	340	58%	63%	90818.79
14	Qiuqi (1 core)	2026-06-15	337	58%	62%	110643.42
15	UWrMaxSat-SCIP	2.0.3	334	57%	61%	40567.73
16	WMaxCDCL-S9	2026-05-17	333	57%	61%	105203.94
17	cpmpy_ortools (1 core)	2026-07-14	324	55%	60%	47829.06
18	NaPS	1.04	323	55%	59%	46419.35
19	roundingsat-satsuma-opt	2026-06-11	322	55%	59%	42066.67
20	roundingsat-opt	2026-06-11	321	55%	59%	43401.32
21	roundingsat-satsuma-opt	2026-06-11 (cert)	319	55%	59%	41327.59
22	roundingsat-opt	2026-06-11 (cert)	318	54%	58%	41932.33
23	AdaptExact	v2	317	54%	58%	92352.48
24	AdaptExact	2026-06-08	317	54%	58%	91906.89
25	cpmpy_ortools (1 core)	2026-05-18	313	54%	58%	135477.31
26	Exact	2026-06-14	311	53%	57%	33869.25
27	Exact_symlocal	2026-06-14	310	53%	57%	34968.59
28	HitPBO	2026-06-22	308	53%	57%	52467.57
29	Exact_symbreak	2026-06-14	307	52%	56%	32243.45
30	Exact	2026-06-14 (cert)	297	51%	55%	35138.97
31	cpmpy_highs (1 core)	2026-07-05	288	49%	53%	103623.2
32	roundingsat-ihs	2026-06-11 (cert)	283	48%	52%	42132.3
33	roundingsat-ihs	2026-06-11	283	48%	52%	35305.97
34	scip-printemps (1 core)	2026-06-28	282	48%	52%	16990.18
35	cpmpy_highs (1 core)	2026-07-14	278	48%	51%	50529.16
36	cpmpy_highs (16 cores)	2026-07-05	277	47%	51%	67450.65
37	exact-printemps (1 core)	2026-05-18	276	47%	51%	20874.72
38	scip-printemps (16 cores)	2026-06-28	263	45%	48%	4085.84
39	WMaxCDCL	2026-05-17	258	44%	47%	60179.03
40	exact-printemps (16 cores)	2026-05-18	252	43%	46%	3387.27
41	HitPBO-PL	2026-06-22 (cert)	248	42%	46%	41798.4
42	OR-Tools CP-SAT (1 core)	2026-05-18	240	41%	44%	30935.48
43	Picat(kissat)	2026-06-19	235	40%	43%	52876.96
44	AY	2026-07-11b	229	39%	42%	16798.88
45	Sat4j Resolution	2026-06-10	159	27%	29%	13598.96
46	AY	0.11.0	156	27%	29%	77125.13
47	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	152	26%	28%	12319.66
48	Sat4j Resolution CERT	2026-05-20 (cert)	152	26%	28%	12095.63
49	Sat4j CuttingPlanes	2026-06-10	152	26%	28%	11939.99
50	PRINTEMPS (1 core)	2026-05-18	29	5%	5%	9941.34
51	AY-cert	2026-07-13-certfix (cert)	15	3%	3%	1801.9
52	PRINTEMPS (16 cores)	2026-05-18	10	2%	2%	4.04
53	DivingFalconSolver (16 cores)	2026-06-12	6	1%	1%	572.29
54	DivingFalconSolver (1 core)	2026-06-12	4	1%	1%	12.05

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 64
Virtual Best Solver (VBS)			64	100%	100%
1	scip-printemps (1 core)	2026-06-28	36	56%	56%	3881.17
2	OR-Tools CP-SAT (16 cores)	2026-05-18	36	56%	56%	3310.8
3	exact-printemps (1 core)	2026-05-18	34	53%	53%	7287.34
4	UWrMaxSat-SCIP	2.0.4	34	53%	53%	1678.5
5	UWrMaxSat-SCIP	2.0.3	34	53%	53%	1675.98
6	scip-printemps (16 cores)	2026-06-28	31	48%	48%	214.2
7	OR-Tools CP-SAT (1 core)	2026-05-18	29	45%	45%	550.02
8	exact-printemps (16 cores)	2026-05-18	29	45%	45%	184.69
9	Picat(kissat)	2026-06-19	28	44%	44%	1619.59
10	Exact	2026-06-14	28	44%	44%	185.49
11	Exact_symbreak	2026-06-14	28	44%	44%	101.97
12	Exact_symlocal	2026-06-14	28	44%	44%	49.05
13	Sat4j Resolution	2026-06-10	25	39%	39%	261.41
14	AY	0.11.0	20	31%	31%	7004.17
15	Sat4j CuttingPlanes	2026-06-10	17	27%	27%	1157.2
16	AY	2026-07-11b	13	20%	20%	9206.48
17	PRINTEMPS (1 core)	2026-05-18	4	6%	6%	4431.12

Number of best answers found within 2 times the VBS time

This section presents the ranking of the different solvers. Solvers are ranked on the number of instances for which they were able to find the best solution obtained by one the solvers within 2 times the VBS time. Ties are broken using the cumulated T1 time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 585
Virtual Best Solver (VBS)			544	93%	100%
1	OR-Tools CP-SAT (16 cores)	2026-05-18	208	36%	38%	4493.8
2	Local-PB	2026-05-14	138	24%	25%	6345.56
3	Exact	2026-06-14	132	23%	24%	937.11
4	Exact_symlocal	2026-06-14	127	22%	23%	950.4
5	UWrMaxSat-SCIP	2.0.3	114	19%	21%	130.69
6	UWrMaxSat-SCIP	2.0.4	113	19%	21%	1669.34
7	Exact_symbreak	2026-06-14	107	18%	20%	319.3
8	Exact	2026-06-14 (cert)	73	12%	13%	1941.49
9	OR-Tools CP-SAT (1 core)	2026-05-18	65	11%	12%	5045.34
10	Qiuqi (16 cores)	2026-06-15	63	11%	12%	641.71
11	cpmpy_ortools (16 cores)	2026-07-14	49	8%	9%	11538.2
12	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	31	5%	6%	2776.89
13	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	28	5%	5%	2780.26
14	roundingsat-opt	2026-06-11	27	5%	5%	954.12
15	roundingsat-satsuma-opt	2026-06-11	23	4%	4%	2557.6
16	HitPBO	2026-06-22	23	4%	4%	718.17
17	roundingsat-opt	2026-06-11 (cert)	22	4%	4%	959.67
18	exact-printemps (1 core)	2026-05-18	21	4%	4%	3509.65
19	exact-printemps (16 cores)	2026-05-18	19	3%	3%	18.57
20	AY	2026-07-11b	19	3%	3%	0.59
21	AutoAdaptRoundingSat	v2	17	3%	3%	61123.54
22	roundingsat-satsuma-opt	2026-06-11 (cert)	17	3%	3%	2560.96
23	roundingsat-ihs	2026-06-11	14	2%	3%	577.74
24	HitPBO-PL	2026-06-22 (cert)	14	2%	3%	83.78
25	Sat4j Resolution	2026-06-10	14	2%	3%	69.88
26	roundingsat-ihs	2026-06-11 (cert)	11	2%	2%	612.19
27	Sat4j Resolution CERT	2026-05-20 (cert)	11	2%	2%	64.24
28	cpmpy_ortools (1 core)	2026-07-14	10	2%	2%	7182.52
29	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	8	1%	1%	25210.85
30	AutoAdaptRoundingSat	2026-06-08	8	1%	1%	23320.62
31	AdaptExact	2026-06-08	8	1%	1%	7203.39
32	AdaptExact	v2	8	1%	1%	7203.38
33	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	7	1%	1%	21614.03
34	Picat(kissat)	2026-06-19	7	1%	1%	70.7
35	Qiuqi (1 core)	2026-06-15	5	1%	1%	7239.23
36	PRINTEMPS (1 core)	2026-05-18	5	1%	1%	4438.43
37	scip-printemps (1 core)	2026-06-28	5	1%	1%	1834.89
38	DivingFalconSolver (16 cores)	2026-06-12	5	1%	1%	570.81
39	cpmpy_highs (1 core)	2026-07-14	4	1%	1%	1261.33
40	scip-printemps (16 cores)	2026-06-28	4	1%	1%	169.25
41	WMaxCDCL	2026-05-17	3	1%	1%	2142.3
42	AY	0.11.0	3	1%	1%	0.73
43	NaPS	1.04	2	0%	0%	1269.05
44	SCIP-NaPS	scip-naps-1.00a2	2	0%	0%	1120.75
45	cpmpy_highs (16 cores)	2026-07-05	2	0%	0%	740.05
46	AY-cert	2026-07-13-certfix (cert)	2	0%	0%	0.12
47	WMaxCDCL-S9	2026-05-17	1	0%	0%	3001.32
48	cpmpy_highs (1 core)	2026-07-05	1	0%	0%	6.41
49	DivingFalconSolver (1 core)	2026-06-12	1	0%	0%	2.68

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 64
Virtual Best Solver (VBS)			64	100%	100%
1	OR-Tools CP-SAT (16 cores)	2026-05-18	28	44%	44%	3207.36
2	OR-Tools CP-SAT (1 core)	2026-05-18	12	19%	19%	0.36
3	Exact	2026-06-14	11	17%	17%	0.26
4	Exact_symbreak	2026-06-14	10	16%	16%	0.07
5	UWrMaxSat-SCIP	2.0.3	9	14%	14%	0.09
6	Exact_symlocal	2026-06-14	8	13%	13%	0
7	UWrMaxSat-SCIP	2.0.4	7	11%	11%	0.09
8	scip-printemps (1 core)	2026-06-28	4	6%	6%	634.61
9	Picat(kissat)	2026-06-19	4	6%	6%	0.21
10	AY	2026-07-11b	3	5%	5%	2111.72
11	exact-printemps (1 core)	2026-05-18	3	5%	5%	0.32
12	exact-printemps (16 cores)	2026-05-18	3	5%	5%	0.32
13	scip-printemps (16 cores)	2026-06-28	1	2%	2%	58.81

Number of best answers found within 4 times the VBS time

This section presents the ranking of the different solvers. Solvers are ranked on the number of instances for which they were able to find the best solution obtained by one the solvers within 4 times the VBS time. Ties are broken using the cumulated T1 time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 585
Virtual Best Solver (VBS)			544	93%	100%
1	OR-Tools CP-SAT (16 cores)	2026-05-18	273	47%	50%	11682.25
2	Local-PB	2026-05-14	180	31%	33%	12487.3
3	Exact	2026-06-14	154	26%	28%	2301.77
4	Exact_symlocal	2026-06-14	149	25%	27%	2736.78
5	UWrMaxSat-SCIP	2.0.3	143	24%	26%	686.94
6	UWrMaxSat-SCIP	2.0.4	141	24%	26%	2081.8
7	Exact_symbreak	2026-06-14	140	24%	26%	1838.31
8	Qiuqi (16 cores)	2026-06-15	109	19%	20%	1564.98
9	cpmpy_ortools (16 cores)	2026-07-14	97	17%	18%	15881.23
10	Exact	2026-06-14 (cert)	94	16%	17%	2099.6
11	OR-Tools CP-SAT (1 core)	2026-05-18	87	15%	16%	5403.71
12	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	60	10%	11%	5090.54
13	exact-printemps (1 core)	2026-05-18	58	10%	11%	5399.62
14	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	58	10%	11%	5071.92
15	exact-printemps (16 cores)	2026-05-18	58	10%	11%	692.95
16	roundingsat-opt	2026-06-11	55	9%	10%	4185.25
17	HitPBO	2026-06-22	50	9%	9%	8240.69
18	roundingsat-opt	2026-06-11 (cert)	47	8%	9%	4162.25
19	roundingsat-satsuma-opt	2026-06-11	46	8%	8%	2859.29
20	roundingsat-ihs	2026-06-11	37	6%	7%	2393.83
21	AdaptExact	v2	34	6%	6%	8588.67
22	AdaptExact	2026-06-08	34	6%	6%	8576.15
23	HitPBO-PL	2026-06-22 (cert)	33	6%	6%	3952.08
24	roundingsat-satsuma-opt	2026-06-11 (cert)	32	5%	6%	2746.43
25	roundingsat-ihs	2026-06-11 (cert)	32	5%	6%	2479.96
26	AY	2026-07-11b	24	4%	4%	0.77
27	Sat4j Resolution	2026-06-10	22	4%	4%	180.97
28	AutoAdaptRoundingSat	v2	20	3%	4%	71910.3
29	scip-printemps (16 cores)	2026-06-28	20	3%	4%	186.24
30	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	19	3%	3%	39729.81
31	scip-printemps (1 core)	2026-06-28	19	3%	3%	1841.96
32	Sat4j Resolution CERT	2026-05-20 (cert)	19	3%	3%	176.08
33	cpmpy_ortools (1 core)	2026-07-14	18	3%	3%	8032.3
34	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	17	3%	3%	32542.11
35	AutoAdaptRoundingSat	2026-06-08	13	2%	2%	37777.97
36	Picat(kissat)	2026-06-19	13	2%	2%	322.69
37	WMaxCDCL	2026-05-17	12	2%	2%	2984.64
38	NaPS	1.04	10	2%	2%	1718.6
39	WMaxCDCL-S9	2026-05-17	9	2%	2%	3336.39
40	Qiuqi (1 core)	2026-06-15	8	1%	1%	11258.02
41	cpmpy_highs (1 core)	2026-07-14	6	1%	1%	1691.07
42	SCIP-NaPS	scip-naps-1.00a2	6	1%	1%	1126.92
43	PRINTEMPS (1 core)	2026-05-18	5	1%	1%	4438.43
44	DivingFalconSolver (16 cores)	2026-06-12	5	1%	1%	570.81
45	cpmpy_highs (1 core)	2026-07-05	4	1%	1%	2178.82
46	AY	0.11.0	4	1%	1%	0.79
47	cpmpy_highs (16 cores)	2026-07-05	3	1%	1%	1185.44
48	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	3	1%	1%	2.01
49	DivingFalconSolver (1 core)	2026-06-12	2	0%	0%	5.49
50	Sat4j CuttingPlanes	2026-06-10	2	0%	0%	1.29
51	AY-cert	2026-07-13-certfix (cert)	2	0%	0%	0.12

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 64
Virtual Best Solver (VBS)			64	100%	100%
1	OR-Tools CP-SAT (16 cores)	2026-05-18	30	47%	47%	3310.13
2	Exact_symbreak	2026-06-14	15	23%	23%	1.83
3	OR-Tools CP-SAT (1 core)	2026-05-18	14	22%	22%	0.49
4	Exact_symlocal	2026-06-14	13	20%	20%	0.74
5	Exact	2026-06-14	13	20%	20%	0.52
6	UWrMaxSat-SCIP	2.0.3	9	14%	14%	0.09
7	Picat(kissat)	2026-06-19	8	13%	13%	0.37
8	UWrMaxSat-SCIP	2.0.4	7	11%	11%	0.09
9	scip-printemps (1 core)	2026-06-28	5	8%	8%	1471.86
10	exact-printemps (16 cores)	2026-05-18	4	6%	6%	0.36
11	AY	2026-07-11b	3	5%	5%	2111.72
12	exact-printemps (1 core)	2026-05-18	3	5%	5%	0.32
13	scip-printemps (16 cores)	2026-06-28	2	3%	3%	58.84
14	Sat4j CuttingPlanes	2026-06-10	1	2%	2%	0.22
15	Sat4j Resolution	2026-06-10	1	2%	2%	0.2

Number of best answers found within 8 times the VBS time

This section presents the ranking of the different solvers. Solvers are ranked on the number of instances for which they were able to find the best solution obtained by one the solvers within 8 times the VBS time. Ties are broken using the cumulated T1 time.

Solvers which gave a wrong answer in a category are excluded from the ranking in that category.

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 585
Virtual Best Solver (VBS)			544	93%	100%
1	OR-Tools CP-SAT (16 cores)	2026-05-18	307	52%	56%	14356.94
2	Local-PB	2026-05-14	212	36%	39%	19847.93
3	Exact	2026-06-14	166	28%	31%	2941.16
4	Exact_symlocal	2026-06-14	164	28%	30%	3526.06
5	Exact_symbreak	2026-06-14	159	27%	29%	1950.06
6	UWrMaxSat-SCIP	2.0.4	158	27%	29%	5352.71
7	UWrMaxSat-SCIP	2.0.3	158	27%	29%	3842.35
8	Qiuqi (16 cores)	2026-06-15	145	25%	27%	2908.81
9	cpmpy_ortools (16 cores)	2026-07-14	133	23%	24%	17190.84
10	OR-Tools CP-SAT (1 core)	2026-05-18	119	20%	22%	8012.29
11	Exact	2026-06-14 (cert)	107	18%	20%	2634.45
12	roundingsat-opt	2026-06-11	87	15%	16%	5334.4
13	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v1	84	14%	15%	6042.09
14	Hybrid-CASHWMaxSATDisjComS-AdaptExact	v2	82	14%	15%	6063.79
15	roundingsat-satsuma-opt	2026-06-11	80	14%	15%	4048.05
16	exact-printemps (1 core)	2026-05-18	79	14%	15%	7399.55
17	HitPBO	2026-06-22	76	13%	14%	16296.27
18	roundingsat-opt	2026-06-11 (cert)	74	13%	14%	5194.51
19	exact-printemps (16 cores)	2026-05-18	74	13%	14%	958.26
20	roundingsat-satsuma-opt	2026-06-11 (cert)	70	12%	13%	4140.38
21	roundingsat-ihs	2026-06-11	64	11%	12%	5967.37
22	roundingsat-ihs	2026-06-11 (cert)	58	10%	11%	6102.49
23	HitPBO-PL	2026-06-22 (cert)	56	10%	10%	7931.72
24	AdaptExact	2026-06-08	54	9%	10%	9826.73
25	AdaptExact	v2	53	9%	10%	9840.51
26	scip-printemps (1 core)	2026-06-28	45	8%	8%	1962.45
27	scip-printemps (16 cores)	2026-06-28	44	8%	8%	261.3
28	Sat4j Resolution	2026-06-10	43	7%	8%	1073.3
29	WMaxCDCL	2026-05-17	39	7%	7%	4486.04
30	NaPS	1.04	35	6%	6%	5559.85
31	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v2	34	6%	6%	54821.97
32	Sat4j Resolution CERT	2026-05-20 (cert)	34	6%	6%	1248.85
33	AY	2026-07-11b	34	6%	6%	34.3
34	Hybrid-CASHWMaxSATDisjComS-AdaptRoundingSat	v1	31	5%	6%	47575.86
35	cpmpy_ortools (1 core)	2026-07-14	29	5%	5%	13241.83
36	WMaxCDCL-S9	2026-05-17	26	4%	5%	5152.68
37	Picat(kissat)	2026-06-19	25	4%	5%	551.63
38	AutoAdaptRoundingSat	v2	23	4%	4%	81392.2
39	AutoAdaptRoundingSat	2026-06-08	23	4%	4%	50261.09
40	SCIP-NaPS	scip-naps-1.00a2	19	3%	3%	1255.05
41	Qiuqi (1 core)	2026-06-15	12	2%	2%	12059.96
42	cpmpy_highs (1 core)	2026-07-14	11	2%	2%	1758.31
43	cpmpy_highs (16 cores)	2026-07-05	10	2%	2%	4061.38
44	cpmpy_highs (1 core)	2026-07-05	9	2%	2%	2227.01
45	Sat4j CuttingPlanes	2026-06-10	7	1%	1%	4.95
46	Sat4j CuttingPlanes CERT	2026-06-10 (cert)	7	1%	1%	4.58
47	PRINTEMPS (1 core)	2026-05-18	6	1%	1%	4439.08
48	AY	0.11.0	6	1%	1%	1.04
49	DivingFalconSolver (16 cores)	2026-06-12	5	1%	1%	570.81
50	cpmpy_ortools (1 core)	2026-05-18	3	1%	1%	197.28
51	DivingFalconSolver (1 core)	2026-06-12	2	0%	0%	5.49
52	AY-cert	2026-07-13-certfix (cert)	2	0%	0%	0.12

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Rank	Solver	Version	Number of best solutions found	% of all instances	% of VBS	Cumulated time
Total number of instances in the category: 64
Virtual Best Solver (VBS)			64	100%	100%
1	OR-Tools CP-SAT (16 cores)	2026-05-18	30	47%	47%	3310.13
2	Exact_symlocal	2026-06-14	18	28%	28%	2.88
3	Exact	2026-06-14	18	28%	28%	2.66
4	Exact_symbreak	2026-06-14	17	27%	27%	2.27
5	OR-Tools CP-SAT (1 core)	2026-05-18	16	25%	25%	2.2
6	UWrMaxSat-SCIP	2.0.3	15	23%	23%	223.51
7	UWrMaxSat-SCIP	2.0.4	12	19%	19%	156.87
8	Picat(kissat)	2026-06-19	8	13%	13%	0.37
9	scip-printemps (1 core)	2026-06-28	6	9%	9%	1471.93
10	exact-printemps (1 core)	2026-05-18	6	9%	9%	0.55
11	exact-printemps (16 cores)	2026-05-18	6	9%	9%	0.53
12	AY	2026-07-11b	3	5%	5%	2111.72
13	scip-printemps (16 cores)	2026-06-28	3	5%	5%	58.89
14	PRINTEMPS (1 core)	2026-05-18	2	3%	3%	4153.04
15	Sat4j CuttingPlanes	2026-06-10	2	3%	3%	1.08
16	AY	0.11.0	2	3%	3%	0.39
17	Sat4j Resolution	2026-06-10	1	2%	2%	0.2

PB'26 competition: ranking of solvers All selected instances (including those not supported by some solvers) max WC time for any solver=3601 s

Ranking on final answers (complete solver point of view)

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN): SAT+UNSAT answers

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN): SAT answers

Category "decision problem, linear constraints, no UNSAT certificate" (DEC-LIN): UNSAT answers

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC): SAT+UNSAT answers

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC): SAT answers

Category "decision problem, non-linear constraints, no UNSAT certificate" (DEC-NLC): UNSAT answers

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN): OPT+UNSAT answers

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN): OPT answers

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN): UNSAT answers

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC): OPT+UNSAT answers

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC): OPT answers

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC): UNSAT answers

Ranking on the number of best answers found (incomplete solver point of view)

Number of best answers found with no further time limit

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Number of best answers found within 2 times the VBS time

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Number of best answers found within 4 times the VBS time

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

Number of best answers found within 8 times the VBS time

Category "optimization problem, linear constraints, no OPT/UNSAT certificate" (OPT-LIN)

Category "optimization problem, non-linear constraints, no OPT/UNSAT certificate" (OPT-NLC)

PB'26 competition: ranking of solvers
All selected instances (including those not supported by some solvers)
max WC time for any solver=3601 s