2018 XCSP3 competition: mini-solvers track: results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
cosoco 1.12 (complete)
GG's minicp 2018-04-29 (complete)
miniBTD 2018.07.27_3 (complete)
miniBTD_12 2018.07.27_12 (complete)
MiniCPFever 2018-04-29 (complete)
minimacht 2018.07.27 (complete)
NACRE 1.0.4 (complete)
slowpoke 2018-04-29 (incomplete)
Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)
SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)
The dodo solver 2018-04-29 (complete)

Bench name	Best results on this instance	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Auction/Auction-sum/ Auction-sum-decay100_c18.xml	SAT f=775413 TT=2520.06 T1=2197.48	SAT (TO) f=539206 TT=2520.1 T1=2355.29	SAT (TO) f=519550 TT=2520.09 T1=2011.68	No data	No data	SAT (TO) f=775413 TT=2520.06 T1=2197.48	No data	No data	SAT (TO) f=314370 TT=2520.07 T1=26.83	SAT (TO) f=356732 TT=2520.06 T1=2183.45	SAT f=632978 TT=303.049 T1=254.01	SAT (TO) f=325462 TT=2520.05 T1=16.48
Auction/Auction-sum/ Auction-sum-decay200_c18.xml	SAT f=1436430 TT=2520.11 T1=1891.35	SAT (TO) f=751088 TT=2519.74 T1=2519.81	SAT (TO) f=810522 TT=2520.11 T1=484.04	No data	No data	SAT (TO) f=1436430 TT=2520.11 T1=1891.35	No data	No data	SAT (TO) f=417425 TT=2520.04 T1=2.83	SAT (TO) f=442141 TT=2520.07 T1=2461.5	SAT f=984576 TT=306.143 T1=263.93	SAT (TO) f=457836 TT=2520.05 T1=294.8
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT f=1931334 TT=2520.12 T1=2291.12	SAT (TO) f=892556 TT=2519.74 T1=2519.7	SAT (TO) f=951699 TT=2520.08 T1=2001.07	No data	No data	SAT (TO) f=1931334 TT=2520.12 T1=2291.12	No data	No data	SAT (TO) f=447988 TT=2520.06 T1=6.26	SAT (TO) f=597293 TT=2520.12 T1=2436.08	SAT f=1199976 TT=303.166 T1=296.08	SAT (TO) f=599258 TT=2520.12 T1=49.86
Auction/Auction-sum/ Auction-sum-decay400_c18.xml	SAT f=2415777 TT=2520.15 T1=2496.14	SAT (TO) f=868923 TT=2520.1 T1=2519.97	SAT (TO) f=824765 TT=2520.08 T1=722.44	No data	No data	SAT (TO) f=2415777 TT=2520.15 T1=2496.14	No data	No data	SAT (TO) f=355039 TT=2520.13 T1=3.15	SAT (TO) f=494343 TT=2520.03 T1=2251.91	SAT f=1191978 TT=303.117 T1=250.2	SAT (TO) f=726732 TT=2520.1 T1=298.35
Auction/Auction-sum/ Auction-sum-decay500_c18.xml	SAT f=2700422 TT=2520.13 T1=2320.06	SAT (TO) f=1052397 TT=2520 T1=2519.78	SAT (TO) f=1150321 TT=2520.06 T1=459.85	No data	No data	SAT (TO) f=2700422 TT=2520.13 T1=2320.06	No data	No data	SAT (TO) f=322308 TT=2520.07 T1=4.02	SAT (TO) f=469182 TT=2520.08 T1=2347.29	SAT f=1305447 TT=303.55 T1=297.86	SAT (TO) f=621609 TT=2520.1 T1=334.54
Auction/Auction-sum/ Auction-sum-example_c18.xml	OPT f=54 TT=0.005 T1=0	OPT f=54 TT=0.005 T1=0	SAT (TO) f=54 TT=2520.05 T1=0.29	No data	No data	SAT (TO) f=54 TT=2522.31 T1=0.29	No data	No data	SAT (TO) f=54 TT=2520.04 T1=0.29	OPT f=54 TT=0.483 T1=0.28	SAT f=54 TT=302.458 T1=0.29	SAT (TO) f=54 TT=2520.1 T1=0.28
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT f=3906753 TT=2520.05 T1=2439.99	SAT (TO) f=3906753 TT=2520.05 T1=2439.99	? TT=2.513	No data	No data	? TT=2.523	No data	No data	? TT=2.531	? TT=2.493	? TT=2.493	? TT=2.522
Auction/Auction-sum/ Auction-sum-matching080_c18.xml	SAT f=9752865 TT=2520.07 T1=2477.68	SAT (TO) f=9752865 TT=2520.07 T1=2477.68	? TT=2.584	No data	No data	? TT=2.607	No data	No data	? TT=2.658	? TT=2.595	? TT=2.596	? TT=2.599
Bacp/Bacp-m2/ Bacp-m2-05_c18.xml	OPT f=9 TT=0.025 T1=0.01	OPT f=9 TT=0.025 T1=0.01	SAT (TO) f=9 TT=2520.03 T1=0.43	No data	No data	SAT (TO) f=9 TT=2520.07 T1=0.39	No data	No data	SAT (TO) f=9 TT=2520.1 T1=0.39	OPT f=9 TT=1.351 T1=0.38	SAT f=9 TT=303.367 T1=0.39	SAT (TO) f=9 TT=2520.06 T1=0.38
Bacp/Bacp-m2/ Bacp-m2-06_c18.xml	OPT f=10 TT=3.243 T1=0.01	OPT f=10 TT=3.243 T1=0.01	SAT (TO) f=10 TT=2520.07 T1=0.45	No data	No data	SAT (TO) f=10 TT=2520.08 T1=0.91	No data	No data	SAT (TO) f=10 TT=2520.1 T1=0.45	OPT f=10 TT=6.972 T1=0.41	SAT f=10 TT=303.618 T1=0.43	SAT (TO) f=10 TT=2520.09 T1=0.42
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Bacp/Bacp-m2/ Bacp-m2-07a_c18.xml	SAT f=12 TT=304.142 T1=0.02	SAT (TO) f=12 TT=2520.08 T1=0.02	SAT (TO) f=12 TT=2520.05 T1=0.48	No data	No data	SAT (TO) f=12 TT=2520.04 T1=0.86	No data	No data	SAT (TO) f=12 TT=2520.09 T1=0.59	SAT (TO) f=12 TT=2520.08 T1=0.61	SAT f=12 TT=304.142 T1=0.6	SAT (TO) f=12 TT=2520.1 T1=1.11
Bacp/Bacp-m2/ Bacp-m2-07b_c18.xml	SAT f=13 TT=303.97 T1=0.03	SAT (TO) f=13 TT=2520.1 T1=0.03	SAT (TO) f=13 TT=2520.05 T1=0.52	No data	No data	SAT (TO) f=13 TT=2520.12 T1=1.79	No data	No data	SAT (TO) f=13 TT=2520.09 T1=0.46	SAT (TO) f=13 TT=2520.02 T1=0.44	SAT f=13 TT=303.97 T1=0.44	SAT (TO) f=13 TT=2520.06 T1=0.46
Bacp/Bacp-m2/ Bacp-m2-08a_c18.xml	SAT f=17 TT=2519.79 T1=0.27	SAT (TO) f=17 TT=2519.79 T1=0.27	SAT (TO) f=17 TT=2520.11 T1=73.56	No data	No data	SAT (TO) f=17 TT=2520.07 T1=0.83	No data	No data	SAT (TO) f=17 TT=2520.11 T1=0.64	SAT (TO) f=17 TT=2520.08 T1=106.94	SAT f=21 TT=304.925 T1=28.64	SAT (TO) f=17 TT=2520.05 T1=1.46
Bacp/Bacp-m2/ Bacp-m2-08b_c18.xml	SAT f=17 TT=2519.79 T1=0.58	SAT (TO) f=17 TT=2519.79 T1=1.86	SAT (TO) f=17 TT=2520.04 T1=128.91	No data	No data	SAT (TO) f=17 TT=2520.09 T1=0.72	No data	No data	SAT (TO) f=17 TT=2520.09 T1=0.58	SAT (TO) f=17 TT=2520.11 T1=124.29	SAT f=21 TT=304.806 T1=9.96	SAT (TO) f=17 TT=2520.1 T1=1.61
Bacp/Bacp-m2/ Bacp-m2-10a-nodv_c18.xml	SAT f=14 TT=304.939 T1=0.12	SAT (TO) f=14 TT=2519.94 T1=0.12	SAT (TO) f=14 TT=2520.05 T1=0.58	No data	No data	SAT (TO) f=14 TT=2520.1 T1=2.37	No data	No data	SAT (TO) f=16 TT=2520.13 T1=0.55	SAT (TO) f=15 TT=2520.07 T1=3.22	SAT f=14 TT=304.939 T1=183.03	SAT (TO) f=14 TT=2520.06 T1=860.4
Bacp/Bacp-m2/ Bacp-m2-10a_c18.xml	SAT f=14 TT=2520.13 T1=3.77	? (TO) TT=2520.05	? (TO) TT=2520.07	No data	No data	SAT (TO) f=14 TT=2520.13 T1=3.77	No data	No data	? (TO) TT=2520.11	? (TO) TT=2520.01	? (TO) TT=2520.03	? (TO) TT=2520.11
Bacp/Bacp-m2/ Bacp-m2-10b_c18.xml	SAT f=14 TT=2519.94 T1=0.19	SAT (TO) f=14 TT=2519.94 T1=0.19	SAT (TO) f=14 TT=2520.11 T1=2.39	No data	No data	SAT (TO) f=14 TT=2520.04 T1=0.57	No data	No data	SAT (TO) f=14 TT=2520.04 T1=0.65	SAT (TO) f=14 TT=2520.08 T1=1.03	SAT f=16 TT=305.162 T1=24.43	SAT (TO) f=14 TT=2520.06 T1=1.75
Bacp/Bacp-m2/ Bacp-m2-12a-nodv_c18.xml	SAT f=17 TT=2519.8 T1=0.72	SAT (TO) f=17 TT=2519.8 T1=0.72	? (TO) TT=2520.11	No data	No data	? (TO) TT=2520.04	No data	No data	? (TO) TT=2520.1	? (TO) TT=2520.11	? (TO) TT=2520.1	? (TO) TT=2520.06
Bacp/Bacp-m2/ Bacp-m2-12a_c18.xml	SAT f=17 TT=2520.04 T1=33.23	? (TO) TT=2520.09	? (TO) TT=2520.05	No data	No data	SAT (TO) f=17 TT=2520.04 T1=33.23	No data	No data	? (TO) TT=2520.11	? (TO) TT=2520.05	? (TO) TT=2520.04	? (TO) TT=2520.09
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT f=17 TT=2519.94 T1=0.07	SAT (TO) f=17 TT=2519.94 T1=0.07	SAT (TO) f=18 TT=2520.11 T1=6.22	No data	No data	SAT (TO) f=17 TT=2520.1 T1=0.8	No data	No data	SAT (TO) f=17 TT=2520.15 T1=0.8	SAT (TO) f=17 TT=2520.11 T1=1.39	SAT f=20 TT=305.313 T1=0.61	SAT (TO) f=17 TT=2520.13 T1=5.29
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
ColouredQueens/ ColouredQueens-05_c18.xml	SAT TT=0.004	SAT TT=0.005	SAT TT=0.506	SAT TT=0.004	SAT TT=0.004	SAT TT=0.513	SAT TT=0.005	SAT TT=0.004	SAT TT=0.53	SAT TT=0.515	SAT TT=0.528	SAT (TO) TT=2520.1
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT TT=0.666	UNSAT TT=2.024	UNSAT TT=1.64	UNSAT TT=0.666	UNSAT TT=0.951	UNSAT TT=1.408	UNSAT TT=0.878	UNSAT TT=7.156	? (TO) TT=2520.05	UNSAT TT=1.936	? TT=304.191	UNSAT TT=2.268
ColouredQueens/ ColouredQueens-07_c18.xml	SAT TT=0.004	SAT TT=0.065	SAT TT=0.619	SAT TT=0.014	SAT TT=0.005	SAT TT=0.532	SAT TT=0.005	SAT TT=0.004	SAT TT=0.563	SAT TT=0.551	SAT TT=0.562	SAT (TO) TT=2520.09
ColouredQueens/ ColouredQueens-08_c18.xml		? (TO) TT=2520.07	? (TO) TT=2520.05	? TT=2520.01	? (TO) TT=2519.89	? (TO) TT=2520.1	? (TO) TT=2519.87	? (TO) TT=2519.89	? (TO) TT=2520.07	? (TO) TT=2520.02	? (TO) TT=2520.11	? (TO) TT=2520.03
ColouredQueens/ ColouredQueens-09_c18.xml		? (TO) TT=2520.08	? (TO) TT=2520.11	? TT=2520.01	? (TO) TT=2519.91	? (TO) TT=2520.02	? (TO) TT=2519.9	? (TO) TT=2519.87	? (TO) TT=2520.03	? (TO) TT=2520.06	? (TO) TT=2520.02	? (TO) TT=2520.04
ColouredQueens/ ColouredQueens-10_c18.xml		? (TO) TT=2520.01	? (TO) TT=2520.09	? (TO) TT=2519.71	? TT=2520	? (TO) TT=2520.07	? (TO) TT=2519.98	? (TO) TT=2519.81	? (TO) TT=2520.12	? (TO) TT=2520.08	? (TO) TT=2520.07	? (TO) TT=2520.08
ColouredQueens/ ColouredQueens-11_c18.xml		? (TO) TT=2519.83	? (TO) TT=2520.08	? (TO) TT=2519.93	? (TO) TT=2519.78	? (TO) TT=2520.11	? (TO) TT=2519.47	? (TO) TT=2519.88	? (TO) TT=2520.07	? (TO) TT=2520.08	? (TO) TT=2520.09	? (TO) TT=2520.12
ColouredQueens/ ColouredQueens-12_c18.xml		? (TO) TT=2520.04	? (TO) TT=2520.08	? (TO) TT=2519.66	? TT=2520	? (TO) TT=2520.1	? TT=2520.01	? (TO) TT=2519.8	? (TO) TT=2520.05	? (TO) TT=2520.07	? (TO) TT=2520.08	? (TO) TT=2520.04
ColouredQueens/ ColouredQueens-13_c18.xml		? (TO) TT=2519.87	? (TO) TT=2520.1	? (TO) TT=2519.96	? (TO) TT=2519.91	? (TO) TT=2520.02	? (TO) TT=2519.96	? (TO) TT=2519.73	? (TO) TT=2520.1	? (TO) TT=2520.03	? (TO) TT=2520.04	? (TO) TT=2520.08
ColouredQueens/ ColouredQueens-14_c18.xml		? (TO) TT=2520.06	? (TO) TT=2520.06	? TT=2520	? TT=2520	? (TO) TT=2520.03	? (TO) TT=2519.94	? (TO) TT=2519.86	? (TO) TT=2520.11	? (TO) TT=2520.08	? (TO) TT=2520.1	? (TO) TT=2520.04
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
ColouredQueens/ ColouredQueens-15_c18.xml		? (TO) TT=2519.59	? (TO) TT=2520.03	? TT=2520	? (TO) TT=2519.82	? (TO) TT=2520.12	? (TO) TT=2519.86	? (TO) TT=2519.53	? (TO) TT=2520.12	? (TO) TT=2520.03	? (TO) TT=2520.06	? (TO) TT=2520.1
ColouredQueens/ ColouredQueens-16_c18.xml		? (TO) TT=2520.04	? (TO) TT=2520.03	? (TO) TT=2519.94	? TT=2520.01	? (TO) TT=2520.03	? (TO) TT=2519.89	? (TO) TT=2519.58	? (TO) TT=2520.12	? (TO) TT=2520.04	? (TO) TT=2520.08	? (TO) TT=2520.11
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT TT=0.044	SAT TT=0.139	SAT TT=1.457	SAT TT=0.045	SAT TT=0.044	SAT TT=1.367	SAT TT=0.044	SAT TT=0.101	SAT TT=1.38	SAT TT=1.438	SAT TT=1.398	SAT (TO) TT=2520.04
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT TT=0.12	SAT TT=0.355	SAT TT=2.012	SAT TT=0.121	SAT TT=0.12	SAT TT=1.83	SAT TT=0.122	SAT TT=0.303	SAT TT=1.785	SAT TT=1.918	SAT TT=1.916	SAT (TO) TT=2520.12
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT TT=0.27	SAT TT=1.156	SAT TT=3.785	SAT TT=0.279	SAT TT=0.27	SAT TT=3.262	SAT TT=0.506	SAT TT=3.472	SAT TT=5.098	SAT TT=7.35	SAT TT=4.693	SAT (TO) TT=2520.04
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT TT=41.907	SAT TT=937.693	SAT TT=1152.42	SAT TT=41.907	SAT TT=721.102	SAT TT=2358.89	SAT TT=597.275	SAT TT=1913.96	? (TO) TT=2520.09	? (TO) TT=2520.03	? (TO) TT=2520.03	SAT (TO) TT=2520.05
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml		? (TO) TT=2519.94	? (TO) TT=2520.05	? (TO) TT=2519.89	? (TO) TT=2519.89	? (TO) TT=2520.11	? (TO) TT=2519.93	? (TO) TT=2519.89	? (TO) TT=2520.08	? (TO) TT=2520.04	? (TO) TT=2520.03	? (TO) TT=2520.03
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml		? (TO) TT=2520.07	? (TO) TT=2520.11	? (TO) TT=2520.06	? (TO) TT=2519.77	? (TO) TT=2520.06	? (TO) TT=2519.91	? (TO) TT=2519.92	? (TO) TT=2520.1	? (TO) TT=2520.1	? (TO) TT=2520.05	? (TO) TT=2520.07
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml		? (TO) TT=2519.76	? (TO) TT=2520.06	? (TO) TT=2520	? (TO) TT=2519.64	? (TO) TT=2520.09	? (TO) TT=2519.87	? (TO) TT=2519.86	? (TO) TT=2520.1	? (TO) TT=2520.08	? (TO) TT=2520.04	? (TO) TT=2520.05
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml		? (TO) TT=2520.09	? (TO) TT=2520.06	? (TO) TT=2520.02	? (TO) TT=2519.98	? (TO) TT=2520.03	? (TO) TT=2520.11	? (TO) TT=2519.94	? (TO) TT=2520.09	? (TO) TT=2520.04	? (TO) TT=2520.12	? (TO) TT=2520.12
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml		? (TO) TT=2519.93	? (TO) TT=2520.11	? (TO) TT=2520.04	? (TO) TT=2519.92	? (TO) TT=2520.09	? (TO) TT=2519.97	? (TO) TT=2519.83	? (TO) TT=2520.04	? (TO) TT=2520.11	? (TO) TT=2520.1	? (TO) TT=2520.1
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml		? (TO) TT=2519.97	? (TO) TT=2520.1	? (TO) TT=2519.87	? (TO) TT=2520.06	? (TO) TT=2520.06	? (TO) TT=2519.9	? (TO) TT=2519.93	? (TO) TT=2520.05	? (TO) TT=2520.09	? (TO) TT=2520.09	? (TO) TT=2520.08
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml		? (TO) TT=2519.96	? (TO) TT=2520.03	? (TO) TT=2520.06	? (TO) TT=2520.01	? (TO) TT=2520.05	? (TO) TT=2520.08	? (TO) TT=2519.9	? (TO) TT=2520.05	? (TO) TT=2520.1	? (TO) TT=2520.06	? (TO) TT=2520.1
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml		? (TO) TT=2519.96	? (TO) TT=2520.06	? (TO) TT=2520.03	? (TO) TT=2519.96	? (TO) TT=2520.11	? (TO) TT=2519.9	? (TO) TT=2519.76	? (TO) TT=2520.04	? (TO) TT=2520.06	? (TO) TT=2520.05	? (TO) TT=2520.1
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT TT=369.771	? (TO) TT=2519.93	? (TO) TT=2520.05	UNSAT TT=369.771	UNSAT TT=640.896	? (TO) TT=2520.12	UNSAT TT=762.414	UNSAT TT=2188.27	? (TO) TT=2520.06	? (TO) TT=2520.12	? (TO) TT=2520.04	? (TO) TT=2520.12
CrosswordDesign/ CrosswordDesign-03-4-rom_c18.xml	OPT f=12 TT=0.053 T1=0.05	OPT f=12 TT=0.053 T1=0.05	OPT f=12 TT=1.659 T1=0.62	No data	No data	SAT (TO) f=12 TT=2520.04 T1=0.51	No data	No data	SAT (TO) f=12 TT=2520.11 T1=0.55	OPT f=12 TT=1.62 T1=0.66	SAT f=12 TT=302.584 T1=0.55	SAT (TO) f=12 TT=2520.05 T1=0.49
CrosswordDesign/ CrosswordDesign-04-4-rom_c18.xml	OPT f=24 TT=0.398 T1=0.32	OPT f=24 TT=0.398 T1=0.32	OPT f=24 TT=6.113 T1=2.15	No data	No data	SAT (TO) f=22 TT=2520.12 T1=84.16	No data	No data	SAT (TO) f=24 TT=2520.06 T1=1.74	OPT f=24 TT=4.388 T1=2.1	SAT f=24 TT=303.243 T1=1.36	SAT (TO) f=24 TT=2520.04 T1=1.68
CrosswordDesign/ CrosswordDesign-05-4-rom_c18.xml	OPT f=38 TT=24.077 T1=10.74	OPT f=38 TT=24.077 T1=10.74	OPT f=38 TT=103.596 T1=40.38	No data	No data	SAT (TO) f=25 TT=2520.05 T1=694.66	No data	No data	SAT (TO) f=38 TT=2520.08 T1=184.46	OPT f=38 TT=255.716 T1=147.64	SAT f=19 TT=303.972 T1=266.76	SAT (TO) f=19 TT=2520.09 T1=4.66
CrosswordDesign/ CrosswordDesign-06-4-rom_c18.xml	SAT f=54 TT=2520.09 T1=1551.96	SAT (TO) f=54 TT=2520.09 T1=1551.96	? TT=33.232	No data	No data	SAT (TO) f=32 TT=2520.13 T1=717.97	No data	No data	SAT (TO) f=44 TT=2520.11 T1=747.92	SAT (TO) f=31 TT=2520.1 T1=2389.8	SAT f=6 TT=308.355 T1=16.06	SAT (TO) f=18 TT=2520.05 T1=13.46
CrosswordDesign/ CrosswordDesign-07-4-rom_c18.xml	SAT f=55 TT=2519.69 T1=2420.93	SAT (TO) f=55 TT=2519.69 T1=2420.93	? TT=32.746	No data	No data	SAT (TO) f=12 TT=2520.13 T1=2451.33	No data	No data	? TT=44.849	SAT (TO) f=0 TT=2520.07 T1=278.55	SAT f=0 TT=325.084 T1=186.63	SAT (TO) f=0 TT=2520.15 T1=32.7
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
CrosswordDesign/ CrosswordDesign-08-4-rom_c18.xml	SAT f=4 TT=2520.05 T1=57.71	SAT (TO) f=4 TT=2520.05 T1=57.71	? TT=29.115	No data	No data	? TT=55.128	No data	No data	? TT=34.758	? TT=74.696	? TT=53.457	? TT=36.002
CrosswordDesign/ CrosswordDesign-09-4-rom_c18.xml		? (TO) TT=2520.08	? TT=26.247	No data	No data	? TT=55.205	No data	No data	? TT=40.016	? TT=75.097	? TT=63.717	? TT=35.741
CrosswordDesign/ CrosswordDesign-10-4-rom_c18.xml		? (TO) TT=2520.07	? TT=29.678	No data	No data	? TT=56.508	No data	No data	? TT=38.405	? TT=66.647	? TT=45.889	? TT=38.262
CrosswordDesign/ CrosswordDesign-11-4-rom_c18.xml	SAT f=65 TT=2520.09 T1=1916.11	SAT (TO) f=65 TT=2520.09 T1=1916.11	? TT=26.723	No data	No data	? TT=52.845	No data	No data	? TT=33.509	? TT=67.127	? TT=57.315	? TT=36.693
CrosswordDesign/ CrosswordDesign-12-4-rom_c18.xml	SAT f=76 TT=2520.09 T1=1509.07	SAT (TO) f=76 TT=2520.09 T1=1509.07	? TT=33.476	No data	No data	? TT=60.199	No data	No data	? TT=35.784	? TT=65.316	? TT=51.004	? TT=36.904
CrosswordDesign/ CrosswordDesign-13-4-rom_c18.xml	SAT f=71 TT=2520.07 T1=2076.15	SAT (TO) f=71 TT=2520.07 T1=2076.15	? TT=39.01	No data	No data	? TT=91.165	No data	No data	? TT=39.057	? TT=86.645	? TT=77.291	? TT=44.303
CrosswordDesign/ CrosswordDesign-14-4-rom_c18.xml	SAT f=57 TT=2520.06 T1=2456.31	SAT (TO) f=57 TT=2520.06 T1=2456.31	? TT=39.129	No data	No data	? TT=48.055	No data	No data	? TT=43.319	? TT=61.648	? TT=57.658	? TT=47.846
CrosswordDesign/ CrosswordDesign-15-4-rom_c18.xml	SAT f=43 TT=2520.11 T1=1941.87	SAT (TO) f=43 TT=2520.11 T1=1941.87	? TT=42.319	No data	No data	? TT=50.029	No data	No data	? TT=41.921	? TT=73.035	? TT=63.246	? TT=46.696
Dubois/ Dubois-018_c18.xml	UNSAT TT=0.006	UNSAT TT=20.636	UNSAT TT=5.659	UNSAT TT=0.006	UNSAT TT=0.006	UNSAT TT=6.9	UNSAT TT=18.836	UNSAT TT=0.006	? (TO) TT=2520.06	UNSAT TT=6.776	? TT=308.751	UNSAT TT=7.375
Dubois/ Dubois-020_c18.xml	UNSAT TT=0.006	UNSAT TT=82.741	UNSAT TT=18.359	UNSAT TT=0.006	UNSAT TT=0.006	UNSAT TT=23.577	UNSAT TT=53.534	UNSAT TT=0.006	? (TO) TT=2520.02	UNSAT TT=23.816	? TT=315.995	UNSAT TT=23.882
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Dubois/ Dubois-021_c18.xml	UNSAT TT=0.006	UNSAT TT=178.399	UNSAT TT=34.811	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=45.457	UNSAT TT=66.078	UNSAT TT=0.006	? (TO) TT=2520.13	UNSAT TT=45.359	? TT=343.655	UNSAT TT=45.922
Dubois/ Dubois-022_c18.xml	UNSAT TT=0.006	UNSAT TT=385.845	UNSAT TT=69.543	UNSAT TT=0.006	UNSAT TT=0.007	UNSAT TT=88.836	UNSAT TT=140.016	UNSAT TT=0.007	? (TO) TT=2520.02	UNSAT TT=88.015	? TT=377.445	UNSAT TT=92.219
Dubois/ Dubois-023_c18.xml	UNSAT TT=0.007	UNSAT TT=642.665	UNSAT TT=137.666	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=177.563	UNSAT TT=325.883	UNSAT TT=0.007	? (TO) TT=2520.04	UNSAT TT=174.404	? TT=380.009	UNSAT TT=189.366
Dubois/ Dubois-024_c18.xml	UNSAT TT=0.007	UNSAT TT=1137.12	UNSAT TT=277.05	UNSAT TT=0.007	UNSAT TT=0.008	UNSAT TT=367.049	UNSAT TT=812.513	UNSAT TT=0.007	? (TO) TT=2520.05	UNSAT TT=365.755	? TT=393.152	UNSAT TT=384.317
Dubois/ Dubois-025_c18.xml	UNSAT TT=0.007	? (TO) TT=2520.09	UNSAT TT=560.109	UNSAT TT=0.007	UNSAT TT=0.007	UNSAT TT=729.84	UNSAT TT=1004.9	UNSAT TT=0.007	? (TO) TT=2520.03	UNSAT TT=734.976	? TT=800.706	UNSAT TT=771.319
Dubois/ Dubois-030_c18.xml	UNSAT TT=0.008	? (TO) TT=2520.04	? (TO) TT=2520.1	UNSAT TT=0.008	UNSAT TT=0.008	? (TO) TT=2520.04	? TT=2520	UNSAT TT=0.009	? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2520.07	? (TO) TT=2520.09
Dubois/ Dubois-040_c18.xml	UNSAT TT=0.01	? (TO) TT=2520	? (TO) TT=2520.1	UNSAT TT=0.01	UNSAT TT=0.01	? (TO) TT=2520.03	? TT=2520.01	UNSAT TT=0.014	? (TO) TT=2520.05	? (TO) TT=2520.05	? (TO) TT=2520.05	? (TO) TT=2520.03
Dubois/ Dubois-050_c18.xml	UNSAT TT=0.012	? (TO) TT=2520.1	? (TO) TT=2520.06	UNSAT TT=0.012	UNSAT TT=0.012	? (TO) TT=2520.04	? (TO) TT=2519.74	UNSAT TT=0.019	? (TO) TT=2520.07	? (TO) TT=2520.05	? (TO) TT=2520.08	? (TO) TT=2520.05
Dubois/ Dubois-075_c18.xml	UNSAT TT=0.018	? (TO) TT=2520.07	? (TO) TT=2520.09	UNSAT TT=0.018	UNSAT TT=0.019	? (TO) TT=2520.04	? (TO) TT=2519.93	UNSAT TT=0.034	? (TO) TT=2520.1	? (TO) TT=2520.05	? (TO) TT=2520.09	? (TO) TT=2520.04
Dubois/ Dubois-100_c18.xml	UNSAT TT=0.025	? (TO) TT=2520.08	? (TO) TT=2520.06	UNSAT TT=0.025	UNSAT TT=0.026	? (TO) TT=2520.06	? (TO) TT=2519.98	UNSAT TT=0.056	? (TO) TT=2520.04	? (TO) TT=2520.09	? (TO) TT=2520.07	? (TO) TT=2520.04
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Eternity/ Eternity-04-04_c18.xml	SAT TT=0.007	SAT TT=0.013	SAT TT=0.818	SAT TT=0.009	SAT TT=0.007	SAT TT=0.822	SAT TT=0.008	SAT TT=0.007	SAT TT=0.834	SAT TT=0.839	SAT TT=0.832	SAT (TO) TT=2520.03
Eternity/ Eternity-05-05_c18.xml	SAT TT=0.053	SAT TT=0.14	SAT TT=1.014	SAT TT=0.091	SAT TT=0.122	SAT TT=1.072	SAT TT=0.136	SAT TT=0.053	SAT TT=1.021	SAT TT=1.104	SAT TT=1.05	SAT (TO) TT=2520.1
Eternity/ Eternity-06-06_c18.xml	SAT TT=0.729	SAT TT=1.034	SAT TT=2.166	SAT TT=4.375	SAT TT=0.729	SAT TT=2.704	SAT TT=4.434	SAT TT=1.059	SAT TT=5.85	SAT TT=3.051	SAT TT=2.132	SAT (TO) TT=2520.1
Eternity/ Eternity-07-07_c18.xml	SAT TT=11.694	SAT TT=13.033	SAT TT=64.035	SAT TT=454.314	SAT TT=11.694	SAT TT=55.954	SAT TT=613.513	SAT TT=375.479	SAT TT=171.361	SAT TT=171.254	SAT TT=101.709	? (TO) TT=2520.03
Eternity/ Eternity-08-08_c18.xml		? (TO) TT=2519.98	? (TO) TT=2520.09	? TT=2520.02	? (TO) TT=2519.93	? (TO) TT=2520.12	? (TO) TT=2519.9	? (TO) TT=2519.78	? (TO) TT=2520.07	? (TO) TT=2520.06	? (TO) TT=2520.11	? (TO) TT=2520.08
Eternity/ Eternity-09-09_c18.xml		? (TO) TT=2520.08	? (TO) TT=2520.03	? (TO) TT=2519.92	? TT=2520.04	? (TO) TT=2520.1	? TT=2520.04	? (TO) TT=2519.63	? (TO) TT=2520.1	? (TO) TT=2520.07	? (TO) TT=2520.07	? (TO) TT=2520.09
Eternity/ Eternity-10-04_c18.xml	SAT TT=1.069	SAT TT=2.079	SAT TT=4.523	SAT TT=2.387	SAT TT=4.69	SAT TT=1.504	SAT TT=1.92	SAT TT=1.069	SAT TT=6.013	SAT TT=1.773	SAT TT=1.639	SAT (TO) TT=2520.08
Eternity/ Eternity-10-05_c18.xml	SAT TT=4.849	SAT TT=24.843	SAT TT=269.276	SAT TT=1818.88	SAT TT=43.692	SAT TT=78.848	SAT TT=4.849	SAT TT=20.353	SAT TT=13.031	SAT TT=230.278	SAT TT=130.934	SAT (TO) TT=2520.05
Eternity/ Eternity-10-06_c18.xml	SAT TT=1010.43	? (TO) TT=2519.69	? (TO) TT=2520.1	? TT=2520.03	? (TO) TT=2519.74	SAT TT=1010.43	? TT=2520.02	? (TO) TT=2519.66	? (TO) TT=2520.09	? (TO) TT=2520.09	? (TO) TT=2520.08	? (TO) TT=2520.11
Eternity/ Eternity-10-10_c18.xml		? (TO) TT=2519.94	? (TO) TT=2520.05	? TT=2520.06	? (TO) TT=2520.05	? (TO) TT=2520.1	? TT=2520.06	? (TO) TT=2519.4	? (TO) TT=2520.09	? (TO) TT=2520.1	? (TO) TT=2520.12	? (TO) TT=2520.03
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Eternity/ Eternity-11-11_c18.xml		? (TO) TT=2519.8	? (TO) TT=2520.11	? (TO) TT=2520.05	? (TO) TT=2519.98	? (TO) TT=2520.12	? (TO) TT=2519.94	? (TO) TT=2519.69	? (TO) TT=2520.06	? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2520.11
Eternity/ Eternity-12-12_c18.xml		? (TO) TT=2519.73	? (TO) TT=2520.03	? (TO) TT=2520.06	? (TO) TT=2519.73	? (TO) TT=2520.11	? (TO) TT=2519.92	? (TO) TT=2519.36	? (TO) TT=2520.08	? (TO) TT=2520.03	? (TO) TT=2520.07	? (TO) TT=2520.07
Eternity/ Eternity-13-13_c18.xml		? (TO) TT=2520.07	? (TO) TT=2520.1	? (TO) TT=2519.91	? (TO) TT=2520.01	? (TO) TT=2520.04	? (TO) TT=2519.99	? (TO) TT=2519.72	? (TO) TT=2520.1	? (TO) TT=2520.05	? (TO) TT=2520.08	? (TO) TT=2520.07
Eternity/ Eternity-14-14_c18.xml		? (TO) TT=2519.8	? (TO) TT=2520.04	? (TO) TT=2520.06	? (TO) TT=2519.79	? (TO) TT=2520.11	? (TO) TT=2519.99	? (TO) TT=2519.71	? (TO) TT=2520.1	? (TO) TT=2520.04	? (TO) TT=2520.07	? (TO) TT=2520.1
Eternity/ Eternity-15-15_c18.xml		? (TO) TT=2519.92	? (TO) TT=2520.06	? (TO) TT=2520.06	? (TO) TT=2520.04	? (TO) TT=2520.05	? (TO) TT=2519.98	? (TO) TT=2519.63	? (TO) TT=2520.07	? (TO) TT=2520.12	? (TO) TT=2520.11	? (TO) TT=2520.06
Fapp/Fapp-ext/ Fapp-ext-01-0200_c18.xml	SAT f=35891368 TT=2520.06 T1=1722.46	SAT (TO) f=35891368 TT=2520.06 T1=1722.46	SAT (TO) f=98242966 TT=2520.14 T1=191.83	No data	No data	? (TO) TT=2520.12	No data	No data	SAT (TO) f=80533724 TT=2520.14 T1=2493.19	SAT (TO) f=98253049 TT=2520.08 T1=2416.57	SAT f=98252677 TT=333.357 T1=316.56	SAT (TO) f=98243090 TT=2520.14 T1=2176.73
Fapp/Fapp-ext/ Fapp-ext-02-0250_c18.xml	SAT f=181903419 TT=2520.12 T1=2446.21	SAT (TO) f=181903419 TT=2520.12 T1=2446.21	SAT (TO) f=201569901 TT=2520.14 T1=444.32	No data	No data	SAT (TO) f=228636201 TT=2520.09 T1=2487.88	No data	No data	SAT (TO) f=201740834 TT=2520.14 T1=119.97	SAT (TO) f=201740847 TT=2520.09 T1=2000.32	? (TO) TT=2520.1	SAT (TO) f=201697974 TT=2520.11 T1=2452.61
Fapp/Fapp-ext/ Fapp-ext-03-0300_c18.xml	SAT f=470973176 TT=2520.12 T1=335.73	SAT (TO) f=470973176 TT=2520.12 T1=335.73	? TT=787.335	No data	No data	? TT=131.957	No data	No data	? TT=346.269	? TT=138.134	? TT=339.62	? TT=341.687
Fapp/Fapp-ext/ Fapp-ext-04-0300_c18.xml	SAT f=244954546 TT=2519.99 T1=999.51	SAT (TO) f=244954546 TT=2519.99 T1=999.51	? TT=1348.12	No data	No data	? TT=125.228	No data	No data	? TT=338.63	? TT=132.403	? TT=331.829	? TT=328.836
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	SAT f=536857239 TT=2519.85 T1=779.87	SAT (TO) f=536857239 TT=2519.85 T1=779.87	? TT=1575.34	No data	No data	? TT=593.77	No data	No data	? TT=316.685	? (TO) TT=2528.11	? TT=270.025	? TT=459.026
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Fapp/Fapp-ext/ Fapp-ext-ex1_c18.xml	OPT f=523 TT=0.4 T1=0.36	OPT f=523 TT=0.4 T1=0.36	SAT (TO) f=523 TT=2520.09 T1=2.48	No data	No data	SAT (TO) f=523 TT=2520.12 T1=0.88	No data	No data	SAT (TO) f=523 TT=2520.09 T1=0.88	SAT (TO) f=1291 TT=2520.1 T1=10.19	SAT f=523 TT=303.657 T1=4.44	SAT (TO) f=523 TT=2520.04 T1=0.75
Fapp/Fapp-ext/ Fapp-ext-ex2_c18.xml	OPT f=13871 TT=0.547 T1=0.54	OPT f=13871 TT=0.547 T1=0.54	SAT (TO) f=13871 TT=2520.06 T1=1.1	No data	No data	SAT (TO) f=13871 TT=2520.06 T1=2.23	No data	No data	SAT (TO) f=13871 TT=2520.05 T1=0.95	OPT f=13871 TT=4.738 T1=1.7	SAT f=13871 TT=305.115 T1=1.37	SAT (TO) f=13871 TT=2520.07 T1=1.07
Fapp/Fapp-ext/ Fapp-ext-test01-0150_c18.xml	SAT f=18299400 TT=2519.71 T1=931.68	SAT (TO) f=18299400 TT=2519.71 T1=931.68	SAT (TO) f=41141603 TT=2520.14 T1=123.61	No data	No data	SAT (TO) f=51771746 TT=2520.14 T1=2490.33	No data	No data	SAT (TO) f=45711678 TT=2520.05 T1=2444.46	SAT (TO) f=45718449 TT=2520.1 T1=1211.72	SAT f=41141589 TT=341.789 T1=274.46	SAT (TO) f=45704624 TT=2520.1 T1=1791.5
Fapp/Fapp-ext/ Fapp-ext-test02-0250_c18.xml	SAT f=89983130 TT=2520.03 T1=2469.3	SAT (TO) f=89983130 TT=2520.03 T1=2469.3	? TT=831.585	No data	No data	? TT=164.663	No data	No data	? TT=177.937	? TT=179.744	? TT=240.32	? TT=341.912
Fapp/Fapp-ext/ Fapp-ext-test03-0400_c18.xml	SAT f=287165498 TT=2520.07 T1=1855.53	SAT (TO) f=287165498 TT=2520.07 T1=1855.53	? TT=857.922	No data	No data	? TT=210.807	No data	No data	? TT=233.808	? TT=208.083	? TT=359.939	? TT=377.737
Frb/ frb-30-15-1_c18.xml	SAT TT=0.112	SAT TT=0.159	SAT TT=5.268	SAT TT=0.36	SAT TT=0.885	SAT TT=7.307	SAT TT=0.835	SAT TT=0.112	SAT TT=13.931	SAT TT=8.791	SAT TT=25.849	SAT (TO) TT=2520.11
Frb/ frb-35-17-1_c18.xml	SAT TT=2.36	SAT TT=2.36	SAT TT=25.327	SAT TT=7.118	SAT TT=12.001	SAT TT=44.476	SAT TT=12.778	SAT TT=2.726	SAT TT=175.82	SAT TT=70.713	SAT TT=101.775	SAT (TO) TT=2520.02
Frb/ frb-40-19-1-mgd_c18.xml	SAT TT=5.218	SAT TT=5.218	SAT TT=135.655	SAT TT=26.676	SAT TT=49.885	SAT TT=229.597	SAT TT=69.511	SAT TT=9.367	SAT TT=507.914	SAT TT=421.009	SAT TT=1239.61	? (TO) TT=2520.11
Frb/ frb-45-21-1_c18.xml	SAT TT=1880.58	SAT TT=1880.58	? (TO) TT=2520.12	? (TO) TT=2520.03	? (TO) TT=2519.99	? (TO) TT=2520.06	? (TO) TT=2519.99	? (TO) TT=2519.9	? (TO) TT=2520.1	? (TO) TT=2520.1	? (TO) TT=2520.06	? (TO) TT=2520.06
Frb/ frb-50-23-1-mgd_c18.xml		? (TO) TT=2519.83	? (TO) TT=2520.06	? TT=2520.05	? TT=2520.05	? (TO) TT=2520.09	? (TO) TT=2519.81	? (TO) TT=2519.85	? (TO) TT=2520.05	? (TO) TT=2520.05	? (TO) TT=2520.08	? (TO) TT=2520.03
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Frb/ frb-50-23-2-mgd_c18.xml		? (TO) TT=2519.94	? (TO) TT=2520.05	? TT=2520.04	? TT=2520.04	? (TO) TT=2520.1	? TT=2520.05	? (TO) TT=2519.8	? (TO) TT=2520.1	? (TO) TT=2520.02	? (TO) TT=2520.1	? (TO) TT=2520.04
Frb/ frb-50-23-3-mgd_c18.xml		? (TO) TT=2519.96	? (TO) TT=2520.03	? TT=2520.05	? (TO) TT=2519.75	? (TO) TT=2520.11	? (TO) TT=2520.02	? (TO) TT=2519.81	? (TO) TT=2520.11	? (TO) TT=2520.07	? (TO) TT=2520.1	? (TO) TT=2520.04
Frb/ frb-53-24-1-mgd_c18.xml		? (TO) TT=2519.82	? (TO) TT=2520.05	? TT=2520.05	? (TO) TT=2519.91	? (TO) TT=2520.12	? (TO) TT=2519.93	? (TO) TT=2519.81	? (TO) TT=2520.03	? (TO) TT=2520.08	? (TO) TT=2520.03	? (TO) TT=2520.12
Frb/ frb-53-24-2-mgd_c18.xml		? (TO) TT=2519.84	? (TO) TT=2520.1	? TT=2520.06	? (TO) TT=2519.83	? (TO) TT=2520.08	? (TO) TT=2519.9	? (TO) TT=2519.96	? (TO) TT=2520.03	? (TO) TT=2520.03	? (TO) TT=2520.11	? (TO) TT=2520.03
Frb/ frb-53-24-3-mgd_c18.xml		? (TO) TT=2519.96	? (TO) TT=2520.04	? TT=2520.06	? TT=2520.06	? (TO) TT=2520.12	? (TO) TT=2519.79	? (TO) TT=2519.86	? (TO) TT=2520.11	? (TO) TT=2520.09	? (TO) TT=2520.07	? (TO) TT=2520.02
Frb/ frb-56-25-1-mgd_c18.xml		? (TO) TT=2520.11	? (TO) TT=2520.01	? (TO) TT=2520.04	? (TO) TT=2519.98	? (TO) TT=2520.04	? (TO) TT=2519.95	? (TO) TT=2519.83	? (TO) TT=2520.11	? (TO) TT=2520.1	? (TO) TT=2520.04	? (TO) TT=2520.07
Frb/ frb-56-25-2-mgd_c18.xml		? (TO) TT=2519.85	? (TO) TT=2520.07	? (TO) TT=2520.07	? (TO) TT=2519.82	? (TO) TT=2520.06	? (TO) TT=2519.93	? (TO) TT=2519.93	? (TO) TT=2520.1	? (TO) TT=2520.1	? (TO) TT=2520.09	? (TO) TT=2520.09
Frb/ frb-56-25-3-mgd_c18.xml		? (TO) TT=2520.08	? (TO) TT=2520.02	? TT=2520.07	? (TO) TT=2519.91	? (TO) TT=2520.04	? (TO) TT=2519.93	? (TO) TT=2519.82	? (TO) TT=2520.06	? (TO) TT=2520.07	? (TO) TT=2520.06	? (TO) TT=2520.11
Frb/ frb-59-26-1-mgd_c18.xml		? (TO) TT=2520.08	? (TO) TT=2520.07	? (TO) TT=2520.04	? (TO) TT=2520.01	? (TO) TT=2520.03	? (TO) TT=2519.98	? (TO) TT=2519.93	? (TO) TT=2520.08	? (TO) TT=2520.07	? (TO) TT=2520.03	? (TO) TT=2520.05
Frb/ frb-59-26-2-mgd_c18.xml		? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2520.06	? TT=2520.08	? (TO) TT=2520.1	? (TO) TT=2519.99	? (TO) TT=2519.83	? (TO) TT=2520.06	? (TO) TT=2520.09	? (TO) TT=2520.04	? (TO) TT=2520.08
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Frb/ frb-59-26-3-mgd_c18.xml		? (TO) TT=2519.98	? (TO) TT=2520.04	? (TO) TT=2520.07	? (TO) TT=2520.07	? (TO) TT=2520.04	? TT=2520.07	? (TO) TT=2519.75	? (TO) TT=2520.09	? (TO) TT=2520.02	? (TO) TT=2520.09	? (TO) TT=2520.11
GolombRuler/ GolombRuler-a3v18-07_c18.xml	OPT f=25 TT=0.04 T1=0.02	OPT f=25 TT=0.04 T1=0.02	SAT (TO) f=27 TT=2520.04 T1=0.37	No data	No data	Wrong UNSAT TT=1.845	No data	No data	SAT (TO) f=25 TT=2520.04 T1=0.37	OPT f=25 TT=2.093 T1=0.35	SAT f=25 TT=302.907 T1=0.4	SAT (TO) f=25 TT=2520.05 T1=0.37
GolombRuler/ GolombRuler-a3v18-08_c18.xml	OPT f=34 TT=0.295 T1=0.1	OPT f=34 TT=0.295 T1=0.1	SAT (TO) f=40 TT=2520.08 T1=0.44	No data	No data	Wrong UNSAT TT=4.424	No data	No data	SAT (TO) f=34 TT=2520.06 T1=1.18	OPT f=34 TT=5.769 T1=0.4	SAT f=34 TT=302.65 T1=0.52	SAT (TO) f=34 TT=2520.1 T1=0.57
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT f=44 TT=1.824 T1=0.79	OPT f=44 TT=1.824 T1=1.34	SAT (TO) f=56 TT=2520.09 T1=0.47	No data	No data	Wrong UNSAT TT=25.796	No data	No data	SAT (TO) f=44 TT=2520.03 T1=3.01	OPT f=44 TT=45.754 T1=0.79	SAT f=44 TT=302.621 T1=14.97	SAT (TO) f=44 TT=2520.03 T1=1.34
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT f=55 TT=14.985 T1=4.07	OPT f=55 TT=14.985 T1=8.85	SAT (TO) f=80 TT=2520.05 T1=0.37	No data	No data	Wrong UNSAT TT=241.494	No data	No data	SAT (TO) f=55 TT=2520.09 T1=84.66	OPT f=55 TT=443.958 T1=4.07	SAT f=56 TT=302.817 T1=2.57	SAT (TO) f=60 TT=2520.05 T1=1.23
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT f=72 TT=372.302 T1=22.72	OPT f=72 TT=372.302 T1=77.17	SAT (TO) f=96 TT=2520.11 T1=0.38	No data	No data	SAT (TO) f=72 TT=2520.07 T1=227.96	No data	No data	SAT (TO) f=72 TT=2520.04 T1=259.52	SAT (TO) f=72 TT=2520.04 T1=22.72	SAT f=74 TT=302.564 T1=1.67	SAT (TO) f=78 TT=2520.03 T1=1.35
GolombRuler/ GolombRuler-a3v18-12_c18.xml	SAT f=85 TT=2520.11 T1=884.65	SAT (TO) f=91 TT=2520.08 T1=295.53	SAT (TO) f=121 TT=2520.04 T1=0.42	No data	No data	SAT (TO) f=91 TT=2520.12 T1=709.01	No data	No data	SAT (TO) f=85 TT=2520.11 T1=884.65	SAT (TO) f=91 TT=2520.02 T1=58.03	SAT f=93 TT=302.398 T1=13.41	SAT (TO) f=105 TT=2520.12 T1=2.02
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT f=109 TT=2520.09 T1=1970.47	SAT (TO) f=113 TT=2520.1 T1=883.56	SAT (TO) f=147 TT=2520.07 T1=0.41	No data	No data	SAT (TO) f=109 TT=2520.09 T1=1970.47	No data	No data	SAT (TO) f=114 TT=2520.1 T1=588.7	SAT (TO) f=110 TT=2520.05 T1=954.26	SAT f=116 TT=302.626 T1=297.86	SAT (TO) f=124 TT=2520.12 T1=4.62
GolombRuler/ GolombRuler-a3v18-14_c18.xml	SAT f=135 TT=2520.08 T1=294.31	SAT (TO) f=141 TT=2520.1 T1=1719.39	SAT (TO) f=177 TT=2520.05 T1=0.42	No data	No data	SAT (TO) f=135 TT=2520.08 T1=649.77	No data	No data	SAT (TO) f=140 TT=2520.04 T1=2021.9	SAT (TO) f=135 TT=2520.11 T1=294.31	SAT f=145 TT=302.543 T1=49.94	SAT (TO) f=168 TT=2520.03 T1=4.77
GolombRuler/ GolombRuler-a3v18-15_c18.xml	SAT f=161 TT=2520.04 T1=947	SAT (TO) f=176 TT=2520.08 T1=1602.13	SAT (TO) f=161 TT=2520.04 T1=947	No data	No data	SAT (TO) f=162 TT=2520.05 T1=2245.15	No data	No data	SAT (TO) f=170 TT=2520.06 T1=805.67	SAT (TO) f=162 TT=2520.11 T1=1668.27	SAT f=173 TT=302.702 T1=38.49	SAT (TO) f=197 TT=2520.09 T1=0.73
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
GolombRuler/ GolombRuler-a3v18-16_c18.xml	SAT f=192 TT=2520.07 T1=2448.4	SAT (TO) f=212 TT=2520.08 T1=336.49	SAT (TO) f=192 TT=2520.07 T1=2448.4	No data	No data	SAT (TO) f=204 TT=2520.09 T1=2185.72	No data	No data	SAT (TO) f=201 TT=2520.09 T1=1640.01	SAT (TO) f=196 TT=2520.09 T1=2183.36	SAT f=202 TT=302.686 T1=30.84	SAT (TO) f=226 TT=2520.02 T1=8.52
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT f=44 TT=11.609 T1=4.5	OPT f=44 TT=11.609 T1=9.07	SAT (TO) f=56 TT=2520.09 T1=0.69	No data	No data	Wrong UNSAT TT=97.566	No data	No data	SAT (TO) f=44 TT=2520.03 T1=6.41	OPT f=44 TT=75.611 T1=4.5	SAT f=64 TT=302.573 T1=9.26	SAT (TO) f=52 TT=2520.1 T1=248.77
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT f=55 TT=174.122 T1=132.1	OPT f=55 TT=174.122 T1=144.03	SAT (TO) f=80 TT=2520.08 T1=0.98	No data	No data	Wrong UNSAT TT=858.026	No data	No data	SAT (TO) f=55 TT=2520.11 T1=336.78	OPT f=55 TT=1285.07 T1=132.1	SAT f=80 TT=303.25 T1=1.04	SAT (TO) f=73 TT=2520.04 T1=2276.37
GolombRuler/ GolombRuler-a3v18-nodv-11_c18.xml	SAT f=72 TT=2519.98 T1=379.97	SAT (TO) f=72 TT=2519.98 T1=379.97	SAT (TO) f=96 TT=2520.13 T1=1.27	No data	No data	SAT (TO) f=72 TT=2520.1 T1=625.97	No data	No data	SAT (TO) f=74 TT=2520.06 T1=2061.87	SAT (TO) f=76 TT=2520.04 T1=898.27	SAT f=96 TT=302.555 T1=3.16	SAT (TO) f=96 TT=2520.05 T1=0.97
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT TT=0.021	? (TO) TT=2520.08	? (TO) TT=2520.03	SAT TT=1.17	SAT TT=0.021	? (TO) TT=2520.09	SAT TT=0.021	SAT TT=5.262	? (TO) TT=2520.1	? (TO) TT=2520.05	? (TO) TT=2520.02	SAT (TO) TT=2520.07
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT TT=0.009	SAT TT=0.575	SAT TT=0.765	SAT TT=0.014	SAT TT=0.009	? (TO) TT=2520.04	SAT TT=0.009	SAT TT=0.217	SAT TT=0.792	? (TO) TT=2520.05	? (TO) TT=2520.05	SAT (TO) TT=2520.1
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT TT=0.027	SAT TT=2.54	SAT TT=7.569	SAT TT=0.4	SAT TT=0.06	? (TO) TT=2520.06	SAT TT=0.027	SAT TT=0.527	SAT TT=1.452	? (TO) TT=2520.04	? (TO) TT=2520.02	SAT (TO) TT=2520.1
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT TT=0.809	SAT TT=1322.77	? (TO) TT=2520.08	SAT TT=438.893	SAT TT=5.399	? (TO) TT=2520.02	SAT TT=0.809	SAT TT=179.596	? (TO) TT=2520.11	? (TO) TT=2520.07	? (TO) TT=2520.04	SAT (TO) TT=2520.02
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT TT=54.16	? (TO) TT=2520.08	? (TO) TT=2520.06	SAT TT=2104.75	SAT TT=425.388	? (TO) TT=2520.04	SAT TT=54.16	? (TO) TT=2519.85	? (TO) TT=2520.06	? (TO) TT=2520.04	? (TO) TT=2520.03	? (TO) TT=2520.09
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT TT=68.119	? (TO) TT=2519.83	? (TO) TT=2520.05	SAT TT=451.632	SAT TT=86.302	? (TO) TT=2520.07	SAT TT=354.745	? (TO) TT=2519.88	SAT TT=68.119	? (TO) TT=2520.1	? (TO) TT=2520.06	? (TO) TT=2520.06
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
GracefulGraph/ GracefulGraph-K05-P03_c18.xml		? (TO) TT=2519.93	? (TO) TT=2520.04	? TT=2520	? TT=2520.01	? (TO) TT=2520.05	? (TO) TT=2519.87	? (TO) TT=2519.84	? (TO) TT=2520.1	? (TO) TT=2520.07	? (TO) TT=2520.1	? (TO) TT=2520.09
GracefulGraph/ GracefulGraph-K06-P02_c18.xml		? (TO) TT=2520.07	? (TO) TT=2520.11	? TT=2520	? (TO) TT=2519.97	? (TO) TT=2520.12	? (TO) TT=2519.96	? (TO) TT=2519.9	? (TO) TT=2520.03	? (TO) TT=2520.1	? (TO) TT=2520.07	? (TO) TT=2520.04
GracefulGraph/ GracefulGraph-K06-P03_c18.xml		? (TO) TT=2520.02	? (TO) TT=2520.02	? TT=2520.02	? TT=2520.02	? (TO) TT=2520.1	? (TO) TT=2519.96	? (TO) TT=2519.94	? (TO) TT=2520.12	? (TO) TT=2520.05	? (TO) TT=2520.09	? (TO) TT=2520.02
GracefulGraph/ GracefulGraph-K07-P02_c18.xml		? (TO) TT=2519.9	? (TO) TT=2520.06	? (TO) TT=2519.95	? TT=2520.02	? (TO) TT=2520.05	? (TO) TT=2519.79	? (TO) TT=2519.73	? (TO) TT=2520.08	? (TO) TT=2520.04	? (TO) TT=2520.12	? (TO) TT=2520.06
GracefulGraph/ GracefulGraph-K07-P03_c18.xml		? (TO) TT=2520.07	? (TO) TT=2520.03	? (TO) TT=2519.95	? (TO) TT=2519.73	? (TO) TT=2520.04	? TT=2520.02	? (TO) TT=2519.92	? (TO) TT=2520.04	? (TO) TT=2520.08	? (TO) TT=2520.04	? (TO) TT=2520.01
GraphColoring/ GraphColoring-2-fullins-5_c18.xml	OPT f=6 TT=354.284 T1=1.97	OPT f=6 TT=354.284 T1=1.97	SAT (TO) f=7 TT=2520.12 T1=4.27	No data	No data	SAT (TO) f=851 TT=2520.12 T1=3.05	No data	No data	SAT (TO) f=6 TT=2520.13 T1=6.19	SAT (TO) f=7 TT=2520.11 T1=3.85	SAT f=7 TT=306.979 T1=4.07	SAT (TO) f=6 TT=2520.08 T1=11.52
GraphColoring/ GraphColoring-3-fullins-5_c18.xml	SAT f=7 TT=315.869 T1=5.69	SAT (TO) f=7 TT=2519.82 T1=5.69	SAT (TO) f=8 TT=2520.09 T1=7.34	No data	No data	SAT (TO) f=2029 TT=2520.09 T1=10.16	No data	No data	SAT (TO) f=7 TT=2520.07 T1=11.03	SAT (TO) f=8 TT=2520.09 T1=6.48	SAT f=7 TT=315.869 T1=16.7	SAT (TO) f=7 TT=2520.07 T1=489.71
GraphColoring/ GraphColoring-4-fullins-4_c18.xml	OPT f=7 TT=15.13 T1=1.06	OPT f=7 TT=15.13 T1=1.06	SAT (TO) f=8 TT=2520.05 T1=1.94	No data	No data	SAT (TO) f=689 TT=2520.04 T1=1.74	No data	No data	SAT (TO) f=7 TT=2520.03 T1=2.93	SAT (TO) f=8 TT=2520.05 T1=1.66	SAT f=7 TT=304.802 T1=5.17	SAT (TO) f=7 TT=2520.07 T1=7.52
GraphColoring/ GraphColoring-4-fullins-5_c18.xml	SAT f=8 TT=2519.92 T1=13.49	SAT (TO) f=8 TT=2519.92 T1=13.49	SAT (TO) f=9 TT=2520.81 T1=37.61	No data	No data	SAT (TO) f=4145 TT=2520.12 T1=38.43	No data	No data	SAT (TO) f=8 TT=2520.14 T1=67.94	SAT (TO) f=9 TT=2520.14 T1=32.4	SAT f=9 TT=349.552 T1=75.63	? (NS) TT=47.67
GraphColoring/ GraphColoring-5-fullins-3_c18.xml	OPT f=7 TT=0.358 T1=0.13	OPT f=7 TT=0.358 T1=0.13	SAT (TO) f=7 TT=2520.12 T1=0.58	No data	No data	SAT (TO) f=153 TT=2520.09 T1=0.6	No data	No data	SAT (TO) f=7 TT=2520.03 T1=0.58	SAT (TO) f=7 TT=2520.1 T1=0.57	SAT f=7 TT=303.84 T1=0.58	SAT (TO) f=7 TT=2520.08 T1=0.57
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
GraphColoring/ GraphColoring-5-fullins-4_c18.xml	OPT f=8 TT=206.048 T1=1.85	OPT f=8 TT=206.048 T1=1.85	SAT (TO) f=9 TT=2520.06 T1=2.14	No data	No data	SAT (TO) f=1084 TT=2520.12 T1=3.25	No data	No data	SAT (TO) f=8 TT=2520.06 T1=4.52	SAT (TO) f=9 TT=2520.09 T1=2.69	SAT f=8 TT=306.713 T1=7.4	SAT (TO) f=8 TT=2520.1 T1=8.41
GraphColoring/ GraphColoring-qg-order100_c18.xml		? (MO) TT=70.092	? TT=113.742	No data	No data	? TT=83.821	No data	No data	? TT=87.587	? TT=88.506	? TT=78.15	? TT=86.12
GraphColoring/ GraphColoring-qg-order30_c18.xml	SAT f=29 TT=2520.01 T1=4.51	SAT (TO) f=29 TT=2520.01 T1=4.51	SAT (TO) f=35 TT=2520.09 T1=8.02	No data	No data	SAT (TO) f=899 TT=2520.12 T1=5.82	No data	No data	SAT (TO) f=29 TT=2520.08 T1=124.08	SAT (TO) f=35 TT=2520.11 T1=5.97	SAT f=33 TT=310.036 T1=108.72	SAT (TO) f=30 TT=2520.08 T1=436.31
GraphColoring/ GraphColoring-qg-order40_c18.xml	SAT f=39 TT=2519.93 T1=10.81	SAT (TO) f=39 TT=2519.93 T1=10.81	SAT (TO) f=49 TT=2520.21 T1=21.44	No data	No data	SAT (TO) f=1599 TT=2520.11 T1=17.06	No data	No data	SAT (TO) f=40 TT=2520.12 T1=425.92	SAT (TO) f=49 TT=2520.07 T1=20.28	SAT f=53 TT=319.095 T1=11.52	SAT (TO) f=49 TT=2520.06 T1=22
GraphColoring/ GraphColoring-qg-order60_c18.xml	SAT f=59 TT=2519.41 T1=81.19	SAT (TO) f=59 TT=2519.41 T1=81.19	? TT=67.798	No data	No data	? TT=68.257	No data	No data	? TT=72.695	? TT=75.694	? TT=77.96	? TT=63.292
GraphColoring/ GraphColoring-queen5-5_c18.xml	OPT f=4 TT=0.029 T1=0.03	OPT f=4 TT=0.029 T1=0.03	SAT (TO) f=4 TT=2520.08 T1=0.4	No data	No data	SAT (TO) f=4 TT=2520.07 T1=0.42	No data	No data	SAT (TO) f=4 TT=2520.02 T1=0.41	OPT f=4 TT=0.896 T1=0.41	SAT f=4 TT=304.08 T1=0.4	SAT (TO) f=4 TT=2520.12 T1=0.41
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT TT=0.004	UNSAT TT=0.005	UNSAT TT=0.564	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.629	UNSAT TT=0.007	UNSAT TT=0.004	? (TO) TT=2520.03	UNSAT TT=0.6	? TT=304.654	UNSAT TT=0.586
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT TT=0.005	UNSAT TT=3.648	UNSAT TT=1.526	UNSAT TT=0.006	UNSAT TT=0.005	UNSAT TT=1.698	UNSAT TT=0.671	UNSAT TT=0.006	? (TO) TT=2520.03	UNSAT TT=1.459	? TT=305.349	UNSAT TT=3.829
Haystacks/ Haystacks-ext-06_c18.xml	UNSAT TT=0.009	? (TO) TT=2519.84	UNSAT TT=12.736	UNSAT TT=0.009	UNSAT TT=0.012	UNSAT TT=14.502	? (TO) TT=2519.93	UNSAT TT=0.01	? (TO) TT=2520.09	UNSAT TT=16.718	? (TO) TT=2520.1	UNSAT TT=686.646
Haystacks/ Haystacks-ext-07_c18.xml	UNSAT TT=0.024	? (TO) TT=2519.98	? (TO) TT=2520.12	UNSAT TT=0.036	UNSAT TT=0.038	? (TO) TT=2520.11	? TT=2520.01	UNSAT TT=0.024	? (TO) TT=2520.04	? (TO) TT=2520.01	? (TO) TT=2520.07	? (TO) TT=2520.04
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Haystacks/ Haystacks-ext-08_c18.xml	UNSAT TT=0.125	? (TO) TT=2519.88	? (TO) TT=2520.02	UNSAT TT=0.229	UNSAT TT=0.232	? (TO) TT=2520.04	? (TO) TT=2519.93	UNSAT TT=0.125	? (TO) TT=2520.07	? (TO) TT=2520.05	? (TO) TT=2520.09	? (TO) TT=2520.11
Haystacks/ Haystacks-ext-09_c18.xml	UNSAT TT=1.894	? (TO) TT=2519.95	? (TO) TT=2520.05	UNSAT TT=1.894	UNSAT TT=1.995	? (TO) TT=2520.09	? (TO) TT=2519.93	UNSAT TT=2.808	? (TO) TT=2520.03	? (TO) TT=2520.05	? (TO) TT=2520.05	? (TO) TT=2520.08
Haystacks/ Haystacks-ext-10_c18.xml	UNSAT TT=17.759	? (TO) TT=2520	? (TO) TT=2520.12	UNSAT TT=17.759	UNSAT TT=19.208	? (TO) TT=2520.02	? (TO) TT=2519.97	UNSAT TT=543.859	? (TO) TT=2520.05	? (TO) TT=2520.06	? (TO) TT=2520.05	? (TO) TT=2520.06
Haystacks/ Haystacks-ext-11_c18.xml	UNSAT TT=197.639	? (TO) TT=2519.89	? (TO) TT=2520.12	UNSAT TT=197.639	UNSAT TT=207.7	? (TO) TT=2520.08	? TT=2520.01	? (TO) TT=2519.96	? (TO) TT=2520.12	? (TO) TT=2520.04	? (TO) TT=2520.06	? (TO) TT=2520.05
Haystacks/ Haystacks-ext-12_c18.xml	UNSAT TT=2367.8	? (TO) TT=2519.98	? (TO) TT=2520.11	UNSAT TT=2367.8	? (TO) TT=2519.84	? (TO) TT=2520.03	? TT=2520.02	? (TO) TT=2519.96	? (TO) TT=2520.09	? (TO) TT=2520.09	? (TO) TT=2520.07	? (TO) TT=2520.11
Haystacks/ Haystacks-ext-13_c18.xml		? (TO) TT=2519.96	? (TO) TT=2520.09	? TT=2520.01	? (TO) TT=2520.02	? (TO) TT=2520.02	? (TO) TT=2519.8	? (TO) TT=2519.99	? (TO) TT=2520.1	? (TO) TT=2520.11	? (TO) TT=2520.04	? (TO) TT=2520.09
Knapsack/ Knapsack-30-100-00_c18.xml	OPT f=709 TT=0.747 T1=0.33	OPT f=709 TT=0.747 T1=0.43	SAT (TO) f=709 TT=2520.09 T1=0.34	No data	No data	SAT (TO) f=709 TT=2520.11 T1=0.34	No data	No data	SAT (TO) f=512 TT=2520.1 T1=0.36	OPT f=709 TT=2.379 T1=1.07	SAT f=709 TT=302.473 T1=0.33	SAT (TO) f=709 TT=2520.02 T1=0.85
Knapsack/ Knapsack-30-100-01_c18.xml	OPT f=871 TT=0.462 T1=0.33	OPT f=871 TT=0.462 T1=0.35	SAT (TO) f=871 TT=2520.11 T1=0.33	No data	No data	SAT (TO) f=871 TT=2521.47 T1=0.37	No data	No data	SAT (TO) f=871 TT=2520.03 T1=0.37	OPT f=871 TT=1.05 T1=0.36	SAT f=871 TT=302.045 T1=0.35	SAT (TO) f=871 TT=2520.09 T1=0.35
Knapsack/ Knapsack-40-150-00_c18.xml	OPT f=932 TT=26.848 T1=0.39	OPT f=932 TT=26.848 T1=20.45	SAT (TO) f=932 TT=2520.11 T1=1.24	No data	No data	? (TO) TT=2527.9	No data	No data	SAT (TO) f=755 TT=2520.11 T1=0.38	OPT f=932 TT=120.451 T1=91.09	SAT f=932 TT=302.036 T1=0.39	SAT (TO) f=932 TT=2520.08 T1=14.32
Knapsack/ Knapsack-40-150-01_c18.xml	OPT f=1128 TT=19.141 T1=0.42	OPT f=1128 TT=19.141 T1=17.95	SAT (TO) f=1128 TT=2520.04 T1=0.95	No data	No data	SAT (TO) f=1128 TT=2522 T1=0.42	No data	No data	SAT (TO) f=901 TT=2520.07 T1=0.36	OPT f=1128 TT=34.159 T1=28.04	SAT f=1128 TT=302.161 T1=0.53	SAT (TO) f=1128 TT=2520.07 T1=5.58
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Knapsack/ Knapsack-50-200-00_c18.xml	OPT f=960 TT=39.576 T1=0.4	OPT f=960 TT=60.795 T1=60.41	SAT (TO) f=960 TT=2520.02 T1=0.88	No data	No data	SAT (TO) f=960 TT=2520.06 T1=0.4	No data	No data	SAT (TO) f=691 TT=2520.08 T1=0.34	OPT f=960 TT=39.576 T1=26.52	SAT f=960 TT=302.594 T1=0.49	SAT (TO) f=960 TT=2520.07 T1=8.31
Knapsack/ Knapsack-50-200-01_c18.xml	OPT f=1297 TT=84.628 T1=0.53	OPT f=1297 TT=84.628 T1=78.67	SAT (TO) f=1297 TT=2520.02 T1=0.97	No data	No data	SAT (TO) f=1297 TT=2520.04 T1=0.53	No data	No data	SAT (TO) f=719 TT=2520.02 T1=0.34	OPT f=1297 TT=157.38 T1=88.21	SAT f=1297 TT=302.025 T1=0.79	SAT (TO) f=1297 TT=2520.09 T1=97.68
Knapsack/ Knapsack-60-250-00_c18.xml	SAT f=1404 TT=302.522 T1=0.56	SAT (TO) f=1378 TT=2520.01 T1=2423.46	SAT (TO) f=1404 TT=2520.03 T1=98.37	No data	No data	SAT (TO) f=1404 TT=2520.14 T1=0.56	No data	No data	SAT (TO) f=767 TT=2520.04 T1=0.34	SAT (TO) f=1286 TT=2520.08 T1=1353.4	SAT f=1404 TT=302.522 T1=0.79	SAT (TO) f=1404 TT=2520.11 T1=122.92
Knapsack/ Knapsack-60-250-01_c18.xml	OPT f=1323 TT=1600.84 T1=0.47	OPT f=1323 TT=1600.84 T1=1499.42	SAT (TO) f=1323 TT=2520.12 T1=3.38	No data	No data	SAT (TO) f=1323 TT=2520.13 T1=0.47	No data	No data	SAT (TO) f=845 TT=2520.12 T1=0.36	OPT f=1323 TT=2160.31 T1=1396.25	SAT f=1323 TT=301.993 T1=0.55	SAT (TO) f=1313 TT=2520.1 T1=484.14
Knapsack/ Knapsack-70-300-00_c18.xml	SAT f=1425 TT=2520.06 T1=0.56	SAT (TO) f=1327 TT=2519.96 T1=2484.21	SAT (TO) f=1425 TT=2520.06 T1=163.45	No data	No data	SAT (TO) f=1425 TT=2520.07 T1=0.56	No data	No data	SAT (TO) f=643 TT=2520.09 T1=0.35	SAT (TO) f=1192 TT=2520.02 T1=1763.18	SAT f=1422 TT=301.975 T1=9.67	SAT (TO) f=1366 TT=2520.11 T1=2363.02
Knapsack/ Knapsack-70-300-01_c18.xml	SAT f=1465 TT=302 T1=0.56	SAT (TO) f=1378 TT=2520.08 T1=2300.2	SAT (TO) f=1465 TT=2520.06 T1=12.82	No data	No data	SAT (TO) f=1465 TT=2520.1 T1=0.56	No data	No data	SAT (TO) f=756 TT=2520.07 T1=0.36	SAT (TO) f=1196 TT=2520.1 T1=2338.95	SAT f=1465 TT=302 T1=11.65	SAT (TO) f=1366 TT=2520.09 T1=398.9
Knapsack/ Knapsack-80-350-00_c18.xml	SAT f=1564 TT=302.239 T1=6.28	SAT (TO) f=1375 TT=2519.95 T1=2509.47	SAT (TO) f=1564 TT=2520.12 T1=321.65	No data	No data	SAT (TO) f=1564 TT=2520.13 T1=82.03	No data	No data	SAT (TO) f=752 TT=2520.05 T1=0.36	SAT (TO) f=1243 TT=2520.09 T1=1802.19	SAT f=1564 TT=302.239 T1=6.28	SAT (TO) f=1447 TT=2520.03 T1=148.12
Knapsack/ Knapsack-80-350-01_c18.xml	SAT f=1668 TT=302.063 T1=0.39	SAT (TO) f=1535 TT=2520.11 T1=417.3	SAT (TO) f=1668 TT=2520.02 T1=83.58	No data	No data	SAT (TO) f=1668 TT=2520.07 T1=0.39	No data	No data	SAT (TO) f=831 TT=2520.1 T1=0.38	SAT (TO) f=1350 TT=2520.05 T1=1970.36	SAT f=1668 TT=302.063 T1=3.66	SAT (TO) f=1601 TT=2520.09 T1=2175.64
Knapsack/ Knapsack-90-400-00_c18.xml	SAT f=1551 TT=2520.04 T1=69.03	SAT (TO) f=1286 TT=2519.95 T1=2508.86	SAT (TO) f=1551 TT=2520.04 T1=566.89	No data	No data	SAT (TO) f=1551 TT=2520.11 T1=69.03	No data	No data	SAT (TO) f=669 TT=2520.02 T1=0.33	SAT (TO) f=1192 TT=2520.04 T1=1375.11	SAT f=1547 TT=302.583 T1=4.59	SAT (TO) f=1418 TT=2520.06 T1=1781.17
Knapsack/ Knapsack-90-400-01_c18.xml	SAT f=1681 TT=302.08 T1=0.48	SAT (TO) f=1292 TT=2519.98 T1=2427.76	SAT (TO) f=1681 TT=2520.03 T1=173.61	No data	No data	SAT (TO) f=1681 TT=2520.1 T1=0.48	No data	No data	SAT (TO) f=571 TT=2520.03 T1=0.35	SAT (TO) f=1248 TT=2520.11 T1=1095.51	SAT f=1681 TT=302.08 T1=3.49	SAT (TO) f=1352 TT=2520.1 T1=977.34
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Langford/ LangfordBin-06_c18.xml	UNSAT TT=0.204	UNSAT TT=1.044	UNSAT TT=0.667	UNSAT TT=0.237	UNSAT TT=0.223	UNSAT TT=0.776	UNSAT TT=0.204	UNSAT TT=0.536	? (TO) TT=2520.09	UNSAT TT=0.536	Wrong Cert. TT=0.607	UNSAT TT=0.663
Langford/ LangfordBin-07_c18.xml	SAT TT=0.005	SAT TT=0.007	SAT TT=0.595	SAT TT=0.161	SAT TT=0.159	SAT TT=0.604	SAT TT=0.133	SAT TT=0.005	SAT TT=0.625	Wrong UNSAT TT=0.546	SAT TT=0.587	SAT (TO) TT=2520.12
Langford/ LangfordBin-08_c18.xml	SAT TT=0.006	SAT TT=0.008	SAT TT=0.618	SAT TT=3.323	SAT TT=2.589	SAT TT=0.659	SAT TT=2.949	SAT TT=0.006	SAT TT=0.701	Wrong UNSAT TT=0.549	SAT TT=0.609	SAT (TO) TT=2520.1
Langford/ LangfordBin-09_c18.xml	UNSAT TT=0.558	? (TO) TT=2520.07	UNSAT TT=42.091	? (TO) TT=2519.96	? TT=2520	UNSAT TT=6.09	? TT=2520.01	? (TO) TT=2519.8	? (TO) TT=2520.07	UNSAT TT=0.558	Wrong Cert. TT=1.55	UNSAT TT=2.881
Langford/ LangfordBin-10_c18.xml	UNSAT TT=0.575	? (TO) TT=2520.03	? (TO) TT=2520.03	? TT=2520	? TT=2520.01	UNSAT TT=21.088	? (TO) TT=2520	? (TO) TT=2519.84	? (TO) TT=2520.13	UNSAT TT=0.575	Wrong Cert. TT=3.411	UNSAT TT=10.252
Langford/ LangfordBin-11_c18.xml	SAT TT=0.007	SAT TT=0.015	SAT TT=0.642	? TT=2520	? (TO) TT=2519.86	SAT TT=1.447	? (TO) TT=2519.95	SAT TT=0.007	SAT TT=0.995	Wrong UNSAT TT=0.572	SAT TT=0.781	SAT (TO) TT=2520.08
Langford/ LangfordBin-12_c18.xml	SAT TT=0.018	SAT TT=0.018	SAT TT=0.814	? TT=2520	? TT=2520.01	SAT TT=0.913	? (TO) TT=2519.93	? (TO) TT=2519.79	SAT TT=1.009	Wrong UNSAT TT=0.613	SAT TT=0.728	SAT (TO) TT=2520.09
Langford/ LangfordBin-13_c18.xml	UNSAT TT=0.615	? (TO) TT=2520.1	? (TO) TT=2520.05	? (TO) TT=2519.94	? (TO) TT=2519.83	? (TO) TT=2520.07	? (TO) TT=2519.94	? (TO) TT=2519.73	? (TO) TT=2520.05	UNSAT TT=0.615	Wrong Cert. TT=268.549	? (TO) TT=2520.1
Langford/ LangfordBin-14_c18.xml	UNSAT TT=0.624	? (TO) TT=2520.08	? (TO) TT=2520.11	? (TO) TT=2519.92	? (TO) TT=2520.01	? (TO) TT=2520.03	? (TO) TT=2519.98	? (TO) TT=2519.8	? (TO) TT=2520.11	UNSAT TT=0.624	? (TO) TT=2520.07	? (TO) TT=2520.07
Langford/ LangfordBin-15_c18.xml	SAT TT=0.006	SAT TT=0.018	SAT TT=0.664	? TT=2520	? (TO) TT=2519.77	SAT TT=1.027	? (TO) TT=2519.87	SAT TT=0.006	SAT TT=0.901	Wrong UNSAT TT=0.64	SAT TT=0.717	SAT (TO) TT=2520.09
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Langford/ LangfordBin-16_c18.xml	SAT TT=0.017	? (TO) TT=2519.75	SAT TT=0.876	? TT=2520.01	? (TO) TT=2519.91	SAT TT=1.713	? (TO) TT=2519.8	SAT TT=0.017	SAT TT=1.187	Wrong UNSAT TT=0.629	SAT TT=0.819	SAT (TO) TT=2520.03
LowAutocorrelation/ LowAutocorrelation-015_c18.xml	OPT f=15 TT=7.739 T1=0.24	OPT f=15 TT=7.739 T1=0.24	? TT=0.633	No data	No data	? TT=0.641	No data	No data	? TT=0.647	? TT=0.635	? TT=0.643	? TT=0.648
LowAutocorrelation/ LowAutocorrelation-020_c18.xml	OPT f=26 TT=549.024 T1=289.52	OPT f=26 TT=549.024 T1=289.52	? TT=0.715	No data	No data	? TT=0.712	No data	No data	? TT=0.711	? TT=0.731	? TT=0.713	? TT=0.698
LowAutocorrelation/ LowAutocorrelation-021_c18.xml	OPT f=26 TT=1039.43 T1=78.78	OPT f=26 TT=1039.43 T1=78.78	? TT=0.71	No data	No data	? TT=0.712	No data	No data	? TT=0.735	? TT=0.721	? TT=0.726	? TT=0.722
LowAutocorrelation/ LowAutocorrelation-022_c18.xml	SAT f=39 TT=2519.93 T1=523.42	SAT (TO) f=39 TT=2519.93 T1=523.42	? TT=0.748	No data	No data	? TT=0.748	No data	No data	? TT=0.747	? TT=0.757	? TT=0.756	? TT=0.756
LowAutocorrelation/ LowAutocorrelation-023_c18.xml	SAT f=47 TT=2520.08 T1=191.71	SAT (TO) f=47 TT=2520.08 T1=191.71	? TT=0.746	No data	No data	? TT=0.756	No data	No data	? TT=0.761	? TT=0.784	? TT=0.763	? TT=0.77
LowAutocorrelation/ LowAutocorrelation-024_c18.xml	SAT f=56 TT=2520.08 T1=73.84	SAT (TO) f=56 TT=2520.08 T1=73.84	? TT=0.768	No data	No data	? TT=0.766	No data	No data	? TT=0.774	? TT=0.812	? TT=0.789	? TT=0.787
LowAutocorrelation/ LowAutocorrelation-025_c18.xml	SAT f=48 TT=2519.96 T1=691.35	SAT (TO) f=48 TT=2519.96 T1=691.35	? TT=0.779	No data	No data	? TT=0.788	No data	No data	? TT=0.786	? TT=0.816	? TT=0.787	? TT=0.804
LowAutocorrelation/ LowAutocorrelation-026_c18.xml	SAT f=53 TT=2519.95 T1=1439.65	SAT (TO) f=53 TT=2519.95 T1=1439.65	? TT=0.785	No data	No data	? TT=0.793	No data	No data	? TT=0.805	? TT=0.804	? TT=0.795	? TT=0.802
LowAutocorrelation/ LowAutocorrelation-027_c18.xml	SAT f=61 TT=2519.94 T1=1158.4	SAT (TO) f=61 TT=2519.94 T1=1158.4	? TT=0.8	No data	No data	? TT=0.819	No data	No data	? TT=0.81	? TT=0.822	? TT=0.808	? TT=0.817
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
LowAutocorrelation/ LowAutocorrelation-028_c18.xml	SAT f=74 TT=2519.83 T1=1269.97	SAT (TO) f=74 TT=2519.83 T1=1269.97	? TT=0.823	No data	No data	? TT=0.837	No data	No data	? TT=0.827	? TT=0.841	? TT=0.832	? TT=0.835
LowAutocorrelation/ LowAutocorrelation-030_c18.xml	SAT f=131 TT=2519.96 T1=185.46	SAT (TO) f=131 TT=2519.96 T1=185.46	? TT=0.858	No data	No data	? TT=0.863	No data	No data	? TT=0.842	? TT=0.866	? TT=0.846	? TT=0.873
LowAutocorrelation/ LowAutocorrelation-035_c18.xml	SAT f=197 TT=2519.94 T1=1606.35	SAT (TO) f=197 TT=2519.94 T1=1606.35	? TT=0.925	No data	No data	? TT=0.931	No data	No data	? TT=0.937	? TT=0.946	? TT=0.924	? TT=0.942
LowAutocorrelation/ LowAutocorrelation-040_c18.xml	SAT f=500 TT=2519.96 T1=2.7	SAT (TO) f=500 TT=2519.96 T1=2.7	? TT=1.006	No data	No data	? TT=1.005	No data	No data	? TT=1.003	? TT=1.004	? TT=1.01	? TT=1.005
LowAutocorrelation/ LowAutocorrelation-050_c18.xml	SAT f=649 TT=2520.09 T1=275.64	SAT (TO) f=649 TT=2520.09 T1=275.64	? TT=1.238	No data	No data	? TT=1.249	No data	No data	? TT=1.279	? TT=1.285	? TT=1.259	? TT=1.271
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT TT=0.337	SAT TT=0.337	SAT TT=1.274	SAT TT=42.998	SAT TT=37.863	SAT TT=16.778	SAT TT=38.234	SAT TT=0.553	SAT TT=3.541	SAT TT=23.018	SAT TT=16.573	? (TO) TT=2520.12
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT TT=2.749	UNSAT TT=3.399	UNSAT TT=4.278	UNSAT TT=356.449	UNSAT TT=215.334	UNSAT TT=2.749	UNSAT TT=217.454	UNSAT TT=3.944	? (TO) TT=2520.06	UNSAT TT=3.108	? TT=303.005	UNSAT TT=11.875
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT TT=0.703	SAT TT=13.062	SAT TT=0.703	SAT TT=274.47	SAT TT=183.111	SAT TT=2.615	SAT TT=183.727	SAT TT=7.694	SAT TT=2.499	SAT TT=3.105	SAT TT=1.895	SAT (TO) TT=2520.02
MagicHexagon/ MagicHexagon-05-0006_c18.xml	SAT TT=3.012	SAT TT=10.174	? (TO) TT=2520.07	? (TO) TT=2520.01	? (TO) TT=2520.1	? (TO) TT=2520.04	? (TO) TT=2520.01	SAT TT=27.886	SAT TT=3.012	? (TO) TT=2520.04	? (TO) TT=2520.1	? (TO) TT=2520.05
MagicHexagon/ MagicHexagon-05-m003_c18.xml	SAT TT=2.448	? (TO) TT=2519.84	SAT TT=2.448	? (TO) TT=2520.08	? (TO) TT=2520.1	? (TO) TT=2520.11	? (TO) TT=2519.91	SAT TT=164.971	SAT TT=13.849	? (TO) TT=2520.02	? (TO) TT=2520.09	? (TO) TT=2520.1
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
MagicHexagon/ MagicHexagon-06-0010_c18.xml	SAT TT=294.829	? (TO) TT=2520.07	SAT TT=294.829	? (TO) TT=2520.1	? (TO) TT=2519.88	? (TO) TT=2520.1	? (TO) TT=2519.94	? (TO) TT=2519.63	? (TO) TT=2520.08	? (TO) TT=2520.03	? (TO) TT=2520.05	? (TO) TT=2520.11
MagicHexagon/ MagicHexagon-06-m001_c18.xml	SAT TT=810.179	SAT TT=810.179	? (TO) TT=2520.08	? (TO) TT=2520.06	? (TO) TT=2519.94	? (TO) TT=2520.04	? (TO) TT=2519.96	? (TO) TT=2519.61	? (TO) TT=2520.02	? (TO) TT=2520.06	? (TO) TT=2520.04	? (TO) TT=2520.1
MagicHexagon/ MagicHexagon-07-0002_c18.xml		? (TO) TT=2519.73	? (TO) TT=2520.03	? (TO) TT=2520.07	? (TO) TT=2520.1	? (TO) TT=2520.08	? (TO) TT=2520.02	? (TO) TT=2519.64	? (TO) TT=2520.02	? (TO) TT=2520.08	? (TO) TT=2520.09	? (TO) TT=2520.02
MagicHexagon/ MagicHexagon-07-m011_c18.xml		? (TO) TT=2519.97	? (TO) TT=2520.09	? (TO) TT=2520.06	? (TO) TT=2519.94	? (TO) TT=2520.09	? (TO) TT=2519.96	? (TO) TT=2519.71	? (TO) TT=2520.11	? (TO) TT=2520.03	? (TO) TT=2520.03	? (TO) TT=2520.03
MagicHexagon/ MagicHexagon-08-0006_c18.xml		? (TO) TT=2520.1	? (TO) TT=2520.11	? (TO) TT=2520.07	? (TO) TT=2519.81	? (TO) TT=2520.04	? (TO) TT=2520.07	? (TO) TT=2519.72	? (TO) TT=2520.03	? (TO) TT=2520.05	? (TO) TT=2520.03	? (TO) TT=2520.06
MagicHexagon/ MagicHexagon-08-m009_c18.xml		? (TO) TT=2519.97	? (TO) TT=2520.05	? (TO) TT=2520.1	? (TO) TT=2519.98	? (TO) TT=2520.07	? (TO) TT=2520	? (TO) TT=2519.72	? (TO) TT=2520.1	? (TO) TT=2520.12	? (TO) TT=2520.04	? (TO) TT=2520.12
MagicSquare/ MagicSquare-04-sum_c18.xml	SAT TT=0.004	SAT TT=0.005	SAT TT=0.551	SAT TT=0.01	SAT TT=0.007	SAT TT=0.512	SAT TT=0.006	SAT TT=0.004	SAT TT=0.558	SAT TT=0.52	SAT TT=0.529	SAT (TO) TT=2520.04
MagicSquare/ MagicSquare-05-sum_c18.xml	SAT TT=0.014	SAT TT=0.014	SAT TT=0.73	SAT TT=0.97	SAT TT=0.296	SAT TT=0.704	SAT TT=0.295	SAT TT=0.015	SAT TT=0.781	SAT TT=0.749	SAT TT=0.73	SAT (TO) TT=2520.08
MagicSquare/ MagicSquare-06-sum_c18.xml	SAT TT=0.01	SAT TT=0.168	SAT TT=10.326	? (TO) TT=2519.89	SAT TT=55.966	SAT TT=2.664	SAT TT=56.064	SAT TT=0.01	SAT TT=0.892	SAT TT=3.374	SAT TT=1.565	SAT (TO) TT=2520.06
MagicSquare/ MagicSquare-07-sum_c18.xml	SAT TT=0.021	SAT TT=0.021	SAT TT=3.473	? (TO) TT=2520.1	SAT TT=2234.36	? (TO) TT=2520.04	SAT TT=2234.84	SAT TT=0.07	SAT TT=1.493	? (TO) TT=2520.05	? (TO) TT=2520.07	? (TO) TT=2520.08
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
MagicSquare/ MagicSquare-08-sum_c18.xml	SAT TT=2.457	SAT TT=2.457	? (TO) TT=2520.11	? (TO) TT=2520.1	? (TO) TT=2520.01	? (TO) TT=2520.05	? (TO) TT=2519.96	? (TO) TT=2519.54	SAT TT=5.822	? (TO) TT=2520.05	? (TO) TT=2520.07	? (TO) TT=2520.05
MagicSquare/ MagicSquare-09-sum_c18.xml	SAT TT=1038.88	SAT TT=1038.88	? (TO) TT=2520.05	? (TO) TT=2520.08	? (TO) TT=2519.92	? (TO) TT=2520.07	? (TO) TT=2520	? (TO) TT=2519.51	? (TO) TT=2520.03	? (TO) TT=2520.03	? (TO) TT=2520.07	? (TO) TT=2520.03
MagicSquare/ MagicSquare-10-sum_c18.xml	SAT TT=29.52	? (TO) TT=2519.83	? (TO) TT=2520.12	? (TO) TT=2520.06	? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2519.93	SAT TT=29.52	? (TO) TT=2520.05	? (TO) TT=2520.03	? (TO) TT=2520.07	? (TO) TT=2520.02
MagicSquare/ MagicSquare-11-sum_c18.xml		? (TO) TT=2520.08	? (TO) TT=2520.04	? (TO) TT=2520.09	? (TO) TT=2520.1	? (TO) TT=2520.08	? (TO) TT=2520.02	? (TO) TT=2519.7	? (TO) TT=2520.09	? (TO) TT=2520.1	? (TO) TT=2520.08	? (TO) TT=2520.02
MagicSquare/ MagicSquare-12-sum_c18.xml		? (TO) TT=2520	? (TO) TT=2520.03	? (TO) TT=2520.07	? (TO) TT=2520.1	? (TO) TT=2520.07	? (TO) TT=2520.01	? (TO) TT=2519.81	? (TO) TT=2520.07	? (TO) TT=2520.04	? (TO) TT=2520.08	? (TO) TT=2520.05
MagicSquare/ MagicSquare-13-sum_c18.xml		? (TO) TT=2519.97	? (TO) TT=2520.11	? (TO) TT=2520.06	? (TO) TT=2520.02	? (TO) TT=2520.07	? (TO) TT=2519.96	? (TO) TT=2519.73	? (TO) TT=2520.01	? (TO) TT=2520.02	? (TO) TT=2520.06	? (TO) TT=2520.02
MagicSquare/ MagicSquare-14-sum_c18.xml		? (TO) TT=2519.91	? (TO) TT=2520.09	? (TO) TT=2520.04	? (TO) TT=2519.94	? (TO) TT=2520.11	? (TO) TT=2519.96	? (TO) TT=2519.96	? (TO) TT=2520.07	? (TO) TT=2520.02	? (TO) TT=2520.11	? (TO) TT=2520.07
MagicSquare/ MagicSquare-15-sum_c18.xml		? (TO) TT=2519.93	? (TO) TT=2520.11	? (TO) TT=2520.07	? (TO) TT=2519.93	? (TO) TT=2520.08	? (TO) TT=2519.94	? (TO) TT=2519.75	? (TO) TT=2520.08	? (TO) TT=2520.09	? (TO) TT=2520.08	? (TO) TT=2520.04
MagicSquare/ MagicSquare-16-sum_c18.xml		? (TO) TT=2519.93	? (TO) TT=2520.09	? (TO) TT=2519.73	? (TO) TT=2520.1	? (TO) TT=2520.08	? (TO) TT=2520.02	? (TO) TT=2519.75	? (TO) TT=2520.02	? (TO) TT=2520.03	? (TO) TT=2520.08	? (TO) TT=2520.05
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	UNSAT TT=187.07	? (TO) TT=2520.07	? (TO) TT=2520.12	? TT=2520	? TT=2520	? (TO) TT=2520.11	? (TO) TT=2519.95	UNSAT TT=187.07	? (TO) TT=2520.06	? (TO) TT=2520.13	? (TO) TT=2520.06	? (TO) TT=2520.11
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml		? (TO) TT=2520.03	? (TO) TT=2520.04	? TT=2520.01	? (TO) TT=2519.99	? (TO) TT=2520.07	? (TO) TT=2519.93	? (TO) TT=2519.54	? (TO) TT=2520.05	? (TO) TT=2520.05	? (TO) TT=2520.11	? (TO) TT=2520.02
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml		? (TO) TT=2520.1	? (TO) TT=2520.07	? (TO) TT=2519.61	? (TO) TT=2519.93	? (TO) TT=2520.06	? (TO) TT=2519.9	? (TO) TT=2519.82	? (TO) TT=2520.09	? (TO) TT=2520.09	? (TO) TT=2520.02	? (TO) TT=2520.08
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml		? (TO) TT=2519.75	? (TO) TT=2520.07	? (TO) TT=2519.94	? (TO) TT=2519.73	? (TO) TT=2520.09	? TT=2520.08	? (TO) TT=2519.62	? (TO) TT=2520.09	? (TO) TT=2520.03	? (TO) TT=2520.05	? (TO) TT=2520.07
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml		? (TO) TT=2520.07	? (TO) TT=2520.06	? (TO) TT=2519.92	? (TO) TT=2519.8	? (TO) TT=2520.08	? (TO) TT=2520.08	? (TO) TT=2519.34	? (TO) TT=2520.04	? (TO) TT=2520.07	? (TO) TT=2520.1	? (TO) TT=2520.05
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	SAT TT=0.235	SAT TT=22.487	SAT TT=1.35	? (TO) TT=2520.09	SAT TT=0.24	SAT TT=1.395	SAT TT=0.235	SAT TT=1.394	SAT TT=1.391	SAT TT=1.362	SAT TT=1.383	SAT (TO) TT=2520.14
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	SAT TT=4.191	SAT TT=1531.73	? (TO) TT=2520.08	? (TO) TT=2520.02	SAT TT=4.205	? (TO) TT=2520.03	SAT TT=4.191	SAT TT=6.825	? (TO) TT=2520.07	? (TO) TT=2520.04	? (TO) TT=2520.08	? (TO) TT=2520.07
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT TT=0.19	SAT TT=0.433	SAT TT=1.973	SAT TT=2.349	SAT TT=0.359	SAT TT=2.152	SAT TT=0.766	SAT TT=0.19	SAT TT=2.08	SAT TT=2.198	SAT TT=2.004	SAT (TO) TT=2520.06
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT TT=0.912	SAT TT=43.31	SAT TT=4.819	SAT TT=23.449	SAT TT=96.493	SAT TT=4.544	SAT TT=54.352	SAT TT=0.912	? (TO) TT=2520.06	SAT TT=4.159	SAT TT=5.279	SAT (TO) TT=2520.13
PseudoBoolean-dec/ Pb-robin12_c18.xml	SAT TT=76.943	SAT TT=1261.92	? (TO) TT=2520.07	? (TO) TT=2519.92	? (TO) TT=2520.06	? (TO) TT=2520.09	? (TO) TT=2519.95	SAT TT=76.943	? (TO) TT=2520.03	? (TO) TT=2520.11	? (TO) TT=2520.1	? (TO) TT=2520.06
PseudoBoolean-dec/ Pb-robin14_c18.xml		? (TO) TT=2519.88	? (TO) TT=2520.07	? (TO) TT=2520.06	? (TO) TT=2519.9	? (TO) TT=2520.05	? (TO) TT=2519.91	? (TO) TT=2519.54	? (TO) TT=2520.04	? (TO) TT=2520.06	? (TO) TT=2520.04	? (TO) TT=2520.07
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
PseudoBoolean-dec/ Pb-robin16_c18.xml		? (TO) TT=2520	? (TO) TT=2520.09	? (TO) TT=2520.03	? (TO) TT=2519.97	? (TO) TT=2520.09	? (TO) TT=2519.98	? (TO) TT=2520.03	? (TO) TT=2520.02	? (TO) TT=2520.05	? (TO) TT=2520.03	? (TO) TT=2520.04
PseudoBoolean-dec/ Pb-robin18_c18.xml		? (TO) TT=2519.89	? (TO) TT=2520.12	? (TO) TT=2519.93	? (TO) TT=2520.05	? (TO) TT=2520.11	? (TO) TT=2519.9	? (TO) TT=2519.82	? (TO) TT=2520.09	? (TO) TT=2520.11	? (TO) TT=2520.06	? (NS) TT=6.822
PseudoBoolean-opt/ Pb-circ10-3_c18.xml	SAT f=364 TT=2520.01 T1=926.76	SAT (TO) f=364 TT=2520.01 T1=926.76	? (TO) TT=2520.03	No data	No data	? (TO) TT=2520.1	No data	No data	? (TO) TT=2520.08	? (TO) TT=2520.07	? (TO) TT=2520.03	? (TO) TT=2520.02
PseudoBoolean-opt/ Pb-circ4-3_c18.xml	OPT f=20 TT=12.891 T1=0.07	OPT f=20 TT=12.891 T1=0.07	SAT (TO) f=26 TT=2520.06 T1=0.64	No data	No data	SAT (TO) f=20 TT=2520.09 T1=5.54	No data	No data	SAT (TO) f=20 TT=2520.02 T1=0.76	OPT f=20 TT=23.951 T1=0.77	SAT f=24 TT=303.865 T1=0.48	SAT (TO) f=20 TT=2520.11 T1=0.74
PseudoBoolean-opt/ Pb-circ6-3_c18.xml	SAT f=66 TT=2519.98 T1=788.49	SAT (TO) f=66 TT=2519.98 T1=788.49	? (TO) TT=2520.07	No data	No data	SAT (TO) f=72 TT=2520.11 T1=2431.91	No data	No data	SAT (TO) f=72 TT=2520.08 T1=727.09	? (TO) TT=2520.1	? (TO) TT=2520.05	SAT (TO) f=76 TT=2520.12 T1=2218.41
PseudoBoolean-opt/ Pb-circ8-3_c18.xml	SAT f=176 TT=2520.05 T1=1004.31	SAT (TO) f=176 TT=2520.05 T1=1004.31	? (TO) TT=2520.06	No data	No data	? (TO) TT=2520.03	No data	No data	? (TO) TT=2520.06	? (TO) TT=2520.08	? (TO) TT=2520.11	? (TO) TT=2520.1
PseudoBoolean-opt/ Pb-garden-100x100_c18.xml	SAT f=2675 TT=2519.99 T1=21.18	SAT (TO) f=2675 TT=2519.99 T1=21.18	SAT (TO) f=3362 TT=2520.08 T1=1665.19	No data	No data	SAT (TO) f=3352 TT=2520.09 T1=2110.98	No data	No data	SAT (TO) f=3383 TT=2520.11 T1=44.85	SAT (TO) f=3375 TT=2520.13 T1=1900.38	SAT f=3365 TT=306.301 T1=244.97	? (NS) TT=7.378
PseudoBoolean-opt/ Pb-garden-15x15_c18.xml	SAT f=56 TT=2520.03 T1=96.25	SAT (TO) f=66 TT=2520.08 T1=0.02	SAT (TO) f=69 TT=2520.02 T1=1131.18	No data	No data	SAT (TO) f=56 TT=2520.03 T1=96.25	No data	No data	SAT (TO) f=74 TT=2520.09 T1=0.52	SAT (TO) f=72 TT=2520.08 T1=7.33	SAT f=60 TT=304.719 T1=265.82	SAT (TO) f=65 TT=2520.09 T1=232.46
PseudoBoolean-opt/ Pb-garden-4x4_c18.xml	OPT f=4 TT=0.006 T1=0	OPT f=4 TT=0.006 T1=0	SAT (TO) f=4 TT=2520.02 T1=0.31	No data	No data	SAT (TO) f=4 TT=2520.45 T1=0.3	No data	No data	SAT (TO) f=4 TT=2520.09 T1=0.31	OPT f=4 TT=0.52 T1=0.29	SAT f=4 TT=47.631 T1=0.3	SAT (TO) f=4 TT=2520.11 T1=0.29
PseudoBoolean-opt/ Pb-garden-7x7_c18.xml	OPT f=12 TT=75.13 T1=8.41	OPT f=12 TT=285.318 T1=236.89	SAT (TO) f=13 TT=2520.08 T1=2.12	No data	No data	SAT (TO) f=12 TT=2520.07 T1=542.59	No data	No data	SAT (TO) f=16 TT=2520.12 T1=0.33	OPT f=12 TT=75.13 T1=15.86	SAT f=13 TT=303.664 T1=0.92	SAT (TO) f=12 TT=2520.11 T1=8.41
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
PseudoBoolean-opt/ Pb-garden-9x9_c18.xml	SAT f=20 TT=2520.05 T1=2434.61	SAT (TO) f=22 TT=2519.93 T1=0.01	SAT (TO) f=21 TT=2520.12 T1=34.99	No data	No data	SAT (TO) f=21 TT=2520.07 T1=0.95	No data	No data	SAT (TO) f=28 TT=2520.06 T1=0.34	SAT (TO) f=22 TT=2520.13 T1=1266.89	SAT f=21 TT=303.821 T1=2.99	SAT (TO) f=20 TT=2520.05 T1=2434.61
PseudoBoolean-opt/ Pb-radar-10-10-45-050-100_c18.xml	SAT f=4 TT=303.722 T1=20.88	SAT (TO) f=11 TT=2520.06 T1=1.54	SAT (TO) f=4 TT=2520.09 T1=2433.79	No data	No data	SAT (TO) f=4 TT=2520.06 T1=392.33	No data	No data	SAT (TO) f=23 TT=2520.11 T1=0.75	SAT (TO) f=15 TT=2520.06 T1=577.25	SAT f=4 TT=303.722 T1=20.88	SAT (TO) f=6 TT=2520.11 T1=187.68
PseudoBoolean-opt/ Pb-radar-10-20-45-050-100_c18.xml	SAT f=4 TT=2520.1 T1=333.13	SAT (TO) f=19 TT=2520.1 T1=2288.33	SAT (TO) f=21 TT=2520.09 T1=705.24	No data	No data	SAT (TO) f=4 TT=2520.1 T1=333.13	No data	No data	SAT (TO) f=36 TT=2520.08 T1=0.72	SAT (TO) f=29 TT=2520.08 T1=1743.21	SAT f=5 TT=304.902 T1=292.12	SAT (TO) f=22 TT=2520.08 T1=1047.36
PseudoBoolean-opt/ Pb-radar-30-30-45-050-100_c18.xml	SAT f=58 TT=2520.05 T1=2514.89	SAT (TO) f=124 TT=2520.04 T1=1555.99	SAT (TO) f=240 TT=2520.13 T1=1337.99	No data	No data	SAT (TO) f=58 TT=2520.05 T1=2514.89	No data	No data	SAT (TO) f=267 TT=2520.12 T1=5.24	SAT (TO) f=253 TT=2520.05 T1=1903.78	SAT f=209 TT=306.155 T1=289.52	SAT (TO) f=178 TT=2520.1 T1=280.29
PseudoBoolean-opt/ Pb-radar-30-70-45-050-100_c18.xml	SAT f=473 TT=2520.13 T1=2468.06	SAT (TO) f=491 TT=2519.68 T1=1535.74	SAT (TO) f=640 TT=2520.14 T1=705.11	No data	No data	SAT (TO) f=473 TT=2520.13 T1=2468.06	No data	No data	SAT (TO) f=666 TT=2520.07 T1=65.4	SAT (TO) f=659 TT=2520.05 T1=1667.26	SAT f=621 TT=306.525 T1=195.37	SAT (TO) f=659 TT=2520.07 T1=19.59
QuadraticAssignment/ QuadraticAssignment-esc128_c18.xml	SAT f=32 TT=2520.12 T1=52.77	SAT (TO) f=42 TT=2520.1 T1=1057.24	SAT (TO) f=32 TT=2520.12 T1=503.74	No data	No data	SAT (TO) f=32 TT=2520.12 T1=52.77	No data	No data	SAT (TO) f=77 TT=2520.11 T1=4.9	SAT (TO) f=80 TT=2520.05 T1=2.84	SAT f=50 TT=305.886 T1=282.44	SAT (TO) f=36 TT=2520.13 T1=122.92
QuadraticAssignment/ QuadraticAssignment-esc16a_c18.xml	SAT f=34 TT=302.659 T1=1.44	SAT (TO) f=34 TT=2519.8 T1=1.44	SAT (TO) f=39 TT=2520.06 T1=0.36	No data	No data	SAT (TO) f=34 TT=2520.11 T1=2.32	No data	No data	SAT (TO) f=36 TT=2520.07 T1=0.43	SAT (TO) f=34 TT=2520.07 T1=96.01	SAT f=34 TT=302.659 T1=1.9	SAT (TO) f=34 TT=2520.03 T1=10.12
QuadraticAssignment/ QuadraticAssignment-esc16d_c18.xml	OPT f=8 TT=139.294 T1=0.03	OPT f=8 TT=139.294 T1=0.03	SAT (TO) f=8 TT=2520.02 T1=0.61	No data	No data	SAT (TO) f=8 TT=2520.1 T1=0.45	No data	No data	SAT (TO) f=8 TT=2520.09 T1=0.56	SAT (TO) f=8 TT=2520.05 T1=78.66	SAT f=8 TT=302.734 T1=0.53	SAT (TO) f=8 TT=2520.03 T1=0.98
QuadraticAssignment/ QuadraticAssignment-esc32a_c18.xml	SAT f=65 TT=2520.05 T1=20.34	SAT (TO) f=93 TT=2520.03 T1=2049.59	SAT (TO) f=75 TT=2520.1 T1=5.26	No data	No data	SAT (TO) f=65 TT=2520.05 T1=20.34	No data	No data	SAT (TO) f=137 TT=2520.08 T1=38.05	SAT (TO) f=120 TT=2520.03 T1=1951.81	SAT f=68 TT=303.258 T1=222.69	SAT (TO) f=73 TT=2520.08 T1=813.22
QuadraticAssignment/ QuadraticAssignment-esc32d_c18.xml	SAT f=100 TT=303.064 T1=4.96	SAT (TO) f=110 TT=2519.81 T1=24.57	SAT (TO) f=112 TT=2520.03 T1=0.86	No data	No data	SAT (TO) f=100 TT=2520.03 T1=4.96	No data	No data	SAT (TO) f=150 TT=2520.04 T1=0.99	SAT (TO) f=125 TT=2520.11 T1=2369.93	SAT f=100 TT=303.064 T1=55.41	SAT (TO) f=115 TT=2520.06 T1=45.7
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
QuadraticAssignment/ QuadraticAssignment-esc64a_c18.xml	SAT f=58 TT=303.945 T1=0.67	SAT (TO) f=58 TT=2520.09 T1=0.67	SAT (TO) f=58 TT=2520.02 T1=0.83	No data	No data	SAT (TO) f=58 TT=2520.07 T1=1.4	No data	No data	SAT (TO) f=114 TT=2520.03 T1=0.66	SAT (TO) f=123 TT=2520.12 T1=0.62	SAT f=58 TT=303.945 T1=50.78	SAT (TO) f=58 TT=2520.09 T1=597.75
QuadraticAssignment/ QuadraticAssignment-had12_c18.xml	SAT f=826 TT=302.804 T1=6.44	SAT (TO) f=832 TT=2520.08 T1=1735.78	SAT (TO) f=896 TT=2520.04 T1=0.57	No data	No data	SAT (TO) f=828 TT=2520.06 T1=176.56	No data	No data	SAT (TO) f=884 TT=2520.09 T1=1.8	SAT (TO) f=840 TT=2520.1 T1=1017.06	SAT f=826 TT=302.804 T1=6.44	SAT (TO) f=900 TT=2520.06 T1=0.5
QuadraticAssignment/ QuadraticAssignment-had14_c18.xml	SAT f=1362 TT=2520.06 T1=1927.11	SAT (TO) f=1385 TT=2520.06 T1=207.58	SAT (TO) f=1512 TT=2520.06 T1=0.53	No data	No data	SAT (TO) f=1362 TT=2520.06 T1=1927.11	No data	No data	SAT (TO) f=1463 TT=2520.1 T1=10.39	SAT (TO) f=1438 TT=2520.08 T1=927.94	SAT f=1372 TT=302.77 T1=4.09	SAT (TO) f=1476 TT=2520.1 T1=1.61
QuadraticAssignment/ QuadraticAssignment-had16_c18.xml	SAT f=1885 TT=302.889 T1=53.06	SAT (TO) f=1934 TT=2519.92 T1=1921.44	SAT (TO) f=2026 TT=2520.04 T1=0.86	No data	No data	SAT (TO) f=1908 TT=2520.08 T1=2489.51	No data	No data	SAT (TO) f=2020 TT=2520.08 T1=12.04	SAT (TO) f=1974 TT=2520.02 T1=41.37	SAT f=1885 TT=302.889 T1=53.06	SAT (TO) f=2021 TT=2520.04 T1=2.11
QuadraticAssignment/ QuadraticAssignment-had18_c18.xml	SAT f=2712 TT=303.052 T1=44.87	SAT (TO) f=2775 TT=2519.74 T1=1888.77	SAT (TO) f=2850 TT=2520.07 T1=1.12	No data	No data	SAT (TO) f=2793 TT=2520.1 T1=2109.78	No data	No data	SAT (TO) f=2883 TT=2520.08 T1=56.88	SAT (TO) f=2839 TT=2520.11 T1=2491.76	SAT f=2712 TT=303.052 T1=44.87	SAT (TO) f=2885 TT=2520.04 T1=9.37
QuadraticAssignment/ QuadraticAssignment-had20_c18.xml	SAT f=3474 TT=303.053 T1=168.94	SAT (TO) f=3668 TT=2520.04 T1=1698.36	SAT (TO) f=3837 TT=2520.07 T1=1.5	No data	No data	SAT (TO) f=3728 TT=2520.1 T1=1695.16	No data	No data	SAT (TO) f=3736 TT=2520.05 T1=6.5	SAT (TO) f=3725 TT=2520.09 T1=115.28	SAT f=3474 TT=303.053 T1=168.94	SAT (TO) f=3733 TT=2520.11 T1=7.6
QuadraticAssignment/ QuadraticAssignment-qap_c18.xml	OPT f=4776 TT=0.378 T1=0.35	OPT f=4776 TT=0.378 T1=0.35	SAT (TO) f=5344 TT=2520.05 T1=0.46	No data	No data	SAT (TO) f=4776 TT=2520.09 T1=1.57	No data	No data	SAT (TO) f=4776 TT=2520.1 T1=0.54	OPT f=4776 TT=1.938 T1=0.79	SAT f=4776 TT=301.842 T1=1.28	SAT (TO) f=4776 TT=2520.07 T1=0.91
QuadraticAssignment/ QuadraticAssignment-sko42_c18.xml	SAT f=9512 TT=2520.07 T1=2184.49	SAT (TO) f=9512 TT=2520.07 T1=2184.49	SAT (TO) f=10091 TT=2520.06 T1=10.25	No data	No data	SAT (TO) f=9982 TT=2520.03 T1=9.05	No data	No data	SAT (TO) f=9791 TT=2520.08 T1=71.18	SAT (TO) f=9923 TT=2520.1 T1=988.54	SAT f=10108 TT=308.484 T1=1.43	SAT (TO) f=10041 TT=2520.05 T1=5.32
QuadraticAssignment/ QuadraticAssignment-sko49_c18.xml	SAT f=13783 TT=2520.06 T1=742.16	SAT (TO) f=13783 TT=2520.06 T1=742.16	SAT (TO) f=14190 TT=2520.11 T1=11.81	No data	No data	SAT (TO) f=14752 TT=2520.05 T1=18.61	No data	No data	SAT (TO) f=14104 TT=2520.09 T1=685.45	SAT (TO) f=14115 TT=2520.14 T1=1822.25	SAT f=14220 TT=307.277 T1=1.6	SAT (TO) f=14151 TT=2520.05 T1=12.09
QuadraticAssignment/ QuadraticAssignment-sko56_c18.xml	SAT f=20529 TT=2520.04 T1=2323.22	SAT (TO) f=20529 TT=2520.04 T1=2323.22	SAT (TO) f=21286 TT=2520.13 T1=27.9	No data	No data	SAT (TO) f=21439 TT=2520.04 T1=35.88	No data	No data	SAT (TO) f=20649 TT=2520.06 T1=97.22	SAT (TO) f=21001 TT=2520.14 T1=1491.88	SAT f=21131 TT=305.715 T1=2.62	SAT (TO) f=21114 TT=2520.09 T1=6.96
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
QuadraticAssignment/ QuadraticAssignment-sko64_c18.xml	SAT f=28923 TT=2520.12 T1=280.92	SAT (TO) f=28923 TT=2520.12 T1=280.92	SAT (TO) f=29809 TT=2520.12 T1=21.96	No data	No data	SAT (TO) f=29996 TT=2520.04 T1=61.97	No data	No data	SAT (TO) f=29202 TT=2520.08 T1=90.92	SAT (TO) f=29180 TT=2520.05 T1=778.76	SAT f=29753 TT=306.17 T1=3.88	SAT (TO) f=29546 TT=2520.08 T1=6.01
QuadraticAssignment/ QuadraticAssignment-sko72_c18.xml	SAT f=38953 TT=2519.88 T1=392.95	SAT (TO) f=38953 TT=2519.88 T1=392.95	SAT (TO) f=39929 TT=2520.1 T1=837.71	No data	No data	SAT (TO) f=40699 TT=2520.11 T1=115.77	No data	No data	SAT (TO) f=39813 TT=2520.04 T1=229.21	SAT (TO) f=39747 TT=2520.11 T1=2258.15	SAT f=40167 TT=307.962 T1=6.37	SAT (TO) f=39968 TT=2520.06 T1=13.84
QuadraticAssignment/ QuadraticAssignment-sko81_c18.xml	SAT f=53146 TT=2520.1 T1=278.88	SAT (TO) f=53487 TT=2520.03 T1=1018.19	SAT (TO) f=54281 TT=2520.09 T1=8.52	No data	No data	SAT (TO) f=55097 TT=2520.11 T1=210.63	No data	No data	SAT (TO) f=53146 TT=2520.1 T1=278.88	SAT (TO) f=53599 TT=2520.09 T1=806.91	SAT f=54111 TT=311.308 T1=10.5	SAT (TO) f=53834 TT=2520.1 T1=12.37
QuadraticAssignment/ QuadraticAssignment-sko90_c18.xml	SAT f=67376 TT=2520.13 T1=161.39	SAT (TO) f=67850 TT=2520.02 T1=1262.28	SAT (TO) f=67862 TT=2520.13 T1=13.18	No data	No data	SAT (TO) f=69326 TT=2520.11 T1=357.13	No data	No data	SAT (TO) f=67376 TT=2520.13 T1=161.39	SAT (TO) f=67480 TT=2520.07 T1=2455.64	SAT f=67650 TT=316.557 T1=19.35	SAT (TO) f=67621 TT=2520.08 T1=14.61
Quasigroups_mini/ QuasiGroup-v4-07_mini_c18.xml	UNSAT TT=0.721	UNSAT TT=2.161	UNSAT TT=5.424	UNSAT TT=8.64	UNSAT TT=16.486	UNSAT TT=6.387	UNSAT TT=3.746	UNSAT TT=0.784	? (TO) TT=2520.14	UNSAT TT=0.721	? TT=302.841	UNSAT TT=4.164
Quasigroups_mini/ QuasiGroup-v4-08_mini_c18.xml	UNSAT TT=0.77	UNSAT TT=480.267	? (TO) TT=2520.07	UNSAT TT=1807.25	UNSAT TT=516.879	UNSAT TT=776.537	UNSAT TT=333.62	UNSAT TT=582.11	? (TO) TT=2521.45	UNSAT TT=0.77	? TT=460.512	UNSAT TT=938.28
Quasigroups_mini/ QuasiGroup-v4-09_mini_c18.xml	SAT TT=0.168	SAT TT=0.168	SAT TT=1.897	SAT TT=1.061	SAT TT=0.745	SAT TT=5.623	SAT TT=0.173	SAT TT=0.176	SAT TT=6.98	Wrong UNSAT TT=0.898	SAT TT=2.772	SAT (TO) TT=2520.03
Quasigroups_mini/ QuasiGroup-v4-10_mini_c18.xml	UNSAT TT=0.953	? (TO) TT=2520.09	? (TO) TT=2520.13	? TT=2520.03	? (TO) TT=2520.03	? (TO) TT=2520.09	? (TO) TT=2519.91	? (TO) TT=2519.5	? (TO) TT=2520.05	UNSAT TT=0.953	? (TO) TT=2520.1	? (TO) TT=2520.04
Quasigroups_mini/ QuasiGroup-v4-12_mini_c18.xml	SAT TT=196.295	? (TO) TT=2520.08	? (TO) TT=2520.12	? (TO) TT=2520.07	? (TO) TT=2519.97	? (TO) TT=2520.1	SAT TT=782.479	SAT TT=196.295	? (TO) TT=2528.38	Wrong UNSAT TT=1.12	? (TO) TT=2520.03	? (TO) TT=2520.12
Quasigroups_mini/ QuasiGroup-v4-14_mini_c18.xml	UNSAT TT=1.258	? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2520.05	? (TO) TT=2519.79	? (TO) TT=2520.06	? (TO) TT=2520.08	? (TO) TT=2519.4	? (TO) TT=2528.37	UNSAT TT=1.258	? (TO) TT=2520.09	? (TO) TT=2520.12
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Quasigroups_mini/ QuasiGroup-v4-16_mini_c18.xml	UNSAT TT=1.486	? (TO) TT=2520.1	? (TO) TT=2524.38	? (TO) TT=2520.08	? (TO) TT=2519.99	? (TO) TT=2520.04	? (TO) TT=2520.09	? (TO) TT=2520.03	? TT=1370.94	UNSAT TT=1.486	? (TO) TT=2520.05	? (TO) TT=2520.08
Quasigroups_mini/ QuasiGroup-v4-20_mini_c18.xml	UNSAT TT=2.06	? (TO) TT=2520.07	? (NS) TT=5.698	? (TO) TT=2519.74	? (TO) TT=2519.75	? (TO) TT=2520.11	? (TO) TT=2519.91	? (TO) TT=2519.82	? (TO) TT=2528.27	UNSAT TT=2.06	? (TO) TT=2520.03	? (TO) TT=2520.08
Quasigroups_mini/ QuasiGroup-v7-07_mini_c18.xml	UNSAT TT=0.415	UNSAT TT=0.6	UNSAT TT=2.847	UNSAT TT=0.944	UNSAT TT=3	UNSAT TT=2.131	UNSAT TT=5.318	UNSAT TT=0.415	? (TO) TT=2520.07	UNSAT TT=0.655	? TT=302.529	UNSAT TT=2.457
Quasigroups_mini/ QuasiGroup-v7-08_mini_c18.xml	UNSAT TT=0.682	UNSAT TT=41.23	? (TO) TT=2520.13	UNSAT TT=42.421	UNSAT TT=767.325	UNSAT TT=14.696	UNSAT TT=786.511	UNSAT TT=30.738	? (TO) TT=2520.07	UNSAT TT=0.682	? TT=548.739	UNSAT TT=211.2
Quasigroups_mini/ QuasiGroup-v7-09_mini_c18.xml	SAT TT=0.114	SAT TT=0.29	SAT TT=1.045	SAT TT=12.261	SAT TT=1.478	SAT TT=1.235	SAT TT=5.758	SAT TT=0.114	SAT TT=2.157	Wrong UNSAT TT=0.735	SAT TT=11.795	SAT (TO) TT=2520.06
Quasigroups_mini/ QuasiGroup-v7-10_mini_c18.xml	UNSAT TT=0.783	? (TO) TT=2520.07	? (TO) TT=2520.12	? (TO) TT=2519.92	? TT=2520.01	? (TO) TT=2520.07	? (TO) TT=2519.95	? (TO) TT=2519.79	? (TO) TT=2528.1	UNSAT TT=0.783	? (TO) TT=2520.05	? (TO) TT=2520.09
Quasigroups_mini/ QuasiGroup-v7-12_mini_c18.xml	UNSAT TT=0.88	? (TO) TT=2520.07	? (TO) TT=2520.12	? TT=2520.02	? (TO) TT=2519.68	? (TO) TT=2520.05	? TT=2520.02	? (TO) TT=2519.61	? (TO) TT=2528.22	UNSAT TT=0.88	? (TO) TT=2520.06	? (TO) TT=2520.11
Quasigroups_mini/ QuasiGroup-v7-14_mini_c18.xml	UNSAT TT=0.977	? (TO) TT=2520.08	? (TO) TT=2520.06	? TT=2520.03	? (TO) TT=2520.01	? (TO) TT=2520.09	? (TO) TT=2520	? (TO) TT=2519.63	? (TO) TT=2527.95	UNSAT TT=0.977	? (TO) TT=2520.04	? (TO) TT=2520.09
Quasigroups_mini/ QuasiGroup-v7-16_mini_c18.xml	UNSAT TT=1.068	? (TO) TT=2520.07	? (TO) TT=2520.11	? (TO) TT=2519.94	? TT=2520.04	? (TO) TT=2520.1	? (TO) TT=2519.98	? (TO) TT=2519.67	? (TO) TT=2528.03	UNSAT TT=1.068	? (TO) TT=2520.07	? (TO) TT=2520.07
Quasigroups_mini/ QuasiGroup-v7-20_mini_c18.xml	UNSAT TT=1.287	? (TO) TT=2520.1	? (TO) TT=2520.06	? (TO) TT=2519.76	? (TO) TT=2519.91	? (TO) TT=2520.05	? (TO) TT=2519.78	? (TO) TT=2519.83	? (NS) TT=39.986	UNSAT TT=1.287	? (TO) TT=2520.03	? (TO) TT=2520.04
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f01_c18.xml	UNSAT TT=310.657	UNSAT TT=987.226	? (TO) TT=2520.03	? (TO) TT=2519.9	? (TO) TT=2520	? (TO) TT=2520.12	? (TO) TT=2519.99	UNSAT TT=310.657	? (TO) TT=2520.12	? (TO) TT=2520.09	? (TO) TT=2520.11	? (TO) TT=2520.07
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f02_c18.xml	UNSAT TT=89.784	UNSAT TT=374.531	? (TO) TT=2520.05	UNSAT TT=2473.79	? (TO) TT=2519.9	? (TO) TT=2520.07	? (TO) TT=2519.91	UNSAT TT=89.784	? (TO) TT=2520.08	? (TO) TT=2520.12	? (TO) TT=2520.06	? (TO) TT=2520.05
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f03_c18.xml	UNSAT TT=21.164	UNSAT TT=106.848	? (TO) TT=2520.06	UNSAT TT=908.285	UNSAT TT=910.067	? (TO) TT=2520.1	UNSAT TT=1326.26	UNSAT TT=21.164	? (TO) TT=2520.08	? (TO) TT=2520.03	? (TO) TT=2520.09	? (TO) TT=2520.1
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f04_c18.xml	UNSAT TT=4.846	UNSAT TT=29.548	? (TO) TT=2520.05	UNSAT TT=230.645	UNSAT TT=223.471	? (TO) TT=2520.09	UNSAT TT=330.11	UNSAT TT=4.846	? (TO) TT=2520.05	? (TO) TT=2520.04	? (TO) TT=2520.1	? (TO) TT=2520.09
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f05_c18.xml	UNSAT TT=1.38	UNSAT TT=6.684	? (TO) TT=2520.07	UNSAT TT=56.696	UNSAT TT=49.888	? (TO) TT=2520.11	UNSAT TT=64.384	UNSAT TT=1.38	? (TO) TT=2520.12	? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2520.11
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f06_c18.xml	UNSAT TT=0.438	UNSAT TT=1.247	? (TO) TT=2520.08	UNSAT TT=12.25	UNSAT TT=10.775	? (TO) TT=2520.09	UNSAT TT=14.423	UNSAT TT=0.438	? (TO) TT=2520.1	? (TO) TT=2520.02	? (TO) TT=2520.02	? (TO) TT=2520.05
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f07_c18.xml	UNSAT TT=0.381	UNSAT TT=0.83	? (TO) TT=2520.11	UNSAT TT=7.975	UNSAT TT=4.406	? (TO) TT=2520.09	UNSAT TT=7.651	UNSAT TT=0.381	? (TO) TT=2520.04	? (TO) TT=2520.06	? (TO) TT=2520.05	? (TO) TT=2520.09
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f08_c18.xml	UNSAT TT=0.213	UNSAT TT=0.213	? (TO) TT=2520.12	UNSAT TT=2.17	UNSAT TT=1.053	? (TO) TT=2520.1	UNSAT TT=1.495	UNSAT TT=0.305	? (TO) TT=2520.04	? (TO) TT=2520.08	? (TO) TT=2520.11	UNSAT TT=1263.96
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f09_c18.xml	UNSAT TT=0.187	UNSAT TT=0.187	? (TO) TT=2520.08	UNSAT TT=1.725	UNSAT TT=0.757	? (TO) TT=2520.05	UNSAT TT=1.015	UNSAT TT=0.275	? (TO) TT=2520.05	? (TO) TT=2520.08	? (TO) TT=2520.11	UNSAT TT=500.233
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f10_c18.xml	UNSAT TT=0.164	UNSAT TT=0.164	? (TO) TT=2520.04	UNSAT TT=0.666	UNSAT TT=0.646	? (TO) TT=2520.12	UNSAT TT=0.637	UNSAT TT=0.249	? (TO) TT=2520.11	? (TO) TT=2520.08	? (TO) TT=2520.03	UNSAT TT=12.889
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f11_c18.xml	UNSAT TT=0.166	UNSAT TT=0.166	? (TO) TT=2520.09	UNSAT TT=0.762	UNSAT TT=0.491	? (TO) TT=2520.05	UNSAT TT=0.62	UNSAT TT=0.253	? (TO) TT=2520.07	? (TO) TT=2520.09	? (TO) TT=2520.07	UNSAT TT=12.002
Rlfap_mini/ Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f12_c18.xml	UNSAT TT=0.164	UNSAT TT=0.164	? (TO) TT=2520.04	UNSAT TT=0.751	UNSAT TT=0.479	? (TO) TT=2520.1	UNSAT TT=0.612	UNSAT TT=0.243	? (TO) TT=2520.08	? (TO) TT=2520.07	? (TO) TT=2520.02	UNSAT TT=12.647
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-01-opt_c18.xml	SAT f=20 TT=2519.92 T1=5.51	SAT (TO) f=20 TT=2519.92 T1=5.51	? (NS) TT=3.181	No data	No data	? (NS) TT=2.548	No data	No data	? (NS) TT=2.915	? (NS) TT=2.711	? (NS) TT=2.894	? (NS) TT=2.923
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-02-opt_c18.xml	SAT f=14 TT=2519.73 T1=0.82	SAT (TO) f=14 TT=2519.73 T1=0.82	? (NS) TT=3.928	No data	No data	? (NS) TT=3.676	No data	No data	? (NS) TT=3.94	? (NS) TT=3.227	? (NS) TT=3.148	? (NS) TT=3.586
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-03-opt_c18.xml	OPT f=380 TT=0.353 T1=0.35	OPT f=380 TT=0.353 T1=0.35	SAT (TO) f=380 TT=2520.12 T1=2.76	No data	No data	SAT (TO) f=764 TT=2520.05 T1=562.94	No data	No data	SAT (TO) f=380 TT=2520.12 T1=2.04	OPT f=380 TT=6.097 T1=2.18	SAT f=380 TT=306.221 T1=2.21	SAT (TO) f=380 TT=2520.08 T1=2.06
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-04-opt_c18.xml	OPT f=394 TT=0.66 T1=0.66	OPT f=394 TT=0.66 T1=0.66	SAT (TO) f=394 TT=2520.1 T1=5.23	No data	No data	SAT (TO) f=792 TT=2520.07 T1=125.88	No data	No data	SAT (TO) f=394 TT=2520.04 T1=8.05	OPT f=394 TT=12.152 T1=7.78	SAT f=736 TT=308.709 T1=172.63	SAT (TO) f=394 TT=2520.1 T1=4.78
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-05-opt_c18.xml	OPT f=221 TT=40.826 T1=11.41	? (exit code) TT=4.79	SAT (TO) f=221 TT=2520.09 T1=14.11	No data	No data	SAT (TO) f=221 TT=2520.04 T1=11.41	No data	No data	SAT (TO) f=221 TT=2520.6 T1=41.54	OPT f=221 TT=40.826 T1=13.73	SAT f=221 TT=317.007 T1=14.99	SAT (TO) f=221 TT=2520.05 T1=13.18
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-06-opt_c18.xml		? (exit code) TT=11.29	? (TO) TT=2520.08	No data	No data	? (TO) TT=2520.09	No data	No data	? (TO) TT=2520.06	? (TO) TT=2520.1	? (TO) TT=2520.07	? (TO) TT=2520.06
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-07-opt_c18.xml	SAT f=4324 TT=2520.09 T1=173.03	SAT (TO) f=10185 TT=2519.67 T1=53.1	SAT (TO) f=6941 TT=2520.15 T1=34.79	No data	No data	SAT (TO) f=4324 TT=2520.09 T1=173.03	No data	No data	SAT (TO) f=7537 TT=2520.11 T1=40.27	SAT (TO) f=18289 TT=2520.14 T1=1105.36	SAT f=4336 TT=330.447 T1=232.6	SAT (TO) f=5364 TT=2520.13 T1=2309.88
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-08-opt_c18.xml	SAT f=20 TT=2520.09 T1=31.33	SAT (TO) f=20 TT=2520.09 T1=31.33	? (NS) TT=5.981	No data	No data	? (NS) TT=5.731	No data	No data	? (NS) TT=12.803	? (NS) TT=4.567	? (NS) TT=4.444	? (NS) TT=4.979
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-09-opt_c18.xml	SAT f=18 TT=2520.04 T1=28.43	SAT (TO) f=18 TT=2520.04 T1=28.43	? (NS) TT=7.297	No data	No data	? (NS) TT=5.298	No data	No data	? (NS) TT=27.927	? (NS) TT=9.756	? (NS) TT=9.336	? (NS) TT=9.77
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-10-opt_c18.xml	OPT f=394 TT=0.832 T1=0.83	OPT f=394 TT=0.832 T1=0.83	SAT (TO) f=394 TT=2520.08 T1=8.83	No data	No data	SAT (TO) f=792 TT=2520.14 T1=4.36	No data	No data	SAT (TO) f=394 TT=2520.07 T1=209.48	SAT (TO) f=792 TT=2520.03 T1=7.6	SAT f=778 TT=312.139 T1=12.04	SAT (TO) f=778 TT=2520.09 T1=8.46
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-11-opt_c18.xml		? (exit code) TT=26.316	? (TO) TT=2520.03	No data	No data	? (TO) TT=2520.1	No data	No data	? (TO) TT=2520.17	? (TO) TT=2520.13	? (TO) TT=2520.04	? (TO) TT=2520.07
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-12-opt_c18.xml	SAT f=34807 TT=2520.14 T1=2168.97	? (exit code) TT=9.936	? (TO) TT=2520.07	No data	No data	? (TO) TT=2520.06	No data	No data	? (TO) TT=2520.08	? (TO) TT=2520.12	? (TO) TT=2520.09	SAT (TO) f=34807 TT=2520.14 T1=2168.97
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-13-opt_c18.xml		? (exit code) TT=46.537	? (TO) TT=2520.27	No data	No data	? (TO) TT=2520.11	No data	No data	? (TO) TT=2520.08	? (TO) TT=2520.05	? (TO) TT=2520.04	? (TO) TT=2520.09
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-graph-14-opt_c18.xml	SAT f=14 TT=2520.08 T1=2.27	SAT (TO) f=14 TT=2520.08 T1=2.27	? (NS) TT=6.462	No data	No data	? (NS) TT=5.304	No data	No data	? (NS) TT=14.04	? (NS) TT=4.52	? (NS) TT=4.429	? (NS) TT=9.631
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-01-opt_c18.xml	SAT f=16 TT=2520.07 T1=1.89	SAT (TO) f=16 TT=2520.07 T1=1.89	? (NS) TT=7.951	No data	No data	? (NS) TT=5.63	No data	No data	? (NS) TT=28.727	? (NS) TT=11.007	? (NS) TT=10.528	? (NS) TT=10.268
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-02-opt_c18.xml	SAT f=14 TT=2520.09 T1=0.12	SAT (TO) f=14 TT=2520.09 T1=0.12	? (NS) TT=3.509	No data	No data	? (NS) TT=2.625	No data	No data	? (NS) TT=5.259	? (NS) TT=2.822	? (NS) TT=2.901	? (NS) TT=2.945
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-03-opt_c18.xml	SAT f=14 TT=2520.07 T1=4.82	SAT (TO) f=14 TT=2520.07 T1=4.82	? (NS) TT=4.893	No data	No data	? (NS) TT=3.55	No data	No data	? (NS) TT=8.352	? (NS) TT=4.146	? (NS) TT=4.382	? (NS) TT=4.082
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-04-opt_c18.xml	OPT f=46 TT=0.616 T1=0.61	OPT f=46 TT=0.616 T1=0.61	? (NS) TT=14.48	No data	No data	? (NS) TT=10.896	No data	No data	? (NS) TT=13.744	? (NS) TT=11.526	? (NS) TT=11.283	? (NS) TT=11.825
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-05-opt_c18.xml	OPT f=792 TT=0.486 T1=0.48	OPT f=792 TT=0.486 T1=0.48	SAT (TO) f=792 TT=2520.11 T1=4.82	No data	No data	SAT (TO) f=792 TT=2520.07 T1=3.27	No data	No data	SAT (TO) f=792 TT=2520.04 T1=4.09	OPT f=792 TT=8.116 T1=3.78	SAT f=792 TT=309.996 T1=3.78	SAT (TO) f=792 TT=2520.11 T1=4.02
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-06-opt_c18.xml		? (exit code) TT=9.847	? (TO) TT=2520.03	No data	No data	? (TO) TT=2520.09	No data	No data	? (TO) TT=2520.08	? (TO) TT=2520.12	? (TO) TT=2520.04	? (TO) TT=2520.07
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-07-opt_c18.xml		? (exit code) TT=14.523	? TT=41.936	No data	No data	? TT=68.889	No data	No data	? TT=214.75	? TT=95.56	? TT=116.849	? TT=288.395
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-08-opt_c18.xml		? (exit code) TT=31.389	? (TO) TT=2520.1	No data	No data	? (TO) TT=2520.05	No data	No data	? (TO) TT=2520.15	? (TO) TT=2520.09	? (TO) TT=2520.04	? (NS) TT=1018.53
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-09-opt_c18.xml	SAT f=24191 TT=2520.1 T1=1005.78	? (exit code) TT=21.828	? (TO) TT=2520.03	No data	No data	SAT (TO) f=24191 TT=2520.1 T1=1005.78	No data	No data	SAT (TO) f=33935 TT=2520.1 T1=67.91	? (TO) TT=2520.13	? (TO) TT=2520.16	SAT (TO) f=29377 TT=2520.13 T1=1158.43
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-10-opt_c18.xml	SAT f=647980 TT=2520.14 T1=2370.07	? (exit code) TT=36.844	? (TO) TT=2520.13	No data	No data	SAT (TO) f=647980 TT=2520.14 T1=2370.07	No data	No data	SAT (TO) f=2513863 TT=2520.16 T1=75.76	? (TO) TT=2520.1	? (TO) TT=2520.15	SAT (TO) f=1851143 TT=2520.08 T1=2156.16
Rlfap_mini/Rlfap-opt_mini/ Rlfap-ext-scen-11-opt_c18.xml	SAT f=22 TT=2520.05 T1=4.45	SAT (TO) f=22 TT=2520.05 T1=4.45	? (NS) TT=5.976	No data	No data	? (NS) TT=3.858	No data	No data	? (NS) TT=15.786	? (NS) TT=4.69	? (NS) TT=4.783	? (NS) TT=4.949
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-2_0_c18.xml	SAT f=282 TT=2519.88 T1=76.28	SAT (TO) f=282 TT=2519.88 T1=76.28	? (TO) TT=2520.1	No data	No data	? (TO) TT=2520.11	No data	No data	? (TO) TT=2520.03	? (TO) TT=2520.03	? (TO) TT=2520.15	? (NS) TT=14.979
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-2_1_c18.xml	SAT f=452 TT=2519.52 T1=27.19	SAT (TO) f=452 TT=2519.52 T1=27.19	? (TO) TT=2520.12	No data	No data	? (TO) TT=2520.06	No data	No data	? (TO) TT=2520.08	? (TO) TT=2520.08	? (TO) TT=2520.11	? (NS) TT=15
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-2_2_c18.xml	SAT f=264 TT=2519.79 T1=102.22	SAT (TO) f=264 TT=2519.79 T1=102.22	? (TO) TT=2520.09	No data	No data	? (TO) TT=2520.07	No data	No data	? (TO) TT=2520.05	? (TO) TT=2520.04	? (TO) TT=2520.12	? (NS) TT=14.88
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-3_0_c18.xml	SAT f=252 TT=2519.48 T1=84.9	SAT (TO) f=252 TT=2519.48 T1=84.9	? (TO) TT=2520.15	No data	No data	? (TO) TT=2520.06	No data	No data	? (TO) TT=2520.06	? (TO) TT=2520.09	? (TO) TT=2520.1	? (NS) TT=14.446
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-3_2_c18.xml	SAT f=410 TT=2520.11 T1=46	SAT (TO) f=410 TT=2520.11 T1=46	? (TO) TT=2520.11	No data	No data	? (TO) TT=2520.07	No data	No data	? (TO) TT=2520.09	? (TO) TT=2520.08	? (TO) TT=2520.09	? (NS) TT=14.837
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-4_0_c18.xml	SAT f=168 TT=2519.67 T1=70.23	SAT (TO) f=168 TT=2519.67 T1=70.23	? (TO) TT=2520.11	No data	No data	? (TO) TT=2520.11	No data	No data	? (TO) TT=2520.1	? (TO) TT=2520.03	? (TO) TT=2520.03	? (NS) TT=14.631
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-5_0_c18.xml	SAT f=190 TT=2519.64 T1=35.62	SAT (TO) f=190 TT=2519.64 T1=35.62	? (TO) TT=2520.04	No data	No data	? (TO) TT=2520.04	No data	No data	? (TO) TT=2520.08	? (TO) TT=2520.04	? (TO) TT=2520.04	? (NS) TT=14.81
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-6_0_c18.xml	SAT f=125 TT=2519.74 T1=96.73	SAT (TO) f=125 TT=2519.74 T1=96.73	? (TO) TT=2520.12	No data	No data	? (TO) TT=2520.09	No data	No data	? (TO) TT=2520.06	? (TO) TT=2520.03	? (TO) TT=2520.17	? (NS) TT=14.681
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-7_0_c18.xml	SAT f=143 TT=2520.11 T1=127.68	SAT (TO) f=143 TT=2520.11 T1=127.68	? (TO) TT=2520.09	No data	No data	? (TO) TT=2520.12	No data	No data	? (TO) TT=2520.1	? (TO) TT=2520.1	? (TO) TT=2520.07	? (NS) TT=14.275
SteelMillSlab_Mini/ SteelMillSlab-m2s-mini-simple_c18.xml	OPT f=0 TT=0.016 T1=0.01	OPT f=0 TT=0.016 T1=0.01	SAT (TO) f=0 TT=2520.09 T1=0.43	No data	No data	SAT (TO) f=0 TT=2520.09 T1=1.01	No data	No data	SAT (TO) f=0 TT=2520.08 T1=0.42	OPT f=0 TT=0.851 T1=0.41	SAT f=0 TT=304.916 T1=0.42	SAT (TO) f=0 TT=2520.09 T1=0.41
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT TT=1.307	SAT TT=16.382	SAT TT=17.276	SAT TT=1.307	SAT TT=3.696	SAT TT=6.064	SAT TT=3.763	SAT TT=28.942	SAT TT=8.414	SAT TT=47.241	SAT TT=63.114	SAT (TO) TT=2520.11
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	UNSAT TT=90.347	? (TO) TT=2519.86	? (TO) TT=2520.12	? TT=2520.02	UNSAT TT=92.459	? (TO) TT=2520.04	UNSAT TT=90.347	? (TO) TT=2519.8	? (TO) TT=2520.07	? (TO) TT=2520.12	? (TO) TT=2520.05	? (TO) TT=2520.06
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	SAT TT=203.898	? (TO) TT=2519.93	? (TO) TT=2520.05	? TT=2520.01	? (TO) TT=2519.91	? (TO) TT=2520.03	? (TO) TT=2519.93	SAT TT=412.542	SAT TT=203.898	? (TO) TT=2520.06	? (TO) TT=2520.03	? (TO) TT=2520.07
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT TT=192.732	UNSAT TT=192.732	UNSAT TT=768.339	UNSAT TT=292.707	UNSAT TT=426.292	? (TO) TT=2520.07	UNSAT TT=416.269	UNSAT TT=507.993	? (TO) TT=2520.11	? (TO) TT=2520.06	? (TO) TT=2520.06	? (TO) TT=2520.1
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT TT=444.933	UNSAT TT=444.933	UNSAT TT=1884.5	UNSAT TT=1228.13	UNSAT TT=1308.78	? (TO) TT=2520.02	UNSAT TT=1295.26	UNSAT TT=1992.94	? (TO) TT=2520.07	? (TO) TT=2520.09	? (TO) TT=2520.07	? (TO) TT=2520.05
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	SAT TT=1784.38	? (TO) TT=2519.86	? (TO) TT=2520.05	SAT TT=2422.5	? (TO) TT=2519.72	SAT TT=1784.38	? TT=2520.04	? (TO) TT=2519.56	? (TO) TT=2520.06	? (TO) TT=2520.08	? (TO) TT=2520.11	? (TO) TT=2520.03
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT TT=45.885	? (TO) TT=2519.77	? (TO) TT=2520.01	UNSAT TT=45.885	UNSAT TT=126.159	? (TO) TT=2520.11	UNSAT TT=129.415	? (TO) TT=2519.81	? (TO) TT=2520.07	? (TO) TT=2520.07	? (TO) TT=2520.09	? (TO) TT=2520.07
Subisomorphism/ Subisomorphism-g19-g43_c18.xml		? (TO) TT=2519.83	? (TO) TT=2520.11	? TT=2520.07	? (TO) TT=2520.07	? (TO) TT=2520.04	? (TO) TT=2520.01	? (TO) TT=2519.55	? (TO) TT=2520.11	? (TO) TT=2520.08	? (TO) TT=2520.11	? (TO) TT=2520.07
Subisomorphism/ Subisomorphism-g19-g45_c18.xml		? (TO) TT=2519.98	? (TO) TT=2520.07	? (TO) TT=2520.04	? TT=2520.06	? (TO) TT=2520.06	? (TO) TT=2519.77	? (TO) TT=2519.63	? (TO) TT=2520.12	? (TO) TT=2520.1	? (TO) TT=2520.08	? (TO) TT=2520.09
Subisomorphism/ Subisomorphism-g29-g50_c18.xml		? (TO) TT=2519.94	? (TO) TT=2520.04	? (TO) TT=2519.95	? (TO) TT=2519.76	? (TO) TT=2520.1	? (TO) TT=2519.86	? (TO) TT=2519.63	? (TO) TT=2520.11	? (TO) TT=2520.05	? (TO) TT=2520.06	? (TO) TT=2520.03
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT TT=0.571	UNSAT TT=0.571	UNSAT TT=9.389	UNSAT TT=3.501	UNSAT TT=4.422	UNSAT TT=6.659	UNSAT TT=4.535	UNSAT TT=0.852	? (TO) TT=2520.07	UNSAT TT=89.39	? TT=316.615	UNSAT TT=23.398
SumColoring/ SumColoring-1-fullins-3_c18.xml	OPT f=24 TT=0.514 T1=0.05	OPT f=24 TT=0.514 T1=0.05	SAT (TO) f=28 TT=2520.07 T1=0.62	No data	No data	SAT (TO) f=24 TT=2520.11 T1=16.76	No data	No data	SAT (TO) f=24 TT=2520.06 T1=5.59	OPT f=24 TT=107.442 T1=15.76	SAT f=28 TT=302.935 T1=0.67	SAT (TO) f=24 TT=2520.04 T1=2.16
SumColoring/ SumColoring-1-fullins-4_c18.xml	SAT f=83 TT=303.884 T1=13.22	SAT (TO) f=84 TT=2519.74 T1=23.25	SAT (TO) f=117 TT=2520.04 T1=1008.08	No data	No data	SAT (TO) f=83 TT=2520.07 T1=308.29	No data	No data	SAT (TO) f=105 TT=2520.06 T1=84.79	SAT (TO) f=111 TT=2520.04 T1=496.39	SAT f=83 TT=303.884 T1=13.22	SAT (TO) f=87 TT=2520.07 T1=655.44
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
SumColoring/ SumColoring-1-fullins-5_c18.xml	SAT f=262 TT=2520.12 T1=811.5	SAT (TO) f=290 TT=2520.08 T1=12.02	SAT (TO) f=375 TT=2520.06 T1=0.94	No data	No data	SAT (TO) f=262 TT=2520.12 T1=811.5	No data	No data	SAT (TO) f=367 TT=2520.09 T1=77.83	SAT (TO) f=375 TT=2520.07 T1=0.93	SAT f=283 TT=309.492 T1=145.5	SAT (TO) f=313 TT=2520.1 T1=979.31
SumColoring/ SumColoring-dsjc-125-1_c18.xml	SAT f=228 TT=305.957 T1=256.59	SAT (TO) f=241 TT=2520.08 T1=4.44	SAT (TO) f=271 TT=2520.04 T1=451.26	No data	No data	SAT (TO) f=233 TT=2520.11 T1=36.98	No data	No data	SAT (TO) f=274 TT=2520.06 T1=9.96	SAT (TO) f=270 TT=2520.02 T1=89.69	SAT f=228 TT=305.957 T1=256.59	SAT (TO) f=253 TT=2520.05 T1=2209.6
SumColoring/ SumColoring-dsjc-125-5_c18.xml	SAT f=1010 TT=2520.1 T1=1343.79	SAT (TO) f=1123 TT=2520.07 T1=87.06	SAT (TO) f=1256 TT=2520.09 T1=276.07	No data	No data	SAT (TO) f=1010 TT=2520.1 T1=1343.79	No data	No data	SAT (TO) f=1289 TT=2520.06 T1=1.16	SAT (TO) f=1289 TT=2520.1 T1=1.28	SAT f=1111 TT=309.153 T1=272.75	SAT (TO) f=1125 TT=2520.06 T1=1398.97
SumColoring/ SumColoring-dsjc-125-9_c18.xml	SAT f=2532 TT=2520.09 T1=2335.8	SAT (TO) f=2797 TT=2519.73 T1=40.93	SAT (TO) f=3135 TT=2520.06 T1=6.41	No data	No data	SAT (TO) f=2532 TT=2520.09 T1=2335.8	No data	No data	SAT (TO) f=3115 TT=2520.1 T1=25.9	SAT (TO) f=3115 TT=2520.04 T1=1.63	SAT f=2804 TT=308.042 T1=226.47	SAT (TO) f=2823 TT=2520.08 T1=1705.89
SumColoring/ SumColoring-dsjc-250-1_c18.xml	SAT f=818 TT=2520.11 T1=2248.8	SAT (TO) f=928 TT=2519.93 T1=74.68	SAT (TO) f=1025 TT=2520.09 T1=6.06	No data	No data	SAT (TO) f=818 TT=2520.11 T1=2248.8	No data	No data	SAT (TO) f=1031 TT=2520.08 T1=1.95	SAT (TO) f=1025 TT=2520.05 T1=5.48	SAT f=895 TT=310.774 T1=263.77	SAT (TO) f=958 TT=2520.03 T1=1269.99
SumColoring/ SumColoring-dsjc-250-5_c18.xml	SAT f=3694 TT=2520.12 T1=2500.2	SAT (TO) f=3949 TT=2520.05 T1=2.56	SAT (TO) f=4362 TT=2520.08 T1=66.49	No data	No data	SAT (TO) f=3694 TT=2520.12 T1=2500.2	No data	No data	SAT (TO) f=4370 TT=2520.03 T1=3.54	SAT (TO) f=4362 TT=2520.12 T1=58.7	SAT f=4370 TT=308.144 T1=2.55	SAT (TO) f=4116 TT=2520.07 T1=1197.9
SumColoring/ SumColoring-dsjc-250-9_c18.xml	SAT f=9608 TT=2520.07 T1=2486.62	SAT (TO) f=10090 TT=2520.04 T1=126.37	SAT (TO) f=10673 TT=2520.11 T1=1376.82	No data	No data	SAT (TO) f=9608 TT=2520.07 T1=2486.62	No data	No data	SAT (TO) f=10623 TT=2520.06 T1=9.34	SAT (TO) f=10673 TT=2520.06 T1=1125.65	SAT f=10636 TT=314.642 T1=267.04	SAT (TO) f=10297 TT=2520.12 T1=1133.17
SumColoring/ SumColoring-myciel3_c18.xml	OPT f=10 TT=0.008 T1=0	OPT f=10 TT=0.008 T1=0	SAT (TO) f=10 TT=2520.04 T1=0.35	No data	No data	SAT (TO) f=10 TT=2520.06 T1=0.57	No data	No data	SAT (TO) f=10 TT=2520.06 T1=0.35	OPT f=10 TT=0.687 T1=0.33	SAT f=10 TT=2.177 T1=0.34	SAT (TO) f=10 TT=2520.05 T1=0.33
SumColoring/ SumColoring-myciel4_c18.xml	OPT f=22 TT=0.236 T1=0.07	OPT f=22 TT=0.236 T1=0.07	SAT (TO) f=22 TT=2520.11 T1=0.41	No data	No data	SAT (TO) f=22 TT=2520.05 T1=1.43	No data	No data	SAT (TO) f=22 TT=2520.03 T1=0.71	OPT f=22 TT=20.81 T1=11.47	SAT f=22 TT=302.738 T1=0.68	SAT (TO) f=22 TT=2520.09 T1=1.5
SumColoring/ SumColoring-myciel5_c18.xml	OPT f=46 TT=1545.7 T1=227.41	OPT f=46 TT=1545.7 T1=227.41	SAT (TO) f=47 TT=2520.03 T1=22.95	No data	No data	SAT (TO) f=47 TT=2520.1 T1=9.96	No data	No data	SAT (TO) f=50 TT=2520.11 T1=960.31	SAT (TO) f=57 TT=2520.01 T1=37.22	SAT f=47 TT=303.387 T1=28.85	SAT (TO) f=46 TT=2520.08 T1=1048.02
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
SumColoring/ SumColoring-myciel6_c18.xml	SAT f=98 TT=2520.09 T1=6.79	SAT (TO) f=118 TT=2520.07 T1=364.95	SAT (TO) f=108 TT=2520.03 T1=31.65	No data	No data	SAT (TO) f=98 TT=2520.09 T1=6.79	No data	No data	SAT (TO) f=136 TT=2520.05 T1=0.55	SAT (TO) f=136 TT=2520.12 T1=0.55	SAT f=108 TT=305.041 T1=2.66	SAT (TO) f=108 TT=2520.08 T1=1371.12
SumColoring/ SumColoring-myciel7_c18.xml	SAT f=208 TT=2520.07 T1=14.49	SAT (TO) f=251 TT=2520.06 T1=0.37	SAT (TO) f=226 TT=2520.07 T1=964.57	No data	No data	SAT (TO) f=208 TT=2520.07 T1=14.49	No data	No data	SAT (TO) f=255 TT=2520.12 T1=0.85	SAT (TO) f=255 TT=2520.03 T1=0.83	SAT f=224 TT=309.534 T1=4.36	SAT (TO) f=220 TT=2520.08 T1=2203.39
TravellingSalesman/ TravellingSalesman-10-20-00_c18.xml	OPT f=47 TT=1.931 T1=0.05	OPT f=47 TT=1.931 T1=0.05	SAT (TO) f=48 TT=2520.1 T1=0.34	No data	No data	SAT (TO) f=47 TT=2520.06 T1=0.7	No data	No data	SAT (TO) f=47 TT=2520.05 T1=0.36	OPT f=47 TT=2.009 T1=0.37	SAT f=47 TT=302.636 T1=0.38	SAT (TO) f=47 TT=2520.1 T1=0.36
TravellingSalesman/ TravellingSalesman-100-50-00_c18.xml	SAT f=451 TT=2520 T1=37.2	SAT (TO) f=451 TT=2520 T1=37.2	SAT (TO) f=1342 TT=2520.07 T1=2251.73	No data	No data	SAT (TO) f=464 TT=2520.14 T1=1933.83	No data	No data	SAT (TO) f=1319 TT=2520.05 T1=840.43	SAT (TO) f=1377 TT=2520.07 T1=1547.52	SAT f=1125 TT=306.673 T1=197.47	SAT (TO) f=499 TT=2520.13 T1=1455.96
TravellingSalesman/ TravellingSalesman-15-30-00_c18.xml	OPT f=93 TT=580.839 T1=0.36	SAT (TO) f=93 TT=2520.08 T1=6.05	SAT (TO) f=101 TT=2520.07 T1=0.47	No data	No data	SAT (TO) f=93 TT=2520.11 T1=0.36	No data	No data	SAT (TO) f=93 TT=2520.07 T1=5.6	OPT f=93 TT=580.839 T1=7.92	SAT f=93 TT=302.848 T1=0.61	SAT (TO) f=93 TT=2520.02 T1=6.53
TravellingSalesman/ TravellingSalesman-150-50-00_c18.xml	SAT f=537 TT=2519.96 T1=74.37	SAT (TO) f=537 TT=2519.96 T1=74.37	SAT (TO) f=2226 TT=2520.12 T1=2.85	No data	No data	SAT (TO) f=600 TT=2520.09 T1=935.23	No data	No data	SAT (TO) f=2044 TT=2520.1 T1=2125.09	SAT (TO) f=2092 TT=2520.06 T1=2376.48	SAT f=1923 TT=304.838 T1=293.02	SAT (TO) f=764 TT=2520.06 T1=2429.02
TravellingSalesman/ TravellingSalesman-20-30-00_c18.xml	SAT f=104 TT=302.882 T1=0.53	SAT (TO) f=104 TT=2519.68 T1=1773.23	SAT (TO) f=104 TT=2520.03 T1=0.53	No data	No data	SAT (TO) f=104 TT=2520.1 T1=6.01	No data	No data	SAT (TO) f=114 TT=2520.04 T1=87.88	SAT (TO) f=104 TT=2520.03 T1=2180.05	SAT f=104 TT=302.882 T1=1.86	SAT (TO) f=104 TT=2520.08 T1=174.27
TravellingSalesman/ TravellingSalesman-25-30-00_c18.xml	SAT f=113 TT=303.201 T1=2.7	SAT (TO) f=118 TT=2519.89 T1=52.61	SAT (TO) f=124 TT=2520.04 T1=3.7	No data	No data	SAT (TO) f=115 TT=2520.08 T1=19.6	No data	No data	SAT (TO) f=138 TT=2520.07 T1=68.99	SAT (TO) f=133 TT=2520.08 T1=228.52	SAT f=113 TT=303.201 T1=2.7	SAT (TO) f=115 TT=2520.12 T1=13.12
TravellingSalesman/ TravellingSalesman-30-30-00_c18.xml	SAT f=126 TT=302.917 T1=18.74	SAT (TO) f=132 TT=2519.94 T1=6.73	SAT (TO) f=142 TT=2520.1 T1=11.56	No data	No data	SAT (TO) f=126 TT=2520.09 T1=2333.02	No data	No data	SAT (TO) f=171 TT=2520.06 T1=124.58	SAT (TO) f=175 TT=2520.02 T1=1467.55	SAT f=126 TT=302.917 T1=18.74	SAT (TO) f=126 TT=2520.11 T1=177.13
TravellingSalesman/ TravellingSalesman-35-30-00_c18.xml	SAT f=148 TT=2520.12 T1=86.14	SAT (TO) f=162 TT=2519.86 T1=202.47	SAT (TO) f=163 TT=2520.07 T1=20.02	No data	No data	SAT (TO) f=153 TT=2520.05 T1=2220.3	No data	No data	SAT (TO) f=218 TT=2520.1 T1=93.91	SAT (TO) f=230 TT=2520.09 T1=2457.67	SAT f=172 TT=303.644 T1=20.51	SAT (TO) f=148 TT=2520.12 T1=86.14
Bench name	Best results	cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
TravellingSalesman/ TravellingSalesman-40-30-00_c18.xml	SAT f=163 TT=303.843 T1=107.42	SAT (TO) f=188 TT=2519.78 T1=1.08	SAT (TO) f=221 TT=2520.1 T1=383.1	No data	No data	SAT (TO) f=171 TT=2520.11 T1=2368.06	No data	No data	SAT (TO) f=257 TT=2520.05 T1=741.29	SAT (TO) f=261 TT=2520.06 T1=938.47	SAT f=163 TT=303.843 T1=107.42	SAT (TO) f=167 TT=2520.1 T1=37.81
TravellingSalesman/ TravellingSalesman-45-30-00_c18.xml	SAT f=171 TT=2520.06 T1=1905.29	SAT (TO) f=192 TT=2520.11 T1=760.85	SAT (TO) f=220 TT=2520.03 T1=592.13	No data	No data	SAT (TO) f=181 TT=2520.03 T1=99.18	No data	No data	SAT (TO) f=263 TT=2520.03 T1=179.47	SAT (TO) f=270 TT=2520.07 T1=2296.41	SAT f=178 TT=304.061 T1=278.99	SAT (TO) f=171 TT=2520.06 T1=1905.29
TravellingSalesman/ TravellingSalesman-50-30-00_c18.xml	SAT f=182 TT=2520.11 T1=923.61	SAT (TO) f=190 TT=2520.09 T1=63.11	SAT (TO) f=238 TT=2520.13 T1=877.85	No data	No data	SAT (TO) f=190 TT=2520.1 T1=125.87	No data	No data	SAT (TO) f=359 TT=2520.07 T1=746.42	SAT (TO) f=362 TT=2520.07 T1=858.26	SAT f=237 TT=303.962 T1=274.77	SAT (TO) f=182 TT=2520.11 T1=923.61
TravellingSalesman/ TravellingSalesman-75-50-00_c18.xml	SAT f=357 TT=2520.02 T1=0.59	SAT (TO) f=357 TT=2520.02 T1=0.59	SAT (TO) f=949 TT=2520.07 T1=2497.78	No data	No data	SAT (TO) f=357 TT=2520.04 T1=2125.05	No data	No data	SAT (TO) f=1027 TT=2520.04 T1=1821.56	SAT (TO) f=1100 TT=2520.11 T1=1082.85	SAT f=724 TT=306.015 T1=271.73	SAT (TO) f=428 TT=2520.07 T1=1811.48

Statistics		cosoco 1.12 (complete)	GG's minicp 2018-04-29 (complete)	miniBTD 2018.07.27_3 (complete)	miniBTD_12 2018.07.27_12 (complete)	MiniCPFever 2018-04-29 (complete)	minimacht 2018.07.27 (complete)	NACRE 1.0.4 (complete)	slowpoke 2018-04-29 (incomplete)	Solver of Xavier Schul & Yvhan Smal 2018-04-28 (incomplete)	SuperSolver_Macq_Stevenart 2018-04-27 (incomplete)	The dodo solver 2018-04-29 (complete)
Number of times the solver is able to give the best known answer		194	78	77	79	104	69	86	50	98	54	76
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		132	8	20	5	33	11	33	7	21	23	5