PB'11 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade, subsubcategory Number Factorization

This page displays the results of the different solvers for each benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade, subsubcategory Number Factorization

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
MinisatID 2.4.8-gmp [DEPRECATED] (complete)
MinisatID 2.5.2-gmp (fixed) (complete)
Sat4j CuttingPlanes 2.3.0 (complete)
Sat4j Res//CP 2.3.0 (complete)
Sat4j Resolution 2.3.0 (complete)

Bench name	Best results on this instance	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114-max.opb		? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.3	? (TO) TT=1800.13
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114.opb	OPT f=1 TT=1.3 T1=0.59	? (TO) TT=1800.13	OPT f=1 TT=1725.45 T1=1725.38	OPT f=1 TT=1.381 T1=0.59	OPT f=1 TT=1.563 T1=1.02	OPT f=1 TT=1.3 T1=0.59
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.28	? (TO) TT=1800.36	? (TO) TT=1800.12
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534.opb	OPT f=1 TT=1.329 T1=0.59	? (TO) TT=1800.05	? (TO) TT=1800.06	OPT f=1 TT=1.431 T1=0.62	OPT f=1 TT=1.557 T1=1.01	OPT f=1 TT=1.329 T1=0.59
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.23	? (TO) TT=1800.38	? (TO) TT=1800.21
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277.opb	OPT f=1 TT=1.491 T1=0.68	? (TO) TT=1800.08	? (TO) TT=1800.07	OPT f=1 TT=1.509 T1=0.68	OPT f=1 TT=1.676 T1=1.08	OPT f=1 TT=1.491 T1=0.68
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.28	? (TO) TT=1800.41	? (TO) TT=1800.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839.opb	OPT f=1 TT=1.462 T1=0.67	? (TO) TT=1800.08	? (TO) TT=1800.07	OPT f=1 TT=1.508 T1=0.68	OPT f=1 TT=1.745 T1=1.07	OPT f=1 TT=1.462 T1=0.67
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354-max.opb	SAT f=-2 TT=1800.38 T1=237.07	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT (TO) f=-2 TT=1800.38 T1=237.07	SAT (TO) f=-2 TT=1800.44 T1=241.06	? (TO) TT=1800.23
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354.opb	OPT f=1 TT=1.626 T1=0.75	? (TO) TT=1800.04	? (TO) TT=1800.05	OPT f=1 TT=1.626 T1=0.75	OPT f=1 TT=1.897 T1=1.14	OPT f=1 TT=1.661 T1=0.78
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522-max.opb	SAT f=-1 TT=1800.41 T1=77.07	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT (TO) f=-1 TT=1800.41 T1=77.07	SAT (TO) f=-1 TT=1800.52 T1=78.45	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522.opb	OPT f=1 TT=1.652 T1=0.79	? (TO) TT=1800.07	? (TO) TT=1800.07	OPT f=1 TT=1.735 T1=0.81	OPT f=1 TT=1.916 T1=1.14	OPT f=1 TT=1.652 T1=0.79
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174-max.opb	SAT f=-1 TT=1800.32 T1=1427.47	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT (TO) f=-1 TT=1800.32 T1=1427.47	? (TO) TT=1800.32	? (TO) TT=1800.13
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174.opb	OPT f=1 TT=1.764 T1=0.86	? (TO) TT=1800.08	? (TO) TT=1800.08	OPT f=1 TT=1.764 T1=0.86	OPT f=1 TT=2.177 T1=1.22	OPT f=1 TT=1.788 T1=0.87
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.22	? (TO) TT=1800.25	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552.opb	OPT f=1 TT=1.784 T1=0.92	? (TO) TT=1800.06	? (TO) TT=1800.07	OPT f=1 TT=1.784 T1=0.92	OPT f=1 TT=2.188 T1=1.22	OPT f=1 TT=1.807 T1=0.92
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554-max.opb	SAT f=-1 TT=1800.39 T1=570.01	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT (TO) f=-1 TT=1800.39 T1=622.11	SAT (TO) f=-1 TT=1800.42 T1=570.01	? (TO) TT=1800.14
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554.opb	OPT f=1 TT=2.114 T1=1.07	? (TO) TT=1800.04	? (TO) TT=1800.06	OPT f=1 TT=2.844 T1=1.84	OPT f=1 TT=2.69 T1=1.39	OPT f=1 TT=2.114 T1=1.07
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.2	? (TO) TT=1800.29	? (TO) TT=1800.13
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197.opb	OPT f=1 TT=2.08 T1=1.02	? (TO) TT=1800.08	? (TO) TT=1800.06	OPT f=1 TT=2.121 T1=1.11	OPT f=1 TT=2.615 T1=1.31	OPT f=1 TT=2.08 T1=1.02
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.24	? (TO) TT=1800.34	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650.opb	OPT f=1 TT=2.277 T1=1.21	? (TO) TT=1800.05	? (TO) TT=1800.06	OPT f=1 TT=2.277 T1=1.21	OPT f=1 TT=3.143 T1=1.4	OPT f=1 TT=2.35 T1=1.21
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249-max.opb		? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.24	? (TO) TT=1800.26
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249.opb	OPT f=1 TT=2.299 T1=1.2	? (TO) TT=1800.08	? (TO) TT=1800.06	OPT f=1 TT=2.299 T1=1.2	OPT f=1 TT=3.125 T1=1.4	OPT f=1 TT=2.431 T1=1.3
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708-max.opb	OPT f=-92 TT=1.49 T1=0.9	OPT f=-92 TT=95.158 T1=36.42	OPT f=-92 TT=4.032 T1=4.03	SAT (TO) f=-92 TT=1800.23 T1=401.07	OPT f=-92 TT=3.409 T1=2.22	OPT f=-92 TT=1.49 T1=0.9
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708.opb	OPT f=1 TT=0.279 T1=0.19	OPT f=1 TT=0.293 T1=0.29	OPT f=1 TT=1.723 T1=1.72	OPT f=1 TT=0.302 T1=0.21	OPT f=1 TT=0.353 T1=0.71	OPT f=1 TT=0.279 T1=0.19
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543-max.opb	OPT f=-1281 TT=0.699 T1=0.37	OPT f=-1281 TT=36.063 T1=28.3	OPT f=-1281 TT=2.381 T1=2.38	SAT (TO) f=-427 TT=1800.25 T1=399.83	OPT f=-1281 TT=1.264 T1=1.22	OPT f=-1281 TT=0.699 T1=0.37
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543.opb	OPT f=1 TT=0.283 T1=0.2	OPT f=1 TT=2.313 T1=2.31	OPT f=1 TT=0.488 T1=0.48	OPT f=1 TT=0.285 T1=0.2	OPT f=1 TT=0.355 T1=0.71	OPT f=1 TT=0.283 T1=0.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.27	? (TO) TT=1800.43	? (TO) TT=1800.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880.opb	OPT f=1 TT=2.695 T1=1.45	? (TO) TT=1800.08	? (TO) TT=1800.04	OPT f=1 TT=2.697 T1=1.45	OPT f=1 TT=3.904 T1=2.02	OPT f=1 TT=2.695 T1=1.45
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.26	? (TO) TT=1800.4	? (TO) TT=1800.24
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390.opb	OPT f=1 TT=2.679 T1=1.45	? (TO) TT=1800.07	? (TO) TT=1800.07	OPT f=1 TT=2.679 T1=1.45	OPT f=1 TT=3.892 T1=2.02	OPT f=1 TT=2.91 T1=1.61
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.28	? (TO) TT=1800.28	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238.opb	OPT f=1 TT=3.148 T1=1.74	? (TO) TT=1800.07	? (TO) TT=1800.09	OPT f=1 TT=3.187 T1=1.74	OPT f=1 TT=4.731 T1=2.15	OPT f=1 TT=3.148 T1=1.74
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885.opb	OPT f=1 TT=3.17 T1=1.76	? (TO) TT=1800.06	? (TO) TT=1800.06	OPT f=1 TT=3.187 T1=1.77	OPT f=1 TT=4.741 T1=2.14	OPT f=1 TT=3.17 T1=1.76
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.22	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074.opb	OPT f=1 TT=3.69 T1=2.08	? (TO) TT=1800.06	? (TO) TT=1800.08	OPT f=1 TT=3.69 T1=2.08	OPT f=1 TT=5.745 T1=2.8	OPT f=1 TT=3.98 T1=2.28
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.27	? (TO) TT=1800.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794.opb	OPT f=1 TT=3.729 T1=2.12	? (TO) TT=1800.08	? (TO) TT=1800.08	OPT f=1 TT=3.729 T1=2.12	OPT f=1 TT=5.808 T1=2.79	OPT f=1 TT=3.736 T1=2.12
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.36	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631.opb	OPT f=1 TT=4.427 T1=2.57	? (TO) TT=1800.06	? (TO) TT=1800.07	OPT f=1 TT=4.496 T1=2.58	OPT f=1 TT=7.182 T1=2.93	OPT f=1 TT=4.427 T1=2.57
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.26	? (TO) TT=1800.21
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433.opb	OPT f=1 TT=4.429 T1=2.57	? (TO) TT=1800.09	? (TO) TT=1800.06	OPT f=1 TT=4.473 T1=2.59	OPT f=1 TT=7.331 T1=2.96	OPT f=1 TT=4.429 T1=2.57
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.23	? (TO) TT=1800.27	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195.opb	OPT f=1 TT=5.731 T1=3.23	? (TO) TT=1800.1	? (TO) TT=1800.07	OPT f=1 TT=5.855 T1=3.23	OPT f=1 TT=9.049 T1=3.73	OPT f=1 TT=5.731 T1=3.26
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.37	? (TO) TT=1800.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159.opb	OPT f=1 TT=5.722 T1=3.22	? (TO) TT=1800.11	? (TO) TT=1800.08	OPT f=1 TT=5.722 T1=3.24	OPT f=1 TT=9.402 T1=3.85	OPT f=1 TT=5.84 T1=3.22
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.33	? (TO) TT=1800.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690.opb	OPT f=1 TT=6.544 T1=3.82	? (TO) TT=1800.08	? (TO) TT=1800.08	OPT f=1 TT=7.307 T1=4.08	OPT f=1 TT=11.124 T1=4.44	OPT f=1 TT=6.544 T1=3.82
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.23	? (TO) TT=1800.12
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220.opb	OPT f=1 TT=6.539 T1=3.8	? (TO) TT=1800.06	? (TO) TT=1800.07	OPT f=1 TT=6.576 T1=3.82	OPT f=1 TT=10.946 T1=4.4	OPT f=1 TT=6.539 T1=3.8
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.22	? (TO) TT=1800.39	? (TO) TT=1800.19
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480.opb	OPT f=1 TT=7.889 T1=4.64	? (TO) TT=1800.1	? (TO) TT=1800.06	OPT f=1 TT=7.889 T1=4.64	OPT f=1 TT=13.478 T1=5.16	OPT f=1 TT=7.947 T1=4.66
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.33	? (TO) TT=1800.22
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999.opb	OPT f=1 TT=7.919 T1=4.67	? (TO) TT=1800.08	? (TO) TT=1800.06	OPT f=1 TT=8.318 T1=4.87	OPT f=1 TT=13.527 T1=5.16	OPT f=1 TT=7.919 T1=4.67
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.39	? (TO) TT=1800.14
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132.opb	OPT f=1 TT=9.358 T1=5.52	? (TO) TT=1800.07	? (TO) TT=1800.07	OPT f=1 TT=9.358 T1=5.52	OPT f=1 TT=16.057 T1=6.36	OPT f=1 TT=9.566 T1=5.59
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.46	? (TO) TT=1800.28	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403.opb	OPT f=1 TT=9.432 T1=5.59	? (TO) TT=1800.08	? (TO) TT=1800.08	OPT f=1 TT=9.432 T1=5.59	OPT f=1 TT=16.637 T1=6.4	OPT f=1 TT=9.822 T1=5.72
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.24	? (TO) TT=1800.11
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478.opb	OPT f=1 TT=11.082 T1=6.61	? (TO) TT=1800.13	? (TO) TT=1800.08	OPT f=1 TT=11.082 T1=6.62	OPT f=1 TT=19.335 T1=7.11	OPT f=1 TT=11.094 T1=6.61
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.2	? (TO) TT=1800.42	? (TO) TT=1800.21
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612.opb	OPT f=1 TT=10.969 T1=6.51	? (TO) TT=1800.09	? (TO) TT=1800.1	OPT f=1 TT=10.987 T1=6.55	OPT f=1 TT=19.827 T1=7.45	OPT f=1 TT=10.969 T1=6.51
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400-max.opb		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.33	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400.opb	OPT f=1 TT=12.625 T1=7.67	? (TO) TT=1800.1	? (TO) TT=1800.06	OPT f=1 TT=12.625 T1=7.67	OPT f=1 TT=22.717 T1=8.29	OPT f=1 TT=12.914 T1=7.8
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.37	? (TO) TT=1800.17
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490.opb	OPT f=1 TT=12.664 T1=7.69	? (TO) TT=1800.08	? (TO) TT=1800.09	OPT f=1 TT=12.766 T1=7.72	OPT f=1 TT=22.543 T1=8.26	OPT f=1 TT=12.664 T1=7.69
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555-max.opb	SAT f=-11 TT=1800.15 T1=981.2	? (TO) TT=1800.06	? (TO) f=-18535 TT=1800.07 T1=1800	? (TO) TT=1800.19	SAT (TO) f=-5 TT=1800.21 T1=118.73	SAT (TO) f=-11 TT=1800.15 T1=981.2
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555.opb	OPT f=1 TT=0.595 T1=0.32	? (TO) TT=1800.08	OPT f=1 TT=70.242 T1=70.24	OPT f=1 TT=0.604 T1=0.32	OPT f=1 TT=0.927 T1=0.82	OPT f=1 TT=0.595 T1=0.32
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986-max.opb	OPT f=-1307731 TT=404.265 T1=398.14	? (TO) f=-13303 TT=1800.04 T1=850.43	OPT f=-1307731 TT=1061.88 T1=1061.85	? (TO) TT=1800.25	OPT f=-1307731 TT=906.09 T1=453.41	OPT f=-1307731 TT=404.265 T1=398.14
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986.opb	OPT f=1 TT=0.592 T1=0.32	OPT f=1 TT=794.262 T1=794.21	OPT f=1 TT=128.924 T1=128.91	OPT f=1 TT=0.609 T1=0.32	OPT f=1 TT=0.87 T1=0.82	OPT f=1 TT=0.592 T1=0.34
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.4	? (TO) TT=1800.19
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641.opb	OPT f=1 TT=15.139 T1=9.13	? (TO) TT=1800.09	? (TO) TT=1800.12	OPT f=1 TT=15.139 T1=9.13	OPT f=1 TT=27.829 T1=10.09	OPT f=1 TT=16.218 T1=9.93
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.25	? (TO) TT=1800.22	? (TO) TT=1800.17
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006.opb	OPT f=1 TT=15.103 T1=9.09	? (TO) TT=1800.1	? (TO) TT=1800.08	OPT f=1 TT=15.103 T1=9.09	OPT f=1 TT=27.228 T1=10.16	OPT f=1 TT=15.198 T1=9.16
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.21	? (TO) TT=1800.23	? (TO) TT=1800.14
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542.opb	OPT f=1 TT=17.622 T1=10.62	? (TO) TT=1800.08	? (TO) TT=1800.11	OPT f=1 TT=17.622 T1=10.62	OPT f=1 TT=31.778 T1=11.48	OPT f=1 TT=18.709 T1=11.3
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498-max.opb		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.2	? (TO) TT=1800.19
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498.opb	OPT f=1 TT=17.296 T1=10.48	? (TO) TT=1800.08	? (TO) TT=1800.08	OPT f=1 TT=17.613 T1=10.61	OPT f=1 TT=33.128 T1=12.18	OPT f=1 TT=17.296 T1=10.48
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129-max.opb		? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.25	? (TO) TT=1800.35	? (TO) TT=1800.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129.opb	OPT f=1 TT=20.232 T1=12.29	? (TO) TT=1800.08	? (TO) TT=1800.1	OPT f=1 TT=20.29 T1=12.34	OPT f=1 TT=38.464 T1=13.65	OPT f=1 TT=20.232 T1=12.29
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.27	? (TO) TT=1800.13
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673.opb	OPT f=1 TT=20.152 T1=12.27	? (TO) TT=1800.11	? (TO) TT=1800.11	OPT f=1 TT=20.152 T1=12.37	OPT f=1 TT=37.041 T1=13.2	OPT f=1 TT=20.253 T1=12.27
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727-max.opb		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.33	? (TO) TT=1800.18
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727.opb	OPT f=1 TT=23.79 T1=14.32	? (TO) TT=1800.17	? (TO) TT=1800.09	OPT f=1 TT=31.047 T1=21.51	OPT f=1 TT=43.49 T1=15.16	OPT f=1 TT=23.79 T1=14.32
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136-max.opb		? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.26	? (TO) TT=1800.27	? (TO) TT=1800.17
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136.opb	OPT f=1 TT=23.775 T1=14.31	? (TO) TT=1800.15	? (TO) TT=1800.1	OPT f=1 TT=25.968 T1=15.67	OPT f=1 TT=43.589 T1=15.18	OPT f=1 TT=23.775 T1=14.31
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866-max.opb		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.21	? (TO) TT=1800.32	? (TO) TT=1800.14
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866.opb	OPT f=1 TT=26.768 T1=16.15	? (TO) TT=1800.15	? (TO) TT=1800.11	OPT f=1 TT=28.598 T1=17.01	OPT f=1 TT=51.391 T1=17.78	OPT f=1 TT=26.768 T1=16.15
Bench name	Best results	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522-max.opb		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.21	? (TO) TT=1800.16
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522.opb	OPT f=1 TT=26.956 T1=16.25	? (TO) TT=1800.11	? (TO) TT=1800.08	OPT f=1 TT=27.212 T1=16.35	OPT f=1 TT=50.158 T1=17.52	OPT f=1 TT=26.956 T1=16.25
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155-max.opb		? (TO) TT=1800.07	? (TO) f=-19 TT=1800.08 T1=1800	? (TO) TT=1800.25	? (TO) TT=1800.28	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155.opb	OPT f=1 TT=1.001 T1=0.43	? (TO) TT=1800.05	OPT f=1 TT=121.986 T1=121.98	OPT f=1 TT=1.001 T1=0.43	OPT f=1 TT=1.476 T1=0.98	OPT f=1 TT=1.002 T1=0.44
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325-max.opb		? (TO) TT=1800.06	? (TO) f=-49 TT=1800.07 T1=1800	? (TO) TT=1800.22	? (TO) TT=1800.34	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325.opb	OPT f=1 TT=1.019 T1=0.43	? (TO) TT=1800.06	OPT f=1 TT=48.108 T1=48.1	OPT f=1 TT=1.019 T1=0.43	OPT f=1 TT=1.53 T1=0.97	OPT f=1 TT=1.12 T1=0.48
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378-max.opb	SAT f=-2 TT=1800.26 T1=7.83	? (TO) TT=1800.05	? (TO) f=-66 TT=1800.07 T1=1800	SAT (TO) f=-2 TT=1800.26 T1=7.83	SAT (TO) f=-2 TT=1800.32 T1=8.01	? (TO) TT=1800.17
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378.opb	OPT f=1 TT=0.932 T1=0.47	? (TO) TT=1800.05	OPT f=1 TT=737.982 T1=737.95	OPT f=1 TT=0.932 T1=0.47	OPT f=1 TT=1.698 T1=0.98	OPT f=1 TT=0.974 T1=0.48
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415-max.opb		? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.27	? (TO) TT=1800.25	? (TO) TT=1800.08
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415.opb	OPT f=1 TT=0.95 T1=0.47	? (TO) TT=1800.09	? (TO) TT=1800.02	OPT f=1 TT=0.95 T1=0.47	OPT f=1 TT=1.762 T1=0.99	OPT f=1 TT=0.99 T1=0.5

Statistics		MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)
Number of times the solver is able to give the best known answer		5	11	55	57	54
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	0	27	4	32