PB'16 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade, subsubcategory Number Factorization

This page displays the results of the different solvers for each benchmark for category optimisation, big integers, linear constraints (OPT-BIGINT-LIN), subcategory Handmade, subsubcategory Number Factorization

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
minisatp 2012-10-02 git-d91742b (complete)
NaPS 1.02 (complete)
Sat4j PB 2.3.6 Res+CP PB16 (complete)
Sat4j PB 2.3.6 Resolution PB16 (complete)
toysat 2016-05-02 (complete)

Bench name	Best results on this instance	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114-max.opb	SAT f=-2 TT=1800.01 T1=1800.3	SAT (TO) f=-2 TT=1800.01 T1=1800.3	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1801.58	? (MO) TT=172.717
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-416317114.opb	OPT f=1 TT=1.214 T1=0.56	OPT f=1 TT=8.941 T1=8.93	? (TO) TT=1800.08	OPT f=1 TT=2.526 T1=1.25	OPT f=1 TT=1.214 T1=0.56	? (MO) TT=175.964
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534-max.opb	SAT f=-2 TT=1800.01 T1=1800.3	SAT (TO) f=-2 TT=1800.01 T1=1800.3	? (TO) TT=1800.11	? (TO) TT=1800.51	? (TO) TT=1800.08	? (MO) TT=170.196
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=100-sizeP=51-sizeQ=100-520972534.opb	OPT f=1 TT=1.263 T1=0.55	OPT f=1 TT=3.629 T1=3.62	? (TO) TT=1800.08	OPT f=1 TT=2.525 T1=1.25	OPT f=1 TT=1.263 T1=0.55	? (MO) TT=170
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277-max.opb	SAT f=-13 TT=1800.08 T1=1800.4	SAT (TO) f=-13 TT=1800.08 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.63	? (TO) TT=1800.01	? (MO) TT=194.521
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-718083277.opb	OPT f=1 TT=1.304 T1=0.61	OPT f=1 TT=6.229 T1=6.22	? (TO) TT=1800.01	OPT f=1 TT=2.246 T1=1.24	OPT f=1 TT=1.304 T1=0.61	? (MO) TT=194.87
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.65	? (TO) TT=1800.05	? (MO) TT=157.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839.opb	OPT f=1 TT=1.274 T1=0.59	OPT f=1 TT=4.541 T1=4.53	? (TO) TT=1800.06	OPT f=1 TT=2.983 T1=1.37	OPT f=1 TT=1.274 T1=0.59	? (MO) TT=157.383
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.77	? (TO) TT=1800.06	? (MO) TT=157.217
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354.opb	OPT f=1 TT=1.425 T1=0.68	OPT f=1 TT=7.211 T1=7.2	? (TO) TT=1800.01	OPT f=1 TT=2.594 T1=1.37	OPT f=1 TT=1.425 T1=0.68	? (MO) TT=156.294
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522-max.opb	SAT f=-3 TT=1800.07 T1=1800.4	SAT (TO) f=-3 TT=1800.07 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.65	? (TO) TT=1800.05	? (MO) TT=164.399
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=140-sizeP=71-sizeQ=140-318609522.opb	OPT f=1 TT=1.477 T1=0.68	OPT f=1 TT=10.394 T1=10.38	? (TO) TT=1800.01	OPT f=1 TT=2.754 T1=1.39	OPT f=1 TT=1.477 T1=0.68	? (MO) TT=163.792
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800	? (MO) TT=169.306
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-203099174.opb	OPT f=1 TT=1.483 T1=0.76	OPT f=1 TT=45.878 T1=45.87	? (TO) TT=1800.02	OPT f=1 TT=2.883 T1=1.47	OPT f=1 TT=1.483 T1=0.76	? (MO) TT=183.497
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552-max.opb	SAT f=-127 TT=1800.08 T1=1800.4	SAT (TO) f=-127 TT=1800.08 T1=1800.4	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.01	? (MO) TT=187.909
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552.opb	OPT f=1 TT=1.494 T1=0.76	OPT f=1 TT=11.254 T1=11.24	? (TO) TT=1800.11	OPT f=1 TT=2.834 T1=1.43	OPT f=1 TT=1.494 T1=0.76	? (MO) TT=191.426
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554-max.opb	SAT f=-2 TT=1800.13 T1=471.22	SAT (TO) f=-1 TT=1800.08 T1=1800.4	? (TO) TT=1800.03	SAT (TO) f=-2 TT=1800.13 T1=471.22	? (TO) TT=1800.89	? (MO) TT=150.005
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554.opb	OPT f=1 TT=1.683 T1=0.84	OPT f=1 TT=16.114 T1=16.1	? (TO) TT=1800.11	OPT f=1 TT=2.995 T1=1.47	OPT f=1 TT=1.683 T1=0.84	? (MO) TT=149.477
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197-max.opb		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.77	? (TO) TT=1800.75	? (MO) TT=149.338
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=180-sizeP=91-sizeQ=180-780825197.opb	OPT f=1 TT=1.694 T1=0.87	OPT f=1 TT=38.658 T1=38.64	? (TO) TT=1800.02	OPT f=1 TT=2.793 T1=1.43	OPT f=1 TT=1.694 T1=0.87	? (MO) TT=149.672
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650-max.opb	SAT f=-30 TT=1800.07 T1=1800.4	SAT (TO) f=-30 TT=1800.07 T1=1800.4	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (MO) TT=185.689
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650.opb	OPT f=1 TT=1.873 T1=0.95	OPT f=1 TT=62.717 T1=62.7	? (TO) TT=1800.07	OPT f=1 TT=3.323 T1=1.56	OPT f=1 TT=1.873 T1=0.95	? (MO) TT=186.48
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.58	? (MO) TT=150.014
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249.opb	OPT f=1 TT=1.944 T1=0.96	OPT f=1 TT=26.871 T1=26.85	? (TO) TT=1800.14	OPT f=1 TT=3.214 T1=1.52	OPT f=1 TT=1.944 T1=0.96	? (MO) TT=149.8
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708-max.opb	OPT f=-92 TT=0.149 T1=0.14	OPT f=-92 TT=0.149 T1=0.14	OPT f=-92 TT=0.287 T1=0.28	OPT f=-92 TT=2.363 T1=1.72	OPT f=-92 TT=0.865 T1=0.42	OPT f=-92 TT=3.087 T1=3.01
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-496708.opb	OPT f=1 TT=0.051 T1=0.05	OPT f=1 TT=0.051 T1=0.05	OPT f=1 TT=0.095 T1=0.09	OPT f=1 TT=0.303 T1=0.71	OPT f=1 TT=0.275 T1=0.19	OPT f=1 TT=2.126 T1=2.1
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543-max.opb	OPT f=-1281 TT=0.079 T1=0.07	OPT f=-1281 TT=0.082 T1=0.08	OPT f=-1281 TT=0.079 T1=0.07	OPT f=-1281 TT=1.544 T1=0.71	OPT f=-1281 TT=0.673 T1=0.33	OPT f=-1281 TT=14.682 T1=14.53
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543.opb	OPT f=1 TT=0.048 T1=0.04	OPT f=1 TT=0.048 T1=0.04	OPT f=1 TT=0.05 T1=0.05	OPT f=1 TT=0.304 T1=0.71	OPT f=1 TT=0.274 T1=0.19	OPT f=1 TT=13.951 T1=13.89
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800	? (TO) TT=1800.02	? (MO) TT=169.963
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880.opb	OPT f=1 TT=2.045 T1=1.08	OPT f=1 TT=36.168 T1=36.14	? (TO) TT=1800.06	OPT f=1 TT=3.622 T1=1.65	OPT f=1 TT=2.045 T1=1.08	? (MO) TT=166.418
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.79	? (MO) TT=151.631
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390.opb	OPT f=1 TT=1.985 T1=1.1	OPT f=1 TT=29.841 T1=29.82	? (TO) TT=1800.06	OPT f=1 TT=3.638 T1=1.66	OPT f=1 TT=1.985 T1=1.1	? (MO) TT=150.409
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238-max.opb		? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.55	? (TO) TT=1800.02	? (MO) TT=169.952
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-330229238.opb	OPT f=1 TT=2.193 T1=1.22	OPT f=1 TT=106.851 T1=106.83	? (TO) TT=1800.06	OPT f=1 TT=3.733 T1=1.79	OPT f=1 TT=2.193 T1=1.22	? (MO) TT=169.016
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885-max.opb	SAT f=-1237 TT=1800.09 T1=1800.4	SAT (TO) f=-1237 TT=1800.09 T1=1800.4	? (TO) TT=1800.11	SAT (TO) f=-1 TT=1800.09 T1=153.8	? (TO) TT=1801.05	? (MO) TT=150.208
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=240-sizeP=121-sizeQ=240-817963885.opb	OPT f=1 TT=2.214 T1=1.18	OPT f=1 TT=49.028 T1=49	? (TO) TT=1800.12	OPT f=1 TT=3.742 T1=1.8	OPT f=1 TT=2.214 T1=1.18	? (MO) TT=153.378
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1801.14	? (MO) TT=169.568
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-466115074.opb	OPT f=1 TT=2.554 T1=1.34	OPT f=1 TT=76.445 T1=76.42	? (TO) TT=1800.14	OPT f=1 TT=4.082 T1=1.91	OPT f=1 TT=2.554 T1=1.34	? (MO) TT=169.205
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794-max.opb		? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.86	? (MO) TT=151.751
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=260-sizeP=131-sizeQ=260-581480794.opb	OPT f=1 TT=2.645 T1=1.44	OPT f=1 TT=58.437 T1=58.41	? (TO) TT=1800.15	OPT f=1 TT=4.121 T1=1.9	OPT f=1 TT=2.645 T1=1.44	? (MO) TT=149.531
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631-max.opb		? (TO) TT=1800.02	? (TO) TT=1800.3	? (TO) TT=1800	? (TO) TT=1800.84	? (MO) TT=158.898
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631.opb	OPT f=1 TT=2.543 T1=1.46	OPT f=1 TT=66.43 T1=66.39	? (TO) TT=1800.17	OPT f=1 TT=4.654 T1=2.05	OPT f=1 TT=2.543 T1=1.46	? (MO) TT=158.714
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433-max.opb		? (TO) TT=1800.08	? (TO) TT=1800.24	? (TO) TT=1800.02	? (TO) TT=1801.06	? (MO) TT=149.418
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433.opb	OPT f=1 TT=2.663 T1=1.49	OPT f=1 TT=251.969 T1=251.96	? (TO) TT=1800.16	OPT f=1 TT=4.572 T1=2.06	OPT f=1 TT=2.663 T1=1.49	? (MO) TT=159.377
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195-max.opb		? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.55	? (TO) TT=1800.94	? (MO) TT=156.581
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-346995195.opb	OPT f=1 TT=3.394 T1=1.92	OPT f=1 TT=84.636 T1=84.59	? (TO) TT=1800.2	OPT f=1 TT=5.111 T1=2.81	OPT f=1 TT=3.394 T1=1.92	? (MO) TT=156.616
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159-max.opb		? (TO) TT=1800.13	? (TO) TT=1800.22	? (TO) TT=1800.69	? (TO) TT=1800.09	? (MO) TT=158.202
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159.opb	OPT f=1 TT=3.494 T1=1.89	OPT f=1 TT=85.187 T1=85.16	? (TO) TT=1800.33	OPT f=1 TT=5.274 T1=2.83	OPT f=1 TT=3.494 T1=1.89	? (MO) TT=166.336
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690-max.opb		? (TO) TT=1800.12	? (TO) TT=1800.28	? (TO) TT=1800.65	? (TO) TT=1800.78	? (MO) TT=151.03
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-287873690.opb	OPT f=1 TT=3.603 T1=2.3	OPT f=1 TT=307.078 T1=307.06	? (TO) TT=1800.3	OPT f=1 TT=5.032 T1=2.48	OPT f=1 TT=3.603 T1=2.3	? (MO) TT=155.41
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220-max.opb		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.04	? (MO) TT=156.882
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=320-sizeP=161-sizeQ=320-420453220.opb	OPT f=1 TT=3.614 T1=2.2	OPT f=1 TT=100.661 T1=100.61	? (TO) TT=1800.28	OPT f=1 TT=5.311 T1=2.48	OPT f=1 TT=3.614 T1=2.2	? (MO) TT=157.403
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480-max.opb	SAT f=-104 TT=1800.1 T1=1800.3	SAT (TO) f=-104 TT=1800.1 T1=1800.3	? (TO) TT=1800.32	? (TO) TT=1800	? (TO) TT=1800.05	? (MO) TT=151.574
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480.opb	OPT f=1 TT=3.962 T1=2.53	OPT f=1 TT=135.026 T1=134.98	? (TO) TT=1800.25	OPT f=1 TT=5.563 T1=2.8	OPT f=1 TT=3.962 T1=2.53	? (MO) TT=149.711
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999-max.opb	SAT f=-57 TT=1800.09 T1=1800.4	SAT (TO) f=-57 TT=1800.09 T1=1800.4	? (TO) TT=1800.27	? (TO) TT=1800.18	? (TO) TT=1800.01	? (MO) TT=157.197
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=340-sizeP=171-sizeQ=340-737522999.opb	OPT f=1 TT=3.944 T1=2.54	OPT f=1 TT=125.531 T1=125.49	? (TO) TT=1800.32	OPT f=1 TT=5.741 T1=2.91	OPT f=1 TT=3.944 T1=2.54	? (MO) TT=157.488
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132-max.opb		? (TO) TT=1800.07	? (TO) TT=1800.39	? (TO) TT=1800.61	? (TO) TT=1800.63	? (MO) TT=154.666
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132.opb	OPT f=1 TT=4.533 T1=2.85	OPT f=1 TT=150.688 T1=150.63	? (TO) TT=1800.36	OPT f=1 TT=6.512 T1=3.43	OPT f=1 TT=4.533 T1=2.85	? (MO) TT=155.228
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403-max.opb		? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1800.01	? (TO) TT=1800.06	? (MO) TT=160.879
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=360-sizeP=181-sizeQ=360-885821403.opb	OPT f=1 TT=4.664 T1=2.98	OPT f=1 TT=257.582 T1=257.54	? (TO) TT=1800.4	OPT f=1 TT=6.796 T1=3.46	OPT f=1 TT=4.664 T1=2.98	? (MO) TT=160.088
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478-max.opb		? (TO) TT=1800.09	? (TO) TT=1800.34	? (TO) TT=1800.19	? (TO) TT=1800	? (MO) TT=158.115
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478.opb	OPT f=1 TT=4.353 T1=2.69	OPT f=1 TT=287.102 T1=287.09	? (TO) TT=1800.43	OPT f=1 TT=8.123 T1=4.22	OPT f=1 TT=4.353 T1=2.69	? (MO) TT=158.42
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612-max.opb		? (TO) TT=1800.13	? (TO) TT=1800.27	? (TO) TT=1800.16	? (TO) TT=1800.58	? (MO) TT=150.796
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612.opb	OPT f=1 TT=4.393 T1=2.73	OPT f=1 TT=197.742 T1=197.71	? (TO) TT=1800.43	OPT f=1 TT=8.314 T1=4.31	OPT f=1 TT=4.393 T1=2.73	? (MO) TT=151.021
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400-max.opb	SAT f=-25 TT=1800.12 T1=1800.4	SAT (TO) f=-25 TT=1800.12 T1=1800.4	Signal TT=11.584	? (TO) TT=1800.17	? (TO) TT=1800.01	? (MO) TT=194.801
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-517735400.opb	OPT f=1 TT=5.252 T1=3.64	OPT f=1 TT=203.778 T1=203.71	Signal TT=11.676	OPT f=1 TT=6.714 T1=3.92	OPT f=1 TT=5.252 T1=3.64	? (MO) TT=195.346
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490-max.opb		? (TO) TT=1800.02	Signal TT=11.436	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=190.113
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=400-sizeP=201-sizeQ=400-87904490.opb	OPT f=1 TT=5.092 T1=3.49	OPT f=1 TT=324.758 T1=324.74	Signal TT=11.521	OPT f=1 TT=7.032 T1=4.08	OPT f=1 TT=5.092 T1=3.49	? (MO) TT=186.556
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555-max.opb	OPT f=-18535 TT=924.581 T1=195.16	OPT f=-18535 TT=924.581 T1=924.72	SAT (TO) f=-1 TT=1800.02 T1=1800.3	SAT (TO) f=-18535 TT=1800.14 T1=195.16	OPT f=-18535 TT=1787.67 T1=1762.14	? (MO) TT=173.677
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555.opb	OPT f=1 TT=0.554 T1=0.3	OPT f=1 TT=32.112 T1=32.11	OPT f=1 TT=48.515 T1=48.52	OPT f=1 TT=0.895 T1=0.83	OPT f=1 TT=0.554 T1=0.3	? (MO) TT=172.6
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986-max.opb	OPT f=-1307731 TT=13.482 T1=8.43	OPT f=-1307731 TT=127.186 T1=127.2	OPT f=-1307731 TT=52.95 T1=52.95	OPT f=-1307731 TT=111.069 T1=52.36	OPT f=-1307731 TT=13.482 T1=8.43	? (MO) TT=169.15
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=40-sizeP=21-sizeQ=40-793490986.opb	OPT f=1 TT=0.523 T1=0.3	OPT f=1 TT=9.2 T1=9.2	OPT f=1 TT=44.347 T1=44.35	OPT f=1 TT=0.685 T1=0.84	OPT f=1 TT=0.523 T1=0.3	? (MO) TT=169.591
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641-max.opb		? (TO) TT=1800.1	Signal TT=13.046	? (TO) TT=1800.02	? (TO) TT=1800.09	? (MO) TT=205.652
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641.opb	OPT f=1 TT=5.762 T1=4.15	OPT f=1 TT=386.699 T1=386.68	Signal TT=13.056	OPT f=1 TT=8.303 T1=4.51	OPT f=1 TT=5.762 T1=4.15	? (MO) TT=204.199
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006-max.opb		? (TO) TT=1800.08	Signal TT=13.061	? (TO) TT=1800.01	? (TO) TT=1800.71	? (MO) TT=201.959
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006.opb	OPT f=1 TT=5.453 T1=4.14	OPT f=1 TT=370.158 T1=370.15	Signal TT=12.876	OPT f=1 TT=7.944 T1=4.5	OPT f=1 TT=5.453 T1=4.14	? (MO) TT=202.303
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542-max.opb		? (TO) TT=1800.11	Signal TT=14.645	? (TO) TT=1800.13	? (TO) TT=1800.06	? (MO) TT=141.809
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-24744542.opb	OPT f=1 TT=6.754 T1=4.85	OPT f=1 TT=470.429 T1=470.43	Signal TT=14.754	OPT f=1 TT=9.762 T1=5.52	OPT f=1 TT=6.754 T1=4.85	? (MO) TT=141.95
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498-max.opb		? (TO) TT=1800.02	Signal TT=14.74	? (TO) TT=1800.14	? (TO) TT=1800.53	? (MO) TT=145.224
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498.opb	OPT f=1 TT=6.604 T1=4.93	OPT f=1 TT=377.568 T1=377.53	Signal TT=14.544	OPT f=1 TT=9.622 T1=5.49	OPT f=1 TT=6.604 T1=4.93	? (MO) TT=142.513
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129-max.opb		? (TO) TT=1800.07	Signal TT=16.532	? (TO) TT=1800.17	? (TO) TT=1800.65	? (MO) TT=151.512
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129.opb	OPT f=1 TT=5.993 T1=4.34	OPT f=1 TT=441.252 T1=441.17	Signal TT=16.387	OPT f=1 TT=10.982 T1=6.17	OPT f=1 TT=5.993 T1=4.34	? (MO) TT=152.869
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673-max.opb		? (TO) TT=1800.13	Signal TT=16.522	? (TO) TT=1800.12	? (TO) TT=1800.01	? (MO) TT=151.269
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=460-sizeP=231-sizeQ=460-510733673.opb	OPT f=1 TT=5.822 T1=4.13	OPT f=1 TT=680.6 T1=680.63	Signal TT=16.467	OPT f=1 TT=10.913 T1=6.36	OPT f=1 TT=5.822 T1=4.13	? (MO) TT=148.055
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727-max.opb	SAT f=-9 TT=1800.14 T1=1800.4	SAT (TO) f=-9 TT=1800.14 T1=1800.4	Signal TT=18.516	? (TO) TT=1800.05	? (TO) TT=1800.05	? (MO) TT=148.114
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727.opb	OPT f=1 TT=7.364 T1=5.52	OPT f=1 TT=556.757 T1=556.73	Signal TT=18.888	OPT f=1 TT=12.713 T1=7.12	OPT f=1 TT=7.364 T1=5.52	? (MO) TT=146.495
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136-max.opb		? (TO) TT=1800.07	Signal TT=18.512	? (TO) TT=1800.07	? (TO) TT=1800.02	? (MO) TT=195.86
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136.opb	OPT f=1 TT=7.353 T1=5.49	OPT f=1 TT=434.029 T1=433.93	Signal TT=18.417	OPT f=1 TT=12.851 T1=7.17	OPT f=1 TT=7.353 T1=5.49	? (MO) TT=198.614
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866-max.opb		? (TO) TT=1800.11	Signal TT=20.278	? (TO) TT=1800.68	? (TO) TT=1800.01	? (MO) TT=199.199
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866.opb	OPT f=1 TT=7.694 T1=5.86	OPT f=1 TT=462.924 T1=462.85	Signal TT=20.485	OPT f=1 TT=9.795 T1=5.86	OPT f=1 TT=7.694 T1=6.04	? (MO) TT=197.257
Bench name	Best results	minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522-max.opb		? (TO) TT=1800.11	Signal TT=21.566	? (TO) TT=1800.62	? (TO) TT=1800.7	? (MO) TT=203.102
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522.opb	OPT f=1 TT=8.053 T1=6.06	OPT f=1 TT=521.12 T1=521.05	Signal TT=20.566	OPT f=1 TT=10.122 T1=6.06	OPT f=1 TT=8.053 T1=6.2	? (MO) TT=197.972
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155-max.opb	SAT f=-5339 TT=1801.21 T1=1340.54	SAT (TO) f=-95 TT=1800.03 T1=1800.3	? (TO) TT=1800.1	SAT (TO) f=-1 TT=1800.16 T1=169.71	SAT (TO) f=-5339 TT=1801.21 T1=1340.54	? (MO) TT=172.893
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155.opb	OPT f=1 TT=0.864 T1=0.4	OPT f=1 TT=3.838 T1=3.83	? (TO) TT=1800.01	OPT f=1 TT=2.054 T1=1.1	OPT f=1 TT=0.864 T1=0.4	? (MO) TT=172.875
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325-max.opb	SAT f=-735 TT=1800.01 T1=407.81	SAT (TO) f=-735 TT=1800.01 T1=1800.3	? (TO) TT=1800.1	SAT (TO) f=-735 TT=1800.11 T1=407.81	? (TO) TT=1800.98	? (MO) TT=172.684
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=60-sizeP=31-sizeQ=60-784051325.opb	OPT f=1 TT=0.883 T1=0.4	OPT f=1 TT=3.211 T1=3.2	? (TO) TT=1800.1	OPT f=1 TT=2.064 T1=1.16	OPT f=1 TT=0.883 T1=0.4	? (MO) TT=174.121
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378-max.opb	SAT f=-22 TT=1800.02 T1=1800.3	SAT (TO) f=-22 TT=1800.02 T1=1800.3	SAT (TO) f=-6 TT=1800.1 T1=1800.4	SAT (TO) f=-3 TT=1801 T1=111.72	? (TO) TT=1800.1	? (MO) TT=188.015
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378.opb	OPT f=1 TT=0.944 T1=0.47	OPT f=1 TT=3.75 T1=3.74	OPT f=1 TT=1450.2 T1=1450.42	OPT f=1 TT=2.324 T1=1.21	OPT f=1 TT=0.944 T1=0.47	? (MO) TT=183.789
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415-max.opb	SAT f=-1969 TT=1800.02 T1=1800.3	SAT (TO) f=-1969 TT=1800.02 T1=1800.3	? (TO) TT=1800.1	SAT (TO) f=-1 TT=1800.12 T1=9.68	? (TO) TT=1800.68	? (MO) TT=178.251
normalized-PB06/OPT-BIGINT/submitted-PB06/ roussel/factor/ normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415.opb	OPT f=1 TT=0.934 T1=0.47	OPT f=1 TT=1.657 T1=1.65	? (TO) TT=1800.01	OPT f=1 TT=2.204 T1=1.18	OPT f=1 TT=0.934 T1=0.47	? (MO) TT=178.491

Statistics		minisatp 2012-10-02 git-d91742b (complete)	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
Number of times the solver is able to give the best known answer		68	8	55	55	4
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		18	1	2	50	0