Pseudo-Boolean Competition 2016

The 2016 pseudo-Boolean competition is organized as a special event of the SAT 2016 conference.

Like the previous evaluations and competitions (PB05, PB06, PB07, PB09, PB10, PB11, PB12, PB Evaluation 2015), the goal is to assess the state of the art in the field of pseudo-Boolean solvers.

This edition of the competition will be very similar to the PB12 competition. We especially encourage the submission of new solvers and new instances.

new This edition of the competition will introduce two novelties:

For questions, comments and any other issue regarding the PB competition, please get in touch with the organizer.

Results of the competition

Some web pages are currently incomplete. We are working on this issue.

Deadlines

The timetable of the 2016 evaluation is detailed below.

Opening of registration site April 1st, 2016
Submitters must request a login by April 15, 2016
Solvers and benchmarks submission deadline
May 1st, 2016
Solvers running May 2016
Solvers description must be provided by June 11, 2016
Results will be given during the SAT 2016 conference July 5-July 8, 2016

Call for solvers

We encourage the submission of any kind of pseudo-Boolean solver (complete or incomplete solvers, working on linear or non-linear constraints, etc.). There are a few simple requirements to ensure that a submitted solver will correctly operate in the evaluation environment. It is expected that any pseudo-Boolean solver can be easily modified to conform to these requirements. People interested in submitting a solver can contact the organizers to get some help.

All the details about the input format, the output of the solver and its running environment are available in this PDF file.

Sample code, parsers for a few languages and a few programming tips are also available.

Benchmarks to test your solvers (as well as the results of the competitions) are available from the previous competitions sites

Solver submitters implicitly accept that the results of their solver be publicly available on the evaluation web site.

Solver submitters are strongly encouraged to make their solver publicly available, either in source code or in executable format. However, this is not a requirement for entering the evaluation.

Solvers submitted by the organizers

Organizers may submit their solvers but must publish on April 1st, 2016 either a precise description of their solver, or the source code, or the binary of their solver, or a fingerprint of one of these.

Call for benchmarks

Benchmarks may be submitted in any reasonable format. The organizers will do their best to translate the submitted benchmarks to the input format adopted for the evaluation. A benchmark submitted in the format of the evaluation will still be normalized to ensure consistency among all the input files.

We would particularly appreciate the submission of:

Submitted benchmarks will be made available on the evaluation web site shortly after the beginning of the evaluation. We cannot accept benchmarks which are not publicly available (because anyone must be able to reproduce the experiments of the evaluation).

Benchmarks submitters should submit a description of their benchmarks set to be made available on the evaluation web site.

Benchmarks of the previous competitions can be downloaded from the previous competitions sites.

Organizer

Olivier ROUSSEL
CRIL, Université d'Artois, France
olivier.roussel at cril.univ-artois.fr / home page