Pseudo-Boolean Competition 2011

The 2011 pseudo-Boolean competition is organized as a special event of the SAT 2011 conference. Like the previous evaluations and competitions(PB05, PB06, PB07, PB09, PB10), the goal is to assess the state of the art in the field of pseudo-Boolean solvers.

This edition of the competition will be very similar to the PB10 competition (no new problem introduced). We especially encourage the submission of new solvers and new instances.

For questions, comments and any other issue regarding the PB competition, please get in touch with pbeval@cril.univ-artois.fr.

Second round (canceled and replaced by PB12)

A second round of the competition was initially planned before the end of 2011, one reason being that we didn't plan to organize a competition in 2012. We believe now that it makes more sense to organize one last edition of the PB competition instead of this second round. Therefore, we invite you to submit solvers and benchmarks to the 2012 edition of the PB competition. This will be the last PB competition organized by Vasco and I. Anyone interested in organizing the competition after 2012 is invited to contact us.

Results of the first round

Deadlines

The timetable of the 2011 evaluation is detailed below.

Opening of registration site March 7, 2011
Submitters must request a login on the registration site by March 21, 2011
Solvers and benchmarks submission deadline
 April 3, 2011
Solvers running April 2011
Solvers description must be provided by May 22, 2011
Results will be given during the SAT 2011 conference June 19-June 22, 2011

Call for solvers

We encourage the submission of any kind of pseudo-Boolean solver (complete or incomplete solvers, working on linear or non-linear constraints, etc.). There are a few simple requirements to ensure that a submitted solver will correctly operate in the evaluation environment. It is expected that any pseudo-Boolean solver can be easily modified to conform to these requirements. People interested in submitting a solver can contact the organizers to get some help.

All the details about the input format, the output of the solver and its running environment are available in this PDF file.

Sample code, parsers for a few languages and a few programming tips are also available.

Benchmarks to test your solvers (as well as the results of the competitions) are available from the PB10 site

Solver submitters implicitly accept that the results of their solver be publicly available on the evaluation web site.
Solver submitters are strongly encouraged to make their solver publicly available, either in source code or in executable format. However, this is not a requirement for entering the evaluation.

Solvers submitted by the organizers

Organizers may submit their solvers but must publish on March 21, 2011 either a precise description of their solver, or the source code, or the binary of their solver, or a fingerprint of one of these.

Vasco Manquinho has submitted the following solvers

Call for benchmarks

Benchmarks may be submitted in any reasonable format. The organizers will do their best to translate the submitted benchmarks to the input format adopted for the evaluation. A benchmark submitted in the format of the evaluation will still be normalized to ensure consistency among all the input files.

We would particularly appreciate the submission of
Submitted benchmarks will be made available on the evaluation web site shortly after the beginning of the evaluation. We cannot accept benchmarks which are not publicly available (because anyone must be able to reproduce the experiments of the evaluation).

Benchmarks submitters may provide a description of their benchmarks set to be made available on the evaluation web site.

Benchmarks of the previous competitions can be downloaded from the PB10 site.

Organization

To reach the organizers, send an email to pbeval@cril.univ-artois.fr.
Vasco MANQUINHO
INESC-ID, Lisboa, Portugal
vmm at sat.inesc.pt / home page
 Olivier ROUSSEL
CRIL, Université d'Artois, France
olivier.roussel at cril.univ-artois.fr / home page