Pseudo-Boolean Competition 2011
The 2011 pseudo-Boolean competition is organized as a special
event of the SAT
Like the previous evaluations and competitions(PB05,
PB07, PB09, PB10), the goal is to
assess the state of the art in the field of pseudo-Boolean solvers.
This edition of the competition will be very similar to the PB10
competition (no new problem introduced). We especially encourage the submission
of new solvers and new instances.
For questions, comments and any other issue regarding the PB
competition, please get in touch with firstname.lastname@example.org.
Second round (canceled and replaced by PB12)
A second round of the competition was initially planned before the end
of 2011, one reason being that we didn't plan to organize a
competition in 2012. We believe now that it makes more sense to
organize one last edition of the PB competition instead of this second
Therefore, we invite you to submit solvers and benchmarks to the 2012 edition of the PB
competition. This will be the last PB competition organized by
Vasco and I. Anyone interested in organizing the competition after
2012 is invited to contact us.
Results of the first round
The timetable of the 2011 evaluation is detailed below.
||March 7, 2011
request a login on the registration
||March 21, 2011
benchmarks submission deadline
|April 3, 2011
| Solvers description
must be provided by
||May 22, 2011
| Results will be
given during the SAT 2011
||June 19-June 22, 2011
Call for solvers
We encourage the submission of any kind of pseudo-Boolean solver
(complete or incomplete solvers, working on linear or non-linear
constraints, etc.). There are a few simple requirements to ensure
that a submitted solver will correctly operate in the evaluation
environment. It is expected that any pseudo-Boolean solver can be
easily modified to conform to these requirements. People interested in
submitting a solver can contact the organizers to get some help.
All the details about the input format, the
output of the solver and its running environment are available in this PDF file.
Sample code, parsers for a few languages and a
few programming tips are also available.
Benchmarks to test your solvers (as well as the results of the
competitions) are available from
the PB10 site
Solver submitters implicitly accept that the results of their solver be
publicly available on the evaluation web site.
Solver submitters are strongly encouraged to make their solver publicly
available, either in source code or in executable format. However, this
is not a requirement for entering the evaluation.
Solvers submitted by the organizers
Organizers may submit their solvers but must publish on March 21, 2011
either a precise description of their solver, or the source code,
or the binary of their solver, or a fingerprint of one of these.
Vasco Manquinho has submitted the following solvers
- bsolo.gz (md5sum add4d3fac285fd09cabf41a8242cc00e)
- pwbo1.1 (md5sum 6e7b1712679c192b3062a97719103c26)
- wbo1.6 (md5sum 369b0b7e6d78801f2943e2a70c54ecc0)
Call for benchmarks
Benchmarks may be submitted in any reasonable format. The organizers
will do their best to translate the submitted benchmarks to the input
format adopted for the evaluation. A benchmark submitted in the format
of the evaluation will still be normalized to ensure consistency among
all the input files.
We would particularly appreciate the submission of
Submitted benchmarks will be made available on the evaluation web site
shortly after the beginning of the evaluation. We cannot accept
benchmarks which are not publicly available (because anyone must be
able to reproduce the experiments of the evaluation).
- industrial benchmarks
- benchmarks generators (written in any reasonable language)
- benchmarks set with a wide distribution of their number of
clauses, cardinality constraints and pseudo-Boolean constraints
- benchmarks with non-linear constraints
Benchmarks submitters may provide a description of their benchmarks set
to be made available on the evaluation web site.
of the previous competitions can be downloaded from the PB10 site.
To reach the organizers, send an email to email@example.com.
INESC-ID, Lisboa, Portugal
vmm at sat.inesc.pt / home page
CRIL, Université d'Artois, France
cril.univ-artois.fr / home page