SAT 2011 Competition: main competition (phase 1): solvers results per benchmarks

Result page for benchmark
SAT-Race-2010-CNF/software-verification/
nec/hard-18-U-10652.cnf

Jump to solvers results

General information on the benchmark

NameSAT-Race-2010-CNF/software-verification/
nec/hard-18-U-10652.cnf
MD5SUMf0f11935e861485056485b47c5e1a7c3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3.08
Satisfiable
(Un)Satisfiability was proved
Number of variables1987351
Number of clauses5963534
Sum of the clauses size14253662
Maximum clause length1155
Minimum clause length1
Number of clauses of size 1109
Number of clauses of size 23971661
Number of clauses of size 31984242
Number of clauses of size 4766
Number of clauses of size 5765
Number of clauses of size over 55991

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerCPU timeWall clock time
Plingeling 587 [DEPRECATED] (complete)3293761UNSAT 3.08 27.872
glucose 2 (complete)3293772UNSAT 4.49132 4.4964
SApperloT 2011-03-23 (complete)3293776UNSAT 6.74297 6.74418
EBGlucose 1.0 (incomplete)3293773UNSAT 8.24675 8.25293
minisat hack: cir_minisat 2011-03-02 (complete)3348632UNSAT 8.34673 8.35022
minisat hack: minisat_psm 2011-04-01 (complete)3348932UNSAT 8.80866 8.80909
SAT09 reference solver:glucose 1.0 (complete)3309206UNSAT 8.86865 33.0223
rcl 2011-04-01 (complete)3293765UNSAT 10.4614 14.0695
minisat hack: LR_GL_SHR 2011-03-02 (complete)3349532UNSAT 18.8721 18.8758
RestartSAT A75 (complete)3293745UNSAT 18.9541 18.9539
SApperloT2010 2011-03-04 [DEPRECATED] (complete)3293774UNSAT 18.9561 19.0203
minisat hack: MiniSAT 2.2.0-agile-26 (complete)3318124UNSAT 18.9721 18.9744
claspmt 2.0-R4095-patched (fixed) (complete)3373480UNSAT 19.0581 6.68061
glueminisat 2.2.5 (complete)3293771UNSAT 19.0941 19.099
minisat hack: LR_GL_NOSHR 2011-03-02 (complete)3350132UNSAT 19.3761 19.3773
RestartSAT B95 (complete)3293744UNSAT 19.3911 19.3918
minisat hack: cir_minisat 2011-05-13 (simp) (complete)3380380UNSAT 19.517 19.6341
minisat hack: LR_NOGL_NOSHR 2011-03-02 (complete)3349832UNSAT 19.812 19.8136
SApperloT2010 2011-05-15 (fixed) (complete)3380080UNSAT 20.042 20.0461
minisat hack reference: minisat 2.2.0 (complete)3362629UNSAT 20.2389 20.239
minisat hack: contrasat 2011-03-02 (complete)3350432UNSAT 21.1858 21.1898
minisat hack: EBMiniSAT 2011-03-02 (incomplete)3349232UNSAT 22.2486 22.2498
clasp 2.0-R4092-indust (complete)3300159UNSAT 24.8962 24.8995
claspmt 2.0-R4095 [DEPRECATED] (complete)3299859UNSAT 25.0912 8.22886
PicoSAT 941 (complete)3293760UNSAT 26.376 26.3759
jMiniSat 2011 (complete)3293778UNSAT 30.7193 27.5259
CryptoMiniSat TechDemo-Alpha-st (complete)3293749UNSAT 31.8472 31.8792
MPhaseSAT64 2011-05-14 (fixed) (complete)3375880UNSAT 36.2705 36.271
MPhaseSAT 2011-02-15 (complete)3293733UNSAT 39.415 39.4159
MPhaseSAT_M 2011-02-16 (complete)3293735UNSAT 42.3946 42.3941
ppfolio seq (complete)3293769UNSAT 43.2414 44.0588
kw 2011-02-28 (complete)3293777UNSAT 47.8457 55.4959
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete)3293753UNSAT 49.3045 49.305
CryptoMiniSat Strange-Night2-st (fixed) (complete)3368380UNSAT 50.1124 50.1152
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete)3293751UNSAT 55.2836 55.2836
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete)3293734UNSAT 56.6704 56.6736
Plingeling 587f (fixed) (complete)3371380UNSAT 57.7812 22.1997
CryptoMiniSat Strange-Night-1-st (fixed) (complete)3370780UNSAT 57.8882 57.8871
QuteRSat 2011-05-12 (fixed) (complete)3377080UNSAT 72.491 72.5159
Sol 2011-04-04 (complete)3293764UNSAT 73.5028 69.6415
SArTagnan 2011-03-24 [DEPRECATED] (complete)3293775UNSAT 85.746 23.9584
QuteRSat 2011-03-01 [DEPRECATED] (complete)3293763UNSAT 94.2867 94.2846
UmSat 2011-05-12 (fixed) (complete)3379480UNSAT 95.4635 95.4693
Lingeling 587 [DEPRECATED] (complete)3293762UNSAT 102.386 102.398
Lingeling 587f (fixed) (complete)3371980UNSAT 103.213 103.263
ppfolio par (complete)3293768UNSAT 111.047 27.8341
synit_sat 2011-03-03 (complete)3293740UNSAT 123.142 123.14
Satisfiability Solver Selector 2011-03-18 (complete)3293770UNSAT 162.44 162.516
CryptoMiniSat TechDemo-Alpha-mt (complete)3293748UNSAT 164.082 53.9152
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete)3293767UNSAT 164.161 163.762
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete)3449895UNSAT 166.72 166.997
CryptoMiniSat Strange-Night-1-mt (fixed) (complete)3369580UNSAT 190.493 49.0306
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)3367180UNSAT 192.152 49.5962
SAT09 reference solver:precosat 236 (complete)3309205UNSAT 202.969 202.967
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete)3293752UNSAT 209.776 54.0713
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete)3293750UNSAT 210.811 54.5028
SArTagnan 2011-05-15 (fixed) (complete)3386324UNSAT 470.142 159.654
riss Auto (complete)3293756? (exit code) 6.89795 6.89888
riss Auto (1200 s timeout) (complete)3473126? (exit code) 6.99494 6.9959
priss UP (complete)3293757? (exit code) 7.04193 7.04323
riss Exp (complete)3293755? (exit code) 7.07792 9.12561
riss 1.0 (complete)3293754? (exit code) 7.13891 7.18412
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)3362437? (exit code) 21.0428 11.0929
SAT09 reference solver:LySAT i/2009-03-20 (complete)3309207? (exit code) 27.3298 27.3304
priss Auto (complete)3293758? (exit code) 30.6173 21.1785
priss 1.0 (complete)3293759? (exit code) 30.8143 16.9699
march_rw 2011-03-02 (complete)3293736? (MO) 49.2585 49.2569
borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout) (complete)3484701? (TO) 1200.08 1209.35
borg-sat 11.03.02-industrial [DEPRECATED] (complete)3317824? (TO) 1299.83 1300.06
borg-sat 11.03.02-par-industrial (fixed) (complete)3378880? (TO) 1299.83 1300.06
borg-sat 11.03.02-seq-industrial (fixed) (complete)3377980? (TO) 1299.91 1300.07
sathys 2011-04-01 (complete)3293766? (TO) 1300.02 1300.01
shortsattime2011 2011-03-02 (incomplete)3293739? (TO) 1300.07 1300.05
Black Hole SAT 2011-03-08 (complete)3293747? (TO) 1300.08 1300.05
sattime+ 2011-03-02 (incomplete)3293743? (TO) 1300.08 1300.05
adaptg2wsat2011 2011-03-02 (incomplete)3293741? (TO) 1300.08 1300.05
sattime2011 2011-03-02 (incomplete)3293737? (TO) 1300.08 1300.04
shortsattime+ 2011-03-02 (incomplete)3293742? (TO) 1300.08 1300.05
sattime 2011-03-02 (incomplete)3293738? (TO) 1300.1 1300.05
STRUCTure 0.1 (hbr=2) (complete)3312204? (TO) 1675.42 1300.23
STRUCTure 0.1 (complete)3313404? (TO) 1707.34 1300.26
UmSat 2011-02-25 [DEPRECATED] (complete)3293746Signal 26.192 26.1962

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

Solution found: