SAT 2011 Competition: main competition (phase 1): solvers results per benchmarks

Result page for benchmark
SAT-Race-2010-CNF/software-verification/
nec/hard-25-U-7061.cnf

Jump to solvers results

General information on the benchmark

NameSAT-Race-2010-CNF/software-verification/
nec/hard-25-U-7061.cnf
MD5SUM23c04ef615431bf15ef9eafe9b944fb8
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.571912
Satisfiable
(Un)Satisfiability was proved
Number of variables541150
Number of clauses1645836
Sum of the clauses size4001876
Maximum clause length1576
Minimum clause length1
Number of clauses of size 1141
Number of clauses of size 21092306
Number of clauses of size 3543262
Number of clauses of size 44256
Number of clauses of size 51339
Number of clauses of size over 54532

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerCPU timeWall clock time
minisat hack: cir_minisat 2011-03-02 (complete)3348478UNSAT 0.571912 0.573623
SApperloT 2011-03-23 (complete)3293868UNSAT 0.71389 0.720152
SArTagnan 2011-05-15 (fixed) (complete)3386170UNSAT 1.24881 1.07455
SArTagnan 2011-03-24 [DEPRECATED] (complete)3293867UNSAT 1.68274 1.08395
Lingeling 587f (fixed) (complete)3371826UNSAT 1.83972 1.84039
Lingeling 587 [DEPRECATED] (complete)3293854UNSAT 1.87471 1.87471
minisat hack reference: minisat 2.2.0 (complete)3362475UNSAT 2.98554 3.00532
minisat hack: MiniSAT 2.2.0-agile-26 (complete)3317970UNSAT 3.03554 3.05194
glueminisat 2.2.5 (complete)3293863UNSAT 3.08353 3.08598
RestartSAT A75 (complete)3293837UNSAT 3.09753 3.09726
RestartSAT B95 (complete)3293836UNSAT 3.10253 3.10397
minisat hack: LR_GL_SHR 2011-03-02 (complete)3349378UNSAT 3.19951 3.23716
minisat hack: cir_minisat 2011-05-13 (simp) (complete)3380226UNSAT 3.20751 3.21602
minisat hack: LR_NOGL_NOSHR 2011-03-02 (complete)3349678UNSAT 3.2755 3.31539
jMiniSat 2011 (complete)3293870UNSAT 3.3035 2.21851
minisat hack: LR_GL_NOSHR 2011-03-02 (complete)3349978UNSAT 3.32649 3.3268
minisat hack: EBMiniSAT 2011-03-02 (incomplete)3349078UNSAT 3.33549 3.33626
claspmt 2.0-R4095 [DEPRECATED] (complete)3299705UNSAT 3.54146 3.54231
claspmt 2.0-R4095-patched (fixed) (complete)3373326UNSAT 3.57446 3.59858
clasp 2.0-R4092-indust (complete)3300005UNSAT 3.66544 3.6864
kw 2011-02-28 (complete)3293869UNSAT 3.9494 3.95279
PicoSAT 941 (complete)3293852UNSAT 4.38233 4.38376
MPhaseSAT64 2011-05-14 (fixed) (complete)3375726UNSAT 4.76927 4.81731
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete)3293826UNSAT 5.52216 5.52271
MPhaseSAT 2011-02-15 (complete)3293825UNSAT 5.8981 5.95437
SAT09 reference solver:precosat 236 (complete)3309211UNSAT 6.08108 6.09107
MPhaseSAT_M 2011-02-16 (complete)3293827UNSAT 6.19306 6.19266
CryptoMiniSat TechDemo-Alpha-st (complete)3293841UNSAT 6.25005 6.26158
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete)3293845UNSAT 6.50901 6.51496
CryptoMiniSat Strange-Night-1-st (fixed) (complete)3370626UNSAT 7.13891 7.19061
ppfolio seq (complete)3293861UNSAT 7.50386 7.50488
Plingeling 587 [DEPRECATED] (complete)3293853UNSAT 7.91779 3.81631
Plingeling 587f (fixed) (complete)3371226UNSAT 7.94079 3.81487
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete)3293843UNSAT 10.3434 10.3892
CryptoMiniSat Strange-Night2-st (fixed) (complete)3368226UNSAT 10.7754 10.778
glucose 2 (complete)3293864UNSAT 11.3613 12.4115
minisat hack: minisat_psm 2011-04-01 (complete)3348778UNSAT 11.4403 11.5236
sathys 2011-04-01 (complete)3293858UNSAT 11.4543 11.455
EBGlucose 1.0 (incomplete)3293865UNSAT 11.5402 11.5888
rcl 2011-04-01 (complete)3293857UNSAT 11.6172 11.9075
SAT09 reference solver:glucose 1.0 (complete)3309212UNSAT 11.7572 11.759
SApperloT2010 2011-03-04 [DEPRECATED] (complete)3293866UNSAT 11.7942 11.7952
UmSat 2011-05-12 (fixed) (complete)3379326UNSAT 12.1841 12.1851
SApperloT2010 2011-05-15 (fixed) (complete)3379926UNSAT 12.4151 12.4162
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)3362441UNSAT 12.817 12.8177
SAT09 reference solver:LySAT i/2009-03-20 (complete)3309213UNSAT 13.6749 13.6812
ppfolio par (complete)3293860UNSAT 16.8364 4.22413
priss UP (complete)3293849UNSAT 20.3639 20.3635
riss 1.0 (complete)3293846UNSAT 21.5157 21.5334
riss Auto (1200 s timeout) (complete)3473128UNSAT 21.8507 21.8513
riss Exp (complete)3293847UNSAT 22.3496 22.3559
riss Auto (complete)3293848UNSAT 23.3494 23.3789
Sol 2011-04-04 (complete)3293856UNSAT 28.8826 27.9528
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete)3293844UNSAT 29.5865 7.47652
CryptoMiniSat Strange-Night-1-mt (fixed) (complete)3369426UNSAT 29.6635 7.49373
CryptoMiniSat TechDemo-Alpha-mt (complete)3293840UNSAT 30.1284 10.562
QuteRSat 2011-03-01 [DEPRECATED] (complete)3293855UNSAT 32.2291 32.2301
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete)3293859UNSAT 32.3181 31.6645
QuteRSat 2011-05-12 (fixed) (complete)3376926UNSAT 33.3449 33.3467
synit_sat 2011-03-03 (complete)3293832UNSAT 34.7137 34.7165
STRUCTure 0.1 (hbr=2) (complete)3312050UNSAT 38.6131 36.5302
STRUCTure 0.1 (complete)3313250UNSAT 38.8141 36.756
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)3367026UNSAT 42.9515 10.8154
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete)3293842UNSAT 44.7412 11.2639
priss 1.0 (complete)3293851UNSAT 86.8538 23.5466
priss Auto (complete)3293850UNSAT 86.9998 22.6636
Satisfiability Solver Selector 2011-03-18 (complete)3293862UNSAT 94.73 94.8469
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete)3449897UNSAT 110.13 110.344
borg-sat 11.03.02-seq-industrial (fixed) (complete)3377826UNSAT 396.148 396.46
borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout) (complete)3484703UNSAT 400.122 400.382
borg-sat 11.03.02-industrial [DEPRECATED] (complete)3317670UNSAT 423.269 396.088
borg-sat 11.03.02-par-industrial (fixed) (complete)3378726UNSAT 454.37 421.099
sattime+ 2011-03-02 (incomplete)3293835UNSAT 1008.81 1008.84
shortsattime+ 2011-03-02 (incomplete)3293834UNSAT 1015.68 1015.72
adaptg2wsat2011 2011-03-02 (incomplete)3293833? (problem) 903.553 903.528
sattime2011 2011-03-02 (incomplete)3293829? (problem) 908.739 908.711
shortsattime2011 2011-03-02 (incomplete)3293831? (problem) 957.26 957.24
sattime 2011-03-02 (incomplete)3293830? (problem) 1009.74 1009.74
minisat hack: contrasat 2011-03-02 (complete)3350278? (exit code) 3.37349 3.37437
Black Hole SAT 2011-03-08 (complete)3293839? (TO) 1300.05 1300.03
march_rw 2011-03-02 (complete)3293828? (TO) 1300.09 1300.05
UmSat 2011-02-25 [DEPRECATED] (complete)3293838Signal 7.2069 7.20731

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

Solution found: