Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.813324.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size91125
Compressed Size14860
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 91117
Compressed Size14883
Max. Term Depth15
Asserts 477
Declared Functions206
Declared Constants172
Declared Sorts 222
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false88 ite9 not51 or30
and182 =>281 =1192 forall515
exists71 let131

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.14502 0.13598
CVC4 CVC4 f7118b2 default unsat ✅ 0.18340 0.17297
veriT veriT-smtcomp2014 default unsat ✅ 0.06986 0.06099
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09418 0.08599
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.14686 0.14598
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19950 0.19597
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19651 0.19397
veriT veriT default unsat ✅ 0.08509 0.08399
Z3 z3 4.4.0 default unsat ✅ 0.10579 0.10598
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.22926 0.22958
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 4.86116 4.88493
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.80394 10.96000
veriT veriT-dev default unsat ✅ 0.04973 0.04995
Z3 z3-4.4.1 default unsat ✅ 0.11255 0.11426
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.23504 0.23522
Vampire vampire4.2-smt vampire unsat ✅ 7.85319 31.11000
veriT veriT-2017-06-17 default unsat ✅ 0.08074 0.08092
Z3 z3-4.5.0 default unsat ✅ 0.11651 0.11600
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.25682 0.25698
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 17.40470 69.11000
veriT veriT_default unsat ✅ 0.08481 0.08505
Z3 z3-4.7.1_default unsat ✅ 0.11743 0.11765
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.17248 0.17224
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26133 0.26168
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26388 0.26418
Par4 Par4-wrapped-sq_default unsat ✅ 0.10468 0.00835
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2421.45000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.52821 3.88959
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.31081 3.64323
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.52455 3.89974
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 29.95290 118.12700
vampire-4.3-smt_vampire_smtcomp unsat ✅ 23.04720 91.22000
veriT veriT-wrapped-sq_default unsat ✅ 0.09409 0.09430
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12471 0.12470
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.19782 0.19376
CVC4 CVC4-sq-final_default unsat ✅ 0.30235 0.30235
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26167 0.26199
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1225.37000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.56414 4.03910
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 10.47610 40.61000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 22.22110 88.04000
veriT veriT_default unsat ✅ 0.06282 0.06315
veriT+vite_default unsat ✅ 0.06192 0.06225
Z3 z3-4.8.8_default unsat ✅ 0.13128 0.13121
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.30588 0.30619
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.30298 0.30285
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.98275 5.09618
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 12.42040 49.12000
veriT veriT_default unsat ✅ 0.05928 0.05961
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.84000
Z3 z3-4.8.17_default unsat ✅ 0.12617 0.12780
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.35302 0.25331
iProver iProver v3.9 unsat ✅ 17.42526 63.24368
SMTInterpol SMTInterpol unknown ❌ 922.66255 3203.68820
Yices2 Yices2 unknown ❌ 1201.36167 1200.70123
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.43171 0.30565
iProver iProver v3.9.3 unsat ✅ 24.93166 91.09515
SMTInterpol SMTInterpol unsat ✅ 4.39712 10.18255
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.04959 4.51369
Yices2 Yices2 unknown ❌ 1201.57294 1201.17822