Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.914447.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size5271
Compressed Size1149
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 5263
Compressed Size1161
Max. Term Depth14
Asserts 33
Declared Functions7
Declared Constants10
Declared Sorts 9
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false11 not20 and4 =>38
=71 forall32 exists2 let3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 1035.44000 1035.35000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.51000 2400.01000
veriT veriT-smtcomp2014 default unsat ✅ 0.02804 0.01900
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.05146 0.04399
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 644.09100 644.00200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 40.14800 40.15990
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 40.14550 40.15490
veriT veriT default unsat ✅ 0.01844 0.01700
Z3 z3 4.4.0 default unsat ✅ 0.06135 0.06099
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.55167 2.55337
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.03890 0.03949
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.05041 0.04170
veriT veriT-dev default unsat ✅ 0.01906 0.01942
Z3 z3-4.4.1 default unsat ✅ 0.35603 0.35743
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.08380 20.08010
Vampire vampire4.2-smt vampire unsat ✅ 0.04371 0.04261
veriT veriT-2017-06-17 default unsat ✅ 6.02550 6.02497
Z3 z3-4.5.0 default unsat ✅ 0.07161 0.07092
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.09150 30.09180
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.04555 0.04547
veriT veriT_default unsat ✅ 6.02588 6.02564
Z3 z3-4.7.1_default unsat ✅ 0.07910 0.07903
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.04620 0.04530
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.29940 60.13540
master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.11970 30.09920
Par4 Par4-wrapped-sq_default unsat ✅ 0.09427 0.00583
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2434.85000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.22025 3.35671
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.03638 3.22945
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.21804 3.36119
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.07461 0.07454
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.04948 0.04938
veriT veriT-wrapped-sq_default unsat ✅ 6.03864 6.03858
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.67353 0.67345
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.04320 0.04337
CVC4 CVC4-sq-final_default unsat ✅ 30.13310 30.11480
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.12560 60.12160
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1229.98000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.28641 3.31975
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.04893 0.04642
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.04983 0.04969
veriT veriT_default unsat ✅ 0.01969 0.02004
veriT+vite_default unsat ✅ 0.01932 0.01965
Z3 z3-4.8.8_default unsat ✅ 0.09915 0.09910
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 30.08840 30.08460
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 0.76546 0.41282
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 1241.11000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.83487 4.70156
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.05955 0.05873
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.04837 0.04823
veriT veriT_default unsat ✅ 0.04656 0.04693
Z3 z3-4.8.11_default unsat ✅ 0.44687 0.44679
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 30.13980 30.10060
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.11815 0.11870
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.64803 0.52624
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 1258.11000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.57599 4.79635
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.05701 0.05698
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06493 0.06491
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 30.24439 30.14351
iProver iProver v3.9 unsat ✅ 0.84019 0.63962
SMTInterpol SMTInterpol unknown ❌ 1201.71322 1243.49076
Yices2 Yices2 unsat ✅ 0.79229 0.69251
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 30.31415 30.19220
iProver iProver v3.9.3 unsat ✅ 0.89367 0.61843
SMTInterpol SMTInterpol unknown ❌ 1201.79500 1439.49789
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.95550 4.14133
Yices2 Yices2 unsat ✅ 1.10995 0.97944