Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.988404.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size73042
Compressed Size11199
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 73034
Compressed Size11172
Max. Term Depth15
Asserts 489
Declared Functions158
Declared Constants32
Declared Sorts 77
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false46 ite24 not84
or19 and35 =>556 =1315
forall513 exists19 let144

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 56.76210 56.75840
CVC4 CVC4 f7118b2 default unsat ✅ 108.09200 108.10100
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.09000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.71000 2400.09000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 20.21710 20.22490
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 8.86283 8.86365
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 8.82336 8.82266
veriT veriT default unknown ❌ 2400.01000 2400.87000
Z3 z3 4.4.0 default unknown ❌ 2400.02000 2392.70000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.52230 4.52510
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.05600 1036.27000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1001.76000 3608.15000
veriT veriT-dev default unsat ✅ 21.27470 21.28650
Z3 z3-4.4.1 default unknown ❌ 1836.63000 1837.37000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.50604 4.50492
Vampire vampire4.2-smt vampire unsat ✅ 196.73100 779.92000
veriT veriT-2017-06-17 default unsat ✅ 5.14590 5.14604
Z3 z3-4.5.0 default unknown ❌ 600.01500 599.85000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.93902 4.93883
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.09000 4765.56000
veriT veriT_default unsat ✅ 0.31962 0.31990
Z3 z3-4.7.1_default unknown ❌ 1200.03000 1199.83000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9526.92000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.00284 4.00319
master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.29525 4.29495
Par4 Par4-wrapped-sq_default unsat ✅ 0.35921 0.00617
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2402.95000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38438 3.63438
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.12563 3.29738
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41238 3.67401
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.06000 9533.21000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.09000 9540.15000
veriT veriT-wrapped-sq_default unsat ✅ 0.34014 0.33954
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1713.30000 1712.87000
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.07000 4768.62000
CVC4 CVC4-sq-final_default unsat ✅ 3.51195 3.51220
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.37394 3.37415
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1233.35000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.45442 3.88657
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 997.93600 3854.32000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.10000 4767.57000
veriT veriT_default unsat ✅ 2.38264 2.38295
veriT+vite_default unsat ✅ 4.92896 4.92879
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.70000
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unsat ✅ 5.13526 5.13469
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.06000 4754.61000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.08000 3984.81000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 4.06048 5.19721
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.06000 4645.90000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.04000 4657.08000
veriT veriT_default unsat ✅ 4.86576 4.86653
Z3 z3-4.8.11_default unknown ❌ 1200.04000 1199.71000
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 2.65577 2.52526
iProver iProver v3.9.3 unknown ❌ 1201.79669 4782.05398
SMTInterpol SMTInterpol unknown ❌ 1021.33219 3275.41894
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01280 4.18256
Yices2 Yices2 unknown ❌ 1201.58544 1201.23601