Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.1185611.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size13628
Compressed Size2539
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 13620
Compressed Size2538
Max. Term Depth13
Asserts 79
Declared Functions24
Declared Constants32
Declared Sorts 29
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false14 ite2 not20
or5 and13 =>55 =196
forall92 exists4 let18

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 1.21330 1.20582
CVC4 CVC4 f7118b2 default unsat ✅ 0.92468 0.91386
veriT veriT-smtcomp2014 default unsat ✅ 0.02854 0.01700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.04000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.01000 2402.50000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.53536 0.53292
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.53220 0.52992
veriT veriT default unsat ✅ 0.01941 0.01900
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.78000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 5.53137 5.53433
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.09595 0.09640
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.13838 0.13184
veriT veriT-dev default unsat ✅ 0.01724 0.01777
Z3 z3-4.4.1 default unknown ❌ 2400.01000 2401.41000
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.13176 0.13165
Vampire vampire4.2-smt vampire unsat ✅ 0.07540 0.07119
veriT veriT-2017-06-17 default unsat ✅ 6.02309 6.02227
Z3 z3-4.5.0 default unsat ✅ 0.11753 0.11641
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.14364 0.14380
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.16057 0.07952
veriT veriT_default unsat ✅ 6.02736 6.02714
Z3 z3-4.7.1_default unsat ✅ 0.08963 0.08952
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.15058 0.15096
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 0.77079 1.35155
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 709.27500 2395.61000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.90932 9.40759
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.14845 0.14896
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13952 0.13716
veriT veriT_default unsat ✅ 0.88608 0.88636
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.92000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.16795 0.16828
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.16440 0.16480
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.90930 4.87955
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.14755 0.14750
veriT veriT_default unsat ✅ 2.03619 2.03671
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.83000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.32985 0.23041
iProver iProver v3.9 unsat ✅ 0.98372 2.23227
SMTInterpol SMTInterpol unknown ❌ 1202.71716 4526.64280
Yices2 Yices2 unknown ❌ 1201.33159 1201.01813
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.34105 0.22624
iProver iProver v3.9.3 unsat ✅ 0.89560 1.97830
SMTInterpol SMTInterpol unknown ❌ 730.84189 2792.76575
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.98887 4.27218
Yices2 Yices2 unknown ❌ 1201.40340 1201.16220