Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.801226.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size4147
Compressed Size953
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 4139
Compressed Size959
Max. Term Depth9
Asserts 32
Declared Functions8
Declared Constants6
Declared Sorts 6
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false5 not5 or1 and2
=>45 =83 forall32 exists1
let3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.14059 0.13998
CVC4 CVC4 f7118b2 default sat ✅ 40.31050 40.30890
veriT veriT-smtcomp2014 default unknown ❌ 30.57650 30.58030
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.02000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.10896 0.10798
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.08410 20.08490
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.08260 20.08690
veriT veriT default unknown ❌ 512.97100 512.99200
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.60000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 306.45400 301.37000
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.71494 9.75897
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.05078 0.05069
veriT veriT-dev default unknown ❌ 2400.02000 2401.39000
Z3 z3-4.4.1 default unknown ❌ 2400.12000 2401.44000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.89400 450.50800
Vampire vampire4.2-smt vampire sat ✅ 0.04675 0.04696
veriT veriT-2017-06-17 default unknown ❌ 600.02300 599.89000
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.94700
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 480.57000 480.50100
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.14162 0.07786
veriT veriT_default unknown ❌ 1200.11000 1199.96000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.97000
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.04000 3351.48000
CVC4 CVC4-sq-final_default sat ✅ 480.74600 480.58700
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 961.27700 960.79400
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 1205.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.24325 3.32708
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.05456 0.05497
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.13989 0.07663
veriT veriT_default unknown ❌ 1200.08000 1199.78000
veriT+vite_default unknown ❌ 1200.01000 1199.84000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.92000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 482.60600 480.61300
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 510.96900 510.57800
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.94294 4.68197
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.10394 0.06660
veriT veriT_default unknown ❌ 1200.02000 1199.92000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.78000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.48121 540.14423
iProver iProver v3.9 sat ✅ 1.34105 3.89994
SMTInterpol SMTInterpol unknown ❌ 1201.71346 1242.89106
Yices2 Yices2 unknown ❌ 1201.34443 1201.17292
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.40641 540.22004
iProver iProver v3.9.3 sat ✅ 1.39279 4.03687
SMTInterpol SMTInterpol unknown ❌ 1201.38147 1260.52323
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89340 3.99133
Yices2 Yices2 unknown ❌ 1201.46387 1201.19436