Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.686109.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size3204
Compressed Size904
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 3196
Compressed Size909
Max. Term Depth12
Asserts 11
Declared Functions11
Declared Constants10
Declared Sorts 16
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 and2 =>16 =31
forall13 let4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 18.58600 18.58020
CVC4 CVC4 f7118b2 default sat ✅ 40.74330 40.73680
veriT veriT-smtcomp2014 default unknown ❌ 373.08600 373.16000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.07000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2.63483 2.63560
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.10690 20.10990
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.10770 20.11090
veriT veriT default unknown ❌ 798.17300 798.34900
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2401.00000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 311.63100 301.99200
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.74873 9.79779
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.09063 0.09008
veriT veriT-dev default unknown ❌ 675.56700 675.88500
Z3 z3-4.4.1 default unknown ❌ 2400.11000 2401.48000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.77200 450.44600
Vampire vampire4.2-smt vampire sat ✅ 0.12872 0.16217
veriT veriT-2017-06-17 default unknown ❌ 600.02300 599.90000
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.94300
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 480.57900 480.33100
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.13948 0.12993
veriT veriT_default unknown ❌ 1200.03000 1199.99000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 7.57627 26.97020
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 961.01700 960.56500
master-2018-06-10-b19c840-competition-default_default sat ✅ 483.19400 480.78100
Par4 Par4-wrapped-sq_default sat ✅ 482.71700 1445.79000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2420.51000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.27373 3.37065
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.20669 3.36480
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.22657 3.31874
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.53492 0.53441
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.24863 0.12715
veriT veriT-wrapped-sq_default unknown ❌ 1471.31000 1471.23000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.09074 0.09069
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 4.52227 13.96780
CVC4 CVC4-sq-final_default sat ✅ 480.56000 480.46100
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 960.93100 960.53500
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 1206.86000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.33602 3.39905
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.19733 0.10858
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.26017 0.27131
veriT veriT_default unknown ❌ 1200.05000 1199.77000
veriT+vite_default unknown ❌ 1200.10000 1200.01000
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.88000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default sat ✅ 481.65300 480.60900
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 2.27114 7.47029
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1427.38000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.98739 5.15006
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.13522 0.12601
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.19522 0.10680
veriT veriT_default unknown ❌ 536.58000 536.54600
Z3 z3-4.8.11_default sat ✅ 6.20082 6.20040
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 480.85100 480.38600
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 511.55400 510.65400
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.89822 4.61493
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.23133 0.12927
veriT veriT_default unknown ❌ 467.84700 467.81400
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.83000
Z3 z3-4.8.17_default unknown ❌ 1200.10000 1199.88000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.35755 540.18423
iProver iProver v3.9.3 sat ✅ 12.44894 44.22827
SMTInterpol SMTInterpol unknown ❌ 1201.89284 1621.96190
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93006 3.89227
Yices2 Yices2 unknown ❌ 1201.27476 1201.01202