Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.828081.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size23886
Compressed Size4241
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 23878
Compressed Size4239
Max. Term Depth16
Asserts 133
Declared Functions28
Declared Constants32
Declared Sorts 34
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false30 ite3 not38
or6 and23 =>195 =418
forall162 exists12 let37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 21.53440 21.52370
CVC4 CVC4 f7118b2 default unsat ✅ 97.07590 95.05550
veriT veriT-smtcomp2014 default unknown ❌ 41.87060 41.87860
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.61000 2400.08000
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 20.66180 20.65190
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.97882 0.97685
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.97670 0.97385
veriT veriT default unknown ❌ 1442.31000 1442.80000
Z3 z3 4.4.0 default unsat ✅ 230.01500 230.07400
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.24189 0.24224
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.09000 996.19800
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1002.11000 3612.07000
veriT veriT-dev default unsat ✅ 21.68860 21.69250
Z3 z3-4.4.1 default unknown ❌ 2400.10000 2401.43000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.21324 0.21196
Vampire vampire4.2-smt vampire unknown ❌ 600.04700 2307.11000
veriT veriT-2017-06-17 default unsat ✅ 18.11590 18.11470
Z3 z3-4.5.0 default unknown ❌ 600.03100 599.92000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24105 0.24120
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 949.54000 3777.45000
veriT veriT_default unsat ✅ 18.10220 18.10340
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.98000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 207.56200 823.97000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.23103 0.23133
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.22694 0.22721
Par4 Par4-wrapped-sq_default unsat ✅ 0.24384 0.00688
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2422.66000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.24398 3.36323
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.06929 3.31551
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.29632 3.39314
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2340.70000 9301.14000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 941.96600 3742.57000
veriT veriT-wrapped-sq_default unsat ✅ 18.11950 18.12010
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2053.88000 2053.73000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.37999 0.28023
iProver iProver v3.9 unsat ✅ 28.47616 104.39512
SMTInterpol SMTInterpol unknown ❌ 1202.74079 1276.34130
Yices2 Yices2 unknown ❌ 1201.26092 1201.03487