Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.651953.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size64712
Compressed Size10192
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 64704
Compressed Size10163
Max. Term Depth14
Asserts 335
Declared Functions117
Declared Constants121
Declared Sorts 124
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false32 ite12 not80
or14 and51 =>359 =910
forall372 exists22 let102

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.12925 0.12098
CVC4 CVC4 f7118b2 default unsat ✅ 0.53805 0.52592
veriT veriT-smtcomp2014 default unsat ✅ 0.08321 0.07399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06929 0.06199
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.11818 0.11798
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.15604 0.15297
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.15460 0.15198
veriT veriT default unsat ✅ 0.11635 0.11498
Z3 z3 4.4.0 default unsat ✅ 0.08366 0.08399
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.19110 0.19148
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.41779 0.41988
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.47315 0.46137
veriT veriT-dev default unsat ✅ 0.04291 0.04338
Z3 z3-4.4.1 default unsat ✅ 0.08413 0.08534
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.19105 0.19087
Vampire vampire4.2-smt vampire unsat ✅ 0.36816 0.36686
veriT veriT-2017-06-17 default unsat ✅ 0.05937 0.05863
Z3 z3-4.5.0 default unsat ✅ 0.09201 0.09138
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.20784 0.20804
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.71305 2.70000
veriT veriT_default unsat ✅ 0.06096 0.06119
Z3 z3-4.7.1_default unsat ✅ 0.10013 0.10007
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.14646 0.14738
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.20949 0.20942
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.21241 0.21275
Par4 Par4-wrapped-sq_default unsat ✅ 0.07325 0.00766
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2410.38000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.41075 3.80622
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10586 3.60156
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.42791 3.85807
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.39439 5.03000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.74092 2.73000
veriT veriT-wrapped-sq_default unsat ✅ 0.06674 0.06710
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.10539 0.10536
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.24460 0.24490
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1.33388 3.31000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 908.55200 3162.94000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.09587 5.69939
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.35599 0.35511
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.35711 0.29408
veriT veriT_default unsat ✅ 0.04525 0.04562
Z3 z3-4.8.11_default unsat ✅ 0.10509 0.10504
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.21071 0.21074
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.23610 0.23664
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.71747 5.25000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 2.60848 7.98031
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.86682 4.96145
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.40229 0.40028
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.03000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.34371 0.24377
iProver iProver v3.9 unsat ✅ 3.35290 10.38544
SMTInterpol SMTInterpol unknown ❌ 636.69784 2351.12966
Yices2 Yices2 unknown ❌ 1201.33640 1200.79834
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.36528 0.25055
iProver iProver v3.9.3 unsat ✅ 1.88834 5.05970
SMTInterpol SMTInterpol unknown ❌ 519.33149 2007.52348
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.15883 4.76505
Yices2 Yices2 unsat ✅ 1022.86945 1022.50257