Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.780666.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size24372
Compressed Size3666
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 24364
Compressed Size3679
Max. Term Depth13
Asserts 135
Declared Functions46
Declared Constants44
Declared Sorts 53
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false30 not6 or8 and12
=>110 =311 forall155 exists8
let63

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1412.24000 1412.04000
CVC4 CVC4 f7118b2 default unsat ✅ 0.71722 0.70589
veriT veriT-smtcomp2014 default unknown ❌ 1780.64000 1781.33000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.07000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 875.42000 873.53700
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.43773 0.43493
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.43338 0.43093
veriT veriT default unknown ❌ 2400.01000 2400.83000
Z3 z3 4.4.0 default unknown ❌ 169.80900 169.82800
SMT-COMP 2016 0.83 (1/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.29425 0.29451
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.14100 995.81200
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 999.66600 3611.57000
veriT veriT-dev default unknown ❌ 2400.05000 2401.41000
Z3 z3-4.4.1 default unknown ❌ 385.53900 385.73700
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.61256 0.25967
Vampire vampire4.2-smt vampire unknown ❌ 600.07200 2305.88000
veriT veriT-2017-06-17 default unsat ✅ 6.29594 6.29463
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.79000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.22756 0.22780
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 612.01800 2431.49000
veriT veriT_default unsat ✅ 6.19377 6.19372
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.73000
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.08000 9517.01000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.22334 0.22366
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.22864 0.22894
Par4 Par4-wrapped-sq_default unsat ✅ 0.25892 0.00660
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.09000 2406.41000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38557 3.42495
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.01080 3.34332
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38213 3.39802
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2399.93000 9600.21000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 600.29100 2381.71000
veriT veriT-wrapped-sq_default unsat ✅ 6.16280 6.16297
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2399.95000
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unsat ✅ 0.26469 0.26501
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.06000 4746.56000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 4285.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.88031 4.68892
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.04000 4659.34000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.11000 4650.08000
veriT veriT_default unsat ✅ 13.59100 13.59250
Z3 z3-4.8.11_default unknown ❌ 1027.65000 1027.41000
SMT-COMP 2023 0.83 (1/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.23901 0.23957
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.20135 0.20193
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.10000 4354.19000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.11000 4114.48000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.02572 4.87391
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.02000 4768.53000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.10000 1200.06000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.35542 0.25596
iProver iProver v3.9 unknown ❌ 1201.74671 4764.85635
SMTInterpol SMTInterpol unknown ❌ 1202.71829 4444.15275
Yices2 Yices2 unknown ❌ 1201.33357 1200.84528
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 0.69754 0.57137
iProver iProver v3.9.3 unknown ❌ 1201.75646 4782.49711
SMTInterpol SMTInterpol unknown ❌ 219.08647 784.31164
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.97372 4.27142
Yices2 Yices2 unknown ❌ 1201.29877 1200.96957