Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.981279.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size73033
Compressed Size11146
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 73025
Compressed Size11197
Max. Term Depth15
Asserts 489
Declared Functions158
Declared Constants32
Declared Sorts 77
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false46 ite24 not84
or19 and35 =>556 =1315
forall513 exists19 let144

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 1.00 (0/4) CVC3 CVC3 default unknown ❌ 2401.87000 2402.17000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.81000 2400.05000
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.01000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2404.95000 2405.30000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1339.44000 1339.49000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1373.57000 1373.69000
veriT veriT default unknown ❌ 2400.01000 2400.73000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2399.00000
SMT-COMP 2016 0.83 (1/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 107.05800 101.12900
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.02600 996.34200
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 998.05500 3605.46000
veriT veriT-dev default unknown ❌ 2400.04000 2401.28000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.31000
SMT-COMP 2017 0.83 (1/6) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.04000 595.52600
Vampire vampire4.2-smt vampire unknown ❌ 600.07500 2306.54000
veriT veriT-2017-06-17 default unsat ✅ 22.29720 22.29680
Z3 z3-4.5.0 default unknown ❌ 600.10100 599.91000
SMT-COMP 2018 0.83 (1/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 15.35060 15.34700
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4774.82000
veriT veriT_default unknown ❌ 1200.09000 1200.01000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.80000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9530.74000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 193.66800 193.33700
master-2018-06-10-b19c840-competition-default_default unsat ✅ 103.89800 103.80800
Par4 Par4-wrapped-sq_default unsat ✅ 105.22800 315.23000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2402.46000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38900 3.77715
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.08685 3.36043
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38716 3.72477
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.04000 9534.50000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.07000 9529.91000
veriT veriT-wrapped-sq_default unsat ✅ 1133.80000 1133.59000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.69000
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unsat ✅ 11.65230 11.65060
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.09000 4749.07000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 4284.67000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.45771 5.10697
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4649.78000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.02000 4670.85000
veriT veriT_default unsat ✅ 410.15900 410.15400
Z3 z3-4.8.11_default unknown ❌ 1200.03000 1199.79000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 11.29990 11.30030
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 129.99900 129.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.81061 4.80919
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.04000 4767.36000
veriT veriT_default unsat ✅ 338.51100 338.36900
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.77000
Z3 z3-4.8.17_default unknown ❌ 1200.04000 1199.82000
SMT-COMP 2023 0.83 (1/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 9.73943 9.73893
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 8.90272 8.90079
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.06000 4263.05000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.14000 4139.24000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.86573 4.92776
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.05000 4761.79000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.92000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unsat ✅ 123.60094 123.49568
iProver iProver v3.9 unknown ❌ 1201.72819 4766.84459
SMTInterpol SMTInterpol unknown ❌ 1202.71821 4489.60295
Yices2 Yices2 unknown ❌ 1201.45582 1200.73517
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 3.50487 3.37475
iProver iProver v3.9.3 unknown ❌ 1201.76434 4781.56130
SMTInterpol SMTInterpol unknown ❌ 843.01859 3228.49401
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.00710 4.27019
Yices2 Yices2 unknown ❌ 1201.54028 1201.19066