Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.970298.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6514
Compressed Size1539
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 6506
Compressed Size1557
Max. Term Depth13
Asserts 35
Declared Functions22
Declared Constants19
Declared Sorts 24
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false2 ite1 not8 or2
and6 =>33 =79 forall25
exists2 let3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 1.00 (0/6) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01900 588.05300
Vampire vampire4.2-smt vampire unknown ❌ 600.05900 2304.45000
veriT veriT-2017-06-17 default unknown ❌ 600.09300 599.96000
Z3 z3-4.5.0 default unknown ❌ 449.75400 449.59000
SMT-COMP 2018 1.00 (0/6) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1172.20000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.06000 4768.95000
veriT veriT_default unknown ❌ 1200.08000 1200.07000
Z3 z3-4.7.1_default unknown ❌ 438.93800 438.83100
SMT-COMP 2019 1.00 (0/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 55.67750 124.91800
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.11000 2376.67000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.02000 2374.03000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.04000 7176.21000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2632.16000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.22087 3.41211
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.00463 3.39456
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.32897 3.34149
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.10000 9562.28000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.05000 9535.55000
veriT veriT-wrapped-sq_default unknown ❌ 2400.05000 2399.52000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 452.35300 452.27100
SMT-COMP 2020 1.00 (0/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.05000 4755.48000
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1183.04000
CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 1200.11000 1178.96000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1255.83000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.36201 3.45085
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.03000 4660.90000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.02000 4759.79000
veriT veriT_default unknown ❌ 1200.02000 1199.70000
veriT+vite_default unknown ❌ 1200.02000 1199.75000
Z3 z3-4.8.8_default unknown ❌ 345.69800 345.68500
SMT-COMP 2021 1.00 (0/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 1181.87000
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.06000 4743.54000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 1225.29000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.96080 4.67806
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.02000 4614.86000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.12000 4645.48000
veriT veriT_default unknown ❌ 1200.10000 1200.09000
Z3 z3-4.8.11_default unknown ❌ 328.16200 328.09400
SMT-COMP 2023 1.00 (0/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1176.33000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1182.28000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4748.42000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1227.60000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.89896 4.81234
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.03000 4771.63000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.10000 1199.99000
SMT-COMP 2024 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.74278 1201.12676
iProver iProver v3.9 unknown ❌ 1201.73567 4764.46647
SMTInterpol SMTInterpol unknown ❌ 1202.25275 1586.32090
Yices2 Yices2 unknown ❌ 1201.24721 1200.95511
SMT-COMP 2025 1.00 (0/5) cvc5 cvc5 unknown ❌ 1201.79056 1200.96431
iProver iProver v3.9.3 unknown ❌ 1201.76027 4782.02333
SMTInterpol SMTInterpol unknown ❌ 1201.76949 1242.94346
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94178 4.02772
Yices2 Yices2 unknown ❌ 1201.30401 1201.08338