Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.770501.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size19013
Compressed Size3437
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 19005
Compressed Size3439
Max. Term Depth14
Asserts 110
Declared Functions49
Declared Constants43
Declared Sorts 62
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false22 ite2 not26 or1
and7 =>98 =253 forall115
exists6 let14

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 1.00 (0/6) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02500 597.88000
Vampire vampire4.2-smt vampire unknown ❌ 600.07700 2305.60000
veriT veriT-2017-06-17 default unknown ❌ 600.01800 599.92000
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.80000
SMT-COMP 2018 1.00 (0/6) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1195.92000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.06000 4771.44000
veriT veriT_default unknown ❌ 1200.12000 1229.99000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.94000
SMT-COMP 2019 1.00 (0/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9522.04000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2389.23000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.03000 2428.91000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.04000 7143.72000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2493.47000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.48396 3.39053
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.03827 3.37048
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38523 3.37068
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.09000 9552.68000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.11000 9534.92000
veriT veriT-wrapped-sq_default unknown ❌ 2351.51000 2351.32000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 804.00700 803.87900
SMT-COMP 2020 1.00 (0/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.04000 4762.09000
CVC4 CVC4-sq-final_default unknown ❌ 1200.04000 1195.56000
CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 1200.05000 1186.97000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 3346.80000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.37864 3.54895
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.08000 4649.04000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1188.77000 4800.30000
veriT veriT_default unknown ❌ 98.92780 96.91210
veriT+vite_default unknown ❌ 1200.02000 1199.82000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.65000
SMT-COMP 2023 1.00 (0/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1220.33000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 1194.29000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1192.76000 4800.06000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 3968.23000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.89418 4.87649
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.11000 4772.98000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.82000
SMT-COMP 2024 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.72357 1200.91662
iProver iProver v3.9 unknown ❌ 1201.71865 4768.91102
SMTInterpol SMTInterpol unknown ❌ 1202.74393 4084.77108
Yices2 Yices2 unknown ❌ 1201.44659 1201.28333
SMT-COMP 2025 1.00 (0/5) cvc5 cvc5 unknown ❌ 1201.78794 1201.07421
iProver iProver v3.9.3 unknown ❌ 1201.78540 4783.42641
SMTInterpol SMTInterpol unknown ❌ 915.88386 3295.53659
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94072 4.09026
Yices2 Yices2 unknown ❌ 1201.53742 1201.11368