Benchmark

non-incremental/UF/sledgehammer/NS_Shared/smtlib.641200.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size54003
Compressed Size8090
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 53995
Compressed Size8100
Max. Term Depth11
Asserts 342
Declared Functions70
Declared Constants67
Declared Sorts 76
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false28 ite1 not54
or14 and27 =>252 =739
forall341 exists24 let126

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 1.00 (0/6) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02300 578.39000
Vampire vampire4.2-smt vampire unknown ❌ 600.09500 2311.36000
veriT veriT-2017-06-17 default unknown ❌ 600.01900 599.96000
Z3 z3-4.5.0 default unknown ❌ 600.05900 599.94000
SMT-COMP 2018 1.00 (0/6) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.11000 1188.00000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4773.67000
veriT veriT_default unknown ❌ 1200.11000 1199.87000
Z3 z3-4.7.1_default unknown ❌ 1200.04000 1199.94000
SMT-COMP 2019 1.00 (0/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9511.83000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.01000 2383.45000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.02000 2386.45000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.13000 7186.97000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.09000 2402.95000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35961 3.49337
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15994 3.34327
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41218 3.40088
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2391.34000 9600.25000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.05000 9518.32000
veriT veriT-wrapped-sq_default unknown ❌ 2400.10000 2400.09000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2275.63000 2274.89000
SMT-COMP 2020 1.00 (0/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.08000 4761.13000
CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1189.01000
CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 1200.03000 1185.18000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.10000 1238.15000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.31550 3.53289
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.10000 4676.85000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4762.45000
veriT veriT_default unknown ❌ 1200.03000 1199.71000
veriT+vite_default unknown ❌ 1200.10000 1200.02000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2024 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.71578 1200.61192
iProver iProver v3.9 unknown ❌ 1201.71714 4765.05768
SMTInterpol SMTInterpol unknown ❌ 1202.74675 2254.57208
Yices2 Yices2 unknown ❌ 1201.41811 1201.27143