Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.694208.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size8480
Compressed Size1769
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 8472
Compressed Size1751
Max. Term Depth9
Asserts 51
Declared Functions24
Declared Constants24
Declared Sorts 27
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite4 not9 or2 and4
=>19 =90 forall41 let12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.29086 0.28996
CVC4 CVC4 f7118b2 default sat ✅ 40.19120 40.17290
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1237.47000 1237.93000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.42449 0.42394
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.08990 20.09590
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.09140 20.09690
veriT veriT default unknown ❌ 2400.01000 2400.72000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.88000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 309.96800 301.52300
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.74663 9.79121
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.07758 0.07749
veriT veriT-dev default unknown ❌ 2400.03000 2581.36000
Z3 z3-4.4.1 default unknown ❌ 329.13600 329.30600
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.36800 450.30500
Vampire vampire4.2-smt vampire sat ✅ 0.06758 0.10274
veriT veriT-2017-06-17 default unknown ❌ 600.01800 599.92000
Z3 z3-4.5.0 default unknown ❌ 456.88300 456.76100
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 481.72700 480.66900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.10572 0.10546
veriT veriT_default unknown ❌ 1200.02000 1199.85000
Z3 z3-4.7.1_default unknown ❌ 523.75300 523.70100
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.09000 9538.58000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 963.52800 961.27900
master-2018-06-10-b19c840-competition-default_default sat ✅ 481.54800 480.85500
Par4 Par4-wrapped-sq_default sat ✅ 481.20400 1442.59000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2403.93000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32294 3.33628
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.13610 3.28619
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.34293 3.30042
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.50198 0.26529
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.11464 0.10716
veriT veriT-wrapped-sq_default unknown ❌ 2111.32000 2110.80000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 287.90600 287.84000
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4768.42000
CVC4 CVC4-sq-final_default sat ✅ 481.13300 480.87900
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 962.53300 961.04900
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.05000 1207.76000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.31159 3.47949
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.13129 0.07565
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.18966 0.10466
veriT veriT_default unknown ❌ 1200.11000 1199.86000
veriT+vite_default unknown ❌ 493.12700 492.77000
Z3 z3-4.8.8_default unknown ❌ 355.28900 355.27200
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 481.29200 480.80700
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 1.26847 3.68000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 4290.11000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.70086 4.69535
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.17111 0.09948
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.12658 0.07613
veriT veriT_default unknown ❌ 1200.11000 1199.98000
Z3 z3-4.8.11_default unknown ❌ 771.78300 771.65500
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 481.18800 480.66300
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 511.17400 510.73700
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.77532 4.83077
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.17479 0.10744
veriT veriT_default unknown ❌ 1200.02000 1199.90000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.91000
Z3 z3-4.8.17_default unknown ❌ 265.02000 264.97200
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 511.72600 510.83900
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 511.06000 510.67700
iProver iProver-3.8-fix_iprover_SMT sat ✅ 340.90000 1340.64000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 4025.33000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.72995 4.70311
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.18439 0.10942
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.11000 1200.07000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.30445 540.19672
iProver iProver v3.9 sat ✅ 2.38768 6.71991
SMTInterpol SMTInterpol unknown ❌ 1202.74824 4435.26964
Yices2 Yices2 unknown ❌ 1201.33263 1201.22173
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.41161 540.20460
iProver iProver v3.9.3 sat ✅ 1.84779 4.99376
SMTInterpol SMTInterpol unknown ❌ 1201.86498 4583.13563
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89851 3.82361
Yices2 Yices2 unknown ❌ 1201.30207 1201.13119