Benchmark

non-incremental/UF/sledgehammer/TypeSafe/uf.683492.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size111668
Compressed Size16470
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 111660
Compressed Size16461
Max. Term Depth16
Asserts 464
Declared Functions263
Declared Constants142
Declared Sorts 297
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false149 ite9 not84
or6 and39 =>549 =1143
forall561 exists24 let143

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 1.11602 1.10083
CVC4 CVC4 f7118b2 default unsat ✅ 112.34200 112.34500
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.10000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12344 0.11498
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 1.21139 1.21081
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.24287 1.24081
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.21860 1.21581
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unsat ✅ 0.14757 0.14798
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 13.17610 13.18450
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.07600 996.24500
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 706.09600 2443.51000
veriT veriT-dev default unknown ❌ 2400.10000 2401.54000
Z3 z3-4.4.1 default unsat ✅ 0.13459 0.13592
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.93895 0.54944
Vampire vampire4.2-smt vampire unknown ❌ 600.05700 2307.29000
veriT veriT-2017-06-17 default unknown ❌ 600.01900 599.99000
Z3 z3-4.5.0 default unsat ✅ 0.14029 0.14023
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.53792 0.53808
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.06000 4769.42000
veriT veriT_default unknown ❌ 1200.05000 1199.95000
Z3 z3-4.7.1_default unsat ✅ 0.14992 0.14986
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.04000 9531.89000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.52869 0.52904
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.56727 0.56753
Par4 Par4-wrapped-sq_default unsat ✅ 0.18085 0.00579
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.11000 2433.49000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.53775 4.00585
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16005 3.60906
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.56269 3.95810
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.13000 9537.92000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.06000 9518.41000
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2399.81000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15751 0.15753
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 64.38420 255.64000
CVC4 CVC4-sq-final_default unsat ✅ 0.54954 0.54975
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.49245 0.49279
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1247.98000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.40238 4.02357
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.07000 4658.14000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4767.64000
veriT veriT_default unknown ❌ 1200.10000 1199.79000
veriT+vite_default unknown ❌ 278.71900 278.67000
Z3 z3-4.8.8_default unsat ✅ 0.17542 0.17534
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unsat ✅ 0.53049 0.53071
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.07000 3624.57000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 1240.88000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.05921 5.08722
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.08000 4646.85000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.03000 4656.91000
veriT veriT_default unknown ❌ 1200.08000 1199.86000
Z3 z3-4.8.11_default unsat ✅ 0.16071 0.16067
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.52227 0.52135
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.50894 0.50818
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 410.22900 1610.28000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 1270.19000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.89252 4.93739
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.05000 4780.97000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.01000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.53573 0.43612
iProver iProver v3.9 unknown ❌ 1201.72831 4761.13583
SMTInterpol SMTInterpol unknown ❌ 1202.24403 1327.22198
Yices2 Yices2 unknown ❌ 1201.22364 1201.06686
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 0.59431 0.47046
iProver iProver v3.9.3 unknown ❌ 1201.76722 4779.06649
SMTInterpol SMTInterpol unknown ❌ 1201.79252 1634.67390
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99842 4.38884
Yices2 Yices2 unknown ❌ 1201.31776 1201.02471