Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1012987.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size141670
Compressed Size18073
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 141662
Compressed Size17876
Max. Term Depth15
Asserts 455
Declared Functions231
Declared Constants126
Declared Sorts 283
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false182 not94 or10 and32
=>1052 =1407 forall561 exists15
let251

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 5.07851 5.07223
CVC4 CVC4 f7118b2 default unsat ✅ 1.82577 1.81472
veriT veriT-smtcomp2014 default unsat ✅ 0.28468 0.27596
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 385.76600 385.71100
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.33167 0.33095
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.35737 0.35495
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.35713 0.35395
veriT veriT default unsat ✅ 0.28488 0.28396
Z3 z3 4.4.0 default unsat ✅ 568.00500 568.14600
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.38407 0.38449
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.38592 0.38831
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.61839 0.36662
veriT veriT-dev default unsat ✅ 0.11546 0.11566
Z3 z3-4.4.1 default unsat ✅ 0.22762 0.22900
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.36900 0.36867
Vampire vampire4.2-smt vampire unsat ✅ 0.43753 0.24662
veriT veriT-2017-06-17 default unsat ✅ 2.52492 2.52386
Z3 z3-4.5.0 default unknown ❌ 600.06000 599.90000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.41417 0.41437
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 3.20632 12.51000
veriT veriT_default unsat ✅ 3.09575 3.09617
Z3 z3-4.7.1_default unknown ❌ 1200.03000 1199.78000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 2.68441 10.54000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.41330 0.41362
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.42071 0.42096
Par4 Par4-wrapped-sq_default unsat ✅ 0.44400 0.00559
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2405.35000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.48686 3.93531
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.22166 3.66427
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.54199 3.97274
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.17085 3.81000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 4.12774 15.96000
veriT veriT-wrapped-sq_default unsat ✅ 3.75621 3.75427
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1217.25000 1217.14000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 2.21409 8.60000
CVC4 CVC4-sq-final_default unsat ✅ 0.48279 0.48302
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.41354 0.41387
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.07000 1349.29000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.49054 4.06774
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.56546 0.31139
vampire-4.3-smt_vampire_smtcomp unsat ✅ 4.67793 18.16410
veriT veriT_default unsat ✅ 0.14619 0.14653
veriT+vite_default unsat ✅ 0.14513 0.14546
Z3 z3-4.8.8_default unknown ❌ 1200.05000 1199.89000
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.48350 0.48381
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 2.34079 8.13000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 1301.95000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.72074 7.84183
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.59018 2.15000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.36657 0.31351
veriT veriT_default unsat ✅ 0.12589 0.12626
Z3 z3-4.8.11_default unsat ✅ 0.24366 0.24364
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.50596 0.38488
iProver iProver v3.9.3 unsat ✅ 3.87138 12.57778
SMTInterpol SMTInterpol unknown ❌ 1201.84073 1811.93007
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.98198 4.12308
Yices2 Yices2 unknown ❌ 1201.30666 1201.05558