Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.611434.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size106082
Compressed Size15835
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 106074
Compressed Size15845
Max. Term Depth19
Asserts 474
Declared Functions217
Declared Constants135
Declared Sorts 245
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5 false126 ite9 not81
or4 and33 =>500 =1128
forall557 exists31 let116

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.18268 0.17397
CVC4 CVC4 f7118b2 default unsat ✅ 0.21403 0.20297
veriT veriT-smtcomp2014 default unsat ✅ 0.07686 0.06799
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.11471 0.10698
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.14480 0.14398
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.17712 0.17497
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.17956 0.17697
veriT veriT default unsat ✅ 0.08304 0.08199
Z3 z3 4.4.0 default unsat ✅ 0.12407 0.12398
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.21510 0.21539
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.80943 0.81732
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.52940 0.26570
veriT veriT-dev default unsat ✅ 0.05254 0.05278
Z3 z3-4.4.1 default unsat ✅ 0.12737 0.12882
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.21286 0.20974
Vampire vampire4.2-smt vampire unsat ✅ 4.65680 18.12180
veriT veriT-2017-06-17 default unsat ✅ 6.05255 6.05201
Z3 z3-4.5.0 default unsat ✅ 0.13568 0.13200
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.22351 0.22426
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.29781 0.29564
veriT veriT_default unsat ✅ 6.06099 6.06114
Z3 z3-4.7.1_default unsat ✅ 0.13972 0.13948
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.28224 0.28260
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 10.33240 39.46000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.93660 2.62091
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.44775 6.97030
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.68219 2.36000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.28970 0.28966
veriT veriT_default unsat ✅ 0.05996 0.06034
Z3 z3-4.8.11_default unsat ✅ 0.15426 0.15423
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.38818 0.25419
iProver iProver v3.9.3 unsat ✅ 12.43459 44.30904
SMTInterpol SMTInterpol unsat ✅ 1.29798 3.40218
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99830 4.06528
Yices2 Yices2 unknown ❌ 1201.38858 1201.17491