Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1266492.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size127874
Compressed Size17310
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 127866
Compressed Size17326
Max. Term Depth19
Asserts 457
Declared Functions181
Declared Constants110
Declared Sorts 209
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false131 ite8 not79
or5 and23 =>796 =1269
forall534 exists14 let226

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 165.02800 165.07500
CVC4 CVC4 f7118b2 default unsat ✅ 82.41010 82.36550
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.14753 0.13998
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 4.37363 4.37433
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 7.93356 7.93379
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 7.88826 7.88680
veriT veriT default unknown ❌ 2400.01000 2401.00000
Z3 z3 4.4.0 default unsat ✅ 0.14878 0.14898
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.96924 1.97163
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 21.75640 21.87450
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.69192 6.35000
veriT veriT-dev default unknown ❌ 2400.04000 2401.54000
Z3 z3-4.4.1 default unsat ✅ 0.15544 0.15681
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.59989 0.59955
Vampire vampire4.2-smt vampire unsat ✅ 5.23585 20.57000
veriT veriT-2017-06-17 default unknown ❌ 600.03100 599.96000
Z3 z3-4.5.0 default unsat ✅ 0.17435 0.16860
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.60230 0.60252
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.79237 0.78924
veriT veriT_default unsat ✅ 109.59500 109.58300
Z3 z3-4.7.1_default unsat ✅ 0.16444 0.16440
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1.46922 5.68000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.66012 0.66048
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.69667 0.69691
Par4 Par4-wrapped-sq_default unsat ✅ 0.17588 0.00581
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2450.23000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31013 3.83177
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.02389 3.68259
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.47663 3.97534
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 46.98430 185.83000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.80219 2.95000
veriT veriT-wrapped-sq_default unsat ✅ 120.32500 120.31800
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.17136 0.17138
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.73778 0.73833
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 198.68400 784.27000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1256.41000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.81357 5.10359
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 25.82790 102.12000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 5.90624 23.17000
veriT veriT_default unknown ❌ 1200.02000 1199.96000
Z3 z3-4.8.11_default unsat ✅ 0.17887 0.17882
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.76040 0.75499
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.71570 0.71630
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4663.12000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 1249.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.04550 4.99999
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 25.09190 99.21050
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.93000