Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1305552.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size110470
Compressed Size15382
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 110462
Compressed Size15378
Max. Term Depth18
Asserts 470
Declared Functions155
Declared Constants60
Declared Sorts 126
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false135 ite8 not80 or5
and40 =>668 =1250 forall569
exists11 let168

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.68000 2403.38000
CVC4 CVC4 f7118b2 default unsat ✅ 0.34893 0.33795
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12360 0.11598
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 653.00200 653.28300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.37522 0.37294
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.37402 0.37094
veriT veriT default unknown ❌ 2400.01000 2400.80000
Z3 z3 4.4.0 default unsat ✅ 0.13211 0.13198
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.43626 0.43668
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 23.57620 23.70340
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 4.34477 17.02000
veriT veriT-dev default unsat ✅ 0.07104 0.07150
Z3 z3-4.4.1 default unsat ✅ 0.13535 0.13666
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.34825 0.34802
Vampire vampire4.2-smt vampire unsat ✅ 0.55368 1.99000
veriT veriT-2017-06-17 default unsat ✅ 6.08328 6.08270
Z3 z3-4.5.0 default unsat ✅ 0.14454 0.14324
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.38821 0.38840
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 446.01200 1774.40000
veriT veriT_default unsat ✅ 6.09983 6.09999
Z3 z3-4.7.1_default unsat ✅ 0.14930 0.14924
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.59189 2.02000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.38962 0.38972
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.39530 0.39559
Par4 Par4-wrapped-sq_default unsat ✅ 0.16152 0.00562
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2551.74000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36839 3.56152
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18166 3.58166
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.27947 3.59714
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 42.25730 167.41000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 7.32519 28.78000
veriT veriT-wrapped-sq_default unsat ✅ 6.10619 6.10559
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15912 0.15914
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.56306 2.02000
CVC4 CVC4-sq-final_default unsat ✅ 0.43970 0.43999
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.38596 0.38629
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.05000 1247.74000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.46727 3.78526
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 6.32846 24.90000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 438.90400 1743.18000
veriT veriT_default unsat ✅ 0.09716 0.09749
veriT+vite_default unsat ✅ 0.10210 0.10241
Z3 z3-4.8.8_default unsat ✅ 0.18513 0.18505
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.44266 0.44284
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 17.34940 67.34000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1246.47000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.85674 5.03153
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 2.30625 8.94000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 6.35218 24.95000
veriT veriT_default unsat ✅ 0.08606 0.08641
Z3 z3-4.8.11_default unsat ✅ 0.16210 0.16206
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.44351 0.44386
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.40988 0.41048
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.64695 4.83307
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.95947 7.56000
veriT veriT_default unsat ✅ 0.08689 0.08725
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.87000
Z3 z3-4.8.17_default unsat ✅ 0.16119 0.16299
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.44261 0.34296
iProver iProver v3.9 unsat ✅ 954.00209 3781.39475
SMTInterpol SMTInterpol unknown ❌ 1202.22046 1338.24126
Yices2 Yices2 unknown ❌ 1201.23437 1201.11767