Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.908703.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size5412
Compressed Size1178
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 5404
Compressed Size1194
Max. Term Depth14
Asserts 33
Declared Functions9
Declared Constants11
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false11 not19 and4 =>38
=71 forall32 exists2 let3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 988.41600 988.25800
CVC4 CVC4 f7118b2 default unknown ❌ 2399.81000 2400.10000
veriT veriT-smtcomp2014 default unknown ❌ 105.94200 105.95300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 16.72330 16.72150
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 1092.81000 1087.82000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 41.50480 41.50870
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 41.58860 41.59070
veriT veriT default unknown ❌ 946.08400 946.05200
Z3 z3 4.4.0 default unsat ✅ 233.89100 233.98600
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 20.59340 20.22940
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.06557 0.06608
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.05186 0.04094
veriT veriT-dev default unknown ❌ 2400.02000 2401.54000
Z3 z3-4.4.1 default unsat ✅ 304.49300 304.59900
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.21630 20.21270
Vampire vampire4.2-smt vampire unsat ✅ 0.04566 0.04393
veriT veriT-2017-06-17 default unsat ✅ 511.96500 511.91200
Z3 z3-4.5.0 default unsat ✅ 9.35175 9.34636
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 33.51190 30.17440
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08565 0.08558
veriT veriT_default unknown ❌ 1200.04000 1200.00000
Z3 z3-4.7.1_default unsat ✅ 23.87870 23.87690
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.13756 0.13561
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.41080 60.25030
master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.23260 30.23290
Par4 Par4-wrapped-sq_default unsat ✅ 12.13740 36.07000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 1724.45000 1972.27000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35262 3.26668
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10849 3.31018
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.40655 3.31169
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.08392 0.07965
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08461 0.08261
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.79000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 21.69550 21.69270
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.42314 0.42076
CVC4 CVC4-sq-final_default unsat ✅ 30.26650 30.24760
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.23320 60.21890
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1227.96000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.30576 3.38247
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.08676 0.05054
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08841 0.08318
veriT veriT_default unsat ✅ 42.44900 42.44830
veriT+vite_default unsat ✅ 25.15260 25.15250
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.84000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 30.33110 30.32920
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 9.91825 9.91292
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.64980 1.53904
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1242.99000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.78800 4.72466
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.09096 0.05822
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.93000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 30.40127 30.27376
iProver iProver v3.9.3 unsat ✅ 0.87192 1.95280
SMTInterpol SMTInterpol unknown ❌ 1201.78051 1634.81365
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.86294 4.01125
Yices2 Yices2 unknown ❌ 1201.35410 1201.03469