Benchmark

non-incremental/UFLIA/sledgehammer/Hoare/smtlib.1046517.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size2241
Compressed Size780
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2233
Compressed Size795
Max. Term Depth14
Asserts 7
Declared Functions15
Declared Constants8
Declared Sorts 15
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not5 =>12 =16 forall6
let2 Int2 +3 -2
<1 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01652 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.03063 0.02000
veriT veriT-smtcomp2014 default unsat ✅ 0.01266 0.00400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02353 0.01500
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00881 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.02011 0.01800
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.02026 0.01700
veriT veriT default unsat ✅ 0.00794 0.00300
Z3 z3 4.4.0 default unsat ✅ 0.03826 0.03799
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01856 0.01887
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 131.56100 132.24600
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 13.07600 51.75000
veriT veriT-dev default unsat ✅ 0.01225 0.00842
Z3 z3-4.4.1 default unsat ✅ 0.03774 0.03933
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.02411 0.02333
Vampire vampire4.2-smt vampire unsat ✅ 5.20086 20.38000
veriT veriT-2017-06-17 default unsat ✅ 0.00844 0.00817
Z3 z3-4.5.0 default unsat ✅ 0.04361 0.04292
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.02393 0.02414
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 908.55600 3615.06000
veriT veriT_default unsat ✅ 0.00924 0.00932
Z3 z3-4.7.1_default unsat ✅ 0.05129 0.05117
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.03323 0.03456
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03179 0.03216
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.02673 0.02702
Par4 Par4-wrapped-sq_default unsat ✅ 0.02176 0.00637
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 0.34621 0.53147
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.41752 3.37261
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.26941 3.35586
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33961 3.34299
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 162.18400 644.39000
veriT veriT-wrapped-sq_default unsat ✅ 0.01383 0.01423
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.05610 0.05611
SMT-COMP 2020 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.02854 0.02842
CVC4 CVC4-sq-final_default unsat ✅ 0.03022 0.03052
Par4 Par4-wrapped-sq_default unsat ✅ 0.02009 0.00629
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.46170 0.74219
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.37349 3.44130
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 11.55700 60.46230
veriT veriT_default unsat ✅ 0.01308 0.01341
veriT+vite_default unsat ✅ 0.01165 0.01194
Z3 z3-4.8.8_default unsat ✅ 0.04838 0.04834
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 0.02732 0.02762
cvc5 cvc5-fixed_default unsat ✅ 0.02998 0.03052
Par4 Par4-wrapped-sq_default unsat ✅ 0.02375 0.00649
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.48161 0.75169
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.85528 4.74682
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 26.38040 104.34000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 142.87200 566.81000
veriT veriT_default unsat ✅ 0.01217 0.01247
Z3 z3-4.8.11_default unsat ✅ 0.03389 0.03386
z3-4.8.8_default unsat ✅ 0.04952 0.04942
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.03361 0.03422
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.05331 0.05386
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4748.80000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.58897 1.06929
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.84167 4.68804
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.61065 2.19000