Benchmark

non-incremental/UFLIA/sledgehammer/Hoare/smtlib.814427.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size19780
Compressed Size3311
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 19772
Compressed Size3323
Max. Term Depth13
Asserts 122
Declared Functions37
Declared Constants22
Declared Sorts 38
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false34 not49 and12 =>105
=226 forall130 exists3 let6
Int2 +23 <1 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 1.00 (0/4) CVC3 CVC3 default unknown ❌ 0.01696 0.00900
CVC4 CVC4 f7118b2 default unknown ❌ 2399.81000 2400.04000
veriT veriT-smtcomp2014 default unknown ❌ 2398.81000 2400.04000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.00000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00905 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 40.37020 40.37190
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 40.36630 40.37090
veriT veriT default unknown ❌ 2400.01000 2400.61000
Z3 z3 4.4.0 default unsat ✅ 2235.72000 2236.50000
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 20.13530 20.14950
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 463.73800 465.94700
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 53.55820 212.55000
veriT veriT-dev default unsat ✅ 20.02680 20.03910
Z3 z3-4.4.1 default unsat ✅ 243.72200 243.82700
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.68220 20.17560
Vampire vampire4.2-smt vampire unsat ✅ 0.32468 0.32324
veriT veriT-2017-06-17 default unsat ✅ 0.03321 0.03295
Z3 z3-4.5.0 default unsat ✅ 504.00500 503.93200
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.64790 30.16880
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 126.48300 502.86000
veriT veriT_default unsat ✅ 0.03576 0.03598
Z3 z3-4.7.1_default unsat ✅ 271.38000 271.27800
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.15581 0.15618
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.60210 60.17660
master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.37170 30.17510
Par4 Par4-wrapped-sq_default unsat ✅ 0.04998 0.00667
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 2403.14000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.39139 3.40533
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.19302 3.40209
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.37380 3.46444
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 135.50200 536.49000
veriT veriT-wrapped-sq_default unsat ✅ 0.04116 0.04148
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 22.68510 22.68370
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.20169 0.20066
CVC4 CVC4-sq-final_default unsat ✅ 30.28920 30.18700
Par4 Par4-wrapped-sq_default unsat ✅ 0.05216 0.00672
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1220.59000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.29366 3.53878
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 25.53360 101.13000
veriT veriT_default unsat ✅ 0.04032 0.04066
veriT+vite_default unsat ✅ 0.02713 0.02742
Z3 z3-4.8.8_default unknown ❌ 1200.11000 1199.74000
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 30.98050 30.18980
cvc5 cvc5-fixed_default unsat ✅ 30.14570 30.14830
Par4 Par4-wrapped-sq_default unsat ✅ 0.04900 0.00620
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 119.50900 149.54600
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.82917 4.99238
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 25.52190 100.76000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 25.57270 100.94000
veriT veriT_default unsat ✅ 0.02290 0.02323
Z3 z3-4.8.11_default unsat ✅ 547.08900 546.86000
z3-4.8.8_default unsat ✅ 584.01600 583.74800
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 31.22150 30.19340
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 30.35960 30.18160
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.83110 4.59144
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 25.44280 100.89000
veriT veriT_default unsat ✅ 0.02303 0.02342
Z3 z3-4.8.17_default unknown ❌ 1200.04000 1199.89000
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.37457 0.27523
iProver iProver v3.9 unsat ✅ 0.89588 2.31984
SMTInterpol SMTInterpol unsat ✅ 378.40224 406.63132
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.44577 0.32508
iProver iProver v3.9.3 unsat ✅ 0.90459 2.29386
SMTInterpol SMTInterpol unsat ✅ 16.31922 28.50788
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.97284 4.23470