Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.664311.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size1527
Compressed Size616
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1519
Compressed Size617
Max. Term Depth13
Asserts 4
Declared Functions8
Declared Constants7
Declared Sorts 9
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 and2 =>4 =12
forall5 exists1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2401.50000 2402.13000
CVC4 CVC4 f7118b2 default sat ✅ 40.40160 40.40390
veriT veriT-smtcomp2014 default unknown ❌ 0.34731 0.33895
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.02969 0.02100
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.10326 0.10298
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 13.34270 13.34500
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 13.37450 13.37400
veriT veriT default unknown ❌ 0.17778 0.17697
Z3 z3 4.4.0 default sat ✅ 0.03880 0.03899
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 335.80900 304.72000
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.70275 9.74757
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.04354 0.04313
veriT veriT-dev default unknown ❌ 23.77240 23.78920
Z3 z3-4.4.1 default sat ✅ 0.03949 0.04073
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 507.44200 455.80800
Vampire vampire4.2-smt vampire sat ✅ 0.04251 0.04066
veriT veriT-2017-06-17 default unknown ❌ 43.81230 87.51440
Z3 z3-4.5.0 default sat ✅ 0.05434 0.05301
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 514.02800 484.90700
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.10922 0.14011
veriT veriT_default unknown ❌ 39.63750 39.64420
Z3 z3-4.7.1_default sat ✅ 0.08215 0.08208
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 240.12300 240.19000
CVC4 CVC4-sq-final_default sat ✅ 320.48000 302.20900
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 426.14100 396.52100
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1217.63000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.36882 3.48774
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.05096 0.08106
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.12178 0.13990
veriT veriT_default unknown ❌ 1200.06000 1199.67000
veriT+vite_default unknown ❌ 1200.06000 1199.99000
Z3 z3-4.8.8_default sat ✅ 0.05884 0.05878
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default sat ✅ 516.49600 515.22300
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.77368 0.47092
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.07000 1221.12000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.94262 5.08412
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.05883 0.05622
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.07891 0.08755
veriT veriT_default unknown ❌ 38.26090 38.26620
Z3 z3-4.8.11_default sat ✅ 0.06280 0.06276
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default sat ✅ 311.85800 298.83400
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 377.35500 369.25200
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.07715 5.77373
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.05058 0.08767
veriT veriT_default unknown ❌ 38.34020 38.34090
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01353 0.01347
Z3 z3-4.8.17_default sat ✅ 0.06402 0.06612
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 289.91900 285.62900
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 378.09000 367.39900
iProver iProver-3.8-fix_iprover_SMT sat ✅ 0.65461 0.36763
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.07000 1624.22000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.06719 5.99751
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.05445 0.09411
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.97000