Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.1090070.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size21562
Compressed Size3659
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21554
Compressed Size3672
Max. Term Depth11
Asserts 171
Declared Functions56
Declared Constants28
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false29 ite8 not25
or8 and15 =>103 =386
forall178 exists9 let21

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 6.44704 6.44902
CVC4 CVC4 f7118b2 default sat ✅ 41.26910 41.26170
veriT veriT-smtcomp2014 default unknown ❌ 1362.26000 1362.86000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1302.61000 1303.09000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 961.21700 959.70200
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.80000 20.79980
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.84340 20.84480
veriT veriT default unknown ❌ 2400.01000 2400.84000
Z3 z3 4.4.0 default unknown ❌ 404.27700 404.37800
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 324.65400 303.84600
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.81958 9.86620
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.15761 0.14981
veriT veriT-dev default unknown ❌ 2400.09000 2431.42000
Z3 z3-4.4.1 default unknown ❌ 192.88100 192.90400
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 464.81700 452.59100
Vampire vampire4.2-smt vampire sat ✅ 0.15803 0.15651
veriT veriT-2017-06-17 default unknown ❌ 600.01800 599.86000
Z3 z3-4.5.0 default unknown ❌ 196.63200 196.52900
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 494.62000 482.56500
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.19304 0.19139
veriT veriT_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.94000
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.08000 4765.62000
CVC4 CVC4-sq-final_default sat ✅ 494.52600 482.72500
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 1014.89000 966.90400
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1419.90000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41342 3.51505
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.22510 0.17688
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.32210 0.20821
veriT veriT_default unknown ❌ 1200.04000 1199.87000
veriT+vite_default unknown ❌ 1200.02000 1199.83000
Z3 z3-4.8.8_default unknown ❌ 479.09100 479.02100
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 521.89300 512.26800
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 520.87200 512.41500
iProver iProver-3.8-fix_iprover_SMT sat ✅ 346.32600 1336.48000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 3525.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.83384 4.92297
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.27840 0.27824
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.04000 1199.94000