Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.1154593.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size23041
Compressed Size3970
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 23033
Compressed Size3984
Max. Term Depth14
Asserts 131
Declared Functions49
Declared Constants49
Declared Sorts 56
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false17 ite4 not36
or5 and27 =>106 =348
forall158 exists12 let20

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.72000 2402.05000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.91000 2400.04000
veriT veriT-smtcomp2014 default unknown ❌ 762.73400 762.91000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 127.18500 127.19700
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.38000 2403.28000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 503.94600 501.94200
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 534.81800 532.90400
veriT veriT default unknown ❌ 696.06400 696.13800
Z3 z3 4.4.0 default unsat ✅ 98.42340 98.45400
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.11000 2311.51000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.16334 0.16414
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.21815 0.11032
veriT veriT-dev default unknown ❌ 2400.08000 2401.41000
Z3 z3-4.4.1 default unsat ✅ 109.20000 109.25300
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 41.00310 40.36250
Vampire vampire4.2-smt vampire unsat ✅ 0.13003 0.12932
veriT veriT-2017-06-17 default unknown ❌ 600.01800 599.89000
Z3 z3-4.5.0 default unsat ✅ 127.63300 127.60200
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 459.48600 451.94300
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.26860 0.13821
veriT veriT_default unknown ❌ 1200.02000 1199.74000
Z3 z3-4.7.1_default unknown ❌ 1200.08000 1200.09000
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.05000 4768.43000
CVC4 CVC4-sq-final_default unsat ✅ 52.57490 52.50300
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 83.10260 82.29780
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1210.11000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.36044 3.46407
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13824 0.13777
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.14453 0.14263
veriT veriT_default unsat ✅ 9.44958 9.45003
veriT+vite_default unknown ❌ 1200.09000 1200.05000
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.78000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 465.98000 452.25900
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 4.79273 17.62000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 4269.80000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.84136 4.74066
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.16897 0.16881
vampire_smt_4.5_vampire_smtcomp unknown ❌ 0.34029 0.28447
veriT veriT_default unknown ❌ 1200.11000 1200.03000
Z3 z3-4.8.11_default unknown ❌ 1200.04000 1199.82000