Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.604281.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size52129
Compressed Size7807
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 52121
Compressed Size7804
Max. Term Depth15
Asserts 294
Declared Functions43
Declared Constants50
Declared Sorts 48
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false32 ite5 not51
or8 and27 =>487 =928
forall351 exists11 let101

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.12402 0.11598
CVC4 CVC4 f7118b2 default unsat ✅ 0.50704 0.49592
veriT veriT-smtcomp2014 default unsat ✅ 0.81036 0.79888
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06214 0.05399
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.11925 0.11898
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.23053 0.22796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.22659 0.22296
veriT veriT default unsat ✅ 0.67284 0.67190
Z3 z3 4.4.0 default unsat ✅ 0.07833 0.07799
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.25777 0.25819
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 21.16100 21.26740
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.64655 9.13738
veriT veriT-dev default unsat ✅ 1.97732 1.97846
Z3 z3-4.4.1 default unsat ✅ 0.09327 0.09459
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.22284 0.22261
Vampire vampire4.2-smt vampire unsat ✅ 1.01784 3.80000
veriT veriT-2017-06-17 default unsat ✅ 0.21775 0.21727
Z3 z3-4.5.0 default unsat ✅ 0.08430 0.08350
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24201 0.24214
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.75621 6.84000
veriT veriT_default unsat ✅ 0.26582 0.26603
Z3 z3-4.7.1_default unsat ✅ 0.10440 0.10434
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 2.18845 8.28000
CVC4 CVC4-sq-final_default unsat ✅ 0.27194 0.27225
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.23812 0.23849
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.05000 1232.35000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.32145 3.57567
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.95989 7.52000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.74997 6.62000
veriT veriT_default unsat ✅ 0.26466 0.26502
veriT+vite_default unsat ✅ 0.31740 0.31763
Z3 z3-4.8.8_default unsat ✅ 0.11898 0.11890
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.25832 0.25864
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.23812 0.23844
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.74510 4.88562
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.81943 6.92000
veriT veriT_default unsat ✅ 0.19017 0.19053
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.11000 1200.07000
Z3 z3-4.8.17_default unsat ✅ 0.10787 0.10969