Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.707387.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size96307
Compressed Size14971
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 96299
Compressed Size15038
Max. Term Depth14
Asserts 515
Declared Functions154
Declared Constants155
Declared Sorts 160
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false65 ite27 not120
or19 and80 =>527 =1411
forall561 exists41 let136

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.18047 0.16797
CVC4 CVC4 f7118b2 default unsat ✅ 0.21937 0.20597
veriT veriT-smtcomp2014 default unsat ✅ 0.08176 0.07299
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09370 0.08599
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.17641 0.17597
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.23046 0.22796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.22968 0.22596
veriT veriT default unsat ✅ 0.09859 0.09798
Z3 z3 4.4.0 default unsat ✅ 0.10377 0.10398
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.27944 0.27974
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 161.38900 162.21500
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 29.76940 118.00000
veriT veriT-dev default unsat ✅ 0.06024 0.06077
Z3 z3-4.4.1 default unsat ✅ 0.10952 0.11079
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.27546 0.27589
Vampire vampire4.2-smt vampire unsat ✅ 146.40400 581.60000
veriT veriT-2017-06-17 default unsat ✅ 0.29051 0.09249
Z3 z3-4.5.0 default unsat ✅ 0.11257 0.11200
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30454 0.30475
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 358.15700 1422.71000
veriT veriT_default unsat ✅ 0.08666 0.08691
Z3 z3-4.7.1_default unsat ✅ 0.12363 0.12350
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.42418 0.42365
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30595 0.30628
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.31101 0.31129
Par4 Par4-wrapped-sq_default unsat ✅ 0.10276 0.00575
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2404.23000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40241 3.85982
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.29007 3.64403
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.35793 3.81398
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 509.32600 2022.46000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1463.42000 5797.18000
veriT veriT-wrapped-sq_default unsat ✅ 0.09460 0.09494
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12911 0.12909
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.40089 0.39662
CVC4 CVC4-sq-final_default unsat ✅ 0.35170 0.35196
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30337 0.30375
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.14000 1249.14000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.46279 3.87939
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 52.52770 208.01000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1191.17000 4800.17000
veriT veriT_default unsat ✅ 0.07134 0.07168
veriT+vite_default unsat ✅ 0.07187 0.07221
Z3 z3-4.8.8_default unsat ✅ 0.14513 0.14507
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.35384 0.35416
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.05000 4745.46000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 4203.93000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.09238 5.95435
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 58.94970 233.25000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 55.86750 221.22000
veriT veriT_default unsat ✅ 0.06598 0.06637
Z3 z3-4.8.11_default unsat ✅ 0.13345 0.13340
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.29597 0.29641
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33914 0.33883
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4327.74000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 3360.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.90713 5.02383
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 29.64390 117.47000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.96000
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 0.46315 0.33080
iProver iProver v3.9.3 unknown ❌ 1201.79601 4782.75994
SMTInterpol SMTInterpol unknown ❌ 160.81334 538.31843
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.13855 4.76007
Yices2 Yices2 unknown ❌ 1201.53917 1201.21197