Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.795622.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size37639
Compressed Size5698
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 37631
Compressed Size5709
Max. Term Depth13
Asserts 267
Declared Functions44
Declared Constants38
Declared Sorts 54
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false43 ite5 not47 or15
and21 =>219 =641 forall281
exists10 let52

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.09042 0.08199
CVC4 CVC4 f7118b2 default unsat ✅ 0.36421 0.35295
veriT veriT-smtcomp2014 default unknown ❌ 1012.45000 1012.75000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.08000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.19481 0.19397
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.17901 0.17597
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.17720 0.17397
veriT veriT default unknown ❌ 2400.01000 2400.94000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.91000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.13347 0.13368
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 33.91660 67.80870
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.62620 5.73000
veriT veriT-dev default unsat ✅ 20.12690 20.13540
Z3 z3-4.4.1 default unknown ❌ 2400.11000 2401.40000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.13740 0.13673
Vampire vampire4.2-smt vampire unsat ✅ 37.47180 148.76000
veriT veriT-2017-06-17 default unsat ✅ 0.21917 0.21636
Z3 z3-4.5.0 default unknown ❌ 600.02300 599.87000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.14748 0.14764
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 837.78500 3333.63000
veriT veriT_default unsat ✅ 0.20457 0.20483
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.94000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 3.81010 14.94000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.15011 0.15044
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.15090 0.15118
Par4 Par4-wrapped-sq_default unsat ✅ 0.16282 0.00575
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2403.47000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.34410 3.39108
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.02395 3.36468
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39995 3.43589
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 54.00080 213.97000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 720.01300 2861.17000
veriT veriT-wrapped-sq_default unsat ✅ 0.22719 0.22759
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.12000 2399.96000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 4.72657 18.47000
CVC4 CVC4-sq-final_default unsat ✅ 0.16924 0.16950
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.15267 0.15302
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1242.13000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.48335 3.47442
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 53.46810 212.15000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 446.17300 1772.01000
veriT veriT_default unsat ✅ 183.31000 183.29000
veriT+vite_default unsat ✅ 0.05146 0.05178
Z3 z3-4.8.8_default unknown ❌ 1200.04000 1199.74000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.17002 0.17036
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 14.30020 55.33260
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.06000 3998.32000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.76906 4.79714
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 43.46830 172.35000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 47.70430 188.44000
veriT veriT_default unsat ✅ 1.04395 1.04452
Z3 z3-4.8.11_default unknown ❌ 1200.04000 1199.71000
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.17092 0.17116
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.16634 0.16656
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.99288 4.74206
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 46.98590 186.34000
veriT veriT_default unsat ✅ 1.05415 1.05470
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 595.74000 595.63800
Z3 z3-4.8.17_default unknown ❌ 1200.07000 1199.39000
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.16358 0.16375
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.16596 0.16654
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 2.15773 6.95847
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 3911.30000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.86058 4.82990
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 32.46540 128.66000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 181.64300 181.61600
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.33526 0.23587
iProver iProver v3.9 unsat ✅ 10.42227 36.49165
SMTInterpol SMTInterpol unknown ❌ 1202.71840 4428.62982
Yices2 Yices2 unknown ❌ 1201.32560 1201.03788
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.34812 0.22333
iProver iProver v3.9.3 unsat ✅ 2.36753 6.93901
SMTInterpol SMTInterpol unknown ❌ 1201.86850 4662.50500
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.91236 3.89345
Yices2 Yices2 unsat ✅ 30.03611 29.88701