Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.582225.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6358
Compressed Size1428
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 6350
Compressed Size1443
Max. Term Depth9
Asserts 47
Declared Functions16
Declared Constants9
Declared Sorts 17
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 not11 or3
and3 =>42 =106 forall55
exists1 let4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.73000 2402.10000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.71000 2400.04000
veriT veriT-smtcomp2014 default unknown ❌ 1629.69000 1630.13000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 3.15595 3.14952
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.17000 2402.77000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 70.28280 70.28530
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 70.26530 70.26730
veriT veriT default unknown ❌ 1956.55000 1957.09000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.89000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 92.58070 90.35530
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.06500 995.66900
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 998.36800 3602.33000
veriT veriT-dev default unknown ❌ 2400.07000 2581.41000
Z3 z3-4.4.1 default unsat ✅ 11.86930 11.87740
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 90.38070 90.27360
Vampire vampire4.2-smt vampire unsat ✅ 118.84400 472.45000
veriT veriT-2017-06-17 default unknown ❌ 600.03000 600.02000
Z3 z3-4.5.0 default unsat ✅ 3.18908 3.18806
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 90.20690 90.20770
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.10000 4772.52000
veriT veriT_default unknown ❌ 1200.11000 1200.07000
Z3 z3-4.7.1_default unsat ✅ 108.99500 108.98900
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.77265 2.75000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 180.35600 180.30400
master-2018-06-10-b19c840-competition-default_default unsat ✅ 90.29870 90.27450
Par4 Par4-wrapped-sq_default unsat ✅ 90.27830 270.40000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2421.11000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35595 3.42079
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.28906 3.29365
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.32295 3.27775
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 316.37000 1255.18000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.07000 9525.11000
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2399.72000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.11000 2399.89000
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 2.26997 8.78000
CVC4 CVC4-sq-final_default unsat ✅ 90.24670 90.22940
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 180.30800 180.26300
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1219.88000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.33897 3.49354
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 478.92600 1793.69000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.09000 4762.01000
veriT veriT_default unsat ✅ 0.32194 0.32229
veriT+vite_default unsat ✅ 0.17435 0.17469
Z3 z3-4.8.8_default unsat ✅ 29.96400 29.96420
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 90.27190 90.25280
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.05000 4308.33000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.10000 1243.31000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.85439 4.83702
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.09000 4659.34000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 479.62500 1805.81000
veriT veriT_default unknown ❌ 1200.03000 1199.81000
Z3 z3-4.8.11_default unsat ✅ 122.78700 122.76000