Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.574997.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size1774
Compressed Size670
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1766
Compressed Size669
Max. Term Depth10
Asserts 5
Declared Functions9
Declared Constants9
Declared Sorts 13
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false2 not2 =>7 =14
forall6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 67.78080 67.77870
CVC4 CVC4 f7118b2 default sat ✅ 40.83890 40.83280
veriT veriT-smtcomp2014 default unknown ❌ 15.53970 15.53860
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2398.91000 2400.02000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.01000 2400.64000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.05150 20.05100
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.06500 20.06490
veriT veriT default unknown ❌ 505.61700 505.70000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.56000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 304.57400 301.18100
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.69963 9.74387
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.04251 0.04232
veriT veriT-dev default unknown ❌ 2400.05000 2401.57000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.35000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 453.09100 450.60500
Vampire vampire4.2-smt vampire sat ✅ 0.04429 0.07557
veriT veriT-2017-06-17 default unknown ❌ 600.05200 599.93000
Z3 z3-4.5.0 default unknown ❌ 600.01800 599.86200
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 500.04800 480.77900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.06981 0.06510
veriT veriT_default unknown ❌ 1200.11000 1199.94000
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1199.99000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 482.37200 480.90100
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.77327 1.88000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 3881.46000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.75337 4.91825
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.05903 0.05861
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.05304 0.04921
veriT veriT_default unknown ❌ 1200.01000 1199.88000
Z3 z3-4.8.11_default unknown ❌ 1200.11000 1199.93000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 512.40200 510.71900
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 511.09200 510.64300
iProver iProver-3.8-fix_iprover_SMT sat ✅ 336.91100 1326.82000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.13000 4258.10000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.88529 4.77382
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.05680 0.05418
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.93000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.42099 540.31381
iProver iProver v3.9 sat ✅ 0.86725 1.97761
SMTInterpol SMTInterpol unknown ❌ 335.53851 1288.22282
Yices2 Yices2 unknown ❌ 1201.22444 1200.68402