Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.648032.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size70792
Compressed Size10858
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 70784
Compressed Size10857
Max. Term Depth14
Asserts 359
Declared Functions123
Declared Constants123
Declared Sorts 129
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false31 ite12 not79
or13 and53 =>417 =1008
forall396 exists22 let107

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.20418 0.19597
CVC4 CVC4 f7118b2 default unsat ✅ 21.59990 21.59070
veriT veriT-smtcomp2014 default unsat ✅ 0.75079 0.73489
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09582 0.08798
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.30878 0.30795
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.26085 0.25796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.26089 0.25796
veriT veriT default unsat ✅ 0.75083 0.74989
Z3 z3 4.4.0 default unsat ✅ 0.10969 0.10898
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.30999 0.30627
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 98.19490 98.66880
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 9.56534 37.59000
veriT veriT-dev default unsat ✅ 2.89854 2.90000
Z3 z3-4.4.1 default unsat ✅ 0.10610 0.10739
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26650 0.26630
Vampire vampire4.2-smt vampire unsat ✅ 31.85520 126.49000
veriT veriT-2017-06-17 default unsat ✅ 1.03818 1.03744
Z3 z3-4.5.0 default unsat ✅ 0.17072 0.16998
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29951 0.29972
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 895.21300 3561.44000
veriT veriT_default unsat ✅ 0.84269 0.84292
Z3 z3-4.7.1_default unsat ✅ 6.85675 6.85570
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.31445 0.31393
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.32225 0.32280
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 4.16161 14.86000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 3876.03000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.96193 4.97302
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 122.44000 486.47000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.40100 0.30131
iProver iProver v3.9 unsat ✅ 7.38534 25.25356
SMTInterpol SMTInterpol unknown ❌ 1202.74615 4434.95580
Yices2 Yices2 unknown ❌ 1201.26593 1201.11857
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.46348 0.34237
iProver iProver v3.9.3 unsat ✅ 3.88941 12.52469
SMTInterpol SMTInterpol unknown ❌ 632.65171 2394.61201
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92971 4.18745
Yices2 Yices2 unknown ❌ 1201.45435 1201.21033