Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.684859.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size91688
Compressed Size15023
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 91680
Compressed Size15014
Max. Term Depth15
Asserts 479
Declared Functions205
Declared Constants177
Declared Sorts 224
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false89 ite9 not51 or30
and201 =>285 =1216 forall507
exists80 let122

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.18626 0.17797
CVC4 CVC4 f7118b2 default unsat ✅ 0.18583 0.18197
veriT veriT-smtcomp2014 default unsat ✅ 0.07316 0.06399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09696 0.08798
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.16878 0.16797
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.21381 0.21097
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.20747 0.20497
veriT veriT default unsat ✅ 0.08640 0.08499
Z3 z3 4.4.0 default unsat ✅ 0.11347 0.11298
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.25431 0.25474
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.22414 1.23038
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.39456 0.20258
veriT veriT-dev default unsat ✅ 0.05189 0.05214
Z3 z3-4.4.1 default unsat ✅ 0.11577 0.11713
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26503 0.26489
Vampire vampire4.2-smt vampire unsat ✅ 0.69192 2.29000
veriT veriT-2017-06-17 default unsat ✅ 0.08616 0.08618
Z3 z3-4.5.0 default unsat ✅ 0.16011 0.15971
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27382 0.27408
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 88.79320 353.05000
veriT veriT_default unsat ✅ 0.10147 0.10168
Z3 z3-4.7.1_default unsat ✅ 0.12607 0.12602
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.31866 0.31886
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.31269 0.31325
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.07335 5.16175
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.49430 0.38101
veriT veriT_default unsat ✅ 0.07205 0.07243
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.26982 0.26959
Z3 z3-4.8.17_default unsat ✅ 0.13485 0.13659
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.26885 0.26867
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.31448 0.31504
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 6.16818 22.17000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1243.19000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.84768 5.03569
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.52099 0.33109
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.44837 0.44834
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.40908 0.29442
iProver iProver v3.9.3 unsat ✅ 5.90978 20.41539
SMTInterpol SMTInterpol unknown ❌ 1201.87531 1825.87980
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.00429 4.31923
Yices2 Yices2 unsat ✅ 0.45550 0.33460