Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.744393.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size70909
Compressed Size11367
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 70901
Compressed Size11319
Max. Term Depth15
Asserts 468
Declared Functions130
Declared Constants92
Declared Sorts 116
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false65 ite7 not49
or30 and146 =>174 =1062
forall474 exists65 let107

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.13493 0.12698
CVC4 CVC4 f7118b2 default unsat ✅ 0.84206 0.83087
veriT veriT-smtcomp2014 default unsat ✅ 0.10784 0.09798
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.23724 0.22996
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.12493 0.12398
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.17005 0.16797
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.16764 0.16497
veriT veriT default unsat ✅ 0.13669 0.13598
Z3 z3 4.4.0 default unsat ✅ 0.10406 0.10398
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.15958 0.15988
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 26.17630 26.31190
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.13441 8.15000
veriT veriT-dev default unsat ✅ 0.03889 0.03913
Z3 z3-4.4.1 default unsat ✅ 0.22775 0.22914
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.16179 0.16066
Vampire vampire4.2-smt vampire unsat ✅ 0.19934 0.19853
veriT veriT-2017-06-17 default unsat ✅ 0.05659 0.05580
Z3 z3-4.5.0 default unsat ✅ 0.11205 0.11107
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16989 0.17015
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 215.63500 857.54000
veriT veriT_default unsat ✅ 0.05954 0.05978
Z3 z3-4.7.1_default unsat ✅ 0.12016 0.12009
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.20872 0.20899
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.10000 2770.91000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.10000 4103.31000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.06164 5.25677
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 20.19640 80.05000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 9.84556 38.76000
veriT veriT_default unsat ✅ 0.04600 0.04652
Z3 z3-4.8.11_default unsat ✅ 0.20964 0.20956
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.20963 0.20992
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19381 0.19431
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.93183 4.79519
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 20.38440 80.13000
veriT veriT_default unsat ✅ 0.04501 0.04530
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.91000
Z3 z3-4.8.17_default unsat ✅ 0.11618 0.11786
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.14422 0.14483
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19275 0.19332
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 6.66611 23.61000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.08000 3934.59000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.91646 4.87551
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 6.74967 26.65000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.98000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.29300 0.19365
iProver iProver v3.9 unsat ✅ 6.40754 22.21946
SMTInterpol SMTInterpol unknown ❌ 1202.74446 4585.39109
Yices2 Yices2 unknown ❌ 1201.34296 1201.21129
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.33822 0.21999
iProver iProver v3.9.3 unsat ✅ 6.40467 20.31670
SMTInterpol SMTInterpol unknown ❌ 793.55706 2869.65758
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.98111 4.24526
Yices2 Yices2 unknown ❌ 1201.52607 1201.24971