Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.740532.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size93012
Compressed Size15402
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 93004
Compressed Size15443
Max. Term Depth15
Asserts 483
Declared Functions221
Declared Constants187
Declared Sorts 246
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false94 ite9 not49 or30
and171 =>279 =1175 forall506
exists67 let133

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.17000 2402.77000
CVC4 CVC4 f7118b2 default unsat ✅ 0.20738 0.19597
veriT veriT-smtcomp2014 default unknown ❌ 876.13300 876.39500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09793 0.08998
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.47000 2403.15000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.15943 0.15698
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.15721 0.15498
veriT veriT default unknown ❌ 2400.01000 2400.84000
Z3 z3 4.4.0 default unsat ✅ 0.11211 0.11198
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.18293 0.18327
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 36.06780 36.23810
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 5.07220 19.95000
veriT veriT-dev default unsat ✅ 0.05060 0.05086
Z3 z3-4.4.1 default unsat ✅ 0.11367 0.11560
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.18504 0.18445
Vampire vampire4.2-smt vampire unsat ✅ 0.85868 3.22000
veriT veriT-2017-06-17 default unsat ✅ 0.07768 0.07758
Z3 z3-4.5.0 default unsat ✅ 0.14040 0.14031
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.19523 0.19544
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 407.37200 1620.32000
veriT veriT_default unsat ✅ 0.09294 0.09319
Z3 z3-4.7.1_default unsat ✅ 0.12648 0.12643
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.20404 0.20428
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.20333 0.20369
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.20361 0.20386
Par4 Par4-wrapped-sq_default unsat ✅ 0.10207 0.00587
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2448.32000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.49002 3.85875
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.24805 3.58421
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.40197 3.74401
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 5.73822 22.22000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 402.87600 1597.78000
veriT veriT-wrapped-sq_default unsat ✅ 0.09560 0.09595
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.13459 0.13460
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.22022 0.22055
CVC4 CVC4-sq-final_default unsat ✅ 0.24713 0.24725
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.20385 0.20416
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.94970 2.74511
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41177 3.92694
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.69992 14.46000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 415.11000 1646.09000
veriT veriT_default unsat ✅ 0.07318 0.07353
veriT+vite_default unsat ✅ 0.07106 0.07139
Z3 z3-4.8.8_default unknown ❌ 704.12400 704.03100
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.24741 0.24771
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 276.60600 1092.06000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 1.04219 3.02186
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.95792 5.22940
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 4.08934 15.41000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.57625 13.83000
veriT veriT_default unsat ✅ 0.06964 0.06999
Z3 z3-4.8.11_default unknown ❌ 481.46800 481.35600
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.24963 0.24993
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.23505 0.23564
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.86527 5.08610
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.63096 6.11000
veriT veriT_default unsat ✅ 0.06566 0.06604
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05383 0.05379
Z3 z3-4.8.17_default unsat ✅ 0.13061 0.13246
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.28882 0.18892
iProver iProver v3.9 unsat ✅ 326.14738 1288.10936
SMTInterpol SMTInterpol unsat ✅ 1.47161 4.12339
Yices2 Yices2 unsat ✅ 0.23049 0.13062
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.37395 0.24779
iProver iProver v3.9.3 unsat ✅ 6.90232 22.21103
SMTInterpol SMTInterpol unsat ✅ 1.58324 4.29079
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.00650 4.40069
Yices2 Yices2 unknown ❌ 1201.40215 1201.10082