Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.705999.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size94667
Compressed Size13951
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 94659
Compressed Size13989
Max. Term Depth20
Asserts 481
Declared Functions208
Declared Constants153
Declared Sorts 221
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false41 ite5 not124
or30 and33 =>415 =1083
forall477 exists6 let240

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.17082 0.16298
CVC4 CVC4 f7118b2 default unsat ✅ 0.23826 0.22696
veriT veriT-smtcomp2014 default unsat ✅ 0.07815 0.06799
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.08282 0.08099
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.17076 0.16997
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.25773 0.25496
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.25661 0.25396
veriT veriT default unsat ✅ 0.08995 0.08899
Z3 z3 4.4.0 default unsat ✅ 0.11093 0.11098
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.29963 0.29990
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.75682 0.76087
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.21582 8.53000
veriT veriT-dev default unsat ✅ 0.05437 0.05491
Z3 z3-4.4.1 default unsat ✅ 0.11288 0.11419
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26495 0.26479
Vampire vampire4.2-smt vampire unsat ✅ 0.94810 3.58000
veriT veriT-2017-06-17 default unsat ✅ 6.05360 6.05255
Z3 z3-4.5.0 default unsat ✅ 0.11925 0.11815
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29439 0.29458
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 3.29365 12.77000
veriT veriT_default unsat ✅ 6.05569 6.05576
Z3 z3-4.7.1_default unsat ✅ 0.12002 0.11992
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.34418 0.34447
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 19.82370 77.26000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.07000 1422.42000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.89593 5.32379
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 1.41750 5.33000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.36002 5.08000
veriT veriT_default unsat ✅ 0.05427 0.05465
Z3 z3-4.8.11_default unsat ✅ 0.12597 0.12587
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.34199 0.34233
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33445 0.33421
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.08472 5.27837
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.40344 5.29000
veriT veriT_default unsat ✅ 0.05561 0.05601
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.12315 0.12308
Z3 z3-4.8.17_default unsat ✅ 0.13615 0.13796
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.38289 0.28327
iProver iProver v3.9 unsat ✅ 6.86375 23.44108
SMTInterpol SMTInterpol unknown ❌ 1202.75246 1539.54717
Yices2 Yices2 unsat ✅ 0.23285 0.13259
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.45552 0.33254
iProver iProver v3.9.3 unsat ✅ 21.96187 79.57853
SMTInterpol SMTInterpol unknown ❌ 1201.76898 1848.08340
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94060 3.94005
Yices2 Yices2 unsat ✅ 0.30626 0.17984