Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.577518.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size71205
Compressed Size9681
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 71197
Compressed Size9699
Max. Term Depth14
Asserts 462
Declared Functions69
Declared Constants78
Declared Sorts 82
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 false63 ite2 not88
or31 and45 =>441 =1143
forall485 exists22 let182

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.23045 0.21996
CVC4 CVC4 f7118b2 default unsat ✅ 20.73740 20.73680
veriT veriT-smtcomp2014 default unsat ✅ 71.26020 71.28720
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.19230 0.18397
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.27517 0.27496
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.78434 0.78188
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.77114 0.76888
veriT veriT default unsat ✅ 548.26600 548.44500
Z3 z3 4.4.0 default unsat ✅ 0.19345 0.19297
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.99843 0.99956
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.06500 995.95500
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 999.13100 3602.76000
veriT veriT-dev default unsat ✅ 5.61629 5.62061
Z3 z3-4.4.1 default unsat ✅ 0.19070 0.19229
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.52805 1.07543
Vampire vampire4.2-smt vampire unknown ❌ 600.06900 2304.10000
veriT veriT-2017-06-17 default unsat ✅ 0.22544 0.22479
Z3 z3-4.5.0 default unsat ✅ 0.20193 0.20138
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.98109 0.98132
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 180.03900 715.82000
veriT veriT_default unsat ✅ 0.28797 0.28823
Z3 z3-4.7.1_default unsat ✅ 0.29348 0.29338
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.51951 0.52003
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.47067 0.47012
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 4.16434 14.65000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 4113.64000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.08000 4.87913
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 682.86600 2717.99000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.83000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.53420 0.43446
iProver iProver v3.9 unsat ✅ 4.35907 13.75011
SMTInterpol SMTInterpol unknown ❌ 1188.70934 4369.53237
Yices2 Yices2 unknown ❌ 1201.38300 1200.83466