Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.580209.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size71098
Compressed Size9790
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 71090
Compressed Size9829
Max. Term Depth14
Asserts 462
Declared Functions69
Declared Constants77
Declared Sorts 82
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 false59 ite2 not91
or32 and47 =>436 =1145
forall481 exists22 let183

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.24114 0.23296
CVC4 CVC4 f7118b2 default unsat ✅ 22.17460 22.16960
veriT veriT-smtcomp2014 default unsat ✅ 35.93860 35.94450
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.48222 1.47377
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.41655 0.41594
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 7.97822 7.97679
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 7.75744 7.75782
veriT veriT default unsat ✅ 179.01600 179.05500
Z3 z3 4.4.0 default unsat ✅ 1.31479 1.31580
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 10.33920 10.34320
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 991.05100 996.37700
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 999.37300 3596.90000
veriT veriT-dev default unsat ✅ 10.34490 10.35050
Z3 z3-4.4.1 default unsat ✅ 0.26836 0.26970
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.01250 1.01160
Vampire vampire4.2-smt vampire unsat ✅ 215.51900 856.70000
veriT veriT-2017-06-17 default unsat ✅ 0.18976 0.18895
Z3 z3-4.5.0 default unsat ✅ 3.13864 3.13237
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.16367 1.16382
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 218.71300 869.83000
veriT veriT_default unsat ✅ 0.21832 0.21859
Z3 z3-4.7.1_default unsat ✅ 0.37481 0.37473
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 2.65128 2.65124
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 3.52893 12.08120
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 4258.93000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.92291 5.03376
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.04000 4656.25000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 152.57900 611.35000
veriT veriT_default unsat ✅ 0.35490 0.35529
Z3 z3-4.8.11_default unsat ✅ 0.27832 0.27829
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.67048 0.67090
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.61152 0.60926
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 5.66846 20.18000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.09000 4290.08000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.98975 4.93015
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 690.59600 2747.00000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.90000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.72910 0.62932
iProver iProver v3.9 unsat ✅ 5.39682 18.04921
SMTInterpol SMTInterpol unknown ❌ 1202.74764 4464.90758
Yices2 Yices2 unknown ❌ 1201.44553 1200.82321