Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.755652.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size95456
Compressed Size14347
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 95448
Compressed Size14363
Max. Term Depth20
Asserts 481
Declared Functions211
Declared Constants152
Declared Sorts 224
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false39 ite5 not131
or30 and36 =>417 =1077
forall490 exists15 let226

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.17375 0.16497
CVC4 CVC4 f7118b2 default unsat ✅ 0.26480 0.25396
veriT veriT-smtcomp2014 default unsat ✅ 0.06817 0.06699
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.10157 0.09298
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.16689 0.16597
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.28922 0.28696
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.28667 0.28396
veriT veriT default unsat ✅ 0.09131 0.08998
Z3 z3 4.4.0 default unsat ✅ 0.11237 0.11198
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.33105 0.33164
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.52867 0.53178
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.12941 4.02000
veriT veriT-dev default unsat ✅ 0.05321 0.05339
Z3 z3-4.4.1 default unsat ✅ 0.11446 0.11575
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.27047 0.26959
Vampire vampire4.2-smt vampire unsat ✅ 0.70744 2.41000
veriT veriT-2017-06-17 default unsat ✅ 6.05313 6.05269
Z3 z3-4.5.0 default unsat ✅ 0.15041 0.14975
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30152 0.30173
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.19525 4.29000
veriT veriT_default unsat ✅ 6.06210 6.06161
Z3 z3-4.7.1_default unsat ✅ 0.12307 0.12302
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.35180 0.35206
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1041.46000 4121.19000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 1484.41000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.93253 5.16741
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.95912 3.45000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.80271 2.82000
veriT veriT_default unsat ✅ 0.05970 0.06005
Z3 z3-4.8.11_default unsat ✅ 0.12372 0.12367
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.30055 0.30032
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.34381 0.34344
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 3.66201 12.72000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.08000 1552.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.77643 4.93288
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.67904 2.30000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.41658 0.41644
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.38199 0.28242
iProver iProver v3.9 unsat ✅ 35.42102 132.48863
SMTInterpol SMTInterpol unknown ❌ 1202.21920 1610.64512
Yices2 Yices2 unsat ✅ 0.41643 0.31660