Benchmark

non-incremental/UF/sledgehammer/NS_Shared/smtlib.631242.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size16949
Compressed Size2617
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 16941
Compressed Size2629
Max. Term Depth12
Asserts 103
Declared Functions41
Declared Constants32
Declared Sorts 49
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false12 not6 or2 =>77
=173 forall102 let65

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2158.46000 2158.88000
CVC4 CVC4 f7118b2 default sat ✅ 40.67830 40.67580
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.61000 2400.01000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1149.20000 1149.53000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.39460 20.39490
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.39970 20.40490
veriT veriT default unknown ❌ 2400.01000 2397.82000
Z3 z3 4.4.0 default unknown ❌ 1490.86000 1490.75000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 319.14900 302.10600
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.92170 9.96853
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.24282 0.24181
veriT veriT-dev default unknown ❌ 2400.04000 2401.47000
Z3 z3-4.4.1 default unknown ❌ 1657.21000 1658.16000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 453.19900 450.90700
Vampire vampire4.2-smt vampire sat ✅ 0.16554 0.16420
veriT veriT-2017-06-17 default unknown ❌ 600.02300 599.89000
Z3 z3-4.5.0 default unknown ❌ 600.01200 599.69000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 481.04400 480.90300
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.38826 0.32728
veriT veriT_default unknown ❌ 1200.11000 1199.98000
Z3 z3-4.7.1_default unknown ❌ 1200.08000 1199.99000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9531.53000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 962.70200 961.18800
master-2018-06-10-b19c840-competition-default_default sat ✅ 480.98800 480.90400
Par4 Par4-wrapped-sq_default sat ✅ 481.10800 1441.79000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2407.62000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.39019 3.40388
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.07471 3.34696
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.18929 3.35257
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 1.43343 5.34000
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.57409 2.11000
veriT veriT-wrapped-sq_default unknown ❌ 2326.53000 2326.39000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.11000 2398.86000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 481.96100 481.15800
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 1.26891 3.84819
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 4104.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.84052 4.79043
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.48932 0.26322
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.36182 0.19532
veriT veriT_default unknown ❌ 1200.03000 1219.89000
Z3 z3-4.8.11_default unknown ❌ 517.66000 517.58900
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 481.15100 480.97400
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 512.17200 511.09200
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.87668 4.62305
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.53016 0.29198
veriT veriT_default unknown ❌ 1200.03000 1199.77000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.84000
Z3 z3-4.8.17_default unknown ❌ 492.55100 492.50900
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 515.24700 511.47300
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 511.84800 510.94500
iProver iProver-3.8-fix_iprover_SMT sat ✅ 343.42700 1343.68000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 3999.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.73244 4.76104
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.56135 0.63112
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1199.90000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.47264 540.29071
iProver iProver v3.9.3 sat ✅ 2.40107 7.29303
SMTInterpol SMTInterpol unknown ❌ 973.19181 3719.96072
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.95971 4.13054
Yices2 Yices2 unknown ❌ 1201.47422 1201.15548