Benchmark

non-incremental/UFIDL/sledgehammer/QEpres/smtlib.858852.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size1496
Compressed Size604
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1488
Compressed Size612
Max. Term Depth8
Asserts 7
Declared Functions10
Declared Constants7
Declared Sorts 10
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 not2 and1
=14 forall4 Int3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.01637 0.00800
CVC4 CVC4 f7118b2 default sat ✅ 0.12591 0.10198
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.02444 0.01700
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.00885 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 0.18555 0.16198
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 0.19971 0.17197
veriT veriT default unknown ❌ 0.00831 0.00200
Z3 z3 4.4.0 default sat ✅ 0.03998 0.03999
SMT-COMP 2016 0.75 (1/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 0.20792 0.21047
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 999.95800 1005.14000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1018.99000 4026.38000
veriT veriT-dev default unknown ❌ 0.06218 0.06939
Z3 z3-4.4.1 default sat ✅ 0.03978 0.04102
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default sat ✅ 0.29169 0.29278
Vampire vampire4.2-smt vampire unknown ❌ 600.04600 2384.58000
veriT veriT-2017-06-17 default unknown ❌ 0.09089 0.10814
Z3 z3-4.5.0 default sat ✅ 0.04739 0.04731
SMT-COMP 2018 0.75 (1/4) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 0.24375 0.24580
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.08000 4778.30000
veriT veriT_default unknown ❌ 0.08882 0.09699
Z3 z3-4.7.1_default sat ✅ 0.05344 0.05338
SMT-COMP 2019 0.57 (3/7) CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 0.30932 0.31179
Par4 Par4-wrapped-sq_default sat ✅ 0.06114 0.00581
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 0.34840 0.58973
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.28751 3.35503
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15506 3.44802
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.37850 3.31140
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.08000 9284.22000
veriT veriT-wrapped-sq_default unknown ❌ 0.10987 0.12213
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.05716 0.05718
z3-4.7.1_default sat ✅ 0.05466 0.05460
SMT-COMP 2020 0.57 (3/7) CVC4 CVC4-sq-final_default unknown ❌ 0.38111 0.30392
Par4 Par4-wrapped-sq_default sat ✅ 0.06317 0.00705
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 0.45359 0.79349
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.42628 3.39623
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.05000 1976.26000
veriT veriT_default unknown ❌ 1200.07000 1199.47000
veriT+vite_default unknown ❌ 0.01162 0.01061
Z3 z3-4.8.8_default sat ✅ 0.04988 0.04983
SMT-COMP 2021 0.62 (3/8) CVC4 CVC4-sq-final_default unknown ❌ 0.34776 0.32458
cvc5 cvc5-fixed_default unknown ❌ 0.29674 0.29775
Par4 Par4-wrapped-sq_default sat ✅ 0.07330 0.00634
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 0.47274 0.78284
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.97388 5.00003
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.05000 4643.56000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.03000 1977.32000
veriT veriT_default unknown ❌ 0.02561 0.02145
Z3 z3-4.8.11_default sat ✅ 0.03488 0.03486
z3-4.8.8_default sat ✅ 0.05259 0.05256
SMT-COMP 2022 0.83 (1/6) CVC4 CVC4-sq-final_default unknown ❌ 0.36802 0.32353
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 0.38515 0.36342
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.92715 4.65354
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1199.41000 4800.21000
veriT veriT_default unknown ❌ 0.01494 0.01172
Z3 z3-4.8.17_default sat ✅ 0.03711 0.03890
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 0.35220 0.31953
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 0.41501 0.35366
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 5.28834 2.37372
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 4.79820 0.92409
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.79918 4.78966
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1138.53000 4800.40000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unknown ❌ 0.45425 0.35660
iProver iProver v3.9 unknown ❌ 14.16336 13.11886
SMTInterpol SMTInterpol sat ✅ 0.51633 0.69967
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unknown ❌ 60.46631 60.33589
iProver iProver v3.9.3 unknown ❌ 14.56344 13.26731
SMTInterpol SMTInterpol sat ✅ 0.57850 0.73939
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.85935 3.76897