Benchmark

non-incremental/UFLIA/sledgehammer/FFT/smtlib.935711.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size995
Compressed Size480
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 987
Compressed Size479
Max. Term Depth9
Asserts 5
Declared Functions2
Declared Constants6
Declared Sorts 4
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 =>3 =4 forall4
let1 Int2 -1 <3
<=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01682 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.02451 0.01100
veriT veriT-smtcomp2014 default unsat ✅ 0.01227 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.01494 0.01400
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00877 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01342 0.01100
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01364 0.01100
veriT veriT default unsat ✅ 0.00793 0.00200
Z3 z3 4.4.0 default unsat ✅ 0.03769 0.03699
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01592 0.01618
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 8.16198 8.19872
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.51955 0.53904
veriT veriT-dev default unsat ✅ 0.01243 0.00944
Z3 z3-4.4.1 default unsat ✅ 0.03685 0.03813
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01590 0.01564
Vampire vampire4.2-smt vampire unsat ✅ 2.06571 7.79000
veriT veriT-2017-06-17 default unsat ✅ 0.00905 0.00838
Z3 z3-4.5.0 default unsat ✅ 0.04258 0.04191
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01615 0.01634
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 240.50500 956.58000
veriT veriT_default unsat ✅ 0.01191 0.00903
Z3 z3-4.7.1_default unsat ✅ 0.05131 0.05126
SMT-COMP 2020 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.03699 0.03490
CVC4 CVC4-sq-final_default unsat ✅ 0.02074 0.02107
Par4 Par4-wrapped-sq_default unsat ✅ 0.02000 0.00679
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.47027 0.80302
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.40492 3.51361
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 4.40674 17.28000
veriT veriT_default unsat ✅ 0.01292 0.01310
veriT+vite_default unsat ✅ 0.01128 0.01162
Z3 z3-4.8.8_default unsat ✅ 0.04791 0.04787
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 0.02047 0.02079
cvc5 cvc5-fixed_default unsat ✅ 0.02241 0.02297
Par4 Par4-wrapped-sq_default unsat ✅ 0.02149 0.00643
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.51316 0.84753
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.83052 4.74485
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.59145 2.10000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.78641 2.85000
veriT veriT_default unsat ✅ 0.01353 0.01202
Z3 z3-4.8.11_default unsat ✅ 0.03339 0.03334
z3-4.8.8_default unsat ✅ 0.04825 0.04818
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.02643 0.02689
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.03071 0.03126
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 13.17620 49.96000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.56575 0.97731
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.82647 4.73489
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.74225 2.55000