Benchmark

non-incremental/UFLRA/FFT/smtlib.620535.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size686
Compressed Size389
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 678
Compressed Size390
Max. Term Depth4
Asserts 3
Declared Functions1
Declared Constants5
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 =3 forall1 Real1
+1 -3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.01753 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 0.01706 0.00700
veriT veriT-smtcomp2014 default unsat ✅ 0.01295 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.00766 0.00600
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.00810 0.00400
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01067 0.00800
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01038 0.00800
veriT veriT default unsat ✅ 0.00811 0.00200
Z3 z3 4.4.0 default unsat ✅ 0.03020 0.02999
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01241 0.01220
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.09029 0.09103
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.08945 0.08983
veriT veriT-dev default unsat ✅ 0.01344 0.00805
Z3 z3-4.4.1 default unsat ✅ 0.02978 0.03102
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01277 0.01178
Vampire vampire4.2-smt vampire unsat ✅ 0.07305 0.07337
veriT veriT-2017-06-17 default unsat ✅ 0.00794 0.00809
Z3 z3-4.5.0 default unsat ✅ 0.03333 0.03138
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01349 0.01255
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.71973 6.76000
veriT veriT_default unsat ✅ 0.00860 0.00882
Z3 z3-4.7.1_default unsat ✅ 0.03433 0.03430
SMT-COMP 2019 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.02302 0.02482
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.01698 0.01731
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.11000 2418.65000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.30837 3.37824
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.13975 3.28975
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.28044 3.32619
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.17226 0.24637
veriT veriT-wrapped-sq_default unsat ✅ 0.01214 0.01252
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03641 0.03638
z3-4.7.1_default unsat ✅ 0.03573 0.03570
SMT-COMP 2020 0.14 (6/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.02661 0.02618
CVC4 CVC4-sq-final_default unsat ✅ 0.01595 0.01624
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.37324 0.56208
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.39176 3.31763
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.79219 5.13000
veriT veriT_default unsat ✅ 0.01248 0.01234
veriT+vite_default unsat ✅ 0.01628 0.01012
Z3 z3-4.8.8_default unsat ✅ 0.03218 0.03214
z3-4.7.1_default unsat ✅ 0.03679 0.03673
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.01657 0.01689
cvc5 cvc5-fixed_default unsat ✅ 0.01908 0.01965
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.40168 0.60068
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.88751 4.67181
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 445.84100 1764.82000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.70893 0.82000
veriT veriT_default unsat ✅ 0.01165 0.01175
Z3 z3-4.8.11_default unsat ✅ 0.01661 0.01657
z3-4.7.1_default unsat ✅ 0.03689 0.03685
z3-4.8.8_default unsat ✅ 0.03244 0.03239
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.01703 0.01736
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.02227 0.02287
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.81279 4.71099
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.29885 0.15016
veriT veriT_default unsat ✅ 0.01145 0.01182
Z3 z3-4.8.17_default unsat ✅ 0.01739 0.01921
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.01985 0.02038
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.02231 0.02286
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.65218 4.59000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.44142 0.64562
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.22769 5.16561
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.91972 3.06268
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.23436 0.13473
iProver iProver v3.9 unsat ✅ 7.43831 24.16807
SMTInterpol SMTInterpol unsat ✅ 0.43581 0.45667
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.30003 0.16897
iProver iProver v3.9.3 unsat ✅ 7.41341 24.52834
SMTInterpol SMTInterpol unsat ✅ 0.48678 0.48071
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89193 3.77298