Benchmark

non-incremental/UFLIA/sledgehammer/Fundamental_Theorem_Algebra/smtlib.628470.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size59670
Compressed Size7708
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 59662
Compressed Size7719
Max. Term Depth14
Asserts 454
Declared Functions32
Declared Constants59
Declared Sorts 41
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 false37 not69 or44
and61 =>427 =849 forall429
exists20 let83 Int287 +19
*2 <151 <=143

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01731 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 0.82940 0.81788
veriT veriT-smtcomp2014 default unsat ✅ 0.16581 0.15898
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.10766 0.10698
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00950 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.27046 0.26796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.26029 0.25696
veriT veriT default unsat ✅ 0.17872 0.17797
Z3 z3 4.4.0 default unsat ✅ 0.14208 0.14198
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.23250 0.23278
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 68.97640 69.56270
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 18.89140 74.55000
veriT veriT-dev default unsat ✅ 0.07054 0.07149
Z3 z3-4.4.1 default unsat ✅ 0.13172 0.13319
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.23790 0.23735
Vampire vampire4.2-smt vampire unsat ✅ 7.09768 27.99000
veriT veriT-2017-06-17 default unsat ✅ 2.29831 4.48798
Z3 z3-4.5.0 default unsat ✅ 0.13726 0.13664
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26013 0.26030
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 65.09560 258.41000
veriT veriT_default unsat ✅ 2.85203 2.85241
Z3 z3-4.7.1_default unsat ✅ 0.15237 0.15232
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 3.07537 11.85000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26423 0.26456
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26319 0.26348
Par4 Par4-wrapped-sq_default unsat ✅ 0.17344 0.00576
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 8360.94000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.41573 3.38143
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.06243 3.30158
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.34082 3.36799
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 80.26210 318.22000
veriT veriT-wrapped-sq_default unsat ✅ 2.01453 2.01456
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15491 0.15490
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 3.39267 13.24000
CVC4 CVC4-sq-final_default unsat ✅ 0.29680 0.29706
Par4 Par4-wrapped-sq_default unsat ✅ 0.16788 0.00637
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.07000 3896.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.38032 3.54877
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 14.11570 55.68000
veriT veriT_default unsat ✅ 2.11900 2.11939
veriT+vite_default unsat ✅ 0.13897 0.13927
Z3 z3-4.8.8_default unsat ✅ 0.16742 0.16737
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 0.36489 0.36221
cvc5 cvc5-fixed_default unsat ✅ 0.27506 0.27563
Par4 Par4-wrapped-sq_default unsat ✅ 0.16204 0.00658
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 3583.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.94498 5.03481
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 40.09960 158.29000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 14.76500 58.23000
veriT veriT_default unsat ✅ 0.10576 0.10615
Z3 z3-4.8.11_default unsat ✅ 0.16775 0.16740
z3-4.8.8_default unsat ✅ 0.20719 0.20518
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.30054 0.30084
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.36818 0.36873
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.83957 4.69215
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 19.63300 76.98000
veriT veriT_default unsat ✅ 0.11467 0.11500
Z3 z3-4.8.17_default unsat ✅ 0.16184 0.16361
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.26882 0.26917
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.36576 0.36629
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.65074 4.47870
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 2842.83000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.85105 4.94046
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 17.71250 70.04000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.35318 0.25381
iProver iProver v3.9 unsat ✅ 5.91868 19.74337
SMTInterpol SMTInterpol unknown ❌ 1202.74589 4067.07098