Benchmark

non-incremental/UFLIA/sledgehammer/Fundamental_Theorem_Algebra/smtlib.924212.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size20778
Compressed Size3563
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 20770
Compressed Size3582
Max. Term Depth10
Asserts 266
Declared Functions31
Declared Constants53
Declared Sorts 33
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false8 ite6 not51 or1
and10 =>39 =496 forall197
exists4 let3 Int39 -22
<22 <=20

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01746 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 41.44170 41.43670
veriT veriT-smtcomp2014 default unknown ❌ 2399.31000 2400.09000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 206.80200 206.83400
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00986 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 21.26200 21.26380
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 21.27710 21.27980
veriT veriT default unknown ❌ 2400.01000 2400.81000
Z3 z3 4.4.0 default unsat ✅ 3.25492 3.25650
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 22.10730 20.42800
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.42244 2.43354
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.09445 0.08764
veriT veriT-dev default unknown ❌ 2400.09000 2401.34000
Z3 z3-4.4.1 default unsat ✅ 164.89500 165.00700
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 22.05690 20.31900
Vampire vampire4.2-smt vampire unsat ✅ 0.09307 0.08852
veriT veriT-2017-06-17 default unknown ❌ 600.02400 599.89000
Z3 z3-4.5.0 default unsat ✅ 13.18810 13.18740
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 33.33690 30.57200
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08274 0.08072
veriT veriT_default unknown ❌ 1200.02000 1199.97000
Z3 z3-4.7.1_default unsat ✅ 64.06920 64.06040
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.32241 0.32400
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 63.40410 60.55410
master-2018-06-10-b19c840-competition-default_default unsat ✅ 31.78960 30.34790
Par4 Par4-wrapped-sq_default unsat ✅ 29.19390 87.30000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 2402.38000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.49236 3.51942
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16732 3.51455
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39670 3.43884
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.61262 0.30929
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.76000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 8.59343 8.55812
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 34.35220 30.67920
cvc5 cvc5-fixed_default unsat ✅ 30.66450 30.27690
Par4 Par4-wrapped-sq_default unsat ✅ 4.97990 14.83000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 6.98109 17.33990
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.80678 4.65704
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.24328 0.18168
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.11085 0.11066
veriT veriT_default unknown ❌ 1200.08000 1199.92000
Z3 z3-4.8.11_default unsat ✅ 430.55200 430.55700
z3-4.8.8_default unsat ✅ 6.67868 6.67762
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 35.85300 30.77330
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 35.67310 30.70080
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.83940 4.59790
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.14212 0.14092
veriT veriT_default unknown ❌ 1200.10000 1199.82000
Z3 z3-4.8.17_default unsat ✅ 104.08700 104.06600
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 35.72610 30.76300
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 36.51310 30.67300
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.15228 3.65992
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 8.79843 20.90870
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.12657 4.76695
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.13705 0.13662
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 30.31228 30.21035
iProver iProver v3.9 unsat ✅ 1.40915 4.16481
SMTInterpol SMTInterpol unsat ✅ 1.91379 5.34146