Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.890929.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size3918
Compressed Size1016
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3910
Compressed Size1034
Max. Term Depth10
Asserts 39
Declared Functions7
Declared Constants11
Declared Sorts 6
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false2 ite2 not7 or2
and3 =>16 =40 forall15
let10 Int26 +24 -19
*14 <20 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00904 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.02431 0.01300
veriT veriT-smtcomp2014 default unsat ✅ 0.01345 0.00500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.02000 2400.08000
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00872 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01693 0.01500
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01730 0.01500
veriT veriT default unsat ✅ 0.00800 0.00400
Z3 z3 4.4.0 default unsat ✅ 0.04457 0.04499
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01973 0.01992
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.37387 2.38523
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.05526 0.05529
veriT veriT-dev default unsat ✅ 0.01248 0.00940
Z3 z3-4.4.1 default unsat ✅ 0.04434 0.04566
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.02044 0.02013
Vampire vampire4.2-smt vampire unsat ✅ 0.03977 0.03974
veriT veriT-2017-06-17 default unsat ✅ 0.00953 0.00852
Z3 z3-4.5.0 default unsat ✅ 0.04974 0.04923
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.02047 0.02071
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08522 0.14780
veriT veriT_default unsat ✅ 0.00967 0.00990
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.94000
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.03175 0.03250
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.02540 0.02574
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.02231 0.02261
Par4 Par4-wrapped-sq_default unsat ✅ 0.02451 0.00603
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 0.33797 0.46639
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.41347 3.37313
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15923 3.37158
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.07280 3.26616
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.08433 0.07351
veriT veriT-wrapped-sq_default unsat ✅ 0.01322 0.01359
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.06085 0.06082
SMT-COMP 2020 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.03977 0.03907
CVC4 CVC4-sq-final_default unsat ✅ 0.02662 0.02688
Par4 Par4-wrapped-sq_default unsat ✅ 0.01958 0.00626
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.59205 0.87677
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.37996 3.42485
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.15518 0.14227
veriT veriT_default unsat ✅ 0.01367 0.01341
veriT+vite_default unsat ✅ 0.01144 0.01175
Z3 z3-4.8.8_default unsat ✅ 0.05496 0.05492
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 0.02750 0.02780
cvc5 cvc5-fixed_default unsat ✅ 0.02786 0.02842
Par4 Par4-wrapped-sq_default unsat ✅ 0.02459 0.00887
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.53853 0.91743
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.49789 5.43042
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.06307 0.06335
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.10690 0.09522
veriT veriT_default unsat ✅ 0.01348 0.01291
Z3 z3-4.8.11_default unsat ✅ 0.04267 0.04261
z3-4.8.8_default unsat ✅ 0.05550 0.05547
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.02784 0.02815
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.04023 0.04078
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.84808 4.65414
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.14095 0.14258
veriT veriT_default unsat ✅ 0.01293 0.01330
Z3 z3-4.8.17_default unsat ✅ 0.04186 0.04356
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.22365 0.12402
iProver iProver v3.9 unsat ✅ 0.86324 1.02550
SMTInterpol SMTInterpol unsat ✅ 0.58268 0.89499
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.28630 0.15796
iProver iProver v3.9.3 unsat ✅ 0.85396 0.96608
SMTInterpol SMTInterpol unsat ✅ 0.56284 0.77982
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.90840 4.06228