Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.844240.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size17173
Compressed Size3146
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 17165
Compressed Size3156
Max. Term Depth9
Asserts 135
Declared Functions15
Declared Constants22
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false17 ite22 not32 or5
and19 =>103 =221 forall96
exists2 let54 Int135 +79
-52 *87 <60 <=31

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unsat ✅ 0.60031 0.59191
CVC4 CVC4 f7118b2 default unsat ✅ 1.07189 1.06084
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.04000
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unsat ✅ 0.45382 0.45293
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 979.46000 1009.34000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1011.13000 1011.20000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.80000
SMT-COMP 2016 0.67 (1/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 697.88500 689.35200
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 994.30800 998.99000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1054.03000 3481.50000
Z3 z3-4.4.1 default unknown ❌ 2400.12000 2400.89000
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.49771 0.49281
Vampire vampire4.2-smt vampire unsat ✅ 41.60680 164.85000
Z3 z3-4.5.0 default unknown ❌ 600.02200 599.85000
SMT-COMP 2018 0.67 (1/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.44982 0.45006
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.08000 4775.10000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.78000
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9535.50000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.45149 0.45182
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.53046 0.53057
Par4 Par4-wrapped-sq_default unsat ✅ 0.48883 0.00664
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31579 3.30460
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.40831 3.34398
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 23.24270 92.11000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1304.02000 5286.75000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.02000
z3-4.7.1_default unsat ✅ 850.24900 850.20500
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4730.38000
CVC4 CVC4-sq-final_default unsat ✅ 0.42497 0.42513
Par4 Par4-wrapped-sq_default unsat ✅ 0.48297 0.00716
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.39761 3.43623
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 18.04800 71.43000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4763.55000
Z3 z3-4.8.8_default unknown ❌ 1200.11000 1199.80000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.45302 0.45334
cvc5 cvc5-fixed_default unsat ✅ 2.01682 2.01373
Par4 Par4-wrapped-sq_default unsat ✅ 0.48362 0.00629
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.28771 0.37614
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.96960 4.80479
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 856.27800 3367.12000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 17.17670 67.07000
Z3 z3-4.8.11_default unknown ❌ 1200.12000 1199.96000
SMT-COMP 2022 0.40 (3/5) CVC4 CVC4-sq-final_default unsat ✅ 0.45675 0.45710
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.59832 0.59880
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.74476 4.63956
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 43.66590 173.03000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.77000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.63454 0.53477
iProver iProver v3.9 unknown ❌ 1201.72313 4781.09836
SMTInterpol SMTInterpol unknown ❌ 1201.71724 1240.59839
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.45859 0.33175
iProver iProver v3.9.3 unknown ❌ 1201.75782 4792.67517
SMTInterpol SMTInterpol unknown ❌ 501.68336 1279.68405
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99830 4.28211