Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.610405.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size45084
Compressed Size6580
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 45076
Compressed Size6596
Max. Term Depth14
Asserts 291
Declared Functions15
Declared Constants17
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite24 not49 or19 and30
=>285 =457 forall286 exists3
let165 Int405 div3 mod2
+83 -105 *249 <189
<=92

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.03030 0.02100
CVC4 CVC4 f7118b2 default unsat ✅ 2.41323 2.39964
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2398.91000 2400.10000
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02545 0.02499
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.41229 0.40994
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.41461 0.41194
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.93000
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.43899 2.43783
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 30.14620 30.28990
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 11.20220 44.11000
Z3 z3-4.4.1 default unknown ❌ 2400.10000 2401.45000
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 10.19230 10.19190
Vampire vampire4.2-smt vampire unsat ✅ 22.70100 89.98000
Z3 z3-4.5.0 default unknown ❌ 166.88400 166.87600
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 21.69490 21.69300
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.64294 2.35000
Z3 z3-4.7.1_default unknown ❌ 154.12900 154.03900
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.31884 0.32011
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 183.67700 181.92100
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 18.69160 18.69170
Par4 Par4-wrapped-sq_default unsat ✅ 25.98990 51.28000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35534 3.37850
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.32423 3.33665
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 134.53900 564.63000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.61733 2.01000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 111.75900 111.71000
z3-4.7.1_default unknown ❌ 2155.35000 1824.39000
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.28040 0.27956
CVC4 CVC4-sq-final_default unsat ✅ 0.49463 0.49469
Par4 Par4-wrapped-sq_default unsat ✅ 0.52949 0.00675
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.33467 3.48956
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 11.66820 46.12000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.53346 0.43751
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.24000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 14.32780 14.32580
cvc5 cvc5-fixed_default unsat ✅ 29.06820 29.06680
Par4 Par4-wrapped-sq_default unsat ✅ 18.48230 36.86000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.30401 0.42008
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.89970 4.83103
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 92.14560 364.41000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 11.65620 46.07000
Z3 z3-4.8.11_default unknown ❌ 171.84700 171.77100
SMT-COMP 2022 0.40 (3/5) CVC4 CVC4-sq-final_default unsat ✅ 0.48025 0.48040
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.78335 0.78386
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.89313 4.77853
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 12.05510 47.64000
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.88000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 2.33162 2.23191
iProver iProver v3.9 unknown ❌ 1201.75447 4783.15361
SMTInterpol SMTInterpol unknown ❌ 1201.72308 1278.92160
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.36514 0.24050
iProver iProver v3.9.3 unknown ❌ 1201.75370 4791.22740
SMTInterpol SMTInterpol unknown ❌ 661.28982 2470.63824
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.90277 3.97838