Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.815840.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size17388
Compressed Size3167
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 17380
Compressed Size3177
Max. Term Depth9
Asserts 135
Declared Functions15
Declared Constants22
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false16 ite24 not28 or4
and15 =>115 =228 forall95
exists4 let42 Int170 +74
-55 *90 <55 <=33

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.32926 0.32095
CVC4 CVC4 f7118b2 default unsat ✅ 1.98440 1.97370
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 458.31400 458.39100
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.51539 0.51492
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1011.00000 1010.89000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1016.69000 1016.69000
Z3 z3 4.4.0 default unsat ✅ 443.43800 443.52000
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 659.82600 649.60100
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 17.19790 17.27860
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.34278 0.20365
Z3 z3-4.4.1 default unsat ✅ 506.08900 506.42400
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.56431 0.56355
Vampire vampire4.2-smt vampire unsat ✅ 0.76301 2.85000
Z3 z3-4.5.0 default unknown ❌ 600.05300 599.81000
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.48775 0.48774
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.50146 0.28311
Z3 z3-4.7.1_default unsat ✅ 439.06100 438.88400
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.04000 9532.79000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.49252 0.49279
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.58075 0.58093
Par4 Par4-wrapped-sq_default unsat ✅ 0.52707 0.99000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35643 3.45329
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.36741 3.40528
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.74876 2.54000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.05951 4.05000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 430.66300 430.48100
z3-4.7.1_default unsat ✅ 446.17100 446.05500
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.11000 4765.66000
CVC4 CVC4-sq-final_default unsat ✅ 0.52030 0.52058
Par4 Par4-wrapped-sq_default unsat ✅ 0.57518 1.06000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.49742 3.46705
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.24911 0.12531
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.49138 0.30129
Z3 z3-4.8.8_default unsat ✅ 481.25900 481.16500
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.33847 0.33904
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.60583 2.60618
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.12000 4751.78000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.83329 4.75144
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.28508 0.15290
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.50412 0.40457
iProver iProver v3.9 unknown ❌ 1201.72447 4778.49715
SMTInterpol SMTInterpol unknown ❌ 1201.73473 1250.92152