Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.706868.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size18725
Compressed Size3254
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 18717
Compressed Size3267
Max. Term Depth12
Asserts 138
Declared Functions15
Declared Constants15
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false6 ite25 not28 or12
and22 =>143 =282 forall117
exists7 let34 Int241 div2
mod2 +49 -62 *76
<67 <=30

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02419 0.01600
CVC4 CVC4 f7118b2 default unsat ✅ 71.51460 71.52010
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1111.45000 1111.44000
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.01204 0.01100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 46.60530 46.61090
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 46.62790 46.64090
Z3 z3 4.4.0 default unknown ❌ 200.65600 200.68300
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 48.13390 46.36630
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 24.26730 24.37630
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.54744 9.82000
Z3 z3-4.4.1 default unknown ❌ 202.86900 202.90900
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 40.94730 40.82790
Vampire vampire4.2-smt vampire unsat ✅ 1.11657 4.27000
Z3 z3-4.5.0 default unknown ❌ 225.85100 225.75100
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.41594 0.41610
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.29547 0.32745
Z3 z3-4.7.1_default unknown ❌ 231.95400 231.94400
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4753.58000
CVC4 CVC4-sq-final_default unsat ✅ 191.61500 186.72200
Par4 Par4-wrapped-sq_default unsat ✅ 192.19300 379.87000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.29798 3.54809
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.69129 2.42000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.27116 0.31359
Z3 z3-4.8.8_default unknown ❌ 204.90900 204.79700
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 24.49370 24.49310
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.58897 0.58946
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91026 10.36530
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.80286 2.98000
Z3 z3-4.8.17_default unsat ✅ 50.32870 50.32080
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 92.41780 92.00890
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 234.16400 230.84200
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4737.99000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.85099 4.82334
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.60608 2.26000
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 90.85892 90.72636
iProver iProver v3.9.3 unsat ✅ 96.09537 378.07883
SMTInterpol SMTInterpol unknown ❌ 1201.88234 3880.70497
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.40227 5.85508