Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.792741.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size41248
Compressed Size6320
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 41240
Compressed Size6354
Max. Term Depth14
Asserts 264
Declared Functions14
Declared Constants32
Declared Sorts 16
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false21 ite30 not92
or18 and73 =>285 =537
forall228 exists7 let130 Int306
div2 mod2 +129 -86
*154 <123 <=75

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.04296 0.01900
CVC4 CVC4 f7118b2 default unsat ✅ 0.33227 0.32895
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.06000
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02199 0.02100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.81859 0.81588
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.80858 0.80588
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2399.10000
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.74128 0.74254
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.09137 1.09672
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.15762 0.07658
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.29000
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.18163 2.18124
Vampire vampire4.2-smt vampire unsat ✅ 0.10233 0.10108
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.93000
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.01571 2.01587
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.12658 0.18157
Z3 z3-4.7.1_default unknown ❌ 1200.03000 1199.78000
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.98525 3.52000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.33385 0.33397
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.37452 0.37486
Par4 Par4-wrapped-sq_default unsat ✅ 0.35397 0.00575
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.28098 3.41235
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.53774 3.35255
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.18137 0.18138
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.12746 0.19268
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2399.60000
z3-4.7.1_default unknown ❌ 2400.04000 2399.73000
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4766.48000
CVC4 CVC4-sq-final_default unsat ✅ 1.82810 1.82821
Par4 Par4-wrapped-sq_default unsat ✅ 3.08867 6.09000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.47439 3.49357
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.11562 0.11545
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.11969 0.19607
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.69000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.36669 0.36697
cvc5 cvc5-fixed_default unsat ✅ 0.15430 0.15492
Par4 Par4-wrapped-sq_default unsat ✅ 0.35350 0.00950
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.39779 0.61011
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.87483 4.79196
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.29732 0.23193
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13475 0.13228
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.71000