Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.815111.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size39656
Compressed Size6069
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 39648
Compressed Size6066
Max. Term Depth14
Asserts 263
Declared Functions14
Declared Constants32
Declared Sorts 16
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false21 ite30 not93
or18 and73 =>285 =534
forall228 exists7 let119 Int306
div2 mod2 +96 -80
*108 <124 <=76

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.04097 0.02499
CVC4 CVC4 f7118b2 default unsat ✅ 4.71446 4.70028
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 964.92100 965.09000
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.02686 0.02600
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1015.88000 1016.07000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1016.97000 1017.10000
Z3 z3 4.4.0 default unsat ✅ 997.05300 997.22200
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 690.28700 684.26100
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 4.57022 4.59261
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.14499 0.14328
Z3 z3-4.4.1 default unsat ✅ 963.83600 964.25300
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.88710 0.88673
Vampire vampire4.2-smt vampire unsat ✅ 3.80533 14.96000
Z3 z3-4.5.0 default unknown ❌ 600.02400 599.90000
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.89224 0.89244
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 16.15540 63.99000
Z3 z3-4.7.1_default unsat ✅ 941.00500 940.81300
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.08000 9530.63000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.88783 0.88813
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 1.04319 1.04351
Par4 Par4-wrapped-sq_default unsat ✅ 0.96582 1.80000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.42935 3.51992
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.44806 3.53555
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.33252 4.79000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 25.03700 99.14000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 968.76500 968.52500
z3-4.7.1_default unsat ✅ 956.92800 956.79300
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4768.63000
CVC4 CVC4-sq-final_default unsat ✅ 0.92916 0.92947
Par4 Par4-wrapped-sq_default unsat ✅ 0.97844 1.83000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.40294 3.47369
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.64822 2.35000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 28.96290 113.95000
Z3 z3-4.8.8_default unsat ✅ 925.35900 925.10200
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.93772 0.93805
cvc5 cvc5-fixed_default unsat ✅ 2.08068 2.08113
Par4 Par4-wrapped-sq_default unsat ✅ 1.01436 1.81000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.43796 0.69633
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.93179 4.92635
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 1.05441 4.06000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.26171 0.20713
Z3 z3-4.8.11_default unsat ✅ 890.06900 889.92000