Benchmark

non-incremental/QF_BV/sage/app2/bench_524.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size342090
Compressed Size42623
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 342082
Compressed Size42633
Max. Term Depth887
Asserts 1
Declared Functions0
Declared Constants1331
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true37 ite1 not248 and1
=419 let865 extract163 bvand1778
bvor64 bvxor60 bvadd3636 bvmul22
bvsub2342 bvsdiv22 bvult126 bvule248
bvslt164 bvsle65 bvshl2196 bvashr1132
zero_extend1465

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04652 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.18196 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unsat ✅ 0.18030 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.18002 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04699 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.06886 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.04976 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.11699 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unsat ✅ 1.87580 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ 872.64800 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unsat ✅ 2.99508 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.96450 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.38483 —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unsat ✅ 0.04541 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04726 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unsat ✅ 0.17751 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07652 0.06977
Boolector SMT17 final boolector unsat ✅ 0.07976 0.07775
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.36619 6.55162
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08920 0.08878
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.20190 0.20113
Q3B Q3B default unsat ✅ 0.40021 0.92866
STP stp_st default unsat ✅ 0.05423 0.05475
stp_mt default unsat ✅ 0.05578 0.05467
Yices2 Yices2-Main default unsat ✅ 0.03103 0.03038
Z3 z3-4.5.0 default unsat ✅ 0.21830 0.21656
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07520 0.07515
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.91843 1.91853
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08671 0.08779
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19859 0.19861
Minkeyrink ST_st unsat ✅ 0.19834 0.19841
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05205 0.05209
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05205 0.05208
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05182 0.05191
Yices2 Yices 2.6.0_default unsat ✅ 0.03189 0.03183
Z3 z3-4.7.1_default unsat ✅ 0.17640 0.17627
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10914 0.10906
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13303 0.13305
Poolector-wrapped-sq_default unsat ✅ 0.27843 0.67978
CVC4 CVC4-sq-final_default unsat ✅ 1.63851 1.63866
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 30.67980 30.68090
MathSAT MathSAT5_default.sh unsat ✅ 0.09037 0.09029
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23170 0.23176
MinkeyRink Solver 2020.3_default unsat ✅ 0.24368 0.24374
STP STP_default unsat ✅ 0.05423 0.05432
STP ++ Mergsat v1_default unsat ✅ 0.04805 0.04965
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03526 0.03523
Z3 z3-4.8.8_default unsat ✅ 0.15690 0.15686
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10935 0.10933
MathSAT mathsat-5.6.6_default unsat ✅ 3.97953 3.97926
STP STP 2021.0_default unsat ✅ 0.14555 0.14570
Z3 z3-4.8.11_default unsat ✅ 0.12474 0.12466
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11278 0.11275
Bitwuzla-wrapped_default unsat ✅ 0.11360 0.11353
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.93220 1.93100
MathSAT MathSAT-5.6.8_default unsat ✅ 4.26352 4.26312
STP STP 2022.4_default unsat ✅ 0.05235 0.05240
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03606 0.03604
Z3++BV z3++bv_0702_default unsat ✅ 9.00741 9.00639
Z3 z3-4.8.17_default unsat ✅ 0.10940 0.11115
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16619 0.16405
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.90411 1.90252
STP STP 2022.4_default unsat ✅ 0.05279 0.05283
STP 2022.4_default unsat ✅ 0.05250 0.05255
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.40980 37.48630
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03535 0.03529
Z3-Owl z3-Owl-Final_default unsat ✅ 0.71156 0.71145
z3-Owl-Final_default unsat ✅ 0.72016 0.72041