Benchmark

non-incremental/QF_BV/sage/app2/bench_536.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size337039
Compressed Size42479
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 337031
Compressed Size42488
Max. Term Depth808
Asserts 1
Declared Functions0
Declared Constants1310
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true36 ite1 not242 and1
=411 let786 extract163 bvand1750
bvor60 bvxor60 bvadd3592 bvmul22
bvsub2322 bvsdiv22 bvult125 bvule248
bvslt164 bvsle63 bvshl2168 bvashr1118
zero_extend1444

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04563
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.17818
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.18373
abziz_portfolio_2012_minfeatures default unsat ✅ 0.17874
abziz_portfolio_2012_solvers default unsat ✅ 0.17739
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.17793
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04835
Boolector-SMT-COMP-2011 default unsat ✅ 0.06782
Boolector-SMT-COMP-2012 default unsat ✅ 0.05856
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.08125
CVC3-SMT-COMP-2011 default unsat ✅ 1.80444
CVC3-SMT-COMP-2012 default unsat ✅ 1.84133
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 221.03100
CVC4-SMT-EVAL-2013 default unknown ❌ 879.24200
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.11996
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.11200
MathSAT5-SMT-COMP-2011 default unsat ✅ 2.88703
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14154
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.42886
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.98794
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.40542
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.37780
STP STP2-SMT-COMP-2011 default unsat ✅ 0.25102
STP2-SMT-COMP-2012 default unsat ✅ 0.04519
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04701
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.15556
Z3-SMT-COMP-2011 default unsat ✅ 0.17175
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07096 0.06996
Boolector SMT17 final boolector unsat ✅ 0.07128 0.07025
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.23834 6.30600
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08641 0.08674
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19009 0.18921
Q3B Q3B default unsat ✅ 0.38634 0.88952
STP stp_st default unsat ✅ 0.14545 0.14381
stp_mt default unsat ✅ 0.14446 0.14396
Yices2 Yices2-Main default unsat ✅ 0.03399 0.02993
Z3 z3-4.5.0 default unsat ✅ 0.14571 0.14484
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07281 0.07272
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.88719 1.88726
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08549 0.08655
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19395 0.19396
Minkeyrink ST_st unsat ✅ 0.19410 0.19416
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05169 0.05174
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05105 0.05106
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05176 0.05178
Yices2 Yices 2.6.0_default unsat ✅ 0.03178 0.03168
Z3 z3-4.7.1_default unsat ✅ 0.19023 0.19017
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10738 0.10734
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13166 0.13168
Poolector-wrapped-sq_default unsat ✅ 0.28034 0.67450
CVC4 CVC4-sq-final_default unsat ✅ 1.59955 1.59979
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 29.83840 29.83400
MathSAT MathSAT5_default.sh unsat ✅ 0.08934 0.08930
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.22991 0.22998
MinkeyRink Solver 2020.3_default unsat ✅ 0.24274 0.24283
STP STP_default unsat ✅ 0.05381 0.05391
STP ++ Mergsat v1_default unsat ✅ 0.04822 0.04988
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03449 0.03445
Z3 z3-4.8.8_default unsat ✅ 0.11184 0.11177
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10751 0.10728
Bitwuzla-wrapped_default unsat ✅ 0.11134 0.11128
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.86095 1.86149
MathSAT MathSAT-5.6.8_default unsat ✅ 4.23847 4.22953
STP STP 2022.4_default unsat ✅ 0.05446 0.05349
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03625 0.03616
Z3++BV z3++bv_0702_default unsat ✅ 2.19380 2.19194
Z3 z3-4.8.17_default unsat ✅ 0.10587 0.10643
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.18526 0.18521
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.84332 1.84370
STP STP 2022.4_default unsat ✅ 0.05304 0.05311
STP 2022.4_default unsat ✅ 0.05431 0.05336
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 11.95100 34.49430
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03645 0.03640
Z3-Owl z3-Owl-Final_default unsat ✅ 0.71393 0.71392
z3-Owl-Final_default unsat ✅ 0.72381 0.72399
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.31200 0.19370
Bitwuzla-MachBV-base unsat ✅ 0.34532 0.22381
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40321 0.28119
BVDecide bv_decide unsat ✅ 377.63582 377.38950
bv_decide-nokernel unsat ✅ 230.58101 230.35977
cvc5 cvc5 unsat ✅ 1.47755 1.34911
SMTInterpol SMTInterpol unsat ✅ 20.40545 40.86277
Yices2 Yices2 unsat ✅ 0.31261 0.17583
Z3alpha Z3-alpha unsat ✅ 0.43168 0.31898
Z3 Z3-alpha-base unsat ✅ 0.45057 0.33194
Z3-Owl-base unsat ✅ 1.25711 1.13819
z3siri-base unsat ✅ 0.41970 0.30167
Z3-Owl Z3-Owl unsat ✅ 0.88842 0.75747