Benchmark

non-incremental/QF_BV/sage/app7/bench_334.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3299439
Compressed Size208061
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3299431
Compressed Size208047
Max. Term Depth12630
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2071 and1
=2747 let12525 extract1537 bvand34040
bvor22396 bvxor1949 bvadd36434 bvmul2
bvsub11902 bvsdiv5 bvult485 bvule523
bvslt212 bvsle121 bvshl11675 bvashr21920
zero_extend1307

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48875 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49919 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.49520 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.49543 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49368 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50174 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66885 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79129 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70797 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.00300 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.17300 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.83400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85722 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.49364 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98151 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96635 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.24609 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.19801 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87029 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.94133 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.13661 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34939 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52526 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49114 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52717 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54519 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49332 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.93210 0.92805
Boolector SMT17 final boolector unsat ✅ 0.87517 0.87375
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.15249 6.63722
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63752 0.63895
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.27758 1.27588
Q3B Q3B default unsat ✅ 0.84538 2.05000
STP stp_st default unsat ✅ 0.56474 0.56485
stp_mt default unsat ✅ 0.57245 0.57085
Yices2 Yices2-Main default unsat ✅ 0.37055 0.36974
Z3 z3-4.5.0 default unsat ✅ 0.59203 0.59084
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78811 0.78789
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.91763 3.91771
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63763 0.63700
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26869 1.26866
Minkeyrink ST_st unsat ✅ 1.27479 1.27476
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57151 0.57151
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57319 0.57326
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57842 0.57840
Yices2 Yices 2.6.0_default unsat ✅ 0.37030 0.37017
Z3 z3-4.7.1_default unsat ✅ 0.54841 0.54826
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24645 1.24628
Boolector Boolector-wrapped-sq_default unsat ✅ 1.53136 1.53117
Poolector-wrapped-sq_default unsat ✅ 1.78024 6.63000
CVC4 CVC4-sq-final_default unsat ✅ 5.36247 5.36235
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79050 0.79040
MathSAT MathSAT5_default.sh unsat ✅ 0.64997 0.64988
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73689 0.73696
MinkeyRink Solver 2020.3_default unsat ✅ 0.76306 0.76309
STP STP_default unsat ✅ 0.54075 0.54074
STP ++ Mergsat v1_default unsat ✅ 0.59780 0.59715
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38088 0.38080
Z3 z3-4.8.8_default unsat ✅ 0.60719 0.60710
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24401 1.24402
MathSAT mathsat-5.6.6_default unsat ✅ 0.65761 0.65742
STP STP 2021.0_default unsat ✅ 0.56116 0.56124
Z3 z3-4.8.11_default unsat ✅ 0.41739 0.41732
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21229 1.21203
Bitwuzla-wrapped_default unsat ✅ 1.37615 1.37234
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.13639 4.13628
MathSAT MathSAT-5.6.8_default unsat ✅ 0.68783 0.68768
STP STP 2022.4_default unsat ✅ 0.61254 0.61147
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37283 0.37274
Z3++BV z3++bv_0702_default unsat ✅ 0.41221 0.41212
Z3 z3-4.8.17_default unsat ✅ 0.41569 0.41719
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.97305 1.97303
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.99287 2.99303
STP STP 2022.4_default unsat ✅ 0.60094 0.60098
STP 2022.4_default unsat ✅ 0.59807 0.59811
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 1075.36000 1189.39000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37290 0.37285
Z3-Owl z3-Owl-Final_default unsat ✅ 1.10439 1.10427
z3-Owl-Final_default unsat ✅ 1.12767 1.12681
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.95490 0.83078
Bitwuzla-MachBV-base unsat ✅ 1.19106 1.06960
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.38062 1.25222
BVDecide bv_decide unknown ❌ 1201.38685 1200.99749
bv_decide-nokernel unknown ❌ 1201.38678 1200.93705
cvc5 cvc5 unsat ✅ 0.83445 0.70243
SMTInterpol SMTInterpol unknown ❌ 1201.84206 1953.32072
Yices2 Yices2 unsat ✅ 0.50575 0.37935
Z3alpha Z3-alpha unsat ✅ 0.92950 0.92036
Z3 Z3-alpha-base unsat ✅ 0.51280 0.38596
Z3-Owl-base unsat ✅ 1.32836 1.20817
z3siri-base unsat ✅ 0.54030 0.40739
Z3-Owl Z3-Owl unsat ✅ 1.08471 0.95192