Benchmark

non-incremental/QF_BV/sage/app7/bench_53.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3332151
Compressed Size210854
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3332143
Compressed Size210862
Max. Term Depth12804
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2215 and1
=2913 let12699 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36770 bvmul5
bvsub11941 bvsdiv11 bvult521 bvule567
bvslt214 bvsle122 bvshl11740 bvashr22017
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49915 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54421 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54207 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54063 —
abziz_portfolio_2012_solvers default unsat ✅ 0.54485 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54981 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66466 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.81079 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70408 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 351.20100 —
CVC3-SMT-COMP-2011 default unsat ✅ 293.52200 —
CVC3-SMT-COMP-2012 default unsat ✅ 306.09800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85599 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.54787 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.00017 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96723 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23813 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20955 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87184 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.03565 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.16766 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.35075 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52439 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49827 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53841 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58837 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53884 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.89200 0.89092
Boolector SMT17 final boolector unsat ✅ 0.86972 0.86865
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.23386 6.78440
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.67220 0.67224
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.26282 1.26188
Q3B Q3B default unsat ✅ 0.91534 2.16984
STP stp_st default unsat ✅ 0.57495 0.57375
stp_mt default unsat ✅ 0.57723 0.57634
Yices2 Yices2-Main default unsat ✅ 0.37053 0.36823
Z3 z3-4.5.0 default unsat ✅ 0.59330 0.59199
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78464 0.78448
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.98270 3.98246
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.64167 0.64268
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27713 1.27710
Minkeyrink ST_st unsat ✅ 1.26919 1.26914
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57881 0.57881
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57749 0.57751
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57586 0.57586
Yices2 Yices 2.6.0_default unsat ✅ 0.36905 0.36880
Z3 z3-4.7.1_default unsat ✅ 0.69762 0.69751
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.25764 1.25763
Boolector Boolector-wrapped-sq_default unsat ✅ 1.50062 1.50066
Poolector-wrapped-sq_default unsat ✅ 1.78033 6.62490
CVC4 CVC4-sq-final_default unsat ✅ 5.41877 5.41823
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.80043 0.80042
MathSAT MathSAT5_default.sh unsat ✅ 0.65471 0.65473
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73849 0.73863
MinkeyRink Solver 2020.3_default unsat ✅ 0.76640 0.76643
STP STP_default unsat ✅ 0.54443 0.54450
STP ++ Mergsat v1_default unsat ✅ 0.54335 0.54487
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37929 0.37908
Z3 z3-4.8.8_default unsat ✅ 0.69756 0.69316
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24506 1.24503
Bitwuzla-wrapped_default unsat ✅ 1.32600 1.32575
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.23112 4.23115
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66975 0.66966
STP STP 2022.4_default unsat ✅ 0.60381 0.60373
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37219 0.37218
Z3++BV z3++bv_0702_default unsat ✅ 0.73108 0.73099
Z3 z3-4.8.17_default unsat ✅ 0.65287 0.65469
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.90121 1.90090
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.03089 3.02835
STP STP 2022.4_default unsat ✅ 0.60594 0.60595
STP 2022.4_default unsat ✅ 0.60209 0.60206
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1310.38000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37096 0.37095
Z3-Owl z3-Owl-Final_default unsat ✅ 1.27219 1.27198
z3-Owl-Final_default unsat ✅ 1.28754 1.28779
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.96700 0.84314
Bitwuzla-MachBV-base unsat ✅ 1.21203 1.08213
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.40680 1.27665
BVDecide bv_decide unknown ❌ 1201.44656 1201.11134
bv_decide-nokernel unknown ❌ 1201.38434 1201.07019
cvc5 cvc5 unsat ✅ 1.27713 1.14888
SMTInterpol SMTInterpol unknown ❌ 1201.90035 1651.52987
Yices2 Yices2 unsat ✅ 0.48492 0.36773
Z3alpha Z3-alpha unsat ✅ 0.93904 0.92187
Z3 Z3-alpha-base unsat ✅ 0.62140 0.48908
Z3-Owl-base unsat ✅ 1.89824 1.78669
z3siri-base unsat ✅ 0.63407 0.50974
Z3-Owl Z3-Owl unsat ✅ 1.13225 1.01217