Benchmark

non-incremental/QF_BV/sage/app7/bench_327.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3300365
Compressed Size207192
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3300357
Compressed Size207180
Max. Term Depth12639
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2072 and1
=2751 let12534 extract1541 bvand34041
bvor22396 bvxor1951 bvadd36436 bvmul2
bvsub11902 bvsdiv5 bvult487 bvule524
bvslt212 bvsle121 bvshl11675 bvashr21920
zero_extend1307

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48940 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50264 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50640 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.49611 —
abziz_portfolio_2012_solvers default unsat ✅ 0.50445 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49869 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65584 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79288 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69580 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.08800 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.16500 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.84000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.82162 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.49505 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99019 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95667 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23373 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.19825 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.86305 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.96429 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.13830 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.33787 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51847 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49117 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52513 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.53818 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49303 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86187 0.86025
Boolector SMT17 final boolector unsat ✅ 0.86752 0.86709
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.16026 6.66615
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64621 0.64581
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.27745 1.27699
Q3B Q3B default unsat ✅ 0.81237 2.01000
STP stp_st default unsat ✅ 0.55603 0.55495
stp_mt default unsat ✅ 0.61381 0.61254
Yices2 Yices2-Main default unsat ✅ 0.36380 0.36294
Z3 z3-4.5.0 default unsat ✅ 0.70478 0.70378
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78110 0.78095
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.88530 3.88560
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63102 0.63208
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.25997 1.25997
Minkeyrink ST_st unsat ✅ 1.26154 1.26154
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57397 0.57407
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57284 0.57283
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57465 0.57471
Yices2 Yices 2.6.0_default unsat ✅ 0.36685 0.36660
Z3 z3-4.7.1_default unsat ✅ 0.83652 0.83637
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50482 1.50485
Poolector-wrapped-sq_default unsat ✅ 1.80084 6.67626
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.19773 1.19766
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.10829 4.10823
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88703 0.88718
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.88888 0.88895
Par4 Par4-wrapped-sq_default unsat ✅ 0.38168 0.00681
STP STP-2019-wrapped-sq_default unsat ✅ 0.58158 0.58164
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58515 0.58531
stp-minisat-wrapped-sq_default unsat ✅ 0.58868 0.58881
stp-mt-wrapped-sq_default unsat ✅ 0.58256 0.58271
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58121 0.58087
stp-riss-wrapped-sq_default unsat ✅ 0.58620 0.58634
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.33900 0.33897
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33998 0.33996
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.33967 0.33968
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.34432 0.34431
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34220 0.34215
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.55697 0.55700
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.23653 1.23639
Boolector Boolector-wrapped-sq_default unsat ✅ 1.46619 1.46590
Poolector-wrapped-sq_default unsat ✅ 1.77973 6.39000
CVC4 CVC4-sq-final_default unsat ✅ 5.31833 5.31856
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.78500 0.78481
MathSAT MathSAT5_default.sh unsat ✅ 0.64144 0.64132
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73448 0.73450
MinkeyRink Solver 2020.3_default unsat ✅ 0.75740 0.75741
STP STP_default unsat ✅ 0.52984 0.52988
STP ++ Mergsat v1_default unsat ✅ 0.53153 0.53323
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37867 0.37766
Z3 z3-4.8.8_default unsat ✅ 0.39807 0.39796
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21760 1.21742
MathSAT mathsat-5.6.6_default unsat ✅ 0.65845 0.65833
STP STP 2021.0_default unsat ✅ 0.56234 0.56243
Z3 z3-4.8.11_default unsat ✅ 0.46009 0.45996
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21625 1.21617
Bitwuzla-wrapped_default unsat ✅ 1.30958 1.30947
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.14902 4.14768
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66647 0.66642
STP STP 2022.4_default unsat ✅ 0.60905 0.60855
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.36769 0.36759
Z3++BV z3++bv_0702_default unsat ✅ 0.51096 0.51087
Z3 z3-4.8.17_default unsat ✅ 0.49621 0.49784
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.88993 1.88987
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.99747 2.99760
STP STP 2022.4_default unsat ✅ 0.59761 0.59767
STP 2022.4_default unsat ✅ 0.59664 0.59671
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 1076.42000 1203.15000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37126 0.37103
Z3-Owl z3-Owl-Final_default unsat ✅ 1.28355 1.28352
z3-Owl-Final_default unsat ✅ 1.29803 1.29819
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.01773 0.88383
Bitwuzla-MachBV-base unsat ✅ 1.21470 1.09386
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.41297 1.27823
BVDecide bv_decide unknown ❌ 1201.38690 1200.90953
bv_decide-nokernel unknown ❌ 1201.43670 1200.97546
cvc5 cvc5 unsat ✅ 1.34291 1.20829
SMTInterpol SMTInterpol unknown ❌ 1201.89464 2510.38149
Yices2 Yices2 unsat ✅ 0.49213 0.36528
Z3alpha Z3-alpha unsat ✅ 0.98056 0.95648
Z3 Z3-alpha-base unsat ✅ 0.65620 0.52877
Z3-Owl-base unsat ✅ 2.09020 1.96427
z3siri-base unsat ✅ 0.66173 0.53581
Z3-Owl Z3-Owl unsat ✅ 1.17456 1.04646