Benchmark

non-incremental/QF_BV/sage/app7/bench_8631.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3334831
Compressed Size211330
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3334823
Compressed Size211335
Max. Term Depth12808
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2239 and1
=2940 let12703 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36783 bvmul6
bvsub11945 bvsdiv15 bvult540 bvule589
bvslt216 bvsle122 bvshl11740 bvashr22018
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49956 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54237 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.53711 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54129 —
abziz_portfolio_2012_solvers default unsat ✅ 0.54736 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54115 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66402 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79908 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70638 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 351.17500 —
CVC3-SMT-COMP-2011 default unsat ✅ 294.22400 —
CVC3-SMT-COMP-2012 default unsat ✅ 306.57600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.86377 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.54749 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99764 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96839 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23663 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20520 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87172 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.06592 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.17230 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34246 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52674 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49868 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53312 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58489 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53638 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86947 0.86875
Boolector SMT17 final boolector unsat ✅ 0.92393 0.92079
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.37524 7.03869
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.66085 0.65763
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.30191 1.29940
Q3B Q3B default unsat ✅ 0.86950 2.24000
STP stp_st default unsat ✅ 0.59038 0.59011
stp_mt default unsat ✅ 0.62690 0.62606
Yices2 Yices2-Main default unsat ✅ 0.36452 0.36386
Z3 z3-4.5.0 default unsat ✅ 0.72203 0.71862
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.79418 0.79413
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.98355 3.97605
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.64127 0.64217
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26734 1.26730
Minkeyrink ST_st unsat ✅ 1.28277 1.28276
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57114 0.57121
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57035 0.57034
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56883 0.56886
Yices2 Yices 2.6.0_default unsat ✅ 0.37218 0.37214
Z3 z3-4.7.1_default unsat ✅ 0.57512 0.57501
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.25544 1.25535
Boolector Boolector-wrapped-sq_default unsat ✅ 1.50177 1.50169
Poolector-wrapped-sq_default unsat ✅ 1.78199 6.60000
CVC4 CVC4-sq-final_default unsat ✅ 5.39126 5.39083
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79830 0.79815
MathSAT MathSAT5_default.sh unsat ✅ 0.65699 0.65698
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73877 0.73886
MinkeyRink Solver 2020.3_default unsat ✅ 0.76199 0.76208
STP STP_default unsat ✅ 0.54553 0.54561
STP ++ Mergsat v1_default unsat ✅ 0.54003 0.54175
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37881 0.37872
Z3 z3-4.8.8_default unsat ✅ 0.62298 0.62288
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.23881 1.23869
MathSAT mathsat-5.6.6_default unsat ✅ 0.67374 0.67366
STP STP 2021.0_default unsat ✅ 0.56719 0.56727
Z3 z3-4.8.11_default unsat ✅ 0.74964 0.74952
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.45638 1.35463
cvc5 cvc5 unsat ✅ 1.86675 1.76729
SMTInterpol SMTInterpol unknown ❌ 1202.72248 1383.92500
STP STP unsat ✅ 40.02900 39.91162
Yices2 Yices2 unsat ✅ 0.47101 0.37103
Z3alpha Z3-alpha unsat ✅ 0.63799 0.50478
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.98865 0.85759
Bitwuzla-MachBV-base unsat ✅ 1.19654 1.07214
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.35388 1.22914
BVDecide bv_decide unknown ❌ 1201.38344 1201.05314
bv_decide-nokernel unknown ❌ 1201.38939 1200.97992
cvc5 cvc5 unsat ✅ 1.30814 1.19074
SMTInterpol SMTInterpol unknown ❌ 1201.87137 1705.50820
Yices2 Yices2 unsat ✅ 0.53465 0.40550
Z3alpha Z3-alpha unsat ✅ 0.96234 0.94583
Z3 Z3-alpha-base unsat ✅ 0.54826 0.42262
Z3-Owl-base unsat ✅ 1.43424 1.29465
z3siri-base unsat ✅ 0.53456 0.41208
Z3-Owl Z3-Owl unsat ✅ 1.02139 0.90210