Benchmark

non-incremental/QF_BV/sage/app2/bench_498.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size352889
Compressed Size44273
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 352881
Compressed Size44284
Max. Term Depth895
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not261 and1
=434 let866 extract163 bvand1824
bvor73 bvxor60 bvadd3708 bvmul22
bvsub2376 bvsdiv22 bvult128 bvule248
bvslt167 bvsle66 bvshl2242 bvashr1155
zero_extend1500

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04661 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.32169 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.32233 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.32157 —
abziz_portfolio_2012_solvers default unsat ✅ 0.32755 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.32505 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04836 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.06968 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.05133 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.27383 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.25688 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.24133 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 224.27500 —
CVC4-SMT-EVAL-2013 default unknown ❌ 873.21000 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.12322 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.11867 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.14944 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14235 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.43113 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.02094 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.40232 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.39201 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.26288 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04687 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04792 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.29560 —
Z3-SMT-COMP-2011 default unsat ✅ 0.31634 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.20349 0.08647
Boolector SMT17 final boolector unsat ✅ 0.07991 0.07895
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.52713 6.86852
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.09092 0.09140
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.20124 0.19784
Q3B Q3B default unsat ✅ 0.41523 0.97523
STP stp_st default unsat ✅ 0.06065 0.05506
stp_mt default unsat ✅ 0.05689 0.05628
Yices2 Yices2-Main default unsat ✅ 0.03229 0.03169
Z3 z3-4.5.0 default unsat ✅ 0.18053 0.17972
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07757 0.07749
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.98626 1.98631
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08955 0.09060
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.20073 0.20075
Minkeyrink ST_st unsat ✅ 0.20039 0.20042
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.14394 0.14393
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.14487 0.14491
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.14489 0.14489
Yices2 Yices 2.6.0_default unsat ✅ 0.03311 0.03306
Z3 z3-4.7.1_default unsat ✅ 0.26701 0.26694
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.13433 0.13433
Poolector-wrapped-sq_default unsat ✅ 0.27757 0.69169
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.12539 0.12537
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.76559 1.76535
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.29886 0.29901
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29497 0.29505
Par4 Par4-wrapped-sq_default unsat ✅ 0.04224 0.00587
STP STP-2019-wrapped-sq_default unsat ✅ 0.06060 0.06077
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06375 0.06390
stp-minisat-wrapped-sq_default unsat ✅ 0.06131 0.06143
stp-mt-wrapped-sq_default unsat ✅ 0.06112 0.06128
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.07185 0.06760
stp-riss-wrapped-sq_default unsat ✅ 0.06196 0.06213
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03414 0.03411
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03409 0.03411
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03404 0.03403
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.03328 0.03329
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03324 0.03324
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07896 0.07896
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11071 0.11059
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13523 0.13523
Poolector-wrapped-sq_default unsat ✅ 0.27762 0.68830
CVC4 CVC4-sq-final_default unsat ✅ 1.67903 1.67923
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 32.09480 32.09360
MathSAT MathSAT5_default.sh unsat ✅ 0.09283 0.09275
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23619 0.23629
MinkeyRink Solver 2020.3_default unsat ✅ 0.24963 0.24972
STP STP_default unsat ✅ 0.05564 0.05576
STP ++ Mergsat v1_default unsat ✅ 0.04996 0.05170
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03580 0.03578
Z3 z3-4.8.8_default unsat ✅ 0.10064 0.10058
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11080 0.11076
MathSAT mathsat-5.6.6_default unsat ✅ 3.74097 3.73961
STP STP 2021.0_default unsat ✅ 0.05700 0.05715
Z3 z3-4.8.11_default unsat ✅ 0.19436 0.19429
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.29396 0.19405
cvc5 cvc5 unsat ✅ 1.79641 1.69582
SMTInterpol SMTInterpol unsat ✅ 35.89820 71.46722
STP STP unsat ✅ 0.80529 0.70502
Yices2 Yices2 unsat ✅ 0.23197 0.13211
Z3alpha Z3-alpha unsat ✅ 0.39369 0.29418
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.41382 0.27475
Bitwuzla-MachBV-base unsat ✅ 0.35466 0.22843
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39933 0.27990
BVDecide bv_decide unsat ✅ 438.23836 437.96854
bv_decide-nokernel unsat ✅ 275.98821 275.78512
cvc5 cvc5 unsat ✅ 1.50209 1.37224
SMTInterpol SMTInterpol unsat ✅ 28.75379 55.21462
Yices2 Yices2 unsat ✅ 0.30456 0.17747
Z3alpha Z3-alpha unsat ✅ 0.42829 0.31668
Z3 Z3-alpha-base unsat ✅ 0.48530 0.36714
Z3-Owl-base unsat ✅ 1.65859 1.54356
z3siri-base unsat ✅ 0.48933 0.36859
Z3-Owl Z3-Owl unsat ✅ 0.88159 0.76099