Benchmark

non-incremental/QF_BV/sage/app8/bench_3237.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2832
Compressed Size797
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2824
Compressed Size797
Max. Term Depth17
Asserts 1
Declared Functions0
Declared Constants18
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not4 and1 =11
let4 bvor5 bvadd26 bvsub8
bvult3 bvule2 bvshl5 zero_extend18

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.03587 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.05665 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05043 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05566 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05068 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06190 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01452 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.03541 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.00957 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.03027 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.02807 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.02588 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.02582 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.02882 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.02233 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.01878 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.04886 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.02668 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.02653 —
STP STP2-SMT-COMP-2011 default unsat ✅ 2.58623 —
STP2-SMT-COMP-2012 default unsat ✅ 0.54897 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.93901 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03936 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04517 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.03305 0.03199
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.04133 0.06699
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.03969 0.06499
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.04979 0.04899
SMT-RAT SMT-RAT-final default unsat ✅ 1.61808 1.61775
STP stp-cryptominisat4 default unsat ✅ 0.41821 0.41694
stp-cmsat4-v15 default unsat ✅ 1.57452 1.57376
stp-cmsat4-mt-v15 default unknown ❌ 0.03911 0.03799
stp-minisat-v15 default unsat ✅ 0.97032 0.96985
Yices2 Yices default unsat ✅ 0.00834 0.00300
Z3 z3 4.4.0 default unsat ✅ 0.06145 0.06099
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.08998 0.08984
ABC_glucose glucose unsat ✅ 0.24995 0.25046
Boolector Boolector boolector unsat ✅ 0.07321 0.07324
Boolector preprop boolector unsat ✅ 0.07380 0.07423
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.03700 0.06167
MapleSTP MapleSTP default unsat ✅ 81.83350 81.88110
MapleSTP-mt default unsat ✅ 44.46510 176.10300
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.04683 0.04805
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.07098 0.07141
Q3B Q3B default unsat ✅ 0.07196 0.07264
STP stp-cms-exp-2016 default unsat ✅ 2.74665 2.74742
stp-cms-mt-2016 default unsat ✅ 0.87309 3.37780
stp-cms-st-2016 default unsat ✅ 1.15457 1.15503
stp-minisat-st-2016 default unsat ✅ 17.36360 17.37370
Yices2 Yices-2.4.2 default unsat ✅ 0.01209 0.00448
Z3 z3-4.4.1 default unsat ✅ 0.05808 0.05935
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02744 0.02642
Boolector SMT17 final boolector unsat ✅ 0.09618 0.09656
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04256 0.06934
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.04539 0.04537
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.09128 0.05758
Q3B Q3B default unsat ✅ 0.07712 0.07688
STP stp_st default unsat ✅ 0.41060 0.40996
stp_mt default unsat ✅ 0.41297 1.55046
Yices2 Yices2-Main default unsat ✅ 0.00762 0.00441
Z3 z3-4.5.0 default unsat ✅ 0.05821 0.05735
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.02230 0.02223
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.08044 0.08057
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.04381 0.04485
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04080 0.04661
Minkeyrink ST_st unsat ✅ 0.03901 0.03925
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.51285 0.51273
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.40671 1.53659
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.07007 1.07006
Yices2 Yices 2.6.0_default unsat ✅ 0.01994 0.00717
Z3 z3-4.7.1_default unsat ✅ 0.05541 0.05531
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05279 0.05271
Boolector Boolector-wrapped-sq_default unsat ✅ 0.03196 0.03197
Poolector-wrapped-sq_default unsat ✅ 0.18663 0.22182
CVC4 CVC4-sq-final_default unsat ✅ 0.02855 0.02884
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.08412 0.08398
MathSAT MathSAT5_default.sh unsat ✅ 0.03232 0.03225
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.03560 0.03579
MinkeyRink Solver 2020.3_default unsat ✅ 0.03728 0.04516
STP STP_default unsat ✅ 0.02988 0.03494
STP ++ Mergsat v1_default unsat ✅ 0.02242 0.02169
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02404 0.00654
Z3 z3-4.8.8_default unsat ✅ 0.05823 0.05816
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05048 0.05046
MathSAT mathsat-5.6.6_default unsat ✅ 0.02706 0.02698
STP STP 2021.0_default unsat ✅ 0.03072 0.04299
Z3 z3-4.8.11_default unsat ✅ 0.04518 0.04511
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.21946 0.11981
cvc5 cvc5 unsat ✅ 0.27718 0.17776
SMTInterpol SMTInterpol unsat ✅ 1.20893 3.24119
STP STP unsat ✅ 0.25791 0.15830
Yices2 Yices2 unsat ✅ 0.21169 0.11191
Z3alpha Z3-alpha unsat ✅ 0.27596 0.17663
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.28309 0.16063
Bitwuzla-MachBV-base unsat ✅ 0.29045 0.15933
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39435 0.27103
BVDecide bv_decide unsat ✅ 0.86278 0.70101
bv_decide-nokernel unsat ✅ 0.74927 0.58104
cvc5 cvc5 unsat ✅ 0.28478 0.16835
SMTInterpol SMTInterpol unsat ✅ 1.83652 4.96121
Yices2 Yices2 unsat ✅ 0.29545 0.16895
Z3alpha Z3-alpha unsat ✅ 0.40436 0.30287
Z3 Z3-alpha-base unsat ✅ 0.91804 0.79435
Z3-Owl-base unsat ✅ 3.01644 2.89293
z3siri-base unsat ✅ 0.89982 0.77994
Z3-Owl Z3-Owl unsat ✅ 1.76137 1.63011