Benchmark

non-incremental/QF_BV/sage/app9/bench_94.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size37301
Compressed Size6700
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 37293
Compressed Size6708
Max. Term Depth101
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not113 and1
=174 let91 extract2 bvand6
bvor63 bvadd315 bvmul11 bvsub95
bvult86 bvule221 bvslt5 bvsle10
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.40274 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.52942 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.52199 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.52233 —
abziz_portfolio_2012_solvers default unsat ✅ 0.52890 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.52281 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.10805 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.34075 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.06636 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.33830 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.24470 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.10226 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.48624 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.11395 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.10957 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.15000 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.96063 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.35260 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.17742 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.13141 —
STP2-SMT-COMP-2012 default unsat ✅ 0.21640 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.56991 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.55552 —
Z3-SMT-COMP-2011 default unsat ✅ 0.52493 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.15508 0.15398
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.91452 1.79573
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.16746 2.30465
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.31239 0.31195
SMT-RAT SMT-RAT-final default unsat ✅ 49.70110 49.71640
STP stp-cryptominisat4 default unsat ✅ 0.18238 0.18097
stp-cmsat4-v15 default unsat ✅ 0.16268 0.16197
stp-cmsat4-mt-v15 default unknown ❌ 0.15834 0.15698
stp-minisat-v15 default unsat ✅ 0.16746 0.16597
Yices2 Yices default unsat ✅ 0.03377 0.03299
Z3 z3 4.4.0 default unsat ✅ 0.55493 0.55492
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.42596 0.42625
ABC_glucose glucose unsat ✅ 2.92508 2.92645
Boolector Boolector boolector unsat ✅ 0.09171 0.09174
Boolector preprop boolector unsat ✅ 0.10121 0.10123
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.92319 1.81720
MapleSTP MapleSTP default unsat ✅ 0.19086 0.19090
MapleSTP-mt default unsat ✅ 0.20773 0.43114
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.26277 0.26426
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.85013 1.14553
Q3B Q3B default unsat ✅ 24.61080 73.45000
STP stp-cms-exp-2016 default unsat ✅ 0.20770 0.20779
stp-cms-mt-2016 default unsat ✅ 0.20918 0.44322
stp-cms-st-2016 default unsat ✅ 0.19026 0.19031
stp-minisat-st-2016 default unsat ✅ 0.17675 0.17684
Yices2 Yices-2.4.2 default unsat ✅ 0.02881 0.02878
Z3 z3-4.4.1 default unsat ✅ 0.67085 0.67247
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.15264 0.15105
Boolector SMT17 final boolector unsat ✅ 0.19767 0.18380
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.41074 2.79139
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.27002 0.26997
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.32006 0.27641
Q3B Q3B default unsat ✅ 1.27518 3.38000
STP stp_st default unsat ✅ 0.85049 0.84990
stp_mt default unsat ✅ 0.87996 2.96616
Yices2 Yices2-Main default unsat ✅ 0.03637 0.03247
Z3 z3-4.5.0 default unsat ✅ 0.72672 0.72599
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.11579 0.11573
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.95690 0.95710
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.28322 0.28422
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.18155 0.25368
Minkeyrink ST_st unsat ✅ 0.17062 0.17065
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.79824 0.79812
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82335 2.75517
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.15801 1.15856
Yices2 Yices 2.6.0_default unsat ✅ 0.02544 0.02539
Z3 z3-4.7.1_default unsat ✅ 0.60806 0.60796
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.20379 0.20376
Boolector Boolector-wrapped-sq_default unsat ✅ 0.16589 0.16589
Poolector-wrapped-sq_default unsat ✅ 0.18755 0.19454
CVC4 CVC4-sq-final_default unsat ✅ 1.18575 1.18594
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 4.40493 4.40483
MathSAT MathSAT5_default.sh unsat ✅ 0.11301 0.11297
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04309 0.04317
MinkeyRink Solver 2020.3_default unsat ✅ 0.04509 0.04516
STP STP_default unsat ✅ 0.13233 0.16929
STP ++ Mergsat v1_default unsat ✅ 0.11539 0.11706
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04278 0.04270
Z3 z3-4.8.8_default unsat ✅ 0.56007 0.55896
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.19279 0.19275
Bitwuzla-wrapped_default unsat ✅ 0.18055 0.18035
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.32020 1.32078
MathSAT MathSAT-5.6.8_default unsat ✅ 0.14075 0.14070
STP STP 2022.4_default unsat ✅ 0.15815 0.15815
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.07845 0.07754
Z3++BV z3++bv_0702_default unsat ✅ 0.22314 0.22309
Z3 z3-4.8.17_default unsat ✅ 0.50036 0.50205
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90306 0.90215
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.00673 1.00551
STP STP 2022.4_default unsat ✅ 0.14641 0.14643
STP 2022.4_default unsat ✅ 0.14637 0.14642
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.97181 13.73490
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06332 0.06236
Z3-Owl z3-Owl-Final_default unsat ✅ 9.19952 9.19803
z3-Owl-Final_default unsat ✅ 10.24460 10.24270
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.75642 0.65686
cvc5 cvc5 unsat ✅ 1.93996 1.83962
SMTInterpol SMTInterpol unsat ✅ 83.72631 105.74318
STP STP unsat ✅ 0.33287 0.23323
Yices2 Yices2 unsat ✅ 0.23395 0.13411
Z3alpha Z3-alpha unsat ✅ 1.19659 1.09719
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.32801 0.18938
Bitwuzla-MachBV-base unsat ✅ 0.74851 0.62455
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.73502 0.60689
BVDecide bv_decide unsat ✅ 7.32813 7.19602
bv_decide-nokernel unsat ✅ 4.10684 3.97173
cvc5 cvc5 unsat ✅ 1.36722 1.24739
SMTInterpol SMTInterpol unsat ✅ 372.89908 393.13842
Yices2 Yices2 unsat ✅ 0.34853 0.22729
Z3alpha Z3-alpha unsat ✅ 2.28152 7.86211
Z3 Z3-alpha-base unsat ✅ 1.61349 1.49258
Z3-Owl-base unsat ✅ 6.15491 6.01796
z3siri-base unsat ✅ 1.66525 1.53653
Z3-Owl Z3-Owl unsat ✅ 4.36584 4.24951