Benchmark

non-incremental/QF_BV/sage/app12/bench_416.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size45636
Compressed Size6282
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 45628
Compressed Size6295
Max. Term Depth51
Asserts 1
Declared Functions0
Declared Constants268
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite32 not169 and1
=313 let41 bvor124 bvadd136
bvsub150 bvult132 bvule118 bvslt25
bvsle24 bvshl128 zero_extend275

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.31879 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.17036 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.16868 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.17176 —
abziz_portfolio_2012_solvers default sat ✅ 0.17397 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.17123 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.58512 —
Boolector-SMT-COMP-2011 default sat ✅ 2.71053 —
Boolector-SMT-COMP-2012 default sat ✅ 0.04447 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 18.32380 —
CVC3-SMT-COMP-2011 default sat ✅ 16.46860 —
CVC3-SMT-COMP-2012 default sat ✅ 16.90370 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.27237 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.24460 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.14117 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.86302 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.17601 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.13785 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.10609 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.39873 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.37010 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.10635 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.07220 —
STP2-SMT-COMP-2012 default sat ✅ 0.14914 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.36544 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.17847 —
Z3-SMT-COMP-2011 default sat ✅ 0.16562 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.37209 3.37149
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.44519 0.85187
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.52147 1.00585
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.81754 0.81688
SMT-RAT SMT-RAT-final default sat ✅ 182.62400 182.66900
STP stp-cryptominisat4 default sat ✅ 0.14990 0.14898
stp-cmsat4-v15 default sat ✅ 0.13372 0.13298
stp-cmsat4-mt-v15 default unknown ❌ 0.12012 0.11898
stp-minisat-v15 default sat ✅ 0.13332 0.13198
Yices2 Yices default sat ✅ 0.01530 0.01400
Z3 z3 4.4.0 default sat ✅ 0.17967 0.17997
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 16.62020 16.61700
ABC_glucose glucose sat ✅ 3.52757 3.52968
Boolector Boolector boolector sat ✅ 2.87202 2.87385
Boolector preprop boolector sat ✅ 2.78708 2.78869
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.54687 1.05806
MapleSTP MapleSTP default sat ✅ 0.14846 0.14848
MapleSTP-mt default sat ✅ 0.16348 0.35909
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.61959 0.62088
MinkeyRink Minkeyrink 2016 default sat ✅ 0.37912 0.54581
Q3B Q3B default unknown ❌ 2400.03000 7203.89000
STP stp-cms-exp-2016 default sat ✅ 0.15097 0.15102
stp-cms-mt-2016 default sat ✅ 0.16265 0.35851
stp-cms-st-2016 default sat ✅ 0.14835 0.14840
stp-minisat-st-2016 default sat ✅ 0.11809 0.11813
Yices2 Yices-2.4.2 default sat ✅ 0.01559 0.01581
Z3 z3-4.4.1 default sat ✅ 0.16489 0.16620
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.31217 1.31144
Boolector SMT17 final boolector sat ✅ 4.70688 4.70545
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.52783 1.01188
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.62755 0.62401
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.19213 0.16191
Q3B Q3B default unknown ❌ 600.06100 1193.41000
STP stp_st default sat ✅ 1.07950 1.07762
stp_mt default sat ✅ 1.57359 3.41479
Yices2 Yices2-Main default sat ✅ 0.01751 0.01694
Z3 z3-4.5.0 default sat ✅ 0.45169 0.45161
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.49076 0.49052
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.59657 0.59665
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.67521 0.67619
MinkeyRink Minkeyrink MT_mt sat ✅ 0.12460 0.20568
Minkeyrink ST_st sat ✅ 0.11696 0.11700
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.35956 0.35978
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.41691 0.74060
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.20453 1.20451
Yices2 Yices 2.6.0_default sat ✅ 0.01774 0.01765
Z3 z3-4.7.1_default sat ✅ 0.40341 0.40336
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.03865 1.03854
Boolector Boolector-wrapped-sq_default sat ✅ 0.96777 0.96770
Poolector-wrapped-sq_default sat ✅ 0.57943 1.90336
CVC4 CVC4-sq-final_default sat ✅ 0.39163 0.39191
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1200.05000
MathSAT MathSAT5_default.sh sat ✅ 0.56886 0.56882
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.09926 0.09946
MinkeyRink Solver 2020.3_default sat ✅ 0.10654 0.12633
STP STP_default sat ✅ 0.11103 0.14475
STP ++ Mergsat v1_default sat ✅ 0.11396 0.11565
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.04567 0.04557
Z3 z3-4.8.8_default sat ✅ 0.54619 0.54610
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.00851 1.00830
MathSAT mathsat-5.6.6_default sat ✅ 0.15487 0.15484
STP STP 2021.0_default sat ✅ 0.10853 0.14399
Z3 z3-4.8.11_default sat ✅ 0.80294 0.80229
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.71974 0.71964
Bitwuzla-wrapped_default sat ✅ 1.02806 1.02800
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.37954 0.38013
MathSAT MathSAT-5.6.8_default sat ✅ 0.19427 0.19419
STP STP 2022.4_default sat ✅ 0.08506 0.08509
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01781 0.01779
Z3++BV z3++bv_0702_default sat ✅ 0.13298 0.13289
Z3 z3-4.8.17_default sat ✅ 0.39227 0.39301
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.31903 0.19273
Bitwuzla-MachBV-base sat ✅ 0.33344 0.20719
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.88629 0.76760
BVDecide bv_decide sat ✅ 5.31952 5.14979
bv_decide-nokernel sat ✅ 4.98340 4.80781
cvc5 cvc5 sat ✅ 0.45357 0.33498
SMTInterpol SMTInterpol unknown ❌ 1201.48913 1227.17122
Yices2 Yices2 sat ✅ 0.33710 0.21596
Z3alpha Z3-alpha sat ✅ 0.60844 0.98766
Z3 Z3-alpha-base sat ✅ 1.13936 1.02076
Z3-Owl-base sat ✅ 3.95844 3.82910
z3siri-base sat ✅ 1.46009 1.33552
Z3-Owl Z3-Owl sat ✅ 3.62850 3.49923