Benchmark

non-incremental/QF_BV/sage/app7/bench_16.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3333455
Compressed Size211266
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3333447
Compressed Size211271
Max. Term Depth12806
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2227 and1
=2927 let12701 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36778 bvmul5
bvsub11943 bvsdiv13 bvult529 bvule575
bvslt215 bvsle122 bvshl11740 bvashr22017
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49458 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49720 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51354 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50655 —
abziz_portfolio_2012_solvers default unsat ✅ 0.50847 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50416 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66604 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.80464 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70085 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.77700 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.79900 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.57800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.86226 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.54074 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99510 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95654 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23983 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.21039 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.88157 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.06978 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.17195 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34929 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52617 —
STP2-SMT-COMP-2012 default unsat ✅ 0.50012 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53353 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54690 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49604 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.96093 0.95218
Boolector SMT17 final boolector unsat ✅ 0.94944 0.94587
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.52780 7.19456
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.70299 0.70188
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.29916 1.29824
Q3B Q3B default unsat ✅ 1.11090 2.24000
STP stp_st default unsat ✅ 0.83693 0.65050
stp_mt default unsat ✅ 0.58715 0.58665
Yices2 Yices2-Main default unsat ✅ 0.52949 0.37651
Z3 z3-4.5.0 default unsat ✅ 0.92061 0.59140
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78801 0.78790
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.95370 3.95373
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63564 0.63664
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26627 1.26621
Minkeyrink ST_st unsat ✅ 1.26788 1.26782
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.58900 0.58889
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.58986 0.58783
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.58271 0.58269
Yices2 Yices 2.6.0_default unsat ✅ 0.37118 0.37106
Z3 z3-4.7.1_default unsat ✅ 0.83567 0.83556
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.23933 1.23921
MathSAT mathsat-5.6.6_default unsat ✅ 0.66992 0.66990
STP STP 2021.0_default unsat ✅ 0.56319 0.56328
Z3 z3-4.8.11_default unsat ✅ 0.73087 0.73079
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24342 1.24324
Bitwuzla-wrapped_default unsat ✅ 1.33411 1.32776
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.28962 4.28810
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67065 0.67045
STP STP 2022.4_default unsat ✅ 0.61975 0.61861
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37315 0.37309
Z3++BV z3++bv_0702_default unsat ✅ 0.40646 0.40639
Z3 z3-4.8.17_default unsat ✅ 0.41622 0.41797
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.91254 1.91231
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.04437 3.04277
STP STP 2022.4_default unsat ✅ 0.60674 0.60677
STP 2022.4_default unsat ✅ 0.60347 0.60346
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1317.04000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37267 0.37258
Z3-Owl z3-Owl-Final_default unsat ✅ 1.07734 1.07727
z3-Owl-Final_default unsat ✅ 1.10002 1.09819
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.19344 1.09328
cvc5 cvc5 unsat ✅ 1.77362 1.67400
SMTInterpol SMTInterpol unknown ❌ 1202.72120 1380.39273
STP STP unsat ✅ 35.36056 35.24450
Yices2 Yices2 unsat ✅ 0.46519 0.36510
Z3alpha Z3-alpha unsat ✅ 0.54550 0.44572
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.01380 0.88006
Bitwuzla-MachBV-base unsat ✅ 1.21590 1.09266
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.36394 1.24278
BVDecide bv_decide unknown ❌ 1201.39890 1200.91642
bv_decide-nokernel unknown ❌ 1201.35650 1200.98053
cvc5 cvc5 unsat ✅ 1.07941 0.95937
SMTInterpol SMTInterpol unknown ❌ 1201.87994 1557.50006
Yices2 Yices2 unsat ✅ 0.47724 0.35346
Z3alpha Z3-alpha unsat ✅ 0.93550 0.92051
Z3 Z3-alpha-base unsat ✅ 0.48288 0.36336
Z3-Owl-base unsat ✅ 1.27389 1.14484
z3siri-base unsat ✅ 0.49567 0.37424
Z3-Owl Z3-Owl unsat ✅ 1.03182 0.90985