Benchmark

non-incremental/QF_BV/sage/app7/bench_647.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4423274
Compressed Size275129
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4423266
Compressed Size275135
Max. Term Depth16969
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2720 and1
=3503 let16755 extract1712 bvand45729
bvor30132 bvxor2276 bvadd49165 bvmul9
bvsub16111 bvsdiv28 bvult625 bvule649
bvslt220 bvsle126 bvshl15791 bvashr29849
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70646 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.69228 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.70193 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.70108 —
abziz_portfolio_2012_solvers default unsat ✅ 0.70048 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.69854 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94167 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06430 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.00088 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 241.77000 —
CVC3-SMT-COMP-2011 default unsat ✅ 204.39500 —
CVC3-SMT-COMP-2012 default unsat ✅ 213.77100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.64457 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.54954 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.30801 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27944 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.64892 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.59497 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.15294 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.57364 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.16835 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87386 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.73807 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70918 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76022 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76197 —
Z3-SMT-COMP-2011 default unsat ✅ 0.69227 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.17658 1.17504
Boolector SMT17 final boolector unsat ✅ 1.21034 1.20929
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.66487 8.99557
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.84787 0.84815
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.66318 1.66144
Q3B Q3B default unsat ✅ 1.08166 2.80000
STP stp_st default unsat ✅ 0.79546 0.79435
stp_mt default unsat ✅ 0.79739 0.79766
Yices2 Yices2-Main default unsat ✅ 0.47997 0.47917
Z3 z3-4.5.0 default unsat ✅ 0.87502 0.87029
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04282 1.04264
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.33914 5.33934
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83862 0.83960
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.70581 1.70581
Minkeyrink ST_st unsat ✅ 1.70713 1.70721
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82060 0.82061
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82779 0.82782
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.81915 0.81908
Yices2 Yices 2.6.0_default unsat ✅ 0.47550 0.47542
Z3 z3-4.7.1_default unsat ✅ 1.06751 1.06737
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67507 1.67479
Boolector Boolector-wrapped-sq_default unsat ✅ 2.00515 2.00502
Poolector-wrapped-sq_default unsat ✅ 2.38278 8.88000
CVC4 CVC4-sq-final_default unsat ✅ 7.25587 7.25529
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05212 1.05195
MathSAT MathSAT5_default.sh unsat ✅ 0.84701 0.84692
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.94712 0.94723
MinkeyRink Solver 2020.3_default unsat ✅ 0.97848 0.97843
STP STP_default unsat ✅ 0.77643 0.77653
STP ++ Mergsat v1_default unsat ✅ 0.77448 0.77611
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.49708 0.49702
Z3 z3-4.8.8_default unsat ✅ 0.51200 0.51192
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65783 3.21783
MathSAT mathsat-5.6.6_default unsat ✅ 0.87394 0.87392
STP STP 2021.0_default unsat ✅ 0.80944 0.80949
Z3 z3-4.8.11_default unsat ✅ 0.47563 0.47557
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.64802 1.64788
Bitwuzla-wrapped_default unsat ✅ 1.82057 1.82052
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.69119 5.69159
MathSAT MathSAT-5.6.8_default unsat ✅ 0.89373 0.89359
STP STP 2022.4_default unsat ✅ 0.86547 0.86446
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.49759 0.49750
Z3++BV z3++bv_0702_default unsat ✅ 1.00752 1.00736
Z3 z3-4.8.17_default unsat ✅ 0.99302 0.99130
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.52956 2.52954
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.21613 4.21103
STP STP 2022.4_default unsat ✅ 0.83713 0.83715
STP 2022.4_default unsat ✅ 0.84383 0.84344
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1334.09000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.48399 0.48391
Z3-Owl z3-Owl-Final_default unsat ✅ 1.17063 1.17068
z3-Owl-Final_default unsat ✅ 1.16818 1.16835
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.14968 1.02696
Bitwuzla-MachBV-base unsat ✅ 1.49895 1.36972
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.75088 1.61987
BVDecide bv_decide unknown ❌ 1201.39550 1200.92080
bv_decide-nokernel unknown ❌ 1201.39255 1200.98748
cvc5 cvc5 unsat ✅ 1.02726 0.90786
SMTInterpol SMTInterpol unknown ❌ 1201.88856 1631.41297
Yices2 Yices2 unsat ✅ 0.54725 0.42837
Z3alpha Z3-alpha unsat ✅ 1.12111 1.13866
Z3 Z3-alpha-base unsat ✅ 0.63144 0.50542
Z3-Owl-base unsat ✅ 1.83317 1.71394
z3siri-base unsat ✅ 0.63341 0.50553
Z3-Owl Z3-Owl unsat ✅ 1.20179 1.08049