Benchmark

non-incremental/QF_BV/sage/app2/bench_520.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size348444
Compressed Size43971
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 348436
Compressed Size43983
Max. Term Depth887
Asserts 1
Declared Functions0
Declared Constants1348
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true38 ite1 not250 and1
=422 let845 extract163 bvand1800
bvor65 bvxor60 bvadd3669 bvmul22
bvsub2356 bvsdiv22 bvult127 bvule248
bvslt165 bvsle65 bvshl2218 bvashr1143
zero_extend1482

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.44 (5/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04684 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unsat ✅ 0.05137 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.02098 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.38718 —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unsat ✅ 0.04603 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04810 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unsat ✅ 0.30132 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.08059 0.07976
Boolector SMT17 final boolector unsat ✅ 0.07090 0.07026
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.45858 6.72106
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.09302 0.09244
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19439 0.19351
Q3B Q3B default unsat ✅ 0.40705 0.95207
STP stp_st default unsat ✅ 0.08723 0.06394
stp_mt default unsat ✅ 0.05605 0.05523
Yices2 Yices2-Main default unsat ✅ 0.03145 0.03097
Z3 z3-4.5.0 default unsat ✅ 0.17111 0.16976
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07587 0.07578
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.94498 1.94509
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08827 0.08931
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19733 0.19734
Minkeyrink ST_st unsat ✅ 0.19749 0.19749
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05248 0.05250
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05367 0.05375
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05224 0.05227
Yices2 Yices 2.6.0_default unsat ✅ 0.03310 0.03304
Z3 z3-4.7.1_default unsat ✅ 0.07851 0.07846
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10894 0.10891
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13324 0.13321
Poolector-wrapped-sq_default unsat ✅ 0.27714 0.68291
CVC4 CVC4-sq-final_default unsat ✅ 1.65123 3.20107
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 31.06000 31.04980
MathSAT MathSAT5_default.sh unsat ✅ 0.09461 0.09458
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23806 0.23814
MinkeyRink Solver 2020.3_default unsat ✅ 0.24866 0.24880
STP STP_default unsat ✅ 0.14185 0.14197
STP ++ Mergsat v1_default unsat ✅ 0.13768 0.13935
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03573 0.03572
Z3 z3-4.8.8_default unsat ✅ 0.27341 0.27334
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10949 0.10944
MathSAT mathsat-5.6.6_default unsat ✅ 3.76404 3.76350
STP STP 2021.0_default unsat ✅ 0.14369 0.14380
Z3 z3-4.8.11_default unsat ✅ 0.15879 0.15876
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10950 0.10948
Bitwuzla-wrapped_default unsat ✅ 0.11257 0.11247
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.92855 1.92900
MathSAT MathSAT-5.6.8_default unsat ✅ 3.95056 3.95071
STP STP 2022.4_default unsat ✅ 0.05325 0.05330
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03752 0.03749
Z3++BV z3++bv_0702_default unsat ✅ 25.46130 25.46000
Z3 z3-4.8.17_default unsat ✅ 0.14402 0.14542
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.17863 0.17847
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.92452 1.92314
STP STP 2022.4_default unsat ✅ 0.05311 0.05312
STP 2022.4_default unsat ✅ 0.05379 0.05376
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.19130 35.74710
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03802 0.03799
Z3-Owl z3-Owl-Final_default unsat ✅ 0.92878 0.92885
z3-Owl-Final_default unsat ✅ 1.00399 1.00412
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.33821 0.21954
Bitwuzla-MachBV-base unsat ✅ 0.32985 0.20616
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40679 0.28833
BVDecide bv_decide unsat ✅ 412.84769 412.62232
bv_decide-nokernel unsat ✅ 255.73479 255.49676
cvc5 cvc5 unsat ✅ 1.46742 1.34728
SMTInterpol SMTInterpol unsat ✅ 24.07658 47.47422
Yices2 Yices2 unsat ✅ 0.30159 0.17443
Z3alpha Z3-alpha unsat ✅ 0.39105 0.28813
Z3 Z3-alpha-base unsat ✅ 0.45560 0.33313
Z3-Owl-base unsat ✅ 1.46428 1.34582
z3siri-base unsat ✅ 0.49409 0.36571
Z3-Owl Z3-Owl unsat ✅ 0.90788 0.77978