Benchmark

non-incremental/QF_BV/sage/app11/bench_70.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1535747
Compressed Size153322
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1535739
Compressed Size153328
Max. Term Depth4223
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1312
and1 =2115 let2890 extract1503
bvand990 bvor281 bvxor2297 bvadd14666
bvmul1186 bvsdiv16 bvult1100 bvule1514
bvslt123 bvsle162 bvshl8918 bvashr13285
zero_extend10189

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16450 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41254 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.41390 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.41379 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41079 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.41450 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.22620 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30903 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24355 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.94350 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.31340 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.36390 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.69992 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.62810 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46085 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44889 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.35080 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54904 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46626 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.95095 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.81339 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.55174 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.09458 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16552 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26000 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44504 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40792 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32870 0.32789
Boolector SMT17 final boolector unsat ✅ 0.33600 0.33176
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.57013 6.37357
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.35212 0.35256
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69736 0.68964
Q3B Q3B default unsat ✅ 27.75410 82.20000
STP stp_st default unsat ✅ 6.74379 6.74197
stp_mt default unsat ✅ 7.44820 7.44726
Yices2 Yices2-Main default unsat ✅ 0.12659 0.12509
Z3 z3-4.5.0 default unsat ✅ 0.25355 0.25302
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29456 0.29449
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.34400 3.34376
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29937 0.30024
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68256 0.68257
Minkeyrink ST_st unsat ✅ 0.68507 0.68503
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 19.76120 19.75680
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 19.76520 19.76590
STP-Riss-st-2018_riss-no-stderr unsat ✅ 19.59690 19.59490
Yices2 Yices 2.6.0_default unsat ✅ 0.12188 0.12178
Z3 z3-4.7.1_default unsat ✅ 0.33933 0.33915
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.57727 1.12716
Poolector-wrapped-sq_default unsat ✅ 0.79237 2.86000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.52369 0.52361
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.33983 3.33987
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.34393 1.34404
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.33926 1.33929
Par4 Par4-wrapped-sq_default unsat ✅ 0.13262 0.00586
STP STP-2019-wrapped-sq_default unsat ✅ 28.33960 28.33400
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 28.23140 28.23010
stp-minisat-wrapped-sq_default unsat ✅ 28.40310 28.39960
stp-mt-wrapped-sq_default unsat ✅ 28.14650 28.14140
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 28.19840 28.19860
stp-riss-wrapped-sq_default unsat ✅ 28.38680 28.37730
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12843 0.12838
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12777 0.12774
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12782 0.12776
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12248 0.12244
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12779 0.12762
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.28948 0.28951
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42021 0.41994
Boolector Boolector-wrapped-sq_default unsat ✅ 0.58169 0.58102
Poolector-wrapped-sq_default unsat ✅ 0.77957 2.58000
CVC4 CVC4-sq-final_default unsat ✅ 3.78306 3.78324
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 86.77450 86.74720
MathSAT MathSAT5_default.sh unsat ✅ 0.30145 0.30140
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05394 1.05415
MinkeyRink Solver 2020.3_default unsat ✅ 1.11722 1.11727
STP STP_default unsat ✅ 10.71870 10.71900
STP ++ Mergsat v1_default unsat ✅ 11.14450 11.14640
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.14041 0.14033
Z3 z3-4.8.8_default unsat ✅ 0.21173 0.21169
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41761 0.41754
Bitwuzla-wrapped_default unsat ✅ 0.44840 0.44832
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.13169 4.13131
MathSAT MathSAT-5.6.8_default unsat ✅ 33.20240 33.19950
STP STP 2022.4_default unsat ✅ 0.19156 0.19158
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14043 0.14038
Z3++BV z3++bv_0702_default unsat ✅ 0.25935 0.25926
Z3 z3-4.8.17_default unsat ✅ 0.23595 0.23773
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.58982 0.58715
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.36732 3.36767
STP STP 2022.4_default unsat ✅ 0.19159 0.19159
STP 2022.4_default unsat ✅ 0.19115 0.19122
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1229.93000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13484 0.13478
Z3-Owl z3-Owl-Final_default unsat ✅ 0.93596 0.93574
z3-Owl-Final_default unsat ✅ 0.96582 0.96590
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.66066 0.56057
cvc5 cvc5 unsat ✅ 1.86954 1.76864
SMTInterpol SMTInterpol unknown ❌ 1202.72079 1969.02845
STP STP unsat ✅ 8.98871 8.88124
Yices2 Yices2 unsat ✅ 0.30539 0.20587
Z3alpha Z3-alpha unsat ✅ 0.44663 0.34675
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.70730 0.57603
Bitwuzla-MachBV-base unsat ✅ 0.65266 0.51915
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.74434 0.61814
BVDecide bv_decide unknown ❌ 1201.39525 1200.99658
bv_decide-nokernel unknown ❌ 1201.42623 1201.06805
cvc5 cvc5 unsat ✅ 1.04309 0.92781
SMTInterpol SMTInterpol unknown ❌ 1201.89351 2533.41399
Yices2 Yices2 unsat ✅ 0.37040 0.24060
Z3alpha Z3-alpha unsat ✅ 0.64584 0.56398
Z3 Z3-alpha-base unsat ✅ 0.40631 0.28869
Z3-Owl-base unsat ✅ 1.02358 0.89563
z3siri-base unsat ✅ 0.40683 0.28689
Z3-Owl Z3-Owl unsat ✅ 0.99585 0.86244