Benchmark

non-incremental/QF_BV/sage/app7/bench_8612.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3335623
Compressed Size211414
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3335615
Compressed Size211420
Max. Term Depth12811
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2243 and1
=2945 let12706 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36786 bvmul7
bvsub11947 bvsdiv17 bvult546 bvule593
bvslt216 bvsle123 bvshl11740 bvashr22019
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49704
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54048
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54462
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54966
abziz_portfolio_2012_solvers default unsat ✅ 0.55075
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54298
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66249
Boolector-SMT-COMP-2011 default unsat ✅ 0.80655
Boolector-SMT-COMP-2012 default unsat ✅ 0.70118
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 351.33500
CVC3-SMT-COMP-2011 default unsat ✅ 293.75200
CVC3-SMT-COMP-2012 default unsat ✅ 307.23700
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85785
CVC4-SMT-EVAL-2013 default unsat ✅ 4.56707
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99712
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96672
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23920
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20332
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87094
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.08310
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.16470
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.35480
STP STP2-SMT-COMP-2011 default unsat ✅ 0.53455
STP2-SMT-COMP-2012 default unsat ✅ 0.50024
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53590
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58781
Z3-SMT-COMP-2011 default unsat ✅ 0.53934
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87136 0.87075
Boolector SMT17 final boolector unsat ✅ 0.87391 0.87342
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.25399 6.83006
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.65738 0.65575
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.25232 1.25233
Q3B Q3B default unsat ✅ 0.86438 2.24000
STP stp_st default unsat ✅ 0.57162 0.57034
stp_mt default unsat ✅ 0.57085 0.56916
Yices2 Yices2-Main default unsat ✅ 0.36932 0.36781
Z3 z3-4.5.0 default unsat ✅ 0.69775 0.69762
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78862 0.78853
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.99708 3.99712
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63669 0.63768
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27152 1.27160
Minkeyrink ST_st unsat ✅ 1.26802 1.26798
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57543 0.57548
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57974 0.57958
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57770 0.57775
Yices2 Yices 2.6.0_default unsat ✅ 0.36590 0.36580
Z3 z3-4.7.1_default unsat ✅ 0.83978 0.83964
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.25402 1.25374
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49755 1.49748
Poolector-wrapped-sq_default unsat ✅ 1.78233 6.40000
CVC4 CVC4-sq-final_default unsat ✅ 5.44117 5.44096
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79784 0.79770
MathSAT MathSAT5_default.sh unsat ✅ 0.65404 0.65393
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73764 0.73772
MinkeyRink Solver 2020.3_default unsat ✅ 0.76819 0.76667
STP STP_default unsat ✅ 0.54133 0.54140
STP ++ Mergsat v1_default unsat ✅ 0.54127 0.54291
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38037 0.38006
Z3 z3-4.8.8_default unsat ✅ 0.61856 0.61848
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24617 1.24612
Bitwuzla-wrapped_default unsat ✅ 1.44758 1.43753
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.19878 4.19907
MathSAT MathSAT-5.6.8_default unsat ✅ 0.69395 0.69266
STP STP 2022.4_default unsat ✅ 0.61622 0.61623
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37702 0.37692
Z3++BV z3++bv_0702_default unsat ✅ 0.76398 0.76346
Z3 z3-4.8.17_default unsat ✅ 0.72833 0.72990
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.96760 0.84861
Bitwuzla-MachBV-base unsat ✅ 1.22481 1.09443
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.45329 1.32842
BVDecide bv_decide unknown ❌ 1201.39144 1201.01081
bv_decide-nokernel unknown ❌ 1201.38372 1200.92755
cvc5 cvc5 unsat ✅ 1.33536 1.20737
SMTInterpol SMTInterpol unknown ❌ 1201.89605 1608.22802
Yices2 Yices2 unsat ✅ 0.46848 0.35122
Z3alpha Z3-alpha unsat ✅ 0.91828 0.89206
Z3 Z3-alpha-base unsat ✅ 0.51649 0.39171
Z3-Owl-base unsat ✅ 1.24877 1.12737
z3siri-base unsat ✅ 0.47924 0.36158
Z3-Owl Z3-Owl unsat ✅ 1.05773 0.92695