Benchmark

non-incremental/QF_BV/sage/app7/bench_372.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3276885
Compressed Size206253
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3276877
Compressed Size206241
Max. Term Depth12496
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2046 and1
=2721 let12391 extract1435 bvand34009
bvor22387 bvxor1749 bvadd36275 bvmul2
bvsub11846 bvsdiv3 bvult483 bvule519
bvslt211 bvsle121 bvshl11572 bvashr21896
zero_extend1158

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48614 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.53350 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.53164 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54156 —
abziz_portfolio_2012_solvers default unsat ✅ 0.53778 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53884 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65756 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79686 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69336 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.37900 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.57800 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.34700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.82874 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.46333 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99816 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.94468 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.22172 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20189 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.86281 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.91094 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.12954 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.32807 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51704 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49082 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.51575 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58282 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53381 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.85864 0.85755
Boolector SMT17 final boolector unsat ✅ 0.86164 0.86104
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.19303 6.73236
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63368 0.63386
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.23728 1.23630
Q3B Q3B default unsat ✅ 0.82551 2.06000
STP stp_st default unsat ✅ 0.55606 0.55478
stp_mt default unsat ✅ 0.56203 0.56089
Yices2 Yices2-Main default unsat ✅ 0.36316 0.36246
Z3 z3-4.5.0 default unsat ✅ 0.51772 0.51738
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77525 0.77519
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.90833 3.90801
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63137 0.63232
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.25186 1.25182
Minkeyrink ST_st unsat ✅ 1.25365 1.25349
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56695 0.56695
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56698 0.56708
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56807 0.56810
Yices2 Yices 2.6.0_default unsat ✅ 0.36244 0.36240
Z3 z3-4.7.1_default unsat ✅ 0.57376 0.57364
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.47553 1.47552
Poolector-wrapped-sq_default unsat ✅ 1.79233 6.63933
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.19593 1.19579
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.04051 4.03545
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.87994 0.88008
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.87820 0.87828
Par4 Par4-wrapped-sq_default unsat ✅ 0.37406 0.00641
STP STP-2019-wrapped-sq_default unsat ✅ 0.58351 0.58359
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.57591 0.57604
stp-minisat-wrapped-sq_default unsat ✅ 0.58531 0.58541
stp-mt-wrapped-sq_default unsat ✅ 0.58232 0.58242
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.57634 0.57641
stp-riss-wrapped-sq_default unsat ✅ 0.61393 0.61414
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34085 0.34080
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33704 0.33706
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34722 0.34724
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33498 0.33489
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.33834 0.33829
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.63992 0.63985
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.22938 1.22907
Boolector Boolector-wrapped-sq_default unsat ✅ 1.48169 1.48156
Poolector-wrapped-sq_default unsat ✅ 1.78175 6.64649
CVC4 CVC4-sq-final_default unsat ✅ 5.34148 5.34182
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79084 0.79084
MathSAT MathSAT5_default.sh unsat ✅ 0.64223 0.64213
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.72575 0.72581
MinkeyRink Solver 2020.3_default unsat ✅ 0.74981 0.74989
STP STP_default unsat ✅ 0.53742 0.53748
STP ++ Mergsat v1_default unsat ✅ 0.53322 0.53487
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37512 0.37506
Z3 z3-4.8.8_default unsat ✅ 0.58111 0.58108
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21853 1.21838
MathSAT mathsat-5.6.6_default unsat ✅ 0.65345 0.65322
STP STP 2021.0_default unsat ✅ 0.55712 0.55722
Z3 z3-4.8.11_default unsat ✅ 0.60014 0.60002
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.20590 1.20575
Bitwuzla-wrapped_default unsat ✅ 1.31151 1.31150
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.06832 4.06627
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66742 0.66729
STP STP 2022.4_default unsat ✅ 0.60223 0.60220
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.36655 0.36646
Z3++BV z3++bv_0702_default unsat ✅ 0.76603 0.76584
Z3 z3-4.8.17_default unsat ✅ 0.65927 0.66119
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.26677 1.16689
cvc5 cvc5 unsat ✅ 1.94041 1.83972
SMTInterpol SMTInterpol unknown ❌ 1202.71833 1386.93004
STP STP unsat ✅ 33.23348 33.13287
Yices2 Yices2 unsat ✅ 0.53583 0.43660
Z3alpha Z3-alpha unsat ✅ 0.55209 0.45251
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.99837 0.87235
Bitwuzla-MachBV-base unsat ✅ 1.23103 1.10266
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.40416 1.27788
BVDecide bv_decide unknown ❌ 1201.38879 1200.91192
bv_decide-nokernel unknown ❌ 1201.38777 1201.01855
cvc5 cvc5 unsat ✅ 1.26810 1.13948
SMTInterpol SMTInterpol unknown ❌ 1201.86863 2621.79692
Yices2 Yices2 unsat ✅ 0.47660 0.35737
Z3alpha Z3-alpha unsat ✅ 0.93912 0.92980
Z3 Z3-alpha-base unsat ✅ 0.59508 0.46748
Z3-Owl-base unsat ✅ 1.63771 1.51475
z3siri-base unsat ✅ 0.59370 0.46087
Z3-Owl Z3-Owl unsat ✅ 1.11166 0.98466