Benchmark

non-incremental/QF_BV/sage/app7/bench_5546.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3512921
Compressed Size225592
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3512913
Compressed Size225599
Max. Term Depth13657
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2454 and1
=3197 let13434 extract1685 bvand35785
bvor23462 bvxor2225 bvadd38782 bvmul7
bvsub12624 bvsdiv19 bvult595 bvule625
bvslt219 bvsle124 bvshl12321 bvashr23096
zero_extend1489

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51870 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.52489 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54430 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.52549 —
abziz_portfolio_2012_solvers default unsat ✅ 0.52196 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53141 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.69700 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.83839 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.74272 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.15800 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.51600 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.38700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.07876 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.73521 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.05193 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.00693 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.31141 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.27446 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.91940 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.39869 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.45914 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.43017 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.55105 —
STP2-SMT-COMP-2012 default unsat ✅ 0.52991 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.57036 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58041 —
Z3-SMT-COMP-2011 default unsat ✅ 0.52617 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.92326 0.92218
Boolector SMT17 final boolector unsat ✅ 0.91608 0.91400
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.76511 7.68150
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69719 0.69720
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.39863 1.39884
Q3B Q3B default unsat ✅ 0.88679 2.25000
STP stp_st default unsat ✅ 0.59672 0.59348
stp_mt default unsat ✅ 0.61911 0.61865
Yices2 Yices2-Main default unsat ✅ 0.38847 0.38741
Z3 z3-4.5.0 default unsat ✅ 0.49552 0.49105
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.82724 0.82711
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.20977 4.20956
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.66989 0.67102
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.34394 1.34387
Minkeyrink ST_st unsat ✅ 1.34822 1.34822
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.61243 0.61253
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.61252 0.61253
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.62135 0.62138
Yices2 Yices 2.6.0_default unsat ✅ 0.39316 0.39173
Z3 z3-4.7.1_default unsat ✅ 0.77857 0.77851
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.57324 1.57286
Poolector-wrapped-sq_default unsat ✅ 1.91170 7.07241
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.26958 1.26949
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.39929 4.39902
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.94098 0.94150
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.94564 0.94570
Par4 Par4-wrapped-sq_default unsat ✅ 0.40820 0.00609
STP STP-2019-wrapped-sq_default unsat ✅ 0.62818 0.62810
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.61835 0.61850
stp-minisat-wrapped-sq_default unsat ✅ 0.62691 0.62699
stp-mt-wrapped-sq_default unsat ✅ 0.62370 0.62381
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.61854 0.61858
stp-riss-wrapped-sq_default unsat ✅ 0.62538 0.62554
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36170 0.36165
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36230 0.36229
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.36242 0.36242
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.35982 0.35984
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.35806 0.35802
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.79696 0.79681
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.31997 1.31980
Boolector Boolector-wrapped-sq_default unsat ✅ 1.57716 1.57706
Poolector-wrapped-sq_default unsat ✅ 1.88059 7.04188
CVC4 CVC4-sq-final_default unsat ✅ 5.78153 5.78173
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.84383 0.84379
MathSAT MathSAT5_default.sh unsat ✅ 0.68930 0.68918
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.77866 0.77870
MinkeyRink Solver 2020.3_default unsat ✅ 0.80075 0.80087
STP STP_default unsat ✅ 0.57605 0.57611
STP ++ Mergsat v1_default unsat ✅ 0.56488 0.56652
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.40483 0.40469
Z3 z3-4.8.8_default unsat ✅ 0.65822 0.65807
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.31052 1.31040
MathSAT mathsat-5.6.6_default unsat ✅ 0.70273 0.70260
STP STP 2021.0_default unsat ✅ 0.60272 0.60279
Z3 z3-4.8.11_default unsat ✅ 0.76964 0.76957
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.30352 1.30331
Bitwuzla-wrapped_default unsat ✅ 1.38851 1.38837
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.55659 4.55674
MathSAT MathSAT-5.6.8_default unsat ✅ 0.71437 0.71423
STP STP 2022.4_default unsat ✅ 0.70738 0.70369
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.39711 0.39699
Z3++BV z3++bv_0702_default unsat ✅ 0.46884 0.46872
Z3 z3-4.8.17_default unsat ✅ 0.47201 0.47371
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.47456 1.37408
cvc5 cvc5 unsat ✅ 2.05555 1.95575
SMTInterpol SMTInterpol unknown ❌ 1202.71831 1427.14153
STP STP unsat ✅ 40.36436 40.25686
Yices2 Yices2 unsat ✅ 0.48479 0.38435
Z3alpha Z3-alpha unsat ✅ 0.61348 0.51386
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.05320 0.92088
Bitwuzla-MachBV-base unsat ✅ 1.27808 1.14964
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.42758 1.29552
BVDecide bv_decide unknown ❌ 1201.39218 1200.97096
bv_decide-nokernel unknown ❌ 1201.38865 1201.01393
cvc5 cvc5 unsat ✅ 1.36892 1.25026
SMTInterpol SMTInterpol unknown ❌ 1201.85289 1641.10053
Yices2 Yices2 unsat ✅ 0.50006 0.38353
Z3alpha Z3-alpha unsat ✅ 0.99439 0.97768
Z3 Z3-alpha-base unsat ✅ 0.52970 0.40797
Z3-Owl-base unsat ✅ 1.33341 1.20840
z3siri-base unsat ✅ 0.52349 0.40269
Z3-Owl Z3-Owl unsat ✅ 1.05805 0.93018