Benchmark

non-incremental/QF_BV/sage/app7/bench_5447.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3529723
Compressed Size226992
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3529715
Compressed Size226991
Max. Term Depth13671
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2457 and1
=3205 let13448 extract1691 bvand35924
bvor23586 bvxor2231 bvadd38975 bvmul7
bvsub12742 bvsdiv19 bvult596 bvule625
bvslt219 bvsle124 bvshl12442 bvashr23228
zero_extend1495

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.52892 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.53758 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.52455 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.53284 —
abziz_portfolio_2012_solvers default unsat ✅ 0.52523 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53937 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.69800 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.84534 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.73713 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 175.00400 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.85800 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.58700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.09533 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.68971 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.06131 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.02745 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.31948 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.30049 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.92678 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.42858 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.47581 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.42670 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.55371 —
STP2-SMT-COMP-2012 default unsat ✅ 0.52654 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.56487 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.56540 —
Z3-SMT-COMP-2011 default unsat ✅ 0.52491 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.91619 0.91545
Boolector SMT17 final boolector unsat ✅ 0.91500 0.91416
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.49222 14.24780
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.76064 0.75890
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.39277 1.39162
Q3B Q3B default unsat ✅ 0.89304 2.21000
STP stp_st default unsat ✅ 0.60999 0.60811
stp_mt default unsat ✅ 0.65394 0.65257
Yices2 Yices2-Main default unsat ✅ 0.39561 0.39416
Z3 z3-4.5.0 default unsat ✅ 0.79019 0.78902
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.89918 0.89918
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.26105 4.26121
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67354 0.67238
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.35498 1.35470
Minkeyrink ST_st unsat ✅ 1.35369 1.35369
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.61248 0.61237
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.61276 0.61284
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.61197 0.61193
Yices2 Yices 2.6.0_default unsat ✅ 0.39492 0.39465
Z3 z3-4.7.1_default unsat ✅ 0.87127 0.87126
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.57680 1.57680
Poolector-wrapped-sq_default unsat ✅ 1.89287 7.12800
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.28620 1.28627
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.45622 4.45630
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.94324 0.94337
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.94361 0.94362
Par4 Par4-wrapped-sq_default unsat ✅ 0.40549 0.00633
STP STP-2019-wrapped-sq_default unsat ✅ 0.63055 0.63066
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.62009 0.62016
stp-minisat-wrapped-sq_default unsat ✅ 0.62673 0.62687
stp-mt-wrapped-sq_default unsat ✅ 0.62800 0.62815
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.62292 0.62308
stp-riss-wrapped-sq_default unsat ✅ 0.62474 0.62485
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36902 0.36899
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36729 0.36725
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.36588 0.36585
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36865 0.36865
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.36680 0.36677
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.59900 0.59894
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.30843 1.30828
Boolector Boolector-wrapped-sq_default unsat ✅ 1.56980 1.56980
Poolector-wrapped-sq_default unsat ✅ 1.89966 6.97000
CVC4 CVC4-sq-final_default unsat ✅ 5.74825 5.74815
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.85397 0.85368
MathSAT MathSAT5_default.sh unsat ✅ 0.68864 0.68857
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.78131 0.78135
MinkeyRink Solver 2020.3_default unsat ✅ 0.80440 0.80453
STP STP_default unsat ✅ 0.58160 0.58145
STP ++ Mergsat v1_default unsat ✅ 0.56959 0.57138
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.40588 0.40556
Z3 z3-4.8.8_default unsat ✅ 0.45545 0.45540
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.32425 1.32414
MathSAT mathsat-5.6.6_default unsat ✅ 0.71631 0.71615
STP STP 2021.0_default unsat ✅ 0.59784 0.59798
Z3 z3-4.8.11_default unsat ✅ 0.71292 0.71290
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.31949 1.31937
Bitwuzla-wrapped_default unsat ✅ 1.39404 1.39406
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.56371 4.56429
MathSAT MathSAT-5.6.8_default unsat ✅ 0.72206 0.72192
STP STP 2022.4_default unsat ✅ 0.65128 0.65111
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.40153 0.40143
Z3++BV z3++bv_0702_default unsat ✅ 0.71501 0.71472
Z3 z3-4.8.17_default unsat ✅ 0.64924 0.65104
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.06606 2.06553
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.26909 3.26947
STP STP 2022.4_default unsat ✅ 0.64158 0.64159
STP 2022.4_default unsat ✅ 0.65247 0.65243
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1312.29000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39864 0.39857
Z3-Owl z3-Owl-Final_default unsat ✅ 1.38055 2.74017
z3-Owl-Final_default unsat ✅ 1.40285 1.40102
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.45810 1.35669
cvc5 cvc5 unsat ✅ 1.99258 1.89226
SMTInterpol SMTInterpol unknown ❌ 1202.74661 1488.15980
STP STP unsat ✅ 44.44153 44.34053
Yices2 Yices2 unsat ✅ 0.48221 0.38237
Z3alpha Z3-alpha unsat ✅ 0.71003 0.61066
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.98275 0.86790
Bitwuzla-MachBV-base unsat ✅ 1.26235 1.14059
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.44286 1.32501
BVDecide bv_decide unknown ❌ 1201.39011 1201.02296
bv_decide-nokernel unknown ❌ 1201.35252 1200.90920
cvc5 cvc5 unsat ✅ 1.31798 1.19797
SMTInterpol SMTInterpol unknown ❌ 1201.84898 1540.19998
Yices2 Yices2 unsat ✅ 0.49894 0.37937
Z3alpha Z3-alpha unsat ✅ 0.99036 0.97853
Z3 Z3-alpha-base unsat ✅ 0.62550 0.49871
Z3-Owl-base unsat ✅ 2.00540 1.87916
z3siri-base unsat ✅ 0.62094 0.49536
Z3-Owl Z3-Owl unsat ✅ 1.25342 1.12345