Benchmark

non-incremental/QF_BV/Sage2/bench_10133.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size133686
Compressed Size15239
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 133678
Compressed Size15169
Max. Term Depth172
Asserts 475
Declared Functions0
Declared Constants363
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false7 ite14 not181
=401 let2452 bvand7 bvor84
bvadd464 bvmul451 bvugt7 bvuge20
bvslt21 bvsle3 bvsgt30 bvsge13
bvshl98 zero_extend1132

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 5.36597 5.36273
Boolector SMT17 final boolector sat ✅ 86.88860 86.89120
CVC4 CVC4-smtcomp2017-main default sat ✅ 10.80240 21.58020
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 4.82988 4.82829
MinkeyRink MinkeyRink 2017.3a default sat ✅ 11.29550 14.68790
Q3B Q3B default unknown ❌ 600.10900 1799.67000
STP stp_st default sat ✅ 133.28600 133.23600
stp_mt default sat ✅ 31.05940 119.71200
Yices2 Yices2-Main default sat ✅ 0.36411 0.36223
Z3 z3-4.5.0 default sat ✅ 414.66200 414.61000
SMT-COMP 2018 Boolector Boolector_default sat ✅ 3.87253 3.87226
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 10.05870 10.05720
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 4.25687 4.25719
MinkeyRink Minkeyrink MT_mt sat ✅ 35.92560 140.83000
Minkeyrink ST_st sat ✅ 22.56330 22.56160
STP STP-CMS-st-2018_default-no-stderr sat ✅ 37.69180 37.59280
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 31.30860 121.35700
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.66863 3.66811
Yices2 Yices 2.6.0_default sat ✅ 0.65809 0.65804
Z3 z3-4.7.1_default sat ✅ 145.89500 145.88300
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 4.12746 4.12740
Poolector-wrapped-sq_default sat ✅ 4.54718 17.54160
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 93.82430 93.81570
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 13.72230 13.72080
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 4.05764 14.33340
MinkeyRink ST-wrapped-sq_default sat ✅ 15.12260 15.12200
Par4 Par4-wrapped-sq_default sat ✅ 0.86107 2.33000
STP STP-2019-wrapped-sq_default sat ✅ 106.99500 106.97800
stp-mergesat-fixed-wrapped-sq_default sat ✅ 9.85254 9.85050
stp-minisat-wrapped-sq_default sat ✅ 5.39672 5.39613
stp-mt-wrapped-sq_default sat ✅ 68.49910 126.05900
stp-portfolio-fixed-wrapped-sq_default sat ✅ 107.92800 122.79200
stp-riss-wrapped-sq_default unknown ❌ 0.96322 0.96341
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.82740 0.82740
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.85982 1.85978
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 35.78010 35.78160
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.97000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.43319 0.43320
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 556.52200 556.43900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.10579 1.10527
Boolector Boolector-wrapped-sq_default sat ✅ 8.08332 8.08311
Poolector-wrapped-sq_default sat ✅ 9.00425 35.13820
CVC4 CVC4-sq-final_default sat ✅ 16.35470 16.35430
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.89000
MathSAT MathSAT5_default.sh sat ✅ 0.66258 0.66253
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.61874 0.61895
MinkeyRink Solver 2020.3_default sat ✅ 40.85840 160.39000
STP STP_default sat ✅ 36.91000 144.44000
STP ++ Mergsat v1_default sat ✅ 9.62546 9.62740
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.04033 4.04009
Z3 z3-4.8.8_default sat ✅ 28.70990 28.70810
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 8.14108 8.14056
Bitwuzla-wrapped_default sat ✅ 8.45753 8.45704
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 8.78949 8.78843
MathSAT MathSAT-5.6.8_default sat ✅ 3.10685 3.10646
STP STP 2022.4_default sat ✅ 5.26684 5.26644
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 5.87614 5.87540
Z3++BV z3++bv_0702_default sat ✅ 1.97917 1.97879
Z3 z3-4.8.17_default sat ✅ 9.60084 9.60211
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 5.29574 5.29547
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 8.69968 8.69768
STP STP 2022.4_default sat ✅ 5.31461 5.31457
STP 2022.4_default sat ✅ 5.29602 5.29552
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1245.43000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.10838 1.10833
Z3-Owl z3-Owl-Final_default sat ✅ 46.26420 46.26050
z3-Owl-Final_default sat ✅ 45.12840 45.11830
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 3.10874 3.00753
cvc5 cvc5 sat ✅ 11.55870 11.45838
SMTInterpol SMTInterpol unknown ❌ 1201.71663 1232.35698
STP STP sat ✅ 5.83038 5.73025
Yices2 Yices2 sat ✅ 4.47103 4.36847
Z3alpha Z3-alpha sat ✅ 6.75691 6.65709
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.86590 1.73357
Bitwuzla-MachBV-base sat ✅ 0.82752 0.69875
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.95682 0.82040
BVDecide bv_decide sat ✅ 11.77752 11.62010
bv_decide-nokernel sat ✅ 11.24448 11.07773
cvc5 cvc5 sat ✅ 10.55341 10.42176
SMTInterpol SMTInterpol unknown ❌ 1201.47146 1224.89678
Yices2 Yices2 sat ✅ 1.86555 1.74030
Z3alpha Z3-alpha sat ✅ 8.68225 33.19867
Z3 Z3-alpha-base sat ✅ 104.42943 104.29522
Z3-Owl-base sat ✅ 450.46191 450.28570
z3siri-base sat ✅ 105.13571 105.00947
Z3-Owl Z3-Owl sat ✅ 19.06403 18.93839