Benchmark

non-incremental/QF_BV/Sage2/bench_11100.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size7273509
Compressed Size54643
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 7273501
Compressed Size54630
Max. Term Depth1460
Asserts 1180
Declared Functions0
Declared Constants518
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite45 not190 =419
let155548 extract44 bvand2 bvor178
bvadd112573 bvmul12917 bvudiv39 bvult196
bvule194 bvugt45 bvuge348 bvsle1
bvsgt20 bvsge1 bvshl178 bvlshr19
zero_extend29318

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.02000 599.88000
Boolector SMT17 final boolector unknown ❌ 600.10600 600.01400
CVC4 CVC4-smtcomp2017-main default sat ✅ 39.13820 75.52830
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.11600 599.92000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 27.30940 50.08780
Q3B Q3B default unknown ❌ 600.05200 1786.90000
STP stp_st default unknown ❌ 600.01200 599.89900
stp_mt default sat ✅ 237.30400 926.70100
Yices2 Yices2-Main default sat ✅ 0.88778 0.88734
Z3 z3-4.5.0 default unknown ❌ 600.01900 599.86600
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unknown ❌ 1200.02000 1199.98000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 108.48100 108.48500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.46000
MinkeyRink Minkeyrink MT_mt sat ✅ 47.56490 184.83300
Minkeyrink ST_st sat ✅ 48.24460 48.23640
STP STP-CMS-st-2018_default-no-stderr sat ✅ 5.08795 5.08737
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 5.40574 7.39714
STP-Riss-st-2018_riss-no-stderr sat ✅ 902.65100 902.61600
Yices2 Yices 2.6.0_default sat ✅ 1.10882 1.10861
Z3 z3-4.7.1_default sat ✅ 1125.96000 1125.86000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 56.32270 56.32560
Poolector-wrapped-sq_default sat ✅ 62.57530 247.36700
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1900.05000 1899.95000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 79.58890 79.58740
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 35.65460 129.13000
MinkeyRink ST-wrapped-sq_default sat ✅ 56.81120 56.78900
Par4 Par4-wrapped-sq_default sat ✅ 1.04104 2.99000
STP STP-2019-wrapped-sq_default sat ✅ 5.16538 5.16569
stp-mergesat-fixed-wrapped-sq_default sat ✅ 152.57400 152.56600
stp-minisat-wrapped-sq_default sat ✅ 762.20500 762.05300
stp-mt-wrapped-sq_default sat ✅ 5.41400 6.75861
stp-portfolio-fixed-wrapped-sq_default sat ✅ 762.35300 932.80700
stp-riss-wrapped-sq_default unknown ❌ 5.20711 4.94805
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.11209 1.11207
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 3.12386 3.12377
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 27.17550 27.17490
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 103.73200 103.72300
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.56955 2.56942
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 543.09600 543.00100
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 29.66120 29.65970
Boolector Boolector-wrapped-sq_default sat ✅ 106.26200 106.26400
Poolector-wrapped-sq_default sat ✅ 123.11300 487.10000
CVC4 CVC4-sq-final_default sat ✅ 39.99440 39.99170
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1199.97000
MathSAT MathSAT5_default.sh sat ✅ 470.03600 469.80300
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.46147 1.46172
MinkeyRink Solver 2020.3_default sat ✅ 33.65740 129.44700
STP STP_default sat ✅ 256.61500 1005.81000
STP ++ Mergsat v1_default sat ✅ 194.86700 194.84500
Yices2 Yices 2.6.2 bug fix_default sat ✅ 5.63175 5.63132
Z3 z3-4.8.8_default sat ✅ 84.32120 84.31430
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 51.99630 51.99280
Bitwuzla-wrapped_default sat ✅ 52.45380 52.44660
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 59.73200 59.71760
MathSAT MathSAT-5.6.8_default sat ✅ 823.92700 823.56600
STP STP 2022.4_default sat ✅ 2.04986 2.04987
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 4.81034 4.80992
Z3++BV z3++bv_0702_default sat ✅ 44.97170 44.96830
Z3 z3-4.8.17_default sat ✅ 214.80700 214.80500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 10.37490 10.37500
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 14.81010 14.80860
STP STP 2022.4_default sat ✅ 2.73448 2.73444
STP 2022.4_default sat ✅ 2.73723 2.73683
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.61533 12.97140
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.96558 0.96555
Z3-Owl z3-Owl-Final_default sat ✅ 299.31800 299.31600
z3-Owl-Final_default sat ✅ 216.03400 216.04500
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 2.52479 2.42484
cvc5 cvc5 sat ✅ 32.27487 32.17305
SMTInterpol SMTInterpol unknown ❌ 1201.71875 1243.42279
STP STP sat ✅ 6.25377 6.15354
Yices2 Yices2 sat ✅ 4.90784 4.80576
Z3alpha Z3-alpha sat ✅ 545.34813 545.18352
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 2.03630 1.90685
Bitwuzla-MachBV-base sat ✅ 2.16974 2.03930
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.21574 2.10029
BVDecide bv_decide unknown ❌ 1201.89966 1201.86874
bv_decide-nokernel unknown ❌ 1201.89827 1201.89192
cvc5 cvc5 sat ✅ 33.29791 33.16526
SMTInterpol SMTInterpol unknown ❌ 1201.58947 1234.13213
Yices2 Yices2 sat ✅ 4.55249 4.43055
Z3alpha Z3-alpha sat ✅ 646.08764 2578.12146
Z3 Z3-alpha-base sat ✅ 189.67008 189.49864
Z3-Owl-base sat ✅ 699.78645 699.52439
z3siri-base sat ✅ 194.89213 194.74122
Z3-Owl Z3-Owl sat ✅ 100.33800 100.19731