Benchmark

non-incremental/QF_BV/Sage2/bench_3906.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size17219
Compressed Size2123
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 17211
Compressed Size2137
Max. Term Depth141
Asserts 40
Declared Functions0
Declared Constants86
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not6 =34 let293
bvor16 bvadd62 bvmul62 bvslt1
bvsle2 bvsgt1 bvsge1 bvshl16
zero_extend131

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.82210 0.82145
Boolector SMT17 final boolector sat ✅ 31.76680 31.76560
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.94467 5.88742
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 4.20212 4.20181
MinkeyRink MinkeyRink 2017.3a default sat ✅ 2.50561 2.50541
Q3B Q3B default unknown ❌ 600.07100 1786.78000
STP stp_st default sat ✅ 1.31385 1.31303
stp_mt default sat ✅ 1.02843 3.32823
Yices2 Yices2-Main default sat ✅ 6.77685 6.77513
Z3 z3-4.5.0 default sat ✅ 124.94200 124.93000
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.78918 0.78898
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 29.96650 29.96390
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.48120 2.48193
MinkeyRink Minkeyrink MT_mt sat ✅ 1.15909 3.95575
Minkeyrink ST_st sat ✅ 2.10533 2.10542
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.63433 0.63455
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.41239 0.95780
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.16993 1.16985
Yices2 Yices 2.6.0_default sat ✅ 2.81268 2.81244
Z3 z3-4.7.1_default sat ✅ 116.94600 116.94700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.41729 0.41732
Poolector-wrapped-sq_default sat ✅ 0.18038 0.13498
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 24.74080 24.74080
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 11.07360 11.07370
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.72525 2.27618
MinkeyRink ST-wrapped-sq_default sat ✅ 1.74060 1.74079
Par4 Par4-wrapped-sq_default sat ✅ 0.97366 2.82000
STP STP-2019-wrapped-sq_default sat ✅ 1.11149 1.11186
stp-mergesat-fixed-wrapped-sq_default sat ✅ 5.08940 5.08895
stp-minisat-wrapped-sq_default sat ✅ 1.22842 1.22857
stp-mt-wrapped-sq_default sat ✅ 0.90758 2.99051
stp-portfolio-fixed-wrapped-sq_default sat ✅ 5.09783 7.25338
stp-riss-wrapped-sq_default unknown ❌ 0.19794 0.19819
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.05597 1.05592
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.89579 0.89580
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.14922 1.14909
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 591.59700 591.54800
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.95690 2.95688
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 187.92700 187.93800
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.69744 4.69699
Boolector Boolector-wrapped-sq_default sat ✅ 2.87972 2.87935
Poolector-wrapped-sq_default sat ✅ 0.18408 0.13878
CVC4 CVC4-sq-final_default sat ✅ 11.92280 11.92160
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.91000
MathSAT MathSAT5_default.sh sat ✅ 0.12508 0.12500
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.20285 0.20297
MinkeyRink Solver 2020.3_default sat ✅ 1.93967 7.08787
STP STP_default sat ✅ 0.99237 3.38305
STP ++ Mergsat v1_default sat ✅ 7.22719 7.22856
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.52256 1.52244
Z3 z3-4.8.8_default sat ✅ 76.35280 76.35110
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.42784 0.42771
MathSAT mathsat-5.6.6_default sat ✅ 0.12270 0.12266
STP STP 2021.0_default sat ✅ 1.00508 3.46598
Z3 z3-4.8.11_default sat ✅ 42.38250 42.37640
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.43478 0.43448
Bitwuzla-wrapped_default sat ✅ 0.43798 0.43793
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 59.39410 59.38080
MathSAT MathSAT-5.6.8_default sat ✅ 0.13502 0.13494
STP STP 2022.4_default sat ✅ 3.85586 3.85604
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.84545 0.84444
Z3++BV z3++bv_0702_default sat ✅ 79.12770 79.11410
Z3 z3-4.8.17_default sat ✅ 17.12180 17.12280
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.20930 11.20850
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 6.20131 6.20113
STP STP 2022.4_default sat ✅ 3.52546 3.52517
STP 2022.4_default sat ✅ 3.53761 3.53684
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1241.98000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 3.57459 3.57091
Z3-Owl z3-Owl-Final_default sat ✅ 91.68560 91.67030
z3-Owl-Final_default sat ✅ 30.42220 30.42000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 20.83207 20.73163
cvc5 cvc5 sat ✅ 20.22027 20.11808
SMTInterpol SMTInterpol unknown ❌ 1201.72063 1241.24717
STP STP sat ✅ 1.39989 1.29990
Yices2 Yices2 sat ✅ 2.73793 2.63628
Z3alpha Z3-alpha sat ✅ 36.39380 36.29265
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 3.73169 3.61088
Bitwuzla-MachBV-base sat ✅ 1.40268 1.28024
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.41990 1.30161
BVDecide bv_decide sat ✅ 3.03924 2.87704
bv_decide-nokernel sat ✅ 3.00159 2.83648
cvc5 cvc5 sat ✅ 22.72283 22.59306
SMTInterpol SMTInterpol unknown ❌ 1201.36171 1224.34320
Yices2 Yices2 sat ✅ 2.07813 1.95505
Z3alpha Z3-alpha sat ✅ 12.71499 49.47027
Z3 Z3-alpha-base sat ✅ 102.24863 102.11357
Z3-Owl-base sat ✅ 434.76272 434.59341
z3siri-base sat ✅ 103.86495 103.71966
Z3-Owl Z3-Owl sat ✅ 13.59074 13.46181