Benchmark

non-incremental/QF_BV/Sage2/bench_8155.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size549815
Compressed Size13939
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 549807
Compressed Size13931
Max. Term Depth186
Asserts 443
Declared Functions0
Declared Constants249
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 not117 =149
let11883 extract5 bvand2 bvor22
bvadd4095 bvmul355 bvult49 bvule73
bvugt12 bvuge160 bvshl3104 bvlshr21
zero_extend4161

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.00250 1.00204
Boolector SMT17 final boolector sat ✅ 4.37134 4.36988
CVC4 CVC4-smtcomp2017-main default sat ✅ 24.94440 49.80410
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 468.78900 468.66500
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.98267 0.98892
Q3B Q3B default unknown ❌ 600.05900 1428.40000
STP stp_st default sat ✅ 9.64034 9.63909
stp_mt default sat ✅ 4.81552 17.54170
Yices2 Yices2-Main default sat ✅ 0.37365 0.37337
Z3 z3-4.5.0 default sat ✅ 34.92830 34.92830
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.91784 0.91770
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 10.34460 10.33730
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 822.15400 822.17700
MinkeyRink Minkeyrink MT_mt sat ✅ 0.68159 1.72769
Minkeyrink ST_st sat ✅ 0.66912 0.66928
STP STP-CMS-st-2018_default-no-stderr sat ✅ 11.11920 11.11100
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.77469 5.66081
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.17284 4.17193
Yices2 Yices 2.6.0_default sat ✅ 1.47521 1.47481
Z3 z3-4.7.1_default sat ✅ 139.99200 139.88000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1.38595 1.38556
Poolector-wrapped-sq_default sat ✅ 0.99029 3.36982
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 4.15711 4.15613
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 8.07429 8.07388
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.64676 1.62840
MinkeyRink ST-wrapped-sq_default sat ✅ 0.84665 0.84671
Par4 Par4-wrapped-sq_default sat ✅ 0.80538 2.24000
STP STP-2019-wrapped-sq_default sat ✅ 2.40662 2.40660
stp-mergesat-fixed-wrapped-sq_default sat ✅ 11.17890 11.16890
stp-minisat-wrapped-sq_default sat ✅ 1.09145 1.09168
stp-mt-wrapped-sq_default sat ✅ 1.80263 5.66056
stp-portfolio-fixed-wrapped-sq_default sat ✅ 11.52650 14.47900
stp-riss-wrapped-sq_default unknown ❌ 0.46813 0.46834
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.78050 0.78047
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.77864 0.77856
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.88937 0.88910
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.75000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.47424 0.47421
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 17.59950 17.59930
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.51379 1.51371
Boolector Boolector-wrapped-sq_default sat ✅ 1.64686 1.64680
Poolector-wrapped-sq_default sat ✅ 0.88023 2.81206
CVC4 CVC4-sq-final_default sat ✅ 12.52120 12.52100
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1200.00000
MathSAT MathSAT5_default.sh sat ✅ 505.91900 505.78000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.27978 0.28002
MinkeyRink Solver 2020.3_default sat ✅ 0.64105 1.69155
STP STP_default sat ✅ 0.53128 1.32829
STP ++ Mergsat v1_default sat ✅ 0.62755 0.62928
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.50434 0.50429
Z3 z3-4.8.8_default sat ✅ 19.51340 19.51160
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.65234 3.21221
MathSAT mathsat-5.6.6_default sat ✅ 778.83200 778.78800
STP STP 2021.0_default sat ✅ 0.64333 1.76323
Z3 z3-4.8.11_default sat ✅ 29.98690 29.97750
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.49153 1.49139
Bitwuzla-wrapped_default sat ✅ 1.63130 3.18134
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 26.50320 26.42260
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.10000 1199.85000
STP STP 2022.4_default sat ✅ 0.97943 0.97923
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.85490 0.85486
Z3++BV z3++bv_0702_default sat ✅ 5.70318 5.70294
Z3 z3-4.8.17_default sat ✅ 28.74960 28.73360
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.78187 1.78170
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 22.57470 22.57580
STP STP 2022.4_default sat ✅ 0.98641 0.98644
STP 2022.4_default sat ✅ 0.98900 0.98791
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 297.85400 335.19400
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.88118 0.88101
Z3-Owl z3-Owl-Final_default sat ✅ 30.47100 30.46790
z3-Owl-Final_default sat ✅ 33.90490 33.90620
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 1.50318 1.40233
cvc5 cvc5 sat ✅ 10.80392 10.70011
SMTInterpol SMTInterpol sat ✅ 77.72907 102.45547
STP STP sat ✅ 1.06772 0.96716
Yices2 Yices2 sat ✅ 1.01763 0.91768
Z3alpha Z3-alpha sat ✅ 19.36084 19.26004