Benchmark

non-incremental/QF_BV/Sage2/bench_6453.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size28541946
Compressed Size52758
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 28541938
Compressed Size52748
Max. Term Depth1491
Asserts 297
Declared Functions0
Declared Constants3284
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not101 =135 let220233
bvor4 bvadd400149 bvmul339 bvudiv120
bvult33 bvule24 bvugt1 bvuge101
bvsge2 bvshl299172 bvlshr4 zero_extend399003

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 3.91313 3.91129
Boolector SMT17 final boolector sat ✅ 6.09527 6.09486
CVC4 CVC4-smtcomp2017-main default sat ✅ 19.64500 27.58140
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 10.73670 10.73640
MinkeyRink MinkeyRink 2017.3a default sat ✅ 9.01319 9.05935
Q3B Q3B default unknown ❌ 600.04100 1788.63000
STP stp_st default sat ✅ 4.54992 4.45107
stp_mt default sat ✅ 4.60933 7.06189
Yices2 Yices2-Main default sat ✅ 2.19531 2.19463
Z3 z3-4.5.0 default unknown ❌ 600.08900 599.97000
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 3.46245 3.46217
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 28.51090 28.51030
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 10.23210 10.23240
MinkeyRink Minkeyrink MT_mt sat ✅ 7.74988 9.05258
Minkeyrink ST_st sat ✅ 7.55594 7.55116
STP STP-CMS-st-2018_default-no-stderr sat ✅ 7.27083 7.27057
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 8.91554 24.00740
STP-Riss-st-2018_riss-no-stderr sat ✅ 180.20400 180.18800
Yices2 Yices 2.6.0_default sat ✅ 2.02166 2.02167
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 5.82015 5.81968
Poolector-wrapped-sq_default sat ✅ 6.24613 24.40680
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 6.31867 6.26671
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 19.64530 19.64270
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 7.24824 7.90874
MinkeyRink ST-wrapped-sq_default sat ✅ 7.07358 7.07320
Par4 Par4-wrapped-sq_default sat ✅ 2.07523 5.91000
STP STP-2019-wrapped-sq_default sat ✅ 3.92589 3.92634
stp-mergesat-fixed-wrapped-sq_default sat ✅ 4.28845 4.28880
stp-minisat-wrapped-sq_default sat ✅ 4.14157 4.14181
stp-mt-wrapped-sq_default sat ✅ 3.99824 4.44904
stp-portfolio-fixed-wrapped-sq_default sat ✅ 4.39616 5.17798
stp-riss-wrapped-sq_default unknown ❌ 3.84999 3.84860
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.99617 1.99628
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.26830 2.26840
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 13.15230 13.15200
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 844.73100 844.75000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.35946 2.35950
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.09000 2399.28000
SMT-COMP 2020 0.33 (6/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.96561 4.96498
Boolector Boolector-wrapped-sq_default sat ✅ 6.14850 6.14801
Poolector-wrapped-sq_default sat ✅ 6.39965 25.03000
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1199.73000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.85000
MathSAT MathSAT5_default.sh sat ✅ 9.12268 9.12299
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 6.20702 6.20685
MinkeyRink Solver 2020.3_default sat ✅ 6.57233 7.24329
STP STP_default sat ✅ 3.41864 3.84020
STP ++ Mergsat v1_default sat ✅ 3.32509 3.32660
Yices2 Yices 2.6.2 bug fix_default sat ✅ 3.02542 3.02544
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.66000
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.71010 4.70536
MathSAT mathsat-5.6.6_default sat ✅ 8.60280 8.60205
STP STP 2021.0_default sat ✅ 3.53237 3.96467
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.65000
SMT-COMP 2022 0.43 (4/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.94210 4.94175
Bitwuzla-wrapped_default sat ✅ 3.99364 3.98941
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.05000 1199.83000
MathSAT MathSAT-5.6.8_default sat ✅ 9.10455 9.10187
STP STP 2022.4_default sat ✅ 3.84044 3.84021
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 2.82680 2.82648
Z3++BV z3++bv_0702_default unknown ❌ 1200.02000 1199.58000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.59000
SMT-COMP 2023 0.50 (3/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 6.15660 6.15613
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.09000 1199.68000
STP STP 2022.4_default sat ✅ 4.60054 4.60042
STP 2022.4_default sat ✅ 4.58933 4.58902
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 16.59400 35.56370
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 2.30351 4.50322
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.01000 1199.69000
z3-Owl-Final_default unknown ❌ 1200.01000 1199.90000
SMT-COMP 2024 0.50 (3/6) Bitwuzla Bitwuzla sat ✅ 3.88898 3.78783
cvc5 cvc5 unknown ❌ 318.05007 319.58529
SMTInterpol SMTInterpol unknown ❌ 187.38961 223.69140
STP STP sat ✅ 43.58516 43.48343
Yices2 Yices2 sat ✅ 2.30817 2.20697
Z3alpha Z3-alpha unknown ❌ 1201.72076 1201.24409
SMT-COMP 2025 0.56 (4/9) Bitwuzla Bitwuzla sat ✅ 2.49209 2.36331
Bitwuzla-MachBV-base sat ✅ 2.86303 2.73805
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.57175 2.44828
BVDecide bv_decide sat ✅ 640.81706 640.62179
bv_decide-nokernel sat ✅ 620.89193 620.66832
cvc5 cvc5 unknown ❌ 202.47038 204.29377
SMTInterpol SMTInterpol unknown ❌ 149.51770 179.82951
Yices2 Yices2 sat ✅ 1.50934 1.39249
Z3alpha Z3-alpha unknown ❌ 1202.28474 4799.36220
Z3 Z3-alpha-base unknown ❌ 1202.19402 1201.90535
Z3-Owl-base unknown ❌ 1201.36704 1200.97281
z3siri-base unknown ❌ 1202.10576 1201.85201
Z3-Owl Z3-Owl unknown ❌ 1201.75681 1201.15805