Benchmark

non-incremental/QF_BV/Sage2/bench_15510.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size596464
Compressed Size18763
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 596456
Compressed Size18753
Max. Term Depth1121
Asserts 332
Declared Functions0
Declared Constants576
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 not46 =52
let13218 extract9 bvand4 bvor6
bvadd4654 bvmul223 bvudiv9 bvult54
bvule100 bvugt19 bvuge103 bvsle1
bvsge3 bvshl3525 bvlshr29 zero_extend4712

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.49826 1.49791
Boolector SMT17 final boolector sat ✅ 6.93426 6.93207
CVC4 CVC4-smtcomp2017-main default sat ✅ 12.73380 25.26020
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 236.58800 236.50700
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.55216 1.53436
Q3B Q3B default unknown ❌ 600.06600 1799.76000
STP stp_st default sat ✅ 2.76821 2.76656
stp_mt default sat ✅ 2.85484 9.59942
Yices2 Yices2-Main default sat ✅ 0.78714 0.78574
Z3 z3-4.5.0 default sat ✅ 14.41450 14.41320
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.49220 1.49219
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 8.23467 8.23434
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 153.90400 153.89200
MinkeyRink Minkeyrink MT_mt sat ✅ 1.12814 2.47617
Minkeyrink ST_st sat ✅ 1.07172 1.07179
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.27700 2.27589
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.42306 8.03554
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.71113 3.71121
Yices2 Yices 2.6.0_default sat ✅ 1.35779 1.35737
Z3 z3-4.7.1_default sat ✅ 10.54810 10.54820
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.27520 2.27504
MathSAT mathsat-5.6.6_default sat ✅ 708.12600 707.95300
STP STP 2021.0_default sat ✅ 0.72989 1.65069
Z3 z3-4.8.11_default sat ✅ 34.57530 34.57160
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.34019 2.32894
Bitwuzla-wrapped_default sat ✅ 2.35413 2.35380
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 18.27880 18.27070
MathSAT MathSAT-5.6.8_default sat ✅ 620.02900 619.83200
STP STP 2022.4_default sat ✅ 1.59657 1.59624
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.62663 1.62638
Z3++BV z3++bv_0702_default sat ✅ 3.66686 3.66672
Z3 z3-4.8.17_default sat ✅ 7.75266 7.75381
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.99294 2.99251
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 14.75560 14.75320
STP STP 2022.4_default sat ✅ 1.56305 1.56307
STP 2022.4_default sat ✅ 1.56436 1.56442
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.54896 11.90290
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.32961 0.32951
Z3-Owl z3-Owl-Final_default sat ✅ 28.46510 28.46320
z3-Owl-Final_default sat ✅ 33.72220 33.71540
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.54554 1.42778
Bitwuzla-MachBV-base sat ✅ 1.88924 1.76533
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.88587 1.76815
BVDecide bv_decide sat ✅ 9.46575 9.30433
bv_decide-nokernel sat ✅ 8.64273 8.50927
cvc5 cvc5 sat ✅ 10.26575 10.14231
SMTInterpol SMTInterpol unknown ❌ 9.61913 21.31451
Yices2 Yices2 sat ✅ 0.96170 0.84420
Z3alpha Z3-alpha sat ✅ 8.39031 28.48803
Z3 Z3-alpha-base sat ✅ 8.67193 8.54490
Z3-Owl-base sat ✅ 38.88165 38.76172
z3siri-base sat ✅ 9.06318 8.93259
Z3-Owl Z3-Owl sat ✅ 14.19465 14.06633