Benchmark

non-incremental/QF_BV/Sage2/bench_15557.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1521646
Compressed Size14321
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1521638
Compressed Size14312
Max. Term Depth1032
Asserts 320
Declared Functions0
Declared Constants338
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not103 =111 let34573
bvand16 bvadd22608 bvmul41 bvult47
bvule41 bvugt23 bvuge97 bvlshr48
zero_extend11757

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.02400 599.85600
Boolector SMT17 final boolector unknown ❌ 600.04800 600.01000
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.21938 5.77201
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 5.16277 5.16257
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.39306 0.33350
Q3B Q3B default unknown ❌ 600.03400 1786.47000
STP stp_st default sat ✅ 0.89505 0.89366
stp_mt default sat ✅ 1.18401 2.40457
Yices2 Yices2-Main default sat ✅ 0.23989 0.23913
Z3 z3-4.5.0 default sat ✅ 1.90452 1.90331
SMT-COMP 2018 Boolector Boolector_default sat ✅ 3.92112 3.92057
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 17.19750 17.19350
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 4.61464 4.61554
MinkeyRink Minkeyrink MT_mt sat ✅ 0.30330 0.33163
Minkeyrink ST_st sat ✅ 0.29478 0.29500
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.45831 0.45815
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.46265 0.82091
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.92996 0.93010
Yices2 Yices 2.6.0_default sat ✅ 0.24308 0.24300
Z3 z3-4.7.1_default sat ✅ 1.58699 1.58659
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.78343 2.78312
Bitwuzla-wrapped_default sat ✅ 2.86240 2.86222
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.02410 4.02489
MathSAT MathSAT-5.6.8_default sat ✅ 1.44124 1.44113
STP STP 2022.4_default sat ✅ 0.19556 0.19558
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.25402 0.25393
Z3++BV z3++bv_0702_default sat ✅ 1068.17000 1068.03000
Z3 z3-4.8.17_default sat ✅ 1.37130 1.37299
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.38604 2.38602
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 25.50180 25.49960
STP STP 2022.4_default sat ✅ 0.19848 0.19850
STP 2022.4_default sat ✅ 0.19845 0.19850
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 13.01630 36.72120
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.24452 0.24449
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.08000 1199.80000
z3-Owl-Final_default sat ✅ 315.08800 315.03900
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.69546 0.59610
cvc5 cvc5 sat ✅ 32.70876 32.59508
SMTInterpol SMTInterpol sat ✅ 14.38959 35.52781
STP STP sat ✅ 1.79162 1.68969
Yices2 Yices2 sat ✅ 0.36355 0.26360
Z3alpha Z3-alpha sat ✅ 10.63335 10.53332
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 0.48691 0.37184
Bitwuzla-MachBV-base sat ✅ 0.59215 0.46662
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.70729 0.58950
BVDecide bv_decide sat ✅ 29.62985 29.45429
bv_decide-nokernel sat ✅ 29.61897 29.44153
cvc5 cvc5 sat ✅ 3.11434 2.98827
SMTInterpol SMTInterpol sat ✅ 11.47414 29.25365
Yices2 Yices2 sat ✅ 0.42326 0.30030
Z3alpha Z3-alpha sat ✅ 7.77472 28.67740
Z3 Z3-alpha-base unknown ❌ 1201.38399 1201.04495
Z3-Owl-base unknown ❌ 1201.38170 1201.08554
z3siri-base unknown ❌ 1201.34912 1201.09944
Z3-Owl Z3-Owl unknown ❌ 1201.75445 1201.28023