Benchmark

non-incremental/QF_BV/Sage2/bench_13313.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size191612
Compressed Size7755
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 191604
Compressed Size7775
Max. Term Depth432
Asserts 56
Declared Functions0
Declared Constants40
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not5 =8 let4599
extract100 bvadd1449 bvmul662 bvule2
bvslt13 bvsle3 bvsgt13 bvsge16
bvshl985 bvlshr284 bvashr299 zero_extend815

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 13.56540 13.56380
Boolector SMT17 final boolector sat ✅ 44.78660 44.77540
CVC4 CVC4-smtcomp2017-main default sat ✅ 293.31800 589.12700
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.07100 599.99000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 30.67250 30.43670
Q3B Q3B default unknown ❌ 0.65324 1.26518
STP stp_st default sat ✅ 13.32880 13.32880
stp_mt default sat ✅ 7.54567 29.12460
Yices2 Yices2-Main default sat ✅ 67.61720 67.61430
Z3 z3-4.5.0 default unknown ❌ 600.04800 599.95200
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default sat ✅ 14.34730 14.34550
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1199.94000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.64000
MinkeyRink Minkeyrink MT_mt sat ✅ 8.91342 34.62140
Minkeyrink ST_st sat ✅ 8.31811 8.31607
STP STP-CMS-st-2018_default-no-stderr sat ✅ 21.07400 21.07230
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 13.44670 52.68730
STP-Riss-st-2018_riss-no-stderr sat ✅ 9.42544 9.42482
Yices2 Yices 2.6.0_default sat ✅ 71.31050 71.30190
Z3 z3-4.7.1_default sat ✅ 36.69800 36.69700
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 8.02310 8.02303
Poolector-wrapped-sq_default sat ✅ 0.38350 0.36962
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 39.46300 39.46190
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 544.29100 544.23000
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 13.31330 51.85240
MinkeyRink ST-wrapped-sq_default sat ✅ 20.92990 20.93090
Par4 Par4-wrapped-sq_default sat ✅ 13.46010 40.28000
STP STP-2019-wrapped-sq_default sat ✅ 17.57190 17.57130
stp-mergesat-fixed-wrapped-sq_default sat ✅ 12.83570 12.83450
stp-minisat-wrapped-sq_default sat ✅ 24.14200 24.14010
stp-mt-wrapped-sq_default sat ✅ 12.38750 48.29360
stp-portfolio-fixed-wrapped-sq_default sat ✅ 24.32780 56.30700
stp-riss-wrapped-sq_default unknown ❌ 0.27620 0.27637
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 28.00180 28.00030
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 116.58600 116.46000
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 28.91610 28.91600
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.06000 2399.86000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 30.38550 30.38660
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.82000
SMT-COMP 2021 0.50 (2/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 8.57409 8.57382
MathSAT mathsat-5.6.6_default unknown ❌ 1200.02000 1199.98000
STP STP 2021.0_default sat ✅ 12.02380 47.03000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.92000
SMT-COMP 2022 0.43 (4/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 15.02060 15.02110
Bitwuzla-wrapped_default sat ✅ 11.53000 11.52830
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 1199.84000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.11000 1199.92000
STP STP 2022.4_default sat ✅ 14.33620 14.33600
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 25.55860 25.55530
Z3++BV z3++bv_0702_default sat ✅ 610.01700 609.90700
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.42420 11.42430
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.03000 1199.84000
STP STP 2022.4_default sat ✅ 15.53610 15.53750
STP 2022.4_default sat ✅ 15.58820 15.58760
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.50078 11.36000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 50.47680 50.46960
Z3-Owl z3-Owl-Final_default sat ✅ 79.23210 79.22310
z3-Owl-Final_default unknown ❌ 1200.02000 1199.91000
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 10.16547 10.05740
cvc5 cvc5 sat ✅ 934.99128 934.59050
SMTInterpol SMTInterpol unknown ❌ 1201.75292 1237.79513
STP STP sat ✅ 45.68561 45.57310
Yices2 Yices2 sat ✅ 9.61742 9.51690
Z3alpha Z3-alpha unknown ❌ 1201.72339 1201.04061
SMT-COMP 2025 0.56 (4/9) Bitwuzla Bitwuzla sat ✅ 10.45368 10.32144
Bitwuzla-MachBV-base sat ✅ 5.86682 5.74636
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 5.94820 5.81588
BVDecide bv_decide sat ✅ 40.80745 40.65232
bv_decide-nokernel sat ✅ 41.20965 41.07152
cvc5 cvc5 unknown ❌ 1201.79687 1200.96533
SMTInterpol SMTInterpol unknown ❌ 1201.78848 1244.80647
Yices2 Yices2 sat ✅ 6.90253 6.76963
Z3alpha Z3-alpha unknown ❌ 1201.00525 4801.34177
Z3 Z3-alpha-base unknown ❌ 1201.29526 1201.05312
Z3-Owl-base unknown ❌ 1201.31783 1201.09107
z3siri-base unknown ❌ 1201.28995 1201.04203
Z3-Owl Z3-Owl unknown ❌ 1201.75537 1201.04381