Benchmark

non-incremental/QF_BV/Sage2/bench_13171.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size8052525
Compressed Size72056
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 8052517
Compressed Size72044
Max. Term Depth1460
Asserts 1282
Declared Functions0
Declared Constants701
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite47 not211 =503
let172476 extract48 bvand4 bvor239
bvadd122178 bvmul13014 bvudiv39 bvult204
bvule197 bvugt47 bvuge355 bvsle1
bvsgt20 bvsge1 bvshl239 bvlshr19
zero_extend36391

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.04800 599.92000
Boolector SMT17 final boolector unknown ❌ 600.10100 600.06200
CVC4 CVC4-smtcomp2017-main default sat ✅ 497.62400 995.74200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01300 599.71000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 22.34240 38.23000
Q3B Q3B default unknown ❌ 600.04400 1799.48000
STP stp_st default sat ✅ 126.85000 126.82100
stp_mt default sat ✅ 126.45700 293.18400
Yices2 Yices2-Main default sat ✅ 65.89920 64.64480
Z3 z3-4.5.0 default unknown ❌ 600.02000 599.92800
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 90.88920 90.88750
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 51.77930 51.77500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.83000
MinkeyRink Minkeyrink MT_mt sat ✅ 31.60250 118.62800
Minkeyrink ST_st sat ✅ 18.09740 18.09690
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.11000 1200.10000
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 56.99030 205.76100
STP-Riss-st-2018_riss-no-stderr sat ✅ 939.01500 938.93700
Yices2 Yices 2.6.0_default sat ✅ 30.15510 30.15160
Z3 z3-4.7.1_default sat ✅ 847.83300 847.69900
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 53.39700 53.39820
Poolector-wrapped-sq_default sat ✅ 58.78520 232.50000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 669.30100 669.25800
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 308.40500 308.27600
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 49.01060 170.24600
MinkeyRink ST-wrapped-sq_default sat ✅ 15.42470 15.42360
Par4 Par4-wrapped-sq_default sat ✅ 37.40380 112.01000
STP STP-2019-wrapped-sq_default sat ✅ 210.34600 210.34900
stp-mergesat-fixed-wrapped-sq_default sat ✅ 506.53900 506.44900
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2400.01000
stp-mt-wrapped-sq_default sat ✅ 60.62070 221.42100
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.03000 3185.15000
stp-riss-wrapped-sq_default unknown ❌ 4.56704 4.56694
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 18.29750 18.29120
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 13.97800 13.97670
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 55.68570 55.68810
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.84000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 10.56340 10.56390
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 476.28900 476.29300
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 66.12310 66.10820
Boolector Boolector-wrapped-sq_default sat ✅ 152.30300 152.23100
Poolector-wrapped-sq_default sat ✅ 181.85900 719.20000
CVC4 CVC4-sq-final_default sat ✅ 105.30100 105.26200
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1199.88000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.72000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.71984 1.72003
MinkeyRink Solver 2020.3_default sat ✅ 15.39200 55.30830
STP STP_default sat ✅ 166.06500 642.82400
STP ++ Mergsat v1_default sat ✅ 341.07200 341.00100
Yices2 Yices 2.6.2 bug fix_default sat ✅ 14.52970 14.52880
Z3 z3-4.8.8_default sat ✅ 257.17400 257.16900
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 62.57820 62.56500
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.86000
STP STP 2021.0_default sat ✅ 217.57900 842.81500
Z3 z3-4.8.11_default sat ✅ 241.46400 241.39100
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 63.39420 63.38230
Bitwuzla-wrapped_default sat ✅ 63.07050 63.06690
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 56.27580 56.27520
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.74000
STP STP 2022.4_default sat ✅ 23.50330 23.49930
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 16.84130 16.83940
Z3++BV z3++bv_0702_default sat ✅ 35.35270 35.35200
Z3 z3-4.8.17_default sat ✅ 138.87300 138.85400
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 38.95790 38.95000
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 58.39200 58.38540
STP STP 2022.4_default sat ✅ 17.16380 17.16460
STP 2022.4_default sat ✅ 17.26120 17.26080
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.67782 12.53870
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 39.41000 39.41040
Z3-Owl z3-Owl-Final_default sat ✅ 378.14600 378.13100
z3-Owl-Final_default sat ✅ 298.57600 298.55300
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 5.32749 5.22211
cvc5 cvc5 sat ✅ 86.29155 86.14382
SMTInterpol SMTInterpol unknown ❌ 1201.74277 1245.40295
STP STP sat ✅ 19.11714 19.01669
Yices2 Yices2 sat ✅ 10.59217 10.48751
Z3alpha Z3-alpha unknown ❌ 1201.07550 1200.62963
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 3.25548 3.12887
Bitwuzla-MachBV-base sat ✅ 9.39006 9.26651
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 9.56799 9.44077
BVDecide bv_decide sat ✅ 1142.18246 1142.51748
bv_decide-nokernel sat ✅ 1198.89397 1199.33821
cvc5 cvc5 sat ✅ 38.77467 38.64901
SMTInterpol SMTInterpol unknown ❌ 1201.85172 1233.40962
Yices2 Yices2 sat ✅ 8.97986 8.85965
Z3alpha Z3-alpha sat ✅ 635.53758 2534.67796
Z3 Z3-alpha-base sat ✅ 404.24405 404.08259
Z3-Owl-base unknown ❌ 1201.33796 1201.02320
z3siri-base sat ✅ 410.23971 410.04000
Z3-Owl Z3-Owl unknown ❌ 1202.26042 1201.49503