Benchmark

non-incremental/QF_BV/Sage2/bench_8870.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size8048565
Compressed Size69822
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 8048557
Compressed Size69811
Max. Term Depth1460
Asserts 1288
Declared Functions0
Declared Constants701
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite47 not214 =507
let172402 extract52 bvand6 bvor239
bvadd122141 bvmul13038 bvudiv39 bvult206
bvule196 bvugt47 bvuge356 bvsle1
bvsgt20 bvsge1 bvshl239 bvlshr19
zero_extend36321

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.03500 599.90800
Boolector SMT17 final boolector unknown ❌ 600.01500 599.93200
CVC4 CVC4-smtcomp2017-main default sat ✅ 291.12800 581.19700
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.08800 599.83000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 74.38790 143.61000
Q3B Q3B default unknown ❌ 600.04900 1787.51000
STP stp_st default sat ✅ 148.31400 148.24700
stp_mt default sat ✅ 9.86943 22.58430
Yices2 Yices2-Main default sat ✅ 34.62560 34.62010
Z3 z3-4.5.0 default unknown ❌ 600.06600 599.92100
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unknown ❌ 1200.02000 1199.77000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 126.42100 126.41500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.11000 1199.96000
MinkeyRink Minkeyrink MT_mt sat ✅ 29.48260 111.89100
Minkeyrink ST_st sat ✅ 69.93980 69.93430
STP STP-CMS-st-2018_default-no-stderr sat ✅ 96.28600 96.27370
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 122.98500 473.85300
STP-Riss-st-2018_riss-no-stderr sat ✅ 21.12550 21.12140
Yices2 Yices 2.6.0_default sat ✅ 29.13120 29.13100
Z3 z3-4.7.1_default sat ✅ 1060.06000 1060.08000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 108.05200 108.04600
Poolector-wrapped-sq_default sat ✅ 125.97400 498.60000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 751.92500 751.85300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 453.46800 453.32900
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 27.87570 105.80500
MinkeyRink ST-wrapped-sq_default sat ✅ 36.23420 36.23200
Par4 Par4-wrapped-sq_default sat ✅ 38.02680 113.99000
STP STP-2019-wrapped-sq_default sat ✅ 105.82600 105.82600
stp-mergesat-fixed-wrapped-sq_default unknown ❌ 2400.02000 2399.61000
stp-minisat-wrapped-sq_default unknown ❌ 2400.11000 2399.54000
stp-mt-wrapped-sq_default sat ✅ 150.47200 538.86300
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.02000 4904.23000
stp-riss-wrapped-sq_default unknown ❌ 6.28030 5.74253
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 34.28940 34.28730
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 14.75890 14.74240
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 58.51480 58.50660
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2399.96000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 7.59319 7.59295
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 544.04700 543.89600
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 60.98790 60.98670
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.92000
STP STP 2021.0_default sat ✅ 383.74600 1513.42000
Z3 z3-4.8.11_default sat ✅ 222.02600 222.04400
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 61.75080 61.74560
Bitwuzla-wrapped_default sat ✅ 74.18680 74.17900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 58.97110 58.96610
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.09000 1199.75000
STP STP 2022.4_default sat ✅ 9.11205 9.11148
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 15.00250 29.89020
Z3++BV z3++bv_0702_default sat ✅ 33.35120 33.34960
Z3 z3-4.8.17_default sat ✅ 143.17300 143.15800
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 29.36470 29.36160
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 287.21200 287.16700
STP STP 2022.4_default sat ✅ 13.69210 13.69240
STP 2022.4_default sat ✅ 13.68260 13.68150
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 5.24237 15.04590
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 33.31840 33.31590
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.79000
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 9.46066 9.35901
cvc5 cvc5 sat ✅ 89.81125 89.69786
SMTInterpol SMTInterpol unknown ❌ 1201.71803 1244.30250
STP STP sat ✅ 16.02861 15.92115
Yices2 Yices2 sat ✅ 8.05636 7.95620
Z3alpha Z3-alpha unknown ❌ 1201.71925 1201.23229
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 2.44279 2.30784
Bitwuzla-MachBV-base sat ✅ 8.53953 8.41122
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 8.67201 8.52741
BVDecide bv_decide sat ✅ 380.63237 380.57464
bv_decide-nokernel sat ✅ 380.10632 380.07562
cvc5 cvc5 sat ✅ 59.30015 59.17571
SMTInterpol SMTInterpol unknown ❌ 1201.59253 1234.19907
Yices2 Yices2 sat ✅ 8.47068 8.34358
Z3alpha Z3-alpha sat ✅ 913.47268 3590.92895
Z3 Z3-alpha-base sat ✅ 612.42401 612.18235
Z3-Owl-base unknown ❌ 1201.34251 1201.08155
z3siri-base sat ✅ 635.68524 635.45320
Z3-Owl Z3-Owl unknown ❌ 1202.25192 1201.44626