Benchmark

non-incremental/QF_BV/Sage2/bench_3793.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1642710
Compressed Size39059
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1642702
Compressed Size39050
Max. Term Depth807
Asserts 794
Declared Functions0
Declared Constants3504
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 ite26 not167
=199 let12709 extract13 bvand8
bvor12 bvadd19928 bvmul509 bvudiv140
bvult157 bvule163 bvugt39 bvuge254
bvsle2 bvsge6 bvshl14186 bvlshr38
zero_extend19138

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 3.27261 3.27165
Boolector SMT17 final boolector sat ✅ 7.38135 7.37988
CVC4 CVC4-smtcomp2017-main default sat ✅ 18.31430 36.03440
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.11400 599.93000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.70133 3.60550
Q3B Q3B default unknown ❌ 600.02800 1200.92000
STP stp_st default sat ✅ 4.56126 4.55561
stp_mt default sat ✅ 4.06195 12.45400
Yices2 Yices2-Main default sat ✅ 0.85115 0.84831
Z3 z3-4.5.0 default unknown ❌ 600.01800 599.92100
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 3.03929 3.03931
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 22.01750 22.01580
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 641.89800 641.81000
MinkeyRink Minkeyrink MT_mt sat ✅ 2.40488 5.00250
Minkeyrink ST_st sat ✅ 2.64588 2.64595
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.31348 3.31362
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.35540 10.02870
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.34307 6.34156
Yices2 Yices 2.6.0_default sat ✅ 0.95472 0.95465
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.81000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 5.33944 5.33925
Poolector-wrapped-sq_default sat ✅ 2.61485 9.93000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 6.21373 6.21323
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 18.74290 18.74170
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 2.93723 7.17480
MinkeyRink ST-wrapped-sq_default sat ✅ 2.49431 2.49403
Par4 Par4-wrapped-sq_default sat ✅ 0.97951 2.69000
STP STP-2019-wrapped-sq_default sat ✅ 2.25932 2.25965
stp-mergesat-fixed-wrapped-sq_default sat ✅ 14.85440 14.84250
stp-minisat-wrapped-sq_default sat ✅ 1.86802 1.86803
stp-mt-wrapped-sq_default sat ✅ 2.62614 6.99766
stp-portfolio-fixed-wrapped-sq_default sat ✅ 12.94700 15.31660
stp-riss-wrapped-sq_default unknown ❌ 1.10623 1.10630
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.02202 1.02197
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.20923 2.20935
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 5.53271 5.53256
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2399.97000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 1.08633 2.10028
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.01000 2399.82000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.12325 4.12303
Boolector Boolector-wrapped-sq_default sat ✅ 1.61963 1.61964
Poolector-wrapped-sq_default sat ✅ 1.98240 7.26000
CVC4 CVC4-sq-final_default sat ✅ 84.22010 84.21600
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1199.95000
MathSAT MathSAT5_default.sh sat ✅ 720.86100 720.69800
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.35319 1.35319
MinkeyRink Solver 2020.3_default sat ✅ 2.26102 4.82098
STP STP_default sat ✅ 1.96049 5.12699
STP ++ Mergsat v1_default sat ✅ 1.60240 1.60411
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.09472 4.09448
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.93000
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.42589 4.42321
Bitwuzla-wrapped_default sat ✅ 4.37276 4.37265
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 99.21410 99.21240
MathSAT MathSAT-5.6.8_default sat ✅ 646.13300 645.68300
STP STP 2022.4_default sat ✅ 2.80952 5.59950
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 3.60752 3.60732
Z3++BV z3++bv_0702_default sat ✅ 48.11210 48.11010
Z3 z3-4.8.17_default unknown ❌ 1200.11000 1199.90000
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 3.58693 3.48398
cvc5 cvc5 sat ✅ 58.43778 58.31692
SMTInterpol SMTInterpol unknown ❌ 211.61793 252.57906
STP STP sat ✅ 2.77617 2.67618
Yices2 Yices2 sat ✅ 1.67605 1.57564
Z3alpha Z3-alpha unknown ❌ 1201.72227 1200.63413
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla sat ✅ 2.61757 2.49806
Bitwuzla-MachBV-base sat ✅ 2.97610 2.85196
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.91532 2.79704
BVDecide bv_decide sat ✅ 36.33002 36.20027
bv_decide-nokernel sat ✅ 29.25427 29.12450
cvc5 cvc5 sat ✅ 47.12317 46.99934
SMTInterpol SMTInterpol unknown ❌ 211.83439 236.67793
Yices2 Yices2 sat ✅ 2.07667 1.95776
Z3alpha Z3-alpha unknown ❌ 1201.00864 4802.10854
Z3 Z3-alpha-base unknown ❌ 1201.28861 1200.92716
Z3-Owl-base unknown ❌ 1201.27429 1201.01200
z3siri-base unknown ❌ 1201.29033 1201.01847
Z3-Owl Z3-Owl sat ✅ 78.19934 78.06567