Benchmark

non-incremental/QF_BV/Sage2/bench_15700.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size290230
Compressed Size7670
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 290222
Compressed Size7666
Max. Term Depth159
Asserts 211
Declared Functions0
Declared Constants108
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not42 =44 let6531
extract3 bvand2 bvor4 bvadd2250
bvmul310 bvult31 bvule50 bvugt4
bvuge78 bvsle1 bvsgt1 bvsge1
bvshl1656 bvlshr46 bvashr5 zero_extend2213

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.36863 0.36781
Boolector SMT17 final boolector sat ✅ 2.43918 2.43833
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.30427 2.48036
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 32.08160 32.08100
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.52770 0.51448
Q3B Q3B default unknown ❌ 600.08600 1799.80000
STP stp_st default sat ✅ 1.83051 1.82926
stp_mt default sat ✅ 1.15916 3.73579
Yices2 Yices2-Main default sat ✅ 0.15196 0.15070
Z3 z3-4.5.0 default sat ✅ 5.61602 5.61500
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.23530 0.23521
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.24152 7.24153
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 76.02550 76.01740
MinkeyRink Minkeyrink MT_mt sat ✅ 0.30913 0.58614
Minkeyrink ST_st sat ✅ 0.28764 0.28768
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.56112 0.56132
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.65373 1.59962
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.79719 1.79731
Yices2 Yices 2.6.0_default sat ✅ 0.06600 0.06594
Z3 z3-4.7.1_default sat ✅ 3.60869 3.60833
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.41062 0.41064
Poolector-wrapped-sq_default sat ✅ 0.37757 0.36577
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2.20113 2.20111
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 4.10972 4.11017
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.23579 0.35788
MinkeyRink ST-wrapped-sq_default sat ✅ 0.21468 0.21478
Par4 Par4-wrapped-sq_default sat ✅ 0.27487 0.00581
STP STP-2019-wrapped-sq_default sat ✅ 1.15271 1.15303
stp-mergesat-fixed-wrapped-sq_default sat ✅ 4.90728 4.90744
stp-minisat-wrapped-sq_default sat ✅ 0.43779 0.43802
stp-mt-wrapped-sq_default sat ✅ 1.03122 3.32340
stp-portfolio-fixed-wrapped-sq_default sat ✅ 4.90998 6.15561
stp-riss-wrapped-sq_default unknown ❌ 0.25079 0.25099
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.28066 0.28062
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.08850 0.08853
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.32137 0.32139
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.06000 2400.00000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.09560 0.09560
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 13.86430 13.86300
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.93279 0.93272
Boolector Boolector-wrapped-sq_default sat ✅ 0.56615 0.56611
Poolector-wrapped-sq_default sat ✅ 0.37772 0.36326
CVC4 CVC4-sq-final_default sat ✅ 20.63200 20.62720
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.98000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.61000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.19235 0.19261
MinkeyRink Solver 2020.3_default sat ✅ 0.21967 0.30643
STP STP_default sat ✅ 0.23638 0.46722
STP ++ Mergsat v1_default sat ✅ 0.19355 0.19541
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.10359 0.10351
Z3 z3-4.8.8_default sat ✅ 11.77360 11.77210
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.44632 0.44627
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.72000
STP STP 2021.0_default sat ✅ 0.20816 0.35646
Z3 z3-4.8.11_default sat ✅ 1.81192 1.81175
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.60416 0.60402
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 11.46920 11.46690
STP STP 2022.4_default sat ✅ 0.27241 0.27237
STP 2022.4_default sat ✅ 0.27191 0.27188
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 9.89540 30.06490
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.10066 0.10063
Z3-Owl z3-Owl-Final_default sat ✅ 14.80940 14.80970
z3-Owl-Final_default sat ✅ 18.21730 18.21400
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.38359 0.28271
cvc5 cvc5 sat ✅ 11.43854 11.33648
SMTInterpol SMTInterpol sat ✅ 8.02095 22.61251
STP STP sat ✅ 0.50903 0.40910
Yices2 Yices2 sat ✅ 0.28152 0.17133
Z3alpha Z3-alpha sat ✅ 0.87593 0.77615
SMT-COMP 2025 Bitwuzla Bitwuzla sat ✅ 0.51439 0.38629
Bitwuzla-MachBV-base sat ✅ 0.51592 0.39556
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.58394 0.46157
BVDecide bv_decide sat ✅ 3.65819 3.49495
bv_decide-nokernel sat ✅ 3.61503 3.44848
cvc5 cvc5 sat ✅ 10.93853 10.81225
SMTInterpol SMTInterpol sat ✅ 4.84338 14.18609
Yices2 Yices2 sat ✅ 0.59406 0.46411
Z3alpha Z3-alpha sat ✅ 4.26272 14.22954
Z3 Z3-alpha-base sat ✅ 4.41984 4.28919
Z3-Owl-base sat ✅ 21.57355 21.43755
z3siri-base sat ✅ 4.64951 4.51955
Z3-Owl Z3-Owl sat ✅ 6.52273 6.39106