Benchmark

non-incremental/QF_BV/20190311-bv-term-small-rw-Noetzli/bv-term-small-rw_609.smt2

Publications: "Syntax-Guided Rewrite Rule Enumeration for SMT Solvers" by A. Noetzli, A. Reynolds, H. Barbosa, A. Niemetz, M. Preiner, C. Barrett, and C. Tinelli, SAT 2019.
Benchmark
Size740
Compressed Size440
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2019-07-07
Generated ByAndres Noetzli, Andrew Reynolds, Haniel Barbosa, Aina Niemetz, Mathias Preiner, Clark Barrett, Cesare Tinelli
Generated On2018-11-08 00:00:00
GeneratorCVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 732
Compressed Size437
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =1 bvneg2 bvmul2
bvshl2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.15140 2.15136
Poolector-wrapped-sq_default unsat ✅ 2.31646 8.68000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 4.49860 4.49675
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.58476 2.58508
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.01412 0.01428
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.01275 0.01286
Par4 Par4-wrapped-sq_default unsat ✅ 1.72099 4.99000
STP STP-2019-wrapped-sq_default unsat ✅ 0.01260 0.01275
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.01239 0.01258
stp-minisat-wrapped-sq_default unsat ✅ 0.01277 0.01290
stp-mt-wrapped-sq_default unsat ✅ 0.01292 0.01311
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.01257 0.01273
stp-riss-wrapped-sq_default unsat ✅ 0.01321 0.01328
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00922 0.00583
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.00702 0.00459
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.00903 0.00571
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 6.73493 6.73197
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01067 0.00607
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 32.47440 32.46460
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.14669 0.14667
Boolector Boolector-wrapped-sq_default unsat ✅ 2.35233 2.35230
Poolector-wrapped-sq_default unsat ✅ 2.48956 9.36000
CVC4 CVC4-sq-final_default unsat ✅ 3.29581 3.29615
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 9.65529 9.65513
MathSAT MathSAT5_default.sh unsat ✅ 8.43400 8.43299
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01194 0.01202
MinkeyRink Solver 2020.3_default unsat ✅ 0.01725 0.01224
STP STP_default unsat ✅ 0.01182 0.01195
STP ++ Mergsat v1_default unsat ✅ 0.01048 0.00685
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01286 0.00355
Z3 z3-4.8.8_default unsat ✅ 21.28170 21.28090
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.12679 0.12674
MathSAT mathsat-5.6.6_default unsat ✅ 8.50040 8.49905
STP STP 2021.0_default unsat ✅ 0.02975 0.01376
Z3 z3-4.8.11_default unsat ✅ 26.78670 26.78500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01556 0.01552
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.85593 3.85048
STP STP 2022.4_default unsat ✅ 0.01048 0.01010
STP 2022.4_default unsat ✅ 0.01096 0.01019
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.41559 11.79140
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01055 0.00348
Z3-Owl z3-Owl-Final_default unsat ✅ 0.68617 0.68620
z3-Owl-Final_default unsat ✅ 0.69312 0.69325
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.23345 0.13348
cvc5 cvc5 unsat ✅ 3.85979 3.75830
SMTInterpol SMTInterpol unknown ❌ 0.44631 0.50177
STP STP unsat ✅ 0.21061 0.11091
Yices2 Yices2 unsat ✅ 0.21172 0.11189
Z3alpha Z3-alpha unsat ✅ 0.27000 0.16944
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.24730 0.12894
Bitwuzla-MachBV-base unsat ✅ 0.24969 0.12972
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.35737 0.23003
BVDecide bv_decide unsat ✅ 0.57455 0.44641
bv_decide-nokernel unsat ✅ 0.55310 0.42573
cvc5 cvc5 unsat ✅ 2.72639 2.60760
SMTInterpol SMTInterpol unknown ❌ 0.51098 0.58098
Yices2 Yices2 unsat ✅ 0.24050 0.12487
Z3alpha Z3-alpha unsat ✅ 0.39022 0.26790
Z3 Z3-alpha-base unsat ✅ 0.31467 0.18856
Z3-Owl-base unsat ✅ 0.30255 0.17608
z3siri-base unsat ✅ 0.28973 0.16585
Z3-Owl Z3-Owl unsat ✅ 0.80870 0.67736