Benchmark

non-incremental/QF_BV/20190311-bv-term-small-rw-Noetzli/bv-term-small-rw_1440.smt2

Publications: "Syntax-Guided Rewrite Rule Enumeration for SMT Solvers" by A. Noetzli, A. Reynolds, H. Barbosa, A. Niemetz, M. Preiner, C. Barrett, and C. Tinelli, SAT 2019.
Benchmark
Size746
Compressed Size446
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2019-07-07
Generated ByAndres Noetzli, Andrew Reynolds, Haniel Barbosa, Aina Niemetz, Mathias Preiner, Clark Barrett, Cesare Tinelli
Generated On2018-11-08 00:00:00
GeneratorCVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 738
Compressed Size444
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =1 bvadd2 bvmul2
bvshl2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2019 0.75 (2/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.00899 0.00620
Poolector-wrapped-sq_default unsat ✅ 0.17514 0.11339
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unknown ❌ 2400.03000 2399.86000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2399.66000
MinkeyRink MinkeyRink MT-wrapped-sq_default unknown ❌ 2400.08000 9508.98000
MinkeyRink ST-wrapped-sq_default unknown ❌ 2400.11000 2399.68000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.17000 7199.45000
STP STP-2019-wrapped-sq_default unknown ❌ 2400.02000 2399.90000
stp-mergesat-fixed-wrapped-sq_default unknown ❌ 2400.02000 2400.15000
stp-minisat-wrapped-sq_default unknown ❌ 2400.10000 2399.94000
stp-mt-wrapped-sq_default unknown ❌ 2400.07000 9533.42000
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.08000 7198.37000
stp-riss-wrapped-sq_default unknown ❌ 0.06198 0.06216
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00989 0.00605
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.00911 0.00546
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01207 0.00596
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.11000 2399.74000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.00936 0.00555
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.01000 2399.41000
SMT-COMP 2020 0.44 (5/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03345 0.00443
Boolector Boolector-wrapped-sq_default unsat ✅ 0.01183 0.00683
Poolector-wrapped-sq_default unsat ✅ 0.17618 0.11471
CVC4 CVC4-sq-final_default unknown ❌ 1200.01000 1199.80000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.85000
MathSAT MathSAT5_default.sh unknown ❌ 1200.11000 1199.93000
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01303 0.01227
MinkeyRink Solver 2020.3_default unsat ✅ 0.02451 0.01294
STP STP_default unsat ✅ 0.01184 0.01199
STP ++ Mergsat v1_default unsat ✅ 0.01164 0.00689
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02662 0.00368
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2021 0.50 (2/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01145 0.00462
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.82000
STP STP 2021.0_default unsat ✅ 0.02537 0.01283
Z3 z3-4.8.11_default unknown ❌ 1200.04000 1199.90000
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01480 0.01476
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.95000
STP STP 2022.4_default unsat ✅ 0.01066 0.01046
STP 2022.4_default unsat ✅ 0.01082 0.01087
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.59915 11.97610
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01236 0.00408
Z3-Owl z3-Owl-Final_default unsat ✅ 0.68453 0.68465
z3-Owl-Final_default unsat ✅ 0.69297 0.69333
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla unsat ✅ 0.21339 0.11371
cvc5 cvc5 unknown ❌ 1201.73959 1201.10872
SMTInterpol SMTInterpol unknown ❌ 0.46194 0.52683
STP STP unsat ✅ 0.21471 0.11508
Yices2 Yices2 unsat ✅ 0.23935 0.13783
Z3alpha Z3-alpha unsat ✅ 0.28283 0.18313
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 0.31560 0.18677
Bitwuzla-MachBV-base unsat ✅ 0.28096 0.15615
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.35532 0.22736
BVDecide bv_decide unknown ❌ 1203.52116 1203.34059
bv_decide-nokernel unknown ❌ 1203.51929 1203.29470
cvc5 cvc5 unknown ❌ 1201.78787 1201.01152
SMTInterpol SMTInterpol unknown ❌ 0.48172 0.56357
Yices2 Yices2 unsat ✅ 0.28315 0.15490
Z3alpha Z3-alpha unsat ✅ 0.37765 0.25982
Z3 Z3-alpha-base unsat ✅ 0.29772 0.17045
Z3-Owl-base unsat ✅ 0.29994 0.17524
z3siri-base unsat ✅ 0.26855 0.15247
Z3-Owl Z3-Owl unsat ✅ 0.82313 0.69375