Benchmark

non-incremental/QF_BV/20190311-bv-term-small-rw-Noetzli/bv-term-small-rw_1322.smt2

Publications: "Syntax-Guided Rewrite Rule Enumeration for SMT Solvers" by A. Noetzli, A. Reynolds, H. Barbosa, A. Niemetz, M. Preiner, C. Barrett, and C. Tinelli, SAT 2019.
Benchmark
Size746
Compressed Size442
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2019-07-07
Generated ByAndres Noetzli, Andrew Reynolds, Haniel Barbosa, Aina Niemetz, Mathias Preiner, Clark Barrett, Cesare Tinelli
Generated On2018-11-08 00:00:00
GeneratorCVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 738
Compressed Size440
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =1 bvmul4 bvshl2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2019 0.75 (2/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.01361 0.00627
Poolector-wrapped-sq_default unsat ✅ 0.17520 0.11183
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unknown ❌ 2400.09000 2399.99000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2399.68000
MinkeyRink MinkeyRink MT-wrapped-sq_default unknown ❌ 2400.04000 9537.90000
MinkeyRink ST-wrapped-sq_default unknown ❌ 2400.02000 2399.93000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.07000 7198.09000
STP STP-2019-wrapped-sq_default unknown ❌ 2400.10000 2399.96000
stp-mergesat-fixed-wrapped-sq_default unknown ❌ 2400.02000 2399.79000
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2400.17000
stp-mt-wrapped-sq_default unknown ❌ 2400.06000 9533.21000
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.06000 7199.14000
stp-riss-wrapped-sq_default unknown ❌ 0.08869 0.08889
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00913 0.00560
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.00888 0.00578
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.00925 0.00559
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.07000 2399.85000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.00978 0.00577
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.73000
SMT-COMP 2020 0.44 (5/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.00969 0.00421
Boolector Boolector-wrapped-sq_default unsat ✅ 0.01160 0.00676
Poolector-wrapped-sq_default unsat ✅ 0.17671 0.11484
CVC4 CVC4-sq-final_default unknown ❌ 1200.01000 1199.75000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.76000
MathSAT MathSAT5_default.sh unknown ❌ 1200.01000 1199.92000
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01154 0.01164
MinkeyRink Solver 2020.3_default unsat ✅ 0.01539 0.01270
STP STP_default unsat ✅ 0.01153 0.01162
STP ++ Mergsat v1_default unsat ✅ 0.01196 0.00711
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01280 0.00325
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.95000
SMT-COMP 2022 0.43 (4/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01328 0.00452
Bitwuzla-wrapped_default unsat ✅ 0.01029 0.00437
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.09000 1199.86000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.86000
STP STP 2022.4_default unsat ✅ 0.01337 0.01042
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01071 0.00352
Z3++BV z3++bv_0702_default unsat ✅ 0.01766 0.01450
Z3 z3-4.8.17_default unknown ❌ 1200.09000 1199.95000
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01925 0.01920
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.01000 1199.69000
STP STP 2022.4_default unsat ✅ 0.01061 0.01023
STP 2022.4_default unsat ✅ 0.01053 0.01029
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.45446 11.62430
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01279 0.00401
Z3-Owl z3-Owl-Final_default unsat ✅ 0.69250 0.69249
z3-Owl-Final_default unsat ✅ 0.69858 0.69869
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla unsat ✅ 0.21509 0.11534
cvc5 cvc5 unknown ❌ 1201.71458 1200.58887
SMTInterpol SMTInterpol unknown ❌ 0.43031 0.51730
STP STP unsat ✅ 0.21237 0.11251
Yices2 Yices2 unsat ✅ 0.21347 0.11360
Z3alpha Z3-alpha unsat ✅ 0.26997 0.17023
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 0.25670 0.13950
Bitwuzla-MachBV-base unsat ✅ 0.24367 0.12559
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.35004 0.22703
BVDecide bv_decide unknown ❌ 1204.56818 1204.37647
bv_decide-nokernel unknown ❌ 1204.51322 1204.27286
cvc5 cvc5 unknown ❌ 1201.78686 1201.04975
SMTInterpol SMTInterpol unknown ❌ 0.54311 0.62136
Yices2 Yices2 unsat ✅ 0.24516 0.12777
Z3alpha Z3-alpha unsat ✅ 0.40535 0.27531
Z3 Z3-alpha-base unsat ✅ 0.32477 0.19822
Z3-Owl-base unsat ✅ 0.31175 0.17623
z3siri-base unsat ✅ 0.29509 0.16738
Z3-Owl Z3-Owl unsat ✅ 0.77844 0.65894