Benchmark

non-incremental/QF_BV/20190311-bv-term-small-rw-Noetzli/bv-term-small-rw_1244.smt2

Publications: "Syntax-Guided Rewrite Rule Enumeration for SMT Solvers" by A. Noetzli, A. Reynolds, H. Barbosa, A. Niemetz, M. Preiner, C. Barrett, and C. Tinelli, SAT 2019.
Benchmark
Size744
Compressed Size440
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2019-07-07
Generated ByAndres Noetzli, Andrew Reynolds, Haniel Barbosa, Aina Niemetz, Mathias Preiner, Clark Barrett, Cesare Tinelli
Generated On2018-11-08 00:00:00
GeneratorCVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 736
Compressed Size440
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =1 bvadd2 bvmul2
bvshl2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.00961 0.00645
Poolector-wrapped-sq_default unsat ✅ 0.17705 0.11584
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.01286 0.01285
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.01000 2399.93000
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.02986 0.03051
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.02755 0.02765
Par4 Par4-wrapped-sq_default unsat ✅ 0.03926 0.00564
STP STP-2019-wrapped-sq_default unsat ✅ 0.02516 0.02548
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.02021 0.02043
stp-minisat-wrapped-sq_default unsat ✅ 0.01878 0.01903
stp-mt-wrapped-sq_default unsat ✅ 0.02738 0.02824
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 0.16498 0.14174
stp-riss-wrapped-sq_default unsat ✅ 0.02017 0.02038
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00970 0.00620
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.00894 0.00558
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01017 0.00627
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.90000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01075 0.00621
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03957 0.03956
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.02270 0.00479
Boolector Boolector-wrapped-sq_default unsat ✅ 0.02293 0.00695
Poolector-wrapped-sq_default unsat ✅ 0.17775 0.11595
CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 1199.94000
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.04136 0.04129
MathSAT MathSAT5_default.sh unsat ✅ 0.02091 0.02086
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01185 0.01195
MinkeyRink Solver 2020.3_default unsat ✅ 0.01415 0.01254
STP STP_default unsat ✅ 0.01190 0.01195
STP ++ Mergsat v1_default unsat ✅ 0.01119 0.00675
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01750 0.00424
Z3 z3-4.8.8_default unsat ✅ 0.03460 0.03457
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01229 0.00458
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.84000
STP STP 2021.0_default unsat ✅ 0.02082 0.01260
Z3 z3-4.8.11_default unsat ✅ 0.02359 0.01929
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01628 0.01625
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.10000 1200.08000
STP STP 2022.4_default unsat ✅ 0.01480 0.01176
STP 2022.4_default unsat ✅ 0.01088 0.01089
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.45833 11.33320
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01028 0.00346
Z3-Owl z3-Owl-Final_default unsat ✅ 0.68368 0.68364
z3-Owl-Final_default unsat ✅ 0.69477 0.69498
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 0.28420 0.15700
Bitwuzla-MachBV-base unsat ✅ 0.28479 0.15719
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.32764 0.20885
BVDecide bv_decide unknown ❌ 1203.62317 1203.51239
bv_decide-nokernel unknown ❌ 1203.62778 1203.49311
cvc5 cvc5 unknown ❌ 1201.79542 1201.04527
SMTInterpol SMTInterpol unknown ❌ 0.52711 0.59932
Yices2 Yices2 unsat ✅ 0.27333 0.14362
Z3alpha Z3-alpha unsat ✅ 0.36637 0.24884
Z3 Z3-alpha-base unsat ✅ 0.31091 0.18481
Z3-Owl-base unsat ✅ 0.29405 0.17283
z3siri-base unsat ✅ 0.28783 0.16946
Z3-Owl Z3-Owl unsat ✅ 0.82461 0.69113