Benchmark

non-incremental/QF_BV/20190311-bv-term-small-rw-Noetzli/bv-term-small-rw_354.smt2

Publications: "Syntax-Guided Rewrite Rule Enumeration for SMT Solvers" by A. Noetzli, A. Reynolds, H. Barbosa, A. Niemetz, M. Preiner, C. Barrett, and C. Tinelli, SAT 2019.
Benchmark
Size738
Compressed Size439
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2019-07-07
Generated ByAndres Noetzli, Andrew Reynolds, Haniel Barbosa, Aina Niemetz, Mathias Preiner, Clark Barrett, Cesare Tinelli
Generated On2018-11-08 00:00:00
GeneratorCVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 730
Compressed Size439
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =1 bvor2 bvneg2
bvmul2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2019 0.25 (6/8) Boolector Boolector-wrapped-sq_default unknown ❌ 2400.09000 2399.91000
Poolector-wrapped-sq_default unknown ❌ 2400.08000 9515.63000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unknown ❌ 2400.06000 2399.89000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.01297 0.01319
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.01429 0.01446
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.01302 0.01307
Par4 Par4-wrapped-sq_default unsat ✅ 0.01346 0.00586
STP STP-2019-wrapped-sq_default unsat ✅ 0.01339 0.01351
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.01284 0.01298
stp-minisat-wrapped-sq_default unsat ✅ 0.01278 0.01293
stp-mt-wrapped-sq_default unsat ✅ 0.01289 0.01305
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.01270 0.01285
stp-riss-wrapped-sq_default unsat ✅ 0.01257 0.01275
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00953 0.00587
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.00854 0.00575
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.00934 0.00558
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.00919 0.00538
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.00999 0.00567
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03465 0.03469
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01215 0.00474
MathSAT mathsat-5.6.6_default unknown ❌ 1200.12000 1200.05000
STP STP 2021.0_default unsat ✅ 0.01670 0.01225
Z3 z3-4.8.11_default unsat ✅ 0.02166 0.02154
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01181 0.00473
Bitwuzla-wrapped_default unsat ✅ 0.01067 0.00446
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.01767 0.01820
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.11000 1200.09000
STP STP 2022.4_default unsat ✅ 0.01077 0.01027
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01252 0.00342
Z3++BV z3++bv_0702_default unsat ✅ 0.01446 0.01441
Z3 z3-4.8.17_default unsat ✅ 0.02124 0.02296
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01102 0.00519
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.01839 0.01900
STP STP 2022.4_default unsat ✅ 0.01224 0.01102
STP 2022.4_default unsat ✅ 0.01087 0.01015
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.27674 11.62340
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01029 0.00343
Z3-Owl z3-Owl-Final_default unsat ✅ 0.69059 0.69065
z3-Owl-Final_default unsat ✅ 0.69599 0.69633
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.21613 0.11663
cvc5 cvc5 unsat ✅ 0.22343 0.12410
SMTInterpol SMTInterpol unsat ✅ 0.47626 0.62838
STP STP unsat ✅ 0.24528 0.14583
Yices2 Yices2 unsat ✅ 0.21411 0.11405
Z3alpha Z3-alpha unsat ✅ 0.26861 0.16917
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.28623 0.15874
Bitwuzla-MachBV-base unsat ✅ 0.26743 0.14948
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.35080 0.22708
BVDecide bv_decide unsat ✅ 0.61928 0.44010
bv_decide-nokernel unsat ✅ 0.57195 0.40157
cvc5 cvc5 unsat ✅ 0.29323 0.16539
SMTInterpol SMTInterpol unknown ❌ 1201.35456 1254.33054
Yices2 Yices2 unsat ✅ 0.25097 0.12934
Z3alpha Z3-alpha unsat ✅ 0.39392 0.27060
Z3 Z3-alpha-base unsat ✅ 0.28314 0.16524
Z3-Owl-base unsat ✅ 0.26600 0.14956
z3siri-base unsat ✅ 0.30175 0.17263
Z3-Owl Z3-Owl unsat ✅ 0.78827 0.66326