Benchmark

non-incremental/QF_BV/log-slicing/bvshl_0718.smt2

Checking the soundness of the translation of bvshl to base operations (bitwise ones, equality, and slicing).
Contributed by Gergely Kovasznai, Andreas Froehlich, and Armin Biere.
Institute for Formal Models and Verification, JKU, Linz, 2013.
source: http://fmv.jku.at/smtbench and "Complexity of Fixed-Size Bit-Vector Logics" by Gergely Kovasznai, Andreas Froehlich, and Armin Biere. Submitted to the journal Theory of Computing Systems in 2013.
Benchmark
Size50357
Compressed Size5448
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 50349
Compressed Size5462
Max. Term Depth5
Asserts 500
Declared Functions0
Declared Constants289
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =520 extract545 bvnot33
bvand64 bvor31 bvshl1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (6/9) 4Simp 4Simp - 2014 default unsat ✅ 250.21800 250.30700
Abziz abziz_portfolio_all_features default unsat ✅ 5.49683 5.38993
abziz_portfolio_min_features default unsat ✅ 5.52594 5.40892
Boolector Boolector boolector unsat ✅ 2.56829 2.56761
CVC4 CVC4 f7118b2 default unsat ✅ 958.88100 1924.54000
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.51000 2400.05000
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 227.03200 227.09200
STP stp-cryptominisat4 default unsat ✅ 134.45400 134.49300
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2398.91000 2400.11000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.07000
SMT-COMP 2015 0.29 (5/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 1.12674 1.12583
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 870.03900 1748.13000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 157.62600 316.10700
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1440.40000 1440.68000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.89000
STP stp-cryptominisat4 default unsat ✅ 128.11000 128.13800
stp-cmsat4-v15 default unsat ✅ 58.84380 58.85610
stp-cmsat4-mt-v15 default unknown ❌ 0.34012 0.33895
stp-minisat-v15 default unsat ✅ 664.18700 664.34000
Yices2 Yices default unknown ❌ 2400.01000 2401.05000
Z3 z3 4.4.0 default unsat ✅ 509.17700 509.37400
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 228.04200 225.41400
ABC_glucose glucose unsat ✅ 356.93800 357.02500
Boolector Boolector boolector unsat ✅ 1.55386 1.55462
Boolector preprop boolector unsat ✅ 1.58542 1.58616
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 167.82800 336.78100
MapleSTP MapleSTP default unsat ✅ 467.05600 467.27400
MapleSTP-mt default unsat ✅ 315.75400 1253.89000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1233.91000 1234.50000
MinkeyRink Minkeyrink 2016 default unsat ✅ 93.80750 365.09000
Q3B Q3B default unknown ❌ 2400.03000 7203.74000
STP stp-cms-exp-2016 default unsat ✅ 248.61800 248.72100
stp-cms-mt-2016 default unsat ✅ 106.59300 422.58800
stp-cms-st-2016 default unsat ✅ 149.42900 149.51900
stp-minisat-st-2016 default unknown ❌ 2400.04000 2401.40000
Yices2 Yices-2.4.2 default unknown ❌ 2400.01000 2401.40000
Z3 z3-4.4.1 default unsat ✅ 589.62900 589.95400
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.78728 0.78665
Boolector SMT17 final boolector unsat ✅ 1.91754 1.90107
CVC4 CVC4-smtcomp2017-main default unsat ✅ 192.76000 384.86200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.05200 599.90000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 311.88500 617.11100
Q3B Q3B default unknown ❌ 600.05400 1786.41000
STP stp_st default unsat ✅ 272.68300 272.62500
stp_mt default unsat ✅ 122.33400 387.15900
Yices2 Yices2-Main default unknown ❌ 600.11200 600.06300
Z3 z3-4.5.0 default unsat ✅ 504.28300 504.25400
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unsat ✅ 0.58040 0.58027
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 10.63500 10.63530
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.53000
MinkeyRink Minkeyrink MT_mt unsat ✅ 27.97510 109.14900
Minkeyrink ST_st unsat ✅ 22.71480 22.71560
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 19.57120 19.57170
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 18.99840 74.20990
STP-Riss-st-2018_riss-no-stderr unsat ✅ 286.19100 286.17300
Yices2 Yices 2.6.0_default unknown ❌ 1200.02000 1199.96000
Z3 z3-4.7.1_default unsat ✅ 629.94600 629.87900
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.83366 0.83365
Poolector-wrapped-sq_default unsat ✅ 0.58926 0.57796
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.49829 1.49806
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 37.52680 37.52230
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 33.46180 131.74300
MinkeyRink ST-wrapped-sq_default unsat ✅ 24.85430 24.85370
Par4 Par4-wrapped-sq_default unsat ✅ 0.61485 1.63000
STP STP-2019-wrapped-sq_default unsat ✅ 18.01800 18.01920
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 271.07400 271.04000
stp-minisat-wrapped-sq_default unsat ✅ 677.91100 677.81500
stp-mt-wrapped-sq_default unsat ✅ 22.15630 86.97960
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 654.25000 958.82900
stp-riss-wrapped-sq_default unknown ❌ 0.33270 0.33289
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.02000 2399.86000
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 23.04700 23.04640
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 365.25400 365.18700
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 1563.12000 1562.44000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.33536 0.33536
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 216.80500 216.77500
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.70253 0.70247
Boolector Boolector-wrapped-sq_default unsat ✅ 0.87797 0.87797
Poolector-wrapped-sq_default unsat ✅ 0.57953 1.87000
CVC4 CVC4-sq-final_default unsat ✅ 32.67270 32.67130
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1199.95000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.72000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.36561 0.36583
MinkeyRink Solver 2020.3_default unsat ✅ 16.31580 63.47400
STP STP_default unsat ✅ 13.41310 52.43560
STP ++ Mergsat v1_default unsat ✅ 352.67200 352.66000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 31.35180 31.34670
Z3 z3-4.8.8_default unsat ✅ 346.00600 345.96700
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.67647 0.67640
Bitwuzla-wrapped_default unsat ✅ 0.88116 0.88094
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 95.08700 95.08400
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.12000 1199.82000
STP STP 2022.4_default unsat ✅ 11.46550 11.46550
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 52.03770 52.03350
Z3++BV z3++bv_0702_default unsat ✅ 62.41030 62.39270
Z3 z3-4.8.17_default unsat ✅ 363.53700 363.47800
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 48.91010 48.90960
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 104.71700 104.71300
STP STP 2022.4_default unsat ✅ 13.55540 13.55490
STP 2022.4_default unsat ✅ 13.52780 13.52800
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1512.50000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1200.07000
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.85000
z3-Owl-Final_default unsat ✅ 33.60020 33.59630