Benchmark

non-incremental/QF_BV/log-slicing/bvult_19958.smt2 

Checking the soundness of the translation of bvult to base operations (bitwise ones, equality, and slicing).
Contributed by Gergely Kovasznai, Andreas Froehlich, and Armin Biere.
Institute for Formal Models and Verification, JKU, Linz, 2013.
source: http://fmv.jku.at/smtbench and "Complexity of Fixed-Size Bit-Vector Logics" by Gergely Kovasznai, Andreas Froehlich, and Armin Biere. Submitted to the journal Theory of Computing Systems in 2013.
Benchmark
Size51193
Compressed Size5664
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 51185
Compressed Size5679
Max. Term Depth5
Asserts 503
Declared Functions0
Declared Constants292
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =534 extract544 bvnot31
bvand61 bvor30 bvult1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (3/9) 4Simp 4Simp - 2014 default unsat ✅ 1502.06000 1502.46000
Abziz abziz_portfolio_all_features default unsat ✅ 2352.58000 2353.61000
abziz_portfolio_min_features default unknown ❌ 2399.12000 2400.10000
Boolector Boolector boolector unsat ✅ 1743.20000 1743.91000
CVC4 CVC4 f7118b2 default unknown ❌ 0.59100 1.01884
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.12000 2400.07000
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.22000 2400.09000
STP stp-cryptominisat4 default unknown ❌ 2399.12000 2400.03000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2398.91000 2400.11000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.02000
SMT-COMP 2015 0.43 (4/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 823.44900 823.79800
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.02000 4822.23000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1724.41000 3464.11000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1720.66000 1721.22000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unknown ❌ 2400.01000 2400.91000
stp-cmsat4-v15 default unsat ✅ 476.28100 476.51700
stp-cmsat4-mt-v15 default unknown ❌ 1.54328 1.54276
stp-minisat-v15 default unsat ✅ 1649.79000 1650.43000
Yices2 Yices default unknown ❌ 2400.01000 2401.05000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.99000
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 2400.11000 2401.45000
ABC_glucose glucose unsat ✅ 2247.60000 2248.64000
Boolector Boolector boolector unsat ✅ 1084.64000 1085.23000
Boolector preprop boolector unsat ✅ 1091.27000 1091.93000
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1819.59000 3656.33000
MapleSTP MapleSTP default unsat ✅ 1100.06000 1100.57000
MapleSTP-mt default unsat ✅ 1140.83000 4524.23000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 2352.79000 2354.07000
MinkeyRink Minkeyrink 2016 default unsat ✅ 505.00700 1852.35000
Q3B Q3B default unknown ❌ 2400.04000 7203.11000
STP stp-cms-exp-2016 default unsat ✅ 401.38300 401.57900
stp-cms-mt-2016 default unsat ✅ 366.68200 1450.49000
stp-cms-st-2016 default unsat ✅ 385.30900 385.52800
stp-minisat-st-2016 default unknown ❌ 2400.10000 2401.48000
Yices2 Yices-2.4.2 default unknown ❌ 2400.06000 2401.43000
Z3 z3-4.4.1 default unsat ✅ 1696.39000 1697.34000
SMT-COMP 2017 0.75 (2/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.07000 599.99000
Boolector SMT17 final boolector unknown ❌ 600.02200 599.86000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.11700 1207.48000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.09800 600.02000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 553.95100 1115.04000
Q3B Q3B default unknown ❌ 600.10900 1799.66000
STP stp_st default unsat ✅ 489.83800 489.77400
stp_mt default unsat ✅ 416.05200 1646.88000
Yices2 Yices2-Main default unknown ❌ 600.02900 599.94600
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.91300
SMT-COMP 2018 0.43 (4/7) Boolector Boolector_default unsat ✅ 941.59000 941.55900
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 762.23200 762.13400
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.80000
MinkeyRink Minkeyrink MT_mt unsat ✅ 532.94000 2083.26000
Minkeyrink ST_st unsat ✅ 502.72300 502.69000
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 504.48100 504.44000
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 454.24100 1788.04000
STP-Riss-st-2018_riss-no-stderr unsat ✅ 916.64900 916.53300
Yices2 Yices 2.6.0_default unknown ❌ 1200.05000 1199.97000
Z3 z3-4.7.1_default unknown ❌ 1200.04000 1200.03000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 313.96200 313.93600
Poolector-wrapped-sq_default unsat ✅ 434.20100 1716.75000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1142.58000 1142.56000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1315.16000 1315.12000
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 482.49300 1886.88000
MinkeyRink ST-wrapped-sq_default unsat ✅ 505.56200 505.54300
Par4 Par4-wrapped-sq_default unsat ✅ 887.80900 2662.97000
STP STP-2019-wrapped-sq_default unsat ✅ 416.31000 416.27700
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1384.98000 1384.73000
stp-minisat-wrapped-sq_default unsat ✅ 399.68500 399.64400
stp-mt-wrapped-sq_default unsat ✅ 429.52900 1689.40000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1543.19000 2613.10000
stp-riss-wrapped-sq_default unknown ❌ 1.96223 1.96217
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.07000 2399.88000
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 554.79100 554.70300
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 895.51700 895.46300
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.79000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 956.94500 956.78800
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.08000 2399.81000
SMT-COMP 2020 0.33 (6/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 308.51000 308.47000
Boolector Boolector-wrapped-sq_default unsat ✅ 346.27600 346.24500
Poolector-wrapped-sq_default unsat ✅ 473.73000 1875.74000
CVC4 CVC4-sq-final_default unsat ✅ 716.44100 716.32700
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1199.80000
MathSAT MathSAT5_default.sh unknown ❌ 1200.03000 1199.98000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.99567 1.99572
MinkeyRink Solver 2020.3_default unsat ✅ 363.66600 1390.72000
STP STP_default unsat ✅ 404.37900 1592.17000
STP ++ Mergsat v1_default unknown ❌ 1200.10000 1200.11000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 148.60600 148.59400
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.79000
SMT-COMP 2023 0.50 (3/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 513.89100 513.82100
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.88000
STP STP 2022.4_default unsat ✅ 597.14500 597.10000
STP 2022.4_default unsat ✅ 582.49200 582.49500
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1219.75000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.84000
Z3-Owl z3-Owl-Final_default unsat ✅ 1046.94000 1046.83000
z3-Owl-Final_default unsat ✅ 636.41800 636.35300
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 178.42656 178.31930
cvc5 cvc5 unsat ✅ 987.06905 986.92043
SMTInterpol SMTInterpol unknown ❌ 1202.22706 1266.71093
STP STP unsat ✅ 259.92967 259.82543
Yices2 Yices2 unsat ✅ 155.72597 155.62217
Z3alpha Z3-alpha unsat ✅ 1046.94316 1046.77970
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 109.82741 109.65820
Bitwuzla-MachBV-base unsat ✅ 150.25835 150.10330
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 166.84084 166.70356
BVDecide bv_decide unknown ❌ 245.04454 245.36625
bv_decide-nokernel unknown ❌ 240.02677 240.16632
cvc5 cvc5 unsat ✅ 705.54671 705.32828
SMTInterpol SMTInterpol unknown ❌ 1201.78636 1420.48466
Yices2 Yices2 unsat ✅ 95.86689 95.72109
Z3alpha Z3-alpha unsat ✅ 888.28151 3543.99010
Z3 Z3-alpha-base unsat ✅ 851.11499 850.93561
Z3-Owl-base unknown ❌ 1201.36406 1201.14654
z3siri-base unsat ✅ 870.35793 870.16088
Z3-Owl Z3-Owl unsat ✅ 788.46012 788.17145