Benchmark

non-incremental/QF_BV/log-slicing/bvult_6000.smt2

Checking the soundness of the translation of bvult to base operations (bitwise ones, equality, and slicing).
Contributed by Gergely Kovasznai, Andreas Froehlich, and Armin Biere.
Institute for Formal Models and Verification, JKU, Linz, 2013.
source: http://fmv.jku.at/smtbench and "Complexity of Fixed-Size Bit-Vector Logics" by Gergely Kovasznai, Andreas Froehlich, and Armin Biere. Submitted to the journal Theory of Computing Systems in 2013.
Benchmark
Size39434
Compressed Size4433
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 39426
Compressed Size4446
Max. Term Depth5
Asserts 385
Declared Functions0
Declared Constants228
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =412 extract420 bvnot27
bvand53 bvor26 bvult1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.11 (8/9) 4Simp 4Simp - 2014 default unsat ✅ 68.79100 68.80750
Abziz abziz_portfolio_all_features default unsat ✅ 92.38570 92.28970
abziz_portfolio_min_features default unsat ✅ 123.16300 123.09600
Boolector Boolector boolector unsat ✅ 417.50000 417.62000
CVC4 CVC4 f7118b2 default unknown ❌ 0.22747 0.35695
MathSAT MathSAT-5.2.12-Main default unsat ✅ 325.53100 325.57700
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 121.55400 121.57500
STP stp-cryptominisat4 default unsat ✅ 118.99500 119.02400
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 489.68000 489.86000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 66.35310 66.33690
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 102.23300 102.25800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 93.37590 187.37200
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 153.12200 307.24300
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 77.39440 77.42420
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.88000
STP stp-cryptominisat4 default unsat ✅ 183.82300 183.90100
stp-cmsat4-v15 default unsat ✅ 41.14240 41.15870
stp-cmsat4-mt-v15 default unknown ❌ 0.54832 0.54692
stp-minisat-v15 default unsat ✅ 96.43640 96.45630
Yices2 Yices default unsat ✅ 695.42400 695.70100
Z3 z3 4.4.0 default unsat ✅ 75.22730 75.26460
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 344.14900 340.54700
ABC_glucose glucose unsat ✅ 184.91200 185.02200
Boolector Boolector boolector unsat ✅ 102.26900 102.33000
Boolector preprop boolector unsat ✅ 103.46600 103.52600
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 144.41700 290.05500
MapleSTP MapleSTP default unsat ✅ 62.60170 62.63780
MapleSTP-mt default unsat ✅ 77.64420 306.40100
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 84.45920 84.51470
MinkeyRink Minkeyrink 2016 default unsat ✅ 52.13760 187.61500
Q3B Q3B default unknown ❌ 2400.06000 7203.97000
STP stp-cms-exp-2016 default unsat ✅ 37.85200 37.86630
stp-cms-mt-2016 default unsat ✅ 47.50100 181.19300
stp-cms-st-2016 default unsat ✅ 45.59350 45.62070
stp-minisat-st-2016 default unsat ✅ 970.00600 970.56100
Yices2 Yices-2.4.2 default unsat ✅ 757.01400 757.41800
Z3 z3-4.4.1 default unsat ✅ 73.83230 73.87870
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 59.95110 59.94710
Boolector SMT17 final boolector unsat ✅ 103.15200 103.14400
CVC4 CVC4-smtcomp2017-main default unsat ✅ 152.77100 306.74000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 101.12100 101.09800
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 49.38450 94.24580
Q3B Q3B default unknown ❌ 600.05600 1785.22000
STP stp_st default unsat ✅ 54.63860 54.63180
stp_mt default unsat ✅ 54.04270 169.94600
Yices2 Yices2-Main default unsat ✅ 443.47200 443.41900
Z3 z3-4.5.0 default unsat ✅ 70.63480 70.62700
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 42.84770 42.84240
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 26.57030 26.57140
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 66.41150 66.40730
MinkeyRink Minkeyrink MT_mt unsat ✅ 84.74160 335.06300
Minkeyrink ST_st unsat ✅ 98.21040 98.20530
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 94.38710 94.36560
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 85.98660 340.49300
STP-Riss-st-2018_riss-no-stderr unsat ✅ 60.33660 60.32300
Yices2 Yices 2.6.0_default unsat ✅ 564.95500 564.90300
Z3 z3-4.7.1_default unsat ✅ 123.82300 123.81800
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 22.83840 22.83080
Poolector-wrapped-sq_default unsat ✅ 27.57340 108.72000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 88.05890 88.04510
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 41.80670 41.80710
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 92.25780 364.50300
MinkeyRink ST-wrapped-sq_default unsat ✅ 103.10000 103.10700
Par4 Par4-wrapped-sq_default unsat ✅ 31.21860 93.43000
STP STP-2019-wrapped-sq_default unsat ✅ 86.81760 86.82270
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 121.52800 121.52400
stp-minisat-wrapped-sq_default unsat ✅ 30.93910 30.93990
stp-mt-wrapped-sq_default unsat ✅ 80.58310 318.25200
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 145.47300 304.48700
stp-riss-wrapped-sq_default unknown ❌ 0.50906 0.50923
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 685.61200 685.57300
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 34.38090 34.38060
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 155.24000 155.20300
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.81000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 29.70520 29.70240
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 146.38700 146.38900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 22.51840 22.51750
Boolector Boolector-wrapped-sq_default unsat ✅ 32.15250 32.15300
Poolector-wrapped-sq_default unsat ✅ 38.25660 151.08000
CVC4 CVC4-sq-final_default unsat ✅ 42.53480 42.53130
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.93000
MathSAT MathSAT5_default.sh unsat ✅ 365.32400 365.26000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.49974 0.49997
MinkeyRink Solver 2020.3_default unsat ✅ 64.09500 253.15400
STP STP_default unsat ✅ 63.87600 252.24700
STP ++ Mergsat v1_default unsat ✅ 143.26200 143.23400
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 15.34430 15.34470
Z3 z3-4.8.8_default unsat ✅ 34.88270 34.88170
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 21.82400 21.82440
MathSAT mathsat-5.6.6_default unsat ✅ 397.39300 397.37200
STP STP 2021.0_default unsat ✅ 70.19770 277.34900
Z3 z3-4.8.11_default unsat ✅ 59.04060 59.04490
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 24.30040 24.29750
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 32.63650 32.63660
STP STP 2022.4_default unsat ✅ 19.30800 19.30620
STP 2022.4_default unsat ✅ 19.32630 19.32700
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1527.74000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 638.23700 638.16200
Z3-Owl z3-Owl-Final_default unsat ✅ 80.94800 80.94240
z3-Owl-Final_default unsat ✅ 64.99290 64.97590
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 20.68374 20.57281
cvc5 cvc5 unsat ✅ 24.60013 24.49948
SMTInterpol SMTInterpol unknown ❌ 1202.22046 1356.76094
STP STP unsat ✅ 19.87978 19.77613
Yices2 Yices2 unsat ✅ 12.61239 12.50722
Z3alpha Z3-alpha unsat ✅ 263.44377 263.33118