Benchmark

non-incremental/QF_BV/log-slicing/bvult_23946.smt2

Checking the soundness of the translation of bvult to base operations (bitwise ones, equality, and slicing).
Contributed by Gergely Kovasznai, Andreas Froehlich, and Armin Biere.
Institute for Formal Models and Verification, JKU, Linz, 2013.
source: http://fmv.jku.at/smtbench and "Complexity of Fixed-Size Bit-Vector Logics" by Gergely Kovasznai, Andreas Froehlich, and Armin Biere. Submitted to the journal Theory of Computing Systems in 2013.
Benchmark
Size51191
Compressed Size5681
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 51183
Compressed Size5694
Max. Term Depth5
Asserts 503
Declared Functions0
Declared Constants292
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 =534 extract544 bvnot31
bvand61 bvor30 bvult1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.78 (2/9) 4Simp 4Simp - 2014 default unsat ✅ 1856.69000 1857.36000
Abziz abziz_portfolio_all_features default unknown ❌ 2399.31000 2400.10000
abziz_portfolio_min_features default unknown ❌ 2399.32000 2400.09000
Boolector Boolector boolector unknown ❌ 2399.02000 2400.10000
CVC4 CVC4 f7118b2 default unknown ❌ 0.64740 1.12583
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.61000 2400.02000
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.12000 2400.01000
STP stp-cryptominisat4 default unsat ✅ 2382.42000 2383.27000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.31000 2400.04000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.05000
SMT-COMP 2015 0.43 (4/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 1303.93000 1304.49000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.02000 4822.16000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2360.41000 4739.52000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1911.30000 1911.97000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.97000
STP stp-cryptominisat4 default unknown ❌ 2400.01000 2400.59000
stp-cmsat4-v15 default unsat ✅ 570.08300 570.14300
stp-cmsat4-mt-v15 default unknown ❌ 1.67587 1.67574
stp-minisat-v15 default unsat ✅ 2219.95000 2220.85000
Yices2 Yices default unknown ❌ 2400.01000 2401.00000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.98000
SMT-COMP 2016 0.40 (6/10) ABC ABC_default default_abc unknown ❌ 2400.12000 2401.46000
ABC_glucose glucose unknown ❌ 2400.02000 2401.12000
Boolector Boolector boolector unsat ✅ 1287.82000 1288.54000
Boolector preprop boolector unsat ✅ 1297.08000 1297.72000
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2245.06000 4511.36000
MapleSTP MapleSTP default unsat ✅ 1307.76000 1308.44000
MapleSTP-mt default unsat ✅ 1155.15000 4570.00000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 2137.50000 2138.88000
MinkeyRink Minkeyrink 2016 default unsat ✅ 695.26900 2588.94000
Q3B Q3B default unknown ❌ 2400.06000 7203.45000
STP stp-cms-exp-2016 default unsat ✅ 567.62800 567.88000
stp-cms-mt-2016 default unsat ✅ 586.98000 2320.50000
stp-cms-st-2016 default unsat ✅ 455.48200 455.69200
stp-minisat-st-2016 default unknown ❌ 2400.03000 2401.45000
Yices2 Yices-2.4.2 default unknown ❌ 2400.07000 2401.43000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.23000
SMT-COMP 2017 0.88 (1/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.03600 599.95000
Boolector SMT17 final boolector unknown ❌ 600.06000 600.00000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.07800 1206.20000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.04700 599.93000
MinkeyRink MinkeyRink 2017.3a default unknown ❌ 600.10300 1206.81000
Q3B Q3B default unknown ❌ 600.06200 1430.42000
STP stp_st default unknown ❌ 600.01500 599.87000
stp_mt default unsat ✅ 533.69800 2112.09000
Yices2 Yices2-Main default unknown ❌ 600.09400 600.03400
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.92300
SMT-COMP 2018 0.43 (4/7) Boolector Boolector_default unsat ✅ 1053.53000 1053.44000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 879.26600 879.09900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.95000
MinkeyRink Minkeyrink MT_mt unsat ✅ 605.52400 2350.31000
Minkeyrink ST_st unsat ✅ 565.50600 565.44300
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 468.16100 468.14300
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 446.23200 1768.32000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.01000 1199.93000
Yices2 Yices 2.6.0_default unknown ❌ 1200.09000 1200.05000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.88000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 400.43300 400.42500
Poolector-wrapped-sq_default unsat ✅ 524.75800 2080.14000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1291.63000 1291.50000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1284.46000 1284.40000
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 524.12500 2067.53000
MinkeyRink ST-wrapped-sq_default unsat ✅ 537.87800 537.78800
Par4 Par4-wrapped-sq_default unsat ✅ 1218.60000 3654.50000
STP STP-2019-wrapped-sq_default unsat ✅ 426.54000 426.44200
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 2099.69000 2099.50000
stp-minisat-wrapped-sq_default unsat ✅ 557.34500 557.26300
stp-mt-wrapped-sq_default unsat ✅ 455.50200 1784.03000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2239.77000 3486.33000
stp-riss-wrapped-sq_default unknown ❌ 2.07260 2.06093
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.09000 2399.87000
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 846.80200 846.75200
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 1157.70000 1157.51000
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.05000 2399.96000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 885.82500 885.64300
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2399.92000
SMT-COMP 2020 0.33 (6/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 375.97100 375.93000
Boolector Boolector-wrapped-sq_default unsat ✅ 599.76200 599.73000
Poolector-wrapped-sq_default unsat ✅ 760.42500 3007.83000
CVC4 CVC4-sq-final_default unsat ✅ 1080.19000 1080.08000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1199.94000
MathSAT MathSAT5_default.sh unknown ❌ 1200.01000 1199.85000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 2.01399 2.01407
MinkeyRink Solver 2020.3_default unsat ✅ 501.13300 1964.17000
STP STP_default unsat ✅ 329.70000 1298.58000
STP ++ Mergsat v1_default unknown ❌ 1200.04000 1199.93000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 207.45400 207.40700
Z3 z3-4.8.8_default unknown ❌ 1200.05000 1200.01000
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 336.07400 336.08300
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1006.26000 1006.15000
STP STP 2022.4_default unsat ✅ 479.59500 479.57300
STP 2022.4_default unsat ✅ 480.11300 480.07500
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1221.28000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.11000 1200.01000
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.84000
z3-Owl-Final_default unsat ✅ 813.31700 813.21000