Benchmark

non-incremental/QF_BV/Sage2/bench_6115.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size17330
Compressed Size2286
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 17322
Compressed Size2287
Max. Term Depth54
Asserts 56
Declared Functions0
Declared Constants57
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not22 =55 let328
bvor16 bvadd60 bvmul60 bvshl16
zero_extend154

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.00972 0.00509
Boolector SMT17 final boolector unsat ✅ 0.00972 0.00466
CVC4 CVC4-smtcomp2017-main default unsat ✅ 8.38902 16.79010
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 553.05600 552.99500
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 6.45316 7.76000
Q3B Q3B default unsat ✅ 0.06432 0.06437
STP stp_st default unsat ✅ 0.91594 0.91583
stp_mt default unsat ✅ 2.08562 4.04118
Yices2 Yices2-Main default unsat ✅ 1.35880 1.35759
Z3 z3-4.5.0 default unknown ❌ 600.01500 599.96800
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unsat ✅ 0.00813 0.00413
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1199.97000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 56.62270 56.62350
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.60702 1.98514
Minkeyrink ST_st unsat ✅ 0.58806 0.58820
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 38.64360 38.64130
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 31.12440 123.17300
STP-Riss-st-2018_riss-no-stderr unsat ✅ 20.56960 20.56740
Yices2 Yices 2.6.0_default unsat ✅ 1.99431 1.99403
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.96000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.00988 0.00938
Poolector-wrapped-sq_default unsat ✅ 0.17554 0.12276
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.00930 0.00769
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 543.85700 543.81800
MinkeyRink MinkeyRink MT-wrapped-sq_default unknown ❌ 2400.05000 9532.98000
MinkeyRink ST-wrapped-sq_default unknown ❌ 2400.01000 2399.82000
Par4 Par4-wrapped-sq_default unsat ✅ 0.01370 0.00638
STP STP-2019-wrapped-sq_default unsat ✅ 47.74690 47.74770
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 149.94500 149.94300
stp-minisat-wrapped-sq_default unsat ✅ 226.74300 226.72200
stp-mt-wrapped-sq_default unsat ✅ 51.19160 196.51500
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 232.15900 438.73400
stp-riss-wrapped-sq_default unknown ❌ 0.17686 0.17706
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 1.13937 1.13918
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 5.78044 5.78007
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.93247 0.93246
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.71000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.10913 0.10913
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1466.89000 1466.74000
SMT-COMP 2020 0.33 (6/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01809 0.00755
Boolector Boolector-wrapped-sq_default unsat ✅ 0.01726 0.00927
Poolector-wrapped-sq_default unsat ✅ 0.17791 0.12598
CVC4 CVC4-sq-final_default unknown ❌ 1200.05000 1199.96000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.92000
MathSAT MathSAT5_default.sh unsat ✅ 291.65000 291.61900
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.11176 0.11201
MinkeyRink Solver 2020.3_default unknown ❌ 1200.07000 4768.31000
STP STP_default unsat ✅ 5.47749 21.25270
STP ++ Mergsat v1_default unsat ✅ 79.82130 79.81400
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 13.50130 13.49730
Z3 z3-4.8.8_default unsat ✅ 808.75200 808.62100
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01189 0.00709
Bitwuzla-wrapped_default unsat ✅ 0.01101 0.00711
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 577.79300 577.63000
MathSAT MathSAT-5.6.8_default unsat ✅ 257.66400 257.66200
STP STP 2022.4_default unsat ✅ 1.59226 1.59240
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 2.28514 2.28497
Z3++BV z3++bv_0702_default unsat ✅ 0.02050 0.02046
Z3 z3-4.8.17_default unsat ✅ 26.08280 26.08170
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla unsat ✅ 0.21798 0.11817
cvc5 cvc5 unknown ❌ 1201.71654 1200.66998
SMTInterpol SMTInterpol unknown ❌ 1201.71055 1244.35479
STP STP unsat ✅ 3.22219 3.12158
Yices2 Yices2 unsat ✅ 1.65223 1.55239
Z3alpha Z3-alpha unsat ✅ 0.29452 0.19494
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.28948 0.16214
Bitwuzla-MachBV-base unsat ✅ 0.28724 0.16076
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.36783 0.23313
BVDecide bv_decide unsat ✅ 6.15748 6.03878
bv_decide-nokernel unsat ✅ 5.41993 5.28330
cvc5 cvc5 unsat ✅ 80.36060 80.23376
SMTInterpol SMTInterpol unknown ❌ 1201.47584 1259.86391
Yices2 Yices2 unsat ✅ 1.41568 1.29663
Z3alpha Z3-alpha unsat ✅ 0.40213 0.27731
Z3 Z3-alpha-base unsat ✅ 0.30858 0.18424
Z3-Owl-base unsat ✅ 0.28510 0.16310
z3siri-base unsat ✅ 0.26220 0.14358
Z3-Owl Z3-Owl unsat ✅ 0.80833 0.68692