Benchmark

non-incremental/QF_BV/Sage2/bench_6109.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size485184
Compressed Size4308
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 485176
Compressed Size4298
Max. Term Depth251
Asserts 86
Declared Functions0
Declared Constants79
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not14 =17 let11293
bvadd5602 bvmul1327 bvult16 bvule16
bvuge31 bvsge5 bvlshr11 zero_extend4339

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.22770 0.22481
Boolector SMT17 final boolector unsat ✅ 0.22327 0.22106
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.86672 3.53659
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.97026 1.96796
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.06593 0.06495
Q3B Q3B default unknown ❌ 600.04900 1799.72000
STP stp_st default unknown ❌ 600.02000 599.93100
stp_mt default unknown ❌ 600.08600 1896.80000
Yices2 Yices2-Main default unsat ✅ 0.16376 0.16371
Z3 z3-4.5.0 default unknown ❌ 600.10300 600.06600
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 0.12201 0.12196
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.61575 1.61561
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.74243 1.74333
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.06605 0.06604
Minkeyrink ST_st unsat ✅ 0.06626 0.06630
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.12000 1200.01000
STP-CMS-mt-2018_multicore-no-stderr unknown ❌ 1200.06000 4773.29000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.06000 1199.82000
Yices2 Yices 2.6.0_default unsat ✅ 0.14374 0.14368
Z3 z3-4.7.1_default unsat ✅ 185.82200 185.79600
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.27355 0.27353
Poolector-wrapped-sq_default unsat ✅ 0.28044 0.38100
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.11525 0.11526
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.82676 0.82703
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.07724 0.07741
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.07649 0.07657
Par4 Par4-wrapped-sq_default unsat ✅ 0.12741 0.00585
STP STP-2019-wrapped-sq_default unsat ✅ 171.80900 171.80100
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 959.87400 959.88100
stp-minisat-wrapped-sq_default unknown ❌ 2400.01000 2399.79000
stp-mt-wrapped-sq_default unsat ✅ 321.90200 1276.92000
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.12000 3693.82000
stp-riss-wrapped-sq_default unknown ❌ 0.65881 0.65893
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.14328 0.14329
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05351 0.05348
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05151 0.05153
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.12000 2399.98000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05404 0.05405
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.89000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.29048 0.29045
Boolector Boolector-wrapped-sq_default unsat ✅ 0.25945 0.25943
Poolector-wrapped-sq_default unsat ✅ 0.28083 0.38717
CVC4 CVC4-sq-final_default unsat ✅ 1.65033 1.65058
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 39.24740 39.24580
MathSAT MathSAT5_default.sh unsat ✅ 3.03935 3.03899
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.06464 0.06471
MinkeyRink Solver 2020.3_default unsat ✅ 0.06777 0.06784
STP STP_default unsat ✅ 0.21236 0.25719
STP ++ Mergsat v1_default unsat ✅ 0.24653 0.24688
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05211 0.05203
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.91000
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.30295 0.30286
MathSAT mathsat-5.6.6_default unsat ✅ 3.22106 3.22095
STP STP 2021.0_default unsat ✅ 0.21328 0.26501
Z3 z3-4.8.11_default unknown ❌ 1200.11000 1199.91000
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.30207 0.30201
Bitwuzla-wrapped_default unsat ✅ 0.23359 0.23349
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.02972 3.03036
MathSAT MathSAT-5.6.8_default unsat ✅ 3.78113 3.78074
STP STP 2022.4_default unsat ✅ 0.16672 0.16673
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05205 0.05202
Z3++BV z3++bv_0702_default unsat ✅ 97.88240 97.85570
Z3 z3-4.8.17_default unsat ✅ 749.07300 749.00500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.34124 0.34119
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.91693 1.91751
STP STP 2022.4_default unsat ✅ 0.16640 0.16642
STP 2022.4_default unsat ✅ 0.16811 0.16807
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 7.74351 23.55020
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.11584 0.11581
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1200.01000
z3-Owl-Final_default unknown ❌ 1200.11000 1199.87000