Benchmark

non-incremental/QF_BV/Sage2/bench_11389.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size746417
Compressed Size34219
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 746409
Compressed Size34208
Max. Term Depth582
Asserts 1062
Declared Functions0
Declared Constants536
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite12 not261 =512
let15409 extract117 bvand71 bvor200
bvadd7144 bvmul2705 bvult154 bvule193
bvugt67 bvuge147 bvshl213 bvlshr56
zero_extend4618

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 18.02300 18.02010
Boolector SMT17 final boolector sat ✅ 111.01300 110.99800
CVC4 CVC4-smtcomp2017-main default sat ✅ 365.58900 733.45600
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 507.59700 507.55900
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.00929 3.02709
Q3B Q3B default unknown ❌ 600.02600 1799.82000
STP stp_st default sat ✅ 434.39700 434.27700
stp_mt default sat ✅ 48.20780 183.88000
Yices2 Yices2-Main default sat ✅ 8.69215 8.69045
Z3 z3-4.5.0 default sat ✅ 192.80200 192.76900
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 26.80060 26.79880
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 46.98650 46.98500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 159.46200 159.45200
MinkeyRink Minkeyrink MT_mt sat ✅ 4.55476 16.33830
Minkeyrink ST_st sat ✅ 12.79280 12.79330
STP STP-CMS-st-2018_default-no-stderr sat ✅ 58.55970 58.56180
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 66.54700 257.56200
STP-Riss-st-2018_riss-no-stderr sat ✅ 29.86210 29.85950
Yices2 Yices 2.6.0_default sat ✅ 6.97152 6.97053
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1200.04000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 23.61040 23.60950
Boolector Boolector-wrapped-sq_default sat ✅ 42.63270 42.62060
Poolector-wrapped-sq_default sat ✅ 48.37640 191.27000
CVC4 CVC4-sq-final_default sat ✅ 47.51530 47.51880
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.90000
MathSAT MathSAT5_default.sh sat ✅ 370.95100 370.85700
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.61855 0.61875
MinkeyRink Solver 2020.3_default sat ✅ 26.79680 104.22700
STP STP_default sat ✅ 25.80830 100.48700
STP ++ Mergsat v1_default sat ✅ 28.52610 28.52960
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.76562 0.76557
Z3 z3-4.8.8_default sat ✅ 48.72110 48.71770
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 21.17100 21.16780
MathSAT mathsat-5.6.6_default sat ✅ 443.27400 443.09500
STP STP 2021.0_default sat ✅ 28.96110 112.38800
Z3 z3-4.8.11_default sat ✅ 68.94930 68.95150
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 17.35360 17.35410
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 19.70450 19.70310
STP STP 2022.4_default sat ✅ 29.20820 29.20340
STP 2022.4_default sat ✅ 29.43800 29.42110
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1247.40000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 7.16669 7.16370
Z3-Owl z3-Owl-Final_default sat ✅ 163.86800 163.82200
z3-Owl-Final_default sat ✅ 201.27500 201.27500
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 3.12408 3.02423
cvc5 cvc5 sat ✅ 38.97382 38.87340
SMTInterpol SMTInterpol unknown ❌ 1201.72318 1232.53904
STP STP sat ✅ 12.76492 12.66452
Yices2 Yices2 sat ✅ 1.13494 1.03506
Z3alpha Z3-alpha unknown ❌ 1201.71529 1200.92166