Benchmark

non-incremental/QF_BV/Sage2/bench_5742.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size39140
Compressed Size3012
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 39132
Compressed Size3022
Max. Term Depth231
Asserts 69
Declared Functions0
Declared Constants121
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not27 =34 let790
bvadd227 bvmul227 bvslt13 bvsle7
bvsgt4 bvsge10 zero_extend309

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 23.25120 23.24630
Boolector SMT17 final boolector sat ✅ 246.27800 246.23900
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.22180 8.42052
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 8.77328 8.77256
MinkeyRink MinkeyRink 2017.3a default sat ✅ 6.80245 8.09000
Q3B Q3B default unknown ❌ 600.03600 1799.32000
STP stp_st default sat ✅ 17.56850 17.56720
stp_mt default sat ✅ 12.00950 45.27290
Yices2 Yices2-Main default sat ✅ 2.51223 2.50672
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.89500
SMT-COMP 2018 Boolector Boolector_default sat ✅ 22.04110 22.03970
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 11.14640 11.14660
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 10.88360 10.88300
MinkeyRink Minkeyrink MT_mt sat ✅ 24.90010 97.14950
Minkeyrink ST_st sat ✅ 28.52300 28.51830
STP STP-CMS-st-2018_default-no-stderr sat ✅ 37.87430 37.87130
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 8.16605 31.16630
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.96681 6.96665
Yices2 Yices 2.6.0_default sat ✅ 10.84880 10.84730
Z3 z3-4.7.1_default sat ✅ 220.66800 220.67800
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.53095 0.53091
Poolector-wrapped-sq_default sat ✅ 0.68322 2.32000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 207.81700 207.80000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 388.25700 388.21300
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 16.61280 63.90080
MinkeyRink ST-wrapped-sq_default sat ✅ 54.20610 54.20700
Par4 Par4-wrapped-sq_default sat ✅ 6.34607 18.86000
STP STP-2019-wrapped-sq_default sat ✅ 26.19000 26.18800
stp-mergesat-fixed-wrapped-sq_default sat ✅ 13.41580 13.40990
stp-minisat-wrapped-sq_default sat ✅ 3.96002 3.95991
stp-mt-wrapped-sq_default sat ✅ 3.18499 11.28540
stp-portfolio-fixed-wrapped-sq_default sat ✅ 27.23100 45.45800
stp-riss-wrapped-sq_default unknown ❌ 0.42971 0.42986
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 5.66017 5.65938
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 5.86635 5.86623
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 13.17940 13.17900
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.11000 2400.02000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 4.42739 4.42705
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1400.30000 1400.12000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.62254 0.62245
Boolector Boolector-wrapped-sq_default sat ✅ 3.58490 3.58474
Poolector-wrapped-sq_default sat ✅ 4.08865 15.73000
CVC4 CVC4-sq-final_default sat ✅ 155.88000 155.84000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.89000
MathSAT MathSAT5_default.sh sat ✅ 0.88975 0.88846
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.44814 0.44839
MinkeyRink Solver 2020.3_default sat ✅ 52.19180 203.47400
STP STP_default sat ✅ 21.50880 84.17070
STP ++ Mergsat v1_default sat ✅ 8.18538 16.29740
Yices2 Yices 2.6.2 bug fix_default sat ✅ 9.22028 9.21976
Z3 z3-4.8.8_default sat ✅ 181.87700 181.69000
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 4.11258 4.10740
MathSAT mathsat-5.6.6_default sat ✅ 3.49050 3.49069
STP STP 2021.0_default sat ✅ 25.54030 100.03200
Z3 z3-4.8.11_default sat ✅ 26.88990 26.88880
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 5.90615 5.90560
Bitwuzla-wrapped_default sat ✅ 3.97198 3.97164
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 22.09430 22.08980
MathSAT MathSAT-5.6.8_default sat ✅ 3.89515 3.89483
STP STP 2022.4_default sat ✅ 1.39770 1.39765
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 5.56261 5.56239
Z3++BV z3++bv_0702_default sat ✅ 179.02100 179.01300
Z3 z3-4.8.17_default sat ✅ 215.53700 215.52500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 13.90800 13.90810
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 30.73810 30.73570
STP STP 2022.4_default sat ✅ 8.71716 8.71680
STP 2022.4_default sat ✅ 8.62017 8.61531
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1227.30000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 5.29488 5.29495
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.81000
z3-Owl-Final_default sat ✅ 202.57900 202.54600