Benchmark

non-incremental/QF_BV/Sage2/bench_2656.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size23028
Compressed Size1900
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 23020
Compressed Size1893
Max. Term Depth60
Asserts 118
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not94 =98 let464
bvadd91 bvmul91 bvult19 zero_extend188

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 12.42250 12.42120
Boolector SMT17 final boolector sat ✅ 68.72990 68.73100
CVC4 CVC4-smtcomp2017-main default sat ✅ 39.80380 79.77380
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 17.64250 17.64390
MinkeyRink MinkeyRink 2017.3a default sat ✅ 7.46530 9.88000
Q3B Q3B default unknown ❌ 600.05900 1799.50000
STP stp_st default sat ✅ 16.03620 16.03450
stp_mt default sat ✅ 1.17593 4.10569
Yices2 Yices2-Main default sat ✅ 193.48800 193.47800
Z3 z3-4.5.0 default sat ✅ 492.80800 492.78300
SMT-COMP 2018 Boolector Boolector_default sat ✅ 11.52800 11.52620
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 141.09300 141.07700
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 5.32312 5.32377
MinkeyRink Minkeyrink MT_mt sat ✅ 3.05265 11.80520
Minkeyrink ST_st sat ✅ 10.70850 10.70880
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.06048 4.05997
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.09076 3.80517
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.88183 1.88169
Yices2 Yices 2.6.0_default sat ✅ 4.97107 4.97087
Z3 z3-4.7.1_default sat ✅ 245.00400 244.95800
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 14.19920 14.19890
Poolector-wrapped-sq_default sat ✅ 3.31280 12.53050
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 43.26660 43.26080
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 90.67850 90.67310
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.24129 4.62414
MinkeyRink ST-wrapped-sq_default sat ✅ 1.18376 1.18377
Par4 Par4-wrapped-sq_default sat ✅ 26.52940 79.43000
STP STP-2019-wrapped-sq_default sat ✅ 3.86575 3.86614
stp-mergesat-fixed-wrapped-sq_default sat ✅ 6.59872 6.59901
stp-minisat-wrapped-sq_default sat ✅ 3.36896 3.36906
stp-mt-wrapped-sq_default sat ✅ 9.46567 36.99450
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.71212 13.96880
stp-riss-wrapped-sq_default unknown ❌ 0.17440 0.17459
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 25.45840 25.45670
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 6.26811 6.26814
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 21.59190 21.59140
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.83000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 58.00170 58.00090
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 248.50700 248.47300
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 69.38450 69.37540
Boolector Boolector-wrapped-sq_default sat ✅ 6.52898 13.03890
Poolector-wrapped-sq_default sat ✅ 7.09581 27.49000
CVC4 CVC4-sq-final_default sat ✅ 19.58150 19.58130
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.97000
MathSAT MathSAT5_default.sh sat ✅ 69.61100 69.59820
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08752 0.08760
MinkeyRink Solver 2020.3_default sat ✅ 3.44429 13.37790
STP STP_default sat ✅ 1.54625 5.90322
STP ++ Mergsat v1_default sat ✅ 13.71560 13.70910
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.86574 0.86556
Z3 z3-4.8.8_default sat ✅ 172.32400 172.28600
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 16.43950 16.42820
Bitwuzla-wrapped_default sat ✅ 4.58422 4.58414
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 17.15710 17.14990
MathSAT MathSAT-5.6.8_default sat ✅ 8.47570 8.47563
STP STP 2022.4_default sat ✅ 1.83678 1.83676
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 124.38600 124.38900
Z3++BV z3++bv_0702_default sat ✅ 28.58920 28.58580
Z3 z3-4.8.17_default sat ✅ 149.80900 149.80100
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 15.86705 15.75903
cvc5 cvc5 sat ✅ 11.02315 10.92237
SMTInterpol SMTInterpol unknown ❌ 1201.71686 1223.48387
STP STP sat ✅ 8.24695 8.14322
Yices2 Yices2 sat ✅ 5.23563 5.13269
Z3alpha Z3-alpha sat ✅ 34.81145 34.71019
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 10.63485 10.51192
Bitwuzla-MachBV-base sat ✅ 9.88035 9.76109
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 17.26303 17.14005
BVDecide bv_decide sat ✅ 22.13109 21.99710
bv_decide-nokernel sat ✅ 22.10176 21.97561
cvc5 cvc5 sat ✅ 10.84957 10.72725
SMTInterpol SMTInterpol unknown ❌ 1201.35777 1234.81549
Yices2 Yices2 sat ✅ 9.57392 9.45431
Z3alpha Z3-alpha sat ✅ 52.11014 206.98949
Z3 Z3-alpha-base sat ✅ 58.34872 58.22813
Z3-Owl-base sat ✅ 242.44008 242.29493
z3siri-base sat ✅ 58.94687 58.82049
Z3-Owl Z3-Owl sat ✅ 167.17718 167.03501