Benchmark

non-incremental/QF_BV/Sage2/bench_8351.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22318
Compressed Size1686
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22310
Compressed Size1685
Max. Term Depth24
Asserts 68
Declared Functions0
Declared Constants7
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not15 =16 let492
bvadd277 bvmul4 bvult9 bvule23
bvugt2 bvuge17 bvlshr7 zero_extend189

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.06581 0.06480
Boolector SMT17 final boolector unsat ✅ 0.22982 0.22912
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.18029 8.53051
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.07650 0.07685
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.09826 0.06370
Q3B Q3B default unsat ✅ 0.18504 0.23506
STP stp_st default unsat ✅ 0.93633 0.93402
stp_mt default unsat ✅ 0.84539 3.19321
Yices2 Yices2-Main default unsat ✅ 0.00860 0.00683
Z3 z3-4.5.0 default unknown ❌ 600.01000 599.95300
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.03852 0.03846
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.13066 0.13083
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.07463 0.07568
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05014 0.05837
Minkeyrink ST_st unsat ✅ 0.04475 0.04495
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.98593 0.98620
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.70196 2.65209
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.04000 1200.07000
Yices2 Yices 2.6.0_default unsat ✅ 0.01049 0.00893
Z3 z3-4.7.1_default unsat ✅ 2.93290 2.93287
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.09440 0.09435
Boolector Boolector-wrapped-sq_default unsat ✅ 0.06394 0.06393
Poolector-wrapped-sq_default unsat ✅ 0.18337 0.18959
CVC4 CVC4-sq-final_default unsat ✅ 1.98344 1.98274
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.08644 0.08640
MathSAT MathSAT5_default.sh unsat ✅ 0.04832 0.04827
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04560 0.04587
MinkeyRink Solver 2020.3_default unsat ✅ 0.04771 0.05266
STP STP_default unsat ✅ 0.02992 0.03522
STP ++ Mergsat v1_default unsat ✅ 0.02126 0.02296
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01245 0.00827
Z3 z3-4.8.8_default unsat ✅ 42.70760 42.70970
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08587 0.08584
MathSAT mathsat-5.6.6_default unsat ✅ 0.05329 0.05325
STP STP 2021.0_default unsat ✅ 0.03154 0.03676
Z3 z3-4.8.11_default unsat ✅ 684.49700 684.38900
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.02924 0.02921
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.98164 0.97955
STP STP 2022.4_default unsat ✅ 0.02899 0.02902
STP 2022.4_default unsat ✅ 0.02832 0.02837
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.74216 13.22980
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01184 0.00790
Z3-Owl z3-Owl-Final_default unsat ✅ 14.78580 14.78250
z3-Owl-Final_default unsat ✅ 6.78528 6.78528
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.22580 0.12600
cvc5 cvc5 unsat ✅ 0.92543 0.82512
SMTInterpol SMTInterpol unsat ✅ 0.80006 1.73002
STP STP unsat ✅ 0.25651 0.15631
Yices2 Yices2 unsat ✅ 0.21393 0.11394
Z3alpha Z3-alpha unsat ✅ 16.07667 15.96443