Benchmark

non-incremental/QF_BV/Sage2/bench_14998.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size30868
Compressed Size3736
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 30860
Compressed Size3753
Max. Term Depth31
Asserts 115
Declared Functions0
Declared Constants39
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 ite1 not36
=58 let608 extract74 bvand7
bvor21 bvadd114 bvmul45 bvudiv6
bvult14 bvule16 bvugt5 bvuge21
bvsge2 bvshl72 bvlshr29 bvashr1
zero_extend200

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.11144 0.11064
Boolector SMT17 final boolector unsat ✅ 1.01122 1.01026
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.78859 3.55159
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62638 0.62635
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.27500 0.24406
Q3B Q3B default unknown ❌ 600.08400 1199.95000
STP stp_st default unsat ✅ 0.21759 0.21712
stp_mt default unsat ✅ 0.26250 0.57087
Yices2 Yices2-Main default unsat ✅ 0.11227 0.10803
Z3 z3-4.5.0 default unsat ✅ 0.26243 0.26173
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.12460 0.12451
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.61801 1.61817
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.77433 0.77527
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.13554 0.18484
Minkeyrink ST_st unsat ✅ 0.12767 0.12788
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.10911 0.10933
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.11992 0.16928
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.40116 0.40127
Yices2 Yices 2.6.0_default unsat ✅ 2.93373 2.93329
Z3 z3-4.7.1_default unsat ✅ 0.23861 0.23857
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.15008 0.15001
Boolector Boolector-wrapped-sq_default unsat ✅ 0.14896 0.14894
Poolector-wrapped-sq_default unsat ✅ 0.17850 0.17050
CVC4 CVC4-sq-final_default unsat ✅ 0.98285 0.98312
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.90000
MathSAT MathSAT5_default.sh unsat ✅ 0.15606 0.15598
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.11240 0.11334
MinkeyRink Solver 2020.3_default unsat ✅ 0.12093 0.15194
STP STP_default unsat ✅ 0.10326 0.13384
STP ++ Mergsat v1_default unsat ✅ 0.08577 0.08728
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.49166 0.49161
Z3 z3-4.8.8_default unsat ✅ 0.35641 0.35620
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.14838 0.14828
MathSAT mathsat-5.6.6_default unsat ✅ 0.28119 0.28117
STP STP 2021.0_default unsat ✅ 0.10984 0.15215
Z3 z3-4.8.11_default unsat ✅ 0.56218 0.56215