Benchmark

non-incremental/QF_BV/Sage2/bench_15549.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size81849
Compressed Size7435
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 81841
Compressed Size7447
Max. Term Depth33
Asserts 301
Declared Functions0
Declared Constants141
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite6 not20 =67
let1452 bvand5 bvor73 bvadd680
bvmul260 bvult65 bvule99 bvugt28
bvuge47 bvshl73 bvlshr11 zero_extend318

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.18813 0.18719
Boolector SMT17 final boolector unsat ✅ 0.36718 0.36659
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.65549 1.26311
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.72607 0.72587
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19002 0.14573
Q3B Q3B default unknown ❌ 600.04600 1799.60000
STP stp_st default unsat ✅ 0.56828 0.56700
stp_mt default unsat ✅ 0.59374 1.94828
Yices2 Yices2-Main default unsat ✅ 0.02281 0.02156
Z3 z3-4.5.0 default unsat ✅ 0.77273 0.77089
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.13467 0.13459
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.58368 0.58383
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.70523 0.70615
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.09793 0.13269
Minkeyrink ST_st unsat ✅ 0.09456 0.09473
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.49976 0.49992
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.45894 1.44270
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.27944 1.27937
Yices2 Yices 2.6.0_default unsat ✅ 0.02064 0.02059
Z3 z3-4.7.1_default unsat ✅ 0.36906 0.36894
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.22154 0.22158
Poolector-wrapped-sq_default unsat ✅ 0.17755 0.16963
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.22968 0.22967
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.36223 0.36241
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.09118 0.12373
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.08536 0.08545
Par4 Par4-wrapped-sq_default unsat ✅ 0.03392 0.00744
STP STP-2019-wrapped-sq_default unsat ✅ 0.43144 0.43180
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 8.28779 8.28728
stp-minisat-wrapped-sq_default unsat ✅ 0.36406 0.36414
stp-mt-wrapped-sq_default unsat ✅ 0.42413 1.28198
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 8.45520 9.03298
stp-riss-wrapped-sq_default unknown ❌ 0.12699 0.12719
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02397 0.02398
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03106 0.03110
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03109 0.03110
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.05790 0.05790
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04359 0.04361
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.45274 0.45277
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16976 0.16970
Boolector Boolector-wrapped-sq_default unsat ✅ 0.17631 0.17629
Poolector-wrapped-sq_default unsat ✅ 0.18692 0.17184
CVC4 CVC4-sq-final_default unsat ✅ 1.04998 1.05026
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 203.79700 203.76700
MathSAT MathSAT5_default.sh unsat ✅ 0.34678 0.34674
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.07769 0.07793
MinkeyRink Solver 2020.3_default unsat ✅ 0.08854 0.11259
STP STP_default unsat ✅ 0.07884 0.09927
STP ++ Mergsat v1_default unsat ✅ 0.06668 0.06836
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02668 0.02593
Z3 z3-4.8.8_default unsat ✅ 0.24904 0.24898