Benchmark

non-incremental/QF_BV/Sage2/bench_14817.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size452041
Compressed Size13040
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 452033
Compressed Size13031
Max. Term Depth140
Asserts 368
Declared Functions0
Declared Constants176
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not57 =61 let10087
extract3 bvand2 bvor8 bvadd3619
bvmul351 bvult57 bvule80 bvugt10
bvuge152 bvsgt3 bvsge4 bvshl2555
bvlshr70 bvashr7 zero_extend3415

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.36762 0.36608
Boolector SMT17 final boolector sat ✅ 4.03485 4.03361
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.65562 3.11639
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 286.05500 286.00200
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.85211 0.84835
Q3B Q3B default unknown ❌ 600.02400 1200.00000
STP stp_st default sat ✅ 1.28296 1.28162
stp_mt default sat ✅ 1.59840 3.92366
Yices2 Yices2-Main default sat ✅ 0.12666 0.12627
Z3 z3-4.5.0 default sat ✅ 2.97477 2.97432
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.46122 0.46115
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.84289 3.84258
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 143.41300 143.33300
MinkeyRink Minkeyrink MT_mt sat ✅ 0.61377 1.39761
Minkeyrink ST_st sat ✅ 0.54227 0.54249
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.96465 0.96488
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.09443 3.12659
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.84613 1.84622
Yices2 Yices 2.6.0_default sat ✅ 0.12501 0.12457
Z3 z3-4.7.1_default sat ✅ 3.25278 3.25282
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1.69783 1.69764
Poolector-wrapped-sq_default sat ✅ 0.48660 0.43511
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 3.87728 3.87706
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 5.29170 5.29140
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.53880 1.19614
MinkeyRink ST-wrapped-sq_default sat ✅ 0.50718 0.50722
Par4 Par4-wrapped-sq_default sat ✅ 0.20095 0.00591
STP STP-2019-wrapped-sq_default sat ✅ 0.95758 0.95367
stp-mergesat-fixed-wrapped-sq_default sat ✅ 8.42439 7.37805
stp-minisat-wrapped-sq_default sat ✅ 0.93010 0.93028
stp-mt-wrapped-sq_default sat ✅ 1.02510 2.76920
stp-portfolio-fixed-wrapped-sq_default sat ✅ 7.42877 8.75027
stp-riss-wrapped-sq_default unknown ❌ 0.41925 0.41942
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.19482 0.19482
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.53943 0.53941
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.71753 0.71753
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.08000 2399.93000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.18079 0.18081
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 6.02835 6.02758
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.84807 0.84785
Boolector Boolector-wrapped-sq_default sat ✅ 0.64313 0.64311
Poolector-wrapped-sq_default sat ✅ 0.77783 2.50000
CVC4 CVC4-sq-final_default sat ✅ 6.95792 6.95724
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.93000
MathSAT MathSAT5_default.sh sat ✅ 79.76930 79.75320
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.30320 0.30344
MinkeyRink Solver 2020.3_default sat ✅ 0.48550 1.02802
STP STP_default sat ✅ 0.41035 0.84900
STP ++ Mergsat v1_default sat ✅ 0.49609 0.49777
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.56757 0.56726
Z3 z3-4.8.8_default sat ✅ 7.16378 14.24360
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.63405 0.53420
cvc5 cvc5 sat ✅ 5.33057 5.23092
SMTInterpol SMTInterpol sat ✅ 17.84725 37.10870
STP STP sat ✅ 0.61144 0.51141
Yices2 Yices2 sat ✅ 0.54051 0.44008
Z3alpha Z3-alpha sat ✅ 1.76337 1.66238