Benchmark

non-incremental/QF_BV/Sage2/bench_8169.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size691312
Compressed Size21320
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 691304
Compressed Size21311
Max. Term Depth171
Asserts 591
Declared Functions0
Declared Constants348
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 not97 =110
let14608 extract21 bvand10 bvor6
bvadd5162 bvmul392 bvult90 bvule119
bvugt19 bvuge248 bvsgt2 bvsge3
bvshl3764 bvlshr56 bvashr2 zero_extend5097

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.82724 1.82608
Boolector SMT17 final boolector sat ✅ 12.26420 12.26130
CVC4 CVC4-smtcomp2017-main default sat ✅ 11.97830 23.73030
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 29.84240 29.71230
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.47331 1.46185
Q3B Q3B default unknown ❌ 600.03200 1200.10000
STP stp_st default sat ✅ 10.94780 10.94760
stp_mt default sat ✅ 10.04490 37.64950
Yices2 Yices2-Main default sat ✅ 0.18980 0.18948
Z3 z3-4.5.0 default sat ✅ 162.74600 162.71600
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.49395 1.49352
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 9.74599 9.74417
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1020.66000 1020.57000
MinkeyRink Minkeyrink MT_mt sat ✅ 1.18766 3.31662
Minkeyrink ST_st sat ✅ 1.01256 1.01253
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.22821 3.22791
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.85170 13.35010
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.05464 3.05447
Yices2 Yices 2.6.0_default sat ✅ 0.18548 0.18540
Z3 z3-4.7.1_default sat ✅ 99.51020 99.50350
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 2.93625 2.93614
Poolector-wrapped-sq_default sat ✅ 1.89585 7.03000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 18.46630 18.46580
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 11.83360 11.83340
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.97573 2.60980
MinkeyRink ST-wrapped-sq_default sat ✅ 0.82795 0.82798
Par4 Par4-wrapped-sq_default sat ✅ 0.41157 0.00621
STP STP-2019-wrapped-sq_default sat ✅ 8.26938 8.27011
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.14620 10.14650
stp-minisat-wrapped-sq_default sat ✅ 1.91043 1.91047
stp-mt-wrapped-sq_default sat ✅ 3.97133 13.78500
stp-portfolio-fixed-wrapped-sq_default sat ✅ 11.06910 21.15860
stp-riss-wrapped-sq_default unknown ❌ 0.64074 0.64076
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.41052 0.41047
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.24571 0.24570
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.38558 1.38556
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.62000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.23129 0.23128
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 93.97430 93.97010
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.62617 2.62579
Bitwuzla-wrapped_default sat ✅ 2.53286 2.53292
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 16.74860 16.74750
MathSAT MathSAT-5.6.8_default sat ✅ 449.71800 449.50200
STP STP 2022.4_default sat ✅ 0.58836 0.58841
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.10810 1.10802
Z3++BV z3++bv_0702_default sat ✅ 7.12902 7.12892
Z3 z3-4.8.17_default sat ✅ 3.90270 3.90404