Benchmark

non-incremental/QF_BV/Sage2/bench_14044.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size422708
Compressed Size7306
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 422700
Compressed Size7296
Max. Term Depth139
Asserts 221
Declared Functions0
Declared Constants32
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not54 =59 let10216
bvadd5499 bvmul713 bvule10 bvslt30
bvsle58 bvsgt15 bvsge48 bvshl1788
bvashr1 zero_extend2161

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.75954 0.75949
Boolector SMT17 final boolector unsat ✅ 4.20742 4.20344
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.97382 3.76454
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 328.15700 328.12400
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.74633 0.73571
Q3B Q3B default unknown ❌ 600.08000 1799.58000
STP stp_st default unsat ✅ 11.30430 11.30260
stp_mt default unsat ✅ 7.07303 26.94140
Yices2 Yices2-Main default unsat ✅ 0.04917 0.04952
Z3 z3-4.5.0 default unsat ✅ 4.43880 4.43757
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 0.66738 0.66734
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.11198 1.11214
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.86000
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.53932 1.44504
Minkeyrink ST_st unsat ✅ 0.55332 0.55334
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 5.31579 5.31563
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 4.92555 18.37070
STP-Riss-st-2018_riss-no-stderr unsat ✅ 6.37139 6.37088
Yices2 Yices 2.6.0_default unsat ✅ 0.06157 0.06152
Z3 z3-4.7.1_default unsat ✅ 2.27752 2.27626
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.11934 1.11918
Poolector-wrapped-sq_default unsat ✅ 0.69768 2.19000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 4.56377 4.56380
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.17175 3.17201
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.54448 1.49850
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.51689 0.51701
Par4 Par4-wrapped-sq_default unsat ✅ 0.05787 0.00627
STP STP-2019-wrapped-sq_default unsat ✅ 39.96360 39.95340
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 30.45720 30.45650
stp-minisat-wrapped-sq_default unsat ✅ 31.73580 31.72530
stp-mt-wrapped-sq_default unsat ✅ 27.41930 107.34100
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 64.81850 162.04000
stp-riss-wrapped-sq_default unknown ❌ 0.36033 0.36052
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05043 0.05044
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.07523 0.07525
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.07895 0.07899
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.76000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.11032 0.11031
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 7.36396 7.36423
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.28541 1.28528
Boolector Boolector-wrapped-sq_default unsat ✅ 1.24845 1.24844
Poolector-wrapped-sq_default unsat ✅ 0.58509 1.91000
CVC4 CVC4-sq-final_default unsat ✅ 16.34030 16.33830
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.89000
MathSAT MathSAT5_default.sh unsat ✅ 226.59000 226.55600
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.21561 0.21586
MinkeyRink Solver 2020.3_default unsat ✅ 0.49338 1.31813
STP STP_default unsat ✅ 0.55151 1.58577
STP ++ Mergsat v1_default unsat ✅ 0.55253 0.55404
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.07091 0.07081
Z3 z3-4.8.8_default unsat ✅ 5.10864 5.10783
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.40274 1.40223
MathSAT mathsat-5.6.6_default unknown ❌ 1200.11000 1199.81000
STP STP 2021.0_default unsat ✅ 0.54517 1.55539
Z3 z3-4.8.11_default unsat ✅ 3.19287 3.19291
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.93683 0.93686
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 11.44580 11.44550
STP STP 2022.4_default unsat ✅ 0.66727 0.66735
STP 2022.4_default unsat ✅ 0.67331 0.67327
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 60.55210 92.19720
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.05469 0.05465
Z3-Owl z3-Owl-Final_default unsat ✅ 33.97520 33.94990
z3-Owl-Final_default unsat ✅ 36.99610 36.99590
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.92657 0.79882
Bitwuzla-MachBV-base unsat ✅ 0.70896 0.59115
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.79370 0.66471
BVDecide bv_decide unsat ✅ 15.95983 15.80175
bv_decide-nokernel unsat ✅ 7.79785 7.64035
cvc5 cvc5 unsat ✅ 7.59546 7.46928
SMTInterpol SMTInterpol unsat ✅ 14.50762 24.64458
Yices2 Yices2 unsat ✅ 0.39440 0.26632
Z3alpha Z3-alpha unsat ✅ 0.65261 1.09787
Z3 Z3-alpha-base unsat ✅ 11.06992 10.94183
Z3-Owl-base unsat ✅ 43.04869 42.92975
z3siri-base unsat ✅ 11.24715 11.12746
Z3-Owl Z3-Owl unsat ✅ 15.17431 15.04542