Benchmark

non-incremental/QF_BV/Sage2/bench_9498.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size27107
Compressed Size2422
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 27099
Compressed Size2434
Max. Term Depth27
Asserts 85
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not20 =24 let598
bvand5 bvadd319 bvmul15 bvult9
bvule16 bvugt6 bvuge29 bvlshr7
zero_extend232

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.11024 0.10954
Boolector SMT17 final boolector unsat ✅ 0.78846 0.52255
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.21463 0.37774
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.15098 0.15226
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.10227 0.06962
Q3B Q3B default unsat ✅ 0.18600 0.22023
STP stp_st default unsat ✅ 1.13179 1.13035
stp_mt default unsat ✅ 1.56597 4.68752
Yices2 Yices2-Main default unsat ✅ 0.00758 0.00632
Z3 z3-4.5.0 default unsat ✅ 1.10758 1.10352
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07552 0.07548
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.12977 0.12987
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.13642 0.13745
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05319 0.06085
Minkeyrink ST_st unsat ✅ 0.04920 0.04941
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 3.03338 3.03307
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.61077 6.19170
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.22953 1.22960
Yices2 Yices 2.6.0_default unsat ✅ 0.00993 0.00988
Z3 z3-4.7.1_default unsat ✅ 0.46459 0.46444
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.12651 0.12651
Poolector-wrapped-sq_default unsat ✅ 0.17820 0.11663
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.37917 0.37915
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.08683 0.08706
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04201 0.04532
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.03913 0.03924
Par4 Par4-wrapped-sq_default unsat ✅ 0.01635 0.00568
STP STP-2019-wrapped-sq_default unsat ✅ 1.89200 1.89216
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 10.58000 10.58070
stp-minisat-wrapped-sq_default unsat ✅ 2.76273 2.76278
stp-mt-wrapped-sq_default unsat ✅ 1.48252 5.69129
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 10.90780 15.45400
stp-riss-wrapped-sq_default unknown ❌ 0.05752 0.05774
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01041 0.01034
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01171 0.01176
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01121 0.01123
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2399.65000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01288 0.01288
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 6.09123 6.09111
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.14928 0.14922
MathSAT mathsat-5.6.6_default unsat ✅ 0.05908 0.05906
STP STP 2021.0_default unsat ✅ 0.03427 0.03883
Z3 z3-4.8.11_default unsat ✅ 1.14088 1.14080
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.15902 0.15896
Bitwuzla-wrapped_default unsat ✅ 0.16500 0.16498
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.21535 0.21371
MathSAT MathSAT-5.6.8_default unsat ✅ 0.06258 0.06253
STP STP 2022.4_default unsat ✅ 0.03351 0.03300
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01383 0.00891
Z3++BV z3++bv_0702_default unsat ✅ 1.44664 1.44635
Z3 z3-4.8.17_default unsat ✅ 9.04856 9.04959
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04217 0.04211
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.20430 0.20445
STP STP 2022.4_default unsat ✅ 0.03297 0.03294
STP 2022.4_default unsat ✅ 0.03170 0.03174
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.96250 14.04250
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01067 0.00790
Z3-Owl z3-Owl-Final_default unsat ✅ 6.94848 6.94812
z3-Owl-Final_default unsat ✅ 5.92357 5.92320
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.24428 0.14440
cvc5 cvc5 unsat ✅ 0.30498 0.20512
SMTInterpol SMTInterpol unsat ✅ 0.93652 2.13449
STP STP unsat ✅ 0.22945 0.12953
Yices2 Yices2 unsat ✅ 0.21824 0.11839
Z3alpha Z3-alpha unsat ✅ 2.53775 2.43704
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.26898 0.15319
Bitwuzla-MachBV-base unsat ✅ 0.30650 0.18322
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39976 0.27308
BVDecide bv_decide unsat ✅ 1.46085 1.30149
bv_decide-nokernel unsat ✅ 1.03322 0.85872
cvc5 cvc5 unsat ✅ 0.32616 0.20843
SMTInterpol SMTInterpol unsat ✅ 0.84485 1.76044
Yices2 Yices2 unsat ✅ 0.26369 0.14473
Z3alpha Z3-alpha unsat ✅ 1.01302 2.82165
Z3 Z3-alpha-base unsat ✅ 20.57023 20.43926
Z3-Owl-base unsat ✅ 91.58575 91.44699
z3siri-base unsat ✅ 20.70845 20.59007
Z3-Owl Z3-Owl unsat ✅ 6.27882 6.15735