Benchmark

non-incremental/QF_BV/Sage2/bench_3170.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size95918
Compressed Size8438
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 95910
Compressed Size8457
Max. Term Depth24
Asserts 324
Declared Functions0
Declared Constants73
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite62 not43 =68
let1829 extract4 bvand3 bvor43
bvadd1138 bvmul290 bvult117 bvule94
bvugt19 bvuge86 bvsge1 bvshl45
bvlshr8 zero_extend131

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.14213 0.13791
Boolector SMT17 final boolector unsat ✅ 0.59479 0.59511
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.55102 3.05353
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 2.35825 2.35594
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.20075 0.15685
Q3B Q3B default unknown ❌ 600.06900 1786.75000
STP stp_st default unsat ✅ 0.72158 0.72102
stp_mt default unsat ✅ 0.98091 2.71726
Yices2 Yices2-Main default unsat ✅ 0.02351 0.01896
Z3 z3-4.5.0 default unsat ✅ 1.56909 1.56819
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.11098 0.11087
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.86483 0.86497
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 3.82942 3.83045
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.10373 0.12918
Minkeyrink ST_st unsat ✅ 0.09967 0.09985
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.67366 1.67368
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.80488 6.85491
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.77059 0.77071
Yices2 Yices 2.6.0_default unsat ✅ 0.01888 0.01882
Z3 z3-4.7.1_default unsat ✅ 1.13086 1.13082
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.17197 0.17200
Poolector-wrapped-sq_default unsat ✅ 0.17783 0.17919
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.59062 0.59062
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.68379 0.68397
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.11853 0.14797
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.10846 0.10858
Par4 Par4-wrapped-sq_default unsat ✅ 0.02805 0.00578
STP STP-2019-wrapped-sq_default unsat ✅ 1.11069 1.11114
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.48332 6.48243
stp-minisat-wrapped-sq_default unsat ✅ 1.14098 1.14114
stp-mt-wrapped-sq_default unsat ✅ 0.37427 1.14889
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.52465 8.57976
stp-riss-wrapped-sq_default unknown ❌ 0.11109 0.11128
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02081 0.02080
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.02959 0.02962
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.02842 0.02840
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 1.12771 1.12774
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03609 0.03606
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.32234 1.32224
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16717 0.16715
Boolector Boolector-wrapped-sq_default unsat ✅ 0.16090 0.16093
Poolector-wrapped-sq_default unsat ✅ 0.17811 0.16715
CVC4 CVC4-sq-final_default unsat ✅ 0.80390 0.80417
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1200.04000
MathSAT MathSAT5_default.sh unsat ✅ 3.93189 3.93135
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.10830 0.10848
MinkeyRink Solver 2020.3_default unsat ✅ 0.11862 0.14864
STP STP_default unsat ✅ 0.09425 0.12708
STP ++ Mergsat v1_default unsat ✅ 0.08089 0.08257
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02347 0.02343
Z3 z3-4.8.8_default unsat ✅ 1.56940 1.56938
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.22154 0.16829
MathSAT mathsat-5.6.6_default unsat ✅ 2.35230 2.35213
STP STP 2021.0_default unsat ✅ 1.56244 5.91162
Z3 z3-4.8.11_default unsat ✅ 0.79839 0.79829
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16769 0.16759
Bitwuzla-wrapped_default unsat ✅ 0.19203 0.19197
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.78529 1.78024
MathSAT MathSAT-5.6.8_default unsat ✅ 3.39560 3.39557
STP STP 2022.4_default unsat ✅ 0.07678 0.07679
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02461 0.02452
Z3++BV z3++bv_0702_default unsat ✅ 0.46491 0.46479
Z3 z3-4.8.17_default unsat ✅ 1.51478 1.51650
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.36567 0.26574
cvc5 cvc5 unsat ✅ 1.17454 1.07408
SMTInterpol SMTInterpol unsat ✅ 48.83310 70.99611
STP STP unsat ✅ 0.26744 0.16767
Yices2 Yices2 unsat ✅ 0.24331 0.14344
Z3alpha Z3-alpha unsat ✅ 0.55655 0.45693
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.35791 0.23833
Bitwuzla-MachBV-base unsat ✅ 0.39756 0.28151
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.46235 0.33457
BVDecide bv_decide unsat ✅ 4.60267 4.42223
bv_decide-nokernel unsat ✅ 2.96303 2.79028
cvc5 cvc5 unsat ✅ 1.00663 0.88823
SMTInterpol SMTInterpol unsat ✅ 144.91628 162.13401
Yices2 Yices2 unsat ✅ 0.32040 0.20161
Z3alpha Z3-alpha unsat ✅ 1.68412 5.38583
Z3 Z3-alpha-base unsat ✅ 2.42962 2.30847
Z3-Owl-base unsat ✅ 9.47093 9.34840
z3siri-base unsat ✅ 2.44525 2.32282
Z3-Owl Z3-Owl unsat ✅ 2.69728 2.56713