Benchmark

non-incremental/QF_BV/Sage2/bench_5244.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size35032
Compressed Size3441
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 35024
Compressed Size3451
Max. Term Depth64
Asserts 156
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false7 ite1 not72
=95 let681 bvand7 bvor2
bvadd145 bvmul137 bvugt7 bvuge20
bvslt18 bvsle1 bvsgt9 bvsge13
bvshl3 zero_extend306

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.00791 0.00559
Boolector SMT17 final boolector unsat ✅ 0.00849 0.00571
CVC4 CVC4-smtcomp2017-main default unsat ✅ 11.50060 23.01620
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 7.47496 7.47383
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.02543 0.02221
Q3B Q3B default unsat ✅ 0.07804 0.07461
STP stp_st default unsat ✅ 1.69166 1.69151
stp_mt default unsat ✅ 1.05226 3.80610
Yices2 Yices2-Main default unsat ✅ 1.02419 1.02362
Z3 z3-4.5.0 default unsat ✅ 2.03660 2.03567
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.00933 0.00568
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.88583 4.88578
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 7.66531 7.66513
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.18798 0.34358
Minkeyrink ST_st unsat ✅ 0.17962 0.17983
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 2.41452 2.41321
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.05250 3.82962
STP-Riss-st-2018_riss-no-stderr unsat ✅ 4.28825 4.28789
Yices2 Yices 2.6.0_default unsat ✅ 1.61910 1.61896
Z3 z3-4.7.1_default unsat ✅ 3.29134 3.29123
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.01043 0.01043
Poolector-wrapped-sq_default unsat ✅ 0.17610 0.13185
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.01023 0.00958
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 11.45100 11.45100
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.16253 0.30140
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.15104 0.15111
Par4 Par4-wrapped-sq_default unsat ✅ 0.01793 0.00579
STP STP-2019-wrapped-sq_default unsat ✅ 0.87343 0.87194
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 4.63007 4.62975
stp-minisat-wrapped-sq_default unsat ✅ 1.00169 1.00180
stp-mt-wrapped-sq_default unsat ✅ 0.88459 3.12664
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 4.82429 6.48068
stp-riss-wrapped-sq_default unknown ❌ 0.11387 0.11403
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 1.83961 1.83974
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 3.31910 3.31896
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 2.13965 2.13956
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2400.00000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.02895 0.02897
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.77248 1.77244
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01406 0.00861
Boolector Boolector-wrapped-sq_default unsat ✅ 0.01123 0.01052
Poolector-wrapped-sq_default unsat ✅ 0.17545 0.13049
CVC4 CVC4-sq-final_default unsat ✅ 12.14760 12.14680
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.89000
MathSAT MathSAT5_default.sh unsat ✅ 10.19070 10.19040
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.11794 0.11822
MinkeyRink Solver 2020.3_default unsat ✅ 0.15593 0.28225
STP STP_default unsat ✅ 0.88516 3.21335
STP ++ Mergsat v1_default unsat ✅ 5.67804 5.67980
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 2.31231 2.31217
Z3 z3-4.8.8_default unsat ✅ 9.55404 9.55446
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01260 0.00861
MathSAT mathsat-5.6.6_default unsat ✅ 13.03800 13.03760
STP STP 2021.0_default unsat ✅ 1.93195 7.32278
Z3 z3-4.8.11_default unsat ✅ 2.45337 2.45329
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26250 0.26243
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.70260 4.69988
STP STP 2022.4_default unsat ✅ 1.34954 1.34932
STP 2022.4_default unsat ✅ 1.35155 1.35145
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1242.12000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 1.67627 1.67609
Z3-Owl z3-Owl-Final_default unsat ✅ 0.70495 0.70491
z3-Owl-Final_default unsat ✅ 0.70900 0.70929
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.21986 0.11997
cvc5 cvc5 unsat ✅ 11.24394 11.14407
SMTInterpol SMTInterpol unknown ❌ 1201.77800 1232.47824
STP STP unsat ✅ 1.68000 1.58028
Yices2 Yices2 unsat ✅ 0.94910 0.84865
Z3alpha Z3-alpha unsat ✅ 0.27223 0.17266
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.26406 0.14712
Bitwuzla-MachBV-base unsat ✅ 0.29846 0.16070
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.36997 0.23489
BVDecide bv_decide unsat ✅ 5.76108 5.60284
bv_decide-nokernel unsat ✅ 4.58413 4.43436
cvc5 cvc5 unsat ✅ 4.13428 4.00520
SMTInterpol SMTInterpol unknown ❌ 1201.77324 1234.73666
Yices2 Yices2 unsat ✅ 1.34124 1.21444
Z3alpha Z3-alpha unsat ✅ 0.40409 0.28833
Z3 Z3-alpha-base unsat ✅ 0.27582 0.15624
Z3-Owl-base unsat ✅ 0.30908 0.18856
z3siri-base unsat ✅ 0.27236 0.15019
Z3-Owl Z3-Owl unsat ✅ 0.79215 0.67260