Benchmark

non-incremental/QF_BV/Sage2/bench_2273.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size16989
Compressed Size1513
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 16981
Compressed Size1503
Max. Term Depth21
Asserts 58
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not13 =14 let367
bvadd201 bvmul4 bvult7 bvule19
bvugt2 bvuge15 bvlshr6 zero_extend143

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.06009 0.05847
Boolector SMT17 final boolector unsat ✅ 0.15265 0.15264
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.33109 0.63380
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.06231 0.06291
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.09498 0.05962
Q3B Q3B default unsat ✅ 0.13655 0.13175
STP stp_st default unsat ✅ 0.17637 0.17514
stp_mt default unsat ✅ 0.17934 0.58662
Yices2 Yices2-Main default unsat ✅ 0.00889 0.00501
Z3 z3-4.5.0 default unsat ✅ 68.82040 68.81240
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04071 0.04062
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.11128 0.11141
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.06407 0.06500
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04353 0.04821
Minkeyrink ST_st unsat ✅ 0.04182 0.04197
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.22843 0.22844
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.19731 0.66405
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.36568 0.36576
Yices2 Yices 2.6.0_default unsat ✅ 0.00748 0.00737
Z3 z3-4.7.1_default unsat ✅ 48.84280 48.84420
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.06377 0.06381
Poolector-wrapped-sq_default unsat ✅ 0.17558 0.25847
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.10020 0.10019
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.06241 0.06263
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05085 0.05423
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04789 0.04797
Par4 Par4-wrapped-sq_default unsat ✅ 0.01643 0.00554
STP STP-2019-wrapped-sq_default unsat ✅ 0.25685 0.25720
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 4.79278 4.78273
stp-minisat-wrapped-sq_default unsat ✅ 0.12274 0.12289
stp-mt-wrapped-sq_default unsat ✅ 0.25077 0.85368
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 4.63545 4.95581
stp-riss-wrapped-sq_default unknown ❌ 0.03937 0.03954
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01139 0.00772
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.00934 0.00911
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01145 0.00918
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.05000 2399.82000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.00939 0.00877
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 20.38930 20.38780
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08311 0.08305
MathSAT mathsat-5.6.6_default unsat ✅ 0.04069 0.04066
STP STP 2021.0_default unsat ✅ 0.02835 0.03231
Z3 z3-4.8.11_default unsat ✅ 3.07650 3.07665
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08928 0.08920
Bitwuzla-wrapped_default unsat ✅ 0.08802 0.08799
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.29896 0.29954
MathSAT MathSAT-5.6.8_default unsat ✅ 0.03628 0.03618
STP STP 2022.4_default unsat ✅ 0.02482 0.02487
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01315 0.00722
Z3++BV z3++bv_0702_default unsat ✅ 3.94896 3.94851
Z3 z3-4.8.17_default unsat ✅ 21.93070 21.93370
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.02360 0.02357
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.27505 0.27516
STP STP 2022.4_default unsat ✅ 0.02504 0.02509
STP 2022.4_default unsat ✅ 0.02509 0.02514
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.60832 12.40810
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01020 0.00615
Z3-Owl z3-Owl-Final_default unsat ✅ 2.63723 2.63722
z3-Owl-Final_default unsat ✅ 2.73353 2.72760
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.22420 0.12433
cvc5 cvc5 unsat ✅ 0.44019 0.34075
SMTInterpol SMTInterpol unsat ✅ 0.71927 1.43690
STP STP unsat ✅ 0.22775 0.12802
Yices2 Yices2 unsat ✅ 0.22924 0.12935
Z3alpha Z3-alpha unsat ✅ 5.73281 5.62966
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.25930 0.13898
Bitwuzla-MachBV-base unsat ✅ 0.31017 0.18280
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.36835 0.24717
BVDecide bv_decide unsat ✅ 1.13767 0.97108
bv_decide-nokernel unsat ✅ 0.84528 0.66742
cvc5 cvc5 unsat ✅ 0.43145 0.30934
SMTInterpol SMTInterpol unsat ✅ 0.74099 1.39959
Yices2 Yices2 unsat ✅ 0.32025 0.19161
Z3alpha Z3-alpha unsat ✅ 3.79122 13.98268
Z3 Z3-alpha-base unsat ✅ 25.39646 25.27465
Z3-Owl-base unsat ✅ 110.35885 110.22150
z3siri-base unsat ✅ 25.49312 25.36342
Z3-Owl Z3-Owl unsat ✅ 13.45541 13.32851