Benchmark

non-incremental/QF_BV/Sage2/bench_11248.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size28296
Compressed Size2466
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 28288
Compressed Size2481
Max. Term Depth27
Asserts 87
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not22 =24 let625
bvand5 bvadd333 bvmul20 bvult8
bvule16 bvugt6 bvuge32 bvlshr7
zero_extend238

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.11092 0.11030
Boolector SMT17 final boolector unsat ✅ 0.27377 0.27326
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.02761 2.03175
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.15853 0.15892
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.10148 0.07048
Q3B Q3B default unsat ✅ 0.17828 0.21807
STP stp_st default unsat ✅ 7.72671 7.72541
stp_mt default unsat ✅ 4.63421 18.19500
Yices2 Yices2-Main default unsat ✅ 0.00801 0.00698
Z3 z3-4.5.0 default unsat ✅ 0.84557 0.84338
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07689 0.07682
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.13313 0.13327
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.15608 0.15709
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05332 0.06145
Minkeyrink ST_st unsat ✅ 0.04952 0.04966
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.22198 1.22214
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.11736 4.23050
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.61579 1.61583
Yices2 Yices 2.6.0_default unsat ✅ 0.00927 0.00920
Z3 z3-4.7.1_default unsat ✅ 3.71382 3.71353
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.14606 0.14604
Poolector-wrapped-sq_default unsat ✅ 0.17738 0.11641
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.16694 0.16693
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.09393 0.09415
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04352 0.04907
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04069 0.04077
Par4 Par4-wrapped-sq_default unsat ✅ 0.02144 0.00610
STP STP-2019-wrapped-sq_default unsat ✅ 4.33321 4.33345
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 9.44241 9.44273
stp-minisat-wrapped-sq_default unsat ✅ 1.58887 1.58896
stp-mt-wrapped-sq_default unsat ✅ 3.98648 15.58810
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 9.61549 15.41860
stp-riss-wrapped-sq_default unknown ❌ 0.06371 0.06388
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01123 0.01123
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01384 0.01386
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01299 0.01298
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 162.95900 162.93500
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01556 0.01555
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.33332 1.33320
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16123 0.16118
MathSAT mathsat-5.6.6_default unsat ✅ 0.08186 0.08184
STP STP 2021.0_default unsat ✅ 0.03617 0.04244
Z3 z3-4.8.11_default unsat ✅ 1.69092 3.28087
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.17272 0.17265
Bitwuzla-wrapped_default unsat ✅ 0.17667 0.17662
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.60955 0.60994
MathSAT MathSAT-5.6.8_default unsat ✅ 0.06955 0.06951
STP STP 2022.4_default unsat ✅ 0.03383 0.03387
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01258 0.01209
Z3++BV z3++bv_0702_default unsat ✅ 0.86686 0.86661
Z3 z3-4.8.17_default unsat ✅ 8.29522 8.29647
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.29757 0.19760
cvc5 cvc5 unsat ✅ 1.07751 0.97713
SMTInterpol SMTInterpol unsat ✅ 0.83361 1.91136
STP STP unsat ✅ 0.23796 0.13805
Yices2 Yices2 unsat ✅ 0.24072 0.14103
Z3alpha Z3-alpha unsat ✅ 10.70441 10.60437
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29422 0.16512
Bitwuzla-MachBV-base unsat ✅ 0.36794 0.24432
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40193 0.28474
BVDecide bv_decide unsat ✅ 1.48790 1.31200
bv_decide-nokernel unsat ✅ 1.03642 0.86315
cvc5 cvc5 unsat ✅ 0.53019 0.41256
SMTInterpol SMTInterpol unsat ✅ 0.82350 1.79480
Yices2 Yices2 unsat ✅ 0.29504 0.16761
Z3alpha Z3-alpha unsat ✅ 21.42393 84.32774
Z3 Z3-alpha-base unsat ✅ 12.99865 12.88039
Z3-Owl-base unsat ✅ 58.61841 58.47167
z3siri-base unsat ✅ 13.15193 13.01965
Z3-Owl Z3-Owl unsat ✅ 3.65515 3.53350