Benchmark

non-incremental/QF_BV/Sage2/bench_13003.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size104104
Compressed Size5548
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 104096
Compressed Size5554
Max. Term Depth26
Asserts 244
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite52 not29 =38
let2216 bvor27 bvadd1745 bvmul190
bvult109 bvule76 bvugt12 bvuge60
bvshl27 bvlshr3 zero_extend91

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 20.94500 20.94340
Boolector SMT17 final boolector unsat ✅ 40.13460 40.13190
CVC4 CVC4-smtcomp2017-main default unsat ✅ 24.29340 48.66500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02300 599.94000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.38498 0.37647
Q3B Q3B default unknown ❌ 600.02400 1799.42000
STP stp_st default unsat ✅ 106.10000 106.09400
stp_mt default unsat ✅ 102.42600 406.06000
Yices2 Yices2-Main default unsat ✅ 0.13200 0.13114
Z3 z3-4.5.0 default unsat ✅ 8.98755 8.98706
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.24810 0.24802
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.47702 5.47665
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 939.99400 939.82700
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.22780 0.39126
Minkeyrink ST_st unsat ✅ 0.21463 0.21467
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 67.62810 67.62780
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 68.69700 272.72500
STP-Riss-st-2018_riss-no-stderr unsat ✅ 70.25610 70.25720
Yices2 Yices 2.6.0_default unsat ✅ 0.12211 0.12204
Z3 z3-4.7.1_default unsat ✅ 15.21250 15.20700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 6.74690 6.74724
Poolector-wrapped-sq_default unsat ✅ 7.19550 27.97360
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 15.77540 15.77290
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 8.73749 8.73763
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.18896 0.27519
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.17617 0.17626
Par4 Par4-wrapped-sq_default unsat ✅ 0.07006 0.00615
STP STP-2019-wrapped-sq_default unsat ✅ 241.90000 241.88100
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 279.94500 279.89600
stp-minisat-wrapped-sq_default unsat ✅ 1601.31000 1601.31000
stp-mt-wrapped-sq_default unsat ✅ 183.64900 729.01400
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1693.29000 2314.64000
stp-riss-wrapped-sq_default unknown ❌ 0.21170 0.21191
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06586 0.06588
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05277 0.05279
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06000 0.06001
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.04117 0.04114
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07878 0.07878
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 7.88374 7.88324
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 29.07100 29.06800
MathSAT mathsat-5.6.6_default unsat ✅ 654.19000 654.14100
STP STP 2021.0_default unsat ✅ 0.14170 0.23094
Z3 z3-4.8.11_default unsat ✅ 36.64620 36.62120
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 21.51040 21.51040
Bitwuzla-wrapped_default unsat ✅ 17.15020 17.14900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 25.07320 25.07210
MathSAT MathSAT-5.6.8_default unsat ✅ 686.99200 686.90700
STP STP 2022.4_default unsat ✅ 0.17177 0.17181
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.23324 0.23316
Z3++BV z3++bv_0702_default unsat ✅ 1.44509 1.44488
Z3 z3-4.8.17_default unsat ✅ 1.16806 1.16975
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.94963 1.94945
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 8.98295 8.98103
STP STP 2022.4_default unsat ✅ 0.14499 0.14506
STP 2022.4_default unsat ✅ 0.14475 0.14478
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1238.72000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.07219 0.07211
Z3-Owl z3-Owl-Final_default unsat ✅ 247.70700 247.66300
z3-Owl-Final_default unsat ✅ 143.91900 143.87900
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 2.36299 2.24437
Bitwuzla-MachBV-base unsat ✅ 1.29372 1.17976
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.43950 0.31240
BVDecide bv_decide unsat ✅ 3.92090 3.76849
bv_decide-nokernel unsat ✅ 2.69276 2.53178
cvc5 cvc5 unsat ✅ 7.54472 7.41501
SMTInterpol SMTInterpol unsat ✅ 36.69266 51.47763
Yices2 Yices2 unsat ✅ 0.39689 0.27056
Z3alpha Z3-alpha unsat ✅ 8.23879 31.50646
Z3 Z3-alpha-base unsat ✅ 404.82444 404.62394
Z3-Owl-base unknown ❌ 1201.25598 1201.06013
z3siri-base unsat ✅ 407.32293 407.16318
Z3-Owl Z3-Owl unsat ✅ 670.76353 670.52820