Benchmark

non-incremental/QF_BV/Sage2/bench_2158.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size23173
Compressed Size1970
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 23165
Compressed Size1962
Max. Term Depth60
Asserts 115
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not91 =95 let468
bvadd96 bvmul96 bvult19 zero_extend185

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 44.78020 44.77600
Boolector SMT17 final boolector sat ✅ 76.00560 75.98000
CVC4 CVC4-smtcomp2017-main default sat ✅ 18.22820 36.50870
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.77908 1.77884
MinkeyRink MinkeyRink 2017.3a default sat ✅ 2.25271 2.28981
Q3B Q3B default unknown ❌ 600.06100 1789.71000
STP stp_st default sat ✅ 15.75600 15.75520
stp_mt default sat ✅ 3.07360 11.56340
Yices2 Yices2-Main default sat ✅ 22.97090 22.96650
Z3 z3-4.5.0 default sat ✅ 445.89500 445.81700
SMT-COMP 2018 Boolector Boolector_default sat ✅ 18.71040 18.70970
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 27.72310 27.72080
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 16.87390 16.87570
MinkeyRink Minkeyrink MT_mt sat ✅ 0.57173 1.96533
Minkeyrink ST_st sat ✅ 1.58775 1.58766
STP STP-CMS-st-2018_default-no-stderr sat ✅ 6.67685 6.67668
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.00303 3.46998
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.95881 0.95882
Yices2 Yices 2.6.0_default sat ✅ 25.71360 25.71160
Z3 z3-4.7.1_default sat ✅ 161.06800 161.05900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 15.95090 15.94840
Boolector Boolector-wrapped-sq_default sat ✅ 4.83846 4.83854
Poolector-wrapped-sq_default sat ✅ 5.38820 20.97000
CVC4 CVC4-sq-final_default sat ✅ 107.23500 107.21700
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.99000
MathSAT MathSAT5_default.sh sat ✅ 45.57000 45.56530
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08630 0.08653
MinkeyRink Solver 2020.3_default sat ✅ 4.14681 16.16690
STP STP_default sat ✅ 0.87315 3.21448
STP ++ Mergsat v1_default sat ✅ 18.64380 18.64290
Yices2 Yices 2.6.2 bug fix_default sat ✅ 16.88630 16.88460
Z3 z3-4.8.8_default sat ✅ 85.41100 85.41230
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 29.28170 29.27960
MathSAT mathsat-5.6.6_default sat ✅ 2.26771 2.26750
STP STP 2021.0_default sat ✅ 1.07586 7.99592
Z3 z3-4.8.11_default sat ✅ 705.05700 704.97300
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 49.36297 49.24622
cvc5 cvc5 sat ✅ 11.03408 10.93394
SMTInterpol SMTInterpol unknown ❌ 1201.71958 1225.31156
STP STP sat ✅ 7.87432 7.77433
Yices2 Yices2 sat ✅ 31.72457 31.60501
Z3alpha Z3-alpha sat ✅ 7.24559 7.14205
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 13.78493 13.66227
Bitwuzla-MachBV-base sat ✅ 1.85981 1.72452
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 5.30752 5.18677
BVDecide bv_decide sat ✅ 35.05871 34.92999
bv_decide-nokernel sat ✅ 35.24903 35.13078
cvc5 cvc5 sat ✅ 35.49562 35.36446
SMTInterpol SMTInterpol unknown ❌ 1201.38546 1235.31084
Yices2 Yices2 sat ✅ 12.37657 12.25254
Z3alpha Z3-alpha sat ✅ 25.72356 101.48576
Z3 Z3-alpha-base sat ✅ 194.96265 194.81402
Z3-Owl-base sat ✅ 804.19433 803.96383
z3siri-base sat ✅ 197.67147 197.50752
Z3-Owl Z3-Owl sat ✅ 147.50527 147.37063