Benchmark

non-incremental/QF_BV/Sage2/bench_4497.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size243595
Compressed Size27080
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 243587
Compressed Size27168
Max. Term Depth102
Asserts 679
Declared Functions0
Declared Constants872
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not207 =673
let4165 bvor560 bvadd589 bvmul569
bvsgt16 bvshl571 zero_extend1647

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.67231 1.67068
Boolector SMT17 final boolector sat ✅ 51.38100 51.37860
CVC4 CVC4-smtcomp2017-main default sat ✅ 17.22370 34.44630
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 2.62796 2.62790
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.08190 3.10856
Q3B Q3B default unknown ❌ 600.05500 1786.27000
STP stp_st default unknown ❌ 600.01200 599.95500
stp_mt default unknown ❌ 600.04600 1906.92000
Yices2 Yices2-Main default sat ✅ 4.61799 4.61127
Z3 z3-4.5.0 default unknown ❌ 600.11200 600.05400
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 1.63816 1.63807
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 20.25850 20.25860
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.22039 3.22065
MinkeyRink Minkeyrink MT_mt sat ✅ 2.69957 9.31540
Minkeyrink ST_st sat ✅ 2.87794 2.87800
STP STP-CMS-st-2018_default-no-stderr sat ✅ 74.88750 74.87810
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 61.66710 241.04200
STP-Riss-st-2018_riss-no-stderr sat ✅ 78.61310 78.60740
Yices2 Yices 2.6.0_default sat ✅ 1.72606 1.72569
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.87000
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.58099 0.58089
MathSAT mathsat-5.6.6_default sat ✅ 0.73517 0.73509
STP STP 2021.0_default sat ✅ 1.67800 5.33714
Z3 z3-4.8.11_default sat ✅ 298.46400 298.36100
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.21149 4.31111
Bitwuzla-wrapped_default sat ✅ 2.33740 2.33731
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 31.26350 31.25950
MathSAT MathSAT-5.6.8_default sat ✅ 0.76336 0.76326
STP STP 2022.4_default sat ✅ 1.54279 1.54273
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 3.38866 3.38809
Z3++BV z3++bv_0702_default sat ✅ 10.04730 10.04580
Z3 z3-4.8.17_default sat ✅ 469.22300 469.09400
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.09252 2.09238
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 42.18210 42.17110
STP STP 2022.4_default sat ✅ 1.33782 1.33774
STP 2022.4_default sat ✅ 1.33443 1.33431
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.06000 1257.96000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 6.17846 6.17730
Z3-Owl z3-Owl-Final_default sat ✅ 53.46560 53.38580
z3-Owl-Final_default sat ✅ 129.21200 129.19600
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 5.56590 5.46524
cvc5 cvc5 sat ✅ 12.85588 12.75097
SMTInterpol SMTInterpol unknown ❌ 1202.24630 1244.42646
STP STP sat ✅ 2.08566 1.98406
Yices2 Yices2 sat ✅ 4.62874 4.52870
Z3alpha Z3-alpha sat ✅ 539.58453 539.46900
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 2.79982 2.67922
Bitwuzla-MachBV-base sat ✅ 2.63405 2.51450
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.74109 2.61295
BVDecide bv_decide sat ✅ 11.88179 11.72713
bv_decide-nokernel sat ✅ 9.75556 9.60782
cvc5 cvc5 sat ✅ 10.84273 10.71966
SMTInterpol SMTInterpol unknown ❌ 1201.79142 1229.43852
Yices2 Yices2 sat ✅ 4.18658 4.06826
Z3alpha Z3-alpha sat ✅ 306.21906 1222.42080
Z3 Z3-alpha-base sat ✅ 467.85113 467.64993
Z3-Owl-base unknown ❌ 1201.26910 1201.04449
z3siri-base sat ✅ 472.96318 472.74955
Z3-Owl Z3-Owl sat ✅ 64.39266 64.25846