Benchmark

non-incremental/QF_BV/Sage2/bench_14221.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size17053
Compressed Size2204
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 17045
Compressed Size2222
Max. Term Depth25
Asserts 71
Declared Functions0
Declared Constants48
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not30 =70 let312
bvor14 bvadd45 bvmul45 bvshl14
zero_extend164

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.00756 0.00447
Boolector SMT17 final boolector unsat ✅ 0.00948 0.00488
CVC4 CVC4-smtcomp2017-main default unsat ✅ 329.77700 662.14500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 219.73800 219.71700
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 13.51620 22.12000
Q3B Q3B default unsat ✅ 0.07131 0.06394
STP stp_st default unsat ✅ 9.60519 9.60182
stp_mt default unsat ✅ 9.56122 37.71100
Yices2 Yices2-Main default unsat ✅ 7.41684 7.41435
Z3 z3-4.5.0 default unsat ✅ 266.27400 266.22200
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01344 0.00516
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 56.83960 56.82590
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 111.87900 111.87100
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.01668 0.01675
Minkeyrink ST_st unsat ✅ 0.01655 0.01661
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 5.50713 5.50683
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 6.36909 25.09090
STP-Riss-st-2018_riss-no-stderr unsat ✅ 6.32479 6.32479
Yices2 Yices 2.6.0_default unsat ✅ 10.07870 10.07780
Z3 z3-4.7.1_default unsat ✅ 4.73219 4.73166
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01435 0.00703
MathSAT mathsat-5.6.6_default unsat ✅ 503.81800 503.72100
STP STP 2021.0_default unsat ✅ 4.72454 18.51500
Z3 z3-4.8.11_default unsat ✅ 5.89673 5.89579
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08070 0.08066
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 43.05700 43.05260
STP STP 2022.4_default unsat ✅ 12.38480 12.38320
STP 2022.4_default unsat ✅ 12.37770 12.37870
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1243.63000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 9.69741 9.69518
Z3-Owl z3-Owl-Final_default unsat ✅ 0.69680 0.69681
z3-Owl-Final_default unsat ✅ 0.70064 0.70073
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.22027 0.12039
cvc5 cvc5 unsat ✅ 324.64312 324.41101
SMTInterpol SMTInterpol unknown ❌ 1201.74166 1247.15015
STP STP unsat ✅ 26.72629 26.61819
Yices2 Yices2 unsat ✅ 3.10692 3.00672
Z3alpha Z3-alpha unsat ✅ 0.28278 0.18315
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.26792 0.13973
Bitwuzla-MachBV-base unsat ✅ 0.26128 0.14597
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.32475 0.20661
BVDecide bv_decide unsat ✅ 61.30052 61.18051
bv_decide-nokernel unsat ✅ 58.43674 58.27204
cvc5 cvc5 unsat ✅ 137.56725 137.41468
SMTInterpol SMTInterpol unknown ❌ 1201.48552 1259.35421
Yices2 Yices2 unsat ✅ 6.48786 6.37089
Z3alpha Z3-alpha unsat ✅ 0.40695 0.29062
Z3 Z3-alpha-base unsat ✅ 0.30721 0.18169
Z3-Owl-base unsat ✅ 0.27062 0.15081
z3siri-base unsat ✅ 0.25887 0.14021
Z3-Owl Z3-Owl unsat ✅ 0.83305 0.69467