Benchmark

non-incremental/QF_BV/Sage2/bench_16774.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size156116
Compressed Size5977
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 156108
Compressed Size5911
Max. Term Depth591
Asserts 164
Declared Functions0
Declared Constants196
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not60 =61 let3436
bvadd2141 bvmul2 bvult21 bvule39
bvugt2 bvuge40 bvlshr21 zero_extend1212

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.16881 0.16884
Boolector SMT17 final boolector unsat ✅ 5.44701 5.44572
CVC4 CVC4-smtcomp2017-main default unsat ✅ 440.91700 878.55200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49374 0.49363
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.40896 0.39367
Q3B Q3B default unknown ❌ 600.03500 1799.79000
STP stp_st default unsat ✅ 0.58104 0.58020
stp_mt default unsat ✅ 0.66038 1.58162
Yices2 Yices2-Main default unsat ✅ 0.03088 0.02942
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.96500
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 0.13956 0.13950
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.95156 1.95161
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.47946 0.48029
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.22409 0.30231
Minkeyrink ST_st unsat ✅ 0.21084 0.21105
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.32579 0.32585
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.34683 0.49834
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.95053 1.95020
Yices2 Yices 2.6.0_default unsat ✅ 0.03051 0.03046
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.91000
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.21927 0.21756
Bitwuzla-wrapped_default unsat ✅ 0.21046 0.21039
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 108.71000 108.69200
MathSAT MathSAT-5.6.8_default unsat ✅ 0.15523 0.15519
STP STP 2022.4_default unsat ✅ 0.30649 0.30649
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.11730 0.11726
Z3++BV z3++bv_0702_default unknown ❌ 1200.03000 1200.01000
Z3 z3-4.8.17_default unknown ❌ 1200.09000 1199.77000
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.45466 0.45459
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.88000
STP STP 2022.4_default unsat ✅ 0.35130 0.35022
STP 2022.4_default unsat ✅ 0.34911 0.34906
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 5.74589 17.42440
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03469 0.03457
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.12000 1199.88000
z3-Owl-Final_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.42479 0.32511
cvc5 cvc5 unsat ✅ 76.73789 76.61632
SMTInterpol SMTInterpol unsat ✅ 2.60178 7.36439
STP STP unsat ✅ 0.52477 0.42517
Yices2 Yices2 unsat ✅ 0.27652 0.17659
Z3alpha Z3-alpha unknown ❌ 1201.71708 1200.88719
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 0.38007 0.25467
Bitwuzla-MachBV-base unsat ✅ 0.41040 0.27170
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.46282 0.33830
BVDecide bv_decide unsat ✅ 7.11837 6.96319
bv_decide-nokernel unsat ✅ 3.41042 3.24716
cvc5 cvc5 unsat ✅ 95.15526 95.02622
SMTInterpol SMTInterpol unsat ✅ 2.38649 6.72108
Yices2 Yices2 unsat ✅ 0.29952 0.17995
Z3alpha Z3-alpha unknown ❌ 1201.00525 4802.42470
Z3 Z3-alpha-base unknown ❌ 1201.28768 1201.07267
Z3-Owl-base unknown ❌ 1201.30686 1200.97728
z3siri-base unknown ❌ 1201.31479 1201.07179
Z3-Owl Z3-Owl unknown ❌ 1201.75733 1201.07374