Benchmark

non-incremental/QF_BV/Sage2/bench_15715.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size43278
Compressed Size3515
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 43270
Compressed Size3530
Max. Term Depth40
Asserts 115
Declared Functions0
Declared Constants34
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not37 =42 let898
bvor3 bvadd326 bvmul140 bvult14
bvule24 bvuge19 bvsgt2 bvsge13
bvshl60 zero_extend332

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.67899 0.67952
Boolector SMT17 final boolector unsat ✅ 1.54767 1.54731
CVC4 CVC4-smtcomp2017-main default unsat ✅ 87.50360 175.62900
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 96.61850 96.60210
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.62088 2.61431
Q3B Q3B default unknown ❌ 600.05200 1799.27000
STP stp_st default unsat ✅ 237.61300 237.59200
stp_mt default unsat ✅ 236.56300 940.65700
Yices2 Yices2-Main default unsat ✅ 1.05214 1.05231
Z3 z3-4.5.0 default unsat ✅ 71.84000 71.82880
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 5.25677 5.25644
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.74018 4.74027
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 116.18400 116.17100
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.71856 2.62555
Minkeyrink ST_st unsat ✅ 2.08548 2.08511
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 113.11400 113.11200
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 119.94400 475.89700
STP-Riss-st-2018_riss-no-stderr unsat ✅ 152.44500 152.43300
Yices2 Yices 2.6.0_default unsat ✅ 0.28396 0.28390
Z3 z3-4.7.1_default unsat ✅ 23.38580 23.38430
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 14.98840 14.98600
Boolector Boolector-wrapped-sq_default unsat ✅ 11.98180 11.97940
Poolector-wrapped-sq_default unsat ✅ 7.29592 28.28000
CVC4 CVC4-sq-final_default unsat ✅ 40.92670 40.92360
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1199.93000
MathSAT MathSAT5_default.sh unsat ✅ 729.36400 729.18100
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.05958 0.05981
MinkeyRink Solver 2020.3_default unsat ✅ 1.34835 5.11228
STP STP_default unsat ✅ 0.51046 1.84953
STP ++ Mergsat v1_default unsat ✅ 5.35031 5.35171
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.33053 0.33048
Z3 z3-4.8.8_default unsat ✅ 8.01838 8.01775
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 14.85250 14.84630
Bitwuzla-wrapped_default unsat ✅ 15.47950 15.47860
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 12.52080 12.51530
MathSAT MathSAT-5.6.8_default unsat ✅ 453.63300 453.55000
STP STP 2022.4_default unsat ✅ 0.46984 0.46982
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.31104 0.31099
Z3++BV z3++bv_0702_default unsat ✅ 7.95415 7.95319
Z3 z3-4.8.17_default unsat ✅ 9.65866 9.66038
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.32479 3.32426
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.63021 0.63075
STP STP 2022.4_default unsat ✅ 0.65904 0.65907
STP 2022.4_default unsat ✅ 0.66268 0.66267
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 177.55900 208.61500
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.25173 0.25166
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.93000
z3-Owl-Final_default unsat ✅ 84.84530 84.74740