Benchmark

non-incremental/QF_BV/Sage2/bench_3470.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21187
Compressed Size1919
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21179
Compressed Size1911
Max. Term Depth60
Asserts 117
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not93 =97 let418
bvadd78 bvmul78 bvult19 zero_extend169

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 40.61750 40.60860
Boolector SMT17 final boolector sat ✅ 77.85310 77.84400
CVC4 CVC4-smtcomp2017-main default sat ✅ 77.56010 155.53900
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 19.43180 19.43270
MinkeyRink MinkeyRink 2017.3a default sat ✅ 9.58763 14.07000
Q3B Q3B default unknown ❌ 600.08500 1799.72000
STP stp_st default sat ✅ 27.02440 27.01160
stp_mt default sat ✅ 5.34159 20.73830
Yices2 Yices2-Main default sat ✅ 42.76030 42.76030
Z3 z3-4.5.0 default sat ✅ 135.08500 135.07200
SMT-COMP 2018 Boolector Boolector_default sat ✅ 66.25230 66.25190
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 55.51290 55.50830
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 34.44380 34.44270
MinkeyRink Minkeyrink MT_mt sat ✅ 4.74055 18.51290
Minkeyrink ST_st sat ✅ 9.40637 9.40585
STP STP-CMS-st-2018_default-no-stderr sat ✅ 35.28510 35.28120
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 18.55580 73.15470
STP-Riss-st-2018_riss-no-stderr sat ✅ 55.01430 55.01390
Yices2 Yices 2.6.0_default sat ✅ 18.28310 18.27920
Z3 z3-4.7.1_default sat ✅ 270.58900 270.58400
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 12.39850 12.39800
Boolector Boolector-wrapped-sq_default sat ✅ 19.86220 19.86200
Poolector-wrapped-sq_default sat ✅ 21.12580 83.32000
CVC4 CVC4-sq-final_default sat ✅ 80.45010 80.43790
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1200.03000
MathSAT MathSAT5_default.sh sat ✅ 101.69200 101.69300
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08958 0.08984
MinkeyRink Solver 2020.3_default sat ✅ 9.13743 35.97990
STP STP_default sat ✅ 3.20652 12.44480
STP ++ Mergsat v1_default sat ✅ 23.10230 23.10280
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.26848 0.26844
Z3 z3-4.8.8_default sat ✅ 66.96020 66.95440
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 15.32180 15.32110
MathSAT mathsat-5.6.6_default sat ✅ 64.25250 64.24940
STP STP 2021.0_default sat ✅ 7.81714 30.83770
Z3 z3-4.8.11_default sat ✅ 239.00000 238.94700
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 15.54330 15.54360
Bitwuzla-wrapped_default sat ✅ 56.41150 56.39530
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 36.09880 36.08820
MathSAT MathSAT-5.6.8_default sat ✅ 49.03180 49.02900
STP STP 2022.4_default sat ✅ 3.96309 3.96288
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 72.53160 72.52570
Z3++BV z3++bv_0702_default sat ✅ 159.93300 159.90400
Z3 z3-4.8.17_default sat ✅ 189.83600 189.77800
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 23.63870 23.63490
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 24.20640 24.19920
STP STP 2022.4_default sat ✅ 2.66369 2.66359
STP 2022.4_default sat ✅ 2.66679 2.66653
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 719.54600 749.97400
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 35.16660 35.16190
Z3-Owl z3-Owl-Final_default sat ✅ 45.79680 45.79490
z3-Owl-Final_default sat ✅ 98.82420 98.80970
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 5.63977 5.52003
Bitwuzla-MachBV-base sat ✅ 31.16243 31.02623
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 22.11682 21.99194
BVDecide bv_decide sat ✅ 58.11730 57.98477
bv_decide-nokernel sat ✅ 58.43759 58.28340
cvc5 cvc5 sat ✅ 59.22004 59.09414
SMTInterpol SMTInterpol unknown ❌ 1201.38831 1227.28840
Yices2 Yices2 sat ✅ 83.59948 83.46950
Z3alpha Z3-alpha sat ✅ 73.62681 292.87181
Z3 Z3-alpha-base sat ✅ 18.02704 17.90570
Z3-Owl-base sat ✅ 72.48105 72.35090
z3siri-base sat ✅ 18.50151 18.37141
Z3-Owl Z3-Owl sat ✅ 88.44578 88.31122