Benchmark

non-incremental/QF_BV/Sage2/bench_3370.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size18352
Compressed Size1810
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 18344
Compressed Size1804
Max. Term Depth60
Asserts 111
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not87 =91 let352
bvadd60 bvmul60 bvult19 zero_extend145

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 46.96720 46.96470
Boolector SMT17 final boolector sat ✅ 50.01270 50.00640
CVC4 CVC4-smtcomp2017-main default sat ✅ 87.53360 176.21600
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 53.67240 53.62540
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.40684 3.44622
Q3B Q3B default unknown ❌ 600.05600 1797.69000
STP stp_st default sat ✅ 7.03290 7.03140
stp_mt default sat ✅ 11.31240 14.00270
Yices2 Yices2-Main default sat ✅ 8.98244 8.98138
Z3 z3-4.5.0 default unknown ❌ 600.02100 600.02200
SMT-COMP 2018 Boolector Boolector_default sat ✅ 20.61650 20.61680
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 17.10780 17.10790
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 20.32800 20.32870
MinkeyRink Minkeyrink MT_mt sat ✅ 0.21416 0.50444
Minkeyrink ST_st sat ✅ 9.16010 9.15503
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.27959 3.27936
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.95081 15.27740
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.31605 1.31608
Yices2 Yices 2.6.0_default sat ✅ 11.02570 11.02390
Z3 z3-4.7.1_default sat ✅ 63.89610 63.89020
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 15.41810 15.40640
MathSAT mathsat-5.6.6_default sat ✅ 17.35470 17.35420
STP STP 2021.0_default sat ✅ 5.85284 22.70780
Z3 z3-4.8.11_default sat ✅ 158.65400 158.64500
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 5.89887 5.89798
Bitwuzla-wrapped_default sat ✅ 20.44650 20.44520
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 118.85900 118.84200
MathSAT MathSAT-5.6.8_default sat ✅ 12.11960 12.11890
STP STP 2022.4_default sat ✅ 0.72810 0.72811
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 14.96860 14.96800
Z3++BV z3++bv_0702_default sat ✅ 12.83220 12.83160
Z3 z3-4.8.17_default sat ✅ 122.57400 122.56200
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 12.87840 12.87790
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 12.00200 12.00220
STP STP 2022.4_default sat ✅ 1.55438 1.55426
STP 2022.4_default sat ✅ 1.55334 1.55336
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1236.85000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 5.01744 5.01700
Z3-Owl z3-Owl-Final_default sat ✅ 100.70400 100.70000
z3-Owl-Final_default sat ✅ 135.67200 135.64700
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 15.98152 15.88067
cvc5 cvc5 sat ✅ 109.72474 109.62268
SMTInterpol SMTInterpol unknown ❌ 1201.72149 1218.91928
STP STP sat ✅ 49.68190 49.55872
Yices2 Yices2 sat ✅ 5.20254 5.09998
Z3alpha Z3-alpha sat ✅ 29.81927 29.71874