Benchmark

non-incremental/QF_BV/Sage2/bench_1721.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22351
Compressed Size2076
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 22343
Compressed Size2088
Max. Term Depth60
Asserts 128
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not104 =108 let440
bvadd78 bvmul78 bvult19 zero_extend180

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 18.43750 18.43650
Boolector SMT17 final boolector sat ✅ 91.70520 91.69360
CVC4 CVC4-smtcomp2017-main default sat ✅ 62.58500 125.66200
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 49.89000 49.88750
MinkeyRink MinkeyRink 2017.3a default sat ✅ 6.41709 7.65000
Q3B Q3B default unknown ❌ 600.05900 1799.32000
STP stp_st default sat ✅ 1.67433 1.67329
stp_mt default sat ✅ 3.93650 15.11660
Yices2 Yices2-Main default sat ✅ 38.13340 38.13190
Z3 z3-4.5.0 default sat ✅ 123.66300 123.65600
SMT-COMP 2018 Boolector Boolector_default sat ✅ 103.57500 103.55500
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 54.04770 54.04820
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 37.14480 37.14410
MinkeyRink Minkeyrink MT_mt sat ✅ 0.99012 3.63378
Minkeyrink ST_st sat ✅ 1.97794 1.97655
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.12974 2.12913
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.26529 8.53447
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.06848 2.06841
Yices2 Yices 2.6.0_default sat ✅ 382.15200 382.12200
Z3 z3-4.7.1_default sat ✅ 25.77190 25.77050
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.22465 3.22412
MathSAT mathsat-5.6.6_default sat ✅ 26.30270 26.30150
STP STP 2021.0_default sat ✅ 0.58010 2.06174
Z3 z3-4.8.11_default sat ✅ 108.52000 108.47300
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 11.74430 11.74440
Bitwuzla-wrapped_default sat ✅ 16.33460 16.33380
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 101.02900 101.01400
MathSAT MathSAT-5.6.8_default sat ✅ 29.25540 29.25620
STP STP 2022.4_default sat ✅ 0.77664 0.77648
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 8.02781 8.02762
Z3++BV z3++bv_0702_default sat ✅ 43.19350 43.18500
Z3 z3-4.8.17_default sat ✅ 114.98500 114.96700
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 4.22071 4.22046
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 28.67830 28.67710
STP STP 2022.4_default sat ✅ 3.11426 3.11074
STP 2022.4_default sat ✅ 3.13490 3.13271
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 471.46000 504.91300
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 174.99900 174.96600
Z3-Owl z3-Owl-Final_default sat ✅ 17.17070 17.16770
z3-Owl-Final_default sat ✅ 16.29730 16.29410
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 15.11945 15.01938
cvc5 cvc5 sat ✅ 84.55025 84.44690
SMTInterpol SMTInterpol unknown ❌ 1201.71844 1234.77036
STP STP sat ✅ 16.97586 16.87177
Yices2 Yices2 sat ✅ 22.16997 22.05959
Z3alpha Z3-alpha sat ✅ 41.51889 41.40078
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 10.79813 10.67925
Bitwuzla-MachBV-base sat ✅ 3.48061 3.35587
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 7.50129 7.38101
BVDecide bv_decide sat ✅ 59.49747 59.37860
bv_decide-nokernel sat ✅ 59.21017 59.07611
cvc5 cvc5 sat ✅ 64.56119 64.43625
SMTInterpol SMTInterpol unknown ❌ 1201.40461 1221.61558
Yices2 Yices2 sat ✅ 16.30935 16.18088
Z3alpha Z3-alpha sat ✅ 175.87852 701.94870
Z3 Z3-alpha-base sat ✅ 70.81089 70.67602
Z3-Owl-base sat ✅ 300.04169 299.89704
z3siri-base sat ✅ 71.93204 71.78869
Z3-Owl Z3-Owl sat ✅ 227.58344 227.41994