Benchmark

non-incremental/QF_BV/Sage2/bench_11101.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size31996
Compressed Size1881
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 31988
Compressed Size1872
Max. Term Depth107
Asserts 34
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite33 not13 =16
let773 bvand1 bvadd231 bvmul70
bvudiv1 bvule11 bvugt1 bvuge2
bvsle1 bvsgt34 bvsge1 bvshl91
bvlshr2 bvashr89 zero_extend209

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 249.76400 249.77200
Boolector SMT17 final boolector sat ✅ 140.13300 140.12000
CVC4 CVC4-smtcomp2017-main default sat ✅ 27.33080 54.78040
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 66.47890 66.47110
MinkeyRink MinkeyRink 2017.3a default sat ✅ 77.31420 151.17000
Q3B Q3B default unknown ❌ 600.07200 1199.92000
STP stp_st default sat ✅ 116.91200 116.91100
stp_mt default sat ✅ 6.05439 23.59660
Yices2 Yices2-Main default sat ✅ 91.44910 91.43840
Z3 z3-4.5.0 default sat ✅ 127.05100 127.05500
SMT-COMP 2018 Boolector Boolector_default sat ✅ 114.55300 114.55500
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 99.94650 99.94320
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 73.72290 73.72530
MinkeyRink Minkeyrink MT_mt sat ✅ 43.63620 172.82700
Minkeyrink ST_st sat ✅ 134.35500 134.34700
STP STP-CMS-st-2018_default-no-stderr sat ✅ 43.09250 43.08580
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 60.87910 241.69400
STP-Riss-st-2018_riss-no-stderr sat ✅ 351.28200 351.24800
Yices2 Yices 2.6.0_default sat ✅ 101.92800 101.93100
Z3 z3-4.7.1_default sat ✅ 78.69260 78.69420
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 82.48970 82.47560
Poolector-wrapped-sq_default sat ✅ 22.00050 86.70000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 72.65370 72.64430
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.73382 2.73405
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 24.65020 97.37860
MinkeyRink ST-wrapped-sq_default sat ✅ 150.99800 150.99500
Par4 Par4-wrapped-sq_default sat ✅ 60.53550 181.41000
STP STP-2019-wrapped-sq_default sat ✅ 123.83300 123.83000
stp-mergesat-fixed-wrapped-sq_default sat ✅ 112.03800 112.02300
stp-minisat-wrapped-sq_default sat ✅ 135.50000 135.49300
stp-mt-wrapped-sq_default sat ✅ 5.13885 19.87510
stp-portfolio-fixed-wrapped-sq_default sat ✅ 157.79000 444.44300
stp-riss-wrapped-sq_default unknown ❌ 0.13832 0.13848
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 80.03140 80.02390
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 41.47060 41.46710
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 41.20360 41.20480
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 2347.78000 2347.75000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 23.26850 23.26940
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 82.83660 82.82770
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 27.44050 27.43940
Boolector Boolector-wrapped-sq_default sat ✅ 22.23410 22.22410
Poolector-wrapped-sq_default sat ✅ 24.63170 97.21930
CVC4 CVC4-sq-final_default sat ✅ 22.58180 22.58050
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.63000
MathSAT MathSAT5_default.sh sat ✅ 9.54967 9.55008
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.17161 0.17188
MinkeyRink Solver 2020.3_default sat ✅ 38.31860 148.52300
STP STP_default sat ✅ 21.56360 85.13690
STP ++ Mergsat v1_default sat ✅ 86.58780 86.57480
Yices2 Yices 2.6.2 bug fix_default sat ✅ 64.76400 64.75990
Z3 z3-4.8.8_default sat ✅ 62.72380 62.71590
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 151.96900 151.95100
MathSAT mathsat-5.6.6_default sat ✅ 37.95690 37.95330
STP STP 2021.0_default sat ✅ 35.48530 140.55600
Z3 z3-4.8.11_default sat ✅ 8.22256 8.22201
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 96.65150 96.63290
Bitwuzla-wrapped_default sat ✅ 21.00220 20.99920
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 220.49400 220.48200
MathSAT MathSAT-5.6.8_default sat ✅ 37.65750 37.65260
STP STP 2022.4_default sat ✅ 44.57270 44.55950
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 14.20020 14.19760
Z3++BV z3++bv_0702_default sat ✅ 11.26040 11.26100
Z3 z3-4.8.17_default sat ✅ 167.54800 167.51900
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 42.69830 42.69520
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 51.49930 51.46060
STP STP 2022.4_default sat ✅ 45.36200 45.35930
STP 2022.4_default sat ✅ 45.10880 45.10320
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.61878 12.02550
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 86.69280 86.69390
Z3-Owl z3-Owl-Final_default sat ✅ 91.00070 90.98520
z3-Owl-Final_default sat ✅ 24.82020 24.82000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 50.69603 50.59410
cvc5 cvc5 sat ✅ 7.50169 7.39939
SMTInterpol SMTInterpol unknown ❌ 3.41278 9.87740
STP STP sat ✅ 23.66419 23.54928
Yices2 Yices2 sat ✅ 26.16752 26.06666
Z3alpha Z3-alpha sat ✅ 81.57569 81.47433
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 11.67065 11.54712
Bitwuzla-MachBV-base sat ✅ 10.40267 10.27213
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 10.39506 10.27525
BVDecide bv_decide sat ✅ 114.04664 113.97196
bv_decide-nokernel sat ✅ 119.01442 118.93566
cvc5 cvc5 sat ✅ 5.95158 5.82700
SMTInterpol SMTInterpol unknown ❌ 1.77542 4.88154
Yices2 Yices2 sat ✅ 46.51251 46.38904
Z3alpha Z3-alpha sat ✅ 38.25070 151.23414
Z3 Z3-alpha-base sat ✅ 242.00331 241.84955
Z3-Owl-base sat ✅ 945.02785 944.82204
z3siri-base sat ✅ 245.80602 245.63952
Z3-Owl Z3-Owl sat ✅ 34.22139 34.09149