Benchmark

non-incremental/QF_BV/Sage2/bench_11118.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size609028
Compressed Size29792
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 609020
Compressed Size29801
Max. Term Depth299
Asserts 1283
Declared Functions0
Declared Constants3838
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite86 not92 =874
let4866 extract12 bvand6 bvor2304
bvadd5396 bvmul443 bvult156 bvule158
bvugt35 bvuge145 bvshl2311 bvlshr6
zero_extend3191

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.86180 1.85968
Boolector SMT17 final boolector sat ✅ 16.78630 16.78680
CVC4 CVC4-smtcomp2017-main default sat ✅ 17.64320 35.09720
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 4.01456 4.01502
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.62574 3.62544
Q3B Q3B default unknown ❌ 600.07600 1432.00000
STP stp_st default sat ✅ 4.53672 4.53466
stp_mt default sat ✅ 5.10820 10.08030
Yices2 Yices2-Main default sat ✅ 0.19566 0.19492
Z3 z3-4.5.0 default sat ✅ 2.56977 2.56872
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.45749 0.45739
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 11.78520 11.78570
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 95.84430 95.84280
MinkeyRink Minkeyrink MT_mt sat ✅ 6.62342 7.48163
Minkeyrink ST_st sat ✅ 8.88838 8.88822
STP STP-CMS-st-2018_default-no-stderr sat ✅ 30.50390 30.48220
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 30.49220 111.42200
STP-Riss-st-2018_riss-no-stderr sat ✅ 11.30010 11.29880
Yices2 Yices 2.6.0_default sat ✅ 0.25293 0.25283
Z3 z3-4.7.1_default sat ✅ 3.58069 3.58004
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.92595 0.92587
Poolector-wrapped-sq_default sat ✅ 0.68246 2.22000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 9.09908 9.09626
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 6.50496 6.50481
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 3.06720 7.27166
MinkeyRink ST-wrapped-sq_default sat ✅ 3.45840 3.45788
Par4 Par4-wrapped-sq_default sat ✅ 0.18955 0.00613
STP STP-2019-wrapped-sq_default sat ✅ 3.70071 3.70101
stp-mergesat-fixed-wrapped-sq_default sat ✅ 8.30112 8.30078
stp-minisat-wrapped-sq_default sat ✅ 4.34173 4.34187
stp-mt-wrapped-sq_default sat ✅ 3.94133 5.58490
stp-portfolio-fixed-wrapped-sq_default sat ✅ 8.58344 10.95860
stp-riss-wrapped-sq_default unknown ❌ 3.35011 3.35031
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.19955 0.19951
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.07437 2.07451
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 7.61627 7.61508
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 179.42700 179.39900
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.63762 0.63740
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 18.89290 18.88900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.15836 2.15833
Boolector Boolector-wrapped-sq_default sat ✅ 0.87209 0.87199
Poolector-wrapped-sq_default sat ✅ 0.78272 2.55499
CVC4 CVC4-sq-final_default sat ✅ 5.73678 5.73658
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.88000
MathSAT MathSAT5_default.sh sat ✅ 1.61664 1.61657
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.96352 1.96358
MinkeyRink Solver 2020.3_default sat ✅ 2.68839 4.74923
STP STP_default sat ✅ 2.20123 3.19096
STP ++ Mergsat v1_default sat ✅ 7.66376 7.66537
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.00181 1.00167
Z3 z3-4.8.8_default sat ✅ 2.63864 2.63850
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.46212 2.46197
MathSAT mathsat-5.6.6_default sat ✅ 582.37000 582.24400
STP STP 2021.0_default sat ✅ 2.67614 4.88275
Z3 z3-4.8.11_default sat ✅ 1.60735 1.60735
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.46832 2.46829
Bitwuzla-wrapped_default sat ✅ 2.49192 2.49084
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 5.78414 5.78469
MathSAT MathSAT-5.6.8_default sat ✅ 4.29029 4.28999
STP STP 2022.4_default sat ✅ 2.89642 2.89592
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.00724 1.00718
Z3++BV z3++bv_0702_default sat ✅ 3.04989 3.04943
Z3 z3-4.8.17_default sat ✅ 1.85062 1.85219
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.16260 4.16245
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 8.30939 8.30946
STP STP 2022.4_default sat ✅ 2.92604 2.92619
STP 2022.4_default sat ✅ 2.91001 2.90992
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1622.91000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.23534 0.23529
Z3-Owl z3-Owl-Final_default sat ✅ 27.19000 27.19100
z3-Owl-Final_default sat ✅ 26.54830 26.54860
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 3.85867 3.75867
cvc5 cvc5 sat ✅ 6.61491 6.51170
SMTInterpol SMTInterpol unknown ❌ 1202.72067 1358.71277
STP STP sat ✅ 2.09575 1.99594
Yices2 Yices2 sat ✅ 1.41964 1.31917
Z3alpha Z3-alpha sat ✅ 199.71143 199.60049
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.13423 1.01866
Bitwuzla-MachBV-base sat ✅ 1.45467 1.32187
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.52024 1.38756
BVDecide bv_decide sat ✅ 67.71590 67.57362
bv_decide-nokernel sat ✅ 38.24060 38.07202
cvc5 cvc5 sat ✅ 4.60810 4.48184
SMTInterpol SMTInterpol unknown ❌ 102.63999 352.82841
Yices2 Yices2 sat ✅ 0.49747 0.36999
Z3alpha Z3-alpha sat ✅ 7.27058 24.82280
Z3 Z3-alpha-base sat ✅ 75.54166 75.41572
Z3-Owl-base sat ✅ 316.32393 316.17448
z3siri-base sat ✅ 79.04796 78.91928
Z3-Owl Z3-Owl sat ✅ 21.35489 21.22743