Benchmark
non-incremental/QF_BV/Sage2/bench_9509.smt2
Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
| Benchmark |
|---|
| Size | 16989 |
| Compressed Size | 1560 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2015-07-02 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 16981 |
| Compressed Size | 1549 |
| Max. Term Depth | 21 |
| Asserts | 58 |
| Declared Functions | 0 |
| Declared Constants | 6 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 1 |
not | 13 |
= | 14 |
let | 367 |
bvadd | 201 |
bvmul | 4 |
bvult | 7 |
bvule | 19 |
bvugt | 2 |
bvuge | 15 |
bvlshr | 6 |
zero_extend | 143 |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
|
Boolector |
Boolector+CaDiCaL SMT17 final boolector |
unsat ✅
|
0.06188
|
0.06010
|
| |
|
Boolector SMT17 final boolector |
unsat ✅
|
0.16045
|
0.15961
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
0.34341
|
0.66682
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
0.06091
|
0.06187
|
| |
MinkeyRink |
MinkeyRink 2017.3a default |
unsat ✅
|
0.09388
|
0.05851
|
| |
Q3B |
Q3B default |
unsat ✅
|
0.11701
|
0.11599
|
| |
STP |
stp_st default |
unsat ✅
|
0.18140
|
0.18041
|
| |
|
stp_mt default |
unsat ✅
|
0.18550
|
0.61841
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
0.01079
|
0.00542
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
41.71710
|
83.41410
|
|
SMT-COMP 2018
|
|
Boolector |
Boolector_default |
unsat ✅
|
0.03946
|
0.03940
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.11331
|
0.11302
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unsat ✅
|
0.06677
|
0.06780
|
| |
MinkeyRink |
Minkeyrink MT_mt |
unsat ✅
|
0.04342
|
0.04794
|
| |
|
Minkeyrink ST_st |
unsat ✅
|
0.04177
|
0.04194
|
| |
STP |
STP-CMS-st-2018_default-no-stderr |
unsat ✅
|
0.32356
|
0.32376
|
| |
|
STP-CMS-mt-2018_multicore-no-stderr |
unsat ✅
|
0.27603
|
0.96816
|
| |
|
STP-Riss-st-2018_riss-no-stderr |
unsat ✅
|
0.28021
|
0.28027
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
0.00975
|
0.00796
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
82.19780
|
82.19160
|
|
SMT-COMP 2020
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.08267
|
0.08264
|
| |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.06381
|
0.06381
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.17691
|
0.17466
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
0.97030
|
0.97062
|
| |
LazyBV2Int |
LazyBV2Int20200523_default.sh |
unsat ✅
|
0.07324
|
0.07318
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
0.03600
|
0.03596
|
| |
MinkeyRink |
MinkeyRink Solver 2020.3.1_default |
unknown ❌
|
0.04585
|
0.04613
|
| |
|
MinkeyRink Solver 2020.3_default |
unsat ✅
|
0.04772
|
0.05157
|
| |
STP |
STP_default |
unsat ✅
|
0.02730
|
0.03097
|
| |
|
STP ++ Mergsat v1_default |
unsat ✅
|
0.01857
|
0.02025
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
0.01078
|
0.00865
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
13.55400
|
13.55490
|
|
SMT-COMP 2021
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.08580
|
0.08580
|
| |
MathSAT |
mathsat-5.6.6_default |
unsat ✅
|
0.03624
|
0.03622
|
| |
STP |
STP 2021.0_default |
unsat ✅
|
0.02850
|
0.03288
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
6.96417
|
6.96376
|
|
SMT-COMP 2023
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.02432
|
0.02425
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
0.29135
|
0.29147
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.02526
|
0.02529
|
| |
|
STP 2022.4_default |
unsat ✅
|
0.02525
|
0.02529
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
unsat ✅
|
4.67329
|
12.79190
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
unsat ✅
|
0.01048
|
0.00664
|
| |
Z3-Owl |
z3-Owl-Final_default |
unsat ✅
|
2.53712
|
2.53715
|
| |
|
z3-Owl-Final_default |
unsat ✅
|
2.42003
|
2.42011
|
|
SMT-COMP 2024
|
|
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.23252
|
0.13265
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.44719
|
0.34679
|
| |
SMTInterpol |
SMTInterpol |
unsat ✅
|
0.75031
|
1.52291
|
| |
STP |
STP |
unsat ✅
|
0.22496
|
0.12541
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.21350
|
0.11360
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
8.17753
|
8.07732
|
|
SMT-COMP 2025
|
|
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.26246
|
0.14453
|
| |
|
Bitwuzla-MachBV-base |
unsat ✅
|
0.26349
|
0.14628
|
| |
Bitwuzla-MachBV |
Bitwuzla-MachBV |
unsat ✅
|
0.36379
|
0.23822
|
| |
BVDecide |
bv_decide |
unsat ✅
|
1.14226
|
0.97299
|
| |
|
bv_decide-nokernel |
unsat ✅
|
0.86776
|
0.68725
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.42710
|
0.31630
|
| |
SMTInterpol |
SMTInterpol |
unsat ✅
|
0.73538
|
1.36553
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.28800
|
0.16448
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
15.99360
|
62.61145
|
| |
Z3 |
Z3-alpha-base |
unsat ✅
|
15.69265
|
15.56676
|
| |
|
Z3-Owl-base |
unsat ✅
|
68.84766
|
68.70977
|
| |
|
z3siri-base |
unsat ✅
|
15.77683
|
15.65585
|
| |
Z3-Owl |
Z3-Owl |
unsat ✅
|
19.40645
|
19.28464
|