Benchmark
non-incremental/QF_BV/Sage2/bench_10511.smt2
Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
| Benchmark |
|---|
| Size | 85156 |
| Compressed Size | 7792 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2015-07-02 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 85148 |
| Compressed Size | 7810 |
| Max. Term Depth | 43 |
| Asserts | 335 |
| Declared Functions | 0 |
| Declared Constants | 126 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 1 |
ite | 8 |
not | 29 |
= | 75 |
let | 1547 |
extract | 7 |
bvand | 7 |
bvor | 63 |
bvadd | 652 |
bvmul | 358 |
bvult | 75 |
bvule | 123 |
bvugt | 18 |
bvuge | 51 |
bvshl | 63 |
bvlshr | 22 |
zero_extend | 330 |
| | | | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
0.12 (7/8) |
Boolector |
Boolector+CaDiCaL SMT17 final boolector |
unsat ✅
|
0.15420
|
0.15362
|
| |
|
Boolector SMT17 final boolector |
unsat ✅
|
0.55398
|
0.55361
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
29.33140
|
58.78370
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
0.93395
|
0.93415
|
| |
MinkeyRink |
MinkeyRink 2017.3a default |
unsat ✅
|
0.19888
|
0.16419
|
| |
Q3B |
Q3B default |
unknown ❌
|
600.04600
|
1799.57000
|
| |
STP |
stp_st default |
unsat ✅
|
68.57990
|
68.57450
|
| |
|
stp_mt default |
unsat ✅
|
57.42460
|
182.53300
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
0.03445
|
0.03209
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
1.65615
|
1.65507
|
|
SMT-COMP 2018
|
|
Boolector |
Boolector_default |
unsat ✅
|
0.11633
|
0.11627
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
106.47500
|
106.45800
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unsat ✅
|
1.02388
|
1.02476
|
| |
MinkeyRink |
Minkeyrink MT_mt |
unsat ✅
|
0.11148
|
0.15359
|
| |
|
Minkeyrink ST_st |
unsat ✅
|
0.10650
|
0.10670
|
| |
STP |
STP-CMS-st-2018_default-no-stderr |
unsat ✅
|
193.76900
|
193.75100
|
| |
|
STP-CMS-mt-2018_multicore-no-stderr |
unsat ✅
|
125.36800
|
498.14200
|
| |
|
STP-Riss-st-2018_riss-no-stderr |
unsat ✅
|
123.17200
|
123.16900
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
0.03327
|
0.03321
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
524.87900
|
524.79800
|
|
SMT-COMP 2020
|
0.11 (8/9) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.16143
|
0.16140
|
| |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.15988
|
0.15989
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.17968
|
0.16879
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
147.96000
|
147.94600
|
| |
LazyBV2Int |
LazyBV2Int20200523_default.sh |
unknown ❌
|
1200.03000
|
1199.88000
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
0.58832
|
0.58826
|
| |
MinkeyRink |
MinkeyRink Solver 2020.3.1_default |
unknown ❌
|
0.09030
|
0.09057
|
| |
|
MinkeyRink Solver 2020.3_default |
unsat ✅
|
0.10061
|
0.12778
|
| |
STP |
STP_default |
unsat ✅
|
0.09475
|
0.11991
|
| |
|
STP ++ Mergsat v1_default |
unsat ✅
|
0.08158
|
0.08326
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
0.04225
|
0.04221
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
54.52700
|
54.52320
|
|
SMT-COMP 2021
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.17868
|
0.17859
|
| |
MathSAT |
mathsat-5.6.6_default |
unsat ✅
|
0.65221
|
0.65207
|
| |
STP |
STP 2021.0_default |
unsat ✅
|
0.10137
|
0.13560
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
20.90930
|
20.90750
|
|
SMT-COMP 2022
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.17629
|
0.17627
|
| |
|
Bitwuzla-wrapped_default |
unsat ✅
|
0.18823
|
0.18815
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
48.38230
|
48.37230
|
| |
MathSAT |
MathSAT-5.6.8_default |
unsat ✅
|
0.60690
|
0.60682
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.08123
|
0.08127
|
| |
Yices2 |
Yices 2.6.2 for SMTCOMP 2021_default |
unsat ✅
|
0.04077
|
0.04075
|
| |
Z3++BV |
z3++bv_0702_default |
unsat ✅
|
35.31980
|
35.31910
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
10.45820
|
20.83930
|
|
SMT-COMP 2025
|
0.44 (5/9) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.31018
|
0.18316
|
| |
|
Bitwuzla-MachBV-base |
unsat ✅
|
0.32636
|
0.20759
|
| |
Bitwuzla-MachBV |
Bitwuzla-MachBV |
unsat ✅
|
0.44090
|
0.32104
|
| |
BVDecide |
bv_decide |
unsat ✅
|
4.67205
|
4.50269
|
| |
|
bv_decide-nokernel |
unsat ✅
|
2.68565
|
2.50921
|
| |
cvc5 |
cvc5 |
unsat ✅
|
38.46818
|
38.34864
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
1201.78661
|
1230.39188
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.34538
|
0.23312
|
| |
Z3alpha |
Z3-alpha |
unknown ❌
|
1201.00628
|
4802.06814
|
| |
Z3 |
Z3-alpha-base |
unknown ❌
|
1201.26389
|
1201.02911
|
| |
|
Z3-Owl-base |
unknown ❌
|
1201.29689
|
1201.01887
|
| |
|
z3siri-base |
unknown ❌
|
1201.27015
|
1201.04290
|
| |
Z3-Owl |
Z3-Owl |
unknown ❌
|
1201.75679
|
1201.01324
|