Benchmark
non-incremental/QF_BV/Sage2/bench_15720.smt2
Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
| Benchmark |
|---|
| Size | 104956 |
| Compressed Size | 8297 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2015-07-02 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 104948 |
| Compressed Size | 8313 |
| Max. Term Depth | 70 |
| Asserts | 310 |
| Declared Functions | 0 |
| Declared Constants | 109 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 1 |
ite | 6 |
not | 35 |
= | 77 |
let | 2084 |
extract | 30 |
bvand | 7 |
bvor | 47 |
bvadd | 974 |
bvmul | 348 |
bvult | 77 |
bvule | 84 |
bvugt | 20 |
bvuge | 57 |
bvshl | 59 |
bvlshr | 26 |
zero_extend | 546 |
| | | | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
0.12 (7/8) |
Boolector |
Boolector+CaDiCaL SMT17 final boolector |
unsat ✅
|
0.31231
|
0.31050
|
| |
|
Boolector SMT17 final boolector |
unsat ✅
|
1.09074
|
1.09073
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
15.54210
|
31.11610
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
25.19780
|
25.19650
|
| |
MinkeyRink |
MinkeyRink 2017.3a default |
unsat ✅
|
0.36085
|
0.32780
|
| |
Q3B |
Q3B default |
unknown ❌
|
600.02400
|
1799.56000
|
| |
STP |
stp_st default |
unsat ✅
|
10.33080
|
10.33060
|
| |
|
stp_mt default |
unsat ✅
|
9.00405
|
34.65380
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
0.07513
|
0.07475
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
7.06008
|
7.05557
|
|
SMT-COMP 2018
|
|
Boolector |
Boolector_default |
unsat ✅
|
0.26361
|
0.26355
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
24.44640
|
24.44740
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unsat ✅
|
11.40730
|
11.40690
|
| |
MinkeyRink |
Minkeyrink MT_mt |
unsat ✅
|
0.21818
|
0.41492
|
| |
|
Minkeyrink ST_st |
unsat ✅
|
0.26525
|
0.26528
|
| |
STP |
STP-CMS-st-2018_default-no-stderr |
unsat ✅
|
221.11900
|
221.11300
|
| |
|
STP-CMS-mt-2018_multicore-no-stderr |
unsat ✅
|
165.23900
|
656.67100
|
| |
|
STP-Riss-st-2018_riss-no-stderr |
unsat ✅
|
310.94400
|
310.90700
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
0.07874
|
0.07868
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
30.33210
|
30.33350
|
|
SMT-COMP 2020
|
0.11 (8/9) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.32459
|
0.32448
|
| |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.24401
|
0.24403
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.28342
|
0.23776
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
3.32704
|
3.32726
|
| |
LazyBV2Int |
LazyBV2Int20200523_default.sh |
unknown ❌
|
1200.01000
|
1199.92000
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
211.43200
|
211.38400
|
| |
MinkeyRink |
MinkeyRink Solver 2020.3.1_default |
unknown ❌
|
0.13667
|
0.13689
|
| |
|
MinkeyRink Solver 2020.3_default |
unsat ✅
|
0.41998
|
1.23609
|
| |
STP |
STP_default |
unsat ✅
|
0.13592
|
0.22496
|
| |
|
STP ++ Mergsat v1_default |
unsat ✅
|
0.12708
|
0.12871
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
0.26936
|
0.26930
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
44.43450
|
44.42990
|
|
SMT-COMP 2022
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.27371
|
0.27359
|
| |
|
Bitwuzla-wrapped_default |
unsat ✅
|
0.27727
|
0.27722
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
8.35191
|
8.35034
|
| |
MathSAT |
MathSAT-5.6.8_default |
unsat ✅
|
295.10000
|
295.05600
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.18198
|
0.18201
|
| |
Yices2 |
Yices 2.6.2 for SMTCOMP 2021_default |
unsat ✅
|
0.07957
|
0.07954
|
| |
Z3++BV |
z3++bv_0702_default |
unsat ✅
|
7.62060
|
7.61998
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
77.96830
|
77.96110
|
|
SMT-COMP 2023
|
0.33 (4/6) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.36923
|
0.36913
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
29.31110
|
29.30720
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.16397
|
0.16401
|
| |
|
STP 2022.4_default |
unsat ✅
|
0.16534
|
0.16535
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
1200.12000
|
1242.48000
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
unsat ✅
|
0.16416
|
0.16414
|
| |
Z3-Owl |
z3-Owl-Final_default |
unknown ❌
|
1200.01000
|
1199.79000
|
| |
|
z3-Owl-Final_default |
unknown ❌
|
1200.02000
|
1199.99000
|
|
SMT-COMP 2024
|
0.33 (4/6) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.34675
|
0.24643
|
| |
cvc5 |
cvc5 |
unsat ✅
|
1.88524
|
1.78569
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
1201.71165
|
1238.56148
|
| |
STP |
STP |
unsat ✅
|
0.33695
|
0.23733
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.28281
|
0.18264
|
| |
Z3alpha |
Z3-alpha |
unknown ❌
|
1201.71533
|
1201.05734
|
|
SMT-COMP 2025
|
0.33 (6/9) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.36702
|
0.25228
|
| |
|
Bitwuzla-MachBV-base |
unsat ✅
|
0.36845
|
0.25113
|
| |
Bitwuzla-MachBV |
Bitwuzla-MachBV |
unsat ✅
|
0.52398
|
0.40198
|
| |
BVDecide |
bv_decide |
unsat ✅
|
4.83591
|
4.70853
|
| |
|
bv_decide-nokernel |
unsat ✅
|
2.72231
|
2.58846
|
| |
cvc5 |
cvc5 |
unsat ✅
|
1.02037
|
0.90373
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
1201.38013
|
1235.79148
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.44011
|
0.31084
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
283.28114
|
1129.81045
|
| |
Z3 |
Z3-alpha-base |
unknown ❌
|
1201.25709
|
1201.00539
|
| |
|
Z3-Owl-base |
unknown ❌
|
1201.27834
|
1201.06186
|
| |
|
z3siri-base |
unknown ❌
|
1201.25194
|
1200.95792
|
| |
Z3-Owl |
Z3-Owl |
unknown ❌
|
1201.75649
|
1200.99469
|