Benchmark
non-incremental/QF_BV/Sage2/bench_12915.smt2
Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
| Benchmark |
|---|
| Size | 432557 |
| Compressed Size | 37393 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2015-07-02 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 432549 |
| Compressed Size | 37405 |
| Max. Term Depth | 40 |
| Asserts | 1457 |
| Declared Functions | 0 |
| Declared Constants | 337 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 1 |
false | 7 |
ite | 359 |
not | 669 |
= | 1088 |
let | 8369 |
extract | 374 |
bvand | 29 |
bvor | 217 |
bvadd | 2078 |
bvmul | 902 |
bvult | 251 |
bvule | 149 |
bvugt | 15 |
bvuge | 91 |
bvslt | 33 |
bvsle | 6 |
bvsgt | 165 |
bvsge | 24 |
bvshl | 668 |
zero_extend | 2412 |
sign_extend | 295 |
| | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2015
|
|
Boolector |
Boolector SMT15 QF_BV final boolector_qf_bv |
unsat ✅
|
0.05150
|
0.05099
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
unsat ✅
|
1.06337
|
1.93071
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
unsat ✅
|
1.11187
|
2.03069
|
| |
MathSAT |
MathSat 5.3.6 main smtcomp2015_main |
unsat ✅
|
1.66621
|
1.66575
|
| |
SMT-RAT |
SMT-RAT-final default |
unsat ✅
|
831.51300
|
831.71600
|
| |
STP |
stp-cryptominisat4 default |
unsat ✅
|
0.27961
|
0.27896
|
| |
|
stp-cmsat4-v15 default |
unsat ✅
|
0.27506
|
0.27396
|
| |
|
stp-cmsat4-mt-v15 default |
unknown ❌
|
0.27063
|
0.26996
|
| |
|
stp-minisat-v15 default |
unsat ✅
|
0.26655
|
0.26596
|
| |
Yices2 |
Yices default |
unsat ✅
|
0.04025
|
0.03899
|
| |
Z3 |
z3 4.4.0 default |
unsat ✅
|
0.16391
|
0.16397
|
|
SMT-COMP 2016
|
0.10 (9/10) |
ABC |
ABC_default default_abc |
unsat ✅
|
0.87506
|
0.87510
|
| |
|
ABC_glucose glucose |
unsat ✅
|
5.26875
|
5.27215
|
| |
Boolector |
Boolector boolector |
unsat ✅
|
0.04481
|
0.04511
|
| |
|
Boolector preprop boolector |
unsat ✅
|
0.04423
|
0.04453
|
| |
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
unsat ✅
|
1.08104
|
1.96444
|
| |
MapleSTP |
MapleSTP default |
unsat ✅
|
0.27286
|
0.27294
|
| |
|
MapleSTP-mt default |
unsat ✅
|
0.29153
|
0.51522
|
| |
MathSAT |
mathsat-5.3.11-linux-x86_64-Main default |
unsat ✅
|
1.42006
|
1.42183
|
| |
MinkeyRink |
Minkeyrink 2016 default |
unsat ✅
|
0.55020
|
0.72012
|
| |
Q3B |
Q3B default |
unknown ❌
|
2400.03000
|
7203.83000
|
| |
STP |
stp-cms-exp-2016 default |
unsat ✅
|
0.28013
|
0.28027
|
| |
|
stp-cms-mt-2016 default |
unsat ✅
|
0.29684
|
0.52885
|
| |
|
stp-cms-st-2016 default |
unsat ✅
|
0.27819
|
0.27833
|
| |
|
stp-minisat-st-2016 default |
unsat ✅
|
0.25090
|
0.25160
|
| |
Yices2 |
Yices-2.4.2 default |
unsat ✅
|
0.04055
|
0.04090
|
| |
Z3 |
z3-4.4.1 default |
unsat ✅
|
0.15949
|
0.16079
|
|
SMT-COMP 2017
|
|
Boolector |
Boolector+CaDiCaL SMT17 final boolector |
unsat ✅
|
0.04601
|
0.04460
|
| |
|
Boolector SMT17 final boolector |
unsat ✅
|
0.04528
|
0.04456
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
1.08961
|
1.97771
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
1.54604
|
1.54606
|
| |
MinkeyRink |
MinkeyRink 2017.3a default |
unsat ✅
|
0.26410
|
0.23143
|
| |
Q3B |
Q3B default |
unsat ✅
|
0.57432
|
1.44216
|
| |
STP |
stp_st default |
unsat ✅
|
0.28367
|
0.28290
|
| |
|
stp_mt default |
unsat ✅
|
0.29896
|
0.51986
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
0.04068
|
0.03923
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
0.18384
|
0.18379
|
|
SMT-COMP 2018
|
|
Boolector |
Boolector_default |
unsat ✅
|
0.04259
|
0.04255
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.99180
|
0.99185
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unsat ✅
|
1.42053
|
1.42157
|
| |
MinkeyRink |
Minkeyrink MT_mt |
unsat ✅
|
0.23900
|
0.26584
|
| |
|
Minkeyrink ST_st |
unsat ✅
|
0.23349
|
0.23372
|
| |
STP |
STP-CMS-st-2018_default-no-stderr |
unsat ✅
|
0.21634
|
0.21645
|
| |
|
STP-CMS-mt-2018_multicore-no-stderr |
unsat ✅
|
0.22467
|
0.25666
|
| |
|
STP-Riss-st-2018_riss-no-stderr |
unsat ✅
|
0.37359
|
0.37371
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
0.04155
|
0.04146
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
0.17615
|
0.17608
|
|
SMT-COMP 2021
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.05724
|
0.05717
|
| |
MathSAT |
mathsat-5.6.6_default |
unsat ✅
|
0.56697
|
0.56692
|
| |
STP |
STP 2021.0_default |
unsat ✅
|
0.21957
|
0.24073
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
0.16142
|
0.16135
|
|
SMT-COMP 2022
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.05779
|
0.05772
|
| |
|
Bitwuzla-wrapped_default |
unsat ✅
|
0.06082
|
0.06078
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
1.13125
|
1.12981
|
| |
MathSAT |
MathSAT-5.6.8_default |
unsat ✅
|
0.65723
|
0.65716
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.29788
|
0.29787
|
| |
Yices2 |
Yices 2.6.2 for SMTCOMP 2021_default |
unsat ✅
|
0.05670
|
0.05667
|
| |
Z3++BV |
z3++bv_0702_default |
unsat ✅
|
0.22354
|
0.22349
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
0.16709
|
0.16889
|
|
SMT-COMP 2023
|
0.17 (5/6) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.44145
|
0.44138
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
0.97911
|
0.97415
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.31246
|
0.31237
|
| |
|
STP 2022.4_default |
unsat ✅
|
0.31146
|
0.31146
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
1200.02000
|
1258.55000
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
unsat ✅
|
0.04735
|
0.04732
|
| |
Z3-Owl |
z3-Owl-Final_default |
unsat ✅
|
0.89020
|
0.89020
|
| |
|
z3-Owl-Final_default |
unsat ✅
|
0.89489
|
0.89511
|