Benchmark
non-incremental/BV/2017-Preiner-keymaera/binary_driver-2007-10-09-node11384.smt2
These benchmarks used in the paper:
Dejan Jovanovic and Leonardo de Moura. Solving Non-Linear Arithmetic.
In IJCAR 2012, published as LNCS volume 7364, pp. 339--354.
The keymaera family contains VCs from Keymaera verification, see:
A. Platzer, J.-D. Quesel, and P. Rummer. Real world verification.
In CADE 2009, pages 485-501. Springer, 2009.
Submitted by Dejan Jovanovic for SMT-LIB.
KeYmaera example: binary_driver-2007-10-09, node 11384 For more info see: No further information available.
Translated to BV by Mathias Preiner.
| Benchmark |
|---|
| Size | 2495 |
| Compressed Size | 863 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2017-07-23 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 2487 |
| Compressed Size | 867 |
| Max. Term Depth | 21 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 15 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
not | 1 |
and | 14 |
=> | 2 |
= | 1 |
exists | 1 |
let | 1 |
BitVec | 1 |
bvneg | 1 |
bvadd | 2 |
bvmul | 9 |
bvsub | 4 |
bvsle | 5 |
bvsgt | 3 |
bvsge | 8 |
| | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
0.25 (3/4) |
Boolector |
Boolector SMT17 final boolector |
unsat ✅
|
1.91270
|
1.91469
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
316.61300
|
304.44200
|
| |
Q3B |
Q3B default |
unknown ❌
|
600.02200
|
1199.82000
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
0.43759
|
0.43565
|
|
SMT-COMP 2018
|
0.25 (3/4) |
Boolector |
Boolector_default |
unsat ✅
|
0.05949
|
0.06183
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.29146
|
0.29163
|
| |
Q3B |
Q3B_default |
unknown ❌
|
1200.04000
|
3598.95000
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
0.50395
|
0.50355
|
|
SMT-COMP 2019
|
0.17 (5/6) |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.10251
|
0.10545
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.27380
|
0.15690
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unsat ✅
|
0.31077
|
0.31112
|
| |
|
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.30852
|
0.30882
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.06584
|
0.00578
|
| |
Q3B |
Q3B-wrapped-sq_default |
unsat ✅
|
0.61377
|
1.72822
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default |
unknown ❌
|
3.15216
|
4.45745
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
0.26765
|
0.26764
|
|
SMT-COMP 2020
|
0.20 (4/5) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.16955
|
0.23636
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
0.34672
|
0.34698
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.06731
|
0.00649
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.3_s_default |
unknown ❌
|
7.80087
|
3.57260
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
0.35835
|
0.35829
|
|
SMT-COMP 2021
|
0.25 (3/4) |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.06915
|
0.00621
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.6_default |
unknown ❌
|
3.72806
|
5.85146
|
| |
YicesQS |
yices-QS-2021-06-13under10_default |
unsat ✅
|
0.03238
|
0.03238
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
0.21183
|
0.21169
|
|
SMT-COMP 2022
|
0.25 (6/8) |
Bitwuzla |
Bitwuzla-wrapped_default |
unsat ✅
|
0.25365
|
0.25359
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
0.24817
|
0.24879
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.06774
|
0.00626
|
| |
Q3B |
Q3B_default |
unsat ✅
|
5.97168
|
7.06427
|
| |
Q3B-pBNN |
Q3B-pBDD SMT-COMP 2022 final_default |
unknown ❌
|
1200.05000
|
3596.32000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.7-wrapped_default |
unknown ❌
|
3.33190
|
5.18149
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.03199
|
0.03202
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
0.23324
|
0.23504
|
|
SMT-COMP 2024
|
0.20 (4/5) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.68015
|
0.58032
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.41528
|
0.31565
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
0.59038
|
0.95057
|
| |
YicesQS |
YicesQS |
unsat ✅
|
0.61732
|
0.51753
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
0.61709
|
0.51681
|