Benchmark
non-incremental/BV/2017-Preiner-keymaera/vsli-alert.proof-node2416.smt2
These benchmarks used in the paper:
Dejan Jovanovic and Leonardo de Moura. Solving Non-Linear Arithmetic.
In IJCAR 2012, published as LNCS volume 7364, pp. 339--354.
The keymaera family contains VCs from Keymaera verification, see:
A. Platzer, J.-D. Quesel, and P. Rummer. Real world verification.
In CADE 2009, pages 485-501. Springer, 2009.
Submitted by Dejan Jovanovic for SMT-LIB.
KeYmaera example: vsli-alert.proof, node 2416 For more info see: No further information available.
Translated to BV by Mathias Preiner.
| Benchmark |
|---|
| Size | 2778 |
| Compressed Size | 936 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2017-07-23 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 2770 |
| Compressed Size | 937 |
| Max. Term Depth | 26 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 14 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
not | 1 |
and | 15 |
=> | 2 |
= | 1 |
exists | 1 |
let | 2 |
BitVec | 1 |
bvneg | 1 |
bvadd | 9 |
bvmul | 12 |
bvsub | 3 |
bvsdiv | 5 |
bvslt | 1 |
bvsle | 4 |
bvsgt | 4 |
bvsge | 8 |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
0.25 (3/4) |
Boolector |
Boolector SMT17 final boolector |
unsat ✅
|
3.58799
|
3.59203
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
340.01200
|
334.77100
|
| |
Q3B |
Q3B default |
unknown ❌
|
600.05300
|
1199.71000
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
3.31155
|
3.31046
|
|
SMT-COMP 2018
|
|
Boolector |
Boolector_default |
unsat ✅
|
0.15261
|
0.15954
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
1.89718
|
1.89730
|
| |
Q3B |
Q3B_default |
unsat ✅
|
0.94051
|
2.75735
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
2.21077
|
2.21036
|
|
SMT-COMP 2019
|
0.33 (4/6) |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.55814
|
0.56240
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.78785
|
2.73981
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unsat ✅
|
1.70736
|
1.70752
|
| |
|
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
2.44075
|
2.44084
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.15817
|
0.00637
|
| |
Q3B |
Q3B-wrapped-sq_default |
unknown ❌
|
2400.05000
|
7197.74000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default |
unknown ❌
|
2.39273
|
3.37663
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
1.07061
|
1.07066
|
|
SMT-COMP 2021
|
0.25 (3/4) |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.16530
|
0.00817
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.6_default |
unknown ❌
|
13.17060
|
14.61240
|
| |
YicesQS |
yices-QS-2021-06-13under10_default |
unsat ✅
|
0.05191
|
0.05192
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
0.96659
|
0.96657
|
|
SMT-COMP 2022
|
0.25 (6/8) |
Bitwuzla |
Bitwuzla-wrapped_default |
unsat ✅
|
14.67770
|
14.67230
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
1.31506
|
1.31557
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.18985
|
0.00862
|
| |
Q3B |
Q3B_default |
unsat ✅
|
1.03134
|
2.81856
|
| |
Q3B-pBNN |
Q3B-pBDD SMT-COMP 2022 final_default |
unknown ❌
|
1200.02000
|
3598.27000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.7-wrapped_default |
unknown ❌
|
7.37681
|
9.74943
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.05105
|
0.05109
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
2.28184
|
2.28360
|
|
SMT-COMP 2023
|
0.33 (4/6) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
1.18543
|
2.25545
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
1.50206
|
1.50149
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.20002
|
0.01135
|
| |
Q3B |
Q3B_default |
unknown ❌
|
1200.04000
|
3598.73000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.9_default |
unknown ❌
|
7.24774
|
9.48099
|
| |
|
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
4.49067
|
12.27640
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.14020
|
0.14021
|
|
SMT-COMP 2024
|
0.20 (4/5) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
3.04568
|
2.92831
|
| |
cvc5 |
cvc5 |
unsat ✅
|
2.56072
|
2.45923
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
1.14213
|
3.01429
|
| |
YicesQS |
YicesQS |
unsat ✅
|
0.34050
|
0.23004
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
2.02940
|
1.92986
|