Benchmark
non-incremental/BV/2017-Preiner-keymaera/ETCS-essentials-live2.proof-node640.smt2
These benchmarks used in the paper:
Dejan Jovanovic and Leonardo de Moura. Solving Non-Linear Arithmetic.
In IJCAR 2012, published as LNCS volume 7364, pp. 339--354.
The keymaera family contains VCs from Keymaera verification, see:
A. Platzer, J.-D. Quesel, and P. Rummer. Real world verification.
In CADE 2009, pages 485-501. Springer, 2009.
Submitted by Dejan Jovanovic for SMT-LIB.
KeYmaera example: ETCS-essentials-live2.proof, node 640 For more info see: @see "Andre Platzer and Jan-David Quesel. European Train Control System: A case study in formal verification. In Karin Breitman and Ana Cavalcanti, editors, 11th International Conference on Formal Engineering Methods, ICFEM, Rio de Janeiro, Brasil, Proceedings, volume 5885 of LNCS, pages 246-265. Springer, 2009."
Translated to BV by Mathias Preiner.
| Benchmark |
|---|
| Size | 1577 |
| Compressed Size | 840 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2017-07-23 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | sat |
| Inferred Status | sat |
| Size | 1569 |
| Compressed Size | 822 |
| Max. Term Depth | 8 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 7 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
not | 1 |
and | 4 |
=> | 1 |
exists | 1 |
BitVec | 1 |
bvadd | 1 |
bvmul | 2 |
bvsgt | 3 |
bvsge | 3 |
| | | | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
0.50 (2/4) |
Boolector |
Boolector SMT17 final boolector |
sat ✅
|
0.52790
|
1.03754
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unknown ❌
|
600.11500
|
595.91000
|
| |
Q3B |
Q3B default |
unknown ❌
|
0.08819
|
0.09027
|
| |
Z3 |
z3-4.5.0 default |
sat ✅
|
19.27000
|
19.26490
|
|
SMT-COMP 2018
|
0.25 (3/4) |
Boolector |
Boolector_default |
sat ✅
|
0.02004
|
0.03307
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unknown ❌
|
1200.09000
|
1187.38000
|
| |
Q3B |
Q3B_default |
sat ✅
|
0.08793
|
0.22645
|
| |
Z3 |
z3-4.7.1_default |
sat ✅
|
13.17940
|
13.17830
|
|
SMT-COMP 2019
|
0.33 (4/6) |
Boolector |
Boolector-wrapped-sq_default |
sat ✅
|
70.22600
|
139.85300
|
| |
|
Poolector-wrapped-sq_default |
sat ✅
|
113.96700
|
449.95900
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unknown ❌
|
2400.03000
|
2383.69000
|
| |
|
master-2018-06-10-b19c840-competition-default_default |
unknown ❌
|
2400.10000
|
2388.03000
|
| |
Par4 |
Par4-wrapped-sq_default |
sat ✅
|
0.42619
|
0.00740
|
| |
Q3B |
Q3B-wrapped-sq_default |
sat ✅
|
0.06694
|
0.15093
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default |
unknown ❌
|
2.22250
|
3.29083
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
sat ✅
|
8.77513
|
8.77524
|
|
SMT-COMP 2020
|
0.60 (2/5) |
Bitwuzla |
Bitwuzla-fixed_default |
unknown ❌
|
1200.02000
|
2399.34000
|
| |
CVC4 |
CVC4-sq-final_default |
unknown ❌
|
1200.02000
|
1187.85000
|
| |
Par4 |
Par4-wrapped-sq_default |
sat ✅
|
0.87143
|
3.28000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.3_s_default |
unknown ❌
|
2.40415
|
3.35770
|
| |
Z3 |
z3-4.8.8_default |
sat ✅
|
8.43476
|
8.43445
|
|
SMT-COMP 2023
|
0.33 (4/6) |
Bitwuzla |
Bitwuzla-fixed_default |
sat ✅
|
0.79504
|
0.79506
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
sat ✅
|
170.21700
|
161.15200
|
| |
Par4 |
Par4-wrapped-sq_default |
sat ✅
|
13.44280
|
53.05000
|
| |
Q3B |
Q3B_default |
sat ✅
|
0.09958
|
0.20733
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.9_default |
unknown ❌
|
3.04057
|
4.75913
|
| |
|
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
4.33058
|
11.15680
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unknown ❌
|
1200.03000
|
1199.91000
|
|
SMT-COMP 2024
|
0.20 (4/5) |
Bitwuzla |
Bitwuzla |
sat ✅
|
0.29834
|
0.19809
|
| |
cvc5 |
cvc5 |
sat ✅
|
160.33116
|
160.18848
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
0.42611
|
0.48021
|
| |
YicesQS |
YicesQS |
sat ✅
|
7.83893
|
7.71799
|
| |
Z3alpha |
Z3-alpha |
sat ✅
|
6.30615
|
6.20594
|