Benchmark
non-incremental/NRA/keymaera/controllability-lemma-node1346.smt2
These benchmarks used in the paper:
Dejan Jovanovic and Leonardo de Moura. Solving Non-Linear Arithmetic.
In IJCAR 2012, published as LNCS volume 7364, pp. 339--354.
The keymaera family contains VCs from Keymaera verification, see:
A. Platzer, J.-D. Quesel, and P. Rummer. Real world verification.
In CADE 2009, pages 485-501. Springer, 2009.
Submitted by Dejan Jovanovic for SMT-LIB.
KeYmaera example: controllability-lemma, node 1346 For more info see: @see "Andre Platzer and Jan-David Quesel. European Train Control System: A case study in formal verification. In Karin Breitman and Ana Cavalcanti, editors, 11th International Conference on Formal Engineering Methods, ICFEM, Rio de Janeiro, Brasil, Proceedings, volume 5885 of LNCS, pages 246-265. Springer, 2009."
| Benchmark |
|---|
| Size | 1570 |
| Compressed Size | 836 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2014-07-21 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 1562 |
| Compressed Size | 840 |
| Max. Term Depth | 18 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 7 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
not | 1 |
and | 5 |
=> | 5 |
forall | 1 |
exists | 1 |
let | 1 |
Real | 2 |
/ | 1 |
+ | 4 |
- | 3 |
* | 13 |
<= | 5 |
> | 1 |
>= | 5 |
| | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2014
|
1.00 (0/3) |
CVC3 |
CVC3 default |
unknown ❌
|
0.01635
|
0.00800
|
| |
CVC4 |
CVC4 f7118b2 default |
unknown ❌
|
2399.12000
|
2400.08000
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default |
unknown ❌
|
0.03662
|
0.02899
|
|
SMT-COMP 2015
|
1.00 (0/3) |
CVC3 |
CVC3 default |
unknown ❌
|
0.00858
|
0.00800
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
unknown ❌
|
2400.01000
|
2401.01000
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
unknown ❌
|
180.12700
|
180.15300
|
| |
Z3 |
z3 4.4.0 default |
unknown ❌
|
0.04648
|
0.04599
|
|
SMT-COMP 2016
|
1.00 (0/3) |
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
unknown ❌
|
0.03981
|
0.04031
|
| |
Vampire |
vampire_smt_4.1 vampire_smtcomp |
unknown ❌
|
999.93000
|
1004.30000
|
| |
|
vampire_smt_4.1_parallel vampire_smtcomp |
unknown ❌
|
1007.22000
|
3973.79000
|
| |
Z3 |
z3-4.4.1 default |
unknown ❌
|
0.05207
|
0.05329
|
|
SMT-COMP 2017
|
0.40 (3/5) |
CVC4 |
CVC4-smtcomp2017-main default |
unknown ❌
|
600.09400
|
598.88500
|
| |
Redlog |
Redlog default |
unsat ✅
|
0.15680
|
0.15761
|
| |
Vampire |
vampire4.2-smt vampire |
unknown ❌
|
600.04600
|
2383.48000
|
| |
veriT |
veriT+Redlog_20170618 default |
unsat ✅
|
0.17398
|
0.17626
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
0.04706
|
0.04606
|
|
SMT-COMP 2018
|
0.67 (1/3) |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unknown ❌
|
1200.02000
|
1196.74000
|
| |
Vampire |
vampire-4.3-smt_vampire_smtcomp |
unknown ❌
|
1200.07000
|
4774.76000
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
0.03893
|
0.03883
|
|
SMT-COMP 2019
|
0.60 (2/5) |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unknown ❌
|
2400.06000
|
2354.98000
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.04563
|
0.00599
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default |
unknown ❌
|
2.37355
|
3.43923
|
| |
|
UltimateEliminator+Yices-2.6.1-wrapped-sq_default |
unknown ❌
|
2.35690
|
3.36484
|
| |
Vampire |
vampire-4.4-smtcomp-wrapped-sq_default |
unknown ❌
|
2400.06000
|
9259.14000
|
| |
|
vampire-4.3-smt_vampire_smtcomp |
unknown ❌
|
2400.07000
|
9537.77000
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
0.04144
|
0.04145
|
| |
|
z3-4.7.1_default |
unsat ✅
|
0.03906
|
0.03896
|
|
SMT-COMP 2020
|
0.60 (2/5) |
CVC4 |
CVC4-sq-final_default |
unknown ❌
|
1200.03000
|
1196.90000
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.04844
|
0.00628
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.3_s_default |
unknown ❌
|
2.44929
|
3.47742
|
| |
Vampire |
vampire_smt_4.5_vampire_smtcomp |
unknown ❌
|
1200.04000
|
4527.14000
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
0.04259
|
0.04256
|
|
SMT-COMP 2021
|
0.57 (3/7) |
CVC4 |
CVC4-sq-final_default |
unknown ❌
|
1200.03000
|
1196.87000
|
| |
cvc5 |
cvc5-fixed_default |
unknown ❌
|
1200.02000
|
1199.26000
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.05571
|
0.00634
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.6_default |
unknown ❌
|
2.93869
|
4.85541
|
| |
Vampire |
vampire_smt_4.6-fixed_vampire_smtcomp |
unknown ❌
|
1200.03000
|
4656.70000
|
| |
YicesQS |
yices-QS-2021-06-13under10_default |
unsat ✅
|
0.08724
|
0.08726
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
0.02853
|
0.02848
|
| |
|
z3-4.8.8_default |
unsat ✅
|
0.03934
|
0.03928
|
|
SMT-COMP 2022
|
0.60 (2/5) |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unknown ❌
|
1200.05000
|
1198.98000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.7-wrapped_default |
unknown ❌
|
2.83058
|
4.94826
|
| |
Vampire |
vampire_4.7_smt_fix-wrapped_vampire_smtcomp |
unknown ❌
|
1200.06000
|
4790.35000
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.05176
|
0.05176
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
0.02082
|
0.02264
|
| |
|
z3-4.8.11_default |
unsat ✅
|
0.02332
|
0.02329
|
|
SMT-COMP 2023
|
0.67 (2/6) |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unknown ❌
|
1200.02000
|
1199.89000
|
| |
iProver |
iProver-3.8-fix_iprover_SMT |
unknown ❌
|
1200.04000
|
4749.91000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.9_default |
unknown ❌
|
2.92469
|
5.19137
|
| |
Vampire |
vampire_4.8_smt_pre_vampire_smtcomp |
unknown ❌
|
1200.10000
|
4763.76000
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.05175
|
0.05179
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
0.01949
|
0.01943
|
|
SMT-COMP 2024
|
0.40 (3/5) |
cvc5 |
cvc5 |
unknown ❌
|
1201.71213
|
1200.68158
|
| |
iProver |
iProver v3.9 |
unsat ✅
|
540.39498
|
2137.39984
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
0.45469
|
0.59846
|
| |
SMT-RAT |
SMT-RAT |
unsat ✅
|
0.22400
|
0.12416
|
| |
YicesQS |
YicesQS |
unsat ✅
|
0.25549
|
0.15600
|
|
SMT-COMP 2025
|
0.50 (4/8) |
cvc5 |
cvc5 |
unknown ❌
|
1201.76835
|
1200.99616
|
| |
iProver |
iProver v3.9.3 |
unknown ❌
|
1201.77047
|
4776.29626
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
0.56058
|
0.72395
|
| |
SMT-RAT |
SMT-RAT |
unsat ✅
|
0.27113
|
0.14667
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT |
unknown ❌
|
2.09078
|
4.64507
|
| |
YicesQS |
YicesQS |
unsat ✅
|
0.31161
|
0.18316
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
0.40974
|
0.35412
|
| |
Z3 |
Z3-alpha-base |
unsat ✅
|
0.32190
|
0.19148
|