Benchmark

non-incremental/QF_NRA/20200911-Pine/1599122159700397000.smt2

These benchmarks were generated while developing the tool Pine [1], which uses
CVC4/Z3 to check inductiveness of invariants. The work is described in [2].

[1] https://github.com/izycheva/pine
[2] A.Izycheva, E.Darulova, H.Seidl, SAS'20, "Counterexample- and Simulation-Guided Floating-Point Loop Invariant Synthesis"

 Loop:
   u' := u + 0.01 * v
   v' := v + 0.01 * (-0.5 * v - 9.81 * u)

 Input ranges:
   u in [0.0,0.0]
   v in [2.0,3.0]

 Invariant:
   -0.71*u + 0.03*v + 1.0*u^2 + -0.09*u*v + 0.06*v^2 <= 0.63
 and
   u in [-0.3,1.3]
   v in [-3.1,3.0]

 Query: Loop and Invariant and not Invariant'
Benchmark
Size1901
Compressed Size918
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2021-07-18
Generated ByAnastasiia Izycheva, Eva Darulova
Generated On2020-09-11 00:00:00
GeneratorPine (using Z3 Python API)
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 1893
Compressed Size926
Max. Term Depth15
Asserts 1
Declared Functions0
Declared Constants4
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and6 =2 let7
/20 +10 -10 *20
<=4 >=6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2022 0.11 (8/9) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.05995 0.06041
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.04000 1199.95000
NRA-LS NRA-LS-FINAL_default sat ✅ 0.09022 0.09030
Par4 Par4-wrapped-sq_default sat ✅ 0.02536 0.00612
SMT-RAT SMT-RAT-MCSAT_default sat ✅ 0.03318 0.03317
veriT veriT+raSAT+Redlog_default sat ✅ 0.02940 0.02950
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01836 0.01832
Z3 z3-4.8.17_default sat ✅ 0.02367 0.02557
Z3++ z3++0715_default sat ✅ 0.28951 0.28958
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.02296 0.02338
NRA-LS cvc5-NRA-LS-sq_default sat ✅ 0.04554 0.04530
Par4 Par4-wrapped-sq_default sat ✅ 0.01696 0.00626
SMT-RAT SMT-RAT-MCSAT_default sat ✅ 0.02457 0.02454
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01616 0.01614
Z3alpha z3alpha_default sat ✅ 0.02494 0.02515
Z3++ z3++0715_default sat ✅ 0.28112 0.28118
Z3++_sq_0526_default sat ✅ 0.28998 0.28990
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 sat ✅ 0.25630 0.13936
SMTInterpol SMTInterpol unknown ❌ 0.46848 0.46144
SMT-RAT SMT-RAT sat ✅ 0.29828 0.17197
Yices2 Yices2 sat ✅ 0.28814 0.16787
Z3alpha Z3-alpha sat ✅ 0.60036 0.48587
Z3 Z3-alpha-base sat ✅ 0.29779 0.17627
z3siri-base sat ✅ 0.29908 0.17358