Benchmark

non-incremental/QF_NRA/20200911-Pine/1599120911869156000.smt2 

These benchmarks were generated while developing the tool Pine [1], which uses
CVC4/Z3 to check inductiveness of invariants. The work is described in [2].

[1] https://github.com/izycheva/pine
[2] A.Izycheva, E.Darulova, H.Seidl, SAS'20, "Counterexample- and Simulation-Guided Floating-Point Loop Invariant Synthesis"

 Loop:
   x' := x + 0.01 * (-2*x - 3*y + x*x) + rndx0
   y' := y + 0.01 * (x + y) + rndy0

 Input ranges:
   x in [0.0,0.1]
   y in [0.0,0.1]
   rndx0 in [-3.5e-08,3.5e-08]
   rndy0 in [-1.6e-08,1.6e-08]

 Invariant:
   -0.03*x + -0.11*y + 0.46*x^2 + 1.0*x*y + 0.86*y^2 <= 0.02
 and
   x in [-0.5,0.3]
   y in [-0.2,0.4]

 Query: Loop and Invariant and not Invariant'
Benchmark
Size2311
Compressed Size1006
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2021-07-18
Generated ByAnastasiia Izycheva, Eva Darulova
Generated On2020-09-11 00:00:00
GeneratorPine (using Z3 Python API)
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 2303
Compressed Size1017
Max. Term Depth12
Asserts 12
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and1 =2 let10
/27 +4 -11 *20
<=6 >=8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2021 0.70 (3/10) CVC4 CVC4-sq-final_default sat ✅ 20.81310 20.81200
cvc5 cvc5-fixed_default sat ✅ 2.61878 2.61906
Par4 Par4-wrapped-sq_default unknown ❌ 1200.06000 2399.98000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 1200.04000 1203.49000
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4642.85000
YicesQS yices-QS-2021-06-13under10_default sat ✅ 0.07596 0.07601
Z3 z3-4.8.11_default unknown ❌ 1200.03000 1199.92000
z3-4.8.8_default unknown ❌ 1200.06000 1199.92000
SMT-COMP 2022 0.56 (4/9) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.04000 1199.89000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.03000 1199.88000
NRA-LS NRA-LS-FINAL_default unknown ❌ 1170.03000 1169.95000
Par4 Par4-wrapped-sq_default sat ✅ 0.10651 0.00722
SMT-RAT SMT-RAT-MCSAT_default sat ✅ 8.19791 8.19744
veriT veriT+raSAT+Redlog_default unknown ❌ 1200.11000 1291.85000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.03854 0.03846
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1200.07000
Z3++ z3++0715_default sat ✅ 28.63790 28.63970
SMT-COMP 2023 0.43 (4/7) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.11000 1199.50000
NRA-LS cvc5-NRA-LS-sq_default unknown ❌ 1170.03000 1170.00000
Par4 Par4-wrapped-sq_default sat ✅ 0.04974 0.00634
SMT-RAT SMT-RAT-MCSAT_default sat ✅ 47.62170 47.61950
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.03413 0.03411
Z3alpha z3alpha_default unknown ❌ 1200.07000 1200.04000
Z3++ z3++0715_default sat ✅ 28.59380 28.59060
Z3++_sq_0526_default sat ✅ 27.37510 27.37120
SMT-COMP 2024 0.40 (3/5) cvc5 cvc5 sat ✅ 0.25385 0.15431
SMTInterpol SMTInterpol unknown ❌ 0.42653 0.46088
SMT-RAT SMT-RAT unknown ❌ 1201.74288 1201.04140
Yices2 Yices2 sat ✅ 0.44865 0.34886
Z3alpha Z3-alpha sat ✅ 15.27071 15.17084
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 sat ✅ 7.11239 6.99148
SMTInterpol SMTInterpol unknown ❌ 0.41438 0.40101
SMT-RAT SMT-RAT sat ✅ 0.52846 0.40471
Yices2 Yices2 sat ✅ 0.43534 0.31344
Z3alpha Z3-alpha sat ✅ 0.60338 0.49574
Z3 Z3-alpha-base sat ✅ 32.75134 32.61774
z3siri-base sat ✅ 33.41539 33.29552