Benchmark

non-incremental/QF_NRA/20200911-Pine/1599121687424286000.smt2 

These benchmarks were generated while developing the tool Pine [1], which uses
CVC4/Z3 to check inductiveness of invariants. The work is described in [2].

[1] https://github.com/izycheva/pine
[2] A.Izycheva, E.Darulova, H.Seidl, SAS'20, "Counterexample- and Simulation-Guided Floating-Point Loop Invariant Synthesis"

 Loop:
   x' := x + 0.01 * (-2*x - 3*y + x*x) + rndx0
   y' := y + 0.01 * (x + y) + rndy0

 Input ranges:
   x in [0.0,0.1]
   y in [0.0,0.1]
   rndx0 in [-3.6e-08,3.6e-08]
   rndy0 in [-3.1e-08,3.1e-08]

 Invariant:
   -0.02*x + -0.08*y + 0.45*x^2 + 1.0*x*y + 0.81*y^2 <= 0.02
 and
   x in [-0.5,0.3]
   y in [-0.2,0.5]

 Query: Loop and Invariant and not Invariant'
Benchmark
Size2311
Compressed Size1008
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2021-07-18
Generated ByAnastasiia Izycheva, Eva Darulova
Generated On2020-09-11 00:00:00
GeneratorPine (using Z3 Python API)
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 2303
Compressed Size1014
Max. Term Depth12
Asserts 12
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and1 =2 let10
/27 +4 -11 *20
<=6 >=8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2021 1.00 (0/10) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1199.91000
cvc5 cvc5-fixed_default unknown ❌ 1200.10000 1200.11000
Par4 Par4-wrapped-sq_default unknown ❌ 1200.04000 2399.76000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 1200.07000 1203.72000
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.12000 4645.30000
YicesQS yices-QS-2021-06-13under10_default unknown ❌ 1200.03000 1199.98000
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.95000
z3-4.8.8_default unknown ❌ 1200.06000 1199.94000
SMT-COMP 2022 0.89 (1/9) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.81000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.92000
NRA-LS NRA-LS-FINAL_default unknown ❌ 1170.03000 1169.87000
Par4 Par4-wrapped-sq_default unknown ❌ 1200.06000 3560.78000
SMT-RAT SMT-RAT-MCSAT_default unsat ✅ 52.94930 52.94780
veriT veriT+raSAT+Redlog_default unknown ❌ 1200.02000 1262.64000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.07000 1199.98000
Z3 z3-4.8.17_default unknown ❌ 1200.04000 1199.82000
Z3++ z3++0715_default unknown ❌ 1200.10000 1200.09000
SMT-COMP 2023 0.86 (1/7) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.57000
NRA-LS cvc5-NRA-LS-sq_default unknown ❌ 1170.03000 1170.02000
Par4 Par4-wrapped-sq_default unknown ❌ 1200.06000 3597.90000
SMT-RAT SMT-RAT-MCSAT_default unsat ✅ 20.10200 20.09700
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1199.89000
Z3alpha z3alpha_default unknown ❌ 1200.05000 1199.99000
Z3++ z3++0715_default unknown ❌ 1200.02000 1199.87000
Z3++_sq_0526_default unknown ❌ 1200.03000 1199.88000
SMT-COMP 2024 0.60 (2/5) cvc5 cvc5 unknown ❌ 1201.72018 1201.09834
SMTInterpol SMTInterpol unknown ❌ 0.45122 0.47092
SMT-RAT SMT-RAT unsat ✅ 11.18739 11.08411
Yices2 Yices2 unsat ✅ 0.50166 0.40198
Z3alpha Z3-alpha unknown ❌ 1201.73890 1200.81817
SMT-COMP 2025 0.50 (3/6) cvc5 cvc5 unsat ✅ 7.66312 7.54412
SMTInterpol SMTInterpol unknown ❌ 0.43316 0.41749
SMT-RAT SMT-RAT unknown ❌ 1201.30321 1201.01957
Yices2 Yices2 unknown ❌ 1201.25000 1201.03982
Z3alpha Z3-alpha unsat ✅ 48.92620 188.89207
Z3 Z3-alpha-base unsat ✅ 15.79320 15.66979
z3siri-base unsat ✅ 15.85771 15.73958