Benchmark

non-incremental/UF/grasshopper/instantiated/insert_loop_invariant_24_5.smt2 

GRASShopper benchmarks.
  Authors: Ruzica Piskac, Thomas Wies, and Damien Zufferey
  URL: http://cs.nyu.edu/wies/software/grasshopper
  See also: GRASShopper - Complete Heap Verification with Mixed Specifications. In TACAS 2014, pages 124-139.

  If this benchmark is satisfiable, GRASShopper reports the following error message:
  tests/spl/sl/sl_insert.spl:24:5-6:An invariant might not be maintained by a loop in procedure insert
  tests/spl/sl/sl_insert.spl:20:16-69:Related location: This is the loop invariant that might not be maintained
Benchmark
Size9718
Compressed Size1840
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 9710
Compressed Size1849
Max. Term Depth6
Asserts 57
Declared Functions9
Declared Constants24
Declared Sorts 4
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not62 or38 and28 =40
forall24

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.58403 0.57591
CVC4 CVC4 f7118b2 default unsat ✅ 0.05960 0.04999
veriT veriT-smtcomp2014 default unsat ✅ 0.07060 0.06899
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.03297 0.02400
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.33992 0.33895
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.05899 0.05599
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.05927 0.05699
veriT veriT default unsat ✅ 0.06805 0.06699
Z3 z3 4.4.0 default unsat ✅ 0.06485 0.06399
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.08834 0.08860
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.30426 1.31091
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.16625 0.07617
veriT veriT-dev default unsat ✅ 0.06114 0.06143
Z3 z3-4.4.1 default unsat ✅ 0.04979 0.05107
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.06907 0.06893
Vampire vampire4.2-smt vampire unsat ✅ 0.12479 0.16745
veriT veriT-2017-06-17 default unsat ✅ 0.03610 0.03552
Z3 z3-4.5.0 default unsat ✅ 0.07709 0.07612
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.11177 0.11191
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.11388 4.20000
veriT veriT_default unsat ✅ 0.04852 0.04876
Z3 z3-4.7.1_default unsat ✅ 0.06183 0.06172
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.32993 0.32951
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.08582 0.08615
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.09408 0.09437
Par4 Par4-wrapped-sq_default unsat ✅ 0.05183 0.00632
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 1.96194 4.75782
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.25824 3.33754
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.09131 3.36476
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.27426 3.29464
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.43232 0.40734
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.85323 3.14000
veriT veriT-wrapped-sq_default unsat ✅ 0.04523 0.04548
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.06527 0.06527
SMT-COMP 2020 0.14 (6/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.19944 0.20059
CVC4 CVC4-sq-final_default unsat ✅ 0.09085 0.09113
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.09033 0.09064
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 119.96000 133.58200
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.50199 3.53654
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13178 0.12913
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.76596 2.76000
veriT veriT_default unsat ✅ 0.04923 0.04956
veriT+vite_default unsat ✅ 0.05282 0.05316
Z3 z3-4.8.8_default unsat ✅ 0.05574 0.05570
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.08615 0.08648
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.08028 0.08084
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.88910 4.84651
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.11725 0.11770
veriT veriT_default unsat ✅ 0.03208 0.03243
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.06844 0.06839
Z3 z3-4.8.17_default unsat ✅ 0.04387 0.04575
SMT-COMP 2023 0.17 (5/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.10599 0.10661
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.07543 0.07598
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.65010 7.23569
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 41.80050 50.34270
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.81004 9.68917
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.14313 0.13884
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06566 0.06560
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.30636 0.20621
iProver iProver v3.9 unsat ✅ 1.82226 4.71606
SMTInterpol SMTInterpol unsat ✅ 77.92707 88.98705
Yices2 Yices2 unsat ✅ 0.23962 0.13970
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 unsat ✅ 0.36766 0.24213
iProver iProver v3.9.3 unsat ✅ 1.88428 5.21305
SMTInterpol SMTInterpol unsat ✅ 72.75599 82.11481
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94641 4.11217
Yices2 Yices2 unsat ✅ 0.27831 0.15956