Benchmark

non-incremental/UFLIA/grasshopper/instantiated/merge_loop_invariant_61_3.smt2 

GRASShopper benchmarks.
  Authors: Ruzica Piskac, Thomas Wies, and Damien Zufferey
  URL: http://cs.nyu.edu/wies/software/grasshopper
  See also: GRASShopper - Complete Heap Verification with Mixed Specifications. In TACAS 2014, pages 124-139.

  If this benchmark is satisfiable, GRASShopper reports the following error message:
  tests/spl/sls/sls_merge_sort.spl:61:3-4:An invariant might not be maintained by a loop in procedure merge
  tests/spl/sls/sls_merge_sort.spl:47:15:Related location: This is the loop invariant that might not be maintained
Benchmark
Size39609
Compressed Size4225
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 39601
Compressed Size4240
Max. Term Depth10
Asserts 168
Declared Functions13
Declared Constants66
Declared Sorts 6
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not234 or169 and111 =174
forall82 <=24 >2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01693 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 29.27310 29.25760
veriT veriT-smtcomp2014 default unsat ✅ 10.64380 10.63940
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.71572 1.70774
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00855 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 252.50800 252.46900
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 252.44800 252.46800
veriT veriT default unsat ✅ 1.23715 1.23681
Z3 z3 4.4.0 default unsat ✅ 0.86542 0.86587
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 34.00060 47.85990
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 127.48300 128.05700
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 21.38850 84.70000
veriT veriT-dev default unsat ✅ 2.30612 2.30768
Z3 z3-4.4.1 default unsat ✅ 2.91740 2.92058
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 76.00130 75.97110
Vampire vampire4.2-smt vampire unknown ❌ 600.06300 2334.96000
veriT veriT-2017-06-17 default unsat ✅ 2.36049 2.35903
Z3 z3-4.5.0 default unsat ✅ 1.71608 1.71489
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 850.13000 846.78500
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 298.50100 1186.61000
veriT veriT_default unsat ✅ 2.06006 2.06024
Z3 z3-4.7.1_default unsat ✅ 0.93468 0.93458
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 674.04800 2672.81000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 165.38000 165.35500
master-2018-06-10-b19c840-competition-default_default unsat ✅ 442.74200 441.46000
Par4 Par4-wrapped-sq_default unsat ✅ 2.57328 7.49000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2499.96000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.25834 3.35023
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18578 3.38189
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41655 3.28642
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 479.75000 1905.35000
veriT veriT-wrapped-sq_default unsat ✅ 2.49486 2.49491
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 5.54397 5.54352
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 16.68950 16.67880
cvc5 cvc5-fixed_default unsat ✅ 11.23460 11.23460
Par4 Par4-wrapped-sq_default unsat ✅ 1.42575 3.99000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.12000 1224.57000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.87763 4.95117
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 428.81800 1674.82000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 436.99500 1712.14000
veriT veriT_default unsat ✅ 1.44300 1.44323
Z3 z3-4.8.11_default unsat ✅ 0.54940 0.54938
z3-4.8.8_default unsat ✅ 0.87271 0.87265
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 38.35040 38.34970
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 89.38270 89.37950
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.81143 4.99119
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 456.18400 1806.05000
veriT veriT_default unsat ✅ 1.84177 1.84208
Z3 z3-4.8.17_default unsat ✅ 1.03263 1.03443
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 149.18500 148.38500
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 59.15120 59.12170
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.12000 4746.17000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1250.17000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.90314 4.73316
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 462.57700 1836.05000
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 14.81705 14.70246
iProver iProver v3.9.3 unknown ❌ 1201.76879 4761.36110
SMTInterpol SMTInterpol unknown ❌ 1201.48720 1328.16726
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.97172 4.24981