Benchmark

non-incremental/UFLIA/grasshopper/uninstantiated/difference_postcondition_of_difference_33_8.smt2 

GRASShopper benchmarks.
  Authors: Ruzica Piskac, Thomas Wies, and Damien Zufferey
  URL: http://cs.nyu.edu/wies/software/grasshopper
  See also: GRASShopper - Complete Heap Verification with Mixed Specifications. In TACAS 2014, pages 124-139.

  If this benchmark is satisfiable, GRASShopper reports the following error message:
  tests/spl/sl_sorted_set/difference.spl:33:8-20:A postcondition of procedure difference might not hold at this return point
  tests/spl/sl_sorted_set/difference.spl:28:10-90:Related location: This is the postcondition that might not hold
Benchmark
Size18599
Compressed Size2720
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 18591
Compressed Size2732
Max. Term Depth6
Asserts 90
Declared Functions18
Declared Constants46
Declared Sorts 6
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not96 or59 and37 =66
forall47 Int15 <6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01801 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.39554 0.38394
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.01000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.04845 0.03999
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00867 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07101 0.06799
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07087 0.06799
veriT veriT default unsat ✅ 0.36334 0.36194
Z3 z3 4.4.0 default unsat ✅ 0.05400 0.05399
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.12459 0.12487
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.49710 2.50902
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.30935 0.16985
veriT veriT-dev default unsat ✅ 0.02929 0.02955
Z3 z3-4.4.1 default unsat ✅ 0.05614 0.05740
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.14281 0.14172
Vampire vampire4.2-smt vampire unsat ✅ 0.15215 0.14861
veriT veriT-2017-06-17 default unsat ✅ 0.16567 0.16579
Z3 z3-4.5.0 default unsat ✅ 0.05591 0.05527
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16986 0.17006
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 235.85100 937.59000
veriT veriT_default unsat ✅ 0.19165 0.19190
Z3 z3-4.7.1_default unsat ✅ 0.07068 0.07061
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1.71080 6.41000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.09858 0.09894
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.11110 0.11138
Par4 Par4-wrapped-sq_default unsat ✅ 0.08783 0.00581
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2415.59000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35793 3.50297
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16202 3.37365
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41156 3.42241
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.57054 0.44384
veriT veriT-wrapped-sq_default unsat ✅ 0.11284 0.11309
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.08422 0.08424
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 2.76239 10.67000
CVC4 CVC4-sq-final_default unsat ✅ 0.14950 0.14982
Par4 Par4-wrapped-sq_default unsat ✅ 0.09670 0.01044
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1226.29000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.32729 3.50509
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.29428 0.16928
veriT veriT_default unsat ✅ 0.17570 0.17597
veriT+vite_default unsat ✅ 0.04560 0.04592
Z3 z3-4.8.8_default unsat ✅ 0.06271 0.06267
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 0.17650 0.17682
cvc5 cvc5-fixed_default unsat ✅ 0.13828 0.13850
Par4 Par4-wrapped-sq_default unsat ✅ 0.07893 0.00666
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 1235.61000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.71776 4.74766
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.39956 0.27431
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.20278 0.14151
veriT veriT_default unsat ✅ 0.02854 0.02890
Z3 z3-4.8.11_default unsat ✅ 0.05106 0.05101
z3-4.8.8_default unsat ✅ 0.06859 0.06851
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.15543 0.15574
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.13306 0.13357
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.93288 4.64336
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.30583 0.24694
veriT veriT_default unsat ✅ 0.02866 0.02900
Z3 z3-4.8.17_default unsat ✅ 0.05176 0.05358
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.19796 0.19850
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.21090 0.21144
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 7.66946 27.87000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1232.40000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.86786 4.79672
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.29448 0.22448
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.28014 0.17994
iProver iProver v3.9 unsat ✅ 23.50839 82.90133
SMTInterpol SMTInterpol unknown ❌ 1201.72236 1251.24030