Benchmark

non-incremental/UF/grasshopper/uninstantiated/rec_insert_check_heap_access_24_6.smt2

GRASShopper benchmarks.
  Authors: Ruzica Piskac, Thomas Wies, and Damien Zufferey
  URL: http://cs.nyu.edu/wies/software/grasshopper
  See also: GRASShopper - Complete Heap Verification with Mixed Specifications. In TACAS 2014, pages 124-139.

  If this benchmark is satisfiable, GRASShopper reports the following error message:
  tests/spl/sl/rec_insert.spl:24:6-21:Possible heap access through null or dangling reference
Benchmark
Size9695
Compressed Size1907
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 9687
Compressed Size1899
Max. Term Depth9
Asserts 70
Declared Functions11
Declared Constants33
Declared Sorts 4
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not58 or35 and23 =48
forall26

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 31.74530 31.74920
CVC4 CVC4 f7118b2 default unsat ✅ 1.16356 1.15182
veriT veriT-smtcomp2014 default unsat ✅ 0.05523 0.04599
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.43805 0.42993
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 2400.55000 2401.38000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.12179 0.11898
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.12045 0.11798
veriT veriT default unsat ✅ 0.02831 0.02700
Z3 z3 4.4.0 default unsat ✅ 0.10057 0.09998
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.63066 0.63125
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.49028 1.49762
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.51951 0.26616
veriT veriT-dev default unsat ✅ 0.08880 0.08929
Z3 z3-4.4.1 default unsat ✅ 0.20389 0.20522
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.62749 1.62691
Vampire vampire4.2-smt vampire unsat ✅ 0.37349 0.37076
veriT veriT-2017-06-17 default unsat ✅ 0.06820 0.06672
Z3 z3-4.5.0 default unsat ✅ 0.69219 0.69112
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16436 0.16450
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.75974 2.87000
veriT veriT_default unsat ✅ 0.05877 0.05900
Z3 z3-4.7.1_default unsat ✅ 0.92716 0.92711
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 4.94365 19.45000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.23345 0.23337
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.21405 0.21435
Par4 Par4-wrapped-sq_default unsat ✅ 0.05099 0.00569
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2406.17000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.34052 3.41662
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14905 3.32566
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33403 3.40615
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.98983 3.39084
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.27475 4.75000
veriT veriT-wrapped-sq_default unsat ✅ 0.04456 0.04492
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.29061 1.29050
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 1.38554 1.38583
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1.25914 3.79000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1237.81000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.80515 4.98525
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.40701 0.34292
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.28693 0.17327
veriT veriT_default unsat ✅ 0.17496 0.17536
Z3 z3-4.8.11_default unsat ✅ 0.13059 0.13056
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.54779 0.54792
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.22002 0.22063
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.07551 5.04349
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.34554 0.17941
veriT veriT_default unsat ✅ 0.23277 0.23312
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 26.43830 26.43770
Z3 z3-4.8.17_default unsat ✅ 0.16815 0.16990
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.20189 0.20231
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.14449 0.14488
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.15138 3.71917
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 1239.00000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95516 4.60268
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.38717 0.20768
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 35.76190 35.76110
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.38334 0.25485
iProver iProver v3.9.3 unsat ✅ 1.39390 4.08390
SMTInterpol SMTInterpol unknown ❌ 1201.38470 1287.50522
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.88043 3.98626
Yices2 Yices2 unsat ✅ 1.23686 1.11058