Benchmark

non-incremental/ALIA/20230321-UltimateAutomizerSvcomp2023/skiplist_3lvl.i_105.smt2

Generated by the tool Ultimate Automizer [1,2] which implements
an automata theoretic approach [3] to software verification.

This SMT script belongs to a set of SMT scripts that was generated by
applying Ultimate Automizer to benchmarks [4] from the SV-COMP 2023 [5,6].
This script may not contain all SMT commands that Ultimate Automizer
issued. In order to meet the restrictions for SMT-COMP benchmarks 
we dropped the commands for getting values (resp. models), 
unsatisfiable cores, and interpolants.

2023-03-21, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)

[1] https://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Max Barth, Daniel Dietsch, Leonard Fichtner,
     Jochen Hoenicke, Dominik Klumpp, Mehdi Naouar, Tanja Schindler,
     Frank Schüssele, Andreas Podelski: Ultimate Automizer and the
     CommuHash Normal Form (Competition Contribution). TACAS 2023
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model
     Checking for People Who Love Automata. CAV 2013
[4] https://github.com/sosy-lab/sv-benchmarks
[5] Dirk Beyer: Competition on Software Verification and
     Witness Validation: SV-COMP 2023.  TACAS 2023
[6] https://sv-comp.sosy-lab.org/2023/
Benchmark
Size11368
Compressed Size1854
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 11360
Compressed Size1898
Max. Term Depth19
Asserts 11
Declared Functions0
Declared Constants7
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not13 or9 and1 =32
forall8 let50 Int49 +24
Array16 select100 store40

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.38000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.01000 1199.50000
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 3.67162 12.72230
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 0.97496 2.50228
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.71161 4.88954
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.10620 0.22137
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unknown ❌ 1201.74960 1201.06151
iProver iProver v3.9 unsat ✅ 2.92932 8.46689
SMTInterpol SMTInterpol unknown ❌ 1.05059 2.49771
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unknown ❌ 1201.79689 1200.99883
iProver iProver v3.9.3 unsat ✅ 52.54329 197.33166
SMTInterpol SMTInterpol unknown ❌ 0.77557 1.59008
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01867 4.28758