Benchmark

non-incremental/ABV/20230321-UltimateAutomizerSvcomp2023/list-ext_flag_1.i_79.smt2

Generated by the tool Ultimate Automizer [1,2] which implements
an automata theoretic approach [3] to software verification.

This SMT script belongs to a set of SMT scripts that was generated by
applying Ultimate Automizer to benchmarks [4] from the SV-COMP 2023 [5,6].
This script may not contain all SMT commands that Ultimate Automizer
issued. In order to meet the restrictions for SMT-COMP benchmarks 
we dropped the commands for getting values (resp. models), 
unsatisfiable cores, and interpolants.

2023-03-21, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)

[1] https://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Max Barth, Daniel Dietsch, Leonard Fichtner,
     Jochen Hoenicke, Dominik Klumpp, Mehdi Naouar, Tanja Schindler,
     Frank Schüssele, Andreas Podelski: Ultimate Automizer and the
     CommuHash Normal Form (Competition Contribution). TACAS 2023
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model
     Checking for People Who Love Automata. CAV 2013
[4] https://github.com/sosy-lab/sv-benchmarks
[5] Dirk Beyer: Competition on Software Verification and
     Witness Validation: SV-COMP 2023.  TACAS 2023
[6] https://sv-comp.sosy-lab.org/2023/
Benchmark
Size5462
Compressed Size1456
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByMatthias Heizmann
Generated On2023-03-21 00:00:00
GeneratorUltimate Automizer
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 5454
Compressed Size1449
Max. Term Depth10
Asserts 6
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and2 =11 forall3
let1 BitVec8 bvadd4 Array3
select17 store13

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 0.50 (2/4) Bitwuzla Bitwuzla-fixed_default unknown ❌ 0.01314 0.01310
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.02386 0.02436
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95164 4.83275
UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 5.16550 15.12760
Z3 z3-4.8.17_default unknown ❌ 0.06698 0.06877
SMT-COMP 2024 0.33 (2/3) Bitwuzla Bitwuzla unknown ❌ 0.22312 0.12299
cvc5 cvc5 unsat ✅ 0.23151 0.13202
SMTInterpol SMTInterpol unsat ✅ 0.73512 1.44190
SMT-COMP 2025 0.50 (2/4) Bitwuzla Bitwuzla unknown ❌ 0.29102 0.16398
cvc5 cvc5 unsat ✅ 80.37405 80.24864
SMTInterpol SMTInterpol unsat ✅ 0.69025 1.23645
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.08014 4.42367