Benchmark

non-incremental/ABV/20230321-UltimateAutomizerSvcomp2023/list-ext_flag.i_85.smt2

Generated by the tool Ultimate Automizer [1,2] which implements
an automata theoretic approach [3] to software verification.

This SMT script belongs to a set of SMT scripts that was generated by
applying Ultimate Automizer to benchmarks [4] from the SV-COMP 2023 [5,6].
This script may not contain all SMT commands that Ultimate Automizer
issued. In order to meet the restrictions for SMT-COMP benchmarks 
we dropped the commands for getting values (resp. models), 
unsatisfiable cores, and interpolants.

2023-03-21, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)

[1] https://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Max Barth, Daniel Dietsch, Leonard Fichtner,
     Jochen Hoenicke, Dominik Klumpp, Mehdi Naouar, Tanja Schindler,
     Frank Schüssele, Andreas Podelski: Ultimate Automizer and the
     CommuHash Normal Form (Competition Contribution). TACAS 2023
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model
     Checking for People Who Love Automata. CAV 2013
[4] https://github.com/sosy-lab/sv-benchmarks
[5] Dirk Beyer: Competition on Software Verification and
     Witness Validation: SV-COMP 2023.  TACAS 2023
[6] https://sv-comp.sosy-lab.org/2023/
Benchmark
Size3161
Compressed Size1183
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByMatthias Heizmann
Generated On2023-03-21 00:00:00
GeneratorUltimate Automizer
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 3153
Compressed Size1187
Max. Term Depth5
Asserts 7
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 =7 forall1 BitVec2
bvadd4 Array1 select7 store1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 0.75 (1/4) Bitwuzla Bitwuzla-fixed_default unknown ❌ 0.01410 0.01185
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.02165 0.02216
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.76831 4.72009
UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.48427 11.83160
Z3 z3-4.8.17_default unknown ❌ 0.03757 0.03931
SMT-COMP 2024 0.33 (2/3) Bitwuzla Bitwuzla unknown ❌ 0.22262 0.12280
cvc5 cvc5 unsat ✅ 0.22873 0.12920
SMTInterpol SMTInterpol unsat ✅ 0.54770 0.68460
SMT-COMP 2025 0.50 (2/4) Bitwuzla Bitwuzla unknown ❌ 0.28252 0.15710
cvc5 cvc5 unsat ✅ 0.29478 0.17297
SMTInterpol SMTInterpol unsat ✅ 0.52481 0.58011
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.87118 3.80304