Benchmark

non-incremental/ABV/20230321-UltimateAutomizerSvcomp2023/list-ext_flag.i_62.smt2

Generated by the tool Ultimate Automizer [1,2] which implements
an automata theoretic approach [3] to software verification.

This SMT script belongs to a set of SMT scripts that was generated by
applying Ultimate Automizer to benchmarks [4] from the SV-COMP 2023 [5,6].
This script may not contain all SMT commands that Ultimate Automizer
issued. In order to meet the restrictions for SMT-COMP benchmarks 
we dropped the commands for getting values (resp. models), 
unsatisfiable cores, and interpolants.

2023-03-21, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)

[1] https://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Max Barth, Daniel Dietsch, Leonard Fichtner,
     Jochen Hoenicke, Dominik Klumpp, Mehdi Naouar, Tanja Schindler,
     Frank Schüssele, Andreas Podelski: Ultimate Automizer and the
     CommuHash Normal Form (Competition Contribution). TACAS 2023
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model
     Checking for People Who Love Automata. CAV 2013
[4] https://github.com/sosy-lab/sv-benchmarks
[5] Dirk Beyer: Competition on Software Verification and
     Witness Validation: SV-COMP 2023.  TACAS 2023
[6] https://sv-comp.sosy-lab.org/2023/
Benchmark
Size3879
Compressed Size1301
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByMatthias Heizmann
Generated On2023-03-21 00:00:00
GeneratorUltimate Automizer
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 3871
Compressed Size1297
Max. Term Depth12
Asserts 3
Declared Functions0
Declared Constants11
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or1 and2 =8
forall3 BitVec6 bvadd3 Array2
select11 store4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 0.50 (2/4) Bitwuzla Bitwuzla-fixed_default unknown ❌ 0.01318 0.01103
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.02645 0.02694
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.04575 4.87064
UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.61669 13.34290
Z3 z3-4.8.17_default unknown ❌ 0.04184 0.04361
SMT-COMP 2024 0.33 (2/3) Bitwuzla Bitwuzla unknown ❌ 0.22053 0.12085
cvc5 cvc5 unsat ✅ 0.23719 0.13753
SMTInterpol SMTInterpol unsat ✅ 0.60893 0.97442
SMT-COMP 2025 0.50 (2/4) Bitwuzla Bitwuzla unknown ❌ 0.29191 0.16535
cvc5 cvc5 unsat ✅ 0.31220 0.18963
SMTInterpol SMTInterpol unsat ✅ 0.66566 0.87888
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94266 4.19289