Benchmark

non-incremental/NIA/20190429-UltimateAutomizerSvcomp2019/verisec_sendmail__tTflag_arr_one_loop_false-unreach-call_true-termination.i_7.smt2

|
Generated by the tool Ultimate Automizer [1,2] which implements
an automata theoretic approach [3] to software verification.

This SMT script belongs to a set of SMT scripts that was generated by
applying Ultimate Automizer to benchmarks [4] from the SV-COMP 2019 [5,6].
This script might _not_ contain all SMT commands that are used by
Ultimate Automizer. In order to satisfy the restrictions of
the SMT-COMP we have to drop e.g., the commands for getting
values (resp. models), unsatisfiable cores and interpolants.

2019-04-27, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)

[1] https://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Yu-Fang Chen, Daniel Dietsch, Marius Greitschus,
     Jochen Hoenicke, Yong Li, Alexander Nutz, Betim Musa, Christian
     Schilling, Tanja Schindler, Andreas Podelski: Ultimate Automizer
     and the Search for Perfect Interpolants - (Competition Contribution).
     TACAS (2) 2018: 447-451
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model
     Checking for People Who Love Automata. CAV 2013:36-52
[4] https://github.com/sosy-lab/sv-benchmarks
[5] Dirk Beyer: Automatic Verification of C and Java Programs: SV-COMP 2019.
     TACAS (3) 2019: 133-155
[6] https://sv-comp.sosy-lab.org/2019/
|
Benchmark
Size3844
Compressed Size1332
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2020-07-06
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 3836
Compressed Size1323
Max. Term Depth13
Asserts 7
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or7 forall4 let15
Int8 mod33 +15 *15
<32 <=7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2022 0.20 (4/5) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 307.71500 304.83500
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 1200.11000 1206.53000
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.17431 4.15578
YicesQS yicesQS-2022-07-02-optim-under10_default unsat ✅ 6.73389 6.73341
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.83000
z3-4.8.11_default unsat ✅ 0.94500 0.94380
SMT-COMP 2023 0.29 (5/7) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 304.18000 301.82900
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.65419 1.62000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 1200.04000 1207.74000
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.76419 2.63848
YicesQS yicesQS-2022-07-02-optim-under10_default unsat ✅ 4.35312 4.35268
Z3 z3-4.8.11_default unsat ✅ 0.04236 0.04233
SMT-COMP 2024 0.20 (4/5) Amaya Amaya unsat ✅ 3.58725 3.48474
cvc5 cvc5 unsat ✅ 0.22336 0.12366
iProver iProver v3.9 unsat ✅ 11.40831 40.95849
SMTInterpol SMTInterpol unknown ❌ 0.75594 1.65336
YicesQS YicesQS unsat ✅ 1.70629 1.60604
SMT-COMP 2025 0.38 (5/8) Amaya Amaya unsat ✅ 3.67184 3.54705
cvc5 cvc5 unsat ✅ 0.28999 0.16233
iProver iProver v3.9.3 unsat ✅ 6.38774 21.33228
SMTInterpol SMTInterpol unknown ❌ 3.69256 8.59178
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1201.78870 1207.78464
YicesQS YicesQS unsat ✅ 2.90410 2.78132
Z3alpha Z3-alpha unsat ✅ 0.36471 0.25767
Z3 Z3-alpha-base unknown ❌ 1201.33493 1201.02846