Benchmark

non-incremental/QF_NIA/UltimateAutomizer/linear_sea.ch_true-unreach-call.i_162.smt2

SMT script generated by Ultimate Automizer [1,2].
Ultimate Automizer is an automatic software verification tool that implements
a new automata-theoretic approach [3].

This SMT script belongs to a set of SMT scripts that was generated by applying
Ultimate Automizer to benchmarks from the SV-COMP 2015 [4,5] which are available 
at [6].

This script does _not_ contain all SMT commands that are used by Ultimate 
Automizer while verifying a program. In order to fulfill the restrictions of
the main track at SMT-COMP this script contains only the commands that are
sufficient to reproduce one single satisfiablity check.

2015-04-30, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)


[1] https://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Daniel Dietsch, Jan Leike, Betim Musa, Andreas Podelski:
Ultimate Automizer with Array Interpolation - (Competition Contribution). 
TACAS 2015: 455-457
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model 
Checking for People Who Love Automata. CAV 2013:36-52
[4] Dirk Beyer: Software Verification and Verifiable Witnesses - (Report on 
SV-COMP 2015). TACAS 2015: 401-416
[5] http://sv-comp.sosy-lab.org/2015/
[6] https://svn.sosy-lab.org/software/sv-benchmarks/tags/svcomp15/


Made compatible to SMT-COMP rules by SMTInterpol
Benchmark
Size2255
Compressed Size1010
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2246
Compressed Size1023
Max. Term Depth6
Asserts 3
Declared Functions0
Declared Constants5
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or1 and3 =6
mod6 <3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2015 0.67 (2/6) AProVE AProVE NIA 2014 default unknown ❌ 0.17526 0.22396
CVC3 CVC3 default unknown ❌ 0.00875 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.00949 0.00800
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01022 0.00800
raSAT raSAT default.sh unknown ❌ 2400.01000 2417.67000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.92000
SMT-RAT-NIA-Parallel-final default unknown ❌ 2400.01000 2401.11000
Z3 z3 4.4.0 default unsat ✅ 0.03076 0.03099
SMT-COMP 2016 0.57 (3/7) AProVE AProVE NIA 2014 default unknown ❌ 0.20029 0.25799
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01423 0.01260
ProB ProB competition unknown ❌ 0.77727 0.76698
raSAT raSAT 0.3 default.sh unknown ❌ 0.01139 0.00353
raSAT 0.4 exp - final default.py unknown ❌ 2400.02000 19.02080
SMT-RAT SMT-RAT default unknown ❌ 2400.03000 2400.29000
Yices2 Yices-2.4.2 default unsat ✅ 0.01189 0.00546
Z3 z3-4.4.1 default unsat ✅ 0.02994 0.03093
SMT-COMP 2017 0.40 (3/5) AProVE AProVE NIA 2014 default unknown ❌ 0.21010 0.27477
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01266 0.01156
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.10000 600.02000
Yices2 Yices2-Main default unsat ✅ 0.00801 0.00544
Z3 z3-4.5.0 default unsat ✅ 0.03335 0.03255
SMT-COMP 2018 0.40 (3/5) AProVE AProVE NIA 2014_default unknown ❌ 0.20722 0.27308
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01134 0.01150
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.03000 1199.65000
Yices2 Yices 2.6.0_default unsat ✅ 0.00838 0.00832
Z3 z3-4.7.1_default unsat ✅ 0.03466 0.03461
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default unknown ❌ 0.23208 0.30136
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.01679 0.01712
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.09419 0.09605
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01349 0.01377
MathSAT mathsat-20190601-wrapped-sq_default unsat ✅ 0.01736 0.01738
mathsat-na-20190601-wrapped-sq_default unsat ✅ 0.01733 0.01735
Par4 Par4-wrapped-sq_default unsat ✅ 0.02666 0.00612
ProB ProB-wrapped-sq_default unknown ❌ 1.26818 1.20560
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.08000 2399.92000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00988 0.00909
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03778 0.03784
SMT-COMP 2021 0.33 (4/6) AProVE AProVE NIA 2014_2021 unknown ❌ 0.22947 0.29566
cvc5 cvc5-fixed_default unsat ✅ 0.01881 0.01936
MathSAT mathsat-5.6.6_default unsat ✅ 0.01682 0.01677
Par4 Par4-wrapped-sq_default unsat ✅ 0.01709 0.00632
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.11000 1199.83000
smtrat-SMTCOMP_default unknown ❌ 1200.04000 1146.20000
Z3 z3-4.8.11_default unsat ✅ 0.01690 0.01699
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.02320 0.02374
MathSAT MathSAT-5.6.8_default unsat ✅ 0.03143 0.03103
Par4 Par4-wrapped-sq_default unsat ✅ 0.03928 0.00737
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01374 0.01369
Yices-ismt yices-ismt-0721_default unsat ✅ 0.03560 0.03542
Z3 z3-4.8.17_default unsat ✅ 0.01822 0.02009
Z3++ z3++0715_default unsat ✅ 0.02529 0.02535