Benchmark

non-incremental/UFNIA/vcc-havoc/vccp-array2.c.2.bar.smt2

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size17942
Compressed Size3437
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 17934
Compressed Size3450
Max. Term Depth57
Asserts 3
Declared Functions59
Declared Constants27
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 not232 or65 =>50
=231 distinct2 forall77 exists6
let21 Int178 +6 -1
*1 <9 <=9 >3
>=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 CVC3 CVC3 2.0 unsat ✅ 0.10000
CVC3 2.3 unsat ✅ 0.10000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.07178
CVC3-SMT-COMP-2011 default unsat ✅ 0.06891
CVC3-SMT-COMP-2012 default unsat ✅ 0.06793
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.12840
Z3-SMT-COMP-2011 default unsat ✅ 0.11181
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.09575 0.08699
CVC4 CVC4 f7118b2 default unsat ✅ 0.23082 0.21697
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.14154 0.13298
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.06699 0.06599
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07723 0.07399
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07618 0.07299
Z3 z3 4.4.0 default unsat ✅ 0.08417 0.08399
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.09305 0.09329
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 994.30900 1000.28000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1009.16000 3390.94000
Z3 z3-4.4.1 default unsat ✅ 0.08220 0.08350
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.11632 0.11523
Vampire vampire4.2-smt vampire unsat ✅ 20.41320 80.99000
Z3 z3-4.5.0 default unsat ✅ 0.09774 0.09693
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.12873 0.12895
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.03000 4774.34000
Z3 z3-4.7.1_default unsat ✅ 0.07611 0.07603
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.30065 0.30274
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.09820 0.09847
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.10277 0.10309
Par4 Par4-wrapped-sq_default unsat ✅ 0.08014 0.00599
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.76457 3.99825
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.54684 3.89975
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.08000 9521.55000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.06000 9517.80000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07614 0.07615
z3-4.7.1_default unsat ✅ 0.07307 0.07301
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.25290 0.25259
CVC4 CVC4-sq-final_default unsat ✅ 0.13026 0.13059
Par4 Par4-wrapped-sq_default unsat ✅ 0.08631 0.00761
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.43434 4.12192
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 182.49000 693.75000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4754.33000
Z3 z3-4.8.8_default unsat ✅ 0.06863 0.06857
SMT-COMP 2022 0.40 (3/5) CVC4 CVC4-sq-final_default unsat ✅ 469.95100 369.23900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.51643 0.51699
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.74241 8.37453
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.06000 4784.75000
Z3 z3-4.8.17_default unsat ✅ 0.09313 0.09495
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.34334 0.24380
iProver iProver v3.9 unknown ❌ 1201.72195 4755.05624
SMTInterpol SMTInterpol unknown ❌ 1202.74540 1485.57331
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.39950 0.27519
iProver iProver v3.9.3 unknown ❌ 1201.81920 4770.71291
SMTInterpol SMTInterpol unknown ❌ 1201.87146 2600.93801
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 3.01893 7.86948