Benchmark

non-incremental/UFNIA/vcc-havoc/baby.2.11.handle_illegal.smt2 

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size171229
Compressed Size17270
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 171221
Compressed Size17365
Max. Term Depth128
Asserts 3
Declared Functions249
Declared Constants114
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true36 false2 ite15 not3005
or577 =>688 =840 distinct2
forall922 exists2 let127 Int1564
+48 -217 *83 <605
<=821 >4 >=12 repeat1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1324.12000 —
CVC3-SMT-COMP-2011 default unknown ❌ 0.44305 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.17484 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.23233 —
Z3-SMT-COMP-2011 default unsat ✅ 0.20034 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.15573 0.14798
CVC4 CVC4 f7118b2 default unsat ✅ 153.36200 153.30400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.21712 0.20597
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.15585 0.15498
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.04317 1.04084
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.04794 1.04484
Z3 z3 4.4.0 default unsat ✅ 0.21940 0.21896
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.54148 1.54246
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.26054 0.26181
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.27048 0.27122
Z3 z3-4.4.1 default unsat ✅ 0.24341 0.24474
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.90053 1.89935
Vampire vampire4.2-smt vampire unsat ✅ 0.19992 0.20027
Z3 z3-4.5.0 default unsat ✅ 0.23993 0.23923
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.54404 1.54427
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.39371 0.29581
Z3 z3-4.7.1_default unsat ✅ 0.23344 0.23131
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 14.58180 57.66000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.86512 1.86532
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 2.28213 2.27117
Par4 Par4-wrapped-sq_default unsat ✅ 0.23571 0.00564
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.43377 3.90133
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.49190 3.87664
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.42547 5.12000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.23386 0.30443
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.24479 0.24477
z3-4.7.1_default unsat ✅ 0.22962 0.22957
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 10.09490 39.76000
CVC4 CVC4-sq-final_default unsat ✅ 2.06389 2.06412
Par4 Par4-wrapped-sq_default unsat ✅ 0.25123 0.00622
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.56776 4.13602
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.29470 0.26512
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.28646 0.29763
Z3 z3-4.8.8_default unsat ✅ 0.24563 0.24555
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 1.81860 1.81876
cvc5 cvc5-fixed_default unsat ✅ 34.75300 33.18950
Par4 Par4-wrapped-sq_default unsat ✅ 0.23816 0.00623
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.51960 1.12179
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 1200.12000 1247.45000
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.48144 0.47722
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.18958 0.19092
Z3 z3-4.8.11_default unsat ✅ 0.23768 0.23762
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 1.47398 1.47422
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 53.81190 53.62010
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.46817 6.07059
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.25255 0.25487
Z3 z3-4.8.17_default unsat ✅ 0.25323 0.25502
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 34.11225 33.98350
iProver iProver v3.9 unsat ✅ 4.37116 15.78299
SMTInterpol SMTInterpol unknown ❌ 1201.74541 1330.02138
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 26.28982 26.17065
iProver iProver v3.9.3 unsat ✅ 2.89122 9.87139
SMTInterpol SMTInterpol unknown ❌ 1201.48899 1733.51800
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.32293 5.30757