Benchmark

non-incremental/UFNIA/vcc-havoc/baby.37.pptea.smt2

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size165879
Compressed Size16388
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 165871
Compressed Size16478
Max. Term Depth97
Asserts 3
Declared Functions249
Declared Constants69
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true29 false2 ite12 not2983
or573 =>612 =788 distinct2
forall915 exists2 let125 Int1557
+46 -217 *80 <599
<=804 >4 >=10 repeat1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.32447
CVC3-SMT-COMP-2011 default unknown ❌ 0.14558
CVC3-SMT-COMP-2012 default unknown ❌ 0.15768
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.20899
Z3-SMT-COMP-2011 default unsat ✅ 0.20264
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.15703 0.15698
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.84199 0.83987
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.79416 0.79188
Z3 z3 4.4.0 default unsat ✅ 0.22590 0.22596
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 33.00450 32.73400
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.25427 0.28888
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.23451 0.23355
Z3 z3-4.4.1 default unsat ✅ 0.19875 0.20015
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 44.23680 41.94060
Vampire vampire4.2-smt vampire unsat ✅ 0.19541 0.19424
Z3 z3-4.5.0 default unsat ✅ 0.24406 0.24382
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 89.07650 88.53180
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.22770 0.28159
Z3 z3-4.7.1_default unsat ✅ 0.22023 0.22015
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 3.49278 13.70000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 20.51390 20.51210
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 24.29410 24.28970
Par4 Par4-wrapped-sq_default unsat ✅ 0.23279 0.00893
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.47589 4.09734
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.27061 3.77009
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.29794 4.37000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.39601 0.30442
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.21603 0.21605
z3-4.7.1_default unsat ✅ 0.22275 0.22272
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 21.36050 21.36050
cvc5 cvc5-fixed_default unsat ✅ 20.44940 20.43060
Par4 Par4-wrapped-sq_default unsat ✅ 0.23049 0.00631
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.69242 1.62591
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 4.48292 19.88230
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.62152 1.89000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.19666 0.19819
Z3 z3-4.8.11_default unsat ✅ 0.21426 0.21412
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 34.39640 34.12440
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 39.31250 39.16210
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 205.38600 232.39900
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.27574 0.27809
Z3 z3-4.8.17_default unsat ✅ 0.22110 0.22291
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 24.56160 24.56070
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 107.32900 105.91700
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 3.16065 10.56000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.33144 6.29700
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.28998 0.29153
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 50.64800 50.54834
iProver iProver v3.9 unsat ✅ 4.34789 15.07052
SMTInterpol SMTInterpol unknown ❌ 1202.72231 1348.46467