Benchmark

non-incremental/UFNIA/vcc-havoc/baby.64.handle_reset.smt2

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size168737
Compressed Size16801
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 168729
Compressed Size16862
Max. Term Depth104
Asserts 3
Declared Functions249
Declared Constants69
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true34 false3 ite13 not3004
or579 =>664 =792 distinct2
forall923 exists2 let129 Int1565
+60 -217 *90 <608
<=834 >4 >=12 repeat1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.30229
CVC3-SMT-COMP-2011 default unknown ❌ 0.44224
CVC3-SMT-COMP-2012 default unknown ❌ 0.16656
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.33748
Z3-SMT-COMP-2011 default unsat ✅ 0.25451
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.16296 0.14798
CVC4 CVC4 f7118b2 default unknown ❌ 2399.61000 2400.01000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.24782 0.23696
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.16736 0.16697
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.71781 1.71474
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.71804 1.71474
Z3 z3 4.4.0 default unsat ✅ 0.30550 0.30595
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.88836 3.89150
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.26147 0.26260
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.24492 0.24559
Z3 z3-4.4.1 default unsat ✅ 0.27590 0.27762
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.90048 1.89985
Vampire vampire4.2-smt vampire unsat ✅ 0.20816 0.20757
Z3 z3-4.5.0 default unsat ✅ 0.31828 0.31738
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.27096 2.27127
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.26284 0.33227
Z3 z3-4.7.1_default unsat ✅ 0.28215 0.28211
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 6.59588 25.93000
CVC4 CVC4-sq-final_default unsat ✅ 1.89242 1.89245
Par4 Par4-wrapped-sq_default unsat ✅ 0.29827 0.00801
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 1200.15000 4221.88000
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.19614 0.19875
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.32085 0.36071
Z3 z3-4.8.8_default unsat ✅ 0.27672 0.27670
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 1.60712 1.60710
cvc5 cvc5-fixed_default unsat ✅ 23.54630 23.54380
Par4 Par4-wrapped-sq_default unsat ✅ 0.28510 0.00613
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.56638 1.28186
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.32423 7.00470
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.74223 2.51000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.20891 0.21004
Z3 z3-4.8.11_default unsat ✅ 0.27860 0.27853
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 64.50024 64.36137
iProver iProver v3.9.3 unsat ✅ 3.38890 11.42599
SMTInterpol SMTInterpol unknown ❌ 1201.48622 1861.43504
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.30626 5.31693