Benchmark

non-incremental/UFNIA/vcc-havoc/verisoft-baby.c.2.15.handle_reset.smt2 

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size199176
Compressed Size19830
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 199168
Compressed Size19938
Max. Term Depth102
Asserts 3
Declared Functions262
Declared Constants79
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true21 false3 ite29 not3514
or670 =>751 =886 distinct2
forall972 exists5 let147 Int1847
+45 -217 *84 <627
<=969 >6 >=8 fp9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ 0.49444 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.36322 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.79127 —
Z3-SMT-COMP-2011 default unsat ✅ 0.59118 —
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.18711 0.17797
CVC4 CVC4 f7118b2 default unknown ❌ 2400.01000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.68311 0.67490
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.17923 0.17897
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.59000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.66000
Z3 z3 4.4.0 default unsat ✅ 0.72881 0.72889
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 34.85420 34.70970
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.26228 0.26323
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.18211 0.18004
Z3 z3-4.4.1 default unsat ✅ 0.86014 0.86177
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 57.67490 53.39880
Vampire vampire4.2-smt vampire unsat ✅ 0.24130 0.23974
Z3 z3-4.5.0 default unsat ✅ 0.79165 0.79088
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 41.94150 39.59240
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.41628 0.37789
Z3 z3-4.7.1_default unsat ✅ 1.03008 1.02997
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 271.86900 1079.12000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 973.37200 963.57700
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 972.48900 963.65900
Par4 Par4-wrapped-sq_default unsat ✅ 0.93685 1.74000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2003.88000 7682.12000
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 1764.26000 6730.35000
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.34481 4.58000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.29886 0.38939
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.81307 0.81306
z3-4.7.1_default unsat ✅ 0.91822 0.91810
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.07000 4766.05000
CVC4 CVC4-sq-final_default unsat ✅ 469.01700 464.28600
Par4 Par4-wrapped-sq_default unsat ✅ 1.08621 2.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 1200.12000 1226.85000
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.30292 0.26192
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.36926 0.34591
Z3 z3-4.8.8_default unsat ✅ 0.89002 0.88998
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 52.41340 52.33210
cvc5 cvc5-fixed_default unsat ✅ 34.83210 34.69680
Par4 Par4-wrapped-sq_default unsat ✅ 1.04662 2.00000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.60342 1.40681
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.35652 6.96798
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.80254 2.88000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.20332 0.20474
Z3 z3-4.8.11_default unsat ✅ 0.88040 0.88024
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 86.39220 83.40780
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 84.10230 83.41190
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 3.16303 10.38000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 4.52970 10.44840
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.55342 1.74000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 318.75911 318.51977
iProver iProver v3.9 unsat ✅ 3.86941 12.87811
SMTInterpol SMTInterpol unknown ❌ 1202.23136 1945.60539
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 51.84913 51.72721
iProver iProver v3.9.3 unsat ✅ 4.37777 14.70445
SMTInterpol SMTInterpol unknown ❌ 1201.54477 1733.45172
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.28231 5.37132