Benchmark

non-incremental/UFNIA/vcc-havoc/verisoft-baby.c.1.35.handle_pf.smt2 

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size195197
Compressed Size19915
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 195189
Compressed Size20011
Max. Term Depth151
Asserts 3
Declared Functions262
Declared Constants112
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true30 false2 ite30 not3417
or648 =>760 =902 distinct2
forall954 exists5 let143 Int1826
+38 -218 *76 <607
<=944 >9 >=15 fp7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 1.00 (0/1) CVC3 CVC3 2.0 unknown ❌ 1200.00000 —
CVC3 2.3 unknown ❌ 0.30000 —
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.36504 —
CVC3-SMT-COMP-2011 default unknown ❌ 0.17127 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.18793 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.21898 —
Z3-SMT-COMP-2011 default unsat ✅ 0.24093 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.42000 2402.06000
CVC4 CVC4 f7118b2 default unsat ✅ 152.28400 152.24800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.19860 0.18997
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2402.10000 2398.70000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.21055 1.20781
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.21380 1.21181
Z3 z3 4.4.0 default unsat ✅ 0.22631 0.22596
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.91864 0.91987
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.26556 0.26688
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.26599 0.26430
Z3 z3-4.4.1 default unsat ✅ 0.24123 0.24258
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.02323 1.02322
Vampire vampire4.2-smt vampire unsat ✅ 0.25306 0.25175
Z3 z3-4.5.0 default unsat ✅ 0.25649 0.25246
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.01095 1.01112
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.24785 0.32941
Z3 z3-4.7.1_default unsat ✅ 0.25986 0.25975
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 15.67990 61.86000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.86774 0.86785
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 1.35223 1.35248
Par4 Par4-wrapped-sq_default unsat ✅ 0.26331 0.00603
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2400.02000 2450.49000
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.37651 3.93715
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.74356 6.16000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.24305 0.32708
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27894 0.27886
z3-4.7.1_default unsat ✅ 0.25438 0.25433
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 12.83940 50.63000
CVC4 CVC4-sq-final_default unsat ✅ 1.14912 1.14928
Par4 Par4-wrapped-sq_default unsat ✅ 0.28844 0.00636
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.75030 4.45312
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.26320 0.26320
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.26725 0.35528
Z3 z3-4.8.8_default unsat ✅ 0.25943 0.25937
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 2.04426 2.04365
cvc5 cvc5-fixed_default unsat ✅ 72.04800 67.95700
Par4 Par4-wrapped-sq_default unsat ✅ 0.25145 0.00703
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.77109 1.82272
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 5.31790 24.70170
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 1.00069 3.44000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.28622 0.28845
Z3 z3-4.8.11_default unsat ✅ 0.26065 0.26062
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 1.01910 1.01925
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 55.04380 54.66230
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.30006 6.20610
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.36913 0.36130
Z3 z3-4.8.17_default unsat ✅ 0.26577 0.26758
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 44.20860 42.77510
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 45.84390 44.37180
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 2.66211 8.58000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 1200.02000 1213.73000
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.39341 0.38612
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 43.14508 43.01440
iProver iProver v3.9.3 unsat ✅ 4.37059 15.69055
SMTInterpol SMTInterpol unknown ❌ 1201.78699 1764.60381
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 3.89125 9.50007