Benchmark

non-incremental/UFNIA/vcc-havoc/verisoft-baby.c.1.29.handle_pf.smt2 

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.
Benchmark
Size193924
Compressed Size19694
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 193916
Compressed Size19755
Max. Term Depth138
Asserts 3
Declared Functions262
Declared Constants100
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true25 false2 ite30 not3423
or652 =>729 =889 distinct2
forall954 exists5 let143 Int1826
+37 -217 *76 <607
<=938 >8 >=14 fp7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.41391 —
CVC3-SMT-COMP-2011 default unknown ❌ 0.46958 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.36704 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.25203 —
Z3-SMT-COMP-2011 default unsat ✅ 0.24558 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.16000 2402.09000
CVC4 CVC4 f7118b2 default unsat ✅ 164.21200 164.16700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.25647 0.24896
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2402.12000 2400.92000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.86570 1.86372
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.90559 1.90271
Z3 z3 4.4.0 default unsat ✅ 0.27767 0.27796
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 5.43046 5.43424
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.27797 0.27885
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.26027 0.25908
Z3 z3-4.4.1 default unsat ✅ 0.33898 0.34038
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.49736 2.49661
Vampire vampire4.2-smt vampire unsat ✅ 0.24312 0.24269
Z3 z3-4.5.0 default unsat ✅ 0.35116 0.35072
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.39202 2.39232
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.29990 0.35148
Z3 z3-4.7.1_default unsat ✅ 0.29601 0.29594
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 16.62020 65.72000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 10.18680 10.18620
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 12.81440 12.81450
Par4 Par4-wrapped-sq_default unsat ✅ 0.30940 0.00564
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2400.07000 2454.70000
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2400.10000 2453.11000
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.44216 4.90973
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.28665 0.34230
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.29617 0.29617
z3-4.7.1_default unsat ✅ 0.30221 0.30214
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 11.25900 43.28000
CVC4 CVC4-sq-final_default unsat ✅ 12.47410 12.46920
Par4 Par4-wrapped-sq_default unsat ✅ 0.28192 0.00684
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 1200.05000 1226.53000
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.26471 0.26650
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.25747 0.34505
Z3 z3-4.8.8_default unsat ✅ 0.29955 0.29951
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 4.64955 4.64994
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 50.98830 50.52360
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 4.99061 10.95490
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.38919 0.30889
Z3 z3-4.8.17_default unsat ✅ 0.28597 0.28775
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 35.81260 34.28930
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 36.50830 34.85820
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 3.16315 10.43000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 1200.09000 1212.58000
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.40740 0.41320