Benchmark

non-incremental/QF_ABV/platania/bellford/bf5.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size106345
Compressed Size6901
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 106337
Compressed Size6913
Max. Term Depth332
Asserts 214
Declared Functions0
Declared Constants227
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite191 not130 and827 =>195
=228 let97 bvadd205 bvult729
bvule110 select545 store50

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ 0.40000 —
Z3 Z3 0.1 unsat ✅ — —
Z3 0.1 (fixed BV) unsat ✅ — —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.00958 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.00969 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.00979 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.19933 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.17866 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.17805 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.04131 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.04409 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.03455 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.05058 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.03804 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.02099 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.01518 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.02518 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.01688 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01939 —
Z3-SMT-COMP-2011 default unsat ✅ 0.03041 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.02192 0.01100
Boolector boolectorj unsat ✅ 0.02195 0.01100
CVC4 CVC4 f7118b2 default unsat ✅ 0.06626 0.05599
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02453 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04245 0.03299
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.03542 0.02700
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.03012 0.01900
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.02520 0.00900
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02504 0.01600
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.00977 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.06223 0.05999
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.06377 0.06099
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.03212 0.03100
Yices2 Yices default unsat ✅ 0.00934 0.00800
Z3 z3 4.4.0 default unsat ✅ 0.03983 0.03999
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.01102 0.01017
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.06354 0.06380
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.02579 0.02662
Yices2 Yices-2.4.2 default unsat ✅ 0.01184 0.01046
Z3 z3-4.4.1 default unsat ✅ 0.03841 0.03957
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.05117 0.01235
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.23347 0.07234
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.02814 0.02703
Yices2 Yices2-Main default unsat ✅ 0.01094 0.01050
Z3 z3-4.5.0 default unsat ✅ 0.12050 0.04610
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.00954 0.00946
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.06562 0.06585
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.02536 0.02641
Yices2 Yices 2.6.0_default unsat ✅ 0.01266 0.01257
Z3 z3-4.7.1_default unsat ✅ 0.04505 0.04499
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.01748 0.01299
Boolector Boolector-wrapped-sq_default unsat ✅ 0.01559 0.01557
CVC4 CVC4-sq-final_default unsat ✅ 0.09791 0.09817
MathSAT MathSAT5_default.sh unsat ✅ 0.02721 0.02713
Par4 Par4-wrapped-sq_default unsat ✅ 0.03783 0.00611
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01907 0.01110
Z3 z3-4.8.8_default unsat ✅ 0.04272 0.04267
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.24618 0.14570
cvc5 cvc5 unsat ✅ 0.26311 0.16349
SMTInterpol SMTInterpol unsat ✅ 20.90835 51.26307
Yices2 Yices2 unsat ✅ 0.24739 0.14673
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.30277 0.16826
cvc5 cvc5 unsat ✅ 0.31543 0.18569
SMTInterpol SMTInterpol unsat ✅ 3.54079 10.33328
Yices2 Yices2 unsat ✅ 0.26585 0.13827
Z3 Z3-Owl-base unsat ✅ 0.34639 0.21640
Z3-Owl Z3-Owl unsat ✅ 0.81937 0.69619