Benchmark

non-incremental/QF_ABV/platania/bellford/bf8.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size246616
Compressed Size14479
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 246608
Compressed Size13863
Max. Term Depth767
Asserts 457
Declared Functions0
Declared Constants470
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite425 not301 and1982 =>453
=480 let226 bvadd496 bvult1740
bvule248 select1352 store104

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ 44.80000 —
Z3 Z3 0.1 unsat ✅ — —
Z3 0.1 (fixed BV) unsat ✅ — —
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 1.50000 —
Z3 Z3 0.1 unsat ✅ — —
Z3.2 unsat ✅ — —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ — —
CVC3 CVC3 2.3 unsat ✅ 2.50000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01456 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.01797 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.01572 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.41598 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.37277 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.37636 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.08305 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.09845 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.05782 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.10453 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.07875 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.04395 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.03009 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.05017 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.02944 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03671 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04359 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.03506 0.02399
Boolector boolectorj unsat ✅ 0.03467 0.02399
CVC4 CVC4 f7118b2 default unsat ✅ 0.12393 0.12198
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02451 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03989 0.02999
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.05367 0.04499
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.05369 0.04299
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.02395 0.01500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.03879 0.03099
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.01955 0.01900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.13031 0.12798
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.13087 0.12798
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.04590 0.04499
Yices2 Yices default unsat ✅ 0.01656 0.01600
Z3 z3 4.4.0 default unsat ✅ 0.05379 0.05399
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.02016 0.02013
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.12996 0.13016
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.03923 0.04020
Yices2 Yices-2.4.2 default unsat ✅ 0.01676 0.01731
Z3 z3-4.4.1 default unsat ✅ 0.05093 0.05217
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.02099 0.01922
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.13112 0.13088
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.03928 0.04020
Yices2 Yices2-Main default unsat ✅ 0.01712 0.01664
Z3 z3-4.5.0 default unsat ✅ 0.05390 0.05335
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.01821 0.01816
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.13839 0.13859
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.03768 0.03864
Yices2 Yices 2.6.0_default unsat ✅ 0.01821 0.01812
Z3 z3-4.7.1_default unsat ✅ 0.05757 0.05747
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 0.04111 0.04107
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01842 0.01835
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.01843 0.01840
Z3 z3-4.8.11_default unsat ✅ 0.04097 0.04093
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23926 0.13944
cvc5 cvc5 unsat ✅ 0.27438 0.17433
SMTInterpol SMTInterpol unsat ✅ 189.39773 225.49159
Yices2 Yices2 unsat ✅ 0.23308 0.13309
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.26637 0.14980
cvc5 cvc5 unsat ✅ 0.33808 0.21111
SMTInterpol SMTInterpol unsat ✅ 5.22703 15.47786
Yices2 Yices2 unsat ✅ 0.28341 0.16346
Z3 Z3-Owl-base unsat ✅ 0.38631 0.26536
Z3-Owl Z3-Owl unsat ✅ 0.81945 0.69329