Benchmark

non-incremental/QF_ABV/platania/bellford/bf11.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size449420
Compressed Size23339
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 449412
Compressed Size23350
Max. Term Depth1382
Asserts 790
Declared Functions0
Declared Constants803
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite749 not544 and3632 =>819
=822 let409 bvadd913 bvult3183
bvule440 select2519 store176

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 3.20000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ 0.10000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02849 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.03420 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.03058 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.70115 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.62461 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.62210 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.14133 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.15875 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.09172 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.16759 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.11725 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.08219 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.05237 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.08517 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.04771 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.06055 —
Z3-SMT-COMP-2011 default unsat ✅ 0.06562 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.05569 0.04499
Boolector boolectorj unsat ✅ 0.05608 0.04499
CVC4 CVC4 f7118b2 default unsat ✅ 0.22368 0.21297
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.01751 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03982 0.03099
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.07977 0.07099
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.08693 0.07599
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.03184 0.02300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.05029 0.04899
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.03305 0.03199
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.22797 0.22596
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.22779 0.22496
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.06489 0.06399
Yices2 Yices default unsat ✅ 0.02392 0.02300
Z3 z3 4.4.0 default unsat ✅ 0.07134 0.07099
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.03557 0.03583
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.22524 0.22586
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.05737 0.05831
Yices2 Yices-2.4.2 default unsat ✅ 0.02523 0.02533
Z3 z3-4.4.1 default unsat ✅ 0.06918 0.07040
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.03356 0.03271
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.22714 0.22684
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.05682 0.05718
Yices2 Yices2-Main default unsat ✅ 0.02467 0.02348
Z3 z3-4.5.0 default unsat ✅ 0.07431 0.07297
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.03069 0.03058
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.23627 0.23646
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.05502 0.05602
Yices2 Yices 2.6.0_default unsat ✅ 0.02604 0.02598
Z3 z3-4.7.1_default unsat ✅ 0.07709 0.07699
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.04178 0.04181
Poolector-wrapped-sq_default unsat ✅ 0.18021 0.26259
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24519 0.24550
Par4 Par4-wrapped-sq_default unsat ✅ 0.03310 0.00588
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02663 0.02662
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07829 0.07827
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.25818 0.15842
cvc5 cvc5 unsat ✅ 0.29920 0.19941
SMTInterpol SMTInterpol unknown ❌ 1201.71520 1268.84772
Yices2 Yices2 unsat ✅ 0.22567 0.12599
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.32504 0.19180
cvc5 cvc5 unsat ✅ 0.36757 0.24660
SMTInterpol SMTInterpol unsat ✅ 23.56840 44.34070
Yices2 Yices2 unsat ✅ 0.28623 0.15384
Z3 Z3-Owl-base unsat ✅ 0.43059 0.31284
Z3-Owl Z3-Owl unsat ✅ 0.84262 0.71944