Benchmark

non-incremental/QF_ABV/platania/bellford/bf23.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1860421
Compressed Size85141
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1860413
Compressed Size85152
Max. Term Depth5642
Asserts 3022
Declared Functions0
Declared Constants3035
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2945 not2236 and15182 =>3363
=3090 let1681 bvadd3841 bvult13275
bvule1748 select10787 store644

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 20.90000 —
Z3 Z3 0.1 unsat ✅ 0.40000 —
Z3.2 unsat ✅ 0.40000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ 0.10000 —
Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.0 unsat ✅ 3.80000 —
MathSAT MathSAT 4.3 unknown ❌ 574.00000 —
Yices2 Yices 2 proto unsat ✅ 0.10000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.08828 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.10997 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.10205 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.71738 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.45944 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.42527 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.57882 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.63145 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.32682 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.67221 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45536 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.33391 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.19630 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.36239 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.17645 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.23176 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21596 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.27237 0.26196
Boolector boolectorj unsat ✅ 0.27300 0.26296
CVC4 CVC4 f7118b2 default unsat ✅ 0.93402 0.92186
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02549 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04716 0.03699
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.26845 0.25996
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.35502 0.34395
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.08048 0.07199
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.18949 0.18197
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.13472 0.13298
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.96499 0.96285
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.97055 0.96685
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.19942 0.19797
Yices2 Yices default unsat ✅ 0.07460 0.07399
Z3 z3 4.4.0 default unsat ✅ 0.19904 0.19897
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.13808 0.13805
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.94922 0.95044
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.17922 0.18035
Yices2 Yices-2.4.2 default unsat ✅ 0.07744 0.07692
Z3 z3-4.4.1 default unsat ✅ 0.19228 0.19361
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.13568 0.13446
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.04465 1.04432
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.18398 0.18356
Yices2 Yices2-Main default unsat ✅ 0.07441 0.07240
Z3 z3-4.5.0 default unsat ✅ 0.21302 0.21246
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.12011 0.12003
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.03800 1.03811
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.17780 0.17875
Yices2 Yices 2.6.0_default unsat ✅ 0.07215 0.07210
Z3 z3-4.7.1_default unsat ✅ 0.20909 0.20893
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.15285 0.15288
Poolector-wrapped-sq_default unsat ✅ 0.27684 0.78359
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.05506 1.05530
Par4 Par4-wrapped-sq_default unsat ✅ 0.07903 0.00662
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.07308 0.07311
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.20963 0.20962
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.14456 0.14450
Boolector Boolector-wrapped-sq_default unsat ✅ 0.21398 0.21081
CVC4 CVC4-sq-final_default unsat ✅ 1.55814 1.55843
MathSAT MathSAT5_default.sh unsat ✅ 0.18684 0.18674
Par4 Par4-wrapped-sq_default unsat ✅ 0.08283 0.00913
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.07835 0.07824
Z3 z3-4.8.8_default unsat ✅ 0.20244 0.20238
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.15970 0.15963
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.40129 1.39536
MathSAT MathSAT-5.6.8_default unsat ✅ 0.18922 0.18914
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.07987 0.07981
Z3 z3-4.8.17_default unsat ✅ 0.20832 0.21014
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40880 0.40877
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.70646 0.70159
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1258.69000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.07984 0.07982
Z3-Owl z3-Owl-Final_default unsat ✅ 1.71756 1.66590
z3-Owl-Final_default unsat ✅ 1.10004 1.10025
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.42269 0.30160
cvc5 cvc5 unsat ✅ 0.61058 0.49670
SMTInterpol SMTInterpol unsat ✅ 1188.82340 1233.38553
Yices2 Yices2 unsat ✅ 0.32419 0.20103
Z3 Z3-Owl-base unsat ✅ 0.96382 0.84417
Z3-Owl Z3-Owl unsat ✅ 0.99346 0.87250