Benchmark

non-incremental/QF_ABV/platania/bellford/bf21.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1558839
Compressed Size72159
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1558831
Compressed Size72171
Max. Term Depth4732
Asserts 2550
Declared Functions0
Declared Constants2563
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2479 not1874 and12707 =>2819
=2612 let1409 bvadd3213 bvult11113
bvule1470 select9009 store546

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 16.00000 —
Z3 Z3 0.1 unsat ✅ 0.30000 —
Z3.2 unsat ✅ 0.30000 —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.3 unsat ✅ 28.20000 —
SMT Evaluation 2013 0.86 (1/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.07335 —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unsat ✅ 0.08496 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.23000 0.21097
Boolector boolectorj unsat ✅ 0.22578 0.21097
CVC4 CVC4 f7118b2 default unsat ✅ 0.76709 0.76488
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02534 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04434 0.03100
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.22437 0.21597
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.29232 0.28096
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.07104 0.06199
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.15459 0.15398
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.10973 0.10898
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.79301 0.79088
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.78228 0.77988
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.16978 0.16897
Yices2 Yices default unsat ✅ 0.06332 0.06199
Z3 z3 4.4.0 default unsat ✅ 0.16946 0.16897
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.11789 0.11787
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.80291 0.80381
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.15483 0.15538
Yices2 Yices-2.4.2 default unsat ✅ 0.06466 0.06445
Z3 z3-4.4.1 default unsat ✅ 0.16551 0.16698
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.11965 0.11955
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.81214 0.81123
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.16933 0.16872
Yices2 Yices2-Main default unsat ✅ 0.10046 0.06734
Z3 z3-4.5.0 default unsat ✅ 0.17546 0.17530
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.10047 0.10043
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.85422 0.85440
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.15232 0.15331
Yices2 Yices 2.6.0_default unsat ✅ 0.06264 0.06253
Z3 z3-4.7.1_default unsat ✅ 0.18337 0.18327
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.12881 0.12877
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.15396 1.14931
MathSAT MathSAT-5.6.8_default unsat ✅ 0.16084 0.16079
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.06870 0.06866
Z3 z3-4.8.17_default unsat ✅ 0.15795 0.15973
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.45300 0.35350
cvc5 cvc5 unsat ✅ 0.53283 0.43344
SMTInterpol SMTInterpol unknown ❌ 1201.71872 1266.02976
Yices2 Yices2 unsat ✅ 0.25681 0.15713