Benchmark

non-incremental/QF_ABV/platania/bellford/bf14.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size712199
Compressed Size35131
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 712191
Compressed Size35144
Max. Term Depth2177
Asserts 1213
Declared Functions0
Declared Constants1226
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1163 not859 and5777 =>1293
=1254 let646 bvadd1456 bvult5058
bvule686 select4046 store266

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 5.50000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ 0.10000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ — —
Boolector 1.2 unsat ✅ — —
CVC3 CVC3 2.0 unsat ✅ 1.50000 —
MathSAT MathSAT 4.3 unknown ❌ 900.00000 —
Yices2 Yices 2 proto unsat ✅ — —
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 unsat ✅ 0.10000 —
CVC3 CVC3 v2.4 unsat ✅ 1.30000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unsat ✅ 0.10000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.03520 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.04391 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.03963 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.07250 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.96338 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.94380 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.21481 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.23660 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.13825 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.27087 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.17774 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.12454 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.07797 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.13147 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.07048 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.09068 —
Z3-SMT-COMP-2011 default unsat ✅ 0.09253 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.05097 0.04999
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.35594 0.35395
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.35771 0.35495
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.09003 0.08898
Yices2 Yices default unsat ✅ 0.03419 0.03299
Z3 z3 4.4.0 default unsat ✅ 0.09435 0.09398
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.05343 0.05342
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.35300 0.35345
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.07976 0.08102
Yices2 Yices-2.4.2 default unsat ✅ 0.03511 0.03509
Z3 z3-4.4.1 default unsat ✅ 0.09139 0.09268
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.05069 0.04871
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.36179 0.36126
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08334 0.08400
Yices2 Yices2-Main default unsat ✅ 0.03488 0.03398
Z3 z3-4.5.0 default unsat ✅ 0.09747 0.09546
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.04697 0.04688
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.38003 0.38009
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.07826 0.07945
Yices2 Yices 2.6.0_default unsat ✅ 0.03484 0.03476
Z3 z3-4.7.1_default unsat ✅ 0.10079 0.10073
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.06398 0.06384
Poolector-wrapped-sq_default unsat ✅ 0.17388 0.34971
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.39116 0.39132
Par4 Par4-wrapped-sq_default unsat ✅ 0.04158 0.00587
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03648 0.03648
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.10348 0.10345
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.29335 0.19362
cvc5 cvc5 unsat ✅ 0.36003 0.26060
SMTInterpol SMTInterpol unknown ❌ 1201.72016 1254.39953
Yices2 Yices2 unsat ✅ 0.23406 0.13419