Benchmark

non-incremental/QF_ABV/platania/bellford/bf10.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size375415
Compressed Size19290
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 375407
Compressed Size19303
Max. Term Depth1157
Asserts 669
Declared Functions0
Declared Constants682
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite631 not455 and3027 =>685
=698 let342 bvadd760 bvult2654
bvule370 select2090 store150

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 2.60000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ — —
SMT-COMP 2009 Boolector Boolector unsat ✅ — —
Boolector 1.2 unsat ✅ — —
CVC3 CVC3 2.0 unsat ✅ 0.80000 —
MathSAT MathSAT 4.3 unsat ✅ 119.70000 —
Yices2 Yices 2 proto unsat ✅ — —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02009 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.02517 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.02229 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.59194 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.52854 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.52650 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.11900 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.12876 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.07991 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.14896 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.09883 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.06449 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.04441 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.07143 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.04089 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05169 —
Z3-SMT-COMP-2011 default unsat ✅ 0.05701 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.02790 0.02700
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19106 0.18797
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19298 0.18997
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.05806 0.05699
Yices2 Yices default unsat ✅ 0.02201 0.02099
Z3 z3 4.4.0 default unsat ✅ 0.06453 0.06399
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.02973 0.02974
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.19107 0.19137
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.05053 0.05151
Yices2 Yices-2.4.2 default unsat ✅ 0.02353 0.02350
Z3 z3-4.4.1 default unsat ✅ 0.06411 0.06538
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.02801 0.02795
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.19189 0.19111
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.05122 0.05031
Yices2 Yices2-Main default unsat ✅ 0.02195 0.02117
Z3 z3-4.5.0 default unsat ✅ 0.06769 0.06712
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.02626 0.02618
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.20071 0.20090
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.04938 0.05037
Yices2 Yices 2.6.0_default unsat ✅ 0.02338 0.02333
Z3 z3-4.7.1_default unsat ✅ 0.07076 0.07066
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03656 0.03659
Poolector-wrapped-sq_default unsat ✅ 0.16906 0.22169
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.20798 0.20831
Par4 Par4-wrapped-sq_default unsat ✅ 0.03217 0.00577
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02447 0.02444
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07397 0.07394
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.27868 0.17839
cvc5 cvc5 unsat ✅ 0.29785 0.19834
SMTInterpol SMTInterpol unsat ✅ 591.96781 638.11172
Yices2 Yices2 unsat ✅ 0.22681 0.12728