Benchmark

non-incremental/QF_ABV/platania/bellford/bf10.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size375415
Compressed Size19290
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 375407
Compressed Size19303
Max. Term Depth1157
Asserts 669
Declared Functions0
Declared Constants682
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite631 not455 and3027 =>685
=698 let342 bvadd760 bvult2654
bvule370 select2090 store150

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅
CVC3 CVC3-1.5 unsat ✅ 2.60000
Z3 Z3 0.1 unsat ✅ 0.10000
Z3.2 unsat ✅
SMT-COMP 2009 Boolector Boolector unsat ✅
Boolector 1.2 unsat ✅
CVC3 CVC3 2.0 unsat ✅ 0.80000
MathSAT MathSAT 4.3 unsat ✅ 119.70000
Yices2 Yices 2 proto unsat ✅
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02009
Boolector-SMT-COMP-2011 default unsat ✅ 0.02517
Boolector-SMT-COMP-2012 default unsat ✅ 0.02229
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.59194
CVC3-SMT-COMP-2011 default unsat ✅ 0.52854
CVC3-SMT-COMP-2012 default unsat ✅ 0.52650
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.11900
CVC4-SMT-EVAL-2013 default unsat ✅ 0.12876
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.07991
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.14896
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.09883
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.06449
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.04441
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.07143
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.04089
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05169
Z3-SMT-COMP-2011 default unsat ✅ 0.05701
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.02790 0.02700
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19106 0.18797
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19298 0.18997
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.05806 0.05699
Yices2 Yices default unsat ✅ 0.02201 0.02099
Z3 z3 4.4.0 default unsat ✅ 0.06453 0.06399
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.02973 0.02974
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.19107 0.19137
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.05053 0.05151
Yices2 Yices-2.4.2 default unsat ✅ 0.02353 0.02350
Z3 z3-4.4.1 default unsat ✅ 0.06411 0.06538
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.02801 0.02795
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.19189 0.19111
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.05122 0.05031
Yices2 Yices2-Main default unsat ✅ 0.02195 0.02117
Z3 z3-4.5.0 default unsat ✅ 0.06769 0.06712
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.02626 0.02618
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.20071 0.20090
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.04938 0.05037
Yices2 Yices 2.6.0_default unsat ✅ 0.02338 0.02333
Z3 z3-4.7.1_default unsat ✅ 0.07076 0.07066
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03656 0.03659
Poolector-wrapped-sq_default unsat ✅ 0.16906 0.22169
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.20798 0.20831
Par4 Par4-wrapped-sq_default unsat ✅ 0.03217 0.00577
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02447 0.02444
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07397 0.07394
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.27868 0.17839
cvc5 cvc5 unsat ✅ 0.29785 0.19834
SMTInterpol SMTInterpol unsat ✅ 591.96781 638.11172
Yices2 Yices2 unsat ✅ 0.22681 0.12728