Benchmark

non-incremental/QF_ABV/platania/bellford/bf13.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size617791
Compressed Size30987
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 617783
Compressed Size31004
Max. Term Depth1892
Asserts 1062
Declared Functions0
Declared Constants1075
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1015 not746 and5007 =>1123
=1100 let561 bvadd1261 bvult4385
bvule598 select3497 store234

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅
CVC3 CVC3-1.5 unsat ✅ 4.80000
Z3 Z3 0.1 unsat ✅ 0.10000
Z3.2 unsat ✅ 0.10000
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 unsat ✅ 0.10000
CVC3 CVC3 v2.4 unsat ✅ 1.10000
MathSAT MathSAT5 unknown ❌ 1200.10000
SONOLAR SONOLAR unsat ✅ 0.10000
Z3 Z3 unknown ❌ 1200.00000
SMT Evaluation 2013 0.57 (3/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unsat ✅ 0.03862
Boolector-SMT-COMP-2012 default unsat ✅ 0.03470
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.22193
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unsat ✅ 0.09205
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.07616 0.06599
Boolector boolectorj unsat ✅ 0.07592 0.06599
CVC4 CVC4 f7118b2 default unsat ✅ 0.29902 0.28996
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.01770 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04031 0.03100
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.10179 0.09198
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.11580 0.10498
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.03751 0.02899
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06507 0.06499
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.04475 0.04399
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.30787 0.30595
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.30640 0.30395
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.07991 0.07899
Yices2 Yices default unsat ✅ 0.03035 0.02899
Z3 z3 4.4.0 default unsat ✅ 0.08500 0.08499
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.04660 0.04655
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.31270 0.31197
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.07065 0.07167
Yices2 Yices-2.4.2 default unsat ✅ 0.03102 0.03095
Z3 z3-4.4.1 default unsat ✅ 0.08298 0.08429
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.04230 0.04245
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.30602 0.30480
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.07146 0.07174
Yices2 Yices2-Main default unsat ✅ 0.03142 0.03005
Z3 z3-4.5.0 default unsat ✅ 0.08822 0.08757
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.04106 0.04097
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.32163 0.32162
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.07107 0.07200
Yices2 Yices 2.6.0_default unsat ✅ 0.03200 0.03194
Z3 z3-4.7.1_default unsat ✅ 0.09219 0.09213
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.05477 0.05479
Poolector-wrapped-sq_default unsat ✅ 0.17502 0.31513
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.33085 0.33120
Par4 Par4-wrapped-sq_default unsat ✅ 0.04387 0.00591
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03293 0.03295
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.09400 0.09400
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.29893 0.19884
cvc5 cvc5 unsat ✅ 0.34575 0.24605
SMTInterpol SMTInterpol unknown ❌ 1201.73987 1252.27124
Yices2 Yices2 unsat ✅ 0.23202 0.13221