Benchmark
non-incremental/QF_ABV/platania/bellford/bf18.c.smt2
The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.
This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.
Contributed by Lorenzo Platania (c1009@unige.it). Translated from CVC format
by Clark Barrett.
| Benchmark |
|---|
| Size | 1156221 |
| Compressed Size | 53125 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2007-07-03 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 1156213 |
| Compressed Size | 53134 |
| Max. Term Depth | 3517 |
| Asserts | 1917 |
| Declared Functions | 0 |
| Declared Constants | 1930 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
ite | 1855 |
not | 1391 |
and | 9407 |
=> | 2093 |
= | 1970 |
let | 1046 |
bvadd | 2376 |
bvult | 8230 |
bvule | 1098 |
select | 6642 |
store | 414 |
| |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2007
|
0.50 (1/2) |
Yices |
Yices 1.0.10 |
unknown ❌
|
1800.70000
|
—
|
| |
Z3 |
Z3 0.1 |
unsat ✅
|
0.20000
|
—
|
| |
|
Z3 0.1 (fixed BV) |
unsat ✅
|
0.20000
|
—
|
|
SMT-COMP 2008
|
|
Boolector |
Boolector |
unsat ✅
|
0.10000
|
—
|
| |
CVC3 |
CVC3-1.5 |
unsat ✅
|
10.90000
|
—
|
| |
Z3 |
Z3 0.1 |
unsat ✅
|
0.20000
|
—
|
| |
|
Z3.2 |
unsat ✅
|
0.20000
|
—
|
|
SMT-COMP 2009
|
0.25 (3/4) |
Boolector |
Boolector |
unsat ✅
|
0.10000
|
—
|
| |
|
Boolector 1.2 |
unsat ✅
|
0.10000
|
—
|
| |
CVC3 |
CVC3 2.0 |
unsat ✅
|
2.40000
|
—
|
| |
MathSAT |
MathSAT 4.3 |
unknown ❌
|
900.00000
|
—
|
| |
Yices2 |
Yices 2 proto |
unsat ✅
|
0.10000
|
—
|
|
SMT-COMP 2011
|
0.40 (3/5) |
Boolector |
Boolector 1.5.23-833 |
unsat ✅
|
0.10000
|
—
|
| |
CVC3 |
CVC3 v2.4 |
unsat ✅
|
2.00000
|
—
|
| |
MathSAT |
MathSAT5 |
unknown ❌
|
1200.10000
|
—
|
| |
SONOLAR |
SONOLAR |
unsat ✅
|
0.20000
|
—
|
| |
Z3 |
Z3 |
unknown ❌
|
1200.00000
|
—
|
|
SMT Evaluation 2013
|
|
Boolector |
Boolector-1.5.118-SMT-EVAL-2013 default |
unsat ✅
|
0.05444
|
—
|
| |
|
Boolector-SMT-COMP-2011 default |
unsat ✅
|
0.06847
|
—
|
| |
|
Boolector-SMT-COMP-2012 default |
unsat ✅
|
0.06290
|
—
|
| |
CVC3 |
CVC3-SMT-COMP-2010 default |
unsat ✅
|
1.70591
|
—
|
| |
|
CVC3-SMT-COMP-2011 default |
unsat ✅
|
1.53709
|
—
|
| |
|
CVC3-SMT-COMP-2012 default |
unsat ✅
|
1.51653
|
—
|
| |
CVC4 |
CVC4-SMT-COMP-2012-Resubmission default |
unsat ✅
|
0.34959
|
—
|
| |
|
CVC4-SMT-EVAL-2013 default |
unsat ✅
|
0.38369
|
—
|
| |
MathSAT |
MathSAT5-5.2.6-SMT-EVAL-2013 default |
unsat ✅
|
0.20860
|
—
|
| |
|
MathSAT5-SMT-COMP-2011 default |
unsat ✅
|
0.43327
|
—
|
| |
|
MathSAT5-SMT-COMP-2012 default |
unsat ✅
|
0.28267
|
—
|
| |
SONOLAR |
SONOLAR-2013-05-15-SMT-EVAL-2013 default |
unsat ✅
|
0.20014
|
—
|
| |
|
SONOLAR-SMT-COMP-2011 default |
unsat ✅
|
0.12358
|
—
|
| |
|
SONOLAR-SMT-COMP-2012 default |
unsat ✅
|
0.21390
|
—
|
| |
Tiffany de Wintermonte |
TdW-SMT-COMP-2012 default |
unsat ✅
|
0.11190
|
—
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default |
unsat ✅
|
0.14167
|
—
|
| |
|
Z3-SMT-COMP-2011 default |
unsat ✅
|
0.13995
|
—
|
|
SMT-COMP 2015
|
|
Boolector |
Boolector SMT15 QF_AUFBV final boolector_qf_aufbv |
unsat ✅
|
0.08079
|
0.07999
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
unsat ✅
|
0.58894
|
0.58691
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
unsat ✅
|
0.58221
|
0.57991
|
| |
MathSAT |
MathSat 5.3.6 main smtcomp2015_main |
unsat ✅
|
0.13099
|
0.12998
|
| |
Yices2 |
Yices default |
unsat ✅
|
0.04983
|
0.04899
|
| |
Z3 |
z3 4.4.0 default |
unsat ✅
|
0.13467
|
0.13498
|
|
SMT-COMP 2016
|
|
Boolector |
Boolector boolector |
unsat ✅
|
0.08520
|
0.08523
|
| |
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
unsat ✅
|
0.58050
|
0.58102
|
| |
MathSAT |
mathsat-5.3.11-linux-x86_64-Main default |
unsat ✅
|
0.11739
|
0.11839
|
| |
Yices2 |
Yices-2.4.2 default |
unsat ✅
|
0.05082
|
0.05075
|
| |
Z3 |
z3-4.4.1 default |
unsat ✅
|
0.13077
|
0.13166
|
|
SMT-COMP 2017
|
|
Boolector |
Boolector SMT17 final boolector |
unsat ✅
|
0.07848
|
0.07757
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
0.60635
|
0.60434
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
0.11892
|
0.11931
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
0.04942
|
0.04852
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
0.13742
|
0.13655
|
|
SMT-COMP 2018
|
0.20 (4/5) |
Boolector |
Boolector_default |
unsat ✅
|
0.07385
|
0.07375
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.62581
|
0.62585
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unknown ❌
|
0.11664
|
0.11767
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
0.05016
|
0.05010
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
0.14139
|
0.14131
|
|
SMT-COMP 2020
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.09121
|
0.09117
|
| |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.09615
|
0.09613
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
0.93403
|
0.93432
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
0.12080
|
0.12072
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.05837
|
0.00673
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
0.05353
|
0.05349
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
0.13809
|
0.13803
|
|
SMT-COMP 2024
|
0.25 (3/4) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.37081
|
0.27111
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.51634
|
0.41660
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
1201.74558
|
1249.14082
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.27873
|
0.17813
|
|
SMT-COMP 2025
|
|
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.34130
|
0.22267
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.48873
|
0.36804
|
| |
SMTInterpol |
SMTInterpol |
unsat ✅
|
142.44763
|
175.79404
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.27416
|
0.15727
|
| |
Z3 |
Z3-Owl-base |
unsat ✅
|
0.72369
|
0.59752
|
| |
Z3-Owl |
Z3-Owl |
unsat ✅
|
0.94140
|
0.81657
|