Benchmark

non-incremental/QF_ABV/platania/bellford/bf15.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size813264
Compressed Size38748
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 813256
Compressed Size38759
Max. Term Depth2482
Asserts 1374
Declared Functions0
Declared Constants1387
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1321 not980 and6602 =>1475
=1418 let737 bvadd1665 bvult5779
bvule780 select4635 store300

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 7.10000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.10000 —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.3 unsat ✅ 8.80000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.03958 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.05520 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.04543 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.23375 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.09947 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.09548 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.24827 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.27962 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.15338 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.29175 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.20014 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.14914 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.08848 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.16234 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.07918 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.10269 —
Z3-SMT-COMP-2011 default unsat ✅ 0.10380 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.10069 0.09198
Boolector boolectorj unsat ✅ 0.10103 0.09098
CVC4 CVC4 f7118b2 default unsat ✅ 0.39048 0.37894
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.03204 0.01800
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04283 0.03000
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.11869 0.11798
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.15034 0.13898
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.03807 0.03699
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09708 0.08599
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.05790 0.05699
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.40354 0.40194
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.40293 0.39994
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.09893 0.09798
Yices2 Yices default unsat ✅ 0.03757 0.03699
Z3 z3 4.4.0 default unsat ✅ 0.10322 0.10298
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.06092 0.06087
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.40296 0.40338
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.08824 0.08923
Yices2 Yices-2.4.2 default unsat ✅ 0.03894 0.03894
Z3 z3-4.4.1 default unsat ✅ 0.10026 0.10142
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.05777 0.05549
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.41464 0.40773
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08799 0.08825
Yices2 Yices2-Main default unsat ✅ 0.03763 0.03731
Z3 z3-4.5.0 default unsat ✅ 0.10660 0.10655
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.05259 0.05253
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.43185 0.43203
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.08600 0.08696
Yices2 Yices 2.6.0_default unsat ✅ 0.03888 0.03883
Z3 z3-4.7.1_default unsat ✅ 0.11131 0.11125
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.06573 0.06563
Boolector Boolector-wrapped-sq_default unsat ✅ 0.07079 0.07077
CVC4 CVC4-sq-final_default unsat ✅ 0.64760 0.64782
MathSAT MathSAT5_default.sh unsat ✅ 0.09193 0.09185
Par4 Par4-wrapped-sq_default unsat ✅ 0.04765 0.00655
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04102 0.04096
Z3 z3-4.8.8_default unsat ✅ 0.11180 0.10894
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.29479 0.19501
cvc5 cvc5 unsat ✅ 0.40760 0.30790
SMTInterpol SMTInterpol unknown ❌ 1201.72282 1251.91552
Yices2 Yices2 unsat ✅ 0.26372 0.16264