Benchmark

non-incremental/QF_ABV/platania/bellford/bf19.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1283798
Compressed Size58775
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1283790
Compressed Size58785
Max. Term Depth3902
Asserts 2118
Declared Functions0
Declared Constants2131
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2053 not1544 and10452 =>2323
=2174 let1161 bvadd2641 bvult9143
bvule1216 select7391 store456

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.80000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3 0.1 (fixed BV) unsat ✅ 0.20000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 12.50000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.30000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ 0.10000 —
Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.0 unsat ✅ 2.60000 —
MathSAT MathSAT 4.3 unknown ❌ 900.00000 —
Yices2 Yices 2 proto unsat ✅ 0.10000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.06034 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.08012 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.07193 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.88475 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.70039 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.68495 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.39808 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.43870 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.23013 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.45161 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31104 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23026 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.13949 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.25045 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.12414 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.15884 —
Z3-SMT-COMP-2011 default unsat ✅ 0.15263 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.16561 0.16298
Boolector boolectorj unsat ✅ 0.17308 0.16397
CVC4 CVC4 f7118b2 default unsat ✅ 0.62151 0.61191
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02511 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03265 0.03100
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.17981 0.17897
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.23765 0.22596
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.05365 0.05199
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.13440 0.12598
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.09333 0.09198
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.65200 0.64990
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.64279 0.63990
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.14359 0.14298
Yices2 Yices default unsat ✅ 0.05424 0.05299
Z3 z3 4.4.0 default unsat ✅ 0.14614 0.14598
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.09457 0.09456
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.63385 0.63438
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.12676 0.12782
Yices2 Yices-2.4.2 default unsat ✅ 0.05613 0.05611
Z3 z3-4.4.1 default unsat ✅ 0.13793 0.13925
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.08870 0.08796
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.73756 0.73774
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.13005 0.13049
Yices2 Yices2-Main default unsat ✅ 0.05344 0.05340
Z3 z3-4.5.0 default unsat ✅ 0.15032 0.14827
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.08329 0.08320
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.69857 0.69852
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.12679 0.12774
Yices2 Yices 2.6.0_default unsat ✅ 0.05329 0.05322
Z3 z3-4.7.1_default unsat ✅ 0.15147 0.15136
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10151 0.10147
Boolector Boolector-wrapped-sq_default unsat ✅ 0.10718 0.10718
CVC4 CVC4-sq-final_default unsat ✅ 1.04220 1.04249
MathSAT MathSAT5_default.sh unsat ✅ 0.13342 0.13337
Par4 Par4-wrapped-sq_default unsat ✅ 0.05985 0.00598
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05780 0.05775
Z3 z3-4.8.8_default unsat ✅ 0.14964 0.14960
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.10748 0.10744
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.95106 0.94972
MathSAT MathSAT-5.6.8_default unsat ✅ 0.13460 0.13456
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05863 0.05857
Z3 z3-4.8.17_default unsat ✅ 0.13510 0.13689