Benchmark

non-incremental/QF_ABV/platania/strcmp/strcmp22.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling a program that compares the content of
two arrays of size N (the increasing parameter) until either a difference or
the termination element (0) is found.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size15210
Compressed Size1893
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 15202
Compressed Size1919
Max. Term Depth134
Asserts 24
Declared Functions0
Declared Constants27
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite21 not67 and154 =>44
=109 let85 bvadd21 bvsub1
bvult22 bvule22 select88

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 Boolector Boolector sat ✅ 0.30000 —
Boolector 1.2 sat ✅ 0.50000 —
CVC3 CVC3 2.0 sat ✅ 0.90000 —
MathSAT MathSAT 4.3 sat ✅ 0.10000 —
Yices2 Yices 2 proto sat ✅ 1.90000 —
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.10601 —
Boolector-SMT-COMP-2011 default sat ✅ 0.49583 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 0.12763 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default sat ✅ 0.11495 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default sat ✅ 0.07780 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.08227 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.15393 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 2.60215 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default sat ✅ 3.71419 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.03802 —
Z3-SMT-COMP-2011 default sat ✅ 0.05630 —
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 4.89674 4.89325
Boolector boolectorj sat ✅ 2.80135 2.79157
CVC4 CVC4 f7118b2 default sat ✅ 0.12305 0.11298
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.68344 0.65690
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.05319 0.09798
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.07798 0.07099
SONOLAR sonolar_smtcomp-2014 default sat ✅ 3.73737 3.72743
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.63809 0.63690
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.08407 0.07099
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.47903 0.47793
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.10978 0.10798
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.10968 0.10698
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.12806 0.12698
Yices2 Yices default sat ✅ 0.30043 0.29995
Z3 z3 4.4.0 default sat ✅ 0.07933 0.07899
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.40118 0.40137
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.10472 0.10493
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.11775 0.11875
Yices2 Yices-2.4.2 default sat ✅ 0.48383 0.48399
Z3 z3-4.4.1 default sat ✅ 0.07347 0.07473
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 1.75000 1.74908
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.13766 0.13468
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.09932 0.09747
Yices2 Yices2-Main default sat ✅ 0.31238 0.31168
Z3 z3-4.5.0 default sat ✅ 0.09135 0.09082
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 3.26263 3.26239
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.11664 0.11686
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.09596 0.09682
Yices2 Yices 2.6.0_default sat ✅ 0.14572 0.14564
Z3 z3-4.7.1_default sat ✅ 0.08685 0.08675
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.02095 0.02098
Poolector-wrapped-sq_default sat ✅ 0.17808 0.13638
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.12301 0.12337
Par4 Par4-wrapped-sq_default sat ✅ 0.13375 0.00662
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.37830 0.37830
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.11383 0.11381
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.02044 0.01952
Boolector Boolector-wrapped-sq_default sat ✅ 0.02098 0.02097
CVC4 CVC4-sq-final_default sat ✅ 0.21057 0.21084
MathSAT MathSAT5_default.sh sat ✅ 0.36886 0.36876
Par4 Par4-wrapped-sq_default sat ✅ 0.13293 0.00616
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.28840 0.28834
Z3 z3-4.8.8_default sat ✅ 1.06523 1.06524
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.02295 0.02258
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.49175 0.49233
MathSAT MathSAT-5.6.8_default sat ✅ 0.28625 0.28618
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.30060 0.30008
Z3 z3-4.8.17_default sat ✅ 0.51774 0.51950
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.23491 0.13518
cvc5 cvc5 sat ✅ 0.49429 0.39475
SMTInterpol SMTInterpol sat ✅ 2.48822 7.02212
Yices2 Yices2 sat ✅ 0.38788 0.28849
SMT-COMP 2025 Bitwuzla Bitwuzla sat ✅ 0.29259 0.16541
cvc5 cvc5 sat ✅ 0.37581 0.24723
SMTInterpol SMTInterpol sat ✅ 2.12424 5.87226
Yices2 Yices2 sat ✅ 0.55308 0.42502
Z3 Z3-Owl-base sat ✅ 2.10562 1.98645
Z3-Owl Z3-Owl sat ✅ 6.20411 6.07517