Benchmark

non-incremental/QF_ABV/platania/strcmp/strcmp57.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling a program that compares the content of
two arrays of size N (the increasing parameter) until either a difference or
the termination element (0) is found.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size38590
Compressed Size3254
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 38582
Compressed Size3266
Max. Term Depth344
Asserts 59
Declared Functions0
Declared Constants62
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite56 not172 and399 =>114
=284 let225 bvadd56 bvsub1
bvult57 bvule57 select228

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 sat ✅ 0.10000
Z3 Z3 0.1 sat ✅ 0.20000
Z3 0.1 (fixed BV) sat ✅ 0.20000
SMT-COMP 2012 Boolector Boolector sat ✅ 3.10000
Boolector 1.5.23-833 sat ✅ 6.70000
CVC3 CVC3 v2.4.2 sat ✅ 0.50000
CVC4 1.0rc.3931 sat ✅ 2.80000
CVC4 1.0rc.3970 sat ✅ 2.70000
SONOLAR SONOLAR sat ✅ 319.40000
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar sat ✅ 22.70000
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 1.92171
Boolector-SMT-COMP-2011 default sat ✅ 3.42079
Boolector-SMT-COMP-2012 default sat ✅ 1.62756
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 0.35751
CVC3-SMT-COMP-2011 default sat ✅ 0.32731
CVC3-SMT-COMP-2012 default sat ✅ 0.32395
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.68626
CVC4-SMT-EVAL-2013 default sat ✅ 0.25282
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.21968
MathSAT5-SMT-COMP-2011 default sat ✅ 1.24802
MathSAT5-SMT-COMP-2012 default sat ✅ 0.77497
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 102.72500
SONOLAR-SMT-COMP-2011 default sat ✅ 83.21200
SONOLAR-SMT-COMP-2012 default sat ✅ 118.32700
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 51.22910
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.12538
Z3-SMT-COMP-2011 default sat ✅ 0.29056
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 72.37330 72.37700
Boolector boolectorj sat ✅ 182.37100 182.38100
CVC4 CVC4 f7118b2 default sat ✅ 0.41711 0.41494
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02733 0.01800
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04954 0.03699
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.52052 0.51992
SONOLAR sonolar_smtcomp-2014 default sat ✅ 71.02140 71.04520
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 3.99868 3.99139
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.19419 0.18597
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 8.19815 8.20075
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.37599 0.37394
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.37800 0.37494
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.45687 0.45593
Yices2 Yices default sat ✅ 5.06789 5.06923
Z3 z3 4.4.0 default sat ✅ 0.26216 0.26196
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 11.09390 11.10110
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.34336 0.34378
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.42452 0.42576
Yices2 Yices-2.4.2 default sat ✅ 3.09060 3.09264
Z3 z3-4.4.1 default sat ✅ 0.17384 0.17514
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 33.69510 33.69240
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.46911 0.46797
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.28763 0.28265
Yices2 Yices2-Main default sat ✅ 4.80131 4.80026
Z3 z3-4.5.0 default sat ✅ 0.32111 0.31931
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 12.67170 12.67100
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.38442 0.38460
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.17302 0.17405
Yices2 Yices 2.6.0_default sat ✅ 4.14783 4.14772
Z3 z3-4.7.1_default sat ✅ 0.30948 0.30935
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.05056 0.05047
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 53.31740 51.05240
MathSAT MathSAT-5.6.8_default sat ✅ 6.72844 6.72766
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 4.56670 4.56619
Z3 z3-4.8.17_default sat ✅ 0.10932 0.11117