Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1239.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1510718
Compressed Size101971
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1510710
Compressed Size101979
Max. Term Depth5
Asserts 10811
Declared Functions0
Declared Constants10531
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite613 not525 =10896 concat213
extract1201 bvnot1 bvand164 bvor248
bvadd4701 bvmul204 bvsub132 bvult16
bvule1 bvslt1 bvsle205 bvshl109
bvlshr215 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 unsat ✅ 1.50000 —
Boolector Boolector unsat ✅ 0.20000 —
CVC3 CVC3-1.5 unsat ✅ 93.70000 —
MathSAT MathSAT-4.2 unsat ✅ 3.90000 —
Spear Spear unsat ✅ 3.30000 —
Spear v1.9 (fh-1-2) unsat ✅ 33.20000 —
SWORD SWORD v0.2 unsat ✅ 3.10000 —
Z3 Z3.2 unsat ✅ 0.90000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.36383 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.30537 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.29341 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.29477 —
abziz_portfolio_2012_solvers default unsat ✅ 0.30093 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.30271 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.12360 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.16829 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.12868 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 123.44500 —
CVC3-SMT-COMP-2011 default unsat ✅ 105.42200 —
CVC3-SMT-COMP-2012 default unsat ✅ 110.55500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.34723 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.51758 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.48889 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.61778 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.53321 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.52076 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.37687 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.54616 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.58125 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.41759 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.24062 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17869 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.42066 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.48074 —
Z3-SMT-COMP-2011 default unsat ✅ 0.29012 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.16344 0.16197
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.16150 3.79442
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.12942 3.73543
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.56913 0.56791
SMT-RAT SMT-RAT-final default unsat ✅ 615.41900 612.92300
STP stp-cryptominisat4 default unsat ✅ 0.15125 0.14998
stp-cmsat4-v15 default unsat ✅ 0.15157 0.15098
stp-cmsat4-mt-v15 default unsat ✅ 0.15242 0.15197
stp-minisat-v15 default unsat ✅ 0.15212 0.15098
Yices2 Yices default unsat ✅ 0.05075 0.04999
Z3 z3 4.4.0 default unsat ✅ 0.52565 0.52592
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 27.86310 27.87870
ABC_glucose glucose unsat ✅ 262.46300 262.60900
Boolector Boolector boolector unsat ✅ 0.23775 0.23788
Boolector preprop boolector unsat ✅ 0.23182 0.23191
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.07844 3.62301
MapleSTP MapleSTP default unsat ✅ 0.14048 0.14049
MapleSTP-mt default unsat ✅ 0.14153 0.14156
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.49512 0.49563
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.25143 0.25153
Q3B Q3B default unknown ❌ 2400.07000 7203.86000
STP stp-cms-exp-2016 default unsat ✅ 0.14694 0.14699
stp-cms-mt-2016 default unsat ✅ 0.14650 0.14657
stp-cms-st-2016 default unsat ✅ 0.15037 0.15042
stp-minisat-st-2016 default unsat ✅ 0.14648 0.14650
Yices2 Yices-2.4.2 default unsat ✅ 0.05132 0.05131
Z3 z3-4.4.1 default unsat ✅ 0.52743 0.52901
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.24292 0.24219
Boolector SMT17 final boolector unsat ✅ 0.23686 0.23577
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.16314 3.78497
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49835 0.49879
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19168 0.19079
Q3B Q3B default unknown ❌ 600.03600 1786.60000
STP stp_st default unsat ✅ 0.20026 0.19947
stp_mt default unsat ✅ 0.20032 0.19952
Yices2 Yices2-Main default unsat ✅ 0.04931 0.04861
Z3 z3-4.5.0 default unsat ✅ 0.54280 0.54195
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.20470 0.20454
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.72830 2.72855
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.49583 0.49690
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.21648 0.21653
Minkeyrink ST_st unsat ✅ 0.21727 0.21727
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19641 0.19641
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.19750 0.19750
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19599 0.19599
Yices2 Yices 2.6.0_default unsat ✅ 0.05061 0.05055
Z3 z3-4.7.1_default unsat ✅ 0.57734 0.57729
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.35556 0.35553
Poolector-wrapped-sq_default unsat ✅ 0.58168 1.85019
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.34074 0.34070
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.23424 2.23447
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.22277 0.22292
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.21831 0.21840
Par4 Par4-wrapped-sq_default unsat ✅ 0.06249 0.00707
STP STP-2019-wrapped-sq_default unsat ✅ 0.20583 0.20596
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20166 0.20168
stp-minisat-wrapped-sq_default unsat ✅ 0.20797 0.20791
stp-mt-wrapped-sq_default unsat ✅ 0.20693 0.20710
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20624 0.20640
stp-riss-wrapped-sq_default unsat ✅ 0.20664 0.20676
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05120 0.05118
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05109 0.05112
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05124 0.05121
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11327 0.11328
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05162 0.05161
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.58608 0.58552
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.32768 0.32761
Boolector Boolector-wrapped-sq_default unsat ✅ 0.35089 0.35086
Poolector-wrapped-sq_default unsat ✅ 0.57844 1.90056
CVC4 CVC4-sq-final_default unsat ✅ 2.43877 2.43835
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 17.30290 17.30290
MathSAT MathSAT5_default.sh unsat ✅ 0.38418 0.38411
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.18067 0.18073
MinkeyRink Solver 2020.3_default unsat ✅ 0.18942 0.18953
STP STP_default unsat ✅ 0.18627 0.18635
STP ++ Mergsat v1_default unsat ✅ 0.18146 0.18310
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05734 0.05731
Z3 z3-4.8.8_default unsat ✅ 0.53959 0.53955
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.32444 0.32437
MathSAT mathsat-5.6.6_default unsat ✅ 0.38302 0.38301
STP STP 2021.0_default unsat ✅ 0.19164 0.19172
Z3 z3-4.8.11_default unsat ✅ 0.60056 0.60050
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.95928 3.95905
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.27620 2.27579
STP STP 2022.4_default unsat ✅ 0.20414 0.20417
STP 2022.4_default unsat ✅ 0.20409 0.20407
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.30520 34.46000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06264 0.06262
Z3-Owl z3-Owl-Final_default unsat ✅ 2.79534 2.79537
z3-Owl-Final_default unsat ✅ 2.81806 2.81633