Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1311.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1567600
Compressed Size106463
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1567592
Compressed Size106474
Max. Term Depth5
Asserts 11241
Declared Functions0
Declared Constants10945
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite645 not547 =11330 concat214
extract1219 bvnot1 bvand165 bvor249
bvadd4846 bvmul204 bvsub132 bvult16
bvule1 bvslt1 bvsle217 bvshl109
bvlshr216 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.37303 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.31691 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.30318 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.30399 —
abziz_portfolio_2012_solvers default unsat ✅ 0.31377 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.30177 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.12363 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.16891 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.13442 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 126.89900 —
CVC3-SMT-COMP-2011 default unsat ✅ 107.43800 —
CVC3-SMT-COMP-2012 default unsat ✅ 112.08100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.38435 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.55738 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.50317 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.63853 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.54645 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.53879 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.36357 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.67254 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.67087 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.42307 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.25074 —
STP2-SMT-COMP-2012 default unsat ✅ 0.18640 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.46133 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.48446 —
Z3-SMT-COMP-2011 default unsat ✅ 0.29630 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.16897 0.16797
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.21056 3.87041
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.17044 3.79842
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.58015 0.57891
SMT-RAT SMT-RAT-final default unknown ❌ 379.51800 379.41000
STP stp-cryptominisat4 default unsat ✅ 0.15726 0.15598
stp-cmsat4-v15 default unsat ✅ 0.15730 0.15598
stp-cmsat4-mt-v15 default unsat ✅ 0.15647 0.15498
stp-minisat-v15 default unsat ✅ 0.15694 0.15598
Yices2 Yices default unsat ✅ 0.05254 0.05199
Z3 z3 4.4.0 default unsat ✅ 0.53566 0.53592
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 28.93110 28.94570
ABC_glucose glucose unsat ✅ 270.41000 270.54900
Boolector Boolector boolector unsat ✅ 0.24523 0.24551
Boolector preprop boolector unsat ✅ 0.24083 0.24089
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.12703 3.70055
MapleSTP MapleSTP default unsat ✅ 0.14938 0.14943
MapleSTP-mt default unsat ✅ 0.14662 0.14668
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.50859 0.51021
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27086 0.27100
Q3B Q3B default unknown ❌ 2400.02000 7203.67000
STP stp-cms-exp-2016 default unsat ✅ 0.15124 0.15129
stp-cms-mt-2016 default unsat ✅ 0.15173 0.15177
stp-cms-st-2016 default unsat ✅ 0.15214 0.15218
stp-minisat-st-2016 default unsat ✅ 0.15113 0.15114
Yices2 Yices-2.4.2 default unsat ✅ 0.05337 0.05335
Z3 z3-4.4.1 default unsat ✅ 0.53576 0.53820
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.25365 0.24628
Boolector SMT17 final boolector unsat ✅ 0.29842 0.29773
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.31952 4.06207
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.53807 0.53497
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.21768 0.21736
Q3B Q3B default unknown ❌ 600.05900 1799.65000
STP stp_st default unsat ✅ 0.20333 0.20289
stp_mt default unsat ✅ 0.18821 0.18824
Yices2 Yices2-Main default unsat ✅ 0.05011 0.04940
Z3 z3-4.5.0 default unsat ✅ 0.60234 0.60155
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.21330 0.21317
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.88140 2.87842
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.51102 0.51195
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.22911 0.22895
Minkeyrink ST_st unsat ✅ 0.22703 0.22708
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.18225 0.18221
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.18371 0.18357
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.18556 0.18537
Yices2 Yices 2.6.0_default unsat ✅ 0.05204 0.05194
Z3 z3-4.7.1_default unsat ✅ 0.60201 0.60183
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.36031 0.36030
Poolector-wrapped-sq_default unsat ✅ 0.58088 1.95124
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.34696 0.34696
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.25103 2.25128
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.23160 0.23179
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.22982 0.22989
Par4 Par4-wrapped-sq_default unsat ✅ 0.05951 0.00609
STP STP-2019-wrapped-sq_default unsat ✅ 0.19318 0.19330
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.19222 0.19239
stp-minisat-wrapped-sq_default unsat ✅ 0.19212 0.19222
stp-mt-wrapped-sq_default unsat ✅ 0.19212 0.19223
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.18779 0.18782
stp-riss-wrapped-sq_default unsat ✅ 0.18780 0.18774
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05289 0.05287
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05246 0.05248
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05228 0.05228
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11426 0.11426
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05206 0.05207
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.56158 0.56147
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.33766 0.33762
Boolector Boolector-wrapped-sq_default unsat ✅ 0.36633 0.36625
Poolector-wrapped-sq_default unsat ✅ 0.57891 1.92087
CVC4 CVC4-sq-final_default unsat ✅ 2.50312 2.50298
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 17.72330 17.72270
MathSAT MathSAT5_default.sh unsat ✅ 0.38733 0.38709
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.19138 0.19147
MinkeyRink Solver 2020.3_default unsat ✅ 0.20102 0.20115
STP STP_default unsat ✅ 0.17175 0.17186
STP ++ Mergsat v1_default unsat ✅ 0.16757 0.16923
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05878 0.05872
Z3 z3-4.8.8_default unsat ✅ 0.55517 0.55503
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.33353 0.33348
MathSAT mathsat-5.6.6_default unsat ✅ 0.39086 0.39085
STP STP 2021.0_default unsat ✅ 0.17593 0.17602
Z3 z3-4.8.11_default unsat ✅ 0.61868 0.61857
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 4.00530 4.00478
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.32816 2.32867
STP STP 2022.4_default unsat ✅ 0.21200 0.21202
STP 2022.4_default unsat ✅ 0.21160 0.21161
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.57340 35.42440
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06320 0.06315
Z3-Owl z3-Owl-Final_default unsat ✅ 2.90062 2.90047
z3-Owl-Final_default unsat ✅ 2.90753 2.87100
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.98551 1.88547
cvc5 cvc5 unsat ✅ 1.73027 1.63056
SMTInterpol SMTInterpol unknown ❌ 1201.71657 1251.11901
STP STP unsat ✅ 0.37744 0.27736
Yices2 Yices2 unsat ✅ 0.24938 0.14952
Z3alpha Z3-alpha unsat ✅ 0.44966 0.34964