Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1155.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1158280
Compressed Size76095
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1158272
Compressed Size76106
Max. Term Depth5
Asserts 8384
Declared Functions0
Declared Constants8163
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite491 not451 =8408 concat88
extract656 bvnot1 bvand75 bvor120
bvadd4104 bvmul45 bvsub40 bvult16
bvule1 bvslt2 bvsle204 bvshl72
bvlshr90 sign_extend14

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.24665 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.25177 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.25545 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.25420 —
abziz_portfolio_2012_solvers default sat ✅ 0.25342 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.26266 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.10262 —
Boolector-SMT-COMP-2011 default sat ✅ 0.28862 —
Boolector-SMT-COMP-2012 default sat ✅ 0.10860 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 90.34650 —
CVC3-SMT-COMP-2011 default sat ✅ 77.17220 —
CVC3-SMT-COMP-2012 default sat ✅ 81.01970 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.91929 —
CVC4-SMT-EVAL-2013 default sat ✅ 1.05244 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.40034 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.48985 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.41270 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.42593 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.31609 —
SONOLAR-SMT-COMP-2010 default sat ✅ 8.94488 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.44758 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.36028 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.27529 —
STP2-SMT-COMP-2012 default sat ✅ 0.18585 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 1.03472 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.34986 —
Z3-SMT-COMP-2011 default sat ✅ 0.25646 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.22160 0.21197
Abziz abziz_portfolio_all_features default sat ✅ 0.59051 0.54592
abziz_portfolio_min_features default sat ✅ 0.55725 0.54392
Boolector Boolector boolector sat ✅ 0.14545 0.13698
CVC4 CVC4 f7118b2 default sat ✅ 1.48970 2.58061
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.36059 0.35195
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.31017 0.29895
STP stp-cryptominisat4 default sat ✅ 0.18925 0.18097
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.05998 0.05099
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.42433 0.41594
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.21350 0.21297
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.46017 2.50362
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.57929 2.74858
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.47912 0.47793
SMT-RAT SMT-RAT-final default sat ✅ 1021.32000 1021.74000
STP stp-cryptominisat4 default sat ✅ 0.18250 0.18197
stp-cmsat4-v15 default sat ✅ 0.18037 0.17897
stp-cmsat4-mt-v15 default unknown ❌ 0.17811 0.17697
stp-minisat-v15 default sat ✅ 0.17926 0.17797
Yices2 Yices default sat ✅ 0.05187 0.05099
Z3 z3 4.4.0 default sat ✅ 0.44276 0.44293
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 19.19780 19.20930
ABC_glucose glucose sat ✅ 183.95800 184.06100
Boolector Boolector boolector sat ✅ 0.27613 0.27645
Boolector preprop boolector sat ✅ 0.31709 0.31718
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.50342 2.59313
MapleSTP MapleSTP default sat ✅ 0.15792 0.15795
MapleSTP-mt default sat ✅ 0.16487 0.17504
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.42399 0.42534
MinkeyRink Minkeyrink 2016 default sat ✅ 0.35031 0.36378
Q3B Q3B default unknown ❌ 2400.06000 7203.83000
STP stp-cms-exp-2016 default sat ✅ 0.16260 0.16266
stp-cms-mt-2016 default sat ✅ 0.17132 0.18018
stp-cms-st-2016 default sat ✅ 0.16239 0.16245
stp-minisat-st-2016 default sat ✅ 0.16659 0.16665
Yices2 Yices-2.4.2 default sat ✅ 0.05505 0.05519
Z3 z3-4.4.1 default sat ✅ 0.39130 0.39275
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.20223 0.20080
Boolector SMT17 final boolector sat ✅ 0.20344 0.20266
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.62704 2.83423
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.42776 0.42842
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.32980 0.29162
Q3B Q3B default unknown ❌ 600.04200 1799.47000
STP stp_st default sat ✅ 0.17777 0.17726
stp_mt default sat ✅ 0.19970 0.20415
Yices2 Yices2-Main default sat ✅ 0.05063 0.05048
Z3 z3-4.5.0 default sat ✅ 0.41236 0.41232
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.67226 0.67210
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.70977 1.70969
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.41852 0.41957
MinkeyRink Minkeyrink MT_mt sat ✅ 0.30728 0.31997
Minkeyrink ST_st sat ✅ 0.30067 0.30088
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.17250 0.17265
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.17675 0.18353
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.21474 0.21472
Yices2 Yices 2.6.0_default sat ✅ 0.05209 0.05202
Z3 z3-4.7.1_default sat ✅ 0.44149 0.44125
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.29018 0.29018
Poolector-wrapped-sq_default sat ✅ 0.48053 0.46650
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 4.02930 4.02896
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 1.51580 1.51581
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.34375 0.35389
MinkeyRink ST-wrapped-sq_default sat ✅ 0.34003 0.34013
Par4 Par4-wrapped-sq_default sat ✅ 0.06180 0.00598
STP STP-2019-wrapped-sq_default sat ✅ 0.18125 0.18157
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.17866 0.17885
stp-minisat-wrapped-sq_default sat ✅ 0.17665 0.17686
stp-mt-wrapped-sq_default sat ✅ 0.18508 0.19069
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.21429 0.22960
stp-riss-wrapped-sq_default unknown ❌ 0.17807 0.17827
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.05277 0.05280
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.06573 0.06574
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.19417 0.19418
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.13272 0.13273
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.08284 0.08278
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.41766 0.41763
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.43852 0.43849
Boolector Boolector-wrapped-sq_default sat ✅ 0.31811 0.31796
Poolector-wrapped-sq_default sat ✅ 0.47888 0.49723
CVC4 CVC4-sq-final_default sat ✅ 1.67126 3.24156
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.95000
MathSAT MathSAT5_default.sh sat ✅ 0.30811 0.30804
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.28459 0.28483
MinkeyRink Solver 2020.3_default sat ✅ 0.30613 0.31622
STP STP_default sat ✅ 0.16894 0.17413
STP ++ Mergsat v1_default sat ✅ 0.16003 0.16172
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.05804 0.05794
Z3 z3-4.8.8_default sat ✅ 0.41975 0.41970
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.43918 0.43914
MathSAT mathsat-5.6.6_default sat ✅ 0.30697 0.30692
STP STP 2021.0_default sat ✅ 0.17295 0.17851
Z3 z3-4.8.11_default sat ✅ 0.46872 0.46856
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.48894 0.36573
Bitwuzla-MachBV-base sat ✅ 0.59205 0.47462
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.67719 0.55433
BVDecide bv_decide sat ✅ 354.24540 354.09909
bv_decide-nokernel sat ✅ 70.93996 70.82989
cvc5 cvc5 sat ✅ 0.93511 0.81959
SMTInterpol SMTInterpol unknown ❌ 1201.58766 1225.27716
Yices2 Yices2 sat ✅ 0.28670 0.16839
Z3alpha Z3-alpha sat ✅ 0.75187 1.22223
Z3 Z3-alpha-base sat ✅ 0.45983 0.33217
Z3-Owl-base sat ✅ 1.09587 0.96568
z3siri-base sat ✅ 0.45682 0.32863
Z3-Owl Z3-Owl sat ✅ 1.66590 1.53884