Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1405.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1843191
Compressed Size126787
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1843183
Compressed Size126775
Max. Term Depth5
Asserts 13202
Declared Functions0
Declared Constants12844
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite787 not658 =13301 concat323
extract1650 bvnot1 bvand278 bvor400
bvadd5201 bvmul204 bvsub133 bvult16
bvule1 bvslt2 bvsle277 bvshl207
bvlshr325 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.67 (1/3) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SONOLAR SONOLAR r252 unknown ❌ 1200.00000 —
STP simplifyingSTP sat ✅ 11.10000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.23789 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.64256 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.64568 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.64666 —
abziz_portfolio_2012_solvers default sat ✅ 0.64646 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.66699 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.19524 —
Boolector-SMT-COMP-2011 default sat ✅ 2.71618 —
Boolector-SMT-COMP-2012 default sat ✅ 0.20164 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.74384 —
CVC4-SMT-EVAL-2013 default sat ✅ 1.95421 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.62001 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.80695 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.69507 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.67684 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.63838 —
SONOLAR-SMT-COMP-2010 default sat ✅ 13.87390 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.99824 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.69156 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.53149 —
STP2-SMT-COMP-2012 default sat ✅ 0.62456 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.04123 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.85058 —
Z3-SMT-COMP-2011 default sat ✅ 0.63828 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.43552 0.42793
Abziz abziz_portfolio_all_features default sat ✅ 1.64221 1.62875
abziz_portfolio_min_features default sat ✅ 1.65025 1.63675
Boolector Boolector boolector sat ✅ 1.33014 1.32180
CVC4 CVC4 f7118b2 default sat ✅ 2.80850 5.00924
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.58194 0.57291
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.61190 0.60191
STP stp-cryptominisat4 default sat ✅ 0.37967 0.37094
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.09306 0.08399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.01836 1.00984
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.86029 0.85987
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.72984 4.79427
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.87563 5.10222
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.78903 0.78788
SMT-RAT SMT-RAT-final default unknown ❌ 351.01800 350.96000
STP stp-cryptominisat4 default sat ✅ 0.37403 0.37294
stp-cmsat4-v15 default sat ✅ 0.36795 0.36594
stp-cmsat4-mt-v15 default unknown ❌ 0.35489 0.35395
stp-minisat-v15 default sat ✅ 0.36054 0.35994
Yices2 Yices default sat ✅ 0.08553 0.08399
Z3 z3 4.4.0 default sat ✅ 0.99011 0.99085
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.02000 2401.37000
ABC_glucose glucose sat ✅ 315.48900 315.43800
Boolector Boolector boolector sat ✅ 1.85558 1.85674
Boolector preprop boolector sat ✅ 1.91971 1.92045
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.81525 4.96447
MapleSTP MapleSTP default sat ✅ 0.37731 0.37749
MapleSTP-mt default sat ✅ 0.39852 0.61161
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.69712 0.69856
MinkeyRink Minkeyrink 2016 default sat ✅ 0.99043 1.17856
Q3B Q3B default unknown ❌ 2400.07000 7204.32000
STP stp-cms-exp-2016 default sat ✅ 0.42295 0.42309
stp-cms-mt-2016 default sat ✅ 0.41015 0.63420
stp-cms-st-2016 default sat ✅ 0.39204 0.39216
stp-minisat-st-2016 default sat ✅ 0.36628 0.36642
Yices2 Yices-2.4.2 default sat ✅ 0.08742 0.08760
Z3 z3-4.4.1 default sat ✅ 0.98924 0.99103
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.43174 0.42464
Boolector SMT17 final boolector sat ✅ 0.45822 0.45711
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.99127 5.30987
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.74637 0.73947
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.70435 0.67157
Q3B Q3B default unknown ❌ 600.06600 1786.19000
STP stp_st default sat ✅ 0.46181 0.46135
stp_mt default sat ✅ 0.43284 0.69292
Yices2 Yices2-Main default sat ✅ 0.08207 0.08147
Z3 z3-4.5.0 default sat ✅ 0.99238 0.99163
SMT-COMP 2018 Boolector Boolector_default sat ✅ 26.78950 26.78890
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.48147 3.48165
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.69963 0.70059
MinkeyRink Minkeyrink MT_mt sat ✅ 0.59614 0.63504
Minkeyrink ST_st sat ✅ 0.58778 0.58789
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.34169 0.34171
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.35247 0.39574
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.71978 0.71957
Yices2 Yices 2.6.0_default sat ✅ 0.08067 0.08062
Z3 z3-4.7.1_default sat ✅ 0.95982 0.95959
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.53572 0.53567
Poolector-wrapped-sq_default sat ✅ 0.79242 2.76658
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 322.95800 322.93200
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.96121 2.96135
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.65643 0.68439
MinkeyRink ST-wrapped-sq_default sat ✅ 0.64243 0.64250
Par4 Par4-wrapped-sq_default sat ✅ 0.09493 0.00591
STP STP-2019-wrapped-sq_default sat ✅ 0.35495 0.35524
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.39107 0.39123
stp-minisat-wrapped-sq_default sat ✅ 0.37508 0.37528
stp-mt-wrapped-sq_default sat ✅ 0.36274 0.39170
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.43983 0.50104
stp-riss-wrapped-sq_default unknown ❌ 0.34814 0.34835
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.08451 0.08453
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.10765 0.10763
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.43547 0.43541
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.80074 0.80072
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.12754 0.12753
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.05057 1.05055
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.38353 1.38349
MathSAT mathsat-5.6.6_default sat ✅ 0.51256 0.51248
STP STP 2021.0_default sat ✅ 0.34024 0.37271
Z3 z3-4.8.11_default sat ✅ 1.09722 1.09706
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.39241 1.39232
Bitwuzla-wrapped_default sat ✅ 1.40712 1.40685
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.36626 4.36545
MathSAT MathSAT-5.6.8_default sat ✅ 0.52811 0.52804
STP STP 2022.4_default sat ✅ 0.59357 0.59362
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.09696 0.09690
Z3++BV z3++bv_0702_default sat ✅ 0.66932 0.66918
Z3 z3-4.8.17_default sat ✅ 1.24352 1.24527
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.91459 0.79528
Bitwuzla-MachBV-base sat ✅ 1.84343 1.71643
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.91300 1.78153
BVDecide bv_decide sat ✅ 995.21232 994.88883
bv_decide-nokernel sat ✅ 157.82163 157.70924
cvc5 cvc5 sat ✅ 1.59772 1.48370
SMTInterpol SMTInterpol unknown ❌ 1201.78774 1233.70157
Yices2 Yices2 sat ✅ 0.33416 0.20673
Z3alpha Z3-alpha sat ✅ 1.04432 2.13967
Z3 Z3-alpha-base sat ✅ 0.72103 0.60101
Z3-Owl-base sat ✅ 2.54281 2.41207
z3siri-base sat ✅ 0.75802 0.62630
Z3-Owl Z3-Owl sat ✅ 3.57997 3.45315