Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1458.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1991197
Compressed Size137067
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1991189
Compressed Size137054
Max. Term Depth5
Asserts 14182
Declared Functions0
Declared Constants13818
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite799 not670 =14287 concat377
extract2009 bvnot1 bvand284 bvor454
bvadd5457 bvmul324 bvsub177 bvult16
bvule1 bvslt2 bvsle277 bvshl221
bvlshr379 sign_extend84

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 sat ✅ 2.40000 —
Boolector Boolector sat ✅ 0.60000 —
CVC3 CVC3-1.5 sat ✅ 316.80000 —
MathSAT MathSAT-4.2 sat ✅ 15.50000 —
Spear Spear sat ✅ 20.00000 —
Spear v1.9 (fh-1-2) sat ✅ 324.60000 —
SWORD SWORD v0.2 sat ✅ 9.20000 —
Z3 Z3.2 sat ✅ 0.70000 —
SMT-COMP 2009 0.25 (6/8) Beaver beaver-smtcomp-2009 sat ✅ 3.10000 —
Boolector Boolector sat ✅ 0.60000 —
Boolector 1.2 sat ✅ 0.70000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 sat ✅ 1.20000 —
OpenSMT OpenSMT 0.2 unknown ❌ 900.10000 —
STP STP #101 sat ✅ 4.60000 —
SWORD sword-1.0 sat ✅ 2.40000 —
Yices2 Yices 2 proto sat ✅ 0.10000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.56369 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.66848 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.67594 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.66879 —
abziz_portfolio_2012_solvers default sat ✅ 0.66786 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.66509 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.20632 —
Boolector-SMT-COMP-2011 default sat ✅ 2.76681 —
Boolector-SMT-COMP-2012 default sat ✅ 0.21878 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.87120 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.08857 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.65942 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.84813 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.73114 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.72104 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.66678 —
SONOLAR-SMT-COMP-2010 default sat ✅ 15.81070 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.04419 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.74389 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.56823 —
STP2-SMT-COMP-2012 default sat ✅ 0.64428 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.17532 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.90158 —
Z3-SMT-COMP-2011 default sat ✅ 0.65714 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.46656 0.45993
Abziz abziz_portfolio_all_features default sat ✅ 1.71399 1.70174
abziz_portfolio_min_features default sat ✅ 1.70308 1.68974
Boolector Boolector boolector sat ✅ 1.38524 1.37779
CVC4 CVC4 f7118b2 default sat ✅ 2.98741 5.31119
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.61323 0.60391
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.65324 0.64290
STP stp-cryptominisat4 default sat ✅ 0.39550 0.38594
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.09916 0.08998
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.06868 1.06084
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.86335 0.86287
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.91147 5.11022
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.06749 5.43617
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.81843 0.81787
SMT-RAT SMT-RAT-final default unknown ❌ 309.81800 307.18000
STP stp-cryptominisat4 default sat ✅ 0.38415 0.38294
stp-cmsat4-v15 default sat ✅ 0.38330 0.38194
stp-cmsat4-mt-v15 default unknown ❌ 0.35889 0.35794
stp-minisat-v15 default sat ✅ 0.37878 0.37794
Yices2 Yices default sat ✅ 0.09187 0.09099
Z3 z3 4.4.0 default sat ✅ 1.05167 1.04784
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.03000 2401.20000
ABC_glucose glucose sat ✅ 373.09300 372.96000
Boolector Boolector boolector sat ✅ 1.85519 1.85624
Boolector preprop boolector sat ✅ 1.94818 1.94926
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.99921 5.28549
MapleSTP MapleSTP default sat ✅ 0.40117 0.40134
MapleSTP-mt default sat ✅ 0.42160 0.65721
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.71776 0.71919
MinkeyRink Minkeyrink 2016 default sat ✅ 1.01317 1.20191
Q3B Q3B default unknown ❌ 2400.08000 7203.91000
STP stp-cms-exp-2016 default sat ✅ 0.44846 0.44866
stp-cms-mt-2016 default sat ✅ 0.42895 0.66308
stp-cms-st-2016 default sat ✅ 0.40871 0.40926
stp-minisat-st-2016 default sat ✅ 0.37435 0.37452
Yices2 Yices-2.4.2 default sat ✅ 0.09249 0.09245
Z3 z3-4.4.1 default sat ✅ 1.02213 1.02467
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.47482 0.47346
Boolector SMT17 final boolector sat ✅ 0.46840 0.46833
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.15886 5.59323
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.73292 0.73264
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.68329 0.65540
Q3B Q3B default unknown ❌ 600.07200 1799.63000
STP stp_st default sat ✅ 0.48248 0.48251
stp_mt default sat ✅ 0.45444 0.72094
Yices2 Yices2-Main default sat ✅ 0.08821 0.08810
Z3 z3-4.5.0 default sat ✅ 1.05152 1.04992
SMT-COMP 2018 Boolector Boolector_default sat ✅ 37.38990 37.38590
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.74980 3.74962
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.72552 0.72659
MinkeyRink Minkeyrink MT_mt sat ✅ 0.63890 0.67726
Minkeyrink ST_st sat ✅ 0.62901 0.62889
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.36111 0.36134
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.36879 0.41246
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.77459 0.77468
Yices2 Yices 2.6.0_default sat ✅ 0.08670 0.08664
Z3 z3-4.7.1_default sat ✅ 1.07871 1.07844
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.69165 0.69162
Poolector-wrapped-sq_default sat ✅ 0.99697 3.37000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 292.51300 292.46700
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.10425 3.10449
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.69663 0.72551
MinkeyRink ST-wrapped-sq_default sat ✅ 0.69039 0.69042
Par4 Par4-wrapped-sq_default sat ✅ 0.10335 0.00594
STP STP-2019-wrapped-sq_default sat ✅ 0.36867 0.36895
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.40403 0.40424
stp-minisat-wrapped-sq_default sat ✅ 0.38455 0.38479
stp-mt-wrapped-sq_default sat ✅ 0.38406 0.41360
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.44266 0.52718
stp-riss-wrapped-sq_default unknown ❌ 0.37871 0.37808
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.08973 0.08968
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.11376 0.11378
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.46785 0.46784
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 1.22884 1.22875
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.13435 0.13436
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.07121 1.07120
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.95821 1.95794
MathSAT mathsat-5.6.6_default sat ✅ 0.54170 0.54165
STP STP 2021.0_default sat ✅ 0.35904 0.38911
Z3 z3-4.8.11_default sat ✅ 1.52081 1.52077
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.97139 1.97094
Bitwuzla-wrapped_default sat ✅ 2.01650 2.01639
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.71481 4.71504
MathSAT MathSAT-5.6.8_default sat ✅ 0.55935 0.55934
STP STP 2022.4_default sat ✅ 0.63669 0.63666
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.10212 0.10205
Z3++BV z3++bv_0702_default sat ✅ 0.70703 0.70664
Z3 z3-4.8.17_default sat ✅ 1.44693 1.44860
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 2.79684 2.69666
cvc5 cvc5 sat ✅ 2.59681 2.49224
SMTInterpol SMTInterpol unknown ❌ 1202.22512 1257.07374
STP STP sat ✅ 0.87314 0.77277
Yices2 Yices2 sat ✅ 0.29178 0.19213
Z3alpha Z3-alpha sat ✅ 0.52377 0.42400
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.93409 0.81327
Bitwuzla-MachBV-base sat ✅ 1.86130 1.74091
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.98758 1.86756
BVDecide bv_decide sat ✅ 1111.03804 1110.80697
bv_decide-nokernel sat ✅ 181.53068 181.40107
cvc5 cvc5 sat ✅ 1.61833 1.48252
SMTInterpol SMTInterpol unknown ❌ 1201.68908 1233.56076
Yices2 Yices2 sat ✅ 0.30729 0.18977
Z3alpha Z3-alpha sat ✅ 1.11215 2.23444
Z3 Z3-alpha-base sat ✅ 0.80144 0.67510
Z3-Owl-base sat ✅ 2.69841 2.57114
z3siri-base sat ✅ 0.78678 0.65421
Z3-Owl Z3-Owl sat ✅ 3.69267 3.56273