Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1447.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1964478
Compressed Size135419
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1964470
Compressed Size135428
Max. Term Depth5
Asserts 14005
Declared Functions0
Declared Constants13642
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite797 not668 =14109 concat368
extract1945 bvnot1 bvand283 bvor445
bvadd5411 bvmul303 bvsub168 bvult16
bvule1 bvslt2 bvsle277 bvshl217
bvlshr370 sign_extend74

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 0.25 (6/8) Beaver beaver-smtcomp-2009 sat ✅ 3.10000 —
Boolector Boolector sat ✅ 0.60000 —
Boolector 1.2 sat ✅ 0.70000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 sat ✅ 1.20000 —
OpenSMT OpenSMT 0.2 unknown ❌ 900.10000 —
STP STP #101 sat ✅ 4.40000 —
SWORD sword-1.0 sat ✅ 2.30000 —
Yices2 Yices 2 proto sat ✅ 0.10000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.24261 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.66318 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.67181 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.66664 —
abziz_portfolio_2012_solvers default sat ✅ 0.66873 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.66797 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.20554 —
Boolector-SMT-COMP-2011 default sat ✅ 2.74036 —
Boolector-SMT-COMP-2012 default sat ✅ 0.21296 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.87061 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.09110 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.65815 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.83916 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.72785 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.71240 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.66724 —
SONOLAR-SMT-COMP-2010 default sat ✅ 15.89390 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.03195 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.73155 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.55369 —
STP2-SMT-COMP-2012 default sat ✅ 0.63684 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.15095 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.87472 —
Z3-SMT-COMP-2011 default sat ✅ 0.65997 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.86440 0.86387
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.86682 5.03423
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.03781 5.38218
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.84873 0.84787
SMT-RAT SMT-RAT-final default unknown ❌ 288.71800 288.68000
STP stp-cryptominisat4 default sat ✅ 0.38460 0.38394
stp-cmsat4-v15 default sat ✅ 0.37903 0.37794
stp-cmsat4-mt-v15 default unknown ❌ 0.36474 0.36394
stp-minisat-v15 default sat ✅ 0.37322 0.37194
Yices2 Yices default sat ✅ 0.09095 0.08999
Z3 z3 4.4.0 default sat ✅ 1.07558 1.07584
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.09000 2401.45000
ABC_glucose glucose sat ✅ 359.79700 359.81200
Boolector Boolector boolector sat ✅ 1.86110 1.86215
Boolector preprop boolector sat ✅ 0.36619 0.36628
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.97699 5.24910
MapleSTP MapleSTP default sat ✅ 0.40014 0.40104
MapleSTP-mt default sat ✅ 0.42108 0.66131
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.71053 0.71176
MinkeyRink Minkeyrink 2016 default sat ✅ 1.01861 1.22150
Q3B Q3B default unknown ❌ 2400.05000 7203.90000
STP stp-cms-exp-2016 default sat ✅ 0.44538 0.44561
stp-cms-mt-2016 default sat ✅ 0.42503 0.65381
stp-cms-st-2016 default sat ✅ 0.41202 0.41222
stp-minisat-st-2016 default sat ✅ 0.37062 0.37079
Yices2 Yices-2.4.2 default sat ✅ 0.09106 0.09176
Z3 z3-4.4.1 default sat ✅ 1.01422 1.01596
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.56590 0.56463
Boolector SMT17 final boolector sat ✅ 0.48409 0.48211
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.13096 5.54775
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.77113 0.77011
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.69569 0.66580
Q3B Q3B default unknown ❌ 600.07100 1427.93000
STP stp_st default sat ✅ 0.43152 0.43094
stp_mt default sat ✅ 0.53763 0.72995
Yices2 Yices2-Main default sat ✅ 0.08645 0.08554
Z3 z3-4.5.0 default sat ✅ 1.07719 1.07601
SMT-COMP 2018 Boolector Boolector_default sat ✅ 37.84440 37.84200
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.64581 3.64560
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.72011 0.72121
MinkeyRink Minkeyrink MT_mt sat ✅ 0.63368 0.67345
Minkeyrink ST_st sat ✅ 0.62658 0.62667
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.35894 0.35912
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.36733 0.41070
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.73631 0.73608
Yices2 Yices 2.6.0_default sat ✅ 0.08566 0.08558
Z3 z3-4.7.1_default sat ✅ 1.06855 1.06848
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.76717 1.76690
Boolector Boolector-wrapped-sq_default sat ✅ 0.56981 0.56980
Poolector-wrapped-sq_default sat ✅ 0.88445 3.03299
CVC4 CVC4-sq-final_default sat ✅ 3.37670 3.37651
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.10000 1199.95000
MathSAT MathSAT5_default.sh sat ✅ 0.53966 0.53961
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.59241 0.59258
MinkeyRink Solver 2020.3_default sat ✅ 0.63055 1.27621
STP STP_default sat ✅ 0.34283 0.37303
STP ++ Mergsat v1_default sat ✅ 0.32883 0.33056
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.13364 0.13359
Z3 z3-4.8.8_default sat ✅ 1.03096 1.03083
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.78138 1.78114
MathSAT mathsat-5.6.6_default sat ✅ 0.53853 0.53846
STP STP 2021.0_default sat ✅ 0.35226 0.38073
Z3 z3-4.8.11_default sat ✅ 1.14613 1.14603
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 5.65219 5.65226
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 3.11526 3.11020
STP STP 2022.4_default sat ✅ 0.64659 0.64277
STP 2022.4_default sat ✅ 0.62634 0.62638
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.75890 35.53390
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.10406 0.10404
Z3-Owl z3-Owl-Final_default sat ✅ 7.43636 7.43570
z3-Owl-Final_default sat ✅ 7.32802 7.32697
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.96154 0.83410
Bitwuzla-MachBV-base sat ✅ 1.81854 1.69816
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.89846 1.77984
BVDecide bv_decide sat ✅ 1051.06073 1050.81031
bv_decide-nokernel sat ✅ 177.58441 177.47441
cvc5 cvc5 sat ✅ 1.67047 1.55358
SMTInterpol SMTInterpol unknown ❌ 1201.69662 1234.81598
Yices2 Yices2 sat ✅ 0.32048 0.20508
Z3alpha Z3-alpha sat ✅ 1.08346 2.17372
Z3 Z3-alpha-base sat ✅ 0.83696 0.71094
Z3-Owl-base sat ✅ 2.94029 2.81627
z3siri-base sat ✅ 0.87880 0.74630
Z3-Owl Z3-Owl sat ✅ 3.74602 3.61448