Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1530.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2403459
Compressed Size162986
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2403451
Compressed Size162991
Max. Term Depth5
Asserts 17006
Declared Functions0
Declared Constants16588
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite925 not777 =17129 concat558
extract2688 bvnot1 bvand441 bvor668
bvadd6097 bvmul450 bvsub245 bvult16
bvule1 bvslt1 bvsle323 bvshl318
bvlshr560 sign_extend94

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.67 (1/3) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SONOLAR SONOLAR r252 unsat ✅ 10.00000 —
STP simplifyingSTP unknown ❌ 10.50000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69312 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.69247 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69728 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68030 —
abziz_portfolio_2012_solvers default unsat ✅ 0.69144 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68461 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.22595 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.27373 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24042 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 122.34400 —
CVC3-SMT-COMP-2011 default unsat ✅ — —
CVC3-SMT-COMP-2012 default unsat ✅ 109.32600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.53557 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.92692 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.87820 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.15354 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.98170 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.94988 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.66211 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.75991 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.22564 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.68099 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.46145 —
STP2-SMT-COMP-2012 default unsat ✅ 0.30075 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 2.76502 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.82344 —
Z3-SMT-COMP-2011 default unsat ✅ 0.67375 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 0.55918 0.55791
Abziz abziz_portfolio_all_features default unsat ✅ 1.41408 1.39979
abziz_portfolio_min_features default unsat ✅ 1.39990 1.38779
Boolector Boolector boolector unsat ✅ 0.26845 0.25896
CVC4 CVC4 f7118b2 default unsat ✅ 2.99873 5.20321
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.81449 0.80588
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.67504 0.66390
STP stp-cryptominisat4 default unsat ✅ 0.25764 0.25696
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.09207 0.08299
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.88378 0.87587
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.41247 0.41194
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.04712 7.24490
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.12057 5.40618
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.06635 1.06584
SMT-RAT SMT-RAT-final default unknown ❌ 290.22400 290.28000
STP stp-cryptominisat4 default unsat ✅ 0.25601 0.25496
stp-cmsat4-v15 default unsat ✅ 0.26035 0.25896
stp-cmsat4-mt-v15 default unsat ✅ 0.27366 0.27296
stp-minisat-v15 default unsat ✅ 0.25791 0.25696
Yices2 Yices default unsat ✅ 0.08724 0.08599
Z3 z3 4.4.0 default unsat ✅ 0.87196 0.86787
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 46.29760 46.32400
ABC_glucose glucose unsat ✅ 485.15200 484.80700
Boolector Boolector boolector unsat ✅ 0.43025 0.43057
Boolector preprop boolector unsat ✅ 0.51751 0.51774
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.05163 5.25753
MapleSTP MapleSTP default unsat ✅ 0.23666 0.23677
MapleSTP-mt default unsat ✅ 0.23890 0.23896
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.93016 0.93167
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.43985 0.44007
Q3B Q3B default unknown ❌ 2400.05000 7204.39000
STP stp-cms-exp-2016 default unsat ✅ 0.24799 0.24804
stp-cms-mt-2016 default unsat ✅ 0.24791 0.24801
stp-cms-st-2016 default unsat ✅ 0.24844 0.24856
stp-minisat-st-2016 default unsat ✅ 0.24731 0.24740
Yices2 Yices-2.4.2 default unsat ✅ 0.08741 0.08759
Z3 z3-4.4.1 default unsat ✅ 0.83517 0.83698
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.63347 0.63210
Boolector SMT17 final boolector unsat ✅ 0.60421 0.60369
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.13195 5.40300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.94512 0.94557
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.33321 0.33115
Q3B Q3B default unknown ❌ 600.04600 1799.31000
STP stp_st default unsat ✅ 0.28471 0.28406
stp_mt default unsat ✅ 0.28302 0.28230
Yices2 Yices2-Main default unsat ✅ 0.08287 0.08151
Z3 z3-4.5.0 default unsat ✅ 0.87525 0.87328
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.72675 0.72659
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.07065 3.07083
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.94346 0.94433
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.37757 0.37761
Minkeyrink ST_st unsat ✅ 0.37743 0.37743
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.27957 0.27954
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.27859 0.27859
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.27964 0.27971
Yices2 Yices 2.6.0_default unsat ✅ 0.08331 0.08320
Z3 z3-4.7.1_default unsat ✅ 0.92772 0.92754
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.61762 0.61739
Boolector Boolector-wrapped-sq_default unsat ✅ 0.90904 0.90892
Poolector-wrapped-sq_default unsat ✅ 0.97716 3.39000
CVC4 CVC4-sq-final_default unsat ✅ 4.50310 4.50334
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.87000
MathSAT MathSAT5_default.sh unsat ✅ 0.75911 0.75903
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.30963 0.30972
MinkeyRink Solver 2020.3_default unsat ✅ 0.32898 0.32907
STP STP_default unsat ✅ 0.25630 0.25638
STP ++ Mergsat v1_default unsat ✅ 0.25142 0.25286
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.09435 0.09424
Z3 z3-4.8.8_default unsat ✅ 0.89122 0.89115
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.60733 0.60724
MathSAT mathsat-5.6.6_default unsat ✅ 0.77320 0.77316
STP STP 2021.0_default unsat ✅ 0.26562 0.26571
Z3 z3-4.8.11_default unsat ✅ 0.91980 0.91975
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.70943 0.70934
Bitwuzla-wrapped_default unsat ✅ 0.62138 0.62113
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 6.26003 6.25988
MathSAT MathSAT-5.6.8_default unsat ✅ 0.79084 0.79032
STP STP 2022.4_default unsat ✅ 0.37677 0.37546
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.09921 0.09885
Z3++BV z3++bv_0702_default unsat ✅ 0.59674 0.59668
Z3 z3-4.8.17_default unsat ✅ 1.05272 1.05347
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 4.45850 4.35595
cvc5 cvc5 unsat ✅ 3.31423 3.21432
SMTInterpol SMTInterpol unknown ❌ 1202.24582 1276.09196
STP STP unsat ✅ 0.50365 0.40330
Yices2 Yices2 unsat ✅ 0.27567 0.17621
Z3alpha Z3-alpha unsat ✅ 0.48453 0.38461
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 1.63991 1.50473
Bitwuzla-MachBV-base unsat ✅ 3.38012 3.26210
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 3.38751 3.26489
BVDecide bv_decide unknown ❌ 1201.39283 1200.91471
bv_decide-nokernel unsat ✅ 255.43785 255.27064
cvc5 cvc5 unsat ✅ 2.12106 2.00032
SMTInterpol SMTInterpol unknown ❌ 1201.76211 1451.92186
Yices2 Yices2 unsat ✅ 0.31525 0.18870
Z3alpha Z3-alpha unsat ✅ 0.93128 1.35628
Z3 Z3-alpha-base unsat ✅ 0.53336 0.40471
Z3-Owl-base unsat ✅ 1.42583 1.30149
z3siri-base unsat ✅ 0.50807 0.39248
Z3-Owl Z3-Owl unsat ✅ 2.48950 2.35471