Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1571.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2524374
Compressed Size171925
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2524366
Compressed Size171931
Max. Term Depth5
Asserts 17830
Declared Functions0
Declared Constants17398
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite955 not807 =17958 concat603
extract2952 bvnot1 bvand463 bvor719
bvadd6277 bvmul509 bvsub267 bvult16
bvule1 bvslt2 bvsle332 bvshl339
bvlshr605 sign_extend118

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.67 (1/3) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SONOLAR SONOLAR r252 unknown ❌ 1200.00000 —
STP simplifyingSTP sat ✅ 14.10000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.24029 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 1.64974 —
abziz_portfolio_2011_solvers_2 default sat ✅ 1.63677 —
abziz_portfolio_2012_minfeatures default sat ✅ 1.66361 —
abziz_portfolio_2012_solvers default sat ✅ 1.65460 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 1.66542 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 6.76927 —
Boolector-SMT-COMP-2011 default sat ✅ 7.89012 —
Boolector-SMT-COMP-2012 default sat ✅ 0.33490 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 2.89915 —
CVC4-SMT-EVAL-2013 default sat ✅ 3.24530 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.94293 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 1.30567 —
MathSAT5-SMT-COMP-2011 default sat ✅ 1.06651 —
MathSAT5-SMT-COMP-2012 default sat ✅ 1.03318 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.12212 —
SONOLAR-SMT-COMP-2010 default sat ✅ 21.48080 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.70237 —
SONOLAR-SMT-COMP-2012 default sat ✅ 1.26732 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.88451 —
STP2-SMT-COMP-2012 default sat ✅ 0.71947 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 3.84476 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 1.59346 —
Z3-SMT-COMP-2011 default sat ✅ 1.63154 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.72952 0.71689
Abziz abziz_portfolio_all_features default sat ✅ 3.45798 3.44548
abziz_portfolio_min_features default sat ✅ 3.45344 3.44048
Boolector Boolector boolector sat ✅ 4.53585 4.52831
CVC4 CVC4 f7118b2 default sat ✅ 4.68241 8.55270
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.88965 0.88087
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.12132 1.11883
STP stp-cryptominisat4 default sat ✅ 0.59400 0.59291
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.13524 0.12598
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 2.24610 2.23766
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.87640 1.87571
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 4.46123 8.03778
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 4.76237 8.64768
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.33280 1.33280
SMT-RAT SMT-RAT-final default unknown ❌ 291.71700 291.65000
STP stp-cryptominisat4 default sat ✅ 0.59181 0.59091
stp-cmsat4-v15 default sat ✅ 0.58355 0.58291
stp-cmsat4-mt-v15 default unknown ❌ 0.54110 0.53992
stp-minisat-v15 default sat ✅ 0.57202 0.57091
Yices2 Yices default sat ✅ 0.12699 0.12598
Z3 z3 4.4.0 default sat ✅ 2.03149 2.03169
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.10000 2401.67000
ABC_glucose glucose sat ✅ 514.27400 513.77300
Boolector Boolector boolector sat ✅ 4.38077 4.38329
Boolector preprop boolector sat ✅ 4.47044 4.47265
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 4.64772 8.41062
MapleSTP MapleSTP default sat ✅ 0.72421 0.72463
MapleSTP-mt default sat ✅ 0.79195 1.58515
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.17015 1.17194
MinkeyRink Minkeyrink 2016 default sat ✅ 2.09442 2.68476
Q3B Q3B default unknown ❌ 2400.06000 7203.66000
STP stp-cms-exp-2016 default sat ✅ 0.82671 0.82714
stp-cms-mt-2016 default sat ✅ 0.81162 1.61867
stp-cms-st-2016 default sat ✅ 0.74194 0.74233
stp-minisat-st-2016 default sat ✅ 0.60580 0.60610
Yices2 Yices-2.4.2 default sat ✅ 0.12855 0.12860
Z3 z3-4.4.1 default sat ✅ 2.23405 2.23660
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.59413 0.59398
Boolector SMT17 final boolector sat ✅ 0.54122 0.54045
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.82458 8.74666
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.20183 1.20168
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.13502 1.10924
Q3B Q3B default unknown ❌ 600.06200 1787.13000
STP stp_st default sat ✅ 1.00927 1.00866
stp_mt default sat ✅ 1.52981 2.32172
Yices2 Yices2-Main default sat ✅ 0.12211 0.12147
Z3 z3-4.5.0 default sat ✅ 2.46125 2.45925
SMT-COMP 2018 Boolector Boolector_default sat ✅ 132.35200 132.34900
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.75347 5.75372
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.18140 1.18222
MinkeyRink Minkeyrink MT_mt sat ✅ 0.98450 1.07342
Minkeyrink ST_st sat ✅ 0.96496 0.96270
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.67822 0.67834
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.72036 0.88738
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.62733 1.62552
Yices2 Yices 2.6.0_default sat ✅ 0.12022 0.12013
Z3 z3-4.7.1_default sat ✅ 2.13458 2.12869
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.90213 0.90211
Poolector-wrapped-sq_default sat ✅ 1.18341 4.38000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 754.27700 754.30500
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 4.57017 4.57044
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.07716 1.14455
MinkeyRink ST-wrapped-sq_default sat ✅ 1.03265 1.03267
Par4 Par4-wrapped-sq_default sat ✅ 0.13038 0.00686
STP STP-2019-wrapped-sq_default sat ✅ 0.68625 0.68667
stp-mergesat-fixed-wrapped-sq_default sat ✅ 1.32033 1.30565
stp-minisat-wrapped-sq_default sat ✅ 0.77376 0.77370
stp-mt-wrapped-sq_default sat ✅ 0.71608 0.83632
stp-portfolio-fixed-wrapped-sq_default sat ✅ 1.37892 1.61902
stp-riss-wrapped-sq_default unknown ❌ 0.67000 0.66997
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.12398 0.12400
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.18887 0.18883
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.00062 1.00061
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 3.95422 3.95428
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.20519 0.20520
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.16496 2.16489
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.98773 2.98786
Boolector Boolector-wrapped-sq_default sat ✅ 1.37270 1.37274
Poolector-wrapped-sq_default sat ✅ 1.68821 6.13000
CVC4 CVC4-sq-final_default sat ✅ 4.98354 4.98307
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.83000
MathSAT MathSAT5_default.sh sat ✅ 0.82644 0.82632
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.93961 0.93983
MinkeyRink Solver 2020.3_default sat ✅ 1.00410 1.06872
STP STP_default sat ✅ 0.65543 0.77778
STP ++ Mergsat v1_default sat ✅ 0.60636 0.60809
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.45379 0.45370
Z3 z3-4.8.8_default sat ✅ 2.59855 2.59858
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.02625 3.02565
MathSAT mathsat-5.6.6_default sat ✅ 0.83059 0.83055
STP STP 2021.0_default sat ✅ 0.66336 0.78260
Z3 z3-4.8.11_default sat ✅ 5.35989 5.35985
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 10.41460 10.41380
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 4.78134 4.78181
STP STP 2022.4_default sat ✅ 0.94164 0.94153
STP 2022.4_default sat ✅ 0.94393 0.94394
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.86140 36.82100
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.14247 0.14243
Z3-Owl z3-Owl-Final_default sat ✅ 18.49770 18.37300
z3-Owl-Final_default sat ✅ 18.32690 18.32410
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 5.11164 5.01092
cvc5 cvc5 sat ✅ 3.82131 3.72138
SMTInterpol SMTInterpol unknown ❌ 1202.24232 1277.64557
STP STP sat ✅ 1.01759 0.91780
Yices2 Yices2 sat ✅ 0.36107 0.26108
Z3alpha Z3-alpha sat ✅ 0.76141 0.65944
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.72174 1.60366
Bitwuzla-MachBV-base sat ✅ 3.57506 3.45672
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 3.61969 3.49213
BVDecide bv_decide unknown ❌ 1201.39121 1201.03906
bv_decide-nokernel sat ✅ 276.14076 276.02011
cvc5 cvc5 sat ✅ 2.44758 2.32521
SMTInterpol SMTInterpol unknown ❌ 1201.77273 1491.16221
Yices2 Yices2 sat ✅ 0.34569 0.22747
Z3alpha Z3-alpha sat ✅ 2.34609 5.87779
Z3 Z3-alpha-base sat ✅ 1.51920 1.40453
Z3-Owl-base sat ✅ 6.09670 5.96276
z3siri-base sat ✅ 1.64816 1.51960
Z3-Owl Z3-Owl sat ✅ 8.23324 8.09758