Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1667.smt2

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2864218
Compressed Size191555
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2864210
Compressed Size191560
Max. Term Depth5
Asserts 20134
Declared Functions0
Declared Constants19678
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1005 not850 =20276 concat720
extract3494 bvnot1 bvand532 bvor836
bvadd6958 bvmul700 bvsub358 bvult16
bvule1 bvslt1 bvsle344 bvshl365
bvlshr722 sign_extend154

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 unsat ✅ 3.70000
Boolector Boolector unsat ✅ 0.30000
CVC3 CVC3-1.5 unsat ✅ 710.20000
MathSAT MathSAT-4.2 unsat ✅ 9.00000
Spear Spear unsat ✅ 8.60000
Spear v1.9 (fh-1-2) unsat ✅ 144.20000
SWORD SWORD v0.2 unsat ✅ 4.90000
Z3 Z3.2 unsat ✅ 2.00000
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.95627
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54375
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54085
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54707
abziz_portfolio_2012_solvers default unsat ✅ 0.54500
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54972
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.26537
Boolector-SMT-COMP-2011 default unsat ✅ 0.38298
Boolector-SMT-COMP-2012 default unsat ✅ 0.29014
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 182.14800
CVC3-SMT-COMP-2011 default unsat ✅ 156.88900
CVC3-SMT-COMP-2012 default unsat ✅ 162.64600
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.35185
CVC4-SMT-EVAL-2013 default unsat ✅ 3.81152
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.09991
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.59903
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.20839
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.17165
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.73261
SONOLAR-SMT-COMP-2010 default unsat ✅ 9.61939
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.64481
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.91230
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52248
STP2-SMT-COMP-2012 default unsat ✅ 0.35247
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 3.66449
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.12532
Z3-SMT-COMP-2011 default unsat ✅ 0.53709
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.36852 0.36794
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 5.22085 9.44456
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 5.17534 9.36658
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.35551 1.35479
SMT-RAT SMT-RAT-final default unknown ❌ 294.21700 294.07000
STP stp-cryptominisat4 default unsat ✅ 0.31046 0.30895
stp-cmsat4-v15 default unsat ✅ 0.30602 0.30495
stp-cmsat4-mt-v15 default unsat ✅ 0.30743 0.30695
stp-minisat-v15 default unsat ✅ 0.32300 0.32195
Yices2 Yices default unsat ✅ 0.10211 0.10098
Z3 z3 4.4.0 default unsat ✅ 1.16656 1.16682
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 57.03560 57.07380
ABC_glucose glucose unsat ✅ 634.97500 634.53500
Boolector Boolector boolector unsat ✅ 0.52032 0.52063
Boolector preprop boolector unsat ✅ 0.51392 0.51445
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 5.03346 9.05867
MapleSTP MapleSTP default unsat ✅ 0.28355 0.28368
MapleSTP-mt default unsat ✅ 0.28550 0.28564
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.20042 1.20210
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.57018 0.57033
Q3B Q3B default unknown ❌ 2400.04000 7203.97000
STP stp-cms-exp-2016 default unsat ✅ 0.29424 0.29422
stp-cms-mt-2016 default unsat ✅ 0.29600 0.29628
stp-cms-st-2016 default unsat ✅ 0.29688 0.29704
stp-minisat-st-2016 default unsat ✅ 0.29546 0.29617
Yices2 Yices-2.4.2 default unsat ✅ 0.10591 0.10568
Z3 z3-4.4.1 default unsat ✅ 1.14340 1.14523
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.51867 0.51793
Boolector SMT17 final boolector unsat ✅ 0.52153 0.52027
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.62313 10.20800
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.21987 1.22052
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.40164 0.40121
Q3B Q3B default unknown ❌ 600.06400 1799.51000
STP stp_st default unsat ✅ 0.36378 0.36308
stp_mt default unsat ✅ 0.41811 0.41724
Yices2 Yices2-Main default unsat ✅ 0.09671 0.09579
Z3 z3-4.5.0 default unsat ✅ 1.20535 1.20467
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.49011 0.49000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 7.30103 7.29997
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.21314 1.21413
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.45534 0.45528
Minkeyrink ST_st unsat ✅ 0.45066 0.45072
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.35980 0.35979
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.36183 0.36179
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.36314 0.36307
Yices2 Yices 2.6.0_default unsat ✅ 0.10071 0.10064
Z3 z3-4.7.1_default unsat ✅ 1.23450 1.23425
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.72331 0.72322
Boolector Boolector-wrapped-sq_default unsat ✅ 0.77386 0.77380
Poolector-wrapped-sq_default unsat ✅ 1.09108 3.86463
CVC4 CVC4-sq-final_default unsat ✅ 5.83051 5.83073
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 36.72910 36.73000
MathSAT MathSAT5_default.sh unsat ✅ 0.94523 0.94516
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.37377 0.37382
MinkeyRink Solver 2020.3_default unsat ✅ 0.39792 0.39789
STP STP_default unsat ✅ 0.33129 0.33141
STP ++ Mergsat v1_default unsat ✅ 0.32905 0.33079
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.11225 0.11216
Z3 z3-4.8.8_default unsat ✅ 1.34034 1.34009
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.71183 0.71176
MathSAT mathsat-5.6.6_default unsat ✅ 1.01986 1.01639
STP STP 2021.0_default unsat ✅ 0.34070 0.34081
Z3 z3-4.8.11_default unsat ✅ 1.40172 1.40171
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 14.07900 14.07420
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 5.89702 5.89716
STP STP 2022.4_default unsat ✅ 0.44966 0.44736
STP 2022.4_default unsat ✅ 0.43723 0.43725
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.75500 36.49900
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12282 0.12276
Z3-Owl z3-Owl-Final_default unsat ✅ 4.72294 4.72255
z3-Owl-Final_default unsat ✅ 4.76896 4.76861
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 2.33216 2.21236
Bitwuzla-MachBV-base unsat ✅ 5.70295 5.58110
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 5.44901 5.32512
BVDecide bv_decide unknown ❌ 1201.39328 1201.00428
bv_decide-nokernel unsat ✅ 364.78679 364.56777
cvc5 cvc5 unsat ✅ 2.60794 2.49285
SMTInterpol SMTInterpol unknown ❌ 1201.87471 1563.04407
Yices2 Yices2 unsat ✅ 0.34297 0.21751
Z3alpha Z3-alpha unsat ✅ 1.10548 1.73843
Z3 Z3-alpha-base unsat ✅ 0.55859 0.44192
Z3-Owl-base unsat ✅ 1.69805 1.58009
z3siri-base unsat ✅ 0.55274 0.42981
Z3-Owl Z3-Owl unsat ✅ 2.79309 2.66471