Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1217.smt2

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1482522
Compressed Size100137
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1482514
Compressed Size100145
Max. Term Depth5
Asserts 10595
Declared Functions0
Declared Constants10337
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite569 not503 =10658 concat208
extract1169 bvnot1 bvand159 bvor243
bvadd4686 bvmul204 bvsub132 bvult16
bvule1 bvslt1 bvsle205 bvshl109
bvlshr210 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.33 (2/3) CVC3 CVC3 2.3 unsat ✅ 553.10000
SONOLAR SONOLAR r252 unsat ✅ 5.80000
STP simplifyingSTP unknown ❌ 5.40000
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.35497
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.28848
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.29388
abziz_portfolio_2012_minfeatures default unsat ✅ 0.29376
abziz_portfolio_2012_solvers default unsat ✅ 0.29113
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.30212
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11636
Boolector-SMT-COMP-2011 default unsat ✅ 0.17608
Boolector-SMT-COMP-2012 default unsat ✅ 0.12791
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 121.15700
CVC3-SMT-COMP-2011 default unsat ✅ 103.33000
CVC3-SMT-COMP-2012 default unsat ✅ 108.62400
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.33005
CVC4-SMT-EVAL-2013 default unsat ✅ 1.49116
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.47902
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.60986
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.52344
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.51433
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.37071
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.49581
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.57196
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.40717
STP STP2-SMT-COMP-2011 default unsat ✅ 0.24541
STP2-SMT-COMP-2012 default unsat ✅ 0.17649
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.41126
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.46888
Z3-SMT-COMP-2011 default unsat ✅ 0.29157
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 0.29564 0.28696
Abziz abziz_portfolio_all_features default unsat ✅ 0.62162 0.57691
abziz_portfolio_min_features default unsat ✅ 0.58088 0.57591
Boolector Boolector boolector unsat ✅ 0.12879 0.11998
CVC4 CVC4 f7118b2 default unsat ✅ 2.03804 3.58145
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.44666 0.43793
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.36852 0.35894
STP stp-cryptominisat4 default unsat ✅ 0.15974 0.14798
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.05796 0.04899
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.55239 0.54392
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.15990 0.15898
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.14034 3.75843
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.10697 3.69544
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.56237 0.56091
SMT-RAT SMT-RAT-final default unsat ✅ 620.06100 620.36100
STP stp-cryptominisat4 default unsat ✅ 0.14806 0.14698
stp-cmsat4-v15 default unsat ✅ 0.14808 0.14698
stp-cmsat4-mt-v15 default unsat ✅ 0.14817 0.14698
stp-minisat-v15 default unsat ✅ 0.14827 0.14698
Yices2 Yices default unsat ✅ 0.04991 0.04899
Z3 z3 4.4.0 default unsat ✅ 0.51990 0.51992
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 27.33390 27.35130
ABC_glucose glucose unsat ✅ 258.58400 258.73300
Boolector Boolector boolector unsat ✅ 0.23550 0.23495
Boolector preprop boolector unsat ✅ 0.22675 0.22685
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.05720 3.58134
MapleSTP MapleSTP default unsat ✅ 0.13769 0.13774
MapleSTP-mt default unsat ✅ 0.25696 0.25710
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.48694 0.48808
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.24502 0.24495
Q3B Q3B default unknown ❌ 2400.06000 7203.89000
STP stp-cms-exp-2016 default unsat ✅ 0.14330 0.14335
stp-cms-mt-2016 default unsat ✅ 0.14625 0.14585
stp-cms-st-2016 default unsat ✅ 0.14441 0.14447
stp-minisat-st-2016 default unsat ✅ 0.14355 0.14360
Yices2 Yices-2.4.2 default unsat ✅ 0.05208 0.05208
Z3 z3-4.4.1 default unsat ✅ 0.53197 0.52353
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.23223 0.23139
Boolector SMT17 final boolector unsat ✅ 0.23660 0.23508
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.13746 3.73707
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49494 0.49524
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.18688 0.18628
Q3B Q3B default unknown ❌ 600.09100 1786.82000
STP stp_st default unsat ✅ 0.19609 0.19560
stp_mt default unsat ✅ 0.20713 0.19475
Yices2 Yices2-Main default unsat ✅ 0.04962 0.04913
Z3 z3-4.5.0 default unsat ✅ 0.55870 0.55860
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.20081 0.20069
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.59200 2.59222
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.49039 0.49145
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.21110 0.21114
Minkeyrink ST_st unsat ✅ 0.21024 0.21029
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19084 0.19085
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.19206 0.19209
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19096 0.19098
Yices2 Yices 2.6.0_default unsat ✅ 0.05045 0.05039
Z3 z3-4.7.1_default unsat ✅ 0.57252 0.57230
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.34679 0.34678
Poolector-wrapped-sq_default unsat ✅ 0.58369 1.84230
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.32669 0.32666
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.14127 2.14131
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.21435 0.21448
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.21285 0.21293
Par4 Par4-wrapped-sq_default unsat ✅ 0.05822 0.00597
STP STP-2019-wrapped-sq_default unsat ✅ 0.20213 0.20227
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20291 0.20305
stp-minisat-wrapped-sq_default unsat ✅ 0.20321 0.20334
stp-mt-wrapped-sq_default unsat ✅ 0.20205 0.20217
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20243 0.20259
stp-riss-wrapped-sq_default unsat ✅ 0.20336 0.20351
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05016 0.05015
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05038 0.05038
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05012 0.05014
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.10892 0.10890
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05028 0.05028
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.54510 0.54506
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.32030 0.32022
MathSAT mathsat-5.6.6_default unsat ✅ 0.37530 0.37523
STP STP 2021.0_default unsat ✅ 0.18703 0.18712
Z3 z3-4.8.11_default unsat ✅ 0.59287 0.59263
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 2.57477 2.47403
cvc5 cvc5 unsat ✅ 1.72241 1.62229
SMTInterpol SMTInterpol unsat ✅ 143.28306 177.15369
STP STP unsat ✅ 0.36859 0.26837
Yices2 Yices2 unsat ✅ 0.27756 0.17644
Z3alpha Z3-alpha unsat ✅ 0.38635 0.28653