Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1450.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1967723
Compressed Size135689
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1967715
Compressed Size135680
Max. Term Depth5
Asserts 14027
Declared Functions0
Declared Constants13664
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite797 not668 =14131 concat368
extract1950 bvnot1 bvand283 bvor445
bvadd5416 bvmul305 bvsub170 bvult16
bvule1 bvslt2 bvsle277 bvshl219
bvlshr370 sign_extend77

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.25018 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.67027 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.67071 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.66425 —
abziz_portfolio_2012_solvers default sat ✅ 0.66348 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.67003 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.20644 —
Boolector-SMT-COMP-2011 default sat ✅ 2.76586 —
Boolector-SMT-COMP-2012 default sat ✅ 0.21448 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.86360 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.09582 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.65363 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.84044 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.72666 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.71251 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.68221 —
SONOLAR-SMT-COMP-2010 default sat ✅ 15.59760 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.03568 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.72934 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.58488 —
STP2-SMT-COMP-2012 default sat ✅ 0.63352 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.14717 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.87884 —
Z3-SMT-COMP-2011 default sat ✅ 0.67050 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.43625 0.42893
Abziz abziz_portfolio_all_features default sat ✅ 1.69468 1.68174
abziz_portfolio_min_features default sat ✅ 1.68724 1.68174
Boolector Boolector boolector sat ✅ 1.32372 1.31580
CVC4 CVC4 f7118b2 default sat ✅ 2.97589 5.29219
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.60614 0.59691
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.65005 0.63890
STP stp-cryptominisat4 default sat ✅ 0.39069 0.38294
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.10181 0.08998
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.08411 1.07583
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.86759 0.86687
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.91348 5.12622
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.05038 5.40118
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.81324 0.81288
SMT-RAT SMT-RAT-final default unknown ❌ 288.61800 288.65000
STP stp-cryptominisat4 default sat ✅ 0.38273 0.38194
stp-cmsat4-v15 default sat ✅ 0.38378 0.38294
stp-cmsat4-mt-v15 default unknown ❌ 0.36172 0.35994
stp-minisat-v15 default sat ✅ 0.37282 0.37194
Yices2 Yices default sat ✅ 0.09067 0.08998
Z3 z3 4.4.0 default sat ✅ 1.05888 1.05884
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.11000 2401.28000
ABC_glucose glucose sat ✅ 359.12000 359.07000
Boolector Boolector boolector sat ✅ 1.86969 1.87091
Boolector preprop boolector sat ✅ 1.99533 1.99644
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.97444 5.24354
MapleSTP MapleSTP default sat ✅ 0.41617 0.41587
MapleSTP-mt default sat ✅ 0.42333 0.66188
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.71029 0.71200
MinkeyRink Minkeyrink 2016 default sat ✅ 1.01746 1.20870
Q3B Q3B default unknown ❌ 2400.03000 7203.49000
STP stp-cms-exp-2016 default sat ✅ 0.44495 0.44510
stp-cms-mt-2016 default sat ✅ 0.42668 0.64977
stp-cms-st-2016 default sat ✅ 0.40389 0.40464
stp-minisat-st-2016 default sat ✅ 0.37403 0.37423
Yices2 Yices-2.4.2 default sat ✅ 0.09100 0.09101
Z3 z3-4.4.1 default sat ✅ 0.99970 1.00133
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.37400 0.37302
Boolector SMT17 final boolector sat ✅ 0.44118 0.43939
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.13427 5.54988
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.72086 0.72131
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.67325 0.64434
Q3B Q3B default unknown ❌ 600.08800 1799.61000
STP stp_st default sat ✅ 0.48498 0.48516
stp_mt default sat ✅ 0.48042 0.66657
Yices2 Yices2-Main default sat ✅ 0.09351 0.09266
Z3 z3-4.5.0 default sat ✅ 1.03116 1.03033
SMT-COMP 2018 Boolector Boolector_default sat ✅ 37.89920 37.89800
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.67256 3.67271
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.71778 0.71883
MinkeyRink Minkeyrink MT_mt sat ✅ 0.64689 0.66869
Minkeyrink ST_st sat ✅ 0.62205 0.62211
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.35662 0.35681
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.36834 0.41262
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.76166 0.76171
Yices2 Yices 2.6.0_default sat ✅ 0.08676 0.08666
Z3 z3-4.7.1_default sat ✅ 1.07474 1.07455
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.57104 0.57103
Poolector-wrapped-sq_default sat ✅ 0.88689 2.93000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 404.74100 404.74300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.11530 3.11483
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.69749 0.72520
MinkeyRink ST-wrapped-sq_default sat ✅ 0.68588 0.68590
Par4 Par4-wrapped-sq_default sat ✅ 0.09592 0.00610
STP STP-2019-wrapped-sq_default sat ✅ 0.36808 0.36842
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.40502 0.40524
stp-minisat-wrapped-sq_default sat ✅ 0.38726 0.38743
stp-mt-wrapped-sq_default sat ✅ 0.37584 0.40571
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.48586 0.51361
stp-riss-wrapped-sq_default unknown ❌ 0.36195 0.36212
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.08869 0.08865
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.11313 0.11309
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.46414 0.46409
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 1.17003 1.17008
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.13443 0.13441
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.03622 1.03615
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.79642 1.79630
Boolector Boolector-wrapped-sq_default sat ✅ 1.08508 2.12510
Poolector-wrapped-sq_default sat ✅ 1.39380 5.10330
CVC4 CVC4-sq-final_default sat ✅ 3.37141 3.37123
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.87000
MathSAT MathSAT5_default.sh sat ✅ 0.53368 0.53358
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.61189 0.59335
MinkeyRink Solver 2020.3_default sat ✅ 0.62775 0.65495
STP STP_default sat ✅ 0.34585 0.37605
STP ++ Mergsat v1_default sat ✅ 0.32829 0.33000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.13316 0.13311
Z3 z3-4.8.8_default sat ✅ 1.05230 1.05130
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.78166 1.78141
MathSAT mathsat-5.6.6_default sat ✅ 0.53424 0.53418
STP STP 2021.0_default sat ✅ 0.35185 0.38217
Z3 z3-4.8.11_default sat ✅ 1.11903 1.11893
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.79090 1.79069
Bitwuzla-wrapped_default sat ✅ 1.89031 1.88989
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.59959 4.59858
MathSAT MathSAT-5.6.8_default sat ✅ 0.55176 0.55157
STP STP 2022.4_default sat ✅ 0.62703 0.62695
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.10240 0.10201
Z3++BV z3++bv_0702_default sat ✅ 0.69994 0.69978
Z3 z3-4.8.17_default sat ✅ 1.27080 1.27252
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 2.93609 2.83296
cvc5 cvc5 sat ✅ 2.84007 2.73857
SMTInterpol SMTInterpol unknown ❌ 1202.22267 1269.31190
STP STP sat ✅ 0.66345 0.56337
Yices2 Yices2 sat ✅ 0.29936 0.19973
Z3alpha Z3-alpha sat ✅ 0.53295 0.43310