Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1527.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2393025
Compressed Size162298
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2393017
Compressed Size162303
Max. Term Depth5
Asserts 16934
Declared Functions0
Declared Constants16519
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite919 not771 =17057 concat552
extract2667 bvnot1 bvand435 bvor662
bvadd6082 bvmul450 bvsub245 bvult16
bvule1 bvslt1 bvsle320 bvshl315
bvlshr554 sign_extend94

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 unsat ✅ 2.80000 —
Boolector Boolector unsat ✅ 0.30000 —
CVC3 CVC3-1.5 unsat ✅ 37.80000 —
MathSAT MathSAT-4.2 unsat ✅ 20.30000 —
Spear Spear unsat ✅ 10.90000 —
Spear v1.9 (fh-1-2) unsat ✅ 47.70000 —
SWORD SWORD v0.2 unsat ✅ 4.20000 —
Z3 Z3.2 unsat ✅ 0.90000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69451 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.67949 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.68254 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68135 —
abziz_portfolio_2012_solvers default unsat ✅ 0.68006 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.67948 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23029 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.27367 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24125 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 122.38700 —
CVC3-SMT-COMP-2011 default unsat ✅ 105.31500 —
CVC3-SMT-COMP-2012 default unsat ✅ 109.14000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.54251 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.93681 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.87149 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.15196 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.98753 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.95371 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.66096 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.75707 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.22800 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.67421 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.46572 —
STP2-SMT-COMP-2012 default unsat ✅ 0.30256 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 2.77279 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.81593 —
Z3-SMT-COMP-2011 default unsat ✅ 0.67779 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.41110 0.40994
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.96132 7.06992
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.15631 5.45817
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.05800 1.05784
SMT-RAT SMT-RAT-final default unknown ❌ 298.41800 298.36000
STP stp-cryptominisat4 default unsat ✅ 0.25344 0.25296
stp-cmsat4-v15 default unsat ✅ 0.25938 0.25796
stp-cmsat4-mt-v15 default unsat ✅ 0.25578 0.25496
stp-minisat-v15 default unsat ✅ 0.25533 0.25396
Yices2 Yices default unsat ✅ 0.08531 0.08399
Z3 z3 4.4.0 default unsat ✅ 0.87255 0.87287
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 46.10400 46.13490
ABC_glucose glucose unsat ✅ 473.22500 472.79400
Boolector Boolector boolector unsat ✅ 0.42716 0.42738
Boolector preprop boolector unsat ✅ 0.54714 0.54718
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.03946 5.23054
MapleSTP MapleSTP default unsat ✅ 0.23665 0.23669
MapleSTP-mt default unsat ✅ 0.23723 0.23805
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.92209 0.92371
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.46109 0.46137
Q3B Q3B default unknown ❌ 2400.06000 7203.54000
STP stp-cms-exp-2016 default unsat ✅ 0.24481 0.24492
stp-cms-mt-2016 default unsat ✅ 0.24852 0.24864
stp-cms-st-2016 default unsat ✅ 0.24577 0.24588
stp-minisat-st-2016 default unsat ✅ 0.24584 0.24595
Yices2 Yices-2.4.2 default unsat ✅ 0.08615 0.08617
Z3 z3-4.4.1 default unsat ✅ 0.83913 0.84102
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.62153 0.62023
Boolector SMT17 final boolector unsat ✅ 0.66359 0.66261
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.12745 5.39606
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.98135 0.98154
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.41119 0.40369
Q3B Q3B default unknown ❌ 600.03800 1431.73000
STP stp_st default unsat ✅ 0.28175 0.28077
stp_mt default unsat ✅ 0.28032 0.27976
Yices2 Yices2-Main default unsat ✅ 0.08417 0.08284
Z3 z3-4.5.0 default unsat ✅ 0.95477 0.95173
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77348 0.77340
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.06790 3.06785
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.94017 0.94130
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.43733 0.43732
Minkeyrink ST_st unsat ✅ 0.43835 0.43843
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.27720 0.27723
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.27915 0.27913
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.27909 0.27918
Yices2 Yices 2.6.0_default unsat ✅ 0.08355 0.08351
Z3 z3-4.7.1_default unsat ✅ 0.90545 0.90522
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.79331 0.79337
Poolector-wrapped-sq_default unsat ✅ 0.91338 3.21000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.63437 0.63436
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.14291 4.14330
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.41649 0.41662
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.40647 0.40655
Par4 Par4-wrapped-sq_default unsat ✅ 0.09221 0.00605
STP STP-2019-wrapped-sq_default unsat ✅ 0.29084 0.29096
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.28881 0.28893
stp-minisat-wrapped-sq_default unsat ✅ 0.28945 0.28959
stp-mt-wrapped-sq_default unsat ✅ 0.28867 0.28880
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.28768 0.28780
stp-riss-wrapped-sq_default unsat ✅ 0.28733 0.28744
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.08315 0.08316
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.08298 0.08301
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.08280 0.08281
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.19911 0.19910
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.08298 0.08297
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.88825 0.88830
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.60937 0.60917
Bitwuzla-wrapped_default unsat ✅ 0.63897 0.63779
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 6.28903 6.28925
MathSAT MathSAT-5.6.8_default unsat ✅ 0.77293 0.77235
STP STP 2022.4_default unsat ✅ 0.42282 0.42185
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.09650 0.09645
Z3++BV z3++bv_0702_default unsat ✅ 0.55565 0.55557
Z3 z3-4.8.17_default unsat ✅ 1.04219 1.04422
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 9.27545 9.27390
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.42895 4.42788
STP STP 2022.4_default unsat ✅ 0.42550 0.42445
STP 2022.4_default unsat ✅ 0.41212 0.41215
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.80430 36.22010
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10114 0.10108
Z3-Owl z3-Owl-Final_default unsat ✅ 4.09961 4.09936
z3-Owl-Final_default unsat ✅ 4.07178 4.07161
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 4.57076 4.47049
cvc5 cvc5 unsat ✅ 3.28092 3.18122
SMTInterpol SMTInterpol unknown ❌ 1202.23522 1270.77771
STP STP unsat ✅ 0.54623 0.44645
Yices2 Yices2 unsat ✅ 0.28493 0.18502
Z3alpha Z3-alpha unsat ✅ 0.48993 0.39049