Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1649.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2846440
Compressed Size190298
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2846432
Compressed Size190304
Max. Term Depth5
Asserts 20000
Declared Functions0
Declared Constants19548
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite997 not844 =20142 concat720
extract3490 bvnot1 bvand532 bvor836
bvadd6908 bvmul700 bvsub358 bvult16
bvule1 bvslt1 bvsle340 bvshl365
bvlshr722 sign_extend154

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 4Simp 4Simp unsat ✅ 1.60000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 1.00000 —
Boolector Boolector unsat ✅ 0.50000 —
CVC3 CVC3 v2.4.2 unsat ✅ 214.90000 —
CVC4 1.0rc.3931 unsat ✅ 5.70000 —
MathSAT MathSAT-HeavyBV unsat ✅ 2.70000 —
SONOLAR SONOLAR unsat ✅ 1.50000 —
Z3 Z3 unsat ✅ 1.00000 —
SMT-COMP 2011 Boolector Boolector 1.5.23-833 unsat ✅ 0.60000 —
CVC3 CVC3 v2.4 unsat ✅ 218.00000 —
MathSAT MathSAT5 unsat ✅ 1.90000 —
SONOLAR SONOLAR unsat ✅ 2.60000 —
STP simplifyingSTP unsat ✅ 5.60000 —
STP2 unsat ✅ 0.90000 —
Z3 Z3 unsat ✅ 0.90000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.95293 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54395 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.53840 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54693 —
abziz_portfolio_2012_solvers default unsat ✅ 0.53746 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53520 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.26837 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.37826 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.28553 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 182.87300 —
CVC3-SMT-COMP-2011 default unsat ✅ 155.51300 —
CVC3-SMT-COMP-2012 default unsat ✅ 162.11300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.33285 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.80835 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.07824 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.60061 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.19692 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.16953 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.73481 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 9.67565 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.60870 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.90687 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52031 —
STP2-SMT-COMP-2012 default unsat ✅ 0.35150 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 3.66889 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.12317 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53428 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.36593 0.36494
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 5.20803 9.43257
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 5.13723 9.30158
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.37203 1.37179
SMT-RAT SMT-RAT-final default unknown ❌ 286.21800 286.18000
STP stp-cryptominisat4 default unsat ✅ 0.30609 0.30495
stp-cmsat4-v15 default unsat ✅ 0.30443 0.30395
stp-cmsat4-mt-v15 default unsat ✅ 0.30365 0.30295
stp-minisat-v15 default unsat ✅ 0.30548 0.30495
Yices2 Yices default unsat ✅ 0.10078 0.09998
Z3 z3 4.4.0 default unsat ✅ 1.17028 1.17082
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 56.77760 56.81030
ABC_glucose glucose unsat ✅ 636.55100 635.64300
Boolector Boolector boolector unsat ✅ 0.51696 0.51710
Boolector preprop boolector unsat ✅ 0.50900 0.50926
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 5.01457 9.03476
MapleSTP MapleSTP default unsat ✅ 0.28270 0.28282
MapleSTP-mt default unsat ✅ 0.28193 0.28250
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.19443 1.19615
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.56212 0.56242
Q3B Q3B default unknown ❌ 2400.09000 7204.09000
STP stp-cms-exp-2016 default unsat ✅ 0.29379 0.29391
stp-cms-mt-2016 default unsat ✅ 0.29491 0.29502
stp-cms-st-2016 default unsat ✅ 0.29418 0.29431
stp-minisat-st-2016 default unsat ✅ 0.29619 0.29632
Yices2 Yices-2.4.2 default unsat ✅ 0.10247 0.10251
Z3 z3-4.4.1 default unsat ✅ 1.13346 1.13550
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.51405 0.51398
Boolector SMT17 final boolector unsat ✅ 0.51641 0.51548
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.57045 10.10160
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.21110 1.21146
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.44396 0.44399
Q3B Q3B default unknown ❌ 600.02000 1799.61000
STP stp_st default unsat ✅ 0.36088 0.36041
stp_mt default unsat ✅ 0.36356 0.36239
Yices2 Yices2-Main default unsat ✅ 0.09659 0.09573
Z3 z3-4.5.0 default unsat ✅ 1.19801 1.19672
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.48262 0.48244
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 7.34410 7.34387
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.20181 1.20265
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.44696 0.44678
Minkeyrink ST_st unsat ✅ 0.44512 0.44510
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.36043 0.36044
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.36139 0.36138
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.36201 0.36198
Yices2 Yices 2.6.0_default unsat ✅ 0.09706 0.09700
Z3 z3-4.7.1_default unsat ✅ 1.22835 1.22802
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.71403 0.71380
Boolector Boolector-wrapped-sq_default unsat ✅ 0.76893 0.76890
Poolector-wrapped-sq_default unsat ✅ 1.07928 3.85206
CVC4 CVC4-sq-final_default unsat ✅ 5.77757 5.77798
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 36.32420 36.31940
MathSAT MathSAT5_default.sh unsat ✅ 0.94526 0.94521
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.37200 0.37212
MinkeyRink Solver 2020.3_default unsat ✅ 0.38871 0.38879
STP STP_default unsat ✅ 0.33040 0.33050
STP ++ Mergsat v1_default unsat ✅ 0.32757 0.32930
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.10999 0.10987
Z3 z3-4.8.8_default unsat ✅ 1.34026 1.34017
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.70298 0.70292
Bitwuzla-wrapped_default unsat ✅ 0.73301 0.73296
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 8.01073 8.00946
MathSAT MathSAT-5.6.8_default unsat ✅ 0.98640 0.98636
STP STP 2022.4_default unsat ✅ 0.44323 0.44322
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.11533 0.11521
Z3++BV z3++bv_0702_default unsat ✅ 0.66874 0.66866
Z3 z3-4.8.17_default unsat ✅ 1.64595 1.64767
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 14.04460 14.04210
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 5.90189 5.82847
STP STP 2022.4_default unsat ✅ 0.44455 0.44459
STP 2022.4_default unsat ✅ 0.43575 0.43577
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 12.07800 37.81020
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.11875 0.11872
Z3-Owl z3-Owl-Final_default unsat ✅ 4.68546 9.27505
z3-Owl-Final_default unsat ✅ 4.68086 4.68058
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 6.81825 6.71695
cvc5 cvc5 unsat ✅ 4.52493 4.42102
SMTInterpol SMTInterpol unknown ❌ 1202.24481 1281.66394
STP STP unsat ✅ 0.54746 0.44763
Yices2 Yices2 unsat ✅ 0.28817 0.18849
Z3alpha Z3-alpha unsat ✅ 0.59286 0.49305