Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1214.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1479498
Compressed Size99925
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1479490
Compressed Size99932
Max. Term Depth5
Asserts 10571
Declared Functions0
Declared Constants10316
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite563 not500 =10631 concat208
extract1166 bvnot1 bvand159 bvor243
bvadd4686 bvmul204 bvsub132 bvult16
bvule1 bvslt1 bvsle205 bvshl109
bvlshr210 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 unsat ✅ 1.50000 —
Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 92.80000 —
MathSAT MathSAT-4.2 unsat ✅ 3.90000 —
Spear Spear unsat ✅ 4.20000 —
Spear v1.9 (fh-1-2) unsat ✅ 32.80000 —
SWORD SWORD v0.2 unsat ✅ 3.00000 —
Z3 Z3.2 unsat ✅ 0.80000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.35625 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.29121 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.30009 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.29288 —
abziz_portfolio_2012_solvers default unsat ✅ 0.29448 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.29397 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11689 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.16046 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.12711 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 113.43300 —
CVC3-SMT-COMP-2011 default unsat ✅ 96.92490 —
CVC3-SMT-COMP-2012 default unsat ✅ 101.75500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.32450 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.49244 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.49427 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.60703 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.52349 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.50937 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.36829 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.50557 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.57060 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.40397 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23590 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17549 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.40864 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.47322 —
Z3-SMT-COMP-2011 default unsat ✅ 0.28613 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.16013 0.15898
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.12662 3.73643
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.10822 3.69044
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.55824 0.55791
SMT-RAT SMT-RAT-final default unsat ✅ 667.81200 668.08100
STP stp-cryptominisat4 default unsat ✅ 0.14667 0.14598
stp-cmsat4-v15 default unsat ✅ 0.14805 0.14698
stp-cmsat4-mt-v15 default unsat ✅ 0.14821 0.14698
stp-minisat-v15 default unsat ✅ 0.14683 0.14598
Yices2 Yices default unsat ✅ 0.04969 0.04899
Z3 z3 4.4.0 default unsat ✅ 0.51813 0.51792
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 27.41240 27.41630
ABC_glucose glucose unsat ✅ 265.44000 265.58900
Boolector Boolector boolector unsat ✅ 0.23269 0.23278
Boolector preprop boolector unsat ✅ 0.22607 0.22641
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.08761 3.65037
MapleSTP MapleSTP default unsat ✅ 0.13690 0.13694
MapleSTP-mt default unsat ✅ 0.14107 0.13694
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.48590 0.48716
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.24412 0.24425
Q3B Q3B default unknown ❌ 2400.03000 7204.25000
STP stp-cms-exp-2016 default unsat ✅ 0.14247 0.14248
stp-cms-mt-2016 default unsat ✅ 0.14328 0.14334
stp-cms-st-2016 default unsat ✅ 0.14454 0.14454
stp-minisat-st-2016 default unsat ✅ 0.14334 0.14338
Yices2 Yices-2.4.2 default unsat ✅ 0.05076 0.05074
Z3 z3-4.4.1 default unsat ✅ 0.51721 0.51869
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.29021 0.28864
Boolector SMT17 final boolector unsat ✅ 0.23272 0.23194
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.11321 3.69678
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49378 0.49381
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.18638 0.18565
Q3B Q3B default unknown ❌ 600.01600 1799.29000
STP stp_st default unsat ✅ 0.22319 0.22305
stp_mt default unsat ✅ 0.24267 0.22986
Yices2 Yices2-Main default unsat ✅ 0.05224 0.04860
Z3 z3-4.5.0 default unsat ✅ 0.62646 0.62581
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.20244 0.20215
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.58101 2.58099
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.50981 0.51100
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.21050 0.21053
Minkeyrink ST_st unsat ✅ 0.20990 0.20993
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19200 0.19204
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.19321 0.19326
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19198 0.19199
Yices2 Yices 2.6.0_default unsat ✅ 0.04988 0.04978
Z3 z3-4.7.1_default unsat ✅ 0.57666 0.57654
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.33636 0.33630
Poolector-wrapped-sq_default unsat ✅ 0.58912 1.88636
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.33029 0.33026
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.14638 2.14666
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.21828 0.21843
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.21270 0.21276
Par4 Par4-wrapped-sq_default unsat ✅ 0.05690 0.00592
STP STP-2019-wrapped-sq_default unsat ✅ 0.20123 0.20135
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20194 0.20208
stp-minisat-wrapped-sq_default unsat ✅ 0.20165 0.20183
stp-mt-wrapped-sq_default unsat ✅ 0.20121 0.20134
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20128 0.20144
stp-riss-wrapped-sq_default unsat ✅ 0.20196 0.20214
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05074 0.05070
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05020 0.05018
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05009 0.05010
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.10937 0.10937
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04992 0.04993
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.54717 0.54716
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31923 0.31920
Boolector Boolector-wrapped-sq_default unsat ✅ 0.34520 0.34518
Poolector-wrapped-sq_default unsat ✅ 0.57825 1.85234
CVC4 CVC4-sq-final_default unsat ✅ 2.38147 2.38166
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 17.17960 17.17900
MathSAT MathSAT5_default.sh unsat ✅ 0.37686 0.37666
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.17750 0.17761
MinkeyRink Solver 2020.3_default unsat ✅ 0.18595 0.18608
STP STP_default unsat ✅ 0.18247 0.18259
STP ++ Mergsat v1_default unsat ✅ 0.17748 0.17914
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05756 0.05752
Z3 z3-4.8.8_default unsat ✅ 0.52742 0.52719
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31857 0.31849
Bitwuzla-wrapped_default unsat ✅ 0.35206 0.35108
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.36873 3.36908
MathSAT MathSAT-5.6.8_default unsat ✅ 0.38675 0.38665
STP STP 2022.4_default unsat ✅ 0.21142 0.21139
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05761 0.05754
Z3++BV z3++bv_0702_default unsat ✅ 0.37475 0.37406
Z3 z3-4.8.17_default unsat ✅ 0.67878 0.68052
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.97369 3.97335
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.20566 2.20428
STP STP 2022.4_default unsat ✅ 0.19874 0.19876
STP 2022.4_default unsat ✅ 0.19986 0.19989
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.48450 35.09380
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06036 0.06031
Z3-Owl z3-Owl-Final_default unsat ✅ 2.73126 2.73082
z3-Owl-Final_default unsat ✅ 2.75154 2.75092