Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1212.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1476279
Compressed Size99716
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1476271
Compressed Size99725
Max. Term Depth5
Asserts 10547
Declared Functions0
Declared Constants10294
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite559 not498 =10605 concat207
extract1162 bvnot1 bvand158 bvor242
bvadd4683 bvmul204 bvsub132 bvult16
bvule1 bvslt1 bvsle205 bvshl109
bvlshr209 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 unsat ✅ 1.50000 —
Boolector Boolector unsat ✅ 0.20000 —
CVC3 CVC3-1.5 unsat ✅ 94.40000 —
MathSAT MathSAT-4.2 unsat ✅ 3.90000 —
Spear Spear unsat ✅ 5.20000 —
Spear v1.9 (fh-1-2) unsat ✅ 35.10000 —
SWORD SWORD v0.2 unsat ✅ 3.10000 —
Z3 Z3.2 unsat ✅ 0.70000 —
SMT-COMP 2011 Boolector Boolector 1.5.23-833 unsat ✅ 0.30000 —
CVC3 CVC3 v2.4 unsat ✅ 124.50000 —
MathSAT MathSAT5 unsat ✅ 0.80000 —
SONOLAR SONOLAR unsat ✅ 0.90000 —
STP simplifyingSTP unsat ✅ 2.20000 —
STP2 unsat ✅ 0.50000 —
Z3 Z3 unsat ✅ 0.50000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.35205 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.29719 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.30599 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.31440 —
abziz_portfolio_2012_solvers default unsat ✅ 0.28746 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.28939 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11656 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.16104 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.13107 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 121.06200 —
CVC3-SMT-COMP-2011 default unsat ✅ 102.01800 —
CVC3-SMT-COMP-2012 default unsat ✅ 106.32600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.32558 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.48440 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.47666 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.61198 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.52500 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.50998 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.37178 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.50988 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.57542 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.40818 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23626 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17819 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.40911 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.46612 —
Z3-SMT-COMP-2011 default unsat ✅ 0.28516 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 0.28730 0.28696
Abziz abziz_portfolio_all_features default unsat ✅ 0.58676 0.57391
abziz_portfolio_min_features default unsat ✅ 0.58271 0.56891
Boolector Boolector boolector unsat ✅ 0.12874 0.11998
CVC4 CVC4 f7118b2 default unsat ✅ 2.03511 3.57646
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.44843 0.43693
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.37027 0.35495
STP stp-cryptominisat4 default unsat ✅ 0.15564 0.14698
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.05798 0.04899
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.55342 0.54392
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.15922 0.15798
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.13326 3.74543
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.09705 3.68244
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.55968 0.55891
SMT-RAT SMT-RAT-final default unsat ✅ 614.38200 614.40100
STP stp-cryptominisat4 default unsat ✅ 0.14774 0.14598
stp-cmsat4-v15 default unsat ✅ 0.14766 0.14598
stp-cmsat4-mt-v15 default unsat ✅ 0.14701 0.14598
stp-minisat-v15 default unsat ✅ 0.14760 0.14598
Yices2 Yices default unsat ✅ 0.05003 0.04899
Z3 z3 4.4.0 default unsat ✅ 0.49364 0.49392
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 27.38020 27.39190
ABC_glucose glucose unsat ✅ 256.61000 256.75900
Boolector Boolector boolector unsat ✅ 0.23019 0.23030
Boolector preprop boolector unsat ✅ 0.22700 0.22712
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.31269 4.09365
MapleSTP MapleSTP default unsat ✅ 0.13579 0.13585
MapleSTP-mt default unsat ✅ 0.13682 0.13688
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.48217 0.48349
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.24313 0.24318
Q3B Q3B default unknown ❌ 2400.08000 7204.57000
STP stp-cms-exp-2016 default unsat ✅ 0.14148 0.14152
stp-cms-mt-2016 default unsat ✅ 0.14245 0.14249
stp-cms-st-2016 default unsat ✅ 0.14176 0.14228
stp-minisat-st-2016 default unsat ✅ 0.14424 0.14500
Yices2 Yices-2.4.2 default unsat ✅ 0.05044 0.05045
Z3 z3-4.4.1 default unsat ✅ 0.51703 0.51848
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.24752 0.24672
Boolector SMT17 final boolector unsat ✅ 0.27056 0.26994
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.11082 3.69237
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49679 0.49684
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.18734 0.18635
Q3B Q3B default unknown ❌ 600.08700 1794.10000
STP stp_st default unsat ✅ 0.19391 0.19329
stp_mt default unsat ✅ 0.20011 0.20055
Yices2 Yices2-Main default unsat ✅ 0.04780 0.04686
Z3 z3-4.5.0 default unsat ✅ 0.53806 0.53729
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.20146 0.20132
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.58200 2.58140
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.48884 0.48963
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.20986 0.20986
Minkeyrink ST_st unsat ✅ 0.20919 0.20901
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19287 0.19269
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.19201 0.19255
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19330 0.19319
Yices2 Yices 2.6.0_default unsat ✅ 0.05041 0.05031
Z3 z3-4.7.1_default unsat ✅ 0.58052 0.58040
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31663 0.31653
Boolector Boolector-wrapped-sq_default unsat ✅ 0.34713 0.34711
Poolector-wrapped-sq_default unsat ✅ 0.58019 1.82119
CVC4 CVC4-sq-final_default unsat ✅ 2.37313 2.37350
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 17.13160 17.13200
MathSAT MathSAT5_default.sh unsat ✅ 0.37481 0.37479
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.17699 0.17709
MinkeyRink Solver 2020.3_default unsat ✅ 0.18573 0.18584
STP STP_default unsat ✅ 0.18148 0.18160
STP ++ Mergsat v1_default unsat ✅ 0.17703 0.17870
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05670 0.05668
Z3 z3-4.8.8_default unsat ✅ 0.52667 0.52658
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31605 0.31604
Bitwuzla-wrapped_default unsat ✅ 0.32765 0.32756
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.34434 3.34488
MathSAT MathSAT-5.6.8_default unsat ✅ 0.37910 0.37909
STP STP 2022.4_default unsat ✅ 0.19916 0.19919
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05728 0.05725
Z3++BV z3++bv_0702_default unsat ✅ 0.36883 0.36874
Z3 z3-4.8.17_default unsat ✅ 0.66808 0.66986
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 2.28534 2.18407
cvc5 cvc5 unsat ✅ 1.85287 1.75303
SMTInterpol SMTInterpol unsat ✅ 147.50881 182.62593
STP STP unsat ✅ 0.38501 0.28539
Yices2 Yices2 unsat ✅ 0.25051 0.15076
Z3alpha Z3-alpha unsat ✅ 0.41098 0.31108