Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1430.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1914605
Compressed Size131795
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1914597
Compressed Size131805
Max. Term Depth5
Asserts 13675
Declared Functions0
Declared Constants13314
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite793 not664 =13777 concat350
extract1823 bvnot1 bvand281 bvor427
bvadd5324 bvmul260 bvsub154 bvult16
bvule1 bvslt2 bvsle277 bvshl213
bvlshr352 sign_extend59

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 sat ✅ 2.40000 —
Boolector Boolector sat ✅ 0.60000 —
CVC3 CVC3-1.5 sat ✅ 292.60000 —
MathSAT MathSAT-4.2 sat ✅ 14.20000 —
Spear Spear sat ✅ 18.90000 —
Spear v1.9 (fh-1-2) sat ✅ 246.10000 —
SWORD SWORD v0.2 sat ✅ 10.00000 —
Z3 Z3.2 sat ✅ 0.60000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.26008 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.64812 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.68818 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.66646 —
abziz_portfolio_2012_solvers default sat ✅ 0.65804 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.64887 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.20109 —
Boolector-SMT-COMP-2011 default sat ✅ 2.72243 —
Boolector-SMT-COMP-2012 default sat ✅ 0.20795 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.80943 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.03286 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.64611 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.82067 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.71200 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.69651 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.64786 —
SONOLAR-SMT-COMP-2010 default sat ✅ 14.98360 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.00248 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.71585 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.54480 —
STP2-SMT-COMP-2012 default sat ✅ 0.62544 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.11550 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.86259 —
Z3-SMT-COMP-2011 default sat ✅ 0.64526 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.44020 0.43293
Abziz abziz_portfolio_all_features default sat ✅ 1.70036 1.68674
abziz_portfolio_min_features default sat ✅ 1.70909 1.69574
Boolector Boolector boolector sat ✅ 1.33440 1.32480
CVC4 CVC4 f7118b2 default sat ✅ 2.91376 5.18221
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.59708 0.58891
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.63469 0.62490
STP stp-cryptominisat4 default sat ✅ 0.37976 0.37894
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.09605 0.08699
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.04716 1.03984
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.86235 0.86187
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.81204 4.93725
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.99591 5.31919
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.80649 0.80588
SMT-RAT SMT-RAT-final default unknown ❌ 315.81800 315.79000
STP stp-cryptominisat4 default sat ✅ 0.37766 0.37694
stp-cmsat4-v15 default sat ✅ 0.37577 0.37494
stp-cmsat4-mt-v15 default unknown ❌ 0.35472 0.35295
stp-minisat-v15 default sat ✅ 0.36834 0.36694
Yices2 Yices default sat ✅ 0.08847 0.08699
Z3 z3 4.4.0 default sat ✅ 1.02167 1.02184
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.04000 2401.56000
ABC_glucose glucose sat ✅ 340.72200 340.78100
Boolector Boolector boolector sat ✅ 1.87275 1.87379
Boolector preprop boolector sat ✅ 0.36430 0.36445
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.92104 5.15916
MapleSTP MapleSTP default sat ✅ 0.38516 0.38532
MapleSTP-mt default sat ✅ 0.40509 0.61683
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.70430 0.70558
MinkeyRink Minkeyrink 2016 default sat ✅ 1.00233 1.19183
Q3B Q3B default unknown ❌ 2400.08000 7203.79000
STP stp-cms-exp-2016 default sat ✅ 0.44039 0.44060
stp-cms-mt-2016 default sat ✅ 0.41933 0.64249
stp-cms-st-2016 default sat ✅ 0.40647 0.40665
stp-minisat-st-2016 default sat ✅ 0.36735 0.36754
Yices2 Yices-2.4.2 default sat ✅ 0.09004 0.09005
Z3 z3-4.4.1 default sat ✅ 1.00687 1.00935
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.38614 0.38552
Boolector SMT17 final boolector sat ✅ 0.38833 0.38737
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.06675 5.43571
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.71824 0.71820
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.67228 0.64687
Q3B Q3B default unknown ❌ 600.07200 1793.23000
STP stp_st default sat ✅ 0.42450 0.42451
stp_mt default sat ✅ 0.50178 0.68971
Yices2 Yices2-Main default sat ✅ 0.08547 0.08427
Z3 z3-4.5.0 default sat ✅ 1.07561 1.07468
SMT-COMP 2018 Boolector Boolector_default sat ✅ 34.20330 34.18490
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.66511 3.66460
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.71307 0.71379
MinkeyRink Minkeyrink MT_mt sat ✅ 0.61732 0.65619
Minkeyrink ST_st sat ✅ 0.61972 0.61801
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.35019 0.35041
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.35908 0.40233
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.73556 0.73565
Yices2 Yices 2.6.0_default sat ✅ 0.08436 0.08424
Z3 z3-4.7.1_default sat ✅ 0.91083 0.91074
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.54231 0.54223
Poolector-wrapped-sq_default sat ✅ 0.79254 2.76000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 272.94800 272.90900
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.03428 3.03443
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.67462 0.70468
MinkeyRink ST-wrapped-sq_default sat ✅ 0.66848 0.66855
Par4 Par4-wrapped-sq_default sat ✅ 0.09176 0.00616
STP STP-2019-wrapped-sq_default sat ✅ 0.36274 0.36297
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.39985 0.40005
stp-minisat-wrapped-sq_default sat ✅ 0.37092 0.37102
stp-mt-wrapped-sq_default sat ✅ 0.37260 0.40201
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.43244 0.51074
stp-riss-wrapped-sq_default unknown ❌ 0.35250 0.35270
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.08714 0.08714
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.11260 0.11260
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.46194 0.46200
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 1.02596 1.02591
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.12783 0.12781
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.02457 1.02463
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.59491 1.59476
Boolector Boolector-wrapped-sq_default sat ✅ 0.60651 0.60646
Poolector-wrapped-sq_default sat ✅ 0.88432 3.08000
CVC4 CVC4-sq-final_default sat ✅ 3.30068 3.30090
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.73000
MathSAT MathSAT5_default.sh sat ✅ 0.52670 0.52665
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.57252 0.57264
MinkeyRink Solver 2020.3_default sat ✅ 0.61195 0.63945
STP STP_default sat ✅ 0.33634 0.36679
STP ++ Mergsat v1_default sat ✅ 0.32170 0.32332
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.09656 0.09644
Z3 z3-4.8.8_default sat ✅ 1.01369 1.01364
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.57827 1.57823
Bitwuzla-wrapped_default sat ✅ 1.63618 1.63429
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.51890 4.51382
MathSAT MathSAT-5.6.8_default sat ✅ 0.54843 0.54831
STP STP 2022.4_default sat ✅ 0.61789 0.61777
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.10371 0.10363
Z3++BV z3++bv_0702_default sat ✅ 0.68544 0.68539
Z3 z3-4.8.17_default sat ✅ 1.26628 2.44817
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 5.16952 5.16880
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.98976 2.99034
STP STP 2022.4_default sat ✅ 0.60867 0.60873
STP 2022.4_default sat ✅ 0.61148 0.61147
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.88080 37.15780
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.10268 0.10259
Z3-Owl z3-Owl-Final_default sat ✅ 7.34510 7.34444
z3-Owl-Final_default sat ✅ 7.35756 7.35496
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 2.85186 2.75187
cvc5 cvc5 sat ✅ 2.50212 2.40124
SMTInterpol SMTInterpol unknown ❌ 1202.24451 1267.58824
STP STP sat ✅ 0.74082 0.63937
Yices2 Yices2 sat ✅ 0.27969 0.18000
Z3alpha Z3-alpha sat ✅ 0.51505 0.41580