Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1461.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2007083
Compressed Size138149
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2007075
Compressed Size138156
Max. Term Depth5
Asserts 14285
Declared Functions0
Declared Constants13921
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite801 not670 =14392 concat386
extract2045 bvnot1 bvand285 bvor463
bvadd5488 bvmul336 bvsub182 bvult16
bvule1 bvslt1 bvsle277 bvshl221
bvlshr388 sign_extend87

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.67 (1/3) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SONOLAR SONOLAR r252 unknown ❌ 1200.00000 —
STP simplifyingSTP sat ✅ 10.60000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.26925 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.67292 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.66802 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.67024 —
abziz_portfolio_2012_solvers default sat ✅ 0.68527 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.66515 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.21570 —
Boolector-SMT-COMP-2011 default sat ✅ 2.76447 —
Boolector-SMT-COMP-2012 default sat ✅ 0.21965 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.89434 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.12188 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.66333 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.85157 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.74031 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.72133 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.68750 —
SONOLAR-SMT-COMP-2010 default sat ✅ 16.62610 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.03487 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.74027 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.56593 —
STP2-SMT-COMP-2012 default sat ✅ 0.63572 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.24807 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.90021 —
Z3-SMT-COMP-2011 default sat ✅ 0.66278 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.44513 0.43793
Abziz abziz_portfolio_all_features default sat ✅ 1.70891 1.70274
abziz_portfolio_min_features default sat ✅ 1.71113 1.69774
Boolector Boolector boolector sat ✅ 1.37266 1.36379
CVC4 CVC4 f7118b2 default sat ✅ 3.00364 5.35019
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.62262 0.61391
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.66141 0.64990
STP stp-cryptominisat4 default sat ✅ 0.39960 0.39094
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.10000 0.09098
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.07903 1.07184
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.87516 0.87487
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.91699 5.12322
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.08160 5.46117
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.82497 0.82387
SMT-RAT SMT-RAT-final default unknown ❌ 291.11800 291.24000
STP stp-cryptominisat4 default sat ✅ 0.38994 0.38894
stp-cmsat4-v15 default sat ✅ 0.38891 0.38794
stp-cmsat4-mt-v15 default unknown ❌ 0.36320 0.36194
stp-minisat-v15 default sat ✅ 0.38131 0.37994
Yices2 Yices default sat ✅ 0.09228 0.09099
Z3 z3 4.4.0 default sat ✅ 1.05006 1.04984
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.05000 2401.25000
ABC_glucose glucose sat ✅ 374.56600 373.59100
Boolector Boolector boolector sat ✅ 1.83640 1.83711
Boolector preprop boolector sat ✅ 1.92298 1.91709
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 3.02206 5.32716
MapleSTP MapleSTP default sat ✅ 0.40641 0.40660
MapleSTP-mt default sat ✅ 0.42816 0.66584
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.72339 0.72584
MinkeyRink Minkeyrink 2016 default sat ✅ 1.01939 1.20420
Q3B Q3B default unknown ❌ 2400.05000 7204.30000
STP stp-cms-exp-2016 default sat ✅ 0.45279 0.45299
stp-cms-mt-2016 default sat ✅ 0.43422 0.66180
stp-cms-st-2016 default sat ✅ 0.42101 0.42121
stp-minisat-st-2016 default sat ✅ 0.37760 0.37798
Yices2 Yices-2.4.2 default sat ✅ 0.09424 0.09425
Z3 z3-4.4.1 default sat ✅ 1.02824 1.02999
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.51461 0.51059
Boolector SMT17 final boolector sat ✅ 0.52062 0.51960
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.21945 5.69864
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.72255 0.72235
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.70692 0.67754
Q3B Q3B default unknown ❌ 600.03000 1799.55000
STP stp_st default sat ✅ 0.43706 0.43632
stp_mt default sat ✅ 0.45731 0.71563
Yices2 Yices2-Main default sat ✅ 0.08770 0.08715
Z3 z3-4.5.0 default sat ✅ 1.06442 1.06329
SMT-COMP 2018 Boolector Boolector_default sat ✅ 38.36550 38.36360
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.75623 3.75654
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.72301 0.72421
MinkeyRink Minkeyrink MT_mt sat ✅ 0.63757 0.67631
Minkeyrink ST_st sat ✅ 0.63879 0.63891
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.36087 0.36103
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.37370 0.41748
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.75411 0.75413
Yices2 Yices 2.6.0_default sat ✅ 0.08678 0.08669
Z3 z3-4.7.1_default sat ✅ 1.09669 1.09653
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.00382 2.00364
MathSAT mathsat-5.6.6_default sat ✅ 0.53983 0.53979
STP STP 2021.0_default sat ✅ 0.35486 0.38585
Z3 z3-4.8.11_default sat ✅ 1.13549 1.13526
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.05489 2.05372
Bitwuzla-wrapped_default sat ✅ 2.06693 2.06667
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.77473 4.77518
MathSAT MathSAT-5.6.8_default sat ✅ 0.55623 0.55607
STP STP 2022.4_default sat ✅ 0.63768 0.63766
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.14008 0.14005
Z3++BV z3++bv_0702_default sat ✅ 0.70823 0.70813
Z3 z3-4.8.17_default sat ✅ 1.27394 1.27571
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 6.17776 6.17746
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 3.20172 3.20192
STP STP 2022.4_default sat ✅ 0.65375 0.65180
STP 2022.4_default sat ✅ 0.63889 0.63895
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.90840 36.06750
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.10533 0.10531
Z3-Owl z3-Owl-Final_default sat ✅ 7.52725 7.52244
z3-Owl-Final_default sat ✅ 7.45827 7.45685