Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1614.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2684807
Compressed Size181823
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2684799
Compressed Size181829
Max. Term Depth5
Asserts 18893
Declared Functions0
Declared Constants18454
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite971 not820 =19030 concat666
extract3297 bvnot1 bvand484 bvor782
bvadd6567 bvmul628 bvsub316 bvult16
bvule1 bvslt1 bvsle332 bvshl353
bvlshr668 sign_extend154

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 0.29 (5/7) Beaver Beaver-1.0 sat ✅ 5.30000 —
Boolector Boolector sat ✅ 1.70000 —
CVC3 CVC3-1.5 sat ✅ 1343.30000 —
MathSAT MathSAT-4.2 sat ✅ 26.70000 —
Spear Spear unknown ❌ 1216.40000 —
Spear v1.9 (fh-1-2) unknown ❌ 1801.00000 —
SWORD SWORD v0.2 unknown ❌ 1800.80000 —
Z3 Z3.2 sat ✅ 2.50000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.42766 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 12.25290 —
abziz_portfolio_2011_solvers_2 default sat ✅ 7.01364 —
abziz_portfolio_2012_minfeatures default sat ✅ 7.27419 —
abziz_portfolio_2012_solvers default sat ✅ 6.23487 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 6.93181 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 10.12530 —
Boolector-SMT-COMP-2011 default sat ✅ 12.90740 —
Boolector-SMT-COMP-2012 default sat ✅ 0.39424 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 3.43296 —
CVC4-SMT-EVAL-2013 default sat ✅ 3.58847 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 32.51770 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 1.55356 —
MathSAT5-SMT-COMP-2011 default sat ✅ 1.16980 —
MathSAT5-SMT-COMP-2012 default sat ✅ 1.15360 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.54443 —
SONOLAR-SMT-COMP-2010 default sat ✅ 31.24930 —
SONOLAR-SMT-COMP-2011 default sat ✅ 2.14941 —
SONOLAR-SMT-COMP-2012 default sat ✅ 1.84932 —
STP STP2-SMT-COMP-2011 default sat ✅ 1.10319 —
STP2-SMT-COMP-2012 default sat ✅ 1.15130 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 4.54379 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 4.71378 —
Z3-SMT-COMP-2011 default sat ✅ 6.65977 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.98931 0.98185
Abziz abziz_portfolio_all_features default sat ✅ 5.17905 5.16521
abziz_portfolio_min_features default sat ✅ 5.23997 5.22821
Boolector Boolector boolector sat ✅ 7.62017 7.60784
CVC4 CVC4 f7118b2 default sat ✅ 5.31589 9.75352
MathSAT MathSAT-5.2.12-Main default sat ✅ 1.35060 1.34280
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.85798 1.84672
STP stp-cryptominisat4 default sat ✅ 0.88599 0.87687
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.16722 0.15798
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 5.32344 5.31719
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.65656 4.65729
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 5.21006 9.48856
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 5.36791 9.79851
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 3.55943 3.55946
SMT-RAT SMT-RAT-final default unknown ❌ 289.31800 289.40000
STP stp-cryptominisat4 default sat ✅ 0.94476 0.94386
stp-cmsat4-v15 default sat ✅ 1.04814 1.04684
stp-cmsat4-mt-v15 default unknown ❌ 0.65963 0.65890
stp-minisat-v15 default sat ✅ 0.82957 0.82887
Yices2 Yices default sat ✅ 0.15901 0.15798
Z3 z3 4.4.0 default sat ✅ 3.54359 3.54446
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.02000 2401.15000
ABC_glucose glucose sat ✅ 573.93200 573.48000
Boolector Boolector boolector sat ✅ 6.54332 6.54756
Boolector preprop boolector sat ✅ 6.62517 6.62884
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 5.24667 9.54425
MapleSTP MapleSTP default sat ✅ 1.05731 1.05786
MapleSTP-mt default sat ✅ 1.29196 3.08820
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 3.57637 3.57960
MinkeyRink Minkeyrink 2016 default sat ✅ 3.15540 4.53494
Q3B Q3B default unknown ❌ 2400.06000 7203.55000
STP stp-cms-exp-2016 default sat ✅ 4.04526 4.04747
stp-cms-mt-2016 default sat ✅ 1.10848 2.49483
stp-cms-st-2016 default sat ✅ 1.04922 1.04977
stp-minisat-st-2016 default sat ✅ 1.26256 1.26352
Yices2 Yices-2.4.2 default sat ✅ 0.15699 0.15705
Z3 z3-4.4.1 default sat ✅ 4.17415 4.17795
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.79782 0.79685
Boolector SMT17 final boolector sat ✅ 0.79915 0.79838
CVC4 CVC4-smtcomp2017-main default sat ✅ 5.34015 9.72262
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.57961 1.58020
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.55437 1.52426
Q3B Q3B default unknown ❌ 600.03400 1799.49000
STP stp_st default sat ✅ 1.25075 1.25066
stp_mt default sat ✅ 2.26457 2.41771
Yices2 Yices2-Main default sat ✅ 0.15222 0.15251
Z3 z3-4.5.0 default sat ✅ 4.61741 4.61201
SMT-COMP 2018 Boolector Boolector_default sat ✅ 151.84800 151.81700
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 6.60868 6.60739
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.03905 3.03737
MinkeyRink Minkeyrink MT_mt sat ✅ 1.29271 1.84619
Minkeyrink ST_st sat ✅ 1.26959 1.26574
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.82657 0.82656
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.86265 1.09523
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.98984 1.98989
Yices2 Yices 2.6.0_default sat ✅ 0.14571 0.14563
Z3 z3-4.7.1_default sat ✅ 7.24361 7.24302
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.09945 4.09922
Boolector Boolector-wrapped-sq_default sat ✅ 0.95876 0.95878
Poolector-wrapped-sq_default sat ✅ 1.27950 4.56000
CVC4 CVC4-sq-final_default sat ✅ 5.47600 5.47610
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1199.82000
MathSAT MathSAT5_default.sh sat ✅ 1.06208 1.06208
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.07709 1.07736
MinkeyRink Solver 2020.3_default sat ✅ 1.29013 1.80408
STP STP_default sat ✅ 0.77331 0.93677
STP ++ Mergsat v1_default sat ✅ 0.71810 0.71981
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.49341 0.49332
Z3 z3-4.8.8_default sat ✅ 3.15194 3.15176
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 7.68268 7.68110
MathSAT mathsat-5.6.6_default sat ✅ 1.05394 1.05385
STP STP 2021.0_default sat ✅ 0.79446 0.96953
Z3 z3-4.8.11_default sat ✅ 4.38082 4.38001
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 4.50559 4.38646
Bitwuzla-MachBV-base sat ✅ 8.41608 8.29538
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 8.26211 8.13648
BVDecide bv_decide unknown ❌ 1201.39216 1201.03187
bv_decide-nokernel sat ✅ 333.78712 333.64208
cvc5 cvc5 sat ✅ 2.48440 2.36538
SMTInterpol SMTInterpol unknown ❌ 1201.89236 1507.38160
Yices2 Yices2 sat ✅ 1.01885 0.89549
Z3alpha Z3-alpha sat ✅ 3.19112 8.95027
Z3 Z3-alpha-base sat ✅ 2.56479 2.43167
Z3-Owl-base sat ✅ 10.37204 10.24131
z3siri-base sat ✅ 2.69657 2.55878
Z3-Owl Z3-Owl sat ✅ 10.34267 10.21211