Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1566.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size2505753
Compressed Size170654
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2505745
Compressed Size170641
Max. Term Depth5
Asserts 17707
Declared Functions0
Declared Constants17276
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite953 not805 =17834 concat594
extract2905 bvnot1 bvand462 bvor710
bvadd6246 bvmul497 bvsub262 bvult16
bvule1 bvslt2 bvsle332 bvshl339
bvlshr596 sign_extend114

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 sat ✅ 3.90000 —
Boolector Boolector sat ✅ 1.30000 —
CVC3 CVC3-1.5 sat ✅ 951.40000 —
MathSAT MathSAT-4.2 sat ✅ 22.50000 —
Spear Spear sat ✅ 915.80000 —
Spear v1.9 (fh-1-2) unknown ❌ 1800.80000 —
SWORD SWORD v0.2 sat ✅ 13.80000 —
Z3 Z3.2 sat ✅ 1.60000 —
SMT-COMP 2010 0.67 (1/3) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SONOLAR SONOLAR r252 unknown ❌ 1200.00000 —
STP simplifyingSTP sat ✅ 16.00000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.01781 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 1.58590 —
abziz_portfolio_2011_solvers_2 default sat ✅ 1.58783 —
abziz_portfolio_2012_minfeatures default sat ✅ 1.60255 —
abziz_portfolio_2012_solvers default sat ✅ 1.58515 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 1.60962 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 6.75656 —
Boolector-SMT-COMP-2011 default sat ✅ 7.72217 —
Boolector-SMT-COMP-2012 default sat ✅ 0.32763 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 2.84030 —
CVC4-SMT-EVAL-2013 default sat ✅ 3.21625 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.94022 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 1.29456 —
MathSAT5-SMT-COMP-2011 default sat ✅ 1.05752 —
MathSAT5-SMT-COMP-2012 default sat ✅ 1.02769 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.23271 —
SONOLAR-SMT-COMP-2010 default sat ✅ 21.06390 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.69232 —
SONOLAR-SMT-COMP-2012 default sat ✅ 1.28769 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.87362 —
STP2-SMT-COMP-2012 default sat ✅ 0.78160 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 3.69551 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 1.65785 —
Z3-SMT-COMP-2011 default sat ✅ 1.59752 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.74547 0.73389
Abziz abziz_portfolio_all_features default sat ✅ 3.67272 3.65544
abziz_portfolio_min_features default sat ✅ 3.69376 3.68144
Boolector Boolector boolector sat ✅ 4.65032 4.64329
CVC4 CVC4 f7118b2 default sat ✅ 4.67001 8.51171
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.87298 0.87187
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.13425 1.12283
STP stp-cryptominisat4 default sat ✅ 0.59604 0.58791
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.13393 0.12498
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 2.29269 2.27865
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.86028 1.85972
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 4.44758 8.01578
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 4.75334 8.63869
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.33179 1.33080
SMT-RAT SMT-RAT-final default unknown ❌ 293.42500 293.33000
STP stp-cryptominisat4 default sat ✅ 0.58284 0.58191
stp-cmsat4-v15 default sat ✅ 0.57603 0.57491
stp-cmsat4-mt-v15 default unknown ❌ 0.53639 0.53492
stp-minisat-v15 default sat ✅ 0.56490 0.56391
Yices2 Yices default sat ✅ 0.12601 0.12498
Z3 z3 4.4.0 default sat ✅ 1.90680 1.90771
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 2400.02000 2401.39000
ABC_glucose glucose sat ✅ 508.10800 507.68500
Boolector Boolector boolector sat ✅ 4.38787 8.70026
Boolector preprop boolector sat ✅ 0.51499 0.51540
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 4.63260 8.38585
MapleSTP MapleSTP default sat ✅ 0.72449 0.72491
MapleSTP-mt default sat ✅ 0.77782 1.53984
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.16708 1.16883
MinkeyRink Minkeyrink 2016 default sat ✅ 2.08079 2.66791
Q3B Q3B default unknown ❌ 2400.08000 7203.74000
STP stp-cms-exp-2016 default sat ✅ 0.83765 0.83808
stp-cms-mt-2016 default sat ✅ 0.76416 1.44361
stp-cms-st-2016 default sat ✅ 0.70124 0.70158
stp-minisat-st-2016 default sat ✅ 0.59998 0.60029
Yices2 Yices-2.4.2 default sat ✅ 0.12763 0.12763
Z3 z3-4.4.1 default sat ✅ 2.04392 2.04665
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.56979 0.56913
Boolector SMT17 final boolector sat ✅ 0.67880 0.67871
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.87946 8.85070
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.21217 1.21219
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.06857 1.06217
Q3B Q3B default unknown ❌ 600.09700 1799.66000
STP stp_st default sat ✅ 0.98809 0.98669
stp_mt default sat ✅ 1.24864 2.18984
Yices2 Yices2-Main default sat ✅ 0.12215 0.12168
Z3 z3-4.5.0 default sat ✅ 1.97737 1.97630
SMT-COMP 2018 Boolector Boolector_default sat ✅ 97.25750 97.25640
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.73629 5.73655
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.16762 1.16853
MinkeyRink Minkeyrink MT_mt sat ✅ 0.94376 1.03558
Minkeyrink ST_st sat ✅ 0.93939 0.93952
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.67640 0.67648
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.70505 0.87280
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.58060 1.58069
Yices2 Yices 2.6.0_default sat ✅ 0.11997 0.11985
Z3 z3-4.7.1_default sat ✅ 2.08960 2.08932
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.12606 3.12587
Bitwuzla-wrapped_default sat ✅ 3.08759 3.08566
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 6.83008 6.82558
MathSAT MathSAT-5.6.8_default sat ✅ 0.85206 0.85196
STP STP 2022.4_default sat ✅ 0.93888 0.93882
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.42977 0.42970
Z3++BV z3++bv_0702_default sat ✅ 1.21022 1.20916
Z3 z3-4.8.17_default sat ✅ 5.03004 5.03030
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 10.23400 10.23380
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 4.72903 4.72967
STP STP 2022.4_default sat ✅ 0.93754 0.93757
STP 2022.4_default sat ✅ 0.93395 0.93397
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.85700 36.14840
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.14374 0.14367
Z3-Owl z3-Owl-Final_default sat ✅ 18.45840 18.45460
z3-Owl-Final_default sat ✅ 18.33100 18.32660
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 4.90444 4.80175
cvc5 cvc5 sat ✅ 3.74709 3.64565
SMTInterpol SMTInterpol unknown ❌ 1202.24514 1281.05163
STP STP sat ✅ 1.08245 0.98256
Yices2 Yices2 sat ✅ 0.35460 0.25490
Z3alpha Z3-alpha sat ✅ 0.75809 0.65778