Benchmark

non-incremental/QF_BV/uclid/catchconv/convert-jpg2gif-query-1352.smt2 

Catchconv benchmarks provided by David Molnar (dmolnar@eecs.berkeley.edu).  Converted to SMT-LIB format by Rhishikesh Limaye (rhishi@eecs.berkeley.edu).  Catchconv is a tool for symbolic execution and run-time type inference for catching integer conversion errors.
Benchmark
Size1655919
Compressed Size113424
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1655911
Compressed Size113430
Max. Term Depth5
Asserts 11879
Declared Functions0
Declared Constants11566
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite685 not579 =11971 concat240
extract1321 bvnot1 bvand191 bvor287
bvadd4996 bvmul204 bvsub132 bvult16
bvule1 bvslt1 bvsle234 bvshl134
bvlshr242 sign_extend37

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Beaver Beaver-1.0 unsat ✅ 1.70000 —
Boolector Boolector unsat ✅ 0.20000 —
CVC3 CVC3-1.5 unsat ✅ 108.40000 —
MathSAT MathSAT-4.2 unsat ✅ 11.30000 —
Spear Spear unsat ✅ 3.40000 —
Spear v1.9 (fh-1-2) unsat ✅ 55.40000 —
SWORD SWORD v0.2 unsat ✅ 3.60000 —
Z3 Z3.2 unsat ✅ 1.00000 —
SMT-COMP 2012 4Simp 4Simp unsat ✅ 0.60000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 0.70000 —
Boolector Boolector unsat ✅ 0.30000 —
CVC3 CVC3 v2.4.2 unsat ✅ 236.90000 —
CVC4 1.0rc.3931 unsat ✅ 2.70000 —
MathSAT MathSAT-HeavyBV unsat ✅ 1.30000 —
SONOLAR SONOLAR unsat ✅ 0.70000 —
Z3 Z3 unsat ✅ 0.70000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.38099 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.39387 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.39602 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.39141 —
abziz_portfolio_2012_solvers default unsat ✅ 0.39212 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.39317 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16657 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.16964 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.17333 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 188.34100 —
CVC3-SMT-COMP-2011 default unsat ✅ 160.64200 —
CVC3-SMT-COMP-2012 default unsat ✅ 167.92200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.46759 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.65110 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.52406 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.71881 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.59206 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.57803 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.41648 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.88808 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.73531 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.42028 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.27786 —
STP2-SMT-COMP-2012 default unsat ✅ 0.19992 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.54589 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.50427 —
Z3-SMT-COMP-2011 default unsat ✅ 0.38379 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.23594 0.23496
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.32181 4.06538
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.28491 4.00039
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.61505 0.61391
SMT-RAT SMT-RAT-final default unknown ❌ 383.21700 383.28000
STP stp-cryptominisat4 default unsat ✅ 0.16676 0.16597
stp-cmsat4-v15 default unsat ✅ 0.16854 0.16797
stp-cmsat4-mt-v15 default unsat ✅ 0.16918 0.16797
stp-minisat-v15 default unsat ✅ 0.16743 0.16597
Yices2 Yices default unsat ✅ 0.05639 0.05499
Z3 z3 4.4.0 default unsat ✅ 0.56276 0.56291
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 30.86660 30.87020
ABC_glucose glucose unsat ✅ 288.86900 288.83600
Boolector Boolector boolector unsat ✅ 0.31288 0.31296
Boolector preprop boolector unsat ✅ 0.35210 0.35211
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.25911 3.93809
MapleSTP MapleSTP default unsat ✅ 0.15727 0.15747
MapleSTP-mt default unsat ✅ 0.15757 0.15762
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.53134 0.53299
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.29335 0.29344
Q3B Q3B default unknown ❌ 2400.07000 7204.57000
STP stp-cms-exp-2016 default unsat ✅ 0.16237 0.16255
stp-cms-mt-2016 default unsat ✅ 0.16321 0.16327
stp-cms-st-2016 default unsat ✅ 0.16397 0.16404
stp-minisat-st-2016 default unsat ✅ 0.16025 0.16031
Yices2 Yices-2.4.2 default unsat ✅ 0.05669 0.05669
Z3 z3-4.4.1 default unsat ✅ 0.53646 0.53801
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.47064 0.46966
Boolector SMT17 final boolector unsat ✅ 0.53251 0.53165
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.37427 4.15597
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.54733 0.54651
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.26237 0.26191
Q3B Q3B default unknown ❌ 600.03600 1799.59000
STP stp_st default unsat ✅ 0.18413 0.18362
stp_mt default unsat ✅ 0.19007 0.18949
Yices2 Yices2-Main default unsat ✅ 0.05366 0.05320
Z3 z3-4.5.0 default unsat ✅ 0.56979 0.56948
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.22906 1.22885
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.03951 3.03948
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.53783 0.53850
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.27606 0.27606
Minkeyrink ST_st unsat ✅ 0.27475 0.27481
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.18128 0.18128
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.18127 0.18133
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.18068 0.18070
Yices2 Yices 2.6.0_default unsat ✅ 0.05544 0.05538
Z3 z3-4.7.1_default unsat ✅ 0.60801 0.60761
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.37601 0.37591
Boolector Boolector-wrapped-sq_default unsat ✅ 0.52860 0.52863
Poolector-wrapped-sq_default unsat ✅ 0.67830 2.12000
CVC4 CVC4-sq-final_default unsat ✅ 2.62884 2.62884
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1200.01000
MathSAT MathSAT5_default.sh unsat ✅ 0.41470 0.41463
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.24264 0.24278
MinkeyRink Solver 2020.3_default unsat ✅ 0.26644 0.26654
STP STP_default unsat ✅ 0.17092 0.17104
STP ++ Mergsat v1_default unsat ✅ 0.16378 0.16546
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.06482 0.06476
Z3 z3-4.8.8_default unsat ✅ 0.54389 0.54383
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.37152 0.37142
MathSAT mathsat-5.6.6_default unsat ✅ 0.41428 0.41426
STP STP 2021.0_default unsat ✅ 0.17512 0.17522
Z3 z3-4.8.11_default unsat ✅ 0.57349 0.57343
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.37055 0.37046
Bitwuzla-wrapped_default unsat ✅ 0.37719 0.37713
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.71704 3.71735
MathSAT MathSAT-5.6.8_default unsat ✅ 0.42867 0.42749
STP STP 2022.4_default unsat ✅ 0.36240 0.36248
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.06410 0.06404
Z3++BV z3++bv_0702_default unsat ✅ 0.46613 0.46607
Z3 z3-4.8.17_default unsat ✅ 0.61121 0.61273
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 4.03992 4.04006
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.52070 2.51437
STP STP 2022.4_default unsat ✅ 0.25858 0.25859
STP 2022.4_default unsat ✅ 0.26053 0.26053
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 11.81520 35.85320
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.07577 0.07158
Z3-Owl z3-Owl-Final_default unsat ✅ 3.05909 3.05804
z3-Owl-Final_default unsat ✅ 3.11184 3.05905
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 2.29322 2.19281
cvc5 cvc5 unsat ✅ 2.14467 2.04440
SMTInterpol SMTInterpol unknown ❌ 1201.72065 1247.16420
STP STP unsat ✅ 0.46783 0.36750
Yices2 Yices2 unsat ✅ 0.25122 0.15141
Z3alpha Z3-alpha unsat ✅ 0.45425 0.35458