Benchmark

non-incremental/QF_BV/sage/app12/bench_5545.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size56776
Compressed Size7665
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 56768
Compressed Size7679
Max. Term Depth56
Asserts 1
Declared Functions0
Declared Constants316
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite39 not234 and1
=415 let46 bvor148 bvadd162
bvsub213 bvult161 bvule144 bvslt37
bvsle36 bvshl155 zero_extend324

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.36220 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.26874 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.27843 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.27316 —
abziz_portfolio_2012_solvers default sat ✅ 0.27332 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.26939 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 4.43521 —
Boolector-SMT-COMP-2011 default sat ✅ 2.40614 —
Boolector-SMT-COMP-2012 default sat ✅ 0.03823 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 9.81124 —
CVC3-SMT-COMP-2011 default sat ✅ 8.66616 —
CVC3-SMT-COMP-2012 default sat ✅ 8.90158 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.25861 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.34900 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.17834 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.75930 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.14484 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.16327 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.10480 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.46496 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.51954 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.11218 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.08352 —
STP2-SMT-COMP-2012 default sat ✅ 0.14688 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.28460 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.29092 —
Z3-SMT-COMP-2011 default sat ✅ 0.26469 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.79108 4.79227
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.59630 1.14482
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.62332 1.20382
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.66887 0.66790
SMT-RAT SMT-RAT-final default sat ✅ 179.51600 179.57100
STP stp-cryptominisat4 default sat ✅ 0.12422 0.12298
stp-cmsat4-v15 default sat ✅ 0.11752 0.11698
stp-cmsat4-mt-v15 default unknown ❌ 0.11122 0.10998
stp-minisat-v15 default sat ✅ 0.11616 0.11498
Yices2 Yices default sat ✅ 0.01637 0.01500
Z3 z3 4.4.0 default sat ✅ 0.16000 0.15998
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 26.14350 26.15820
ABC_glucose glucose sat ✅ 4.46000 4.46233
Boolector Boolector boolector sat ✅ 2.92143 2.92134
Boolector preprop boolector sat ✅ 2.83384 2.83583
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.62406 1.20700
MapleSTP MapleSTP default sat ✅ 0.13157 0.13158
MapleSTP-mt default sat ✅ 0.13708 0.28306
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.58674 0.58805
MinkeyRink Minkeyrink 2016 default sat ✅ 0.25858 0.36261
Q3B Q3B default unknown ❌ 2400.02000 7203.83000
STP stp-cms-exp-2016 default sat ✅ 0.12851 0.12859
stp-cms-mt-2016 default sat ✅ 0.13917 0.28673
stp-cms-st-2016 default sat ✅ 0.12688 0.12685
stp-minisat-st-2016 default sat ✅ 0.29176 0.29189
Yices2 Yices-2.4.2 default sat ✅ 0.02002 0.01992
Z3 z3-4.4.1 default sat ✅ 0.18421 0.18545
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.34033 1.33921
Boolector SMT17 final boolector sat ✅ 4.30852 4.30857
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.53066 1.01354
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.72385 0.72410
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.13121 0.11833
Q3B Q3B default unknown ❌ 600.07300 1786.52000
STP stp_st default sat ✅ 0.47800 0.47791
stp_mt default sat ✅ 0.64724 1.30873
Yices2 Yices2-Main default sat ✅ 0.01774 0.01725
Z3 z3-4.5.0 default sat ✅ 0.49983 0.49520
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.54150 0.54146
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.76360 0.76372
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.60347 0.60457
MinkeyRink Minkeyrink MT_mt sat ✅ 0.08317 0.09308
Minkeyrink ST_st sat ✅ 0.08047 0.08065
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.26136 0.26139
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.28027 0.47251
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.04000 1200.09000
Yices2 Yices 2.6.0_default sat ✅ 0.01822 0.01811
Z3 z3-4.7.1_default sat ✅ 0.43201 0.43190
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.21094 0.21085
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.39572 0.39628
STP STP 2022.4_default sat ✅ 0.09134 0.09139
STP 2022.4_default sat ✅ 0.09142 0.09144
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1256.68000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01888 0.01884
Z3-Owl z3-Owl-Final_default sat ✅ 10.01090 10.01040
z3-Owl-Final_default sat ✅ 10.05870 10.05800
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.27391 0.17418
cvc5 cvc5 sat ✅ 0.59491 0.49525
SMTInterpol SMTInterpol unknown ❌ 1201.72413 1233.60882
STP STP sat ✅ 0.26668 0.16662
Yices2 Yices2 sat ✅ 0.23997 0.14002
Z3alpha Z3-alpha sat ✅ 0.36630 0.26680
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.30350 0.18405
Bitwuzla-MachBV-base sat ✅ 0.31694 0.19660
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.89268 0.77133
BVDecide bv_decide sat ✅ 6.64114 6.47513
bv_decide-nokernel sat ✅ 6.02459 5.88865
cvc5 cvc5 sat ✅ 0.46834 0.35056
SMTInterpol SMTInterpol unknown ❌ 1201.46982 1229.72787
Yices2 Yices2 sat ✅ 0.35440 0.22816
Z3alpha Z3-alpha sat ✅ 0.73770 1.51046
Z3 Z3-alpha-base sat ✅ 1.07587 0.95229
Z3-Owl-base sat ✅ 3.36907 3.24294
z3siri-base sat ✅ 1.10688 0.97854
Z3-Owl Z3-Owl sat ✅ 3.98389 3.86084