Benchmark

non-incremental/QF_BV/sage/app2/bench_557.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size314468
Compressed Size40173
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 314460
Compressed Size40183
Max. Term Depth920
Asserts 1
Declared Functions0
Declared Constants1205
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true34 ite1 not231 and1
=398 let744 extract163 bvand1626
bvor52 bvxor60 bvadd3328 bvmul22
bvsub2171 bvsdiv22 bvult123 bvule248
bvslt161 bvsle63 bvshl2009 bvashr1042
zero_extend1339

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 4Simp 4Simp unsat ✅ — —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 0.10000 —
Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3 v2.4.2 unsat ✅ 0.30000 —
CVC4 1.0rc.3931 unknown ❌ 10.30000 —
MathSAT MathSAT-HeavyBV unsat ✅ 0.10000 —
SONOLAR SONOLAR unsat ✅ 0.60000 —
Z3 Z3 unsat ✅ 0.10000 —
SMT Evaluation 2013 0.22 (7/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.14832 —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.14793 —
abziz_portfolio_2012_solvers default unsat ✅ 0.14833 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.14821 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unsat ✅ 0.06397 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.04727 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unsat ✅ 1.41848 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.44209 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ 892.76800 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.11275 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.10409 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 2.72749 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.95510 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.35815 —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unsat ✅ 0.04315 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04474 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unsat ✅ 0.14190 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07230 0.06990
Boolector SMT17 final boolector unsat ✅ 0.06610 0.06680
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.96227 5.76643
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08336 0.08433
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.18590 0.18552
Q3B Q3B default unsat ✅ 0.35575 0.79107
STP stp_st default unsat ✅ 0.05295 0.05199
stp_mt default unsat ✅ 0.05588 0.05391
Yices2 Yices2-Main default unsat ✅ 0.02941 0.02825
Z3 z3-4.5.0 default unsat ✅ 0.17515 0.17427
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.06884 0.06876
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.72657 1.72654
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08306 0.08411
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.18204 0.18209
Minkeyrink ST_st unsat ✅ 0.18196 0.18196
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.12929 0.12934
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.12921 0.12920
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.12810 0.12812
Yices2 Yices 2.6.0_default unsat ✅ 0.03046 0.03037
Z3 z3-4.7.1_default unsat ✅ 0.15857 0.15847
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10181 0.10176
MathSAT mathsat-5.6.6_default unsat ✅ 3.66848 3.66838
STP STP 2021.0_default unsat ✅ 0.05296 0.05304
Z3 z3-4.8.11_default unsat ✅ 0.16496 0.16489
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10225 0.10221
Bitwuzla-wrapped_default unsat ✅ 0.10436 0.10428
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.60572 1.60615
MathSAT MathSAT-5.6.8_default unsat ✅ 3.66971 3.66911
STP STP 2022.4_default unsat ✅ 0.04961 0.04967
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03384 0.03381
Z3++BV z3++bv_0702_default unsat ✅ 29.57510 29.57160
Z3 z3-4.8.17_default unsat ✅ 0.17262 0.17442
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 6.50355 6.50219
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.64410 1.64449
STP STP 2022.4_default unsat ✅ 0.04951 0.04952
STP 2022.4_default unsat ✅ 0.04958 0.04959
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 11.55750 33.22070
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03294 0.03288
Z3-Owl z3-Owl-Final_default unsat ✅ 0.82986 0.82979
z3-Owl-Final_default unsat ✅ 0.83369 0.83388
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.33878 0.21771
Bitwuzla-MachBV-base unsat ✅ 0.31588 0.20131
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.42531 0.29875
BVDecide bv_decide unsat ✅ 336.31802 336.11557
bv_decide-nokernel unsat ✅ 205.44984 205.25536
cvc5 cvc5 unsat ✅ 1.27308 1.14267
SMTInterpol SMTInterpol unsat ✅ 16.16326 37.39377
Yices2 Yices2 unsat ✅ 0.28315 0.15537
Z3alpha Z3-alpha unsat ✅ 0.41962 0.31090
Z3 Z3-alpha-base unsat ✅ 0.39593 0.26702
Z3-Owl-base unsat ✅ 0.71478 0.58769
z3siri-base unsat ✅ 0.37615 0.24133
Z3-Owl Z3-Owl unsat ✅ 0.88193 0.75112