Benchmark

non-incremental/QF_BV/sage/app7/bench_6002.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4465301
Compressed Size280167
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4465293
Compressed Size280155
Max. Term Depth17064
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2773 and1
=3573 let16844 extract1722 bvand46148
bvor30441 bvxor2330 bvadd49680 bvmul9
bvsub16270 bvsdiv28 bvult644 bvule652
bvslt221 bvsle126 bvshl15944 bvashr30118
zero_extend1525

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71096 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68381 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.68095 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68174 —
abziz_portfolio_2012_solvers default unsat ✅ 0.68563 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68807 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95146 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06897 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.00289 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 580.85700 —
CVC3-SMT-COMP-2011 default unsat ✅ 482.26000 —
CVC3-SMT-COMP-2012 default unsat ✅ 503.34100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.67290 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.59537 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32144 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27166 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.66572 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.61555 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.15815 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.68069 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.26770 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87906 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74362 —
STP2-SMT-COMP-2012 default unsat ✅ 0.71020 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76229 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76472 —
Z3-SMT-COMP-2011 default unsat ✅ 0.67989 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.24216 1.23800
Boolector SMT17 final boolector unsat ✅ 1.20144 1.20030
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.77571 9.18063
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.84868 0.84903
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.70006 1.69831
Q3B Q3B default unsat ✅ 1.12220 2.93000
STP stp_st default unsat ✅ 0.83218 0.83266
stp_mt default unsat ✅ 0.81462 0.81455
Yices2 Yices2-Main default unsat ✅ 0.28272 0.28171
Z3 z3-4.5.0 default unsat ✅ 0.89048 0.88961
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.06821 1.06792
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.34086 5.34050
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83302 0.83388
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.72487 1.72468
Minkeyrink ST_st unsat ✅ 1.73514 1.73525
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83334 0.83339
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83074 0.83063
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83244 0.83249
Yices2 Yices 2.6.0_default unsat ✅ 0.27515 0.27501
Z3 z3-4.7.1_default unsat ✅ 0.96258 0.96226
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.68642 1.68609
Boolector Boolector-wrapped-sq_default unsat ✅ 2.11106 2.11098
Poolector-wrapped-sq_default unsat ✅ 2.48872 9.31000
CVC4 CVC4-sq-final_default unsat ✅ 7.33998 7.33859
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05621 1.05613
MathSAT MathSAT5_default.sh unsat ✅ 0.85898 0.85861
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.97293 0.97298
MinkeyRink Solver 2020.3_default unsat ✅ 1.00997 1.01005
STP STP_default unsat ✅ 0.78395 0.78403
STP ++ Mergsat v1_default unsat ✅ 0.77028 0.77201
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.32695 0.32688
Z3 z3-4.8.8_default unsat ✅ 0.68651 0.68641
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66991 1.66978
Bitwuzla-wrapped_default unsat ✅ 1.86748 1.86735
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.71275 5.71308
MathSAT MathSAT-5.6.8_default unsat ✅ 0.88573 0.88546
STP STP 2022.4_default unsat ✅ 0.85169 0.85174
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.32706 0.32695
Z3++BV z3++bv_0702_default unsat ✅ 0.90401 0.90382
Z3 z3-4.8.17_default unsat ✅ 0.84346 0.84125
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.52644 2.52651
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.24310 4.23949
STP STP 2022.4_default unsat ✅ 0.95213 0.94913
STP 2022.4_default unsat ✅ 0.85455 0.85456
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1335.02000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.31684 0.31680
Z3-Owl z3-Owl-Final_default unsat ✅ 1.17823 1.17820
z3-Owl-Final_default unsat ✅ 1.18362 1.18371
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.14397 1.02470
Bitwuzla-MachBV-base unsat ✅ 1.51687 1.39533
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.71787 1.58742
BVDecide bv_decide unknown ❌ 1201.38512 1201.01349
bv_decide-nokernel unknown ❌ 1201.37545 1200.98402
cvc5 cvc5 unsat ✅ 0.93207 0.80436
SMTInterpol SMTInterpol unknown ❌ 1201.85133 1979.80970
Yices2 Yices2 unsat ✅ 0.47361 0.33464
Z3alpha Z3-alpha unsat ✅ 1.06598 1.08089
Z3 Z3-alpha-base unsat ✅ 0.60432 0.47352
Z3-Owl-base unsat ✅ 1.64824 1.53059
z3siri-base unsat ✅ 0.62705 0.50986
Z3-Owl Z3-Owl unsat ✅ 1.12082 0.99796