Benchmark

non-incremental/QF_BV/sage/app11/bench_396.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1530926
Compressed Size151093
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1530918
Compressed Size151101
Max. Term Depth4211
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1287
and1 =2079 let2878 extract1486
bvand968 bvor273 bvxor2281 bvadd14629
bvmul1183 bvsdiv16 bvult1096 bvule1501
bvslt122 bvsle163 bvshl8908 bvashr13274
zero_extend10174

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41389 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40384 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40518 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41236 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21674 —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.63220 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46145 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44954 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.15290 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54573 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54352 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08004 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16512 —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32626 0.32529
Boolector SMT17 final boolector unsat ✅ 0.33566 0.33512
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.82444 6.83664
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31947 0.31822
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69551 0.69283
Q3B Q3B default unsat ✅ 27.85960 82.57000
STP stp_st default unsat ✅ 6.80249 6.79985
stp_mt default unsat ✅ 6.81964 6.81869
Yices2 Yices2-Main default unsat ✅ 0.12599 0.12547
Z3 z3-4.5.0 default unsat ✅ 0.32854 0.32778
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29272 0.29262
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.31508 3.31497
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.31339 0.31451
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68012 0.68015
Minkeyrink ST_st unsat ✅ 0.68137 0.68130
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.16640 12.16700
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.17490 12.17390
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.16290 12.16190
Yices2 Yices 2.6.0_default unsat ✅ 0.12132 0.12125
Z3 z3-4.7.1_default unsat ✅ 0.27270 0.27255
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.58463 0.58412
Poolector-wrapped-sq_default unsat ✅ 0.81143 2.89972
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.50938 0.50933
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.30926 3.30917
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.35426 1.35443
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.33586 1.33596
Par4 Par4-wrapped-sq_default unsat ✅ 0.13229 0.00599
STP STP-2019-wrapped-sq_default unsat ✅ 12.57670 12.57600
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 12.59550 12.59500
stp-minisat-wrapped-sq_default unsat ✅ 12.57670 12.57690
stp-mt-wrapped-sq_default unsat ✅ 12.57770 12.57760
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 12.59130 12.59130
stp-riss-wrapped-sq_default unsat ✅ 12.55640 12.55720
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12676 0.12673
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12370 0.12366
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12654 0.12652
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12535 0.12534
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12625 0.12622
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.28382 0.28383
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41667 0.41665
Boolector Boolector-wrapped-sq_default unsat ✅ 0.58086 0.58083
Poolector-wrapped-sq_default unsat ✅ 0.77821 2.63525
CVC4 CVC4-sq-final_default unsat ✅ 3.77827 3.77872
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 87.68370 87.67760
MathSAT MathSAT5_default.sh unsat ✅ 0.32405 0.32395
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05312 1.05124
MinkeyRink Solver 2020.3_default unsat ✅ 1.11717 1.11724
STP STP_default unsat ✅ 21.09720 21.09440
STP ++ Mergsat v1_default unsat ✅ 22.31810 22.31570
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.13898 0.13885
Z3 z3-4.8.8_default unsat ✅ 0.20367 0.20360
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41418 0.41412
MathSAT mathsat-5.6.6_default unsat ✅ 33.69430 33.68970
STP STP 2021.0_default unsat ✅ 15.73080 15.73050
Z3 z3-4.8.11_default unsat ✅ 0.22930 0.22923
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41683 0.41674
Bitwuzla-wrapped_default unsat ✅ 0.44176 0.44173
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.11920 4.11475
MathSAT MathSAT-5.6.8_default unsat ✅ 0.31078 0.31063
STP STP 2022.4_default unsat ✅ 0.19040 0.19045
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.13957 0.13955
Z3++BV z3++bv_0702_default unsat ✅ 0.29389 0.29374
Z3 z3-4.8.17_default unsat ✅ 0.27427 0.27411
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62668 0.62522
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.32146 3.31989
STP STP 2022.4_default unsat ✅ 0.18991 0.18993
STP 2022.4_default unsat ✅ 0.19614 0.19615
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1235.14000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13492 0.13487
Z3-Owl z3-Owl-Final_default unsat ✅ 0.93133 0.93136
z3-Owl-Final_default unsat ✅ 0.94061 0.94092
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.73748 0.63762
cvc5 cvc5 unsat ✅ 1.37969 1.27993
SMTInterpol SMTInterpol unknown ❌ 1202.71965 1911.38702
STP STP unsat ✅ 9.41596 9.31597
Yices2 Yices2 unsat ✅ 0.31050 0.21048
Z3alpha Z3-alpha unsat ✅ 0.44619 0.34674