Benchmark

non-incremental/QF_BV/sage/app7/bench_6569.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3458871
Compressed Size219557
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3458863
Compressed Size219562
Max. Term Depth13271
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2403 and1
=3123 let13166 extract1677 bvand35290
bvor23149 bvxor2195 bvadd38138 bvmul7
bvsub12350 bvsdiv19 bvult584 bvule625
bvslt219 bvsle124 bvshl12163 bvashr22783
zero_extend1479

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51131
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.56367
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.56279
abziz_portfolio_2012_minfeatures default unsat ✅ 0.57252
abziz_portfolio_2012_solvers default unsat ✅ 0.56309
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.56026
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.68466
Boolector-SMT-COMP-2011 default unsat ✅ 0.82714
Boolector-SMT-COMP-2012 default unsat ✅ 0.72056
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 352.20600
CVC3-SMT-COMP-2011 default unsat ✅ 294.36200
CVC3-SMT-COMP-2012 default unsat ✅ 307.47000
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.04515
CVC4-SMT-EVAL-2013 default unsat ✅ 4.66614
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.03700
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.00256
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.28418
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.25428
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.90162
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.24502
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.37050
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.40125
STP STP2-SMT-COMP-2011 default unsat ✅ 0.54273
STP2-SMT-COMP-2012 default unsat ✅ 0.52535
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.55124
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.61711
Z3-SMT-COMP-2011 default unsat ✅ 0.55481
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.93241 0.93201
Boolector SMT17 final boolector unsat ✅ 0.92049 0.92043
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.47085 7.18950
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.74351 0.74376
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.35376 1.35358
Q3B Q3B default unsat ✅ 0.90212 2.30000
STP stp_st default unsat ✅ 0.61414 0.61370
stp_mt default unsat ✅ 0.67334 0.66997
Yices2 Yices2-Main default unsat ✅ 0.38205 0.38007
Z3 z3-4.5.0 default unsat ✅ 0.78215 0.77990
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.80673 0.80670
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.12706 4.12734
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.65505 0.65630
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.35427 1.34844
Minkeyrink ST_st unsat ✅ 1.34846 1.34784
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.60661 0.60639
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.60581 0.60577
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.60014 0.60017
Yices2 Yices 2.6.0_default unsat ✅ 0.37872 0.37858
Z3 z3-4.7.1_default unsat ✅ 0.87433 0.87399
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.29107 1.29086
Boolector Boolector-wrapped-sq_default unsat ✅ 1.54969 1.54855
Poolector-wrapped-sq_default unsat ✅ 1.88259 6.95853
CVC4 CVC4-sq-final_default unsat ✅ 5.67604 5.67523
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.83267 0.83254
MathSAT MathSAT5_default.sh unsat ✅ 0.67616 0.67601
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.76365 0.76343
MinkeyRink Solver 2020.3_default unsat ✅ 0.79237 0.79249
STP STP_default unsat ✅ 0.56982 0.56977
STP ++ Mergsat v1_default unsat ✅ 0.56222 0.56401
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.39157 0.39152
Z3 z3-4.8.8_default unsat ✅ 0.37096 0.37089
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.03557 2.03531
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.17799 3.17811
STP STP 2022.4_default unsat ✅ 0.63249 0.63255
STP 2022.4_default unsat ✅ 0.62582 0.62585
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1314.35000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.38909 0.38900
Z3-Owl z3-Owl-Final_default unsat ✅ 1.30673 1.30662
z3-Owl-Final_default unsat ✅ 1.36292 1.31057
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.26345 1.16380
cvc5 cvc5 unsat ✅ 1.90056 1.80078
SMTInterpol SMTInterpol unknown ❌ 1202.74663 1401.71151
STP STP unsat ✅ 38.95752 38.85703
Yices2 Yices2 unsat ✅ 0.47021 0.37035
Z3alpha Z3-alpha unsat ✅ 0.55602 0.45609
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.03363 0.90503
Bitwuzla-MachBV-base unsat ✅ 1.23734 1.11194
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.44674 1.31889
BVDecide bv_decide unknown ❌ 1201.35115 1201.00633
bv_decide-nokernel unknown ❌ 1201.38634 1200.98612
cvc5 cvc5 unsat ✅ 1.33171 1.21301
SMTInterpol SMTInterpol unknown ❌ 1201.89209 1769.97955
Yices2 Yices2 unsat ✅ 0.47440 0.35647
Z3alpha Z3-alpha unsat ✅ 0.97876 0.96782
Z3 Z3-alpha-base unsat ✅ 0.49970 0.38301
Z3-Owl-base unsat ✅ 1.33807 1.20829
z3siri-base unsat ✅ 0.49216 0.37412
Z3-Owl Z3-Owl unsat ✅ 1.06017 0.93132