Benchmark

non-incremental/QF_BV/sage/app7/bench_1250.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1939712
Compressed Size133188
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1939704
Compressed Size133196
Max. Term Depth7484
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1691 and1
=2280 let7385 extract1264 bvand19452
bvor12685 bvxor1470 bvadd21118 bvmul1
bvsub6799 bvult438 bvule476 bvslt204
bvsle100 bvshl6636 bvashr12319 zero_extend979

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.29641 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.32858 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.33213 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.33411 —
abziz_portfolio_2012_solvers default unsat ✅ 0.32993 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.32569 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.37343 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.45435 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.39675 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 79.88220 —
CVC3-SMT-COMP-2011 default unsat ✅ 67.56400 —
CVC3-SMT-COMP-2012 default unsat ✅ 70.66190 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.54617 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.48235 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.57656 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.55654 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.72379 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.70847 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.51442 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.62931 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.59523 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.79260 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.31280 —
STP2-SMT-COMP-2012 default unsat ✅ 0.29859 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.28451 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.35256 —
Z3-SMT-COMP-2011 default unsat ✅ 0.32681 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.53246 0.53192
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.58093 4.22136
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.58023 4.22436
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.40482 0.40394
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.20000
STP stp-cryptominisat4 default unsat ✅ 0.26197 0.26096
stp-cmsat4-v15 default unsat ✅ 0.26259 0.26196
stp-cmsat4-mt-v15 default unsat ✅ 0.25947 0.25896
stp-minisat-v15 default unsat ✅ 0.26142 0.26096
Yices2 Yices default unsat ✅ 0.11526 0.11398
Z3 z3 4.4.0 default unsat ✅ 0.34761 0.34795
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.10889 1.10901
ABC_glucose glucose unsat ✅ 1.13547 1.13571
Boolector Boolector boolector unsat ✅ 0.65886 0.65956
Boolector preprop boolector unsat ✅ 0.64782 0.64801
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.52600 4.13969
MapleSTP MapleSTP default unsat ✅ 0.24711 0.24724
MapleSTP-mt default unsat ✅ 0.24960 0.24969
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.36724 0.36847
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.35834 0.35853
Q3B Q3B default unsat ✅ 0.59114 1.33000
STP stp-cms-exp-2016 default unsat ✅ 0.25391 0.25396
stp-cms-mt-2016 default unsat ✅ 0.25864 0.25877
stp-cms-st-2016 default unsat ✅ 0.25839 0.25850
stp-minisat-st-2016 default unsat ✅ 0.25807 0.25822
Yices2 Yices-2.4.2 default unsat ✅ 0.11496 0.11500
Z3 z3-4.4.1 default unsat ✅ 0.33053 0.33196
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.49269 0.49257
Boolector SMT17 final boolector unsat ✅ 0.50289 0.50171
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.52289 4.08101
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.38048 0.38068
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.76030 0.75876
Q3B Q3B default unsat ✅ 0.57180 0.57168
STP stp_st default unsat ✅ 0.33526 0.33381
stp_mt default unsat ✅ 0.32936 0.32745
Yices2 Yices2-Main default unsat ✅ 0.11064 0.10998
Z3 z3-4.5.0 default unsat ✅ 0.33022 0.32851
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.43485 0.43477
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.34183 2.34195
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.36609 0.36708
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.76568 0.76575
Minkeyrink ST_st unsat ✅ 0.75474 0.75464
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.32199 0.32207
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.32120 0.32124
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.32209 0.32212
Yices2 Yices 2.6.0_default unsat ✅ 0.10706 0.10701
Z3 z3-4.7.1_default unsat ✅ 0.35337 0.35321
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.85138 0.85139
Poolector-wrapped-sq_default unsat ✅ 1.09152 3.89222
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.68449 0.68454
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.55677 2.55674
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.54800 0.54813
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.54630 0.54636
Par4 Par4-wrapped-sq_default unsat ✅ 0.11734 0.00639
STP STP-2019-wrapped-sq_default unsat ✅ 0.34971 0.34983
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.34479 0.34495
stp-minisat-wrapped-sq_default unsat ✅ 0.34980 0.34991
stp-mt-wrapped-sq_default unsat ✅ 0.34976 0.34988
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.34594 0.34605
stp-riss-wrapped-sq_default unsat ✅ 0.34796 0.34806
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.11111 0.11113
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.11051 0.11049
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.11024 0.11022
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.10924 0.10925
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.11061 0.11065
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.41685 0.41676
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.66749 0.66740
Boolector Boolector-wrapped-sq_default unsat ✅ 0.84546 0.84542
Poolector-wrapped-sq_default unsat ✅ 1.08058 3.88865
CVC4 CVC4-sq-final_default unsat ✅ 3.12234 3.12246
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.45915 0.45910
MathSAT MathSAT5_default.sh unsat ✅ 0.38038 0.38030
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.45204 0.45213
MinkeyRink Solver 2020.3_default unsat ✅ 0.47119 0.47130
STP STP_default unsat ✅ 0.30588 0.30595
STP ++ Mergsat v1_default unsat ✅ 0.30195 0.30366
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12983 0.12974
Z3 z3-4.8.8_default unsat ✅ 0.35990 0.35983
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.66571 0.66565
Bitwuzla-wrapped_default unsat ✅ 0.74147 0.74145
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.36644 2.36685
MathSAT MathSAT-5.6.8_default unsat ✅ 0.38967 0.38955
STP STP 2022.4_default unsat ✅ 0.35623 0.35628
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.13157 0.13154
Z3++BV z3++bv_0702_default unsat ✅ 0.24064 0.24057
Z3 z3-4.8.17_default unsat ✅ 0.25659 0.25836
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.04852 1.04837
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.74624 1.74657
STP STP 2022.4_default unsat ✅ 0.35235 0.35240
STP 2022.4_default unsat ✅ 0.35116 0.35115
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 513.97900 592.33800
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12724 0.12715
Z3-Owl z3-Owl-Final_default unsat ✅ 1.06135 1.06121
z3-Owl-Final_default unsat ✅ 1.06429 1.06450
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.73792 0.63794
cvc5 cvc5 unsat ✅ 0.65756 0.55776
SMTInterpol SMTInterpol unsat ✅ 996.44198 1469.44177
STP STP unsat ✅ 11.54226 11.43828
Yices2 Yices2 unsat ✅ 0.32036 0.21924
Z3alpha Z3-alpha unsat ✅ 0.41538 0.31589
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.66440 0.54004
Bitwuzla-MachBV-base unsat ✅ 0.76701 0.64083
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.90956 0.77965
BVDecide bv_decide unsat ✅ 746.70436 746.48570
bv_decide-nokernel unsat ✅ 703.62320 703.32799
cvc5 cvc5 unsat ✅ 0.87132 0.74782
SMTInterpol SMTInterpol unknown ❌ 1201.85193 2900.23411
Yices2 Yices2 unsat ✅ 0.31289 0.19275
Z3alpha Z3-alpha unsat ✅ 0.67004 0.61083
Z3 Z3-alpha-base unsat ✅ 0.46139 0.33755
Z3-Owl-base unsat ✅ 1.22117 1.10195
z3siri-base unsat ✅ 0.46209 0.34666
Z3-Owl Z3-Owl unsat ✅ 1.03344 0.91269