Benchmark

non-incremental/QF_BV/sage/app7/bench_1626.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1468287
Compressed Size108795
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1468279
Compressed Size108804
Max. Term Depth5644
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1566 and1
=2122 let5587 extract1227 bvand14179
bvor9184 bvxor1410 bvadd15722 bvmul1
bvsub5085 bvult430 bvule462 bvslt198
bvsle98 bvshl4916 bvashr8872 zero_extend936

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.20682 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.27109 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.26918 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.26670 —
abziz_portfolio_2012_solvers default unsat ✅ 0.26759 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.27494 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.28074 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.34330 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.29727 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 143.61700 —
CVC3-SMT-COMP-2011 default unsat ✅ 120.31900 —
CVC3-SMT-COMP-2012 default unsat ✅ 125.46400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.20399 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.00393 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.44967 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.42385 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.55800 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54456 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.39545 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.17665 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.64467 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.58026 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.22145 —
STP2-SMT-COMP-2012 default unsat ✅ 0.20687 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.21344 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.29094 —
Z3-SMT-COMP-2011 default unsat ✅ 0.25946 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.39716 0.39594
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.98086 3.24051
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.97721 3.23751
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.31927 0.31795
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.85000
STP stp-cryptominisat4 default unsat ✅ 0.19792 0.19697
stp-cmsat4-v15 default unsat ✅ 0.19745 0.19597
stp-cmsat4-mt-v15 default unsat ✅ 0.19728 0.19597
stp-minisat-v15 default unsat ✅ 0.19741 0.19597
Yices2 Yices default unsat ✅ 0.08992 0.08898
Z3 z3 4.4.0 default unsat ✅ 0.28949 0.28896
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.84263 0.84291
ABC_glucose glucose unsat ✅ 0.84508 0.84588
Boolector Boolector boolector unsat ✅ 0.50540 0.50566
Boolector preprop boolector unsat ✅ 0.49637 0.49662
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.93689 3.17784
MapleSTP MapleSTP default unsat ✅ 0.18714 0.18717
MapleSTP-mt default unsat ✅ 0.18745 0.18750
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.29445 0.29562
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.25604 0.25615
Q3B Q3B default unsat ✅ 0.49039 0.84959
STP stp-cms-exp-2016 default unsat ✅ 0.19265 0.19269
stp-cms-mt-2016 default unsat ✅ 0.19552 0.19560
stp-cms-st-2016 default unsat ✅ 0.19494 0.19501
stp-minisat-st-2016 default unsat ✅ 0.20759 0.20767
Yices2 Yices-2.4.2 default unsat ✅ 0.09039 0.09039
Z3 z3-4.4.1 default unsat ✅ 0.23319 0.23459
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.37372 0.37293
Boolector SMT17 final boolector unsat ✅ 0.40072 0.40062
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.10493 3.42932
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31405 0.31336
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.59873 0.59788
Q3B Q3B default unsat ✅ 0.51882 0.51693
STP stp_st default unsat ✅ 0.26026 0.25901
stp_mt default unsat ✅ 0.23894 0.23869
Yices2 Yices2-Main default unsat ✅ 0.08993 0.08760
Z3 z3-4.5.0 default unsat ✅ 0.27869 0.27784
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.33028 0.32982
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.78807 1.78788
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.28402 0.28509
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.57229 0.57208
Minkeyrink ST_st unsat ✅ 0.57351 0.57351
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.24126 0.24128
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.24126 0.24128
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.24126 0.24127
Yices2 Yices 2.6.0_default unsat ✅ 0.08380 0.08373
Z3 z3-4.7.1_default unsat ✅ 0.31952 0.31922
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.61588 0.61584
Poolector-wrapped-sq_default unsat ✅ 0.78859 2.80088
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.51176 0.51174
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.82553 1.82555
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.43345 0.43358
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.43232 0.43237
Par4 Par4-wrapped-sq_default unsat ✅ 0.09237 0.00600
STP STP-2019-wrapped-sq_default unsat ✅ 0.25459 0.25471
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.25010 0.25023
stp-minisat-wrapped-sq_default unsat ✅ 0.25164 0.25161
stp-mt-wrapped-sq_default unsat ✅ 0.25300 0.25291
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.24945 0.24961
stp-riss-wrapped-sq_default unsat ✅ 0.25338 0.25347
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.08739 0.08735
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.08722 0.08716
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.08700 0.08701
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08658 0.08655
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.08892 0.08883
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.30563 0.30558
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.50625 0.50614
Boolector Boolector-wrapped-sq_default unsat ✅ 0.61123 0.61123
Poolector-wrapped-sq_default unsat ✅ 0.77736 2.79092
CVC4 CVC4-sq-final_default unsat ✅ 2.37038 2.37054
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.35745 0.35741
MathSAT MathSAT5_default.sh unsat ✅ 0.29209 0.29197
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.35730 0.35745
MinkeyRink Solver 2020.3_default unsat ✅ 0.37196 0.37206
STP STP_default unsat ✅ 0.23096 0.23102
STP ++ Mergsat v1_default unsat ✅ 0.23032 0.23211
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.10234 0.10225
Z3 z3-4.8.8_default unsat ✅ 0.22688 0.22680
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.50434 0.50429
MathSAT mathsat-5.6.6_default unsat ✅ 0.30156 0.30149
STP STP 2021.0_default unsat ✅ 0.23883 0.23950
Z3 z3-4.8.11_default unsat ✅ 0.20219 0.20214
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.50265 0.50254
Bitwuzla-wrapped_default unsat ✅ 0.54134 0.54116
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.83938 1.83993
MathSAT MathSAT-5.6.8_default unsat ✅ 0.30396 0.30390
STP STP 2022.4_default unsat ✅ 0.25853 0.25860
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.10358 0.10327
Z3++BV z3++bv_0702_default unsat ✅ 0.27613 0.27595
Z3 z3-4.8.17_default unsat ✅ 0.25821 0.25855
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.76683 0.76671
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.33935 1.33449
STP STP 2022.4_default unsat ✅ 0.25572 0.25562
STP 2022.4_default unsat ✅ 0.25245 0.25251
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 427.14000 484.50000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.09976 0.09972
Z3-Owl z3-Owl-Final_default unsat ✅ 0.89923 0.89926
z3-Owl-Final_default unsat ✅ 0.92527 0.92555
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.58505 0.45787
Bitwuzla-MachBV-base unsat ✅ 0.60734 0.48363
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.74046 0.61150
BVDecide bv_decide unsat ✅ 375.19920 375.02272
bv_decide-nokernel unsat ✅ 327.08962 326.89651
cvc5 cvc5 unsat ✅ 0.54579 0.41923
SMTInterpol SMTInterpol unknown ❌ 1201.89053 3146.97772
Yices2 Yices2 unsat ✅ 0.33762 0.21299
Z3alpha Z3-alpha unsat ✅ 0.61426 0.53588
Z3 Z3-alpha-base unsat ✅ 0.42410 0.29215
Z3-Owl-base unsat ✅ 0.80435 0.68273
z3siri-base unsat ✅ 0.40377 0.27942
Z3-Owl Z3-Owl unsat ✅ 0.93009 0.80351