Benchmark

non-incremental/QF_BV/sage/app7/bench_1794.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1208513
Compressed Size94661
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1208505
Compressed Size94666
Max. Term Depth4634
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1501 and1
=2034 let4577 extract1189 bvand11308
bvor7295 bvxor1349 bvadd12780 bvmul1
bvsub4110 bvult425 bvule447 bvslt190
bvsle96 bvshl3956 bvashr6974 zero_extend904

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.17107 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22131 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.22193 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.22587 —
abziz_portfolio_2012_solvers default unsat ✅ 0.22033 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.22154 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23358 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.27802 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24665 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 103.90100 —
CVC3-SMT-COMP-2011 default unsat ✅ 86.99110 —
CVC3-SMT-COMP-2012 default unsat ✅ 90.37050 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.03597 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.74836 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.37416 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.35418 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.46945 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45066 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.32442 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.80568 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.15583 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.47604 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.18699 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17001 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.17723 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.24963 —
Z3-SMT-COMP-2011 default unsat ✅ 0.22199 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.32929 0.32795
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.66974 2.74058
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.66513 2.73258
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.25968 0.25896
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.88000
STP stp-cryptominisat4 default unsat ✅ 0.16537 0.16397
stp-cmsat4-v15 default unsat ✅ 0.16176 0.16098
stp-cmsat4-mt-v15 default unsat ✅ 0.16387 0.16297
stp-minisat-v15 default unsat ✅ 0.16192 0.16098
Yices2 Yices default unsat ✅ 0.07545 0.07399
Z3 z3 4.4.0 default unsat ✅ 0.24714 0.24696
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.69111 0.69145
ABC_glucose glucose unsat ✅ 0.68379 0.68406
Boolector Boolector boolector unsat ✅ 0.39655 0.39696
Boolector preprop boolector unsat ✅ 0.38942 0.38986
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.64921 2.71319
MapleSTP MapleSTP default unsat ✅ 0.15568 0.15575
MapleSTP-mt default unsat ✅ 0.15420 0.15426
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.23653 0.23769
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.20824 0.20833
Q3B Q3B default unsat ✅ 0.42453 1.00459
STP stp-cms-exp-2016 default unsat ✅ 0.16102 0.16130
stp-cms-mt-2016 default unsat ✅ 0.16125 0.16129
stp-cms-st-2016 default unsat ✅ 0.16055 0.16059
stp-minisat-st-2016 default unsat ✅ 0.16072 0.16074
Yices2 Yices-2.4.2 default unsat ✅ 0.07737 0.07738
Z3 z3-4.4.1 default unsat ✅ 0.28180 0.28377
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32030 0.31894
Boolector SMT17 final boolector unsat ✅ 0.32900 0.32819
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.61126 2.61260
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.25624 0.25393
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.46133 0.46063
Q3B Q3B default unsat ✅ 0.42522 0.99028
STP stp_st default unsat ✅ 0.19838 0.19767
stp_mt default unsat ✅ 0.21090 0.20697
Yices2 Yices2-Main default unsat ✅ 0.07524 0.07519
Z3 z3-4.5.0 default unsat ✅ 0.25835 0.25741
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.26830 0.26825
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.45993 1.45996
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.23056 0.23131
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.46644 0.46642
Minkeyrink ST_st unsat ✅ 0.48119 0.47865
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.20045 0.20032
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.20035 0.20028
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.20030 0.20026
Yices2 Yices 2.6.0_default unsat ✅ 0.07165 0.07156
Z3 z3-4.7.1_default unsat ✅ 0.30801 0.30788
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40275 0.40270
Boolector Boolector-wrapped-sq_default unsat ✅ 0.49764 0.49745
Poolector-wrapped-sq_default unsat ✅ 0.67750 2.31381
CVC4 CVC4-sq-final_default unsat ✅ 1.93622 1.93624
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.28823 0.28814
MathSAT MathSAT5_default.sh unsat ✅ 0.23830 0.23819
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.30092 0.30100
MinkeyRink Solver 2020.3_default unsat ✅ 0.31187 0.31196
STP STP_default unsat ✅ 0.19305 0.19309
STP ++ Mergsat v1_default unsat ✅ 0.18697 0.18863
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.08517 0.08514
Z3 z3-4.8.8_default unsat ✅ 0.19680 0.19670
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40114 0.40105
MathSAT mathsat-5.6.6_default unsat ✅ 0.24460 0.24456
STP STP 2021.0_default unsat ✅ 0.25760 0.25441
Z3 z3-4.8.11_default unsat ✅ 0.23940 0.23937
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40346 0.40337
Bitwuzla-wrapped_default unsat ✅ 0.43559 0.43418
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.49302 1.49338
MathSAT MathSAT-5.6.8_default unsat ✅ 0.26933 0.26806
STP STP 2022.4_default unsat ✅ 0.21986 0.21864
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.08740 0.08721
Z3++BV z3++bv_0702_default unsat ✅ 0.17075 0.17072
Z3 z3-4.8.17_default unsat ✅ 0.17704 0.17789
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.55774 0.45830
cvc5 cvc5 unsat ✅ 0.73735 0.63802
SMTInterpol SMTInterpol unsat ✅ 777.62769 1153.81539
STP STP unsat ✅ 5.04503 4.94499
Yices2 Yices2 unsat ✅ 0.27389 0.17393
Z3alpha Z3-alpha unsat ✅ 0.39781 0.25261
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.62238 0.49641
Bitwuzla-MachBV-base unsat ✅ 0.56188 0.43519
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.66887 0.53434
BVDecide bv_decide unsat ✅ 215.91534 215.73510
bv_decide-nokernel unsat ✅ 191.75977 191.59913
cvc5 cvc5 unsat ✅ 0.62262 0.49234
SMTInterpol SMTInterpol unknown ❌ 1201.88752 3573.40012
Yices2 Yices2 unsat ✅ 0.31439 0.19745
Z3alpha Z3-alpha unsat ✅ 0.54732 0.45677
Z3 Z3-alpha-base unsat ✅ 0.42802 0.30181
Z3-Owl-base unsat ✅ 0.89250 0.76580
z3siri-base unsat ✅ 0.38945 0.27192
Z3-Owl Z3-Owl unsat ✅ 0.94708 0.81389