Benchmark

non-incremental/QF_BV/sage/app7/bench_6725.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3442027
Compressed Size219102
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3442019
Compressed Size219108
Max. Term Depth13201
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2393 and1
=3110 let13097 extract1677 bvand35108
bvor23029 bvxor2191 bvadd37949 bvmul7
bvsub12294 bvsdiv19 bvult584 bvule625
bvslt219 bvsle124 bvshl12108 bvashr22668
zero_extend1479

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51300
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.55664
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.56089
abziz_portfolio_2012_minfeatures default unsat ✅ 0.56388
abziz_portfolio_2012_solvers default unsat ✅ 0.56455
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.56158
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.68559
Boolector-SMT-COMP-2011 default unsat ✅ 0.83195
Boolector-SMT-COMP-2012 default unsat ✅ 0.72131
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.49600
CVC3-SMT-COMP-2011 default unsat ✅ 147.51300
CVC3-SMT-COMP-2012 default unsat ✅ 154.23700
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.00849
CVC4-SMT-EVAL-2013 default unsat ✅ 4.65010
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.02570
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.98660
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.27739
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.24724
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.90085
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.21808
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.35409
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.39344
STP STP2-SMT-COMP-2011 default unsat ✅ 0.54096
STP2-SMT-COMP-2012 default unsat ✅ 0.51234
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.54574
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.60299
Z3-SMT-COMP-2011 default unsat ✅ 0.55261
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.89580 0.89510
Boolector SMT17 final boolector unsat ✅ 0.89257 0.89203
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.37161 7.01231
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.70894 0.70787
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.29959 1.29628
Q3B Q3B default unsat ✅ 0.87576 2.29000
STP stp_st default unsat ✅ 0.60964 0.60899
stp_mt default unsat ✅ 0.62830 0.62824
Yices2 Yices2-Main default unsat ✅ 0.38350 0.38060
Z3 z3-4.5.0 default unsat ✅ 0.66221 0.66040
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.81194 0.81178
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.13374 4.13298
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.65857 0.65944
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.32303 1.32294
Minkeyrink ST_st unsat ✅ 1.32787 1.32783
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.59876 0.59867
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.59651 0.59654
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.59728 0.59733
Yices2 Yices 2.6.0_default unsat ✅ 0.38036 0.38022
Z3 z3-4.7.1_default unsat ✅ 0.83016 0.82995
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.54014 1.54000
Poolector-wrapped-sq_default unsat ✅ 1.79420 6.63000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.24927 1.24888
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.29717 4.29737
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.92814 0.92831
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.92096 1.79096
Par4 Par4-wrapped-sq_default unsat ✅ 0.40376 0.00607
STP STP-2019-wrapped-sq_default unsat ✅ 0.62348 1.18363
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.60456 0.60466
stp-minisat-wrapped-sq_default unsat ✅ 0.61190 0.61209
stp-mt-wrapped-sq_default unsat ✅ 0.61214 0.61218
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.60546 0.60559
stp-riss-wrapped-sq_default unsat ✅ 0.61242 0.61252
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.35410 0.35403
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.35763 0.35761
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.35221 0.35216
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.35090 0.35093
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.35204 0.35203
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.71463 0.71464
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.29466 1.29448
Boolector Boolector-wrapped-sq_default unsat ✅ 1.55321 1.55319
Poolector-wrapped-sq_default unsat ✅ 1.88112 6.94881
CVC4 CVC4-sq-final_default unsat ✅ 5.64500 5.64459
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.82640 0.82627
MathSAT MathSAT5_default.sh unsat ✅ 0.73611 0.73266
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.76208 0.76215
MinkeyRink Solver 2020.3_default unsat ✅ 0.78650 0.78653
STP STP_default unsat ✅ 0.56182 0.56184
STP ++ Mergsat v1_default unsat ✅ 0.55793 0.55944
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38956 0.38949
Z3 z3-4.8.8_default unsat ✅ 0.63634 0.63619
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.26667 1.16655
cvc5 cvc5 unsat ✅ 1.90086 1.80144
SMTInterpol SMTInterpol unknown ❌ 1202.72042 1402.17598
STP STP unsat ✅ 41.87491 41.75634
Yices2 Yices2 unsat ✅ 0.52993 0.42979
Z3alpha Z3-alpha unsat ✅ 0.56552 0.46581
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.95816 0.84298
Bitwuzla-MachBV-base unsat ✅ 1.27185 1.14273
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.38463 1.27026
BVDecide bv_decide unknown ❌ 1201.38999 1201.03802
bv_decide-nokernel unknown ❌ 1201.39428 1201.04947
cvc5 cvc5 unsat ✅ 1.39629 1.26508
SMTInterpol SMTInterpol unknown ❌ 1201.87446 1794.46060
Yices2 Yices2 unsat ✅ 0.46735 0.35114
Z3alpha Z3-alpha unsat ✅ 0.98622 0.97338
Z3 Z3-alpha-base unsat ✅ 0.63517 0.50847
Z3-Owl-base unsat ✅ 1.92589 1.80800
z3siri-base unsat ✅ 0.60886 0.48872
Z3-Owl Z3-Owl unsat ✅ 1.17674 1.04594