Benchmark

non-incremental/QF_BV/sage/app7/bench_8646.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3334567
Compressed Size211562
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3334559
Compressed Size211568
Max. Term Depth12812
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2234 and1
=2935 let12707 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36783 bvmul6
bvsub11945 bvsdiv15 bvult538 bvule583
bvslt216 bvsle122 bvshl11740 bvashr22018
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49403 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54428 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54356 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54487 —
abziz_portfolio_2012_solvers default unsat ✅ 0.53897 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54786 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66267 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.80283 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70042 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 351.21700 —
CVC3-SMT-COMP-2011 default unsat ✅ 293.77400 —
CVC3-SMT-COMP-2012 default unsat ✅ 306.56700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85164 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.53765 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99394 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95400 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23784 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20754 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87155 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.04958 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.17188 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34793 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52403 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49864 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53004 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58574 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53752 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.89954 0.89962
Boolector SMT17 final boolector unsat ✅ 0.92607 0.92572
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.29432 6.89185
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.65875 0.65895
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.25475 1.25384
Q3B Q3B default unsat ✅ 0.86490 2.04000
STP stp_st default unsat ✅ 0.61859 0.61374
stp_mt default unsat ✅ 0.65021 0.64855
Yices2 Yices2-Main default unsat ✅ 0.36657 0.36542
Z3 z3-4.5.0 default unsat ✅ 0.56944 0.54859
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78720 0.78711
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.97107 3.97138
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.64072 0.64166
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27511 1.27487
Minkeyrink ST_st unsat ✅ 1.26837 1.26843
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57856 0.57863
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57910 0.57902
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57693 0.57696
Yices2 Yices 2.6.0_default unsat ✅ 0.36920 0.36906
Z3 z3-4.7.1_default unsat ✅ 0.83100 0.83081
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.23782 1.23775
Boolector Boolector-wrapped-sq_default unsat ✅ 1.47915 1.47896
Poolector-wrapped-sq_default unsat ✅ 1.78147 6.62000
CVC4 CVC4-sq-final_default unsat ✅ 5.41071 5.41034
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79529 0.79508
MathSAT MathSAT5_default.sh unsat ✅ 0.65555 0.65544
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.74158 0.74131
MinkeyRink Solver 2020.3_default unsat ✅ 0.76164 0.76179
STP STP_default unsat ✅ 0.54175 0.54172
STP ++ Mergsat v1_default unsat ✅ 0.54015 0.54185
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37973 0.37961
Z3 z3-4.8.8_default unsat ✅ 0.39754 0.39747
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.25062 1.25049
MathSAT mathsat-5.6.6_default unsat ✅ 0.67014 0.67008
STP STP 2021.0_default unsat ✅ 0.56304 0.56308
Z3 z3-4.8.11_default unsat ✅ 0.64021 0.64014
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24271 1.24266
Bitwuzla-wrapped_default unsat ✅ 1.33412 1.32403
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.21342 4.21340
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67059 0.67049
STP STP 2022.4_default unsat ✅ 0.61969 0.61865
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37522 0.37513
Z3++BV z3++bv_0702_default unsat ✅ 0.73808 0.73798
Z3 z3-4.8.17_default unsat ✅ 0.65484 0.65670
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.16103 1.06123
cvc5 cvc5 unsat ✅ 1.95450 1.85312
SMTInterpol SMTInterpol unknown ❌ 1202.72081 1375.45549
STP STP unsat ✅ 38.53819 38.43456
Yices2 Yices2 unsat ✅ 0.49015 0.38994
Z3alpha Z3-alpha unsat ✅ 0.55209 0.45278
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.98593 0.85750
Bitwuzla-MachBV-base unsat ✅ 1.21676 1.09448
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.52949 1.39922
BVDecide bv_decide unknown ❌ 1201.38340 1201.06170
bv_decide-nokernel unknown ❌ 1201.38556 1201.03572
cvc5 cvc5 unsat ✅ 0.91222 0.79024
SMTInterpol SMTInterpol unknown ❌ 1201.85150 2568.36206
Yices2 Yices2 unsat ✅ 0.50176 0.37827
Z3alpha Z3-alpha unsat ✅ 0.96088 0.94144
Z3 Z3-alpha-base unsat ✅ 0.53620 0.40760
Z3-Owl-base unsat ✅ 1.28215 1.15736
z3siri-base unsat ✅ 0.51679 0.39618
Z3-Owl Z3-Owl unsat ✅ 1.06182 0.93304