Benchmark

non-incremental/QF_BV/sage/app7/bench_339.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3280939
Compressed Size206801
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3280931
Compressed Size206789
Max. Term Depth12504
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2068 and1
=2745 let12399 extract1435 bvand34039
bvor22396 bvxor1749 bvadd36335 bvmul2
bvsub11851 bvsdiv5 bvult485 bvule523
bvslt211 bvsle121 bvshl11575 bvashr21920
zero_extend1158

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49117 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50813 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51372 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.52107 —
abziz_portfolio_2012_solvers default unsat ✅ 0.51403 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.51551 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66278 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79584 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.71409 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 337.43100 —
CVC3-SMT-COMP-2011 default unsat ✅ 282.14800 —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.82881 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.44139 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98184 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.93629 —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.19381 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.84724 —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.12840 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.32987 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51300 —
STP2-SMT-COMP-2012 default unsat ✅ 0.50092 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50840 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.55183 —
Z3-SMT-COMP-2011 default unsat ✅ 0.51874 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87555 0.87460
Boolector SMT17 final boolector unsat ✅ 0.87406 0.87398
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.19381 6.73027
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63392 0.63357
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24504 1.24492
Q3B Q3B default unsat ✅ 0.83959 2.04000
STP stp_st default unsat ✅ 0.56015 0.55884
stp_mt default unsat ✅ 0.56376 0.56279
Yices2 Yices2-Main default unsat ✅ 0.20825 0.20749
Z3 z3-4.5.0 default unsat ✅ 0.60971 0.60962
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.79077 0.79057
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.87969 3.87897
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62673 0.62783
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26286 1.26264
Minkeyrink ST_st unsat ✅ 1.26132 1.26123
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57005 0.56992
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57105 0.57113
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57177 0.57180
Yices2 Yices 2.6.0_default unsat ✅ 0.20233 0.20220
Z3 z3-4.7.1_default unsat ✅ 0.78690 0.78675
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.53262 1.53266
Poolector-wrapped-sq_default unsat ✅ 1.80251 6.79872
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.24267 1.24256
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.05244 4.05273
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88731 0.88745
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.88211 0.88196
Par4 Par4-wrapped-sq_default unsat ✅ 0.21003 0.00592
STP STP-2019-wrapped-sq_default unsat ✅ 0.58071 0.58063
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.57626 0.57642
stp-minisat-wrapped-sq_default unsat ✅ 0.58639 0.58643
stp-mt-wrapped-sq_default unsat ✅ 0.58913 0.58355
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.57651 0.57662
stp-riss-wrapped-sq_default unsat ✅ 0.58404 0.58409
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.20650 0.20645
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.20751 0.20753
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.20715 0.20710
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.20429 0.20429
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.20765 0.20766
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.77687 0.77682
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21567 1.21563
Bitwuzla-wrapped_default unsat ✅ 1.29283 1.29269
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.10922 4.10760
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66490 0.66483
STP STP 2022.4_default unsat ✅ 0.60600 0.60601
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.23997 0.23993
Z3++BV z3++bv_0702_default unsat ✅ 0.71744 0.71737
Z3 z3-4.8.17_default unsat ✅ 0.65062 0.65240
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.87463 1.87436
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.96714 2.96496
STP STP 2022.4_default unsat ✅ 0.59819 0.59818
STP 2022.4_default unsat ✅ 0.59241 0.59241
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 870.07200 986.24400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.23414 0.23408
Z3-Owl z3-Owl-Final_default unsat ✅ 1.28956 1.28946
z3-Owl-Final_default unsat ✅ 1.30727 1.30732
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.14321 1.04363
cvc5 cvc5 unsat ✅ 0.97516 0.87568
SMTInterpol SMTInterpol unknown ❌ 1202.72222 1488.34216
STP STP unsat ✅ 30.59150 30.48503
Yices2 Yices2 unsat ✅ 0.36774 0.26783
Z3alpha Z3-alpha unsat ✅ 0.54903 0.44886
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.97678 0.85056
Bitwuzla-MachBV-base unsat ✅ 1.21219 1.08355
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.35438 1.23323
BVDecide bv_decide unknown ❌ 1201.39108 1201.04697
bv_decide-nokernel unknown ❌ 1201.38686 1201.03223
cvc5 cvc5 unsat ✅ 1.23828 1.12262
SMTInterpol SMTInterpol unknown ❌ 1201.89581 2685.13365
Yices2 Yices2 unsat ✅ 0.39558 0.26322
Z3alpha Z3-alpha unsat ✅ 0.94079 0.92414
Z3 Z3-alpha-base unsat ✅ 0.64023 0.51089
Z3-Owl-base unsat ✅ 1.95329 1.82910
z3siri-base unsat ✅ 0.59679 0.48287
Z3-Owl Z3-Owl unsat ✅ 1.15411 1.03049