Benchmark

non-incremental/QF_BV/sage/app7/bench_6458.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3465171
Compressed Size220444
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3465163
Compressed Size220448
Max. Term Depth13297
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2409 and1
=3130 let13192 extract1685 bvand35348
bvor23187 bvxor2205 bvadd38205 bvmul7
bvsub12369 bvsdiv19 bvult585 bvule625
bvslt219 bvsle124 bvshl12185 bvashr22821
zero_extend1485

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51272 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.56620 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.56379 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.56199 —
abziz_portfolio_2012_solvers default unsat ✅ 0.55915 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.56102 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.69302 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.83539 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.72614 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 352.42400 —
CVC3-SMT-COMP-2011 default unsat ✅ 294.80100 —
CVC3-SMT-COMP-2012 default unsat ✅ 307.53200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.02633 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.70135 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.04767 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.99240 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.28998 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.25836 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.90128 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.26638 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.38530 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.40302 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.54361 —
STP2-SMT-COMP-2012 default unsat ✅ 0.51612 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.55025 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.61563 —
Z3-SMT-COMP-2011 default unsat ✅ 0.55348 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.95582 0.95318
Boolector SMT17 final boolector unsat ✅ 0.90660 0.90492
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.61954 7.43877
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.67273 0.67274
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.31033 1.30978
Q3B Q3B default unsat ✅ 0.94052 2.42000
STP stp_st default unsat ✅ 0.62186 0.62080
stp_mt default unsat ✅ 0.59291 0.59165
Yices2 Yices2-Main default unsat ✅ 0.38121 0.38117
Z3 z3-4.5.0 default unsat ✅ 0.57381 0.57242
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.82974 0.82966
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.13807 4.13823
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.70699 1.30815
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.32583 1.32575
Minkeyrink ST_st unsat ✅ 1.33492 1.33491
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.60002 0.60005
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.60303 0.60300
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.59916 0.59905
Yices2 Yices 2.6.0_default unsat ✅ 0.38040 0.38033
Z3 z3-4.7.1_default unsat ✅ 0.86475 0.86248
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.56608 1.56601
Poolector-wrapped-sq_default unsat ✅ 1.89701 7.01528
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.26397 1.26397
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.35015 4.34997
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.92913 0.92927
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.92348 0.92344
Par4 Par4-wrapped-sq_default unsat ✅ 0.39881 0.00602
STP STP-2019-wrapped-sq_default unsat ✅ 0.61422 0.61432
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.60898 0.60908
stp-minisat-wrapped-sq_default unsat ✅ 0.61862 0.61876
stp-mt-wrapped-sq_default unsat ✅ 0.61394 0.61399
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.60748 0.60743
stp-riss-wrapped-sq_default unsat ✅ 0.61712 0.61723
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.35218 0.35218
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.35435 0.35432
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.35370 0.35373
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.34962 0.34958
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.35479 0.35471
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.57831 0.57834
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.28975 1.28960
MathSAT mathsat-5.6.6_default unsat ✅ 0.69142 0.69132
STP STP 2021.0_default unsat ✅ 0.58811 0.58814
Z3 z3-4.8.11_default unsat ✅ 0.61432 0.61432
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.27945 1.27908
Bitwuzla-wrapped_default unsat ✅ 1.36960 1.36946
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.44950 4.44764
MathSAT MathSAT-5.6.8_default unsat ✅ 0.69770 0.69768
STP STP 2022.4_default unsat ✅ 0.63390 0.63379
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.39197 0.39187
Z3++BV z3++bv_0702_default unsat ✅ 0.72011 0.72006
Z3 z3-4.8.17_default unsat ✅ 0.65244 0.65419
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.09719 2.09670
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.19522 3.18980
STP STP 2022.4_default unsat ✅ 0.63096 0.63102
STP 2022.4_default unsat ✅ 0.64220 0.64224
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1324.01000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39554 0.39545
Z3-Owl z3-Owl-Final_default unsat ✅ 1.34806 1.34449
z3-Owl-Final_default unsat ✅ 1.28892 1.28876
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.02013 0.89097
Bitwuzla-MachBV-base unsat ✅ 1.21140 1.09220
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.42476 1.29784
BVDecide bv_decide unknown ❌ 1201.39136 1200.85914
bv_decide-nokernel unknown ❌ 1201.34653 1201.01337
cvc5 cvc5 unsat ✅ 1.33034 1.20172
SMTInterpol SMTInterpol unknown ❌ 1201.84820 1634.73702
Yices2 Yices2 unsat ✅ 0.51509 0.38952
Z3alpha Z3-alpha unsat ✅ 0.97325 0.95751
Z3 Z3-alpha-base unsat ✅ 0.59910 0.47983
Z3-Owl-base unsat ✅ 1.90011 1.77806
z3siri-base unsat ✅ 0.63359 0.50864
Z3-Owl Z3-Owl unsat ✅ 1.18094 1.04668