Benchmark

non-incremental/QF_BV/sage/app2/bench_488.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size357665
Compressed Size44533
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 357657
Compressed Size44543
Max. Term Depth891
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not263 and1
=436 let869 extract167 bvand1824
bvor73 bvxor60 bvadd3759 bvmul22
bvsub2426 bvsdiv22 bvult130 bvule251
bvslt167 bvsle68 bvshl2244 bvashr1155
zero_extend1506

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04720
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.06428
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.06471
abziz_portfolio_2012_minfeatures default unsat ✅ 0.06582
abziz_portfolio_2012_solvers default unsat ✅ 0.06451
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06569
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.05463
Boolector-SMT-COMP-2011 default unsat ✅ 0.07019
Boolector-SMT-COMP-2012 default unsat ✅ 0.05142
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.60271
CVC3-SMT-COMP-2011 default unsat ✅ 0.53627
CVC3-SMT-COMP-2012 default unsat ✅ 0.52563
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌ 872.36300
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.12375
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.11498
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.23117
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14277
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.43245
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.06612
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.43280
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.39370
STP STP2-SMT-COMP-2011 default unsat ✅ 0.26815
STP2-SMT-COMP-2012 default unsat ✅ 0.04655
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04856
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05621
Z3-SMT-COMP-2011 default unsat ✅ 0.05973
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07989 0.07724
Boolector SMT17 final boolector unsat ✅ 0.07613 0.07300
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.63427 7.00237
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.09315 0.09306
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.20801 0.20698
Q3B Q3B default unsat ✅ 0.44405 0.74695
STP stp_st default unsat ✅ 0.15943 0.15813
stp_mt default unsat ✅ 0.16111 0.15984
Yices2 Yices2-Main default unsat ✅ 0.03318 0.03229
Z3 z3-4.5.0 default unsat ✅ 0.19395 0.19030
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07744 0.07734
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.00832 2.00851
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08916 0.09018
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19986 0.19989
Minkeyrink ST_st unsat ✅ 0.19992 0.20000
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05307 0.05313
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05311 0.05314
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05325 0.05333
Yices2 Yices 2.6.0_default unsat ✅ 0.03360 0.03354
Z3 z3-4.7.1_default unsat ✅ 0.24546 0.24536
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.13770 0.13759
Poolector-wrapped-sq_default unsat ✅ 0.27811 0.69749
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.12747 0.12736
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.75130 1.75068
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.29928 0.29941
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29815 0.29819
Par4 Par4-wrapped-sq_default unsat ✅ 0.04366 0.00616
STP STP-2019-wrapped-sq_default unsat ✅ 0.06275 0.06290
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06100 0.06112
stp-minisat-wrapped-sq_default unsat ✅ 0.06173 0.06182
stp-mt-wrapped-sq_default unsat ✅ 0.06196 0.06203
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.06137 0.06150
stp-riss-wrapped-sq_default unsat ✅ 0.06183 0.06193
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03523 0.03519
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03432 0.03431
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03413 0.03411
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.03360 0.03362
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03437 0.03436
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.22059 0.22052
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11217 0.11209
MathSAT mathsat-5.6.6_default unsat ✅ 4.39566 4.39546
STP STP 2021.0_default unsat ✅ 0.05799 0.05807
Z3 z3-4.8.11_default unsat ✅ 0.13944 0.13931
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16384 0.16377
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.03214 2.02805
STP STP 2022.4_default unsat ✅ 0.05415 0.05402
STP 2022.4_default unsat ✅ 0.05466 0.05469
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.42540 36.30090
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03764 0.03759
Z3-Owl z3-Owl-Final_default unsat ✅ 0.80409 0.80416
z3-Owl-Final_default unsat ✅ 0.81098 0.81129
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.31874 0.19956
Bitwuzla-MachBV-base unsat ✅ 0.34126 0.22386
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40501 0.28649
BVDecide bv_decide unsat ✅ 32.60182 32.46806
bv_decide-nokernel unsat ✅ 28.17469 28.03991
cvc5 cvc5 unsat ✅ 1.54759 1.42786
SMTInterpol SMTInterpol unsat ✅ 29.39750 56.96046
Yices2 Yices2 unsat ✅ 0.29882 0.17393
Z3alpha Z3-alpha unsat ✅ 0.41093 0.30287
Z3 Z3-alpha-base unsat ✅ 0.40356 0.28530
Z3-Owl-base unsat ✅ 0.95472 0.82423
z3siri-base unsat ✅ 0.37427 0.25263
Z3-Owl Z3-Owl unsat ✅ 0.89964 0.77403