Benchmark

non-incremental/QF_BV/sage/app12/bench_917.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size37414
Compressed Size5161
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 37406
Compressed Size5179
Max. Term Depth48
Asserts 1
Declared Functions0
Declared Constants224
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite29 not134 and1
=246 let38 bvor104 bvadd113
bvsub114 bvult112 bvule94 bvslt19
bvsle17 bvshl106 zero_extend232

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.28843 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.14771 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.14638 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.15148 —
abziz_portfolio_2012_solvers default sat ✅ 0.14937 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.15347 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 4.90814 —
Boolector-SMT-COMP-2011 default sat ✅ 2.63717 —
Boolector-SMT-COMP-2012 default sat ✅ 0.03312 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 9.31732 —
CVC3-SMT-COMP-2011 default sat ✅ 8.37350 —
CVC3-SMT-COMP-2012 default sat ✅ 8.49697 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.18651 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.31770 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.59882 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.76647 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.13242 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.55250 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.09762 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.39512 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.27483 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.11445 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.07710 —
STP2-SMT-COMP-2012 default sat ✅ 0.14644 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.43666 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.16135 —
Z3-SMT-COMP-2011 default sat ✅ 0.14102 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2.59918 2.59960
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.46623 0.89786
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.56030 1.08783
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.63971 0.63890
SMT-RAT SMT-RAT-final default sat ✅ 153.52400 153.53800
STP stp-cryptominisat4 default sat ✅ 0.12151 0.12098
stp-cmsat4-v15 default sat ✅ 0.11787 0.11698
stp-cmsat4-mt-v15 default unknown ❌ 0.10231 0.10098
stp-minisat-v15 default sat ✅ 0.10848 0.10698
Yices2 Yices default sat ✅ 0.01460 0.01400
Z3 z3 4.4.0 default sat ✅ 0.13010 0.12998
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 10.88390 10.88920
ABC_glucose glucose sat ✅ 2.68736 2.68928
Boolector Boolector boolector sat ✅ 3.32194 3.32406
Boolector preprop boolector sat ✅ 3.23395 3.23628
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.43305 0.83467
MapleSTP MapleSTP default sat ✅ 0.13238 0.13240
MapleSTP-mt default sat ✅ 0.14477 0.32784
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.63302 0.63429
MinkeyRink Minkeyrink 2016 default sat ✅ 0.28824 0.43022
Q3B Q3B default unknown ❌ 2400.02000 7203.76000
STP stp-cms-exp-2016 default sat ✅ 0.13161 0.13178
stp-cms-mt-2016 default sat ✅ 0.14443 0.33394
stp-cms-st-2016 default sat ✅ 0.12896 0.12901
stp-minisat-st-2016 default sat ✅ 0.14867 0.14869
Yices2 Yices-2.4.2 default sat ✅ 0.01583 0.01570
Z3 z3-4.4.1 default sat ✅ 0.17699 0.17835
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.27248 1.27155
Boolector SMT17 final boolector sat ✅ 5.51818 5.51738
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.47493 0.91678
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.59255 0.59152
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.18132 0.13741
Q3B Q3B default unknown ❌ 600.02800 1785.73000
STP stp_st default sat ✅ 0.44985 0.44901
stp_mt default sat ✅ 0.59601 1.14049
Yices2 Yices2-Main default sat ✅ 0.01576 0.01500
Z3 z3-4.5.0 default sat ✅ 0.38903 0.38784
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.50318 0.50310
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.61686 0.61702
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.54805 0.54907
MinkeyRink Minkeyrink MT_mt sat ✅ 0.07847 0.09307
Minkeyrink ST_st sat ✅ 0.07412 0.07432
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.41206 0.41216
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.46455 0.73530
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.39380 1.39356
Yices2 Yices 2.6.0_default sat ✅ 0.01677 0.01672
Z3 z3-4.7.1_default sat ✅ 0.41991 0.41980
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.72502 0.72483
Boolector Boolector-wrapped-sq_default sat ✅ 0.69151 0.69146
Poolector-wrapped-sq_default sat ✅ 0.68101 2.19000
CVC4 CVC4-sq-final_default sat ✅ 0.34795 0.34822
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.93000
MathSAT MathSAT5_default.sh sat ✅ 0.18778 0.18769
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.07105 0.07125
MinkeyRink Solver 2020.3_default sat ✅ 0.07707 0.08761
STP STP_default sat ✅ 0.09720 0.14461
STP ++ Mergsat v1_default sat ✅ 0.08473 0.08635
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01663 0.01659
Z3 z3-4.8.8_default sat ✅ 0.42297 0.42294
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.08349 1.08345
MathSAT mathsat-5.6.6_default sat ✅ 0.47500 0.47494
STP STP 2021.0_default sat ✅ 0.15929 0.20696
Z3 z3-4.8.11_default sat ✅ 0.45448 0.45439
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.07089 1.07076
Bitwuzla-wrapped_default sat ✅ 0.97089 0.97091
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.30266 0.30317
MathSAT MathSAT-5.6.8_default sat ✅ 0.17722 0.17715
STP STP 2022.4_default sat ✅ 0.08204 0.08207
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01735 0.01674
Z3++BV z3++bv_0702_default sat ✅ 0.13137 0.13128
Z3 z3-4.8.17_default sat ✅ 0.45095 0.45275
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.17789 0.17785
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.33175 0.33116
STP STP 2022.4_default sat ✅ 0.18514 0.18520
STP 2022.4_default sat ✅ 0.18474 0.18480
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.13000 1255.51000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01619 0.01617
Z3-Owl z3-Owl-Final_default sat ✅ 9.93253 9.93283
z3-Owl-Final_default sat ✅ 10.19810 10.19730
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.29065 0.19088
cvc5 cvc5 sat ✅ 0.42294 0.32340
SMTInterpol SMTInterpol unknown ❌ 1201.71907 1234.41156
STP STP sat ✅ 0.42048 0.32070
Yices2 Yices2 sat ✅ 0.22526 0.12566
Z3alpha Z3-alpha sat ✅ 0.35054 0.25046
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.31082 0.18606
Bitwuzla-MachBV-base sat ✅ 0.34709 0.22099
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.44807 0.32698
BVDecide bv_decide sat ✅ 4.35578 4.16868
bv_decide-nokernel sat ✅ 4.09960 3.91882
cvc5 cvc5 sat ✅ 0.44212 0.32469
SMTInterpol SMTInterpol unknown ❌ 1201.47405 1226.50865
Yices2 Yices2 sat ✅ 0.29424 0.16428
Z3alpha Z3-alpha sat ✅ 0.64964 1.17402
Z3 Z3-alpha-base sat ✅ 1.09842 0.96758
Z3-Owl-base sat ✅ 3.48377 3.36255
z3siri-base sat ✅ 1.10607 0.97444
Z3-Owl Z3-Owl sat ✅ 4.18773 4.06624