Benchmark

non-incremental/QF_BV/sage/app7/bench_7113.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4466505
Compressed Size278874
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4466497
Compressed Size278862
Max. Term Depth17069
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2767 and1
=3566 let16856 extract1720 bvand46141
bvor30435 bvxor2318 bvadd49666 bvmul9
bvsub16266 bvsdiv28 bvult642 bvule652
bvslt220 bvsle126 bvshl15939 bvashr30110
zero_extend1523

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71433 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.69685 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69910 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.71114 —
abziz_portfolio_2012_solvers default unsat ✅ 0.70105 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.71008 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.96221 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.07315 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.01273 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 242.09000 —
CVC3-SMT-COMP-2011 default unsat ✅ 204.70800 —
CVC3-SMT-COMP-2012 default unsat ✅ 213.98800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.68944 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.61563 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32436 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27385 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.66131 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.62323 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.16084 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.64511 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.26233 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.89243 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74542 —
STP2-SMT-COMP-2012 default unsat ✅ 0.72017 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77004 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76934 —
Z3-SMT-COMP-2011 default unsat ✅ 0.69227 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.24222 1.24073
Boolector SMT17 final boolector unsat ✅ 1.18357 1.18352
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.76264 9.13826
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.87381 0.87294
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.70547 1.70550
Q3B Q3B default unsat ✅ 1.11359 2.96000
STP stp_st default unsat ✅ 0.80912 0.80767
stp_mt default unsat ✅ 0.86947 0.86876
Yices2 Yices2-Main default unsat ✅ 0.47362 0.47301
Z3 z3-4.5.0 default unsat ✅ 0.62193 0.62095
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.06020 1.06021
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.34461 5.34430
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.84203 0.84326
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.71737 1.71744
Minkeyrink ST_st unsat ✅ 1.71346 1.71342
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82835 0.82829
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82873 0.82873
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82899 0.82908
Yices2 Yices 2.6.0_default unsat ✅ 0.48735 0.48730
Z3 z3-4.7.1_default unsat ✅ 0.97724 0.97710
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.04358 2.04224
Poolector-wrapped-sq_default unsat ✅ 2.41081 9.07953
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.67180 1.67165
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.67948 5.67630
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.15641 1.15658
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.15578 1.15581
Par4 Par4-wrapped-sq_default unsat ✅ 0.50313 0.00677
STP STP-2019-wrapped-sq_default unsat ✅ 0.83862 0.83872
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.82251 0.82261
stp-minisat-wrapped-sq_default unsat ✅ 0.83363 0.83308
stp-mt-wrapped-sq_default unsat ✅ 0.83964 0.83960
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.82210 0.82214
stp-riss-wrapped-sq_default unsat ✅ 0.84339 0.84354
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.44967 0.44967
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44758 0.44758
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44614 0.44613
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.44282 0.44278
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44803 0.44805
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.94585 0.94498
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69240 1.69221
Boolector Boolector-wrapped-sq_default unsat ✅ 2.03981 2.03956
Poolector-wrapped-sq_default unsat ✅ 2.39240 9.00000
CVC4 CVC4-sq-final_default unsat ✅ 7.36168 7.36140
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05964 1.05935
MathSAT MathSAT5_default.sh unsat ✅ 0.86434 0.86433
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.95424 0.95432
MinkeyRink Solver 2020.3_default unsat ✅ 0.98503 0.98508
STP STP_default unsat ✅ 0.78612 0.78619
STP ++ Mergsat v1_default unsat ✅ 0.77652 0.77811
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.50144 0.50139
Z3 z3-4.8.8_default unsat ✅ 0.48304 0.48297
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67726 1.67724
Bitwuzla-wrapped_default unsat ✅ 1.86632 1.86607
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.73638 5.73611
MathSAT MathSAT-5.6.8_default unsat ✅ 0.90534 0.90426
STP STP 2022.4_default unsat ✅ 0.85534 0.85534
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.50050 0.50042
Z3++BV z3++bv_0702_default unsat ✅ 0.95953 0.95921
Z3 z3-4.8.17_default unsat ✅ 0.87428 0.87561
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.56499 2.56467
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.31224 4.31313
STP STP 2022.4_default unsat ✅ 0.84828 0.84828
STP 2022.4_default unsat ✅ 0.84909 0.84796
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1343.96000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.49511 0.49509
Z3-Owl z3-Owl-Final_default unsat ✅ 1.51385 1.51370
z3-Owl-Final_default unsat ✅ 1.53240 1.53267
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.49149 1.39083
cvc5 cvc5 unsat ✅ 2.37846 2.27746
SMTInterpol SMTInterpol unknown ❌ 1202.74429 1434.57469
STP STP unsat ✅ 68.32600 68.18871
Yices2 Yices2 unsat ✅ 0.54365 0.44371
Z3alpha Z3-alpha unsat ✅ 0.61902 0.51925
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.21692 1.09658
Bitwuzla-MachBV-base unsat ✅ 1.46170 1.33638
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.70477 1.57697
BVDecide bv_decide unknown ❌ 1201.38222 1200.95216
bv_decide-nokernel unknown ❌ 1201.39065 1200.95030
cvc5 cvc5 unsat ✅ 1.43813 1.32227
SMTInterpol SMTInterpol unknown ❌ 1201.84722 1653.77286
Yices2 Yices2 unsat ✅ 0.57641 0.45211
Z3alpha Z3-alpha unsat ✅ 1.08995 1.10713
Z3 Z3-alpha-base unsat ✅ 0.74876 0.61971
Z3-Owl-base unsat ✅ 2.26111 2.13971
z3siri-base unsat ✅ 0.74719 0.61797
Z3-Owl Z3-Owl unsat ✅ 1.30340 1.17264