Benchmark

non-incremental/QF_BV/sage/app7/bench_264.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3307805
Compressed Size209058
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3307797
Compressed Size209036
Max. Term Depth12685
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2121 and1
=2806 let12580 extract1547 bvand34099
bvor22404 bvxor1957 bvadd36544 bvmul2
bvsub11905 bvsdiv5 bvult487 bvule526
bvslt212 bvsle121 bvshl11680 bvashr21970
zero_extend1310

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49263 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54086 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.53803 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54703 —
abziz_portfolio_2012_solvers default unsat ✅ 0.54377 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53697 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66013 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79242 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69812 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.65500 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.81800 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.57700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.83143 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.50795 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99120 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95038 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.26310 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20638 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.86548 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.96726 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.15308 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.33975 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52162 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49973 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52489 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58437 —
Z3-SMT-COMP-2011 default unsat ✅ 0.54186 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.88073 0.87900
Boolector SMT17 final boolector unsat ✅ 0.87995 0.87886
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.22436 6.77014
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64452 0.64441
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24685 1.24551
Q3B Q3B default unsat ✅ 0.82378 2.01000
STP stp_st default unsat ✅ 0.57756 0.57679
stp_mt default unsat ✅ 0.56428 0.56299
Yices2 Yices2-Main default unsat ✅ 0.36534 0.36523
Z3 z3-4.5.0 default unsat ✅ 0.53653 0.53415
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77744 0.77732
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.90103 3.90095
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63189 0.63294
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26234 1.26295
Minkeyrink ST_st unsat ✅ 1.25909 1.25892
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57413 0.57405
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57310 0.57315
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.59508 0.59207
Yices2 Yices 2.6.0_default unsat ✅ 0.36846 0.36796
Z3 z3-4.7.1_default unsat ✅ 0.81882 0.81590
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50245 1.50243
Poolector-wrapped-sq_default unsat ✅ 1.80348 6.73374
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.20261 1.20250
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.14290 4.14224
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88394 0.88402
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.88608 0.88623
Par4 Par4-wrapped-sq_default unsat ✅ 0.37601 0.00608
STP STP-2019-wrapped-sq_default unsat ✅ 0.58944 0.58953
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58104 0.58074
stp-minisat-wrapped-sq_default unsat ✅ 0.58691 0.58705
stp-mt-wrapped-sq_default unsat ✅ 0.58551 0.58559
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.61021 0.61030
stp-riss-wrapped-sq_default unsat ✅ 0.58688 0.58703
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34024 0.34021
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33881 0.33882
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34659 0.34652
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33859 0.33857
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34256 0.34258
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.63131 0.63129
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.22757 1.22753
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49212 1.49213
Poolector-wrapped-sq_default unsat ✅ 1.78308 6.61019
CVC4 CVC4-sq-final_default unsat ✅ 5.37725 5.37718
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79113 0.79107
MathSAT MathSAT5_default.sh unsat ✅ 0.64999 0.64997
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73753 0.73759
MinkeyRink Solver 2020.3_default unsat ✅ 0.76152 0.76158
STP STP_default unsat ✅ 0.54215 0.54225
STP ++ Mergsat v1_default unsat ✅ 0.53909 0.54085
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37617 0.37606
Z3 z3-4.8.8_default unsat ✅ 0.37339 0.37339
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.22370 1.22360
MathSAT mathsat-5.6.6_default unsat ✅ 0.66696 0.66687
STP STP 2021.0_default unsat ✅ 0.56307 0.56310
Z3 z3-4.8.11_default unsat ✅ 0.63823 0.63801
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.90035 1.89968
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.98996 2.99006
STP STP 2022.4_default unsat ✅ 0.60421 0.60419
STP 2022.4_default unsat ✅ 0.64161 0.64032
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 1128.54000 1233.23000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37328 0.37321
Z3-Owl z3-Owl-Final_default unsat ✅ 1.04008 1.04009
z3-Owl-Final_default unsat ✅ 1.07942 2.09962
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.16401 1.06432
cvc5 cvc5 unsat ✅ 1.30760 1.20653
SMTInterpol SMTInterpol unknown ❌ 1202.21535 1356.96323
STP STP unsat ✅ 32.77518 32.67438
Yices2 Yices2 unsat ✅ 0.45881 0.35870
Z3alpha Z3-alpha unsat ✅ 0.54361 0.44378
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.97135 0.83727
Bitwuzla-MachBV-base unsat ✅ 1.17327 1.05883
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.35781 1.22809
BVDecide bv_decide unknown ❌ 1201.34856 1201.00909
bv_decide-nokernel unknown ❌ 1201.39348 1201.02359
cvc5 cvc5 unsat ✅ 0.82923 0.69712
SMTInterpol SMTInterpol unknown ❌ 1201.90202 2596.60800
Yices2 Yices2 unsat ✅ 0.47653 0.35443
Z3alpha Z3-alpha unsat ✅ 0.96153 0.95464
Z3 Z3-alpha-base unsat ✅ 0.55709 0.43450
Z3-Owl-base unsat ✅ 1.51361 1.38577
z3siri-base unsat ✅ 0.65308 0.52787
Z3-Owl Z3-Owl unsat ✅ 1.03510 0.91253