Benchmark

non-incremental/QF_BV/sage/app2/bench_501.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size352724
Compressed Size44416
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 352716
Compressed Size44428
Max. Term Depth893
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not259 and1
=432 let864 extract163 bvand1824
bvor71 bvxor60 bvadd3708 bvmul22
bvsub2376 bvsdiv22 bvult128 bvule248
bvslt166 bvsle66 bvshl2242 bvashr1155
zero_extend1500

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04749 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.32177 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.32465 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.32319 —
abziz_portfolio_2012_solvers default unsat ✅ 0.32028 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.32396 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.05122 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.07122 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.05178 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.27643 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.25675 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.24248 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 218.81200 —
CVC4-SMT-EVAL-2013 default unknown ❌ 874.30200 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.12292 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.11396 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.14349 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14249 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.43092 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.02365 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.39364 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.39022 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.25930 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04691 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04901 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.29867 —
Z3-SMT-COMP-2011 default unsat ✅ 0.31494 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07188 0.07127
Boolector SMT17 final boolector unsat ✅ 0.07639 0.07557
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.45526 6.73953
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08944 0.08958
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19695 0.19632
Q3B Q3B default unsat ✅ 0.41903 0.98438
STP stp_st default unsat ✅ 0.06033 0.05910
stp_mt default unsat ✅ 0.06199 0.06122
Yices2 Yices2-Main default unsat ✅ 0.03152 0.03148
Z3 z3-4.5.0 default unsat ✅ 0.14367 0.14251
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07747 0.07743
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.98934 1.98936
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08908 0.09008
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19958 0.19959
Minkeyrink ST_st unsat ✅ 0.20053 0.20063
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05275 0.05283
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05254 0.05259
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05241 0.05249
Yices2 Yices 2.6.0_default unsat ✅ 0.03383 0.03378
Z3 z3-4.7.1_default unsat ✅ 0.09555 0.09549
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.13921 0.13922
Poolector-wrapped-sq_default unsat ✅ 0.27950 0.69251
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.12627 0.12625
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.73193 1.73210
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.29825 0.29833
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29757 0.29762
Par4 Par4-wrapped-sq_default unsat ✅ 0.04324 0.00593
STP STP-2019-wrapped-sq_default unsat ✅ 0.06110 0.06128
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06190 0.06204
stp-minisat-wrapped-sq_default unsat ✅ 0.06164 0.06156
stp-mt-wrapped-sq_default unsat ✅ 0.06546 0.06563
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.06094 0.06110
stp-riss-wrapped-sq_default unsat ✅ 0.06100 0.06114
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03433 0.03431
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03198 0.03196
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03392 0.03393
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.03302 0.03303
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03375 0.03372
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.17440 0.17438
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11061 0.11059
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13513 0.13513
Poolector-wrapped-sq_default unsat ✅ 0.27999 0.69181
CVC4 CVC4-sq-final_default unsat ✅ 1.66891 1.66931
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 31.79130 31.79150
MathSAT MathSAT5_default.sh unsat ✅ 0.09371 0.09367
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23702 0.23711
MinkeyRink Solver 2020.3_default unsat ✅ 0.25041 0.25048
STP STP_default unsat ✅ 0.05545 0.05555
STP ++ Mergsat v1_default unsat ✅ 0.04939 0.05103
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03620 0.03612
Z3 z3-4.8.8_default unsat ✅ 0.14219 0.14211
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11127 0.11124
Bitwuzla-wrapped_default unsat ✅ 0.11861 0.11740
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.01298 2.01337
MathSAT MathSAT-5.6.8_default unsat ✅ 4.06984 4.05742
STP STP 2022.4_default unsat ✅ 0.05340 0.05341
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03810 0.03809
Z3++BV z3++bv_0702_default unsat ✅ 47.02520 47.02110
Z3 z3-4.8.17_default unsat ✅ 0.17365 0.17546
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.32212 0.20205
Bitwuzla-MachBV-base unsat ✅ 0.32444 0.20677
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.43113 0.30383
BVDecide bv_decide unsat ✅ 438.06175 437.82331
bv_decide-nokernel unsat ✅ 274.25762 274.03946
cvc5 cvc5 unsat ✅ 1.54161 1.41359
SMTInterpol SMTInterpol unsat ✅ 26.74662 51.32288
Yices2 Yices2 unsat ✅ 0.26857 0.14585
Z3alpha Z3-alpha unsat ✅ 0.43612 0.31874
Z3 Z3-alpha-base unsat ✅ 0.37890 0.25541
Z3-Owl-base unsat ✅ 0.76419 0.63910
z3siri-base unsat ✅ 0.37821 0.25194
Z3-Owl Z3-Owl unsat ✅ 0.87764 0.75114