Benchmark

non-incremental/QF_BV/sage/app1/bench_2320.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size14134
Compressed Size2557
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 14126
Compressed Size2565
Max. Term Depth50
Asserts 1
Declared Functions0
Declared Constants5
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite36 not14 and1
=17 let40 bvor3 bvadd103
bvsub73 bvsdiv37 bvult73 bvule64
bvslt3 bvsle109 bvshl3 zero_extend40

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.28225 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.02330 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.02328 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.03418 —
abziz_portfolio_2012_solvers default unsat ✅ 0.02524 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.02518 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.27085 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.00935 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.25356 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 37.77110 —
CVC3-SMT-COMP-2011 default unsat ✅ 33.70670 —
CVC3-SMT-COMP-2012 default unsat ✅ 34.72350 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.01989 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.02435 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.91584 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 5.14276 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.01992 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.75849 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.22482 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.82212 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.83844 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.23632 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.01280 —
STP2-SMT-COMP-2012 default unsat ✅ 0.00921 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.01515 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.00966 —
Z3-SMT-COMP-2011 default unsat ✅ 0.01829 —
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.70634 0.70550
Boolector SMT17 final boolector unsat ✅ 0.66185 0.65955
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.03139 0.04269
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 3.73809 3.73724
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.01479 0.01444
Q3B Q3B default unknown ❌ 600.07900 1192.59000
STP stp_st default unsat ✅ 0.01295 0.01236
stp_mt default unsat ✅ 0.02635 0.01394
Yices2 Yices2-Main default unsat ✅ 0.00775 0.00346
Z3 z3-4.5.0 default unsat ✅ 0.03351 0.03253
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.62622 0.62614
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.07614 0.07631
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 3.63460 3.63510
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.01394 0.01400
Minkeyrink ST_st unsat ✅ 0.01481 0.01492
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.00922 0.00919
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.00941 0.00943
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.00928 0.00940
Yices2 Yices 2.6.0_default unsat ✅ 0.00729 0.00615
Z3 z3-4.7.1_default unsat ✅ 0.03630 0.03620
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.46894 0.46875
Boolector Boolector-wrapped-sq_default unsat ✅ 0.85540 0.85533
Poolector-wrapped-sq_default unsat ✅ 0.47748 0.46556
CVC4 CVC4-sq-final_default unsat ✅ 0.03547 0.03578
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.15156 0.15153
MathSAT MathSAT5_default.sh unsat ✅ 2.07236 2.07199
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01583 0.01591
MinkeyRink Solver 2020.3_default unsat ✅ 0.02567 0.01691
STP STP_default unsat ✅ 0.01525 0.01536
STP ++ Mergsat v1_default unsat ✅ 0.01149 0.01069
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01374 0.00431
Z3 z3-4.8.8_default unsat ✅ 0.03242 0.03221
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.52137 0.51803
Bitwuzla-wrapped_default unsat ✅ 0.53959 0.53951
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.03329 0.03385
MathSAT MathSAT-5.6.8_default unsat ✅ 2.19041 2.18818
STP STP 2022.4_default unsat ✅ 0.02163 0.01392
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01236 0.00447
Z3++BV z3++bv_0702_default unsat ✅ 0.01780 0.01772
Z3 z3-4.8.17_default unsat ✅ 0.01854 0.02017
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.99690 0.89644
cvc5 cvc5 unsat ✅ 0.23276 0.13315
SMTInterpol SMTInterpol unsat ✅ 1.47256 4.17811
STP STP unsat ✅ 0.24722 0.14763
Yices2 Yices2 unsat ✅ 0.21395 0.11403
Z3alpha Z3-alpha unsat ✅ 0.29061 0.19063
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.30556 0.16828
Bitwuzla-MachBV-base unsat ✅ 0.68178 0.55573
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.53285 0.41784
BVDecide bv_decide unsat ✅ 13.54765 13.36980
bv_decide-nokernel unsat ✅ 6.03777 5.86034
cvc5 cvc5 unsat ✅ 0.29553 0.16886
SMTInterpol SMTInterpol unsat ✅ 1.45209 3.96674
Yices2 Yices2 unsat ✅ 0.24319 0.12663
Z3alpha Z3-alpha unsat ✅ 0.35991 0.24791
Z3 Z3-alpha-base unsat ✅ 0.27601 0.15485
Z3-Owl-base unsat ✅ 0.30667 0.18070
z3siri-base unsat ✅ 0.27532 0.15779
Z3-Owl Z3-Owl unsat ✅ 0.82208 0.69198