Benchmark

non-incremental/QF_BV/sage/app7/bench_4780.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4512097
Compressed Size277406
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4512089
Compressed Size277412
Max. Term Depth16992
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2775 and1
=3578 let16841 extract1725 bvand46148
bvor30442 bvxor2334 bvadd49692 bvmul9
bvsub16271 bvsdiv28 bvult646 bvule656
bvslt221 bvsle126 bvshl15947 bvashr30118
zero_extend1528

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.72367 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68779 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69700 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68252 —
abziz_portfolio_2012_solvers default unsat ✅ 0.68233 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.69492 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94892 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.07460 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.00091 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 577.91500 —
CVC3-SMT-COMP-2011 default unsat ✅ 480.57900 —
CVC3-SMT-COMP-2012 default unsat ✅ 499.19000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.70397 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.64683 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32127 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26545 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.67279 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.62505 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.16994 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.58759 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.26967 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.88637 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74920 —
STP2-SMT-COMP-2012 default unsat ✅ 0.72383 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76229 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.75035 —
Z3-SMT-COMP-2011 default unsat ✅ 0.68089 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.16084 1.15935
Boolector SMT17 final boolector unsat ✅ 1.16108 1.15965
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.72400 9.09380
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.86934 0.86931
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.73334 1.73225
Q3B Q3B default unsat ✅ 1.16752 3.14000
STP stp_st default unsat ✅ 0.86941 0.86867
stp_mt default unsat ✅ 0.91454 0.90880
Yices2 Yices2-Main default unsat ✅ 0.27187 0.27081
Z3 z3-4.5.0 default unsat ✅ 0.88634 0.88543
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.05145 1.05138
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.38247 5.38271
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.84611 0.84705
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.71270 1.71274
Minkeyrink ST_st unsat ✅ 1.70798 1.70796
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83476 0.83460
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83199 0.83205
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83276 0.83276
Yices2 Yices 2.6.0_default unsat ✅ 0.26118 0.26114
Z3 z3-4.7.1_default unsat ✅ 0.99251 0.99234
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.11005 2.10989
Poolector-wrapped-sq_default unsat ✅ 2.50294 9.42369
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.68996 1.68962
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.62581 5.62573
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.16526 1.16547
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.16716 1.16642
Par4 Par4-wrapped-sq_default unsat ✅ 0.27438 0.00600
STP STP-2019-wrapped-sq_default unsat ✅ 0.83668 0.83681
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.82044 0.82052
stp-minisat-wrapped-sq_default unsat ✅ 0.83066 0.83079
stp-mt-wrapped-sq_default unsat ✅ 0.82822 0.82833
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.82381 0.82389
stp-riss-wrapped-sq_default unsat ✅ 0.83141 0.83154
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.26849 0.26849
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.26747 0.26745
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.27564 0.27564
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.26443 0.26445
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.26781 0.26780
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.02382 1.02386
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69576 3.29563
Boolector Boolector-wrapped-sq_default unsat ✅ 2.07745 2.07726
Poolector-wrapped-sq_default unsat ✅ 2.51316 9.27689
CVC4 CVC4-sq-final_default unsat ✅ 7.35676 7.35698
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04545 1.04522
MathSAT MathSAT5_default.sh unsat ✅ 0.85193 0.85183
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.96529 0.96536
MinkeyRink Solver 2020.3_default unsat ✅ 0.99602 0.99503
STP STP_default unsat ✅ 0.78435 0.78449
STP ++ Mergsat v1_default unsat ✅ 0.77312 0.77471
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31802 0.31798
Z3 z3-4.8.8_default unsat ✅ 0.50480 0.50475
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.47051 1.37026
cvc5 cvc5 unsat ✅ 1.94613 1.84635
SMTInterpol SMTInterpol unknown ❌ 1202.72303 1429.48144
STP STP unsat ✅ 84.48354 84.32657
Yices2 Yices2 unsat ✅ 0.42097 0.32080
Z3alpha Z3-alpha unsat ✅ 0.64374 0.54396
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.20078 1.07185
Bitwuzla-MachBV-base unsat ✅ 1.48062 1.34895
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.65953 1.53294
BVDecide bv_decide unknown ❌ 1201.38352 1201.01035
bv_decide-nokernel unknown ❌ 1201.39008 1201.04296
cvc5 cvc5 unsat ✅ 0.99720 0.87760
SMTInterpol SMTInterpol unknown ❌ 1201.88514 1762.21146
Yices2 Yices2 unsat ✅ 0.40849 0.29061
Z3alpha Z3-alpha unsat ✅ 1.06920 1.08341
Z3 Z3-alpha-base unsat ✅ 0.59797 0.48212
Z3-Owl-base unsat ✅ 1.66888 1.54278
z3siri-base unsat ✅ 0.59258 0.46811
Z3-Owl Z3-Owl unsat ✅ 1.12793 0.99321