Benchmark

non-incremental/QF_BV/sage/app7/bench_8047.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3362164
Compressed Size213621
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3362156
Compressed Size213626
Max. Term Depth12918
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2321 and1
=3031 let12813 extract1667 bvand34284
bvor22490 bvxor2174 bvadd37027 bvmul7
bvsub12012 bvsdiv19 bvult567 bvule607
bvslt218 bvsle124 bvshl11826 bvashr22104
zero_extend1468

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49464 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50456 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51524 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.51289 —
abziz_portfolio_2012_solvers default unsat ✅ 0.50318 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50574 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66265 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.80328 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70740 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.61100 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.65500 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.73400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.88560 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.57484 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.00511 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95836 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.24737 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.21264 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.88669 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.10301 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.21835 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.36166 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52548 —
STP2-SMT-COMP-2012 default unsat ✅ 0.50031 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53578 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.55449 —
Z3-SMT-COMP-2011 default unsat ✅ 0.50714 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.88461 0.88355
Boolector SMT17 final boolector unsat ✅ 0.87818 0.87731
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.30350 6.90005
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64802 0.64798
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.26280 1.26177
Q3B Q3B default unsat ✅ 0.86103 2.22000
STP stp_st default unsat ✅ 0.57733 0.57653
stp_mt default unsat ✅ 0.57790 0.57603
Yices2 Yices2-Main default unsat ✅ 0.36950 0.36869
Z3 z3-4.5.0 default unsat ✅ 0.71265 0.71243
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.79282 0.79267
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.97686 3.97711
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.64368 0.64475
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27985 1.27987
Minkeyrink ST_st unsat ✅ 1.29180 1.29176
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.58203 0.58203
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.58588 0.58573
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.58267 0.58251
Yices2 Yices 2.6.0_default unsat ✅ 0.37195 0.37187
Z3 z3-4.7.1_default unsat ✅ 0.59491 0.59483
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50471 1.50465
Poolector-wrapped-sq_default unsat ✅ 1.79994 6.75935
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.21705 1.21701
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.20736 4.20719
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.90462 0.90475
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.90093 0.90096
Par4 Par4-wrapped-sq_default unsat ✅ 0.38040 0.00617
STP STP-2019-wrapped-sq_default unsat ✅ 0.59623 0.59629
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58895 0.58905
stp-minisat-wrapped-sq_default unsat ✅ 0.59600 1.15614
stp-mt-wrapped-sq_default unsat ✅ 0.59705 0.59719
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.60638 0.60580
stp-riss-wrapped-sq_default unsat ✅ 0.62667 0.62672
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34209 0.34208
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34472 0.34475
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34747 0.34747
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.34232 0.34233
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34137 0.34133
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.76145 0.76147
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24530 1.24521
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49110 1.49099
Poolector-wrapped-sq_default unsat ✅ 1.77947 6.65909
CVC4 CVC4-sq-final_default unsat ✅ 5.46591 5.46582
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.80714 0.80708
MathSAT MathSAT5_default.sh unsat ✅ 0.65816 0.65814
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.74371 0.74378
MinkeyRink Solver 2020.3_default unsat ✅ 0.77134 0.77147
STP STP_default unsat ✅ 0.54491 0.54474
STP ++ Mergsat v1_default unsat ✅ 0.53902 0.54064
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38324 0.38310
Z3 z3-4.8.8_default unsat ✅ 0.59953 0.59931
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.01203 2.01186
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.06333 3.06138
STP STP 2022.4_default unsat ✅ 0.60979 0.60971
STP 2022.4_default unsat ✅ 0.61379 0.61385
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1315.29000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37467 0.37466
Z3-Owl z3-Owl-Final_default unsat ✅ 1.06669 1.06664
z3-Owl-Final_default unsat ✅ 1.07555 1.07577
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.18491 1.08449
cvc5 cvc5 unsat ✅ 1.62924 1.52966
SMTInterpol SMTInterpol unknown ❌ 1202.74263 1393.63438
STP STP unsat ✅ 36.00947 35.89581
Yices2 Yices2 unsat ✅ 0.46224 0.36180
Z3alpha Z3-alpha unsat ✅ 0.57487 0.47520
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.99579 0.87235
Bitwuzla-MachBV-base unsat ✅ 1.23891 1.10945
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.39457 1.27098
BVDecide bv_decide unknown ❌ 1201.38082 1200.90896
bv_decide-nokernel unknown ❌ 1201.38923 1200.98640
cvc5 cvc5 unsat ✅ 0.77250 0.65232
SMTInterpol SMTInterpol unknown ❌ 1201.89279 1854.43056
Yices2 Yices2 unsat ✅ 0.47375 0.35422
Z3alpha Z3-alpha unsat ✅ 0.96505 0.94839
Z3 Z3-alpha-base unsat ✅ 0.55013 0.42271
Z3-Owl-base unsat ✅ 1.41117 1.28325
z3siri-base unsat ✅ 0.54446 0.41605
Z3-Owl Z3-Owl unsat ✅ 1.08176 0.95224