Benchmark

non-incremental/QF_BV/sage/app7/bench_2725.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4397025
Compressed Size274405
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4397017
Compressed Size274406
Max. Term Depth16795
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2593 and1
=3369 let16581 extract1712 bvand45542
bvor30058 bvxor2276 bvadd48816 bvmul7
bvsub16086 bvsdiv19 bvult604 bvule626
bvslt219 bvsle124 bvshl15777 bvashr29720
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69890 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68356 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.67866 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68503 —
abziz_portfolio_2012_solvers default unsat ✅ 0.68021 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68498 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94234 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06180 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99222 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 577.98600 —
CVC3-SMT-COMP-2011 default unsat ✅ 479.42400 —
CVC3-SMT-COMP-2012 default unsat ✅ 500.16800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.60214 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.53981 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32563 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.24970 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.62722 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.59120 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.12987 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.51201 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.14368 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.85079 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.73750 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70332 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.74787 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.75075 —
Z3-SMT-COMP-2011 default unsat ✅ 0.67343 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.16045 1.15508
Boolector SMT17 final boolector unsat ✅ 1.15726 1.15625
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.69090 9.02948
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.83595 0.83691
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.66675 1.66537
Q3B Q3B default unsat ✅ 1.07631 2.67693
STP stp_st default unsat ✅ 0.81249 0.81044
stp_mt default unsat ✅ 0.79387 0.79378
Yices2 Yices2-Main default unsat ✅ 0.26973 0.26846
Z3 z3-4.5.0 default unsat ✅ 0.63443 0.62664
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.03783 1.03776
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.29329 5.29274
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.82305 0.82410
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.68985 1.68979
Minkeyrink ST_st unsat ✅ 1.68621 1.68599
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82042 0.82035
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82101 0.82103
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82405 0.82395
Yices2 Yices 2.6.0_default unsat ✅ 0.26176 0.26170
Z3 z3-4.7.1_default unsat ✅ 0.93549 0.93527
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.99391 1.99386
Poolector-wrapped-sq_default unsat ✅ 2.31004 8.75465
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.63922 1.63910
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.54497 5.54474
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.15265 1.15274
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.15062 1.15064
Par4 Par4-wrapped-sq_default unsat ✅ 0.27533 0.00660
STP STP-2019-wrapped-sq_default unsat ✅ 0.81616 0.81630
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81098 0.81102
stp-minisat-wrapped-sq_default unsat ✅ 0.81899 0.81900
stp-mt-wrapped-sq_default unsat ✅ 0.82081 0.82092
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.82513 0.82510
stp-riss-wrapped-sq_default unsat ✅ 0.85367 0.85370
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.26694 0.26689
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.26759 0.26761
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.26725 0.26725
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.26334 0.26332
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.26754 0.26749
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.68937 0.68940
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66304 1.66280
Boolector Boolector-wrapped-sq_default unsat ✅ 1.97234 1.97195
Poolector-wrapped-sq_default unsat ✅ 2.41146 9.00796
CVC4 CVC4-sq-final_default unsat ✅ 7.17238 7.17245
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.02747 1.02742
MathSAT MathSAT5_default.sh unsat ✅ 0.84813 0.84808
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.95241 0.95249
MinkeyRink Solver 2020.3_default unsat ✅ 0.98488 0.98495
STP STP_default unsat ✅ 0.77936 0.77951
STP ++ Mergsat v1_default unsat ✅ 0.77128 0.77285
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31353 0.31341
Z3 z3-4.8.8_default unsat ✅ 0.45988 0.45978
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.53713 2.53709
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.17947 4.17977
STP STP 2022.4_default unsat ✅ 0.83673 0.83667
STP 2022.4_default unsat ✅ 0.83213 0.83205
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.09000 1337.96000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.30288 0.30285
Z3-Owl z3-Owl-Final_default unsat ✅ 1.52154 1.52149
z3-Owl-Final_default unsat ✅ 1.52999 1.53022