Benchmark

non-incremental/QF_BV/sage/app7/bench_803.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4422621
Compressed Size274703
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4422613
Compressed Size274711
Max. Term Depth16968
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2719 and1
=3501 let16754 extract1712 bvand45729
bvor30132 bvxor2276 bvadd49158 bvmul9
bvsub16109 bvsdiv27 bvult621 bvule643
bvslt220 bvsle125 bvshl15791 bvashr29849
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70245 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.65516 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.64396 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.65489 —
abziz_portfolio_2012_solvers default unsat ✅ 0.64415 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.65000 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95405 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.05921 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99780 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 242.45200 —
CVC3-SMT-COMP-2011 default unsat ✅ 204.39500 —
CVC3-SMT-COMP-2012 default unsat ✅ 213.82200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.65330 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.53932 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.31112 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27893 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.63363 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.59523 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14222 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.56783 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.18073 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87519 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74291 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70724 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77139 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.69385 —
Z3-SMT-COMP-2011 default unsat ✅ 0.63766 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.27301 1.27317
Boolector SMT17 final boolector unsat ✅ 1.20649 1.20304
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.71482 9.07420
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.90529 0.90535
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.68816 1.68043
Q3B Q3B default unsat ✅ 1.12165 2.89000
STP stp_st default unsat ✅ 0.87170 0.87195
stp_mt default unsat ✅ 0.89545 0.89444
Yices2 Yices2-Main default unsat ✅ 0.47564 0.47457
Z3 z3-4.5.0 default unsat ✅ 0.80200 0.80081
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04564 1.04554
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.30594 5.30511
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83195 0.83321
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69700 1.69690
Minkeyrink ST_st unsat ✅ 1.69401 1.69400
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82485 0.82479
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.94218 0.94223
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82768 0.82769
Yices2 Yices 2.6.0_default unsat ✅ 0.48130 0.48119
Z3 z3-4.7.1_default unsat ✅ 1.06117 1.06097
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.00004 1.99959
Poolector-wrapped-sq_default unsat ✅ 2.40483 9.06390
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.62307 1.61839
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.54339 5.54235
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.14590 1.14585
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.15253 1.15263
Par4 Par4-wrapped-sq_default unsat ✅ 0.48841 0.00605
STP STP-2019-wrapped-sq_default unsat ✅ 0.82550 0.82554
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81268 0.81276
stp-minisat-wrapped-sq_default unsat ✅ 0.82773 0.82784
stp-mt-wrapped-sq_default unsat ✅ 0.82310 0.82305
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81315 0.81316
stp-riss-wrapped-sq_default unsat ✅ 0.82327 0.82338
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.44822 0.44821
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44578 0.44581
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44475 0.44478
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.44028 0.44023
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44141 0.44142
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.86546 0.86547
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65809 1.65795
MathSAT mathsat-5.6.6_default unsat ✅ 0.87318 0.87312
STP STP 2021.0_default unsat ✅ 0.78832 0.78846
Z3 z3-4.8.11_default unsat ✅ 0.78683 0.78680
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.53108 2.53053
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.29376 4.28960
STP STP 2022.4_default unsat ✅ 0.83796 0.83795
STP 2022.4_default unsat ✅ 0.83917 0.83906
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.06000 1327.35000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.48954 0.48951
Z3-Owl z3-Owl-Final_default unsat ✅ 1.45573 1.45537
z3-Owl-Final_default unsat ✅ 1.46444 1.46452
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.51999 1.42022
cvc5 cvc5 unsat ✅ 1.00328 0.90354
SMTInterpol SMTInterpol unknown ❌ 1202.72016 1433.03299
STP STP unsat ✅ 66.93586 66.81307
Yices2 Yices2 unsat ✅ 0.54241 0.44256
Z3alpha Z3-alpha unsat ✅ 0.62214 0.52241