Benchmark

non-incremental/QF_BV/sage/app7/bench_4747.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3581424
Compressed Size231106
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3581416
Compressed Size231112
Max. Term Depth13791
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2492 and1
=3261 let13605 extract1705 bvand36373
bvor23898 bvxor2267 bvadd39542 bvmul7
bvsub13023 bvsdiv19 bvult602 bvule626
bvslt219 bvsle124 bvshl12717 bvashr23641
zero_extend1509

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.53121 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.58278 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.57390 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.58534 —
abziz_portfolio_2012_solvers default unsat ✅ 0.58307 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.58406 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.70986 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.85652 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.74912 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.87400 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.91000 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.68500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.14985 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.74981 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.07214 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.02952 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.34194 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.29885 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.94345 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.75075 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.54269 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.46584 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.61735 —
STP2-SMT-COMP-2012 default unsat ✅ 0.54587 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.56890 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.63779 —
Z3-SMT-COMP-2011 default unsat ✅ 0.58061 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.95265 0.95201
Boolector SMT17 final boolector unsat ✅ 0.93763 0.93707
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.63973 7.47290
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69156 0.69254
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.36077 1.36074
Q3B Q3B default unsat ✅ 0.91580 2.27000
STP stp_st default unsat ✅ 0.61432 0.61343
stp_mt default unsat ✅ 0.62101 0.62088
Yices2 Yices2-Main default unsat ✅ 0.39033 0.38961
Z3 z3-4.5.0 default unsat ✅ 0.77859 0.77865
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.84224 0.84210
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.36416 4.36419
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67735 0.67846
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.38227 1.38215
Minkeyrink ST_st unsat ✅ 1.42602 1.42604
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.62486 0.62486
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.62587 0.62597
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.62571 0.62566
Yices2 Yices 2.6.0_default unsat ✅ 0.38925 0.38909
Z3 z3-4.7.1_default unsat ✅ 0.85789 0.85786
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.61147 1.61147
Poolector-wrapped-sq_default unsat ✅ 1.89298 7.10000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.30836 1.30837
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.56158 4.56200
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.95752 0.95766
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.95926 0.95935
Par4 Par4-wrapped-sq_default unsat ✅ 0.41591 0.00632
STP STP-2019-wrapped-sq_default unsat ✅ 0.63653 0.63667
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.63215 0.63213
stp-minisat-wrapped-sq_default unsat ✅ 0.63889 0.63900
stp-mt-wrapped-sq_default unsat ✅ 0.63750 0.63750
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.62989 0.62985
stp-riss-wrapped-sq_default unsat ✅ 0.63859 0.63870
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36564 0.36563
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36352 0.36346
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.37106 0.37106
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36407 0.36406
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.36368 0.36350
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.57720 0.57714
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.11222 2.11210
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.36523 3.35842
STP STP 2022.4_default unsat ✅ 0.68724 0.68730
STP 2022.4_default unsat ✅ 0.68855 0.68839
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.10000 1313.70000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39794 0.39785
Z3-Owl z3-Owl-Final_default unsat ✅ 1.06513 1.06499
z3-Owl-Final_default unsat ✅ 1.07595 1.07628
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.52966 1.42983
cvc5 cvc5 unsat ✅ 2.25771 2.15682
SMTInterpol SMTInterpol unknown ❌ 1202.74761 1419.63410
STP STP unsat ✅ 43.58911 43.48823
Yices2 Yices2 unsat ✅ 0.50399 0.40372
Z3alpha Z3-alpha unsat ✅ 0.57059 0.47059