TY - JOUR
T1 - Superiority of Bayes estimators over the MLE in high dimensional multinomial models and its implication for nonparametric Bayes theory
AU - Bhattacharya, Rabi
AU - Oliver, Rachel
N1 - Funding Information:
The authors gratefully acknowledge National Science Foundation, United States of America grant DMS 1811317 and helpful comments made by the Associate Editor and two reviewers.
Publisher Copyright:
© 2020 Elsevier B.V.
PY - 2020/10
Y1 - 2020/10
N2 - The performance of Bayes estimators is examined, in comparison with the MLE, in multinomial models with a relatively large number of cells. The prior for the Bayes estimator is taken to be the conjugate Dirichlet, i.e., the multivariate Beta, with exchangeable distributions over the coordinates, including the non-informative uniform distribution. The choice of the multinomial is motivated by its many applications in business and industry, but also by its use in providing a simple nonparametric estimator of an unknown distribution. It is striking that the Bayes procedure outperforms the asymptotically efficient MLE over most of the parameter spaces for even moderately large dimensional parameter spaces and rather large sample sizes.
AB - The performance of Bayes estimators is examined, in comparison with the MLE, in multinomial models with a relatively large number of cells. The prior for the Bayes estimator is taken to be the conjugate Dirichlet, i.e., the multivariate Beta, with exchangeable distributions over the coordinates, including the non-informative uniform distribution. The choice of the multinomial is motivated by its many applications in business and industry, but also by its use in providing a simple nonparametric estimator of an unknown distribution. It is striking that the Bayes procedure outperforms the asymptotically efficient MLE over most of the parameter spaces for even moderately large dimensional parameter spaces and rather large sample sizes.
KW - Bayes estimators versus the MLE
KW - High dimensional multinomials
KW - Nonparametric Bayes
UR - http://www.scopus.com/inward/record.url?scp=85084952766&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85084952766&partnerID=8YFLogxK
U2 - 10.1016/j.csda.2020.107011
DO - 10.1016/j.csda.2020.107011
M3 - Article
AN - SCOPUS:85084952766
VL - 150
JO - Computational Statistics and Data Analysis
JF - Computational Statistics and Data Analysis
SN - 0167-9473
M1 - 107011
ER -