Modeling sparsity with super heavy-tailed priors

Zihan Zhu, Xueying Tang

Research output: Contribution to journalArticlepeer-review

Abstract

Sparsity is often a desired structure for parameters in highdimensional statistical problems. Within a Bayesian framework, sparsity is usually induced by spike-and-slab priors or global-local shrinkage priors. The latter choice is often expressed as a scale mixture of normal distributions. It marginally places a polynomial-tailed distribution on the parameter. In general, a heavier-tailed distribution has a better performance in estimating sparse parameters. We consider the log Cauchy prior and, more generally, super heavy-tailed priors in the normal mean estimation problem. This class of priors is proper while having a tail order arbitrarily close to one. The resulting posterior mean is a shrinkage estimator, and the posterior contraction rate is sharp minimax. The empirical performance of these priors is demonstrated through simulations and a real data example.

Original languageEnglish (US)
Pages (from-to)1570-1608
Number of pages39
JournalElectronic Journal of Statistics
Volume19
Issue number1
DOIs
StatePublished - 2025

Keywords

  • optimal posterior contraction rate
  • Shrinkage prior
  • sparsity
  • super heavy-tailed prior

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint

Dive into the research topics of 'Modeling sparsity with super heavy-tailed priors'. Together they form a unique fingerprint.

Cite this