Moment-based method for random effects selection in linear mixed models

Mihye Ahn, Hao Helen Zhang, Wenbin Lu

Research output: Contribution to journalArticlepeer-review

24 Scopus citations


The selection of random effects in linear mixed models is an important yet challenging problem in practice. We propose a robust and unified framework for automatically selecting random effects and estimating covariance components in linear mixed models. A moment-based loss function is first constructed for estimating the covariance matrix of random effects. Two types of shrinkage penalties, a hard thresholding operator and a new sandwich-type soft-thresholding penalty, are then imposed for sparse estimation and random effects selection. Compared with existing approaches, the new procedure does not require any distributional assumption on the random effects and error terms. We establish the asymptotic properties of the resulting estimator in terms of its consistency in both random effects selection and variance component estimation. Optimization strategies are suggested to tackle the computational challenges involved in estimating the sparse variance-covariance matrix. Furthermore, we extend the procedure to incorporate the selection of fixed effects as well. Numerical results show the promising performance of the new approach in selecting both random and fixed effects, and consequently, improving the efficiency of estimating model parameters. Finally, we apply the approach to a data set from the Amsterdam Growth and Health study.

Original languageEnglish (US)
Pages (from-to)1539-1562
Number of pages24
JournalStatistica Sinica
Issue number4
StatePublished - Oct 2012


  • Hard thresholding
  • Linear mixed model
  • Shrinkage estimation
  • Variance component selection

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty


Dive into the research topics of 'Moment-based method for random effects selection in linear mixed models'. Together they form a unique fingerprint.

Cite this