English
Related papers

Related papers: Sparse high-dimensional linear mixed modeling with…

200 papers

We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM…

Machine Learning · Statistics 2015-01-28 Zhaoran Wang , Quanquan Gu , Yang Ning , Han Liu

We present generalized additive latent and mixed models (GALAMMs) for analysis of clustered data with responses and latent variables depending smoothly on observed variables. A scalable maximum likelihood estimation algorithm is proposed,…

Methodology · Statistics 2023-03-29 Øystein Sørensen , Anders M. Fjell , Kristine B. Walhovd

Parameter estimation in logistic regression is a well-studied problem with the Newton-Raphson method being one of the most prominent optimization techniques used in practice. A number of monotone optimization methods including…

Computation · Statistics 2023-04-11 Nicholas C. Henderson , Zhongzhe Ouyang

In recent years, a rich variety of regularization procedures have been proposed for high dimensional regression problems. However, tuning parameter choice and computational efficiency in ultra-high dimensional problems remain vexing issues.…

Computation · Statistics 2012-01-18 Hua Zhou , Artin Armagan , David B. Dunson

This work introduces a Bayesian methodology for fitting large discrete graphical models with spike-and-slab priors to encode sparsity. We consider a quasi-likelihood approach that enables node-wise parallel computation resulting in reduced…

Methodology · Statistics 2019-10-21 Anwesha Bhattacharyya , Yves Atchade

Recent technological advancements have led to the rapid generation of high-throughput biological data, which can be used to address novel scientific questions in broad areas of research. These data can be thought of as a large matrix with…

Computation · Statistics 2021-03-01 Jane W. Liang , Saunak Sen

Nonlinear Mixed Effects models (NLME) models are widely used in pharmacometrics and related fields to analyze hierarchical and longitudinal data. However, as the number of parameters and random effects increases, traditional methods for…

Methodology · Statistics 2026-04-30 Mohamed Tarek , Pedro Afonso

Data for several applications in diverse fields can be represented as multiple matrices that are linked across rows or columns. This is particularly common in molecular biomedical research, in which multiple molecular "omics" technologies…

Machine Learning · Statistics 2024-08-02 Eric F. Lock

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji

Latent Markov (LM) models represent an important class of models for the analysis of longitudinal data (Bartolucci et. al., 2013), especially when response variables are categorical. These models have a great potential of application for…

Computation · Statistics 2015-01-20 Francesco Bartolucci , Alessio Farcomeni , Silvia Pandolfi , Fulvia Pennoni

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

Methodology · Statistics 2021-06-29 Haim Bar , James Booth , Martin T. Wells

Linear mixed models (LMMs) are used as an important tool in the data analysis of repeated measures and longitudinal studies. The most common form of LMMs utilize a normal distribution to model the random effects. Such assumptions can often…

Methodology · Statistics 2016-02-16 Hien D. Nguyen , Geoffrey J. McLachlan

The analysis of data from multiple experiments, such as observations of several individuals, is commonly approached using mixed-effects models, which account for variation between individuals through hierarchical representations. This makes…

Computation · Statistics 2026-03-05 Henrik Häggström , Sebastian Persson , Marija Cvijovic , Umberto Picchini

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

In this paper, Bayesian parameter estimation through the consideration of the Maximum A Posteriori (MAP) criterion is revisited under the prism of the Expectation-Maximization (EM) algorithm. By incorporating a sparsity-promoting penalty…

Systems and Control · Computer Science 2015-08-06 Rodrigo Carvajal , Juan C. Agüero , Boris I. Godoy , Dimitrios Katselis

Additive smooth models, such as Generalized additive models (GAMs) of location, scale, and shape (GAMLSS), are a popular choice for modeling experimental data. However, software available to fit such models is usually not tailored…

Methodology · Statistics 2025-06-17 Joshua Krause , Jelmer P. Borst , Jacolien van Rij

Mixtures of linear mixed models (MLMMs) are useful for clustering grouped data and can be estimated by likelihood maximization through the EM algorithm. The conventional approach to determining a suitable number of components is to compare…

Applications · Statistics 2014-05-26 Siew Li Tan , David J. Nott

Motivated by genome-wide association studies, we consider a standard linear model with one additional random effect in situations where many predictors have been collected on the same subjects and each predictor is analyzed separately.…

Applications · Statistics 2013-04-24 Matti Pirinen , Peter Donnelly , Chris C. A. Spencer

Two key challenges in modern statistical applications are the large amount of information recorded per individual, and that such data are often not collected all at once but in batches. These batch effects can be complex, causing…

Applications · Statistics 2019-05-21 Alejandra Avalos-Pacheco , David Rossell , Richard S. Savage

Bayesian graphical models are a useful tool for understanding dependence relationships among many variables, particularly in situations with external prior information. In high-dimensional settings, the space of possible graphs becomes…

Machine Learning · Statistics 2019-02-07 Zehang Richard Li , Tyler H. McCormick