English
Related papers

Related papers: Scalable Subset Selection in Linear Mixed Models

200 papers

Long Short-Term Memory (LSTM) neural network models have become the cornerstone for sequential data modeling in numerous applications, ranging from natural language processing to time series forecasting. Despite their success, the problem…

Machine Learning · Statistics 2026-05-26 Fahad Mostafa

Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables,…

Methodology · Statistics 2011-01-04 Xia Cui , Heng Peng , Songqiao Wen , Lixing Zhu

The problem of best subset selection in linear regression is considered with the aim to find a fixed size subset of features that best fits the response. This is particularly challenging when the total available number of features is very…

Methodology · Statistics 2023-11-28 Sarat Moka , Benoit Liquet , Houying Zhu , Samuel Muller

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, additive models consider…

Machine Learning · Statistics 2017-10-18 Sheng Chen , Arindam Banerjee

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

The sparsity-restricted maximum likelihood estimator (SMLE) has received considerable attention for feature screening in ultrahigh-dimensional regression. SMLE is a computationally convenient method that naturally incorporates the joint…

Other Statistics · Statistics 2022-01-11 Qianxiang Zang , Chen Xu , Kelly Burkett

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

Personalization of machine learning (ML) predictions for individual users/domains/enterprises is critical for practical recommendation systems. Standard personalization approaches involve learning a user/domain specific embedding that is…

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

Machine Learning · Computer Science 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

Machine Learning · Statistics 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

Structured Latent Attribute Models (SLAMs) are a family of discrete latent variable models widely used in education, psychology, and epidemiology to model multivariate categorical data. A SLAM assumes that multiple discrete latent…

Methodology · Statistics 2021-07-12 Yuqi Gu , Gongjun Xu

High-dimensional longitudinal data is increasingly used in a wide range of scientific studies. To properly account for dependence between longitudinal observations, statistical methods for high-dimensional linear mixed models (LMMs) have…

Methodology · Statistics 2024-07-10 Anja Zgodic , Ray Bai , Jiajia Zhang , Peter Olejua , Alexander C. McLain

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

We present fast classification techniques for sparse generalized linear and additive models. These techniques can handle thousands of features and thousands of observations in minutes, even in the presence of many highly correlated…

Machine Learning · Computer Science 2022-11-01 Jiachang Liu , Chudi Zhong , Margo Seltzer , Cynthia Rudin

We propose an L1-penalized algorithm for fitting high-dimensional generalized linear mixed models. Generalized linear mixed models (GLMMs) can be viewed as an extension of generalized linear models for clustered observations. This…

Computation · Statistics 2014-06-03 Jürg Schelldorfer , Lukas Meier , Peter Bühlmann

For the problem of high-dimensional sparse linear regression, it is known that an $\ell_0$-based estimator can achieve a $1/n$ "fast" rate on the prediction error without any conditions on the design matrix, whereas in absence of…

Statistics Theory · Mathematics 2015-12-01 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

Longitudinal analysis is important in many disciplines, such as the study of behavioral transitions in social science. Only very recently, feature selection has drawn adequate attention in the context of longitudinal modeling. Standard…

Methodology · Statistics 2016-10-26 Tingyang Xu , Jiangwen Sun , Jinbo Bi

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

Sparse prediction with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm for selection…

Methodology · Statistics 2021-12-22 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel