English
Related papers

Related papers: Component-based regularisation of multivariate gen…

200 papers

Estimation of generalized linear mixed models (GLMMs) with non-nested random effects structures requires approximation of high-dimensional integrals. Many existing methods are tailored to the low-dimensional integrals produced by nested…

Computation · Statistics 2014-04-01 Andrew T. Karl , Yan Yang , Sharon L. Lohr

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin

Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables,…

Methodology · Statistics 2011-01-04 Xia Cui , Heng Peng , Songqiao Wen , Lixing Zhu

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent…

Methodology · Statistics 2012-02-09 Mohsen Pourahmadi

Mixtures of linear mixed models (MLMMs) are useful for clustering grouped data and can be estimated by likelihood maximization through the EM algorithm. The conventional approach to determining a suitable number of components is to compare…

Applications · Statistics 2014-05-26 Siew Li Tan , David J. Nott

In additive models with many nonparametric components, a number of regularized estimators have been proposed and proven to attain various error bounds under different combinations of sparsity and fixed smoothness conditions. Some of these…

Statistics Theory · Mathematics 2020-11-16 Yisha Yao , Cun-Hui Zhang

Motivated by regression analysis for microbiome compositional data, this paper considers generalized linear regression analysis with compositional covariates, where a group of linear constraints on regression coefficients are imposed to…

Methodology · Statistics 2018-01-11 Jiarui Lu , Pixu Shi , Hongzhe Li

Endmember variability is an important factor for accurately unveiling vital information relating the pure materials and their distribution in hyperspectral images. Recently, the extended linear mixing model (ELMM) has been proposed as a…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Tales Imbiriba , Ricardo Augusto Borsoi , José Carlos Moreira Bermudez

In this paper, we introduce the Generalized Mixed Regularized Reduced Rank Regression model (GMR4), an extension of the GMR3 model designed to improve performance in high-dimensional settings. GMR3 is a regression method for a mix of…

Methodology · Statistics 2025-12-16 Lorenza Cotugno , Mark de Rooij , Roberta Siciliano

Gaussian graphical models (GGMs) are widely used to recover the conditional independence structure among random variables. Recent work has sought to incorporate auxiliary covariates to improve estimation, particularly in applications such…

Methodology · Statistics 2026-03-31 Ruobin Liu , Guo Yu

Models with random effects, such as generalised linear mixed models (GLMMs), are often used for analysing clustered data. Parameter inference with these models is difficult because of the presence of cluster-specific random effects, which…

Computation · Statistics 2024-04-19 Bao Anh Vu , David Gunawan , Andrew Zammit-Mangion

Regression by composition provides a flexible framework for constructing conditional distributions through sequential group actions. However, when multiple flows act on the same distribution, the model becomes non-identifiable, leading to…

Methodology · Statistics 2026-03-30 Safaa K. Kadhem

The generalized partially linear additive model (GPLAM) is a flexible and interpretable approach to building predictive models. It combines features in an additive manner, allowing each to have either a linear or nonlinear effect on the…

Methodology · Statistics 2018-03-29 Yin Lou , Jacob Bien , Rich Caruana , Johannes Gehrke

Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools…

Machine Learning · Computer Science 2022-01-28 Łukasz Kidziński , Francis K. C. Hui , David I. Warton , Trevor Hastie

In this study, we have developed an incremental machine learning (ML) method that efficiently obtains the optimal model when a small number of instances or features are added or removed. This problem holds practical importance in model…

Machine Learning · Statistics 2023-06-23 Hiroyuki Hanada , Noriaki Hashimoto , Kouichi Taji , Ichiro Takeuchi

Mixed membership models are an extension of finite mixture models, where each observation can partially belong to more than one mixture component. A probabilistic framework for mixed membership models of high-dimensional continuous data is…

Semiparametric regression offers a flexible framework for modeling non-linear relationships between a response and covariates. A prime example are generalized additive models where splines (say) are used to approximate non-linear functional…

Statistics Theory · Mathematics 2018-10-05 Francis K. C. Hui , Chong You , Han Lin Shang , Samuel Müller

The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under the assumption that…

Methodology · Statistics 2017-11-01 Alexander J. Gibberd , James D. B. Nelson

Two popular approaches for relating correlated measurements of a non-Gaussian response variable to a set of predictors are to fit a marginal model using generalized estimating equations and to fit a generalized linear mixed model by…

Methodology · Statistics 2017-02-23 Jeffrey J. Gory , Peter F. Craigmile , Steven N. MacEachern

The rebmix package provides R functions for random univariate and multivariate finite mixture model generation, estimation, clustering and classification. The paper is focused on multivariate normal mixture models with unrestricted…

Machine Learning · Statistics 2018-01-29 Marko Nagode