English
Related papers

Related papers: Grouping effects of sparse CCA models in variable …

200 papers

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

Applications · Statistics 2017-04-04 Emiliano Diaz

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

Statistics Theory · Mathematics 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

Categorical covariates such as race, sex, or group are ubiquitous in regression analysis. While main-only (or ANCOVA) linear models are predominant, cat-modified linear models that include categorical-continuous or categorical-categorical…

Methodology · Statistics 2024-08-02 Daniel R. Kowal

Recent developments in regularized Canonical Correlation Analysis (CCA) promise powerful methods for high-dimensional, multiview data analysis. However, justifying the structural assumptions behind many popular approaches remains a…

Methodology · Statistics 2025-11-18 Lennie Wells , Kumar Thurimella , Sergio Bacallado

Multi-cellular programs (MCPs) are coordinated patterns of gene expression across interacting cell types that collectively drive complex biological processes such as tissue development and immune responses. While MCPs are typically…

Methodology · Statistics 2026-02-05 Qi Xu , Jing Lei , Kathryn Roeder

We study the application of the grouped fixed effects approach to binary choice models for panel data in presence of severe complete separation. Through data loss, complete separation may lead to biased estimates of Average Partial Effects…

Econometrics · Economics 2025-11-07 Claudia Pigini , Alessandro Pionati , Francesco Valentini

Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Magne Thoresen

We consider asymptotically exact inference on the leading canonical correlation directions and strengths between two high dimensional vectors under sparsity restrictions. In this regard, our main contribution is the development of a loss…

Statistics Theory · Mathematics 2022-02-10 Nilanjana Laha , Nathan Huey , Brent Coull , Rajarshi Mukherjee

Canonical Correlation Analysis (CCA) and its regularised versions have been widely used in the neuroimaging community to uncover multivariate associations between two data modalities (e.g., brain imaging and behaviour). However, these…

Machine Learning · Statistics 2021-03-12 Fabio S. Ferreira , Agoston Mihalik , Rick A. Adams , John Ashburner , Janaina Mourao-Miranda

This paper sets a proposal of a new method and two new algorithms for Correspondence Analysis when we have Symbolic Multi--Valued Variables (SymCA). In our method, there are two multi--valued variables $X$ and $Y$, that is to say, the…

Methodology · Statistics 2024-01-22 Oldemar Rodriguez

Grouping structures arise naturally in many statistical modeling problems. Several methods have been proposed for variable selection that respect grouping structure in variables. Examples include the group LASSO and several concave group…

Statistics Theory · Mathematics 2013-01-07 Jian Huang , Patrick Breheny , Shuangge Ma

Sparse PCA is one of the most well-studied problems in high-dimensional statistics. In this problem, we are given samples from a distribution with covariance $\Sigma$, whose top eigenvector $v \in R^d$ is $s$-sparse. Existing sparse PCA…

Machine Learning · Statistics 2026-03-04 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Peiyuan Zhang

This manuscript is concerned with relating two approaches that can be used to explore complex dependence structures between categorical variables, namely Bayesian partitioning of the covariate space incorporating a variable selection…

Methodology · Statistics 2016-01-06 Michail Papathomas , Sylvia Richardson

Canonical correlation analysis (CCA) has proven an effective tool for two-view dimension reduction due to its profound theoretical foundation and success in practical applications. In respect of multi-view learning, however, it is limited…

Machine Learning · Statistics 2015-02-10 Yong Luo , Dacheng Tao , Yonggang Wen , Kotagiri Ramamohanarao , Chao Xu

In this paper, we introduce Adaptive Cluster Lasso(ACL) method for variable selection in high dimensional sparse regression models with strongly correlated variables. To handle correlated variables, the concept of clustering or grouping…

Machine Learning · Statistics 2016-03-14 Niharika Gauraha , Swapan K. Parui

In genetic studies, not only can the number of predictors obtained from microarray measurements be extremely large, there can also be multiple response variables. Motivated by such a situation, we consider semiparametric dimension reduction…

Methodology · Statistics 2013-09-25 Heng Lian , Shujie Ma

It is well known that individual parameters of strongly correlated predictor variables in a linear model cannot be accurately estimated by the least squares regression due to multicollinearity generated by such variables. Surprisingly, an…

Statistics Theory · Mathematics 2022-10-04 Min Tsao

Factor analysis is a statistical technique that explains correlations among observed random variables with the help of a smaller number of unobserved factors. In traditional full factor analysis, each observed variable is influenced by…

Statistics Theory · Mathematics 2024-12-09 Mathias Drton , Alexandros Grosdos , Irem Portakal , Nils Sturma

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requires optimizing one or…

Machine Learning · Computer Science 2023-02-22 Leland Barnard , Farwa Ali , Hugo Botha , David T. Jones