English
Related papers

Related papers: Sparse Canonical Correlation Analysis via Concave …

200 papers

Canonical Correlation Analysis (CCA) has been widely applied to jointly embed multiple views of data in a maximally correlated latent space. However, the alignment between various data perspectives, which is required by traditional…

Machine Learning · Computer Science 2023-12-11 Biqian Cheng , Evangelos E. Papalexakis , Jia Chen

Canonical correlation analysis (CCA) is a technique for finding correlated sets of features between two datasets. In this paper, we propose a novel extension of CCA to the online, streaming data setting: Sliding Window Informative Canonical…

Machine Learning · Statistics 2026-05-12 Arvind Prasadan

Interpreting the internal reasoning of vision-language models is essential for deploying AI in safety-critical domains. Concept-based explainability provides a human-aligned lens by representing a model's behavior through semantically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ehud Gordon , Meir Yossef Levi , Guy Gilboa

Canonical Correlation Analysis (CCA) is a statistical technique used to extract common information from multiple data sources or views. It has been used in various representation learning problems, such as dimensionality reduction, word…

Machine Learning · Computer Science 2020-06-18 Benjamin Dutton

We propose a new technique, Singular Vector Canonical Correlation Analysis (SVCCA), a tool for quickly comparing two representations in a way that is both invariant to affine transform (allowing comparison between different layers and…

Machine Learning · Statistics 2017-11-09 Maithra Raghu , Justin Gilmer , Jason Yosinski , Jascha Sohl-Dickstein

We study the sample complexity of canonical correlation analysis (CCA), \ie, the number of samples needed to estimate the population canonical correlation and directions up to arbitrarily small error. With mild assumptions on the data…

Machine Learning · Computer Science 2019-10-22 Chao Gao , Dan Garber , Nathan Srebro , Jialei Wang , Weiran Wang

The Canonical Correlation Analysis (CCA) family of methods is foundational in multiview learning. Regularised linear CCA methods can be seen to generalise Partial Least Squares (PLS) and be unified with a Generalized Eigenvalue Problem…

Machine Learning · Computer Science 2024-05-02 James Chapman , Lennie Wells , Ana Lawry Aguila

Generalized correlation analysis (GCA) is concerned with uncovering linear relationships across multiple datasets. It generalizes canonical correlation analysis that is designed for two datasets. We study sparse GCA when there are…

Machine Learning · Statistics 2023-02-07 Sheng Gao , Zongming Ma

Integrative analyses of different high dimensional data types are becoming increasingly popular. Similarly, incorporating prior functional relationships among variables in data analysis has been a topic of increasing interest as it helps…

Methodology · Statistics 2016-06-09 Sandra E. Safo , Shuzhao Li , Qi Long

Canonical correlation analysis (CCA) is a powerful technique for discovering whether or not hidden sources are commonly present in two (or more) datasets. Its well-appreciated merits include dimensionality reduction, clustering,…

Machine Learning · Computer Science 2018-08-15 Jia Chen , Gang Wang , Yanning Shen , Georgios B. Giannakis

Since the beginning of the 21st century, the size, breadth, and granularity of data in biology and medicine has grown rapidly. In the example of neuroscience, studies with thousands of subjects are becoming more common, which provide…

Generalized Canonical Correlation Analysis (GCCA) is an important tool that finds numerous applications in data mining, machine learning, and artificial intelligence. It aims at finding `common' random variables that are strongly correlated…

Machine Learning · Computer Science 2021-05-19 Mikael Sørensen , Charilaos I. Kanatsoulis , Nicholas D. Sidiropoulos

This article critically assesses the utility of the classical statistical technique of Canonical Correlation Analysis (CCA) for studying spatial associations and proposes a new approach to enhance it. Unlike bivariate correlation analysis,…

Methodology · Statistics 2026-02-12 Zhenzhi Jiao , Angela Yao , Ran Tao , Jean-Claude Thill

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Principal Component Analysis (PCA) has been used to study the pathogenesis of diseases. To enhance the interpretability of classical PCA, various improved PCA methods have been proposed to date. Among these, a typical method is the…

Machine Learning · Computer Science 2019-05-29 Chun-Mei Feng , Yong Xu , Jin-Xing Liu , Ying-Lian Gao , Chun-Hou Zheng

Canonical correlation analysis is a family of multivariate statistical methods for the analysis of paired sets of variables. Since its proposition, canonical correlation analysis has for instance been extended to extract relations between…

Machine Learning · Computer Science 2017-11-08 Viivi Uurtio , João M. Monteiro , Jaz Kandola , John Shawe-Taylor , Delmiro Fernandez-Reyes , Juho Rousu

This paper is concerned with the analysis of correlation between two high-dimensional data sets when there are only few correlated signal components but the number of samples is very small, possibly much smaller than the dimensions of the…

Information Theory · Computer Science 2016-04-08 Yang Song , Peter J. Schreier , David Ramirez , Tanuj Hasija

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

In this paper we consider asymptotically exact support recovery in the context of high dimensional and sparse Canonical Correlation Analysis (CCA). Our main results describe four regimes of interest based on information theoretic and…

Statistics Theory · Mathematics 2022-10-12 Nilanjana Laha , Rajarshi Mukherjee