English
Related papers

Related papers: Subspace Perspective on Canonical Correlation Anal…

200 papers

In the era of big data, reducing data dimensionality is critical in many areas of science. Widely used Principal Component Analysis (PCA) addresses this problem by computing a low dimensional data embedding that maximally explain variance…

Machine Learning · Statistics 2017-02-24 Soheil Feizi , David Tse

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data. Both problems can be formulated as…

Machine Learning · Statistics 2019-03-28 Shixiang Chen , Shiqian Ma , Lingzhou Xue , Hui Zou

The availability of multi-modality datasets provides a unique opportunity to characterize the same object of interest using multiple viewpoints more comprehensively. In this work, we investigate the use of canonical correlation analysis…

Machine Learning · Computer Science 2024-10-28 Vaishnavi Subramanian , Tanveer Syeda-Mahmood , Minh N. Do

This paper considers the problem of canonical-correlation analysis (CCA) (Hotelling, 1936) and, more broadly, the generalized eigenvector problem for a pair of symmetric matrices. These are two fundamental problems in data analysis and…

Machine Learning · Computer Science 2016-05-30 Rong Ge , Chi Jin , Sham M. Kakade , Praneeth Netrapalli , Aaron Sidford

Interpreting the internal reasoning of vision-language models is essential for deploying AI in safety-critical domains. Concept-based explainability provides a human-aligned lens by representing a model's behavior through semantically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ehud Gordon , Meir Yossef Levi , Guy Gilboa

Given two data matrices $X$ and $Y$, sparse canonical correlation analysis (SCCA) is to seek two sparse canonical vectors $u$ and $v$ to maximize the correlation between $Xu$ and $Yv$. However, classical and sparse CCA models consider the…

Machine Learning · Computer Science 2017-10-16 Wenwen Min , Juan Liu , Shihua Zhang

Recently proposed automatic pathological speech detection approaches rely on spectrogram input representations or wav2vec2 embeddings. These representations may contain pathology irrelevant uncorrelated information, such as changing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Yacouba Kaloga , Shakeel A. Sheikh , Ina Kodrasi

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first…

Machine Learning · Statistics 2017-05-19 Xianghui Luo , Robert J. Durrant

In this paper we address the problem of matching sets of vectors embedded in the same input space. We propose an approach which is motivated by canonical correlation analysis (CCA), a statistical technique which has proven successful in a…

Computer Vision and Pattern Recognition · Computer Science 2013-06-11 Ognjen Arandjelovic

The first order behavior of multivariate heavy-tailed random vectors above large radial thresholds is ruled by a limit measure in a regular variation framework. For a high dimensional vector, a reasonable assumption is that the support of…

Statistics Theory · Mathematics 2019-06-27 Holger Drees , Anne Sabourin

For multiple multivariate data sets, we derive conditions under which Generalized Canonical Correlation Analysis (GCCA) improves classification performance of the projected datasets, compared to standard Canonical Correlation Analysis (CCA)…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Ming Sun , Minh Tang , Carey E. Priebe

Canonical Correlation Analysis (CCA) has been exploited immensely for learning latent representations in various fields. This study takes a step further by demonstrating the potential of CCA in identifying Elementary Discourse Units(EDUs)…

Computation and Language · Computer Science 2025-05-30 Akanksha Mehndiratta , Krishna Asawa

Linking two data sources is a basic building block in numerous computer vision problems. Canonical Correlation Analysis (CCA) achieves this by utilizing a linear optimizer in order to maximize the correlation between the two views. Recent…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Aviv Eisenschtat , Lior Wolf

This paper considers canonical correlation analysis for two longitudinal variables that are possibly sampled at different time resolutions with irregular grids. We modeled trajectories of the multivariate variables using random effects and…

Applications · Statistics 2023-02-03 Seonjoo Lee , Jongwoo Choi , Zhiqian Fang , F. DuBois Bowman

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

Principal component analysis (PCA) has been widely applied to dimensionality reduction and data pre-processing for different applications in engineering, biology and social science. Classical PCA and its variants seek for linear projections…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Feiping Nie , Yi Yang , Heng Huang

Cross-modality retrieval encompasses retrieval tasks where the fetched items are of a different type than the search query, e.g., retrieving pictures relevant to a given text query. The state-of-the-art approach to cross-modality retrieval…

Information Retrieval · Computer Science 2018-04-17 Matthias Dorfer , Jan Schlüter , Andreu Vall , Filip Korzeniowski , Gerhard Widmer

Motivation: Biomedical studies increasingly produce multi-view high-dimensional datasets (e.g., multi-omics) that demand integrative analysis. Existing canonical correlation analysis (CCA) and generalized CCA methods address at most two of…

Machine Learning · Statistics 2025-02-27 Rong Wu , Ziqi Chen , Gen Li , Hai Shu

Classic and deep generalized canonical correlation analysis (GCCA) algorithms seek low-dimensional common representations of data entities from multiple ``views'' (e.g., audio and image) using linear transformations and neural networks,…

Machine Learning · Computer Science 2023-04-05 Sagar Shrestha , Xiao Fu