English
Related papers

Related papers: ORCCA: Optimal Randomized Canonical Correlation An…

200 papers

Random features is one of the most popular techniques to speed up kernel methods in large-scale problems. Related works have been recognized by the NeurIPS Test-of-Time award in 2017 and the ICML Best Paper Finalist in 2019. The body of…

Machine Learning · Statistics 2021-07-13 Fanghui Liu , Xiaolin Huang , Yudong Chen , Johan A. K. Suykens

In classical canonical correlation analysis (CCA), the goal is to determine the linear transformations of two random vectors into two new random variables that are most strongly correlated. Canonical variables are pairs of these new random…

Methodology · Statistics 2025-10-24 Tomasz Górecki , Mirosław Krzyśko , Felix Gnettner , Piotr Kokoszka

Canonical Correlation Analysis (CCA) is a widely used statistical tool with both well established theory and favorable performance for a wide range of machine learning problems. However, computing CCA for huge datasets can be very slow…

Machine Learning · Statistics 2014-12-31 Yichao Lu , Dean P. Foster

A novel feature selection model via orthogonal canonical correlation analysis with the $(2,1)$-norm regularization is proposed, and the model is solved by a practical NEPv approach (nonlinear eigenvalue problem with eigenvector dependency),…

Numerical Analysis · Mathematics 2025-02-27 Li Wang , Lei-Hong Zhang , Ren-Cang Li

We investigate the application of randomized quasi-Monte Carlo (RQMC) methods in random feature approximations for kernel-based learning. Compared to the classical Monte Carlo (MC) approach \citep{rahimi2007random}, RQMC improves the…

Methodology · Statistics 2025-09-09 Yian Huang , Zhen Huang

Canonical correlation analysis (CCA) is a standard tool for studying associations between two data sources; however, it is not designed for data with count or proportion measurement types. In addition, while CCA uncovers common signals, it…

Computation · Statistics 2022-08-02 Dongbang Yuan , Yunfeng Zhang , Shuai Guo , Wenyi Wang , Irina Gaynanova

Canonical correlation analysis is a technique to extract common features from a pair of multivariate data. In complex situations, however, it does not extract useful features because of its linearity. On the other hand, kernel method used…

Machine Learning · Computer Science 2007-05-23 Shotaro Akaho

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

Quantitative Methods · Quantitative Biology 2014-01-24 Samuel M. Gross , Robert Tibshirani

We study the problem of acoustic feature learning in the setting where we have access to another (non-acoustic) modality for feature learning but not at test time. We use deep variational canonical correlation analysis (VCCA), a recently…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Qingming Tang , Weiran Wang , Karen Livescu

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Recent advances in citation recommendation have improved accuracy by leveraging multi-view representation learning to integrate the various modalities present in scholarly documents. However, effectively combining multiple data views…

Information Retrieval · Computer Science 2025-07-24 Conor McNamara , Effirul Ramlan

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

Machine Learning · Statistics 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

Canonical Correlation Analysis (CCA) is a widespread technique for discovering linear relationships between two sets of variables $X \in \mathbb{R}^{n \times p}$ and $Y \in \mathbb{R}^{n \times q}$. In high dimensions however, standard…

Methodology · Statistics 2024-05-31 Claire Donnat , Elena Tuzhilina

The classical Canonical Correlation Analysis (CCA) identifies the correlations between two sets of multivariate variables based on their covariance, which has been widely applied in diverse fields such as computer vision, natural language…

Optimization and Control · Mathematics 2024-01-02 Yongchun Li , Santanu S. Dey , Weijun Xie

We present RandomizedCCA, a randomized algorithm for computing canonical analysis, suitable for large datasets stored either out of core or on a distributed file system. Accurate results can be obtained in as few as two data passes, which…

Machine Learning · Statistics 2014-11-14 Paul Mineiro , Nikos Karampatziakis

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Generalized Canonical Correlation Analysis (GCCA) is an important tool that finds numerous applications in data mining, machine learning, and artificial intelligence. It aims at finding `common' random variables that are strongly correlated…

Machine Learning · Computer Science 2021-05-19 Mikael Sørensen , Charilaos I. Kanatsoulis , Nicholas D. Sidiropoulos

Canonical correlation analysis (CCA) is a fundamental statistical tool for exploring the correlation structure between two sets of random variables. In this paper, motivated by recent success of applying CCA to learn low dimensional…

Statistics Theory · Mathematics 2018-01-23 Zhuang Ma , Xiaodong Li

The accuracy of Optical Character Recognition (OCR) is crucial to the success of subsequent applications used in text analyzing pipeline. Recent models of OCR post-processing significantly improve the quality of OCR-generated text, but are…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Jie Mei , Aminul Islam , Yajing Wu , Abidalrahman Moh'd , Evangelos E. Milios

Canonical correlation analysis (CCA) is a technique for finding correlations between different data modalities and learning low-dimensional representations. As fairness becomes crucial in machine learning, fair CCA has gained attention.…

Machine Learning · Computer Science 2025-10-02 Bojian Hou , Zhanliang Wang , Zhuoping Zhou , Boning Tong , Zexuan Wang , Jingxuan Bao , Duy Duong-Tran , Qi Long , Li Shen