English
Related papers

Related papers: Stochastic Approximation for Canonical Correlation…

200 papers

Random features approach has been widely used for kernel approximation in large-scale machine learning. A number of recent studies have explored data-dependent sampling of features, modifying the stochastic oracle from which random features…

Machine Learning · Computer Science 2021-11-03 Yinsong Wang , Shahin Shahrampour

Classical canonical correlation analysis (CCA) requires matrices to be low dimensional, i.e. the number of features cannot exceed the sample size. Recent developments in CCA have mainly focused on the high-dimensional setting, where the…

Methodology · Statistics 2021-06-09 Wenjia Wang , Yi-Hui Zhou

Canonical Correlation Analysis (CCA) is a linear representation learning method that seeks maximally correlated variables in multi-view data. Non-linear CCA extends this notion to a broader family of transformations, which are more powerful…

Machine Learning · Computer Science 2020-02-11 Amichai Painsky , Meir Feder , Naftali Tishby

This paper investigates fairness and bias in Canonical Correlation Analysis (CCA), a widely used statistical technique for examining the relationship between two sets of variables. We present a framework that alleviates unfairness by…

Machine Learning · Computer Science 2023-09-28 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Boning Tong , Jia Xu , Yanbo Feng , Qi Long , Li Shen

Regularized generalized canonical correlation analysis (RGCCA) is a generalization of regularized canonical correlation analysis to three or more sets of variables, which is a component-based approach aiming to study the relationships…

Statistics Theory · Mathematics 2025-03-21 Kuo-Yue Li , Qi-Ye Zhang , Yong-Han Sun

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

Computation · Statistics 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

Tensor canonical correlation analysis (TCCA) has garnered significant attention due to its effectiveness in capturing high-order correlations in multi-view learning. However, existing TCCA methods often underemphasize the characterization…

Optimization and Control · Mathematics 2025-12-10 Yanjiao Zhu , Wanquan Liu , Xianchao Xiu , Jianqin Sun

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Many analyses of multivariate data focus on evaluating the dependence between two sets of variables, rather than the dependence among individual variables within each set. Canonical correlation analysis (CCA) is a classical data analysis…

Methodology · Statistics 2024-04-23 Jordan G. Bryan , Jonathan Niles-Weed , Peter D. Hoff

Deep CCA is a recently proposed deep neural network extension to the traditional canonical correlation analysis (CCA), and has been successful for multi-view representation learning in several domains. However, stochastic optimization of…

Machine Learning · Computer Science 2015-10-08 Weiran Wang , Raman Arora , Karen Livescu , Nathan Srebro

Recent advances in citation recommendation have improved accuracy by leveraging multi-view representation learning to integrate the various modalities present in scholarly documents. However, effectively combining multiple data views…

Information Retrieval · Computer Science 2025-07-24 Conor McNamara , Effirul Ramlan

Motivated by penalized likelihood maximization in complex models, we study optimization problems where neither the function to optimize nor its gradient have an explicit expression, but its gradient can be approximated by a Monte Carlo…

Computation · Statistics 2017-09-28 Gersende Fort , Edouard Ollier , Adeline Samson

Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them. Several variants of CCA have been introduced in the literature, in particular, variants based…

Machine Learning · Computer Science 2022-03-25 Tomer Friedlander , Lior Wolf

Canonical correlation analysis is a statistical technique that is used to find relations between two sets of variables. An important extension in pattern analysis is to consider more than two sets of variables. This problem can be expressed…

Machine Learning · Computer Science 2013-02-06 Jan Rupnik , Primoz Skraba , John Shawe-Taylor , Sabrina Guettes

In classical canonical correlation analysis (CCA), the goal is to determine the linear transformations of two random vectors into two new random variables that are most strongly correlated. Canonical variables are pairs of these new random…

Methodology · Statistics 2025-10-24 Tomasz Górecki , Mirosław Krzyśko , Felix Gnettner , Piotr Kokoszka

We present RandomizedCCA, a randomized algorithm for computing canonical analysis, suitable for large datasets stored either out of core or on a distributed file system. Accurate results can be obtained in as few as two data passes, which…

Machine Learning · Statistics 2014-11-14 Paul Mineiro , Nikos Karampatziakis

In clinical and biomedical research, multiple high-dimensional datasets are nowadays routinely collected from omics and imaging devices. Multivariate methods, such as Canonical Correlation Analysis (CCA), integrate two (or more) datasets to…

Methodology · Statistics 2025-03-20 Nuria Senar , Mark van de Wiel , Aeilko Zwinderman , Michel Hof

This paper considers the problem of canonical-correlation analysis (CCA) (Hotelling, 1936) and, more broadly, the generalized eigenvector problem for a pair of symmetric matrices. These are two fundamental problems in data analysis and…

Machine Learning · Computer Science 2016-05-30 Rong Ge , Chi Jin , Sham M. Kakade , Praneeth Netrapalli , Aaron Sidford

This paper studies high-dimensional canonical correlation analysis (CCA) with an emphasis on the vectors that define canonical variables. The paper shows that when two dimensions of data grow to infinity jointly and proportionally, the…

Econometrics · Economics 2025-01-24 Anna Bykhovskaya , Vadim Gorin

Combining the predictions of multiple trained models through ensembling is generally a good way to improve accuracy by leveraging the different learned features of the models, however it comes with high computational and storage costs.…

Machine Learning · Computer Science 2024-07-09 Stefan Horoi , Albert Manuel Orozco Camacho , Eugene Belilovsky , Guy Wolf