English
Related papers

Related papers: Sparse Kernel Canonical Correlation Analysis via $…

200 papers

Incorporating prior knowledge into a data-driven modeling problem can drastically improve performance, reliability, and generalization outside of the training sample. The stronger the structural properties, the more effective these…

Robotics · Computer Science 2023-11-20 Wooyoung Chung , Daniel Polani , Stas Tiomkin

Canonical Correlation Analysis (CCA) has been exploited immensely for learning latent representations in various fields. This study takes a step further by demonstrating the potential of CCA in identifying Elementary Discourse Units(EDUs)…

Computation and Language · Computer Science 2025-05-30 Akanksha Mehndiratta , Krishna Asawa

Canonical Variate Analysis (CVA) is a multivariate statistical technique and a direct application of Linear Discriminant Analysis (LDA) that aims to find linear combinations of variables that best differentiate between groups in a dataset.…

Computation · Statistics 2025-09-23 Raeesa Ganey , Sugnet Lubbe

In genome-wide interaction studies, to detect gene-gene interactions, most methods are divided into two folds: single nucleotide polymorphisms (SNP) based and gene-based methods. Basically, the methods based on the gene are more effective…

Machine Learning · Statistics 2016-06-02 Md ashad Alam , Osamu Komori , Yu-Ping Wang

Canonical correlation analysis (CCA) is a state-of-the-art method for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems. Various extended methods have been developed, and…

Neurons and Cognition · Quantitative Biology 2018-07-03 Yangsong Zhang , Erwei Yin , Fali Li , Yu Zhang , Toshihisa Tanaka , Qibin Zhao , Yan Cui , Peng Xu , Dezhong Yao , Daqing Guo

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

Computation · Statistics 2016-01-29 Qiaoya Zhang , Yiyuan She

In this paper, we study the application of sparse principal component analysis (PCA) to clustering and feature selection problems. Sparse PCA seeks sparse factors, or linear combinations of the data variables, explaining a maximum amount of…

Artificial Intelligence · Computer Science 2008-10-08 Ronny Luss , Alexandre d'Aspremont

We propose using canonical correlation analysis (CCA) to generate features from sequences of medical billing codes. Applying this novel use of CCA to a database of medical billing codes for patients with diverticulitis, we first demonstrate…

Machine Learning · Statistics 2017-01-09 Corinne L. Jones , Sham M. Kakade , Lucas W. Thornblade , David R. Flum , Abraham D. Flaxman

Correspondence analysis (CA) is a multivariate statistical tool used to visualize and interpret data dependencies by finding maximally correlated embeddings of pairs of random variables. CA has found applications in fields ranging from…

Machine Learning · Computer Science 2020-07-01 Hsiang Hsu , Salman Salamatian , Flavio P. Calmon

We aim to analyze the relation between two random vectors that may potentially have both different number of attributes as well as realizations, and which may even not have a joint distribution. This problem arises in many practical…

Machine Learning · Statistics 2015-11-12 Hoang-Vu Nguyen , Jilles Vreeken

We present an efficient stochastic algorithm (RSG+) for canonical correlation analysis (CCA) using a reparametrization of the projection matrices. We show how this reparametrization (into structured matrices), simple in hindsight, directly…

Machine Learning · Computer Science 2021-06-15 Zihang Meng , Rudrasis Chakraborty , Vikas Singh

We consider a linear regression $y=X\beta+u$ where $X\in\mathbb{\mathbb{{R}}}^{n\times p}$, $p\gg n,$ and $\beta$ is $s$-sparse. Motivated by examples in financial and economic data, we consider the situation where $X$ has highly correlated…

Information Theory · Computer Science 2015-04-07 Behrooz Ghorbani , Ozgur Yilmaz

We consider asymptotically exact inference on the leading canonical correlation directions and strengths between two high dimensional vectors under sparsity restrictions. In this regard, our main contribution is the development of a loss…

Statistics Theory · Mathematics 2022-02-10 Nilanjana Laha , Nathan Huey , Brent Coull , Rajarshi Mukherjee

Principal component analysis (PCA) is one of the most widely used dimensionality reduction methods in scientific data analysis. In many applications, for additional interpretability, it is desirable for the factor loadings to be sparse,…

Optimization and Control · Mathematics 2017-12-05 Santanu S. Dey , Rahul Mazumder , Marco Molinaro , Guanyi Wang

There are a multitude of methods to perform multi-set correlated component analysis (MCCA), including some that require iterative solutions. The methods differ on the criterion they optimize and the constraints placed on the solutions. This…

Machine Learning · Statistics 2018-02-13 Lucas C Parra

Principal component analysis (PCA) is a widespread technique for data analysis that relies on the covariance-correlation matrix of the analyzed data. However to properly work with high-dimensional data, PCA poses severe mathematical…

Quantitative Methods · Quantitative Biology 2018-10-18 Luigi Leonardo Palese

Linking two data sources is a basic building block in numerous computer vision problems. Canonical Correlation Analysis (CCA) achieves this by utilizing a linear optimizer in order to maximize the correlation between the two views. Recent…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Aviv Eisenschtat , Lior Wolf

Comparing learned neural representations in neural networks is a challenging but important problem, which has been approached in different ways. The Centered Kernel Alignment (CKA) similarity metric, particularly its linear variant, has…

Machine Learning · Computer Science 2022-11-17 MohammadReza Davari , Stefan Horoi , Amine Natik , Guillaume Lajoie , Guy Wolf , Eugene Belilovsky

We present an analysis of the Locally Competitive Algorithm (LCA), a Hopfield-style neural network that efficiently solves sparse approximation problems (e.g., approximating a vector from a dictionary using just a few non-zero…

Dynamical Systems · Mathematics 2015-03-19 Aurèle Balavoine , Justin Romberg , Christopher J. Rozell