English
Related papers

Related papers: Sparse canonical correlation analysis for multiple…

200 papers

Sensor technologies are becoming increasingly prevalent in the biomedical field, with applications ranging from telemonitoring of people at risk, to using sensor derived information as objective endpoints in clinical trials. To fully…

Machine Learning · Computer Science 2021-07-27 Narayan Schütz , Angela Botros , Michael Single , Aileen C. Naef , Philipp Buluschek , Tobias Nef

Classic and deep generalized canonical correlation analysis (GCCA) algorithms seek low-dimensional common representations of data entities from multiple ``views'' (e.g., audio and image) using linear transformations and neural networks,…

Machine Learning · Computer Science 2023-04-05 Sagar Shrestha , Xiao Fu

We propose Cooperative Component Analysis (CoCA), a new method for unsupervised multi-view analysis: it identifies the component that simultaneously captures significant within-view variance and exhibits strong cross-view correlation. The…

Methodology · Statistics 2024-07-25 Daisy Yi Ding , Alden Green , Min Woo Sun , Robert Tibshirani

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Linking between two data sources is a basic building block in numerous computer vision problems. In this paper, we set to answer a fundamental cognitive question: are prior correspondences necessary for linking between different domains?…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Yedid Hoshen , Lior Wolf

Finding overcomplete latent representations of data has applications in data analysis, signal processing, machine learning, theoretical neuroscience and many other fields. In an overcomplete representation, the number of latent features…

Machine Learning · Computer Science 2021-06-10 Jesse A. Livezey , Alejandro F. Bujan , Friedrich T. Sommer

This paper studies the convergence rate of a continuous-time dynamical system for L1-minimization, known as the Locally Competitive Algorithm (LCA). Solving L1-minimization} problems efficiently and rapidly is of great interest to the…

Dynamical Systems · Mathematics 2017-04-26 Aurèle Balavoine , Christopher J. Rozell , Justin Romberg

Incorporating prior knowledge into a data-driven modeling problem can drastically improve performance, reliability, and generalization outside of the training sample. The stronger the structural properties, the more effective these…

Robotics · Computer Science 2023-11-20 Wooyoung Chung , Daniel Polani , Stas Tiomkin

Deep CCA is a recently proposed deep neural network extension to the traditional canonical correlation analysis (CCA), and has been successful for multi-view representation learning in several domains. However, stochastic optimization of…

Machine Learning · Computer Science 2015-10-08 Weiran Wang , Raman Arora , Karen Livescu , Nathan Srebro

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Canonical correlation analysis (CCA) is a technique for finding correlations between different data modalities and learning low-dimensional representations. As fairness becomes crucial in machine learning, fair CCA has gained attention.…

Machine Learning · Computer Science 2025-10-02 Bojian Hou , Zhanliang Wang , Zhuoping Zhou , Boning Tong , Zexuan Wang , Jingxuan Bao , Duy Duong-Tran , Qi Long , Li Shen

In this paper we consider asymptotically exact support recovery in the context of high dimensional and sparse Canonical Correlation Analysis (CCA). Our main results describe four regimes of interest based on information theoretic and…

Statistics Theory · Mathematics 2022-10-12 Nilanjana Laha , Rajarshi Mukherjee

Numeric tabular datasets are the dominant data format in scientific practice, yet large language models lack native mechanisms for representing numeric datasets in a meaningful way across heterogeneous feature spaces. Existing approaches…

Machine Learning · Computer Science 2026-05-29 M. Ross Kunz , John Merickel , Keith Wilson

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

Computation · Statistics 2016-01-29 Qiaoya Zhang , Yiyuan She

Canonical correlation analysis (CCA) has been one of the most popular methods for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). Despite its efficiency, a potential problem is…

Machine Learning · Statistics 2014-01-17 Yu Zhang , Guoxu Zhou , Jing Jin , Xingyu Wang , Andrzej Cichocki

Repeated measurements are common in many fields, where random variables are observed repeatedly across different subjects. Such data have an underlying hierarchical structure, and it is of interest to learn covariance/correlation at…

Methodology · Statistics 2023-06-13 Sunpeng Duan , Guo Yu , Juntao Duan , Yuedong Wang

Finding relationships between multiple views of data is essential both for exploratory analysis and as pre-processing for predictive tasks. A prominent approach is to apply variants of Canonical Correlation Analysis (CCA), a classical…

Machine Learning · Statistics 2016-01-11 Ziyuan Lin , Jaakko Peltonen

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

Optimization and Control · Mathematics 2009-07-14 Zhaosong Lu , Yong Zhang

Comparing different neural network representations and determining how representations evolve over time remain challenging open questions in our understanding of the function of neural networks. Comparing representations in neural networks…

Machine Learning · Statistics 2018-10-25 Ari S. Morcos , Maithra Raghu , Samy Bengio

Scaling methods have long been utilized to simplify and cluster high-dimensional data. However, the general latent spaces across all predefined groups derived from these methods sometimes do not fall into researchers' interest regarding…

Social and Information Networks · Computer Science 2023-06-02 Takanori Fujiwara , Tzu-Ping Liu