English
Related papers

Related papers: Multiview Representation Learning for a Union of S…

200 papers

Classical canonical correlation analysis (CCA) requires matrices to be low dimensional, i.e. the number of features cannot exceed the sample size. Recent developments in CCA have mainly focused on the high-dimensional setting, where the…

Methodology · Statistics 2021-06-09 Wenjia Wang , Yi-Hui Zhou

In this work, we propose the joint linked component analysis (joint\_LCA) for multiview data. Unlike classic methods which extract the shared components in a sequential manner, the objective of joint\_LCA is to identify the view-specific…

Machine Learning · Statistics 2024-06-18 Lin Xiao , Luo Xiao

This paper studies high-dimensional canonical correlation analysis (CCA) with an emphasis on the vectors that define canonical variables. The paper shows that when two dimensions of data grow to infinity jointly and proportionally, the…

Econometrics · Economics 2025-01-24 Anna Bykhovskaya , Vadim Gorin

Many self-supervised speech models, varying in their pre-training objective, input modality, and pre-training data, have been proposed in the last few years. Despite impressive successes on downstream tasks, we still have a limited…

Computation and Language · Computer Science 2023-03-20 Ankita Pasad , Bowen Shi , Karen Livescu

A new approach to the sparse Canonical Correlation Analysis (sCCA)is proposed with the aim of discovering interpretable associations in very high-dimensional multi-view, i.e.observations of multiple sets of variables on the same subjects,…

Machine Learning · Statistics 2019-09-18 Omid S. Solari , James B. Brown , Peter J. Bickel

Many analyses of multivariate data focus on evaluating the dependence between two sets of variables, rather than the dependence among individual variables within each set. Canonical correlation analysis (CCA) is a classical data analysis…

Methodology · Statistics 2024-04-23 Jordan G. Bryan , Jonathan Niles-Weed , Peter D. Hoff

Sparse language vectors from linguistic typology databases and learned embeddings from tasks like multilingual machine translation have been investigated in isolation, without analysing how they could benefit from each other's language…

Computation and Language · Computer Science 2020-10-27 Arturo Oncevay , Barry Haddow , Alexandra Birch

We extend multi-way, multivariate ANOVA-type analysis to cases where one covariate is the view, with features of each view coming from different, high-dimensional domains. The different views are assumed to be connected by having paired…

Machine Learning · Statistics 2009-12-17 Ilkka Huopaniemi , Tommi Suvitaival , Janne Nikkilä , Matej Orešič , Samuel Kaski

Multi-view data are increasingly prevalent in practice. It is often relevant to analyze the relationships between pairs of views by multi-view component analysis techniques such as Canonical Correlation Analysis (CCA). However, data may…

Machine Learning · Statistics 2019-12-10 Eric Lei , Kyle Miller , Michael R. Pinsky , Artur Dubrawski

In high-dimensional settings, Canonical Correlation Analysis (CCA) often fails, and existing sparse methods force an untenable choice between computational speed and statistical rigor. This work introduces a fast and provably consistent…

Methodology · Statistics 2025-07-16 Zixuan Wu , Elena Tuzhilina , Claire Donnat

We consider the problem of sparse canonical correlation analysis (CCA), i.e., the search for two linear combinations, one for each multivariate, that yield maximum correlation using a specified number of variables. We propose an efficient…

Computation · Statistics 2008-01-18 Ami Wiesel , Mark Kliger , Alfred O. Hero

Canonical correlation analysis is a classical technique for exploring the relationship between two sets of variables. It has important applications in analyzing high dimensional datasets originated from genomics, imaging and other fields.…

Methodology · Statistics 2016-04-05 Chao Gao , Zongming Ma , Harrison H. Zhou

The Platonic Representation Hypothesis suggests that independently trained neural networks converge to increasingly similar latent spaces. However, current strategies for mapping these representations are inherently pairwise, scaling…

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

The canonical correlation analysis (CCA) is commonly used to analyze data sets with paired data, e.g. measurements of gene expression and metabolomic intensities of the same experiments. This allows to find interesting relationships between…

Data driven optimization and machine learning based performance diagnostics of radio access networks entails significant challenges arising not only from the nature of underlying data sources but also due to complex spatio-temporal…

Networking and Internet Architecture · Computer Science 2022-09-30 Furqan Ahmed , Muhammad Zeeshan Asghar , Jyri Hämäläinen

Multi-view action clustering leverages the complementary information from different camera views to enhance the clustering performance. Although existing approaches have achieved significant progress, they assume all camera views are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Xiaoqiang Yan , Yingtao Gan , Yiqiao Mao , Yangdong Ye , Hui Yu

We address the problem of integrating textual and visual information in vector space models for word meaning representation. We first present the Residual CCA (R-CCA) method, that complements the standard CCA method by representing, for…

Computation and Language · Computer Science 2016-10-05 Hagar Loeub , Roi Reichart

The availability of multi-modality datasets provides a unique opportunity to characterize the same object of interest using multiple viewpoints more comprehensively. In this work, we investigate the use of canonical correlation analysis…

Machine Learning · Computer Science 2024-10-28 Vaishnavi Subramanian , Tanveer Syeda-Mahmood , Minh N. Do

This paper learns multi-modal embeddings from text, audio, and video views/modes of data in order to improve upon down-stream sentiment classification. The experimental framework also allows investigation of the relative contributions of…

Information Retrieval · Computer Science 2019-07-23 Zhongkai Sun , Prathusha K Sarma , William Sethares , Erik P. Bucy