English
Related papers

Related papers: Encoding Prior Knowledge with Eigenword Embeddings

200 papers

Recently proposed automatic pathological speech detection approaches rely on spectrogram input representations or wav2vec2 embeddings. These representations may contain pathology irrelevant uncorrelated information, such as changing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Yacouba Kaloga , Shakeel A. Sheikh , Ina Kodrasi

The classical Canonical Correlation Analysis (CCA) identifies the correlations between two sets of multivariate variables based on their covariance, which has been widely applied in diverse fields such as computer vision, natural language…

Optimization and Control · Mathematics 2024-01-02 Yongchun Li , Santanu S. Dey , Weijun Xie

Canonical Correlation Analysis (CCA) is a multivariate technique that takes two datasets and forms the most highly correlated possible pairs of linear combinations between them. Each subsequent pair of linear combinations is orthogonal to…

Methodology · Statistics 2015-12-22 Jacob Coleman , Joseph Replogle , Gabriel Chandler , Johanna Hardin

Knowledge Graphs are a widely used method to represent relations between entities in various AI applications, and Graph Embedding has rapidly become a standard technique to represent Knowledge Graphs in such a way as to facilitate…

Machine Learning · Computer Science 2023-11-02 Zhijin Guo , Zhaozhen Xu , Martha Lewis , Nello Cristianini

Canonical correlation analysis is a technique to extract common features from a pair of multivariate data. In complex situations, however, it does not extract useful features because of its linearity. On the other hand, kernel method used…

Machine Learning · Computer Science 2007-05-23 Shotaro Akaho

We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal…

Machine Learning · Statistics 2009-08-20 David R. Hardoon , John Shawe-Taylor

We propose using canonical correlation analysis (CCA) to generate features from sequences of medical billing codes. Applying this novel use of CCA to a database of medical billing codes for patients with diverticulitis, we first demonstrate…

Machine Learning · Statistics 2017-01-09 Corinne L. Jones , Sham M. Kakade , Lucas W. Thornblade , David R. Flum , Abraham D. Flaxman

This paper is concerned with the analysis of correlation between two high-dimensional data sets when there are only few correlated signal components but the number of samples is very small, possibly much smaller than the dimensions of the…

Information Theory · Computer Science 2016-04-08 Yang Song , Peter J. Schreier , David Ramirez , Tanuj Hasija

Modern vision pipelines increasingly rely on pretrained image encoders whose representations are reused across tasks and models, yet these representations are often overcomplete and model-specific. We propose a simple, training-free method…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dylan B. Lewis , Jens Gregor , Hector Santos-Villalobos

Canonical Correlation Analysis (CCA) is a widely used statistical tool with both well established theory and favorable performance for a wide range of machine learning problems. However, computing CCA for huge datasets can be very slow…

Machine Learning · Statistics 2014-12-31 Yichao Lu , Dean P. Foster

Canonical Correlation Analysis (CCA) is a widely used spectral technique for finding correlation structures in multi-view datasets. In this paper, we tackle the problem of large scale CCA, where classical algorithms, usually requiring…

Machine Learning · Statistics 2015-06-29 Zhuang Ma , Yichao Lu , Dean Foster

In this paper we address the problem of matching sets of vectors embedded in the same input space. We propose an approach which is motivated by canonical correlation analysis (CCA), a statistical technique which has proven successful in a…

Computer Vision and Pattern Recognition · Computer Science 2013-06-11 Ognjen Arandjelovic

Kernel canonical correlation analysis (KCCA) is a nonlinear multi-view representation learning technique with broad applicability in statistics and machine learning. Although there is a closed-form solution for the KCCA objective, it…

Machine Learning · Computer Science 2016-03-01 Weiran Wang , Karen Livescu

The availability of multi-modality datasets provides a unique opportunity to characterize the same object of interest using multiple viewpoints more comprehensively. In this work, we investigate the use of canonical correlation analysis…

Machine Learning · Computer Science 2024-10-28 Vaishnavi Subramanian , Tanveer Syeda-Mahmood , Minh N. Do

Unlabeled data is often used to learn representations which can be used to supplement baseline features in a supervised learner. For example, for text applications where the words lie in a very high dimensional space (the size of the…

Computation and Language · Computer Science 2012-07-03 Paramveer Dhillon , Jordan Rodu , Dean Foster , Lyle Ungar

In this paper, we formulate the Canonical Correlation Analysis (CCA) problem on matrix manifolds. This framework provides a natural way for dealing with matrix constraints and tools for building efficient algorithms even in an adaptive…

Machine Learning · Computer Science 2012-07-03 Florian Yger , Maxime Berar , Gilles Gasso , Alain Rakotomamonjy

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsupervised learning to…

Machine Learning · Computer Science 2021-06-09 Ofir Lindenbaum , Moshe Salhov , Amir Averbuch , Yuval Kluger

We describe a technique for structured prediction, based on canonical correlation analysis. Our learning algorithm finds two projections for the input and the output spaces that aim at projecting a given input and its correct output into…

Computation and Language · Computer Science 2017-11-21 Nikos Papasarantopoulos , Helen Jiang , Shay B. Cohen

This paper learns multi-modal embeddings from text, audio, and video views/modes of data in order to improve upon down-stream sentiment classification. The experimental framework also allows investigation of the relative contributions of…

Information Retrieval · Computer Science 2019-07-23 Zhongkai Sun , Prathusha K Sarma , William Sethares , Erik P. Bucy

Incorporating prior knowledge into a data-driven modeling problem can drastically improve performance, reliability, and generalization outside of the training sample. The stronger the structural properties, the more effective these…

Robotics · Computer Science 2023-11-20 Wooyoung Chung , Daniel Polani , Stas Tiomkin