English
Related papers

Related papers: Linking Image and Text with 2-Way Nets

200 papers

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Xuefei Zhe , Shifeng Chen , Hong Yan

Canonical correlation analysis (CCA) is a technique for measuring the association between two multivariate data matrices. A regularized modification of canonical correlation analysis (RCCA) which imposes an $\ell_2$ penalty on the CCA…

Methodology · Statistics 2021-07-30 Elena Tuzhilina , Leonardo Tozzi , Trevor Hastie

We introduce a conceptually simple yet effective model for self-supervised representation learning with graph data. It follows the previous methods that generate two views of an input graph through data augmentation. However, unlike…

Machine Learning · Computer Science 2021-10-29 Hengrui Zhang , Qitian Wu , Junchi Yan , David Wipf , Philip S. Yu

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive…

Machine Learning · Statistics 2012-09-18 Ming Sun , Carey E. Priebe , Minh Tang

Canonical correlation analysis (CCA) is a technique for finding correlations between different data modalities and learning low-dimensional representations. As fairness becomes crucial in machine learning, fair CCA has gained attention.…

Machine Learning · Computer Science 2025-10-02 Bojian Hou , Zhanliang Wang , Zhuoping Zhou , Boning Tong , Zexuan Wang , Jingxuan Bao , Duy Duong-Tran , Qi Long , Li Shen

In this paper, we propose a deep probabilistic multi-view model that is composed of a linear multi-view layer based on probabilistic canonical correlation analysis (CCA) description in the latent space together with deep generative networks…

Machine Learning · Computer Science 2020-03-10 Mahdi Karami , Dale Schuurmans

Incorporating prior knowledge into a data-driven modeling problem can drastically improve performance, reliability, and generalization outside of the training sample. The stronger the structural properties, the more effective these…

Robotics · Computer Science 2023-11-20 Wooyoung Chung , Daniel Polani , Stas Tiomkin

The classical Canonical Correlation Analysis (CCA) identifies the correlations between two sets of multivariate variables based on their covariance, which has been widely applied in diverse fields such as computer vision, natural language…

Optimization and Control · Mathematics 2024-01-02 Yongchun Li , Santanu S. Dey , Weijun Xie

In this paper, we are committed to designing a high-performance network for two-view geometry. We first propose a Guided Loss and theoretically establish the direct negative correlation between the loss and Fn-measure by dynamically…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Zhi Chen , Fan Yang , Wenbing Tao

We present Deep Generalized Canonical Correlation Analysis (DGCCA) -- a method for learning nonlinear transformations of arbitrarily many views of data, such that the resulting transformations are maximally informative of each other. While…

Machine Learning · Computer Science 2017-06-16 Adrian Benton , Huda Khayrallah , Biman Gujral , Dee Ann Reisinger , Sheng Zhang , Raman Arora

In many modern computer application problems, the classification of image data plays an important role. Among many different supervised machine learning models, convolutional neural networks (CNNs) and linear discriminant analysis (LDA) as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Axel Klawonn , Martin Lanser , Janine Weber

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chong Liu , Yuqi Zhang , Hongsong Wang , Weihua Chen , Fan Wang , Yan Huang , Yi-Dong Shen , Liang Wang

Connected component analysis (CCA) has been heavily used to label binary images and classify segments. However, it has not been well-exploited to segment multi-valued natural images. This work proposes a novel multi-value segmentation…

Computer Vision and Pattern Recognition · Computer Science 2014-02-12 Dibyendu Mukherjee

Blind source separation (BSS) is one of the most important and established research topics in signal processing and many algorithms have been proposed based on different statistical properties of the source signals. For second-order…

Numerical Analysis · Mathematics 2014-03-11 Wei Liu

We present a deep learning approach for learning the joint semantic embeddings of images and captions in a Euclidean space, such that the semantic similarity is approximated by the L2 distances in the embedding space. For that, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Noam Malali , Yosi Keller

We investigate the identifiability of nonlinear Canonical Correlation Analysis (CCA) in a multi-view setup, where each view is generated by an unknown nonlinear map applied to a linear mixture of shared latents and view-private noise.…

Machine Learning · Computer Science 2026-03-02 Zhiwei Han , Stefan Matthes , Hao Shen

We consider learning representations (features) in the setting in which we have access to multiple unlabeled views of the data for learning while only one view is available for downstream tasks. Previous work on this problem has proposed…

Machine Learning · Computer Science 2016-02-03 Weiran Wang , Raman Arora , Karen Livescu , Jeff Bilmes

Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers…

Machine Learning · Computer Science 2012-06-22 Sivaraman Balakrishnan , Kriti Puniyani , John Lafferty

Correspondence analysis (CA) is a multivariate statistical tool used to visualize and interpret data dependencies. CA has found applications in fields ranging from epidemiology to social sciences. However, current methods used to perform CA…

Machine Learning · Statistics 2019-02-22 Hsiang Hsu , Salman Salamatian , Flavio P. Calmon

This paper investigates fairness and bias in Canonical Correlation Analysis (CCA), a widely used statistical technique for examining the relationship between two sets of variables. We present a framework that alleviates unfairness by…

Machine Learning · Computer Science 2023-09-28 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Boning Tong , Jia Xu , Yanbo Feng , Qi Long , Li Shen