English
Related papers

Related papers: Information Theory-Guided Heuristic Progressive Mu…

200 papers

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Multi-view clustering has received much attention recently. Most of the existing multi-view clustering methods only focus on one-sided clustering. As the co-occurring data elements involve the counts of sample-feature co-occurrences, it is…

Machine Learning · Computer Science 2019-05-28 Peng Xu , Zhaohong Deng , Kup-Sze Choi , Longbing Cao , Shitong Wang

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Multi-view image compression plays a critical role in 3D-related applications. Existing methods adopt a predictive coding architecture, which requires joint encoding to compress the corresponding disparity as well as residual information.…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Xinjie Zhang , Jiawei Shao , Jun Zhang

Contrastive learning has achieved promising performance in the field of multi-view clustering recently. However, the positive and negative sample construction mechanisms ignoring semantic consistency lead to false negative pairs, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Siwen Liu , Jinyan Liu , Hanning Yuan , Qi Li , Jing Geng , Ziqiang Yuan , Huaxu Han

Incomplete multi-view clustering (IMVC) is an unsupervised approach, among which IMVC via contrastive learning has received attention due to its excellent performance. The previous methods have the following problems: 1) Over-reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Kaiwu Zhang , Shiqiang Du , Baokai Liu , Shengxia Gao

Recently, contrastive learning (CL) plays an important role in exploring complementary information for multi-view clustering (MVC) and has attracted increasing attention. Nevertheless, real-world multi-view data suffer from data…

Machine Learning · Computer Science 2025-12-29 Hongqing He , Jie Xu , Wenyuan Yang , Yonghua Zhu , Guoqiu Wen , Xiaofeng Zhu

Contrastive learning between different views of the data achieves outstanding success in the field of self-supervised representation learning and the learned representations are useful in broad downstream tasks. Since all supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Haoqing Wang , Xun Guo , Zhi-Hong Deng , Yan Lu

Self-supervised learning based on instance discrimination has shown remarkable progress. In particular, contrastive learning, which regards each image as well as its augmentations as an individual class and tries to distinguish them from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haohang Xu , Xiaopeng Zhang , Hao Li , Lingxi Xie , Hongkai Xiong , Qi Tian

Existing multi-view image compression methods often rely on 2D projection-based similarities between views to estimate disparities. While effective for small disparities, such as those in stereo images, these methods struggle with the more…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yujun Huang , Bin Chen , Niu Lian , Baoyi An , Shu-Tao Xia

Hierarchical clustering recursively partitions data at an increasingly finer granularity. In real-world applications, multi-view data have become increasingly important. This raises a less investigated problem, i.e., multi-view hierarchical…

Machine Learning · Computer Science 2022-05-06 Fangfei Lin , Bing Bai , Kun Bai , Yazhou Ren , Peng Zhao , Zenglin Xu

Visual imagery does not consist of solitary objects, but instead reflects the composition of a multitude of fluid concepts. While there have been great advances in visual representation learning, such advances have focused on building…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Austin Stone , Hagen Soltau , Robert Geirhos , Xi Yi , Ye Xia , Bingyi Cao , Kaifeng Chen , Abhijit Ogale , Jonathon Shlens

Multimodal representation learning is commonly built on a shared-private decomposition, treating latent information as either common to all modalities or specific to one. This binary view is often inadequate: many factors are shared by only…

Machine Learning · Statistics 2026-04-08 Huichao Li , Junhan Yu , Doudou Zhou

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Although an object may appear in numerous contexts, we often describe it in a limited number of ways. Language allows us to abstract away visual variation to represent and communicate concepts. Building on this intuition, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Mohamed El Banani , Karan Desai , Justin Johnson

Multi-view clustering can explore common semantics from multiple views and has attracted increasing attention. However, existing works punish multiple objectives in the same feature space, where they ignore the conflict between learning…

Machine Learning · Computer Science 2022-03-28 Jie Xu , Huayi Tang , Yazhou Ren , Liang Peng , Xiaofeng Zhu , Lifang He

Multi-view (or -modality) representation learning aims to understand the relationships between different view representations. Existing methods disentangle multi-view representations into consistent and view-specific representations by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Guanzhou Ke , Yang Yu , Guoqing Chao , Xiaoli Wang , Chenyang Xu , Shengfeng He

3D contrastive representation learning has exhibited remarkable efficacy across various downstream tasks. However, existing contrastive learning paradigms based on cosine similarity fail to deeply explore the potential intra-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Naiwen Hu , Haozhe Cheng , Yifan Xie , Pengcheng Shi , Jihua Zhu

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

Machine Learning · Computer Science 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft