English
Related papers

Related papers: CaCo: Both Positive and Negative Samples are Direc…

200 papers

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Contrastive learning is a powerful framework for learning self-supervised representations that generalize well to downstream supervised tasks. We show that multiple existing contrastive learning methods can be reinterpreted as learning…

Machine Learning · Computer Science 2023-02-16 Daniel D. Johnson , Ayoub El Hanchi , Chris J. Maddison

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Contrastive learning is a powerful technique to learn representations that are semantically distinctive and geometrically invariant. While most of the earlier approaches have demonstrated its effectiveness on single-modality learning tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anurag Jain , Yashaswi Verma

Asymmetric appearance between positive pair effectively reduces the risk of representation degradation in contrastive learning. However, there are still a mass of appearance similarities between positive pair constructed by the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Chengchao Shen , Jianzhong Chen , Shu Wang , Hulin Kuang , Jin Liu , Jianxin Wang

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

Machine Learning · Computer Science 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Unsupervised contrastive learning achieves great success in learning image representations with CNN. Unlike most recent methods that focused on improving accuracy of image classification, we present a novel contrastive learning approach,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Enze Xie , Jian Ding , Wenhai Wang , Xiaohang Zhan , Hang Xu , Peize Sun , Zhenguo Li , Ping Luo

Many contrastive representation learning methods learn a single global representation of an entire image. However, dense contrastive representation learning methods such as DenseCL (Wang et al., 2021) can learn better representations for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Berk Iskender , Zhenlin Xu , Simon Kornblith , En-Hung Chu , Maryam Khademi

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Self-supervised methods have shown tremendous success in the field of computer vision, including applications in remote sensing and medical imaging. Most popular contrastive-loss based methods like SimCLR, MoCo, MoCo-v2 use multiple views…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Umangi Jain , Alex Wilson , Varun Gulshan

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Current multimodal models leveraging contrastive learning often face limitations in developing fine-grained conceptual understanding. This is due to random negative samples during pretraining, causing almost exclusively very dissimilar…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Philipp J. Rösch , Norbert Oswald , Michaela Geierhos , Jindřich Libovický

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin