English
Related papers

Related papers: Improved Baselines with Momentum Contrastive Learn…

200 papers

Recommender systems guide users through vast amounts of information by suggesting items based on their predicted preferences. Collaborative filtering-based deep learning techniques have regained popularity due to their straightforward…

Machine Learning · Computer Science 2024-09-11 Makbule Gulcin Ozsoy

Recent unsupervised contrastive representation learning follows a Single Instance Multi-view (SIM) paradigm where positive pairs are usually constructed with intra-image data augmentation. In this paper, we propose an effective approach…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xiangxiang Chu , Xiaohang Zhan , Bo Zhang

Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate the complementary…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Orchid Majumder , Avinash Ravichandran , Subhransu Maji , Alessandro Achille , Marzia Polito , Stefano Soatto

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Wenbin Li , Meihao Kong , Xuesong Yang , Lei Wang , Jing Huo , Yang Gao , Jiebo Luo

Multi-modal contrastive learning (MMCL) has recently garnered considerable interest due to its superior performance in visual tasks, achieved by embedding multi-modal data, such as visual-language pairs. However, there still lack…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Qi Zhang , Yifei Wang , Yisen Wang

Contrastive learning has been adopted as a core method for unsupervised visual representation learning. Without human annotation, the common practice is to perform an instance discrimination task: Given a query image crop, this task labels…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Chen Wei , Huiyu Wang , Wei Shen , Alan Yuille

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

We propose a webly-supervised representation learning method that does not suffer from the annotation unscalability of supervised learning, nor the computation unscalability of self-supervised learning. Most existing works on…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Junnan Li , Caiming Xiong , Steven C. H. Hoi

This work presents improvements in monocular hand shape estimation by building on top of recent advances in unsupervised learning. We extend momentum contrastive learning and contribute a structured collection of hand images, well suited…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Christian Zimmermann , Max Argus , Thomas Brox

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

Machine Learning · Computer Science 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on supervised learning and thus require vast amounts of training data. Due to their scarcity and minuscule…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Xiaochen Zheng

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Contrastive learning (CL) is one of the most successful paradigms for self-supervised learning (SSL). In a principled way, it considers two augmented "views" of the same image as positive to be pulled closer, and all other images as…

Machine Learning · Computer Science 2023-06-21 Chun-Hsiao Yeh , Cheng-Yao Hong , Yen-Chi Hsu , Tyng-Luh Liu , Yubei Chen , Yann LeCun

Language-supervised vision models have recently attracted great attention in computer vision. A common approach to build such models is to use contrastive learning on paired data across the two modalities, as exemplified by Contrastive…

Machine Learning · Computer Science 2023-03-16 Ryumei Nakada , Halil Ibrahim Gulluk , Zhun Deng , Wenlong Ji , James Zou , Linjun Zhang

Multimodal representation learning is a challenging task in which previous work mostly focus on either uni-modality pre-training or cross-modality fusion. In fact, we regard modeling multimodal representation as building a skyscraper, where…

Computation and Language · Computer Science 2024-08-15 Ronghao Lin , Haifeng Hu

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

Machine Learning · Computer Science 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Contrastive learning demonstrates great promise for representation learning. Data augmentations play a critical role in contrastive learning by providing informative views of the data without necessitating explicit labels. Nonetheless, the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Zihu Wang , Yu Wang , Zhuotong Chen , Hanbin Hu , Peng Li

Recently, multimodal contrastive learning (MMCL) approaches, such as CLIP, have achieved a remarkable success in learning representations that are robust against distribution shift and generalize to new domains. Despite the empirical…

Machine Learning · Computer Science 2024-03-19 Yihao Xue , Siddharth Joshi , Dang Nguyen , Baharan Mirzasoleiman