English
Related papers

Related papers: Boosting Contrastive Self-Supervised Learning with…

200 papers

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Unsupervised person re-identification (re-ID) aims at closing the performance gap to supervised methods. These methods build reliable relationship between data points while learning representations. However, we empirically show that the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Xuanyu He , Wei Zhang , Ran Song , Qian Zhang , Xiangyuan Lan , Lin Ma

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

Visual contrastive learning aims to learn representations by contrasting similar (positive) and dissimilar (negative) pairs of data samples. The design of these pairs significantly impacts representation quality, training efficiency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shasvat Desai , Debasmita Ghose , Deep Chakraborty

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhongchen Ma , Lisha Li , Qirong Mao , Songcan Chen

Contrastive learning predicts whether two images belong to the same category by training a model to make their feature representations as close or as far away as possible. In this paper, we rethink how to mine samples in contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Hengkui Dong , Xianzhong Long , Yun Li

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Negative sampling is a limiting factor w.r.t. the generalization of metric-learned neural networks. We show that uniform negative sampling provides little information about the class boundaries and thus propose three novel techniques for…

Machine Learning · Computer Science 2021-02-15 James O' Neill , Danushka Bollegala

Contrastive learning has shown remarkable results in recent self-supervised approaches for visual representation. By learning to contrast positive pairs' representation from the corresponding negatives pairs, one can train good visual…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Sungnyun Kim , Gihun Lee , Sangmin Bae , Se-Young Yun

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

Unpaired image-to-image translation aims to find a mapping between the source domain and the target domain. To alleviate the problem of the lack of supervised labels for the source images, cycle-consistency based methods have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Yupei Lin , Sen Zhang , Tianshui Chen , Yongyi Lu , Guangping Li , Yukai Shi

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Learning from large amounts of unsupervised data and a small amount of supervision is an important open problem in computer vision. We propose a new semi-supervised learning method, Semantic Positives via Pseudo-Labels (SemPPL), that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Matko Bošnjak , Pierre H. Richemond , Nenad Tomasev , Florian Strub , Jacob C. Walker , Felix Hill , Lars Holger Buesing , Razvan Pascanu , Charles Blundell , Jovana Mitrovic

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

Machine Learning · Computer Science 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee