English
Related papers

Related papers: QK Iteration: A Self-Supervised Representation Lea…

200 papers

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.…

Information Retrieval · Computer Science 2024-03-13 Shipeng Song , Bin Liu , Fei Teng , Tianrui Li

Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Tom George Grigg , Dan Busbridge , Jason Ramapuram , Russ Webb

Self-supervised learning aims to learn good representations with unlabeled data. Recent works have shown that larger models benefit more from self-supervised learning than smaller models. As a result, the gap between supervised and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yuxuan Shu , Xiao Gu , Guang-Zhong Yang , Benny Lo

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Human perception is routinely assessing the similarity between images, both for decision making and creative thinking. But the underlying cognitive process is not really well understood yet, hence difficult to be mimicked by computer vision…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Olivier Risser-Maroix , Amine Marzouki , Hala Djeghim , Camille Kurtz , Nicolas Lomenie

Self-supervised learning algorithms (SSL) based on instance discrimination have shown promising results, performing competitively or even outperforming supervised learning counterparts in some downstream tasks. Such approaches employ data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Mohammad Alkhalefi , Georgios Leontidis , Mingjun Zhong

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

Machine Learning · Computer Science 2022-05-03 Ralph Peeters , Christian Bizer

Human skeleton point clouds are commonly used to automatically classify and predict the behaviour of others. In this paper, we use a contrastive self-supervised learning method, SimCLR, to learn representations that capture the semantics of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Nico Lingg , Miguel Sarabia , Luca Zappella , Barry-John Theobald

Contrastive learning has shown remarkable results in recent self-supervised approaches for visual representation. By learning to contrast positive pairs' representation from the corresponding negatives pairs, one can train good visual…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Sungnyun Kim , Gihun Lee , Sangmin Bae , Se-Young Yun

Contrastive learning is commonly applied to self-supervised learning, and has been shown to outperform traditional approaches such as the triplet loss and N-pair loss. However, the requirement of large batch sizes and memory banks has made…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Rishab Balasubramanian , Rupashree Dey , Kunal Rathore

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

The 2021 Image Similarity Challenge introduced a dataset to serve as a new benchmark to evaluate recent image copy detection methods. There were 200 participants to the competition. This paper presents a quantitative and qualitative…

Feature representation via self-supervised learning has reached remarkable success in image-level contrastive learning, which brings impressive performances on image classification tasks. While image-level feature representation mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Junwei Yang , Ke Zhang , Zhaolin Cui , Jinming Su , Junfeng Luo , Xiaolin Wei

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Recently, self-supervised methods show remarkable achievements in image-level representation learning. Nevertheless, their image-level self-supervisions lead the learned representation to sub-optimal for dense prediction tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Yunsung Lee , Teakgyu Hong , Han-Cheol Cho , Junbum Cha , Seungryong Kim

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke