English
Related papers

Related papers: Demystifying Contrastive Self-Supervised Learning:…

200 papers

Contrastive learning has been adopted as a core method for unsupervised visual representation learning. Without human annotation, the common practice is to perform an instance discrimination task: Given a query image crop, this task labels…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Chen Wei , Huiyu Wang , Wei Shen , Alan Yuille

Input space reconstruction is an attractive representation learning paradigm. Despite interpretability of the reconstruction and generation, we identify a misalignment between learning by reconstruction, and learning for perception. We show…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Randall Balestriero , Yann LeCun

This paper presents a framework for learning visual representations from unlabeled video demonstrations captured from multiple viewpoints. We show that these representations are applicable for imitating several robotic tasks, including pick…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 André Correia , Luís A. Alexandre

This work tackles the problem of semi-supervised learning of image classifiers. Our main insight is that the field of semi-supervised learning can benefit from the quickly advancing field of self-supervised visual representation learning.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Xiaohua Zhai , Avital Oliver , Alexander Kolesnikov , Lucas Beyer

Creating representations of shapes that are invari-ant to isometric or almost-isometric transforma-tions has long been an area of interest in shape anal-ysis, since enforcing invariance allows the learningof more effective and robust shape…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Jeffrey Gu , Serena Yeung

A key challenge in self-supervised video representation learning is how to effectively capture motion information besides context bias. While most existing works implicitly achieve this with video-specific pretext tasks (e.g., predicting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Lianghua Huang , Yu Liu , Bin Wang , Pan Pan , Yinghui Xu , Rong Jin

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representations are often…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sangwoo Mo , Hyunwoo Kang , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin

While visual imitation learning offers one of the most effective ways of learning from visual demonstrations, generalizing from them requires either hundreds of diverse demonstrations, task specific priors, or large, hard-to-train…

Robotics · Computer Science 2021-12-07 Jyothish Pari , Nur Muhammad Shafiullah , Sridhar Pandian Arunachalam , Lerrel Pinto

Contrastive self-supervised learning has gained attention for its ability to create high-quality representations from large unlabelled data sets. A key reason that these powerful features enable data-efficient learning of downstream tasks…

Machine Learning · Computer Science 2024-01-29 Calum Heggan , Tim Hospedales , Sam Budgett , Mehrdad Yaghoobi

Learning with complete or partial supervision is powerful but relies on ever-growing human annotation efforts. As a way to mitigate this serious problem, as well as to serve specific applications, unsupervised learning has emerged as an…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Huy V. Vo , Francis Bach , Minsu Cho , Kai Han , Yann LeCun , Patrick Perez , Jean Ponce

Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Tom George Grigg , Dan Busbridge , Jason Ramapuram , Russ Webb

Instance segmentation is an active topic in computer vision that is usually solved by using supervised learning approaches over very large datasets composed of object level masks. Obtaining such a dataset for any new domain can be very…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhenzhen Weng , Mehmet Giray Ogut , Shai Limonchik , Serena Yeung

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Self-supervised learning of deep neural networks has become a prevalent paradigm for learning representations that transfer to a variety of downstream tasks. Similar to proposed models of the ventral stream of biological vision, it is…

Machine Learning · Computer Science 2023-06-26 Kion Fallah , Alec Helbling , Kyle A. Johnsen , Christopher J. Rozell

Learning robust representations that allow to reliably establish relations between images is of paramount importance for virtually all of computer vision. Annotating the quadratic number of pairwise relations between training images is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Timo Milbich , Omair Ghori , Ferran Diego , Björn Ommer

The present phase of Machine Learning is characterized by supervised learning algorithms relying on large sets of labeled examples ($n \to \infty$). The next phase is likely to focus on algorithms capable of learning from very few labeled…

Computer Vision and Pattern Recognition · Computer Science 2014-03-12 Fabio Anselmi , Joel Z. Leibo , Lorenzo Rosasco , Jim Mutch , Andrea Tacchetti , Tomaso Poggio

Unsupervised visual representation learning remains a largely unsolved problem in computer vision research. Among a big body of recently proposed approaches for unsupervised learning of visual representations, a class of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Alexander Kolesnikov , Xiaohua Zhai , Lucas Beyer

Labeling videos at scale is impractical. Consequently, self-supervised visual representation learning is key for efficient video analysis. Recent success in learning image representations suggests contrastive learning is a promising…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nishant Rai , Ehsan Adeli , Kuan-Hui Lee , Adrien Gaidon , Juan Carlos Niebles

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Beril Besbinar , Pascal Frossard