English
Related papers

Related papers: Collapse-Proof Non-Contrastive Self-Supervised Lea…

200 papers

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

The {\em stop gradient} and {\em exponential moving average} iterative procedures are commonly used in non-contrastive approaches to self-supervised learning to avoid representation collapse, with excellent performance in downstream…

Machine Learning · Computer Science 2026-02-06 Jean Ponce , Basile Terver , Martial Hebert , Michael Arbel

We study the discriminative probabilistic modeling on a continuous domain for the data prediction task of (multimodal) self-supervised representation learning. To address the challenge of computing the integral in the partition function for…

Machine Learning · Computer Science 2025-03-06 Bokun Wang , Yunwen Lei , Yiming Ying , Tianbao Yang

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

Machine Learning · Statistics 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pedro O. Pinheiro , Amjad Almahairi , Ryan Y. Benmalek , Florian Golemo , Aaron Courville

Recently, clustering with deep network framework has attracted attention of several researchers in the computer vision community. Deep framework gains extensive attention due to its efficiency and scalability towards large-scale and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jayasree Saha , Jayanta Mukhopadhyay

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

We introduce in this paper a new statistical perspective, exploiting the Jaccard similarity metric, as a measure-based metric to effectively invoke non-linear features in the loss of self-supervised contrastive learning. Specifically, our…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Bo Jiang , Hamid Krim , Tianfu Wu , Derya Cansever

Learning self-supervised representations using reconstruction or contrastive losses improves performance and sample complexity of image-based and multimodal reinforcement learning (RL). Here, different self-supervised loss functions have…

Machine Learning · Computer Science 2024-06-27 Philipp Becker , Sebastian Mossburger , Fabian Otto , Gerhard Neumann

In this paper, we propose a recurrent framework for Joint Unsupervised LEarning (JULE) of deep representations and image clusters. In our framework, successive operations in a clustering algorithm are expressed as steps in a recurrent…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Jianwei Yang , Devi Parikh , Dhruv Batra

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

Existing self-supervised learning methods learn representation by means of pretext tasks which are either (1) discriminating that explicitly specify which features should be separated or (2) aligning that precisely indicate which features…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Anjan Dutta , Massimiliano Mancini , Zeynep Akata

Current research in Computer Vision has shown that Convolutional Neural Networks (CNN) give state-of-the-art performance in many classification tasks and Computer Vision problems. The embedding of CNN, which is the internal representation…

Computer Vision and Pattern Recognition · Computer Science 2015-08-04 Axel Angel

This paper proposes a novel deep subspace clustering approach which uses convolutional autoencoders to transform input images into new representations lying on a union of linear subspaces. The first contribution of our work is to insert…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Mohsen Kheirandishfard , Fariba Zohrizadeh , Farhad Kamangar

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

Supervised learning of convolutional neural networks (CNNs) can require very large amounts of labeled data. Labeling thousands or millions of training examples can be extremely time consuming and costly. One direction towards addressing…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Amir Ghaderi , Vassilis Athitsos

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

This paper proposes an unsupervised method for learning a unified representation that serves both discriminative and generative purposes. While most existing unsupervised learning approaches focus on a representation for only one of these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shengbang Tong , Xili Dai , Yubei Chen , Mingyang Li , Zengyi Li , Brent Yi , Yann LeCun , Yi Ma

The ability to predict future states of the environment is a central pillar of intelligence. At its core, effective prediction requires an internal model of the world and an understanding of the rules by which the world changes. Here, we…

Machine Learning · Computer Science 2016-01-21 William Lotter , Gabriel Kreiman , David Cox