English
Related papers

Related papers: Scaling and Benchmarking Self-Supervised Visual Re…

200 papers

The remarkable success of deep learning in various domains relies on the availability of large-scale annotated datasets. However, obtaining annotations is expensive and requires great effort, which is especially challenging for videos.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Madeline C. Schiappa , Yogesh S. Rawat , Mubarak Shah

We present a novel self-taught framework for unsupervised metric learning, which alternates between predicting class-equivalence relations between data through a moving average of an embedding model and learning the model with the predicted…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

This paper presents a simple unsupervised visual representation learning method with a pretext task of discriminating all images in a dataset using a parametric, instance-level classifier. The overall framework is a replica of a supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Yu Liu , Lianghua Huang , Pan Pan , Bin Wang , Yinghui Xu , Rong Jin

Recently introduced self-supervised methods for image representation learning provide on par or superior results to their fully supervised competitors, yet the corresponding efforts to explain the self-supervised approaches lag behind.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Witold Oleszkiewicz , Dominika Basaj , Igor Sieradzki , Michał Górszczak , Barbara Rychalska , Koryna Lewandowska , Tomasz Trzciński , Bartosz Zieliński

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

3D object representation learning is a fundamental challenge in computer vision to infer about the 3D world. Recent advances in deep learning have shown their efficiency in 3D object recognition, among which view-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Xiang Gao , Wei Hu , Guo-Jun Qi

In self-supervised learning, one trains a model to solve a so-called pretext task on a dataset without the need for human annotation. The main objective, however, is to transfer this model to a target domain and task. Currently, the most…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Mehdi Noroozi , Ananth Vinjimoor , Paolo Favaro , Hamed Pirsiavash

Deep neural models have achieved state of the art performance on a wide range of problems in computer science, especially in computer vision. However, deep neural networks often require large datasets of labeled samples to generalize…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Patrick Kage , Jay C. Rothenberger , Pavlos Andreadis , Dimitrios I. Diochnos

Providing visual summaries of scientific publications can increase information access for readers and thereby help deal with the exponential growth in the number of scientific publications. Nonetheless, efforts in providing visual…

Information Retrieval · Computer Science 2021-01-15 Shintaro Yamamoto , Anne Lauscher , Simone Paolo Ponzetto , Goran Glavaš , Shigeo Morishima

Can we automatically group images into semantically meaningful clusters when ground-truth annotations are absent? The task of unsupervised image classification remains an important, and open challenge in computer vision. Several recent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Marc Proesmans , Luc Van Gool

Unsupervised visual representation learning offers the opportunity to leverage large corpora of unlabeled trajectories to form useful visual representations, which can benefit the training of reinforcement learning (RL) algorithms. However,…

Machine Learning · Computer Science 2024-06-04 Wancong Zhang , Anthony GX-Chen , Vlad Sobal , Yann LeCun , Nicolas Carion

Self-supervised contrastive learning has emerged as a powerful tool in machine learning and computer vision to learn meaningful representations from unlabeled data. Meanwhile, its empirical success has encouraged many theoretical studies to…

Machine Learning · Computer Science 2025-05-29 Jingyi Cui , Hongwei Wen , Yisen Wang

Although deep networks have significantly increased the performance of visual recognition methods, it is still challenging to achieve the robustness across visual domains that is necessary for real-world applications. To tackle this issue,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Antonio D'Innocente , Silvia Bucci , Barbara Caputo , Tatiana Tommasi

Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning recovers…

Instrumentation and Methods for Astrophysics · Physics 2022-06-30 Md Abul Hayat , George Stein , Peter Harrington , Zarija Lukić , Mustafa Mustafa

This paper proposes a novel method of learning by predicting view assignments with support samples (PAWS). The method trains a model to minimize a consistency loss, which ensures that different views of the same unlabeled instance are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Mahmoud Assran , Mathilde Caron , Ishan Misra , Piotr Bojanowski , Armand Joulin , Nicolas Ballas , Michael Rabbat

Supervised learning in large discriminative models is a mainstay for modern computer vision. Such an approach necessitates investing in large-scale human-annotated datasets for achieving state-of-the-art results. In turn, the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Liang-Chieh Chen , Raphael Gontijo Lopes , Bowen Cheng , Maxwell D. Collins , Ekin D. Cubuk , Barret Zoph , Hartwig Adam , Jonathon Shlens

Despite significant advances, the performance of state-of-the-art continual learning approaches hinges on the unrealistic scenario of fully labeled data. In this paper, we tackle this challenge and propose an approach for continual…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Zhiqi Kang , Enrico Fini , Moin Nabi , Elisa Ricci , Karteek Alahari

Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qin Wang , Kai Krajsek , Hanno Scharr

The need for labeled data is among the most common and well-known practical obstacles to deploying deep learning algorithms to solve real-world problems. The current generation of learning algorithms requires a large volume of data labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Aaron Reite , Scott Kangas , Zackery Steck , Steven Goley , Jonathan Von Stroh , Steven Forsyth

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto