English
Related papers

Related papers: Revisiting Self-Supervised Visual Representation L…

200 papers

Unsupervised representation learning for speech processing has matured greatly in the last few years. Work in computer vision and natural language processing has paved the way, but speech data offers unique challenges. As a result, methods…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Lasse Borgholt , Jakob Drachmann Havtorn , Joakim Edin , Lars Maaløe , Christian Igel

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

Whilst computer vision models built using self-supervised approaches are now commonplace, some important questions remain. Do self-supervised models learn highly redundant channel features? What if a self-supervised network could…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Tarun Krishna , Ayush K. Rai , Yasser A. D. Djilali , Alan F. Smeaton , Kevin McGuinness , Noel E. O'Connor

Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation. This paper proposes a novel image augmentation technique, overlaying images,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Yinheng Li , Han Ding , Shaofei Wang

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

Supervised learning of convolutional neural networks (CNNs) can require very large amounts of labeled data. Labeling thousands or millions of training examples can be extremely time consuming and costly. One direction towards addressing…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Amir Ghaderi , Vassilis Athitsos

Self-supervised representation learning methods aim to provide powerful deep feature learning without the requirement of large annotated datasets, thus alleviating the annotation bottleneck that is one of the main barriers to practical…

Machine Learning · Computer Science 2022-05-18 Linus Ericsson , Henry Gouk , Chen Change Loy , Timothy M. Hospedales

Recent self-supervised video representation learning methods have found significant success by exploring essential properties of videos, e.g. speed, temporal order, etc. This work exploits an essential yet under-explored property of videos,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Hanwen Liang , Niamul Quader , Zhixiang Chi , Lizhe Chen , Peng Dai , Juwei Lu , Yang Wang

Self-supervised learning is an effective way for label-free model pre-training, especially in the video domain where labeling is expensive. Existing self-supervised works in the video domain use varying experimental setups to demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh Singh Rawat

The immense success of deep learning based methods in computer vision heavily relies on large scale training datasets. These richly annotated datasets help the network learn discriminative visual features. Collecting and annotating such…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Yash Patel , Lluis Gomez , Raul Gomez , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hyungtae Lee , Heesung Kwon

Self-supervision as an emerging technique has been employed to train convolutional neural networks (CNNs) for more transferrable, generalizable, and robust representation learning of images. Its introduction to graph convolutional networks…

Machine Learning · Computer Science 2020-07-21 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Multi-view clustering (MVC) has had significant implications in cross-modal representation learning and data-driven decision-making in recent years. It accomplishes this by leveraging the consistency and complementary information among…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Jiatai Wang , Zhiwei Xu , Xuewen Yang , Hailong Li , Bo Li , Xuying Meng

Self-supervised learning has emerged as a powerful paradigm for label-free model pretraining, particularly in the video domain, where manual annotation is costly and time-intensive. However, existing self-supervised approaches employ…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh S Rawat

As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning.…

Machine Learning · Computer Science 2021-03-24 Yao-Hung Hubert Tsai , Yue Wu , Ruslan Salakhutdinov , Louis-Philippe Morency

Self supervised representation learning has recently attracted a lot of research interest for both the audio and visual modalities. However, most works typically focus on a particular modality or feature alone and there has been very…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Abhinav Shukla , Konstantinos Vougioukas , Pingchuan Ma , Stavros Petridis , Maja Pantic

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer