中文
相关论文

相关论文: Revisiting Self-Supervised Visual Representation L…

200 篇论文

Unsupervised representation learning for speech processing has matured greatly in the last few years. Work in computer vision and natural language processing has paved the way, but speech data offers unique challenges. As a result, methods…

音频与语音处理 · 电气工程与系统科学 2022-03-04 Lasse Borgholt , Jakob Drachmann Havtorn , Joakim Edin , Lars Maaløe , Christian Igel

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

计算机视觉与模式识别 · 计算机科学 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

Whilst computer vision models built using self-supervised approaches are now commonplace, some important questions remain. Do self-supervised models learn highly redundant channel features? What if a self-supervised network could…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Tarun Krishna , Ayush K. Rai , Yasser A. D. Djilali , Alan F. Smeaton , Kevin McGuinness , Noel E. O'Connor

Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation. This paper proposes a novel image augmentation technique, overlaying images,…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Yinheng Li , Han Ding , Shaofei Wang

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

计算机视觉与模式识别 · 计算机科学 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

Supervised learning of convolutional neural networks (CNNs) can require very large amounts of labeled data. Labeling thousands or millions of training examples can be extremely time consuming and costly. One direction towards addressing…

计算机视觉与模式识别 · 计算机科学 2017-07-27 Amir Ghaderi , Vassilis Athitsos

Self-supervised representation learning methods aim to provide powerful deep feature learning without the requirement of large annotated datasets, thus alleviating the annotation bottleneck that is one of the main barriers to practical…

机器学习 · 计算机科学 2022-05-18 Linus Ericsson , Henry Gouk , Chen Change Loy , Timothy M. Hospedales

Recent self-supervised video representation learning methods have found significant success by exploring essential properties of videos, e.g. speed, temporal order, etc. This work exploits an essential yet under-explored property of videos,…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Hanwen Liang , Niamul Quader , Zhixiang Chi , Lizhe Chen , Peng Dai , Juwei Lu , Yang Wang

Self-supervised learning is an effective way for label-free model pre-training, especially in the video domain where labeling is expensive. Existing self-supervised works in the video domain use varying experimental setups to demonstrate…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh Singh Rawat

The immense success of deep learning based methods in computer vision heavily relies on large scale training datasets. These richly annotated datasets help the network learn discriminative visual features. Collecting and annotating such…

计算机视觉与模式识别 · 计算机科学 2018-07-09 Yash Patel , Lluis Gomez , Raul Gomez , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Hyungtae Lee , Heesung Kwon

Self-supervision as an emerging technique has been employed to train convolutional neural networks (CNNs) for more transferrable, generalizable, and robust representation learning of images. Its introduction to graph convolutional networks…

机器学习 · 计算机科学 2020-07-21 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Multi-view clustering (MVC) has had significant implications in cross-modal representation learning and data-driven decision-making in recent years. It accomplishes this by leveraging the consistency and complementary information among…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Jiatai Wang , Zhiwei Xu , Xuewen Yang , Hailong Li , Bo Li , Xuying Meng

Self-supervised learning has emerged as a powerful paradigm for label-free model pretraining, particularly in the video domain, where manual annotation is costly and time-intensive. However, existing self-supervised approaches employ…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh S Rawat

As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning.…

机器学习 · 计算机科学 2021-03-24 Yao-Hung Hubert Tsai , Yue Wu , Ruslan Salakhutdinov , Louis-Philippe Morency

Self supervised representation learning has recently attracted a lot of research interest for both the audio and visual modalities. However, most works typically focus on a particular modality or feature alone and there has been very…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Abhinav Shukla , Konstantinos Vougioukas , Pingchuan Ma , Stavros Petridis , Maja Pantic

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

计算机视觉与模式识别 · 计算机科学 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer