English
Related papers

Related papers: Unsupervised Representation Learning by Predicting…

200 papers

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

Learning features from massive unlabelled data is a vast prevalent topic for high-level tasks in many machine learning applications. The recent great improvements on benchmark data sets achieved by increasingly complex unsupervised learning…

Neural and Evolutionary Computing · Computer Science 2015-09-29 Wentao Zhu , Jun Miao , Laiyun Qing , Xilin Chen

In visual recognition tasks, such as image classification, unsupervised learning exploits cheap unlabeled data and can help to solve these tasks more efficiently. We show that the recursive autoconvolution operator, adopted from physics,…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Boris Knyazev , Erhardt Barth , Thomas Martinetz

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Unsupervised pre-training was a critical technique for training deep neural networks years ago. With sufficient labeled data and modern training techniques, it is possible to train very deep neural networks from scratch in a purely…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Jianfeng Dong , Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

The success of deep neural networks generally requires a vast amount of training data to be labeled, which is expensive and unfeasible in scale, especially for video collections. To alleviate this problem, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Longlong Jing , Xiaodong Yang , Jingen Liu , Yingli Tian

We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Gary B Huang , Huei-Fang Yang , Shin-ya Takemura , Pat Rivlin , Stephen M Plaza

In this paper, we present a technique for unsupervised learning of visual representations. Specifically, we train a model for foreground and background classification task, in the process of which it learns visual representations.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-04 Aditya Vora

Traditionally, training neural networks to perform semantic segmentation required expensive human-made annotations. But more recently, advances in the field of unsupervised learning have made significant progress on this issue and towards…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski

Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Xi Li , Huimin Ma , Hongbing Ma , Yidong Wang

A feature learning task involves training models that are capable of inferring good representations (transformations of the original space) from input data alone. When working with limited or unlabelled data, and also when multiple visual…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Gabriel B. Cavallari , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

In this paper, we present an approach for learning a visual representation from the raw spatiotemporal signals in videos. Our representation is learned without supervision from semantic labels. We formulate our method as an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Ishan Misra , C. Lawrence Zitnick , Martial Hebert

Deep learning methods are successfully used in applications pertaining to ubiquitous computing, health, and well-being. Specifically, the area of human activity recognition (HAR) is primarily transformed by the convolutional and recurrent…

Machine Learning · Computer Science 2019-07-30 Aaqib Saeed , Tanir Ozcelebi , Johan Lukkien

Learning visual representations with self-supervised learning has become popular in computer vision. The idea is to design auxiliary tasks where labels are free to obtain. Most of these tasks end up providing data to learn specific kinds of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Xiaolong Wang , Kaiming He , Abhinav Gupta

Object parts serve as crucial intermediate representations in various downstream tasks, but part-level representation learning still has not received as much attention as other vision tasks. Previous research has established that Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jiahao Xia , Wenjian Huang , Min Xu , Jianguo Zhang , Haimin Zhang , Ziyu Sheng , Dong Xu

Convolutional neural networks (CNNs) have recently received a lot of attention due to their ability to model local stationary structures in natural images in a multi-scale fashion, when learning all model parameters with supervision. While…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Mattis Paulin , Julien Mairal , Matthijs Douze , Zaid Harchaoui , Florent Perronnin , Cordelia Schmid

Unsupervised localization and segmentation are long-standing computer vision challenges that involve decomposing an image into semantically-meaningful segments without any labeled data. These tasks are particularly interesting in an…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina , Andrea Vedaldi

Visual attributes are great means of describing images or scenes, in a way both humans and computers understand. In order to establish a correspondence between images and to be able to compare the strength of each property between images,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Yaser Souri , Erfan Noury , Ehsan Adeli

Recent results indicate that the generic descriptors extracted from the convolutional neural networks are very powerful. This paper adds to the mounting evidence that this is indeed the case. We report on a series of experiments conducted…

Computer Vision and Pattern Recognition · Computer Science 2014-05-13 Ali Sharif Razavian , Hossein Azizpour , Josephine Sullivan , Stefan Carlsson

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi