English
Related papers

Related papers: Unsupervised Learning of Visual Representations us…

200 papers

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

Semantic segmentation is a crucial step in many Earth observation tasks. Large quantity of pixel-level annotation is required to train deep networks for semantic segmentation. Earth observation techniques are applied to varieties of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Sudipan Saha , Lichao Mou , Muhammad Shahzad , Xiao Xiang Zhu

Unsupervised representation learning holds the promise of exploiting large amounts of unlabeled data to learn general representations. A promising technique for unsupervised learning is the framework of Variational Auto-encoders (VAEs).…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Kamal Gupta , Saurabh Singh , Abhinav Shrivastava

While great strides have been made in using deep learning algorithms to solve supervised learning tasks, the problem of unsupervised learning - leveraging unlabeled examples to learn about the structure of a domain - remains a difficult…

Machine Learning · Computer Science 2017-03-02 William Lotter , Gabriel Kreiman , David Cox

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

From CNN, RNN, to ViT, we have witnessed remarkable advancements in video prediction, incorporating auxiliary inputs, elaborate neural architectures, and sophisticated training strategies. We admire these progresses but are confused about…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Zhangyang Gao , Cheng Tan , Lirong Wu , Stan Z. Li

Deep convolutional networks have achieved the state-of-the-art for semantic image segmentation tasks. However, training these networks requires access to densely labeled images, which are known to be very expensive to obtain. On the other…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Gaurav Pandey , Ambedkar Dukkipati

Convolutional neural networks (CNNs) have recently received a lot of attention due to their ability to model local stationary structures in natural images in a multi-scale fashion, when learning all model parameters with supervision. While…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Mattis Paulin , Julien Mairal , Matthijs Douze , Zaid Harchaoui , Florent Perronnin , Cordelia Schmid

Unsupervised machine learning offers significant opportunities for extracting knowledge from unlabeled data sets and for achieving maximum machine learning performance. This paper demonstrates how to construct, use, and evaluate a high…

Materials Science · Physics 2021-04-13 Ryan Cohn , Elizabeth Holm

The de-facto approach to many vision tasks is to start from pretrained visual representations, typically learned via supervised training on ImageNet. Recent methods have explored unsupervised pretraining to scale to vast quantities of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Karan Desai , Justin Johnson

Although deep learning based methods have achieved great success in many computer vision tasks, their performance relies on a large number of densely annotated samples that are typically difficult to obtain. In this paper, we focus on the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Zhengeng Yang , Hongshan Yu , Yong He , Zhi-Hong Mao , Ajmal Mian

Discriminative self-supervised learning allows training models on any random group of internet images, and possibly recover salient information that helps differentiate between the images. Applied to ImageNet, this leads to object centric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Priya Goyal , Quentin Duval , Isaac Seessel , Mathilde Caron , Ishan Misra , Levent Sagun , Armand Joulin , Piotr Bojanowski

The success of deep neural networks generally requires a vast amount of training data to be labeled, which is expensive and unfeasible in scale, especially for video collections. To alleviate this problem, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Longlong Jing , Xiaodong Yang , Jingen Liu , Yingli Tian

Webly-supervised learning has recently emerged as an alternative paradigm to traditional supervised learning based on large-scale datasets with manual annotations. The key idea is that models such as CNNs can be learned from the noisy…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Christian Rupprecht , Ansh Kapil , Nan Liu , Lamberto Ballan , Federico Tombari

We introduce an unsupervised visual representation learning system based entirely on local plasticity rules, without labels, backpropagation, or global error signals. The model is a VisNet-inspired hierarchical architecture combining…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Mehdi Fatan Serj , C. Alejandro Parraga , Xavier Otazu

Learning visual features from unlabeled images has proven successful for semantic categorization, often by mapping different $views$ of the same object to the same feature to achieve recognition invariance. However, visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Jiayun Wang , Yubei Chen , Stella X. Yu

Recent advances in machine learning leverage massive datasets of unlabeled images from the web to learn general-purpose image representations for tasks from image classification to face recognition. But do unsupervised computer vision…

Computers and Society · Computer Science 2021-01-28 Ryan Steed , Aylin Caliskan

A large part of the current success of deep learning lies in the effectiveness of data -- more precisely: labelled data. Yet, labelling a dataset with human annotation continues to carry high costs, especially for videos. While in the image…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Yuki M. Asano , Mandela Patrick , Christian Rupprecht , Andrea Vedaldi

Self supervised representation learning has recently attracted a lot of research interest for both the audio and visual modalities. However, most works typically focus on a particular modality or feature alone and there has been very…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Abhinav Shukla , Konstantinos Vougioukas , Pingchuan Ma , Stavros Petridis , Maja Pantic

In this work, we propose the use of large set of unlabeled images as a source of regularization data for learning robust visual representation. Given a visual model trained by a labeled dataset in a supervised fashion, we augment our…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Hamid Izadinia , Pierre Garrigues