English
Related papers

Related papers: Augmenting Supervised Neural Networks with Unsuper…

200 papers

Hyperspectral imaging is a rich source of data, allowing for multitude of effective applications. However, such imaging remains challenging because of large data dimension and, typically, small pool of available training examples. While…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Wojciech Masarczyk , Przemysław Głomb , Bartosz Grabowski , Mateusz Ostaszewski

Image retargeting aims to alter the size of the image with attention to the contents. One of the main obstacles to training deep learning models for image retargeting is the need for a vast labeled dataset. Labeled datasets are unavailable…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 MohammadHossein Givkashi , MohammadReza Naderi , Nader Karimi , Shahram Shirani , Shadrokh Samavi

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

A major goal of unsupervised learning is to discover data representations that are useful for subsequent tasks, without access to supervised labels during training. Typically, this involves minimizing a surrogate objective, such as the…

Machine Learning · Computer Science 2019-02-27 Luke Metz , Niru Maheswaranathan , Brian Cheung , Jascha Sohl-Dickstein

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

This paper briefly reviews the connections between meta-learning and self-supervised learning. Meta-learning can be applied to improve model generalization capability and to construct general AI algorithms. Self-supervised learning utilizes…

Machine Learning · Computer Science 2021-11-17 Huimin Peng

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

Supervised learning with a convolutional neural network is recognized as a powerful means of image restoration. However, most such methods have been designed for application to grayscale and/or color images; therefore, they have limited…

Image and Video Processing · Electrical Eng. & Systems 2019-07-02 Ryuji Imamura , Tatsuki Itasaka , Masahiro Okuda

Image recognition is an important topic in computer vision and image processing, and has been mainly addressed by supervised deep learning methods, which need a large set of labeled images to achieve promising performance. However, in most…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Haoqian Wang , Zhiwei Xu , Jun Xu , Wangpeng An , Lei Zhang , Qionghai Dai

The need for a large amount of labeled data in the supervised setting has led recent studies to utilize self-supervised learning to pre-train deep neural networks using unlabeled data. Many self-supervised training strategies have been…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Mojtaba Bahrami , Mahsa Ghorbani , Nassir Navab

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Guo-Jun Qi , Jiebo Luo

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

Deep learning usually requires large amounts of labeled training data, but annotating data is costly and tedious. The framework of semi-supervised learning provides the means to use both labeled data and arbitrary amounts of unlabeled data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Christoph Baur , Shadi Albarqouni , Nassir Navab

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Over the last years, deep convolutional neural networks (ConvNets) have transformed the field of computer vision thanks to their unparalleled capacity to learn high level semantic image features. However, in order to successfully learn…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Spyros Gidaris , Praveer Singh , Nikos Komodakis

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

The recent rise of unsupervised and self-supervised learning has dramatically reduced the dependency on labeled data, providing effective image representations for transfer to downstream vision tasks. Furthermore, recent works employed…

Machine Learning · Computer Science 2021-06-14 Andrey Voynov , Stanislav Morozov , Artem Babenko