English
Related papers

Related papers: Self-supervised Feature Enhancement: Applying Inte…

200 papers

Convolutional Neural Networks have been a subject of great importance over the past decade and great strides have been made in their utility for producing state of the art performance in many computer vision problems. However, the behavior…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Swami Sankaranarayanan , Arpit Jain , Ser Nam Lim

Deep neural networks demonstrated their ability to provide remarkable performances on a wide range of supervised learning tasks (e.g., image classification) when trained on extensive collections of labeled data (e.g., ImageNet). However,…

Machine Learning · Computer Science 2020-07-07 Yassine Ouali , Céline Hudelot , Myriam Tami

Supervised deep neural networks are the-state-of-the-art for many tasks in the remote sensing domain, against the fact that such techniques require the dataset consisting of pairs of input and label, which are rare and expensive to collect…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sarun Gulyanon , Wasit Limprasert , Pokpong Songmuang , Rachada Kongkachandra

Although CNNs have gained the ability to transfer learned knowledge from source task to target task by virtue of large annotated datasets but consume huge processing time to fine-tune without GPU. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Tasfia Shermin , Manzur Murshed , Guojun Lu , Shyh Wei Teng

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

We present an unsupervised visual feature learning algorithm driven by context-based pixel prediction. By analogy with auto-encoders, we propose Context Encoders -- a convolutional neural network trained to generate the contents of an…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Deepak Pathak , Philipp Krahenbuhl , Jeff Donahue , Trevor Darrell , Alexei A. Efros

This work investigates the unexplored usability of self-supervised representation learning in the direction of functional knowledge transfer. In this work, functional knowledge transfer is achieved by joint optimization of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Prakash Chandra Chhipa , Muskaan Chopra , Gopal Mengi , Varun Gupta , Richa Upadhyay , Meenakshi Subhash Chippa , Kanjar De , Rajkumar Saini , Seiichi Uchida , Marcus Liwicki

While high-resolution pathology images lend themselves well to `data hungry' deep learning algorithms, obtaining exhaustive annotations on these images is a major challenge. In this paper, we propose a self-supervised CNN approach to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Navid Alemi Koohbanani , Balagopal Unnikrishnan , Syed Ali Khurram , Pavitra Krishnaswamy , Nasir Rajpoot

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zuan Gao , Yuxin Wang , Yadong Qu , Boqiang Zhang , Zixiao Wang , Jianjun Xu , Hongtao Xie

Fully-supervised CNN-based approaches for learning local image descriptors have shown remarkable results in a wide range of geometric tasks. However, most of them require per-pixel ground-truth keypoint correspondence data which is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Iaroslav Melekhov , Zakaria Laskar , Xiaotian Li , Shuzhe Wang , Juho Kannala

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mrinal Anand , Aditya Garg

In recent visual self-supervision works, an imitated classification objective, called pretext task, is established by assigning labels to transformed or augmented input images. The goal of pretext can be predicting what transformations are…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Seunghan Yang , Debasmit Das , Simyung Chang , Sungrack Yun , Fatih Porikli

Existing image recognition techniques based on convolutional neural networks (CNNs) basically assume that the training and test datasets are sampled from i.i.d distributions. However, this assumption is easily broken in the real world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi

Graph Neural Networks (GNNs) have been widely applied in the semi-supervised node classification task, where a key point lies in how to sufficiently leverage the limited but valuable label information. Most of the classical GNNs solely use…

Machine Learning · Computer Science 2022-12-26 Le Yu , Leilei Sun , Bowen Du , Tongyu Zhu , Weifeng Lv

Deep convolutional networks for semantic image segmentation typically require large-scale labeled data, e.g. ImageNet and MS COCO, for network pre-training. To reduce annotation efforts, self-supervised semantic segmentation is recently…

Computer Vision and Pattern Recognition · Computer Science 2018-01-31 Xiaohang Zhan , Ziwei Liu , Ping Luo , Xiaoou Tang , Chen Change Loy

This work proposes a hybrid unsupervised and supervised learning method to pre-train models applied in Earth observation downstream tasks when only a handful of labels denoting very general semantic concepts are available. We combine a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Omar A. Castaño-Idarraga , Raul Ramos-Pollán , Freddie Kalaitzis

Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning…

Machine Learning · Computer Science 2015-06-22 Alexey Dosovitskiy , Philipp Fischer , Jost Tobias Springenberg , Martin Riedmiller , Thomas Brox

Features play a crucial role in computer vision. Initially designed to detect salient elements by means of handcrafted algorithms, features are now often learned by different layers in Convolutional Neural Networks (CNNs). This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Loris Nanni , Stefano Ghidoni , Sheryl Brahnam

Deep Neural Networks (DNNs) have been successfully applied to a wide range of problems. However, two main limitations are commonly pointed out. The first one is that they require long time to design. The other is that they heavily rely on…

Neural and Evolutionary Computing · Computer Science 2024-06-21 Adriano Vinhas , João Correia , Penousal Machado