English
Related papers

Related papers: Revisiting Self-Supervised Visual Representation L…

200 papers

Machine Learning and Inference methods have become ubiquitous in our attempt to induce more abstract representations of natural language text, visual scenes, and other messy, naturally occurring data, and support decisions that depend on…

Machine Learning · Computer Science 2020-05-27 Dan Roth

We propose a semi-supervised learning approach for video classification, VideoSSL, using convolutional neural networks (CNN). Like other computer vision tasks, existing supervised video classification methods demand a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Longlong Jing , Toufiq Parag , Zhe Wu , Yingli Tian , Hongcheng Wang

The objective of this paper is visual-only self-supervised video representation learning. We make the following contributions: (i) we investigate the benefit of adding semantic-class positives to instance-based Info Noise Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Tengda Han , Weidi Xie , Andrew Zisserman

As the deep learning revolution marches on, self-supervised learning has garnered increasing attention in recent years thanks to its remarkable representation learning ability and the low dependence on labeled data. Among these varied…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Siyuan Li , Luyuan Zhang , Zedong Wang , Di Wu , Lirong Wu , Zicheng Liu , Jun Xia , Cheng Tan , Yang Liu , Baigui Sun , Stan Z. Li

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Statistics 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

In recent years, deep learning poses a deep technical revolution in almost every field and attracts great attentions from industry and academia. Especially, the convolutional neural network (CNN), one representative model of deep learning,…

Human-Computer Interaction · Computer Science 2018-07-09 Mao Yang , Bo Li , Guanxiong Feng , Zhongjiang Yan

Deep learning and convolutional neural networks (CNNs) have made progress in polarimetric synthetic aperture radar (PolSAR) image classification over the past few years. However, a crucial issue has not been addressed, i.e., the requirement…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Lamei Zhang , Siyu Zhang , Bin Zou , Hongwei Dong

Self-supervised representation learning has seen remarkable progress in the last few years. More recently, contrastive instance learning has shown impressive results compared to its supervised learning counterparts. However, even with the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Srikar Appalaraju , Yi Zhu , Yusheng Xie , István Fehérvári

Convolutional neural networks perform well on object recognition because of a number of recent advances: rectified linear units (ReLUs), data augmentation, dropout, and large labelled datasets. Unsupervised data has been proposed as another…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Tom Le Paine , Pooya Khorrami , Wei Han , Thomas S. Huang

Single image super-resolution (SR) via deep learning has recently gained significant attention in the literature. Convolutional neural networks (CNNs) are typically learned to represent the mapping between low-resolution (LR) and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Hojjat S. Mousavi , Tiantong Guo , Vishal Monga

Self-supervised learning is a promising unsupervised learning framework that has achieved success with large floating point networks. But such networks are not readily deployable to edge devices. To accelerate deployment of models with the…

Machine Learning · Computer Science 2022-03-30 Dahyun Kim , Jonghyun Choi

Deep convolutional neural networks (CNNs) have been immensely successful in many high-level computer vision tasks given large labeled datasets. However, for video semantic object segmentation, a domain where labels are scarce, effectively…

Computer Vision and Pattern Recognition · Computer Science 2016-06-08 Huiling Wang , Tapani Raiko , Lasse Lensu , Tinghuai Wang , Juha Karhunen

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Guo-Jun Qi , Jiebo Luo

Recent research put a big effort in the development of deep learning architectures and optimizers obtaining impressive results in areas ranging from vision to language processing. However little attention has been addressed to the need of a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Gabriele Valvano , Andrea Leo , Daniele Della Latta , Nicola Martini , Gianmarco Santini , Dante Chiappino , Emiliano Ricciardi

The deep convolutional neural network (DCNN) in computer vision has given promising results. It is widely applied in many areas, from medicine, agriculture, self-driving car, biometric system, and almost all computer vision-based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Gaurav Hirani , Waleed Abdulla

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

Learning representations with self-supervision for convolutional networks (CNN) has been validated to be effective for vision tasks. As an alternative to CNN, vision transformers (ViT) have strong representation ability with spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Zhong-Yu Li , Shanghua Gao , Ming-Ming Cheng

In recent years, discriminative self-supervised methods have made significant strides in advancing various visual tasks. The central idea of learning a data encoder that is robust to data distortions/augmentations is straightforward yet…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yuewei Yang , Hai Li , Yiran Chen

Convolutional neural networks (CNNs) have been successfully applied to solve the problem of correspondence estimation between semantically related images. Due to non-availability of large training datasets, existing methods resort to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Zakaria Laskar , Juho Kannala