English
Related papers

Related papers: Patch-Wise Self-Supervised Visual Representation L…

200 papers

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pedro O. Pinheiro , Amjad Almahairi , Ryan Y. Benmalek , Florian Golemo , Aaron Courville

The unsupervised visual inspection of defects in industrial products poses a significant challenge due to substantial variations in product surfaces. Current unsupervised models struggle to strike a balance between detecting texture and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Peng Wang , Haiming Yao , Wenyong Yu

The downstream accuracy of self-supervised methods is tightly linked to the proxy task solved during training and the quality of the gradients extracted from it. Richer and more meaningful gradients updates are key to allow self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Tim Lebailly , Tinne Tuytelaars

We introduce SPARse Fine-grained Contrastive Alignment (SPARC), a simple method for pretraining more fine-grained multimodal representations from image-text pairs. Given that multiple image patches often correspond to single words, we…

We present a new method of self-supervised learning and knowledge distillation based on the multi-views and multi-representations (MV-MR). The MV-MR is based on the maximization of dependence between learnable embeddings from augmented and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Vitaliy Kinakh , Mariia Drozdova , Slava Voloshynovskiy

Self-supervised depth estimation has shown its great effectiveness in producing high quality depth maps given only image sequences as input. However, its performance usually drops when estimating on border areas or objects with thin…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Rui Li , Qing Mao , Pei Wang , Xiantuo He , Yu Zhu , Jinqiu Sun , Yanning Zhang

Self-supervised contrastive learning heavily relies on the view variance brought by data augmentation, so that it can learn a view-invariant pre-trained representation. Beyond increasing the view variance for contrast, this work focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yong Zhang , Rui Zhu , Shifeng Zhang , Xu Zhou , Shifeng Chen , Xiaofan Chen

State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jiho Jang , Seonhoon Kim , Kiyoon Yoo , Chaerin Kong , Jangho Kim , Nojun Kwak

In contrastive self-supervised learning, the common way to learn discriminative representation is to pull different augmented "views" of the same image closer while pushing all other images further apart, which has been proven to be…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kaiyou Song , Shan Zhang , Zihao An , Zimeng Luo , Tong Wang , Jin Xie

Recently self-supervised representation learning has drawn considerable attention from the scene text recognition community. Different from previous studies using contrastive learning, we tackle the issue from an alternative perspective,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Canjie Luo , Lianwen Jin , Jingdong Chen

The emerging task of fine-grained image classification in low-data regimes assumes the presence of low inter-class variance and large intra-class variation along with a highly limited amount of training samples per class. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Dmitry Demidov , Abduragim Shtanchaev , Mihail Mihaylov , Mohammad Almansoori

With the increase in the number of image data and the lack of corresponding labels, weakly supervised learning has drawn a lot of attention recently in computer vision tasks, especially in the fine-grained semantic segmentation problem. To…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Ke Zhang , Sihong Chen , Qi Ju , Yong Jiang , Yucong Li , Xin He

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Weakly-supervised image segmentation (WSIS) is a critical task in computer vision that relies on image-level class labels. Multi-stage training procedures have been widely used in existing WSIS approaches to obtain high-quality pseudo-masks…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Chunyan Wang , Dong Zhang , Rui Yan

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

Recent progress in vision-language pretraining has enabled significant improvements to many downstream computer vision applications, such as classification, retrieval, segmentation and depth prediction. However, a fundamental capability…

Implicit surface representations, such as signed-distance functions, combined with deep learning have led to impressive models which can represent detailed shapes of objects with arbitrary topology. Since a continuous function is learned,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Carsten Stoll , Christian Theobalt

This study aims to optimize the few-shot image classification task and improve the model's feature extraction and classification performance by combining self-supervised learning with the deep network model ResNet-101. During the training…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuyang Xiao

Effective image classification hinges on discerning relevant features from both foreground and background elements, with the foreground typically holding the critical information. While humans adeptly classify images with limited exposure,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Weihao Jiang , Haoyang Cui , Kun He

Although deep learning based methods have achieved great success in many computer vision tasks, their performance relies on a large number of densely annotated samples that are typically difficult to obtain. In this paper, we focus on the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Zhengeng Yang , Hongshan Yu , Yong He , Zhi-Hong Mao , Ajmal Mian