English
Related papers

Related papers: Distilling Self-Supervised Vision Transformers for…

200 papers

Vision-language models (VLMs) pre-trained on large, heterogeneous data sources are becoming increasingly popular, providing rich multi-modal embeddings that enable efficient transfer to new tasks. A particularly relevant application is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Julio Silva-Rodríguez , Ender Konukoglu

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

Previous works on multi-label image recognition (MLIR) usually use CNNs as a starting point for research. In this paper, we take pure Vision Transformer (ViT) as the research base and make full use of the advantages of Transformer with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yunqing Hu , Xuan Jin , Yin Zhang , Haiwen Hong , Jingfeng Zhang , Feihu Yan , Yuan He , Hui Xue

In this paper, we propose a new approach to applying point-level annotations for weakly-supervised panoptic segmentation. Instead of the dense pixel-level labels used by fully supervised methods, point-level labels only provide a single…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Junsong Fan , Zhaoxiang Zhang , Tieniu Tan

Humans possess remarkable ability to accurately classify new, unseen images after being exposed to only a few examples. Such ability stems from their capacity to identify common features shared between new and previously seen images while…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Weihao Jiang , Chang Liu , Kun He

Current weakly supervised object localization and segmentation rely on class-discriminative visualization techniques to generate pseudo-labels for pixel-level training. Such visualization methods, including class activation mapping (CAM)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Xiangwei Shi , Seyran Khademi , Yunqiang Li , Jan van Gemert

Semantic segmentation tasks based on weakly supervised condition have been put forward to achieve a lightweight labeling process. For simple images that only include a few categories, researches based on image-level annotations have…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Xi Li , Huimin Ma , Sheng Yi , Yanxian Chen

Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Many sophisticated methods have been developed to address the challenges this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xiu-Shen Wei , He-Yang Xu , Faen Zhang , Yuxin Peng , Wei Zhou

Weakly supervised learning has emerged as an appealing alternative to alleviate the need for large labeled datasets in semantic segmentation. Most current approaches exploit class activation maps (CAMs), which can be generated from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Gaurav Patel , Jose Dolz

The successful application of deep learning to many visual recognition tasks relies heavily on the availability of a large amount of labeled data which is usually expensive to obtain. The few-shot learning problem has attracted increasing…

Machine Learning · Computer Science 2020-03-11 Zhongjie Yu , Lin Chen , Zhongwei Cheng , Jiebo Luo

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Vision Transformers (ViTs) are widely adopted in medical imaging tasks, and some existing efforts have been directed towards vision-language training for Chest X-rays (CXRs). However, we envision that there still exists a potential for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Umar Marikkar , Sara Atito , Muhammad Awais , Adam Mahdi

We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored topic despite the wide adoption of the ViT architectures to different tasks. To tackle this problem, we propose a new SSL pipeline, consisting of first…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Zhaowei Cai , Avinash Ravichandran , Paolo Favaro , Manchen Wang , Davide Modolo , Rahul Bhotika , Zhuowen Tu , Stefano Soatto

Since the preparation of labeled data for training semantic segmentation networks of point clouds is a time-consuming process, weakly supervised approaches have been introduced to learn from only a small fraction of data. These methods are…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Gengxin Liu , Oliver van Kaick , Hui Huang , Ruizhen Hu

Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Haohan Wang , Liang Liu , Wuhao Zhang , Jiangning Zhang , Zhenye Gan , Yabiao Wang , Chengjie Wang , Haoqian Wang

Self-Supervised Learning (SSL) for Vision Transformers (ViTs) has recently demonstrated considerable potential as a pre-training strategy for a variety of computer vision tasks, including image classification and segmentation, both in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yannis Kaltampanidis , Alexandros Doumanoglou , Dimitrios Zarpalas

This paper addresses semi-supervised semantic segmentation by exploiting a small set of images with pixel-level annotations (strong supervisions) and a large set of images with only image-level annotations (weak supervisions). Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Rumeng Yi , Yaping Huang , Qingji Guan , Mengyang Pu , Runsheng Zhang

Providing pixel-level supervisions for scene text segmentation is inherently difficult and costly, so that only few small datasets are available for this task. To face the scarcity of training data, previous approaches based on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Simone Bonechi , Paolo Andreini , Monica Bianchini , Franco Scarselli

Current state-of-the-art methods for object detection rely on annotated bounding boxes of large data sets for training. However, obtaining such annotations is expensive and can require up to hundreds of hours of manual labor. This poses a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Hannah Kniesel , Leon Sick , Tristan Payer , Tim Bergner , Kavitha Shaga Devan , Clarissa Read , Paul Walther , Timo Ropinski

Unsupervised semantic segmentation requires assigning a label to every pixel without any human annotations. Despite recent advances in self-supervised representation learning for individual images, unsupervised semantic segmentation with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Wenbin He , William Surmeier , Arvind Kumar Shekar , Liang Gou , Liu Ren