English
Related papers

Related papers: Distilling Self-Supervised Vision Transformers for…

200 papers

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

Constructing an organized dataset comprised of a large number of images and several captions for each image is a laborious task, which requires vast human effort. On the other hand, collecting a large number of images and sentences…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Dong-Jin Kim , Jinsoo Choi , Tae-Hyun Oh , In So Kweon

The high cost of pixel-level annotations makes it appealing to train saliency detection models with weak supervision. However, a single weak supervision source usually does not contain enough information to train a well-performing model. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yu Zeng , Yunzhi Zhuge , Huchuan Lu , Lihe Zhang , Mingyang Qian , Yizhou Yu

Semantic segmentation aims to classify every pixel of an input image. Considering the difficulty of acquiring dense labels, researchers have recently been resorting to weak labels to alleviate the annotation burden of segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Yazhou Yao , Tao Chen , Guosen Xie , Chuanyi Zhang , Fumin Shen , Qi Wu , Zhenmin Tang , Jian Zhang

Since acquiring pixel-wise annotations for training convolutional neural networks for semantic image segmentation is time-consuming, weakly supervised approaches that only require class tags have been proposed. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Johann Sawatzky , Debayan Banerjee , Juergen Gall

Semantic segmentation is a key computer vision task that has been actively researched for decades. In recent years, supervised methods have reached unprecedented accuracy, however they require many pixel-level annotations for every new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Nir Zabari , Yedid Hoshen

Semi-supervised medical image segmentation has gained growing interest due to its ability to utilize unannotated data. The current state-of-the-art methods mostly rely on pseudo-labeling within a co-training framework. These methods depend…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Suruchi Kumari , Pravendra Singh

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is particularly important for semantic segmentation tasks involving 3D datasets, which are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

Fully supervised change detection methods require difficult to procure pixel-level labels, while weakly supervised approaches can be trained with image-level labels. However, most of these approaches require a combination of changed and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Philipp Andermatt , Radu Timofte

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

Enabling computational systems with the ability to localize actions in video-based content has manifold applications. Traditionally, such a problem is approached in a fully-supervised setting where video-clips with complete frame-by-frame…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Kurt Degiorgio , Fabio Cuzzolin

Existing salient instance detection (SID) methods typically learn from pixel-level annotated datasets. In this paper, we present the first weakly-supervised approach to the SID problem. Although weak supervision has been considered in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Xin Tian , Ke Xu , Xin Yang , Baocai Yin , Rynson W. H. Lau

Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE, a pure ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Haojie Yu , Kang Zhao , Xiaoming Xu

Existing weakly or semi-supervised semantic segmentation methods utilize image or box-level supervision to generate pseudo-labels for weakly labeled images. However, due to the lack of strong supervision, the generated pseudo-labels are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Md Amirul Islam , Matthew Kowal , Sen Jia , Konstantinos G. Derpanis , Neil D. B. Bruce

In the field of semi-supervised medical image segmentation, the shortage of labeled data is the fundamental problem. How to effectively learn image features from unlabeled images to improve segmentation accuracy is the main research…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zhanhong Qiu , Haitao Gan , Ming Shi , Zhongwei Huang , Zhi Yang

This work addresses weakly-supervised image semantic segmentation based on image-level class labels. One common approach to this task is to propagate the activation scores of Class Activation Maps (CAMs) using a random-walk mechanism in…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Shun-Yi Pan , Cheng-You Lu , Shih-Po Lee , Wen-Hsiao Peng

Nuclei segmentation is a crucial task for whole slide image analysis in digital pathology. Generally, the segmentation performance of fully-supervised learning heavily depends on the amount and quality of the annotated data. However, it is…

Image and Video Processing · Electrical Eng. & Systems 2023-08-21 Yi Lin , Zhiyong Qu , Hao Chen , Zhongke Gao , Yuexiang Li , Lili Xia , Kai Ma , Yefeng Zheng , Kwang-Ting Cheng

Weakly supervised semantic segmentation with only image-level labels saves large human effort to annotate pixel-level labels. Cutting-edge approaches rely on various innovative constraints and heuristic rules to generate the masks for every…

Computer Vision and Pattern Recognition · Computer Science 2020-01-31 Junsong Fan , Zhaoxiang Zhang , Tieniu Tan , Chunfeng Song , Jun Xiao

Vision Transformers (ViTs) have emerged as popular models in computer vision, demonstrating state-of-the-art performance across various tasks. This success typically follows a two-stage strategy involving pre-training on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Zijun Long , Zaiqiao Meng , Gerardo Aragon Camarasa , Richard McCreadie

This study investigates barely-supervised medical image segmentation where only few labeled data, i.e., single-digit cases are available. We observe the key limitation of the existing state-of-the-art semi-supervised solution cross pseudo…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Huimin Wu , Xiaomeng Li , Yiqun Lin , Kwang-Ting Cheng