English
Related papers

Related papers: Decoder Denoising Pretraining for Semantic Segment…

200 papers

Pixel-level labels are particularly expensive to acquire. Hence, pretraining is a critical step to improve models on a task like semantic segmentation. However, prominent algorithms for pretraining neural networks use image-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Mathilde Caron , Neil Houlsby , Cordelia Schmid

While significant attention has been recently focused on designing supervised deep semantic segmentation algorithms for vision tasks, there are many domains in which sufficient supervised pixel-level labels are difficult to obtain. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Xide Xia , Brian Kulis

Based on the observation that semantic segmentation errors are partially predictable, we propose a compact formulation using confusion statistics of the trained classifier to refine (re-estimate) the initial pixel label hypotheses. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 James W. Davis , Christopher Menart , Muhammad Akbar , Roman Ilin

Pre-training is a strong strategy for enhancing visual models to efficiently train them with a limited number of labeled images. In semantic segmentation, creating annotation masks requires an intensive amount of labor and time, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Risa Shinoda , Ryo Hayamizu , Kodai Nakashima , Nakamasa Inoue , Rio Yokota , Hirokatsu Kataoka

Pseudo-label learning is widely used in semantic segmentation, particularly in label-scarce scenarios such as unsupervised domain adaptation (UDA) and semisupervised learning (SSL). Despite its success, this paradigm can generate erroneous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Wangkai Li , Rui Sun , Zhaoyang Li , Tianzhu Zhang

Training deep networks for semantic segmentation requires large amounts of labeled training data, which presents a major challenge in practice, as labeling segmentation masks is a highly labor-intensive process. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Lukas Hoyer , Dengxin Dai , Qin Wang , Yuhua Chen , Luc Van Gool

Using deep learning, we now have the ability to create exceptionally good semantic segmentation systems; however, collecting the prerequisite pixel-wise annotations for training images remains expensive and time-consuming. Therefore, it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Aneesh Rangnekar , Christopher Kanan , Matthew Hoffman

Semantic segmentation is a challenging computer vision task demanding a significant amount of pixel-level annotated data. Producing such data is a time-consuming and costly process, especially for domains with a scarcity of experts, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Sara Mousavi , Zhenning Yang , Kelley Cross , Dawnie Steadman , Audris Mockus

Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jinxi Xiang , Zhuowei Li , Wenji Wang , Qing Xia , Shaoting Zhang

Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space. Autoencoder-based language models are appealing in dense retrieval as they train the encoder to output high-quality…

Machine Learning · Computer Science 2021-09-17 Shuqi Lu , Di He , Chenyan Xiong , Guolin Ke , Waleed Malik , Zhicheng Dou , Paul Bennett , Tieyan Liu , Arnold Overwijk

State-of-the-art methods for Transformer-based semantic segmentation typically adopt Transformer decoders that are used to extract additional embeddings from image embeddings via cross-attention, refine either or both types of embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Qishuai Wen , Chun-Guang Li

We are considering in this paper the task of label-efficient fine-tuning of segmentation models: We assume that a large labeled dataset is available and allows to train an accurate segmentation model in one domain, and that we have to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Bruno Sauvalle , Mathieu Salzmann

Although well-known large-scale datasets, such as ImageNet, have driven image understanding forward, most of these datasets require extensive manual annotation and are thus not easily scalable. This limits the advancement of image…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Jean Lahoud , Bernard Ghanem

The rapid development of deep learning has made a great progress in image segmentation, one of the fundamental tasks of computer vision. However, the current segmentation algorithms mostly rely on the availability of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Wei Shen , Zelin Peng , Xuehui Wang , Huayu Wang , Jiazhong Cen , Dongsheng Jiang , Lingxi Xie , Xiaokang Yang , Qi Tian

Recent advances in semi-supervised learning (SSL) demonstrate that a combination of consistency regularization and pseudo-labeling can effectively improve image classification accuracy in the low-data regime. Compared to classification,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuliang Zou , Zizhao Zhang , Han Zhang , Chun-Liang Li , Xiao Bian , Jia-Bin Huang , Tomas Pfister

Semantic segmentation remains a computationally intensive algorithm for embedded deployment even with the rapid growth of computation power. Thus efficient network design is a critical aspect especially for applications like automated…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Arindam Das , Saranya Kandan , Senthil Yogamani , Pavel Krizek

Optical neuroimaging is a vital tool for understanding the brain structure and the connection between regions and nuclei. However, the image noise introduced in the sample preparation and the imaging system hinders the extraction of the…

Image and Video Processing · Electrical Eng. & Systems 2021-09-23 Tianfang Zhu , Yue Guan , Anan Li

We focus on prediction problems with structured outputs that are subject to output validity constraints, e.g. pseudocode-to-code translation where the code must compile. While labeled input-output pairs are expensive to obtain, "unlabeled"…

Machine Learning · Computer Science 2023-10-26 Sang Michael Xie , Tengyu Ma , Percy Liang

Medical ultrasound imaging is ubiquitous, but manual analysis struggles to keep pace. Automated segmentation can help but requires large labeled datasets, which are scarce. Semi-supervised learning leveraging both unlabeled and limited…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Yaxiong Chen , Yujie Wang , Zixuan Zheng , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

Semantic segmentation requires per-pixel prediction for a given image. Typically, the output resolution of a segmentation network is severely reduced due to the downsampling operations in the CNN backbone. Most previous methods employ…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Bowen Zhang , Yifan Liu , Zhi Tian , Chunhua Shen