English
Related papers

Related papers: Masked-attention Mask Transformer for Universal Im…

200 papers

This paper investigates the capability of plain Vision Transformers (ViTs) for semantic segmentation using the encoder-decoder framework and introduces \textbf{SegViTv2}. In this study, we introduce a novel Attention-to-Mask (\atm) module…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Bowen Zhang , Liyang Liu , Minh Hieu Phan , Zhi Tian , Chunhua Shen , Yifan Liu

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Observing the close relationship among panoptic, semantic and instance segmentation tasks, we propose to train a universal multi-dataset multi-task segmentation model: DaTaSeg.We use a shared representation (mask proposals with class…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Xiuye Gu , Yin Cui , Jonathan Huang , Abdullah Rashwan , Xuan Yang , Xingyi Zhou , Golnaz Ghiasi , Weicheng Kuo , Huizhong Chen , Liang-Chieh Chen , David A Ross

Semantic segmentation research has recently witnessed rapid progress, but many leading methods are unable to identify object instances. In this paper, we present Multi-task Network Cascades for instance-aware semantic segmentation. Our…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Jifeng Dai , Kaiming He , Jian Sun

Point-based interactive image segmentation can ease the burden of mask annotation in applications such as semantic segmentation and image editing. However, fully extracting the target mask with limited user inputs remains challenging. We…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Chaowei Fang , Ziyin Zhou , Junye Chen , Hanjing Su , Qingyao Wu , Guanbin Li

Instance segmentation is a form of image detection which has a range of applications, such as object refinement, medical image analysis, and image/video editing, all of which demand a high degree of accuracy. However, this precision is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Muhammed Korkmaz , T. Metin Sezgin

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

Existing 3D semantic segmentation methods rely on point-wise or voxel-wise feature descriptors to output segmentation predictions. However, these descriptors are often supervised at point or voxel level, leading to segmentation models that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Bo Sun , Qixing Huang , Xiangru Huang

Recently, attention-based encoder-decoder models have been used extensively in image captioning. Yet there is still great difficulty for the current methods to achieve deep image understanding. In this work, we argue that such understanding…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Fenglin Liu , Xuancheng Ren , Yuanxin Liu , Kai Lei , Xu Sun

Instance segmentation is one of the fundamental vision tasks. Recently, fully convolutional instance segmentation methods have drawn much attention as they are often simpler and more efficient than two-stage approaches like Mask R-CNN. To…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Hao Chen , Kunyang Sun , Zhi Tian , Chunhua Shen , Yongming Huang , Youliang Yan

The state of the art in learning meaningful semantic representations of words is the Transformer model and its attention mechanisms. Simply put, the attention mechanisms learn to attend to specific parts of the input dispensing recurrence…

Computation and Language · Computer Science 2020-12-24 Dongsheng Wang , Casper Hansen , Lucas Chaves Lima , Christian Hansen , Maria Maistro , Jakob Grue Simonsen , Christina Lioma

Instance segmentation is essential for applications such as automated monitoring of plant health, growth, and yield. However, extensive effort is required to create large-scale datasets with pixel-level annotations of each object instance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Keyhan Najafian , Farhad Maleki , Lingling Jin , Ian Stavness

The goal of this work is to segment the objects in an image that are referred to by a sequence of linguistic descriptions (referring expressions). We propose a deep neural network with recurrent layers that output a sequence of binary…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Alba Herrera-Palacio , Carles Ventura , Carina Silberer , Ionut-Teodor Sorodoc , Gemma Boleda , Xavier Giro-i-Nieto

In previous deep-learning-based methods, semantic segmentation has been regarded as a static or dynamic per-pixel classification task, \textit{i.e.,} classify each pixel representation to a specific category. However, these methods only…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Fangjian Lin , Zhanhao Liang , Sitong Wu , Junjun He , Kai Chen , Shengwei Tian

Recognizing human actions from untrimmed videos is an important task in activity understanding, and poses unique challenges in modeling long-range temporal relations. Recent works adopt a predict-and-refine strategy which converts an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Zhichao Liu , Leshan Wang , Desen Zhou , Jian Wang , Songyang Zhang , Yang Bai , Errui Ding , Rui Fan

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Bastian Wittmann , Fernando Navarro , Suprosanna Shit , Bjoern Menze

Hair artifacts in dermoscopic images present significant challenges for accurate skin lesion analysis, potentially obscuring critical diagnostic features in dermatological assessments. This work introduces a fine-tuned SegFormer model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Asif Mohammed Saad , Umme Niraj Mahi

Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Omar Elharrouss , Somaya Al-Maadeed , Nandhini Subramanian , Najmath Ottakath , Noor Almaadeed , Yassine Himeur

Image segmentation is a long-standing challenge in computer vision, studied continuously over several decades, as evidenced by seminal algorithms such as N-Cut, FCN, and MaskFormer. With the advent of foundation models (FMs), contemporary…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Tianfei Zhou , Wang Xia , Fei Zhang , Boyu Chang , Wenguan Wang , Ye Yuan , Ender Konukoglu , Daniel Cremers

Advancements in machine vision that enable detailed inferences to be made from images have the potential to transform many sectors including agriculture. Precision agriculture, where data analysis enables interventions to be precisely…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Madeleine Darbyshire , Elizabeth Sklar , Simon Parsons