English
Related papers

Related papers: SegFormer: Simple and Efficient Design for Semanti…

200 papers

Learning representations on large-sized graphs is a long-standing challenge due to the inter-dependence nature involved in massive data points. Transformers, as an emerging class of foundation encoders for graph-structured data, have shown…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Wentao Zhao , Chenxiao Yang , Hengrui Zhang , Fan Nie , Haitian Jiang , Yatao Bian , Junchi Yan

Beyond the Transformer, it is important to explore how to exploit the capacity of the MetaFormer, an architecture that is fundamental to the performance improvements of the Transformer. Previous studies have exploited it only for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Beoungwoo Kang , Seunghun Moon , Yubin Cho , Hyunwoo Yu , Suk-Ju Kang

Finetuning a pretrained backbone in the encoder part of an image transformer network has been the traditional approach for the semantic segmentation task. However, such an approach leaves out the semantic context that an image provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Jitesh Jain , Anukriti Singh , Nikita Orlov , Zilong Huang , Jiachen Li , Steven Walton , Humphrey Shi

Medical image segmentation is important for computer-aided diagnosis. Good segmentation demands the model to see the big picture and fine details simultaneously, i.e., to learn image features that incorporate large context while keep high…

Image and Video Processing · Electrical Eng. & Systems 2021-06-03 Shaohua Li , Xiuchao Sui , Xiangde Luo , Xinxing Xu , Yong Liu , Rick Goh

The escalating threat of weapon-related violence necessitates automated detection systems capable of pixel-level precision for accurate threat assessment in real-time security applications. Traditional weapon detection approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Akhila Kambhatla , Taminul Islam , Khaled R Ahmed

The recent researches in Deep Convolutional Neural Network have focused their attention on improving accuracy that provide significant advances. However, if they were limited to classification tasks, nowadays with contributions from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Geraldin Nanfack , Azeddine Elhassouny , Rachid Oulad Haj Thami

Semantic segmentation of microscopy cell images by deep learning is a significant technique. We considered that the Transformers, which have recently outperformed CNNs in image recognition, could also be improved and developed for cell…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Hinako Mitsuoka , Kazuhiro Hotta

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

This paper investigates the capability of plain Vision Transformers (ViTs) for semantic segmentation using the encoder-decoder framework and introduces \textbf{SegViTv2}. In this study, we introduce a novel Attention-to-Mask (\atm) module…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Bowen Zhang , Liyang Liu , Minh Hieu Phan , Zhi Tian , Chunhua Shen , Yifan Liu

Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Yunhe Gao , Mu Zhou , Di Liu , Zhennan Yan , Shaoting Zhang , Dimitris N. Metaxas

Transparent objects, such as glass walls and doors, constitute architectural obstacles hindering the mobility of people with low vision or blindness. For instance, the open space behind glass doors is inaccessible, unless it is correctly…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Jiaming Zhang , Kailun Yang , Angela Constantinescu , Kunyu Peng , Karin Müller , Rainer Stiefelhagen

LiDAR-based semantic segmentation is critical in the fields of robotics and autonomous driving as it provides a comprehensive understanding of the scene. This paper proposes a lightweight and efficient projection-based semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ben Ding

Recent mainstream weakly supervised semantic segmentation (WSSS) approaches are mainly based on Class Activation Map (CAM) generated by a CNN (Convolutional Neural Network) based image classifier. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Junliang Chen , Xiaodong Zhao , Cheng Luo , Linlin Shen

The fully convolutional network (FCN) with an encoder-decoder architecture has been the standard paradigm for semantic segmentation. The encoder-decoder architecture utilizes an encoder to capture multilevel feature maps, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Libo Wang , Rui Li , Chenxi Duan , Ce Zhang , Xiaoliang Meng , Shenghui Fang

Feature pyramids have been widely adopted in convolutional neural networks and transformers for tasks in medical image segmentation. However, existing models generally focus on the Encoder-side Transformer for feature extraction. We further…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hongyi Cai , Mohammad Mahdinur Rahman , Wenzhen Dong , Jingyu Wu

Multi-modal human action segmentation is a critical and challenging task with a wide range of applications. Nowadays, the majority of approaches concentrate on the fusion of dense signals (i.e., RGB, optical flow, and depth maps). However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qi Liu , Xinchen Liu , Kun Liu , Xiaoyan Gu , Wu Liu

Accurate segmentation of organs and lesions in medical images is essential for clinical applications including diagnosis, prognosis, and treatment planning. While Vision Transformers (ViTs) have shown impressive segmentation performance,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Jin Yang , Xiaobing Yu , Peijie Qiu

In the wake of Masked Image Modeling (MIM), a diverse range of plain, non-hierarchical Vision Transformer (ViT) models have been pre-trained with extensive datasets, offering new paradigms and significant potential for semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Yuanduo Hong , Jue Wang , Weichao Sun , Huihui Pan

As a fundamental task in computer vision, semantic segmentation is widely applied in fields such as autonomous driving, remote sensing image analysis, and medical image processing. In recent years, Transformer-based segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tai An , Weiqiang Huang , Da Xu , Qingyuan He , Jiacheng Hu , Yujia Lou

Convolutional neural networks (CNNs) have been the consensus for medical image segmentation tasks. However, they suffer from the limitation in modeling long-range dependencies and spatial correlations due to the nature of convolution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Moein Heidari , Amirhossein Kazerouni , Milad Soltany , Reza Azad , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof