English
Related papers

Related papers: IncepFormer: Efficient Inception Transformer with …

200 papers

Semantic segmentation of night-time images holds significant importance in computer vision, particularly for applications like night environment perception in autonomous driving systems. However, existing methods tend to parse night-time…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yuwen Pan , Rui Sun , Naisong Luo , Tianzhu Zhang , Yongdong Zhang

Encoder transformer models compress information from all tokens in a sequence into a single [CLS] token to represent global context. This approach risks diluting fine-grained or hierarchical features, leading to information loss in…

Computation and Language · Computer Science 2025-09-23 Asif Shahriar , Rifat Shahriyar , M Saifur Rahman

Recent efforts have explored multimodal semantic segmentation using various backbone architectures. However, while most methods aim to improve accuracy, their computational efficiency remains underexplored. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Zelin Zhang , Tao Zhang , KediLI , Xu Zheng

The traditional Transformer model encounters challenges with variable-length input sequences, particularly in Hyperspectral Image Classification (HSIC), leading to efficiency and scalability concerns. To overcome this, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Manuel Mazzara , Salvatore Distifano

Finetuning a pretrained backbone in the encoder part of an image transformer network has been the traditional approach for the semantic segmentation task. However, such an approach leaves out the semantic context that an image provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Jitesh Jain , Anukriti Singh , Nikita Orlov , Zilong Huang , Jiachen Li , Steven Walton , Humphrey Shi

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng

Aggregation of multi-stage features has been revealed to play a significant role in semantic segmentation. Unlike previous methods employing point-wise summation or concatenation for feature aggregation, this study proposes the Category…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Quan Tang , Chuanjian Liu , Fagui Liu , Yifan Liu , Jun Jiang , Bowen Zhang , Kai Han , Yunhe Wang

Most existing 3D instance segmentation methods are derived from 3D semantic segmentation models. However, these indirect approaches suffer from certain limitations. They fail to fully leverage global and local semantic information for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Lei Pan , Wuyang Luan , Yuan Zheng , Qiang Fu , Junhui Li

Recently, Transformer-based models have achieved promising results in various vision tasks, due to their ability to model long-range dependencies. However, transformers are computationally expensive, which limits their applications in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mohammed A. M. Elhassan , Changjun Zhou , Amina Benabid , Abuzar B. M. Adam

In this paper, we address the semantic segmentation problem with a focus on the context aggregation strategy. Our motivation is that the label of a pixel is the category of the object that the pixel belongs to. We present a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Yuhui Yuan , Xiaokang Chen , Xilin Chen , Jingdong Wang

Hyperspectral image (HSI) classification (HSIC) requires effective modeling of complex spatial-spectral dependencies under limited labeled data and high dimensionality. While transformer-based models have shown strong capability in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Muhammad Ahmad

3D instance segmentation plays a crucial role in comprehending 3D scenes. Despite recent advancements in this field, existing approaches exhibit certain limitations. These methods often rely on fixed instance positions obtained from sampled…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mengnan Zhao , Lihe Zhang , Yuqiu Kong , Baocai Yin

We introduce a fast and efficient convolutional neural network, ESPNet, for semantic segmentation of high resolution images under resource constraints. ESPNet is based on a new convolutional module, efficient spatial pyramid (ESP), which is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Sachin Mehta , Mohammad Rastegari , Anat Caspi , Linda Shapiro , Hannaneh Hajishirzi

As a fundamental task in computer vision, semantic segmentation is widely applied in fields such as autonomous driving, remote sensing image analysis, and medical image processing. In recent years, Transformer-based segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tai An , Weiqiang Huang , Da Xu , Qingyuan He , Jiacheng Hu , Yujia Lou

Transformers have shown impressive performance in various natural language processing and computer vision tasks, due to the capability of modeling long-range dependencies. Recent progress has demonstrated that combining such Transformers…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Sitong Wu , Tianyi Wu , Fangjian Lin , Shengwei Tian , Guodong Guo

We propose a novel approach for semantic segmentation that uses an encoder in the reverse direction to decode. Many semantic segmentation networks adopt a feedforward encoder-decoder architecture. Typically, an input is first downsampled by…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Beinan Wang , John Glossner , Daniel Iancu , Georgi N. Gaydadjiev

We propose iSegFormer, a memory-efficient transformer that combines a Swin transformer with a lightweight multilayer perceptron (MLP) decoder. With the efficient Swin transformer blocks for hierarchical self-attention and the simple MLP…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Qin Liu , Zhenlin Xu , Yining Jiao , Marc Niethammer

Recently, it has attracted more and more attentions to fuse multi-scale features for semantic image segmentation. Various works were proposed to employ progressive local or global fusion, but the feature fusions are not rich enough for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Fangjian Lin , Tianyi Wu , Sitong Wu , Shengwei Tian , Guodong Guo