English
Related papers

Related papers: Sigma: Siamese Mamba Network for Multi-Modal Seman…

200 papers

Multimodal semantic segmentation has emerged as a powerful paradigm for enhancing scene understanding by leveraging complementary information from multiple sensing modalities (e.g., RGB, depth, and thermal). However, existing cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Guoan Xu , Yang Xiao , Guangwei Gao , Dongchen Zhu , Guo-Jun Qi , Wenjing Jia

Mamba, a State Space Model (SSM), has recently shown competitive performance to Convolutional Neural Networks (CNNs) and Transformers in Natural Language Processing and general sequence modeling. Various attempts have been made to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Trung Dinh Quoc Dang , Huy Hoang Nguyen , Aleksei Tiulpin

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Aitao Yang , Min Li , Yao Ding , Leyuan Fang , Yaoming Cai , Yujie He

RGB-D salient object detection (SOD) aims to identify the most conspicuous objects in a scene with the incorporation of depth cues. Existing methods mainly rely on CNNs, limited by the local receptive fields, or Vision Transformers that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Lanhu Wu , Zilin Gao , Hao Fei , Mong-Li Lee , Wynne Hsu

State Space Models (SSMs), especially Mamba, have shown great promise in medical image segmentation due to their ability to model long-range dependencies with linear computational complexity. However, accurate medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Chaowei Chen , Li Yu , Shiquan Min , Shunfang Wang

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Mingya Zhang , Yue Yu , Limei Gu , Tingsheng Lin , Xianping Tao

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano

Semantic segmentation of multi-source remote sensing images is a fundamental task for Earth observation applications. Existing methods often struggle with insufficient multi-scale context modeling and suboptimal cross-modal feature fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Feng Gao , Zhilin Jin , Yanhai Gan , Junyu Dong , Qian Du

Accurate organ and lesion segmentation is a critical prerequisite for computer-aided diagnosis. Convolutional Neural Networks (CNNs), constrained by their local receptive fields, often struggle to capture complex global anatomical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Haodong Chen , Xianfei Han , Qwen

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu

Hyperspectral image (HSI) classification is pivotal in the remote sensing (RS) field, particularly with the advancement of deep learning techniques. Sequential models, adapted from the natural language processing (NLP) field such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Weilian Zhou , Sei-Ichiro Kamata , Haipeng Wang , Man-Sing Wong , Huiying , Hou

The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiamu Sheng , Jingyi Zhou , Jiong Wang , Peng Ye , Jiayuan Fan

Convolutional neural networks (CNNs) and transformers are widely employed in constructing UNet architectures for medical image segmentation tasks. However, CNNs struggle to model long-range dependencies, while transformers suffer from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Shaolei Zhang , Jinyan Liu , Tianyi Qian , Xuesong Li

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

Recent learned image compression (LIC) leverages Mamba-style state-space models (SSMs) for global receptive fields with linear complexity. However, the standard Mamba adopts content-agnostic, predefined raster (or multi-directional) scans…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunuo Chen , Zezheng Lyu , Bing He , Hongwei Hu , Qi Wang , Yuan Tian , Li Song , Wenjun Zhang , Guo Lu

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

The integration of RGB and thermal data can significantly improve semantic segmentation performance in wild environments for field robots. Nevertheless, multi-source data processing (e.g. Transformer-based approaches) imposes significant…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiaodong Guo , Zi'ang Lin , Luwen Hu , Zhihong Deng , Tong Liu , Wujie Zhou

Translating NIR to the visible spectrum is challenging due to cross-domain complexities. Current models struggle to balance a broad receptive field with computational efficiency, limiting practical use. Although the Selective Structured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Huiyu Zhai , Guang Jin , Xingxing Yang , Guosheng Kang

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haotian Zhang , Keyan Chen , Chenyang Liu , Hao Chen , Zhengxia Zou , Zhenwei Shi