English
Related papers

Related papers: SegMamba: Long-range Sequential Modeling Mamba For…

200 papers

Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics and structured cross-channel dependencies, posing fundamental challenges for automated analysis. Conventional…

Signal Processing · Electrical Eng. & Systems 2026-05-08 ZhengXiao He , Huayu Li , Xiwen Chen , Janet M Roveda , Jinghao Wen , Siyuan Tian , Ao Li

Land cover analysis using hyperspectral images (HSI) remains an open problem due to their low spatial resolution and complex spectral information. Recent studies are primarily dedicated to designing Transformer-based architectures for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Guanchun Wang , Xiangrong Zhang , Zelin Peng , Tianyang Zhang , Licheng Jiao

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

While the Mamba architecture demonstrates superior inference efficiency and competitive performance on short-context natural language processing (NLP) tasks, empirical evidence suggests its capacity to comprehend long contexts is limited…

Computation and Language · Computer Science 2025-01-03 Danlong Yuan , Jiahao Liu , Bei Li , Huishuai Zhang , Jingang Wang , Xunliang Cai , Dongyan Zhao

Large pre-trained models have achieved outstanding results in sequence modeling. The Transformer block and its attention mechanism have been the main drivers of the success of these models. Recently, alternative architectures, such as…

Machine Learning · Computer Science 2025-01-29 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

In recent developments, the Mamba architecture, known for its selective state space approach, has shown potential in the efficient modeling of long sequences. However, its application in image generation remains underexplored. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Shentong Mo , Yapeng Tian

In image fusion tasks, images from different sources possess distinct characteristics. This has driven the development of numerous methods to explore better ways of fusing them while preserving their respective characteristics.Mamba, as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zihan Cao , Xiao Wu , Liang-Jian Deng , Yu Zhong

Long-range sequence processing poses a significant challenge for Transformers due to their quadratic complexity in input length. A promising alternative is Mamba, which demonstrates high performance and achieves Transformer-level…

Machine Learning · Computer Science 2025-04-11 Assaf Ben-Kish , Itamar Zimerman , Shady Abu-Hussein , Nadav Cohen , Amir Globerson , Lior Wolf , Raja Giryes

Decision Transformer, a promising approach that applies Transformer architectures to reinforcement learning, relies on causal self-attention to model sequences of states, actions, and rewards. While this method has shown competitive…

Machine Learning · Computer Science 2024-04-01 Toshihiro Ota

Due to the long-range modeling ability and linear complexity property, Mamba has attracted considerable attention in point cloud analysis. Despite some interesting progress, related work still suffers from imperfect point cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Kanglin Qu , Pan Gao , Qun Dai , Zhanzhi Ye , Rui Ye , Yuanhao Sun

State Space Models (SSMs) have emerged as powerful alternatives to attention-based Transformers, with Mamba demonstrating impressive efficiency and scalability. As these models grow increasingly larger, the need for Parameter-Efficient…

Machine Learning · Computer Science 2026-03-03 Donghyun Lee , Yuhang Li , Ruokai Yin , Shiting Xiao , Priyadarshini Panda

Mamba, based on state space model (SSM) with its linear complexity and great success in classification provide its superiority in 3D point cloud analysis. Prior to that, Transformer has emerged as one of the most prominent and successful…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jia-wei Chen , Yu-jie Xiong , Yong-bin Gao

Mamba has garnered widespread attention due to its flexible design and efficient hardware performance to process 1D sequences based on the state space model (SSM). Recent studies have attempted to apply Mamba to the visual domain by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chengkun Wang , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation. The recent advancements of Convolutional Neural Networks (CNNs) and Transformers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Keyan Chen , Bowen Chen , Chenyang Liu , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

Recently, deep learning models have achieved excellent performance in hyperspectral image (HSI) classification. Among the many deep models, Transformer has gradually attracted interest for its excellence in modeling the long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Lingbo Huang , Yushi Chen , Xin He

Skin lesion segmentation is a crucial method for identifying early skin cancer. In recent years, both convolutional neural network (CNN) and Transformer-based methods have been widely applied. Moreover, combining CNN and Transformer…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Shun Zou , Mingya Zhang , Bingjian Fan , Zhengyi Zhou , Xiuguo Zou

Widely used traditional pipelines for subcortical brain segmentation are often inefficient and slow, particularly when processing large datasets. Furthermore, deep learning models face challenges due to the high resolution of MRI images and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Aaron Cao , Zongyu Li , Jordan Jomsky , Andrew F. Laine , Jia Guo

In the field of multi-source remote sensing image classification, remarkable progress has been made by using Convolutional Neural Network (CNN) and Transformer. Recently, Mamba-based methods built upon the State Space Model (SSM) have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Feng Gao , Xuepeng Jin , Xiaowei Zhou , Junyu Dong , Qian Du

The accelerated MRI reconstruction poses a challenging ill-posed inverse problem due to the significant undersampling in k-space. Deep neural networks, such as CNNs and ViTs, have shown substantial performance improvements for this task…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Yucong Meng , Zhiwei Yang , Zhijian Song , Yonghong Shi