English
Related papers

Related papers: Routing Mamba: Scaling State Space Models with Mix…

200 papers

Human motion generation stands as a significant pursuit in generative computer vision, while achieving long-sequence and efficient motion generation remains challenging. Recent advancements in state space models (SSMs), notably Mamba, have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zeyu Zhang , Akide Liu , Ian Reid , Richard Hartley , Bohan Zhuang , Hao Tang

The Transformer architecture has shown a remarkable ability in modeling global relationships. However, it poses a significant computational challenge when processing high-dimensional medical images. This hinders its development and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhaohu Xing , Tian Ye , Yijun Yang , Guang Liu , Lei Zhu

In this paper, we analyze the computational limitations of Mamba and State-space Models (SSMs) by using the circuit complexity framework. Despite Mamba's stateful design and recent attention as a strong candidate to outperform Transformers,…

Computational Complexity · Computer Science 2025-02-21 Yifang Chen , Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

Machine Learning · Computer Science 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

Linear RNN architectures, like Mamba, can be competitive with Transformer models in language modeling while having advantageous deployment characteristics. Given the focus on training large-scale Transformer models, we consider the…

Machine Learning · Computer Science 2025-06-30 Junxiong Wang , Daniele Paliotta , Avner May , Alexander M. Rush , Tri Dao

Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Siran Peng , Xiangyu Zhu , Haoyu Deng , Liang-Jian Deng , Zhen Lei

Due to the long-range modeling ability and linear complexity property, Mamba has attracted considerable attention in point cloud analysis. Despite some interesting progress, related work still suffers from imperfect point cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Kanglin Qu , Pan Gao , Qun Dai , Zhanzhi Ye , Rui Ye , Yuanhao Sun

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Recent advancements have demonstrated that the performance of large language models (LLMs) can be significantly enhanced by scaling computational resources at test time. A common strategy involves generating multiple Chain-of-Thought (CoT)…

Computation and Language · Computer Science 2025-02-28 Daniele Paliotta , Junxiong Wang , Matteo Pagliardini , Kevin Y. Li , Aviv Bick , J. Zico Kolter , Albert Gu , François Fleuret , Tri Dao

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

State space models (SSMs) have emerged as an efficient alternative to transformer-based models, offering linear complexity that scales better than transformers. One of the latest advances in SSMs, Mamba, introduces a selective scan…

Machine Learning · Computer Science 2025-03-03 Junpeng Wang , Chin-Chia Michael Yeh , Uday Singh Saini , Mahashweta Das

Despite the significant achievements of Vision Transformers (ViTs) in various vision tasks, they are constrained by the quadratic complexity. Recently, State Space Models (SSMs) have garnered widespread attention due to their global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Yuheng Shi , Minjing Dong , Chang Xu

Recent advances in efficient sequence modeling have introduced selective state-space layers, a key component of the Mamba architecture, which have demonstrated remarkable success in a wide range of NLP and vision tasks. While Mamba's…

Machine Learning · Computer Science 2025-02-05 Edo Cohen-Karlik , Itamar Zimerman , Liane Galanti , Ido Atad , Amir Globerson , Lior Wolf

We present Jamba, a new base large language model based on a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture. Specifically, Jamba interleaves blocks of Transformer and Mamba layers, enjoying the benefits of both model…

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

The recent empirical success of Mamba and other selective state space models (SSMs) has renewed interest in non-attention architectures for sequence modeling, yet their theoretical foundations remain underexplored. We present a first-step…

Machine Learning · Computer Science 2026-02-16 Mugunthan Shandirasegaran , Hongkang Li , Songyang Zhang , Meng Wang , Shuai Zhang

Bio-inspired Spiking Neural Networks (SNNs) provide an energy-efficient way to extract 3D spatio-temporal features. However, existing 3D SNNs have struggled with long-range dependencies until the recent emergence of Mamba, which offers…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Peixi Wu , Bosong Chai , Menghua Zheng , Wei Li , Zhangchi Hu , Jie Chen , Zheyu Zhang , Hebei Li , Xiaoyan Sun

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diego Adame , Fabian Vazquez , Jose A. Nunez , Huimin Li , Jinghao Yang , Erik Enriquez , DongChul Kim , Haoteng Tang , Bin Fu , Pengfei Gu

State Space Models (SSMs) have emerged as a potent tool in sequence modeling tasks in recent years. These models approximate continuous systems using a set of basis functions and discretize them to handle input data, making them well-suited…

Machine Learning · Computer Science 2024-07-16 Jiaxi Hu , Disen Lan , Ziyu Zhou , Qingsong Wen , Yuxuan Liang