English
Related papers

Related papers: Visual Attention Exploration in Vision-Based Mamba…

200 papers

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Efficiently modeling large 2D contexts is essential for various fields including Giga-Pixel Whole Slide Imaging (WSI) and remote sensing. Transformer-based models offer high parallelism but face challenges due to their quadratic complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jingwei Zhang , Anh Tien Nguyen , Xi Han , Vincent Quoc-Huy Trinh , Hong Qin , Dimitris Samaras , Mahdi S. Hosseini

Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches. However, CNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational complexity.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haoyang He , Yuhu Bai , Jiangning Zhang , Qingdong He , Hongxu Chen , Zhenye Gan , Chengjie Wang , Xiangtai Li , Guanzhong Tian , Lei Xie

Structured state space models (SSMs) have recently emerged as a promising foundation for sequence modeling, with Mamba-based architectures demonstrating strong performance through input-dependent state transitions, albeit at considerable…

Machine Learning · Computer Science 2026-05-28 Hassan Saadatmand , Geoffrey I. Webb , Hamid Rezatofighi , Mahsa Salehi

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

Machine Learning · Computer Science 2025-07-31 Alice Zhang , Chao Li

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

Machine Learning · Computer Science 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis

State Space Models (SSMs) have emerged as powerful alternatives to attention-based Transformers, with Mamba demonstrating impressive efficiency and scalability. As these models grow increasingly larger, the need for Parameter-Efficient…

Machine Learning · Computer Science 2026-03-03 Donghyun Lee , Yuhang Li , Ruokai Yin , Shiting Xiao , Priyadarshini Panda

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu

Hybrid models that combine state space models (SSMs) with attention mechanisms have shown strong performance by leveraging the efficiency of SSMs and the high recall ability of attention. However, the architectural design choices behind…

Computation and Language · Computer Science 2025-11-03 Hyunji Lee , Wenhao Yu , Hongming Zhang , Kaixin Ma , Jiyeon Kim , Dong Yu , Minjoon Seo

3D visual perception tasks, such as 3D detection from multi-camera images, are essential components of autonomous driving and assistance systems. However, designing computationally efficient methods remains a significant challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Hongyu Ke , Jack Morris , Kentaro Oguchi , Xiaofei Cao , Yongkang Liu , Haoxin Wang , Yi Ding

As one of the most representative DL techniques, Transformer architecture has empowered numerous advanced models, especially the large language models (LLMs) that comprise billions of parameters, becoming a cornerstone in deep learning.…

Machine Learning · Computer Science 2026-04-07 Haohao Qu , Liangbo Ning , Rui An , Wenqi Fan , Tyler Derr , Hui Liu , Xin Xu , Qing Li

Large pre-trained models have achieved outstanding results in sequence modeling. The Transformer block and its attention mechanism have been the main drivers of the success of these models. Recently, alternative architectures, such as…

Machine Learning · Computer Science 2025-01-29 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

Recent advancements in medical imaging have resulted in more complex and diverse images, with challenges such as high anatomical variability, blurred tissue boundaries, low organ contrast, and noise. Traditional segmentation methods…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Yufeng Jiang , Zongxi Li , Xiangyan Chen , Haoran Xie , Jing Cai

State Space Models (SSMs) have emerged as a promising alternative to the popular transformer-based models and have been increasingly gaining attention. Compared to transformers, SSMs excel at tasks with sequential data or longer contexts,…

Machine Learning · Computer Science 2025-03-17 Xingtai Lv , Youbang Sun , Kaiyan Zhang , Shang Qu , Xuekai Zhu , Yuchen Fan , Yi Wu , Ermo Hua , Xinwei Long , Ning Ding , Bowen Zhou

Recent Vision Mamba (Vim) models exhibit nearly linear complexity in sequence length, making them highly attractive for processing visual data. However, the training methodologies and their potential are still not sufficiently explored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zizheng Huang , Haoxing Chen , Jiaqi Li , Jun Lan , Huijia Zhu , Weiqiang Wang , Limin Wang

Structured state-space models (SSMs) such as S4, stemming from the seminal work of Gu et al., are gaining popularity as effective approaches for modeling sequential data. Deep SSMs demonstrate outstanding performance across a diverse set of…

Machine Learning · Computer Science 2025-01-07 Nicola Muca Cirone , Antonio Orvieto , Benjamin Walker , Cristopher Salvi , Terry Lyons

The problem of imputing multivariate time series spans a wide range of fields, from clinical healthcare to multi-sensor systems. Initially, Recurrent Neural Networks (RNNs) were employed for this task; however, their error accumulation…

Machine Learning · Computer Science 2024-10-10 Javier Solís-García , Belén Vega-Márquez , Juan A. Nepomuceno , Isabel A. Nepomuceno-Chamorro

Recent advancements in sequence modeling have led to the development of the Mamba architecture, noted for its selective state space approach, offering a promising avenue for efficient long sequence handling. However, its application in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Shentong Mo

The Transformer model, particularly its cross-attention module, is widely used for feature fusion in target sound extraction which extracts the signal of interest based on given clues. Despite its effectiveness, this approach suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-26 Donghang Wu , Yiwen Wang , Xihong Wu , Tianshu Qu

The vision-language tracking task aims to perform object tracking based on various modality references. Existing Transformer-based vision-language tracking methods have made remarkable progress by leveraging the global modeling ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xinqi Liu , Li Zhou , Zikun Zhou , Jianqiu Chen , Zhenyu He