English
Related papers

Related papers: A Mamba-Based Model for Automatic Chord Recognitio…

200 papers

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang

Human activity recognition (HAR) from inertial sensors is essential for ubiquitous computing, mobile health, and ambient intelligence. Conventional deep models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs),…

Human-Computer Interaction · Computer Science 2025-11-27 Thai-Khanh Nguyen , Uyen Vo , Tan M. Nguyen , Thieu N. Vo , Trung-Hieu Le , Cuong Pham

Recent works have shown the remarkable superiority of transformer models in reinforcement learning (RL), where the decision-making problem is formulated as sequential generation. Transformer-based agents could emerge with self-improvement…

Machine Learning · Computer Science 2024-06-04 Sili Huang , Jifeng Hu , Zhejian Yang , Liwei Yang , Tao Luo , Hechang Chen , Lichao Sun , Bo Yang

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Yang Liu , Li Wan , Yiteng Huang , Ming Sun , Yangyang Shi , Florian Metze

Traffic image restoration under adverse weather conditions remains a critical challenge for intelligent transportation systems. Existing methods primarily focus on spatial-domain modeling but neglect frequency-domain priors. Although the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Liwen Pan , Longguang Wang , Guangwei Gao , Jun Wang , Jun Shi , Juncheng Li

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

Machine Learning · Computer Science 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

CrackMamba, a Mamba-based model, is designed for efficient and accurate crack segmentation for monitoring the structural health of infrastructure. Traditional Convolutional Neural Network (CNN) models struggle with limited receptive fields,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xin Zuo , Yu Sheng , Jifeng Shen , Yongwei Shan

State-space models (SSMs), particularly Mamba, have become powerful architectures for sequence modeling, yet their internal dynamics remain poorly understood compared to attention-based models. We introduce and validate the Influence Score,…

Machine Learning · Computer Science 2025-11-25 Mohamed Mabrok , Yalda Zafari

Current state-of-the-art (SOTA) methods in 3D Human Pose Estimation (HPE) are primarily based on Transformers. However, existing Transformer-based 3D HPE backbones often encounter a trade-off between accuracy and computational efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Xinyi Zhang , Qiqi Bao , Qinpeng Cui , Wenming Yang , Qingmin Liao

Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tao Wang , Tiecheng Bai , Chao Xu , Bin Liu , Erlei Zhang , Jiyun Huang , Hongming Zhang

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

Deep learning-based single-channel speaker separation has improved significantly in recent years largely due to the introduction of the transformer-based attention mechanism. However, these improvements come at the expense of intense…

Skeleton-based action recognition has garnered significant attention in the computer vision community. Inspired by the recent success of the selective state-space model (SSM) Mamba in modeling 1D temporal sequences, we propose TSkel-Mamba,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Yanan Liu , Jun Liu , Hao Zhang , Dan Xu , Hossein Rahmani , Mohammed Bennamoun , Qiuhong Ke

In this study, we focus on video captioning by fully open multimodal large language models (MLLMs). The comprehension of visual sequences is challenging because of their intricate temporal dependencies and substantial sequence length. The…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Daichi Yashima , Shuhei Kurita , Yusuke Oda , Shuntaro Suzuki , Seitaro Otsuki , Komei Sugiura

Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics and structured cross-channel dependencies, posing fundamental challenges for automated analysis. Conventional…

Signal Processing · Electrical Eng. & Systems 2026-05-08 ZhengXiao He , Huayu Li , Xiwen Chen , Janet M Roveda , Jinghao Wen , Siyuan Tian , Ao Li

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

Machine Learning · Computer Science 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

Myocardial motion tracking is important for assessing cardiac function and diagnosing cardiovascular diseases, for which cine cardiac magnetic resonance (CMR) has been established as the gold standard imaging modality. Many existing methods…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Jiahui Yin , Xinxing Cheng , Jinming Duan , Yan Pang , Declan O'Regan , Hadrien Reynaud , Qingjie Meng

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

Machine Learning · Computer Science 2025-07-31 Alice Zhang , Chao Li

Nuclei segmentation and classification provide an essential basis for tumor immune microenvironment analysis. The previous nuclei segmentation and classification models require splitting large images into smaller patches for training,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ye Zhang , Zijie Fang , Yifeng Wang , Lingbo Zhang , Xianchao Guan , Yongbing Zhang

The Sequential Recommendation modeling paradigm is shifting from Transformer to Mamba architecture, which comprises two generations: Mamba1, based on the State Space Model (SSM), and Mamba2, based on State Space Duality (SSD). Although SSD…

Information Retrieval · Computer Science 2025-08-21 Hao Fan , Mengyi Zhu , Yanrong Hu , Hailin Feng , Zhijie He , Hongjiu Liu , Qingyang Liu