English
Related papers

Related papers: Mamba-driven multi-perspective structural understa…

200 papers

Scaling inference-time compute has emerged as an important driver of LLM performance, making inference efficiency a central focus of model design alongside model quality. While the current Transformer-based models deliver strong model…

Machine Learning · Computer Science 2026-03-17 Aakash Lahoti , Kevin Y. Li , Berlin Chen , Caitlin Wang , Aviv Bick , J. Zico Kolter , Tri Dao , Albert Gu

Mamba, an architecture with RNN-like token mixer of state space model (SSM), was recently introduced to address the quadratic complexity of the attention mechanism and subsequently applied to vision tasks. Nevertheless, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Weihao Yu , Xinchao Wang

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Language models are widely used in chemistry for molecular property prediction and small-molecule generation, yet Natural Products (NPs) remain underexplored despite their importance in drug discovery. To address this gap, we develop…

Machine Learning · Computer Science 2026-02-17 Ho-Hsuan Wang , Afnan Sultan , Andrea Volkamer , Dietrich Klakow

Hyperspectral image (HSI) classification has garnered substantial attention in remote sensing fields. Recent Mamba architectures built upon the Selective State Space Models (S6) have demonstrated enormous potential in long-range sequence…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yan He , Bing Tu , Puzhao Jiang , Bo Liu , Jun Li , Antonio Plaza

Point cloud completion aims to generate a complete and high-fidelity point cloud from an initially incomplete and low-quality input. A prevalent strategy involves leveraging Transformer-based models to encode global features and facilitate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yixuan Li , Weidong Yang , Ben Fei

In this paper, we propose a self-prior guided Mamba-UNet network (SMamba-UNet) for medical image super-resolution. Existing methods are primarily based on convolutional neural networks (CNNs) or Transformers. CNNs-based methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zexin Ji , Beiji Zou , Xiaoyan Kui , Pierre Vera , Su Ruan

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Zehui Chen , Miguel Espinosa , Linus Ericsson , Zhenyu Wang , Jiaming Liu , Elliot J. Crowley

With the rapid growth of the Internet of Things ecosystem, Automatic Modulation Classification (AMC) has become increasingly paramount. However, extended signal lengths offer a bounty of information, yet impede the model's adaptability,…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Yezhuo Zhang , Zinan Zhou , Yichao Cao , Guangyu Li , Xuanpeng Li

Semantic segmentation, as a basic tool for intelligent interpretation of remote sensing images, plays a vital role in many Earth Observation (EO) applications. Nowadays, accurate semantic segmentation of remote sensing images remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Libo Wang , Dongxu Li , Sijun Dong , Xiaoliang Meng , Xiaokang Zhang , Danfeng Hong

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

The recent surge in State Space Models (SSMs), particularly the emergence of Mamba, has established them as strong alternatives or complementary modules to Transformers across diverse domains. In this work, we aim to explore the potential…

Sound · Computer Science 2025-07-10 Wei-Jaw Lee , Fang-Chih Hsieh , Xuanjun Chen , Fang-Duo Tsai , Yi-Hsuan Yang

Human activity recognition (HAR) from inertial sensors is essential for ubiquitous computing, mobile health, and ambient intelligence. Conventional deep models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs),…

Human-Computer Interaction · Computer Science 2025-11-27 Thai-Khanh Nguyen , Uyen Vo , Tan M. Nguyen , Thieu N. Vo , Trung-Hieu Le , Cuong Pham

Large language models (LLMs) have advanced significantly due to the attention mechanism, but their quadratic complexity and linear memory demands limit their performance on long-context tasks. Recently, researchers introduced Mamba, an…

Computation and Language · Computer Science 2024-10-22 Wangjie You , Zecheng Tang , Juntao Li , Lili Yao , Min Zhang

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views. Existing multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xiaoyu Zheng , Xu Chen , Shaogang Gong , Xavier Griffin , Greg Slabaugh

Hyperspectral image (HSI) classification has been one of the hot topics in remote sensing fields. Recently, the Mamba architecture based on selective state-space models (S6) has demonstrated great advantages in long sequence modeling.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Hongxing Peng , Kang Lin , Huanai Liu

Point cloud registration (PCR) is a fundamental task in 3D computer vision and robotics. Most learning-based PCR methods rely on Transformer architectures, which suffer from quadratic computational complexity. This limitation restricts the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Bingxi Liu , An Liu , Hao Chen , Huaqi Tao , Jinqiang Cui , Yiqun Wang , Hong Zhang

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyang Wang , Jian-Qing Zheng , Yichi Zhang , Ge Cui , Lei Li