English
Related papers

Related papers: CollaMamba: Efficient Collaborative Perception wit…

200 papers

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano

Video anomaly detection (VAD) has been extensively researched due to its potential for intelligent video systems. However, most existing methods based on CNNs and transformers still suffer from substantial computational burdens and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhangxun Li , Mengyang Zhao , Xuan Yang , Yang Liu , Jiamu Sheng , Xinhua Zeng , Tian Wang , Kewei Wu , Yu-Gang Jiang

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

Machine Learning · Computer Science 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

The Transformer model has demonstrated success across a wide range of domains, including in Multi-Agent Reinforcement Learning (MARL) where the Multi-Agent Transformer (MAT) has emerged as a leading algorithm in the field. However, a…

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

Remote sensing images are frequently obscured by cloud cover, posing significant challenges to data integrity and reliability. Effective cloud detection requires addressing both short-range spatial redundancies and long-range atmospheric…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Tianxiang Xue , Jiayi Zhao , Jingsheng Li , Changlu Chen , Kun Zhan

Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zifu Wan , Pingping Zhang , Yuhao Wang , Silong Yong , Simon Stepputtis , Katia Sycara , Yaqi Xie

Mamba, with its advantages of global perception and linear complexity, has been widely applied to identify changes of the target regions within the remote sensing (RS) images captured under complex scenarios and varied conditions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhenkai Wu , Xiaowen Ma , Rongrong Lian , Kai Zheng , Mengting Ma , Wei Zhang , Siyang Song

Multimodal Sentiment Analysis (MSA) requires effective modeling of cross-modal interactions and contextual dependencies while remaining computationally efficient. Existing fusion approaches predominantly rely on Transformer-based…

Computation and Language · Computer Science 2026-04-07 Minghai Jiao , Jing Xiao , Peng Xiao , Ende Zhang , Shuang Kan , Wenyan Jiang , Jinyao Li , Yixian Liu , Haidong Xin

Recent works have demonstrated that attention-based transformer and large language model (LLM) architectures can achieve strong channel state prediction (CSP) performance by capturing long-range temporal dependencies across channel state…

Information Theory · Computer Science 2026-04-27 Aladin Djuhera , Haris Gacanin , Holger Boche

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rui Pan , Ruiying Lu

Channel prediction is a key technology for improving the performance of various functions such as precoding, adaptive modulation, and resource allocation in MIMO-OFDM systems. Especially in high-mobility scenarios with fast time-varying…

Signal Processing · Electrical Eng. & Systems 2025-12-19 Sheng Luo , Jiashu Xie , Yueling Che , Junmei Yao , Jian Tian , Daquan Feng , Kaishun Wu

Point cloud segmentation is an important topic in 3D understanding that has traditionally has been tackled using either the CNN or Transformer. Recently, Mamba has emerged as a promising alternative, offering efficient long-range contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yong Xien Chng , Xuchong Qiu , Yizeng Han , Yifan Pu , Jiewei Cao , Gao Huang

Predicting user preferences and sequential dependencies based on historical behavior is the core goal of sequential recommendation. Although attention-based models have shown effectiveness in this field, they often struggle with inference…

Machine Learning · Computer Science 2024-06-11 Yuda Wang , Xuxin He , Shengxin Zhu

Reconstructing degraded images is a critical task in image processing. Although CNN and Transformer-based models are prevalent in this field, they exhibit inherent limitations, such as inadequate long-range dependency modeling and high…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Rui Deng , Tianpei Gu

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Puskal Khadka , KC Santosh

Two-view correspondence learning aims to discern true and false correspondences between image pairs by recognizing their underlying different information. Previous methods either treat the information equally or require the explicit storage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiang Fang , Shihua Zhang , Hao Zhang , Tao Lu , Huabing Zhou , Jiayi Ma

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu