English
Related papers

Related papers: PointABM:Integrating Bidirectional State Space Mod…

200 papers

Attention-based methods have demonstrated exceptional performance in modelling long-range dependencies on spherical cortical surfaces, surpassing traditional Geometric Deep Learning (GDL) models. However, their extensive inference time and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Rongzhao He , Weihao Zheng , Leilei Zhao , Ying Wang , Dalin Zhu , Dan Wu , Bin Hu

Accurate 3D medical image segmentation demands architectures capable of reconciling global context modeling with spatial topology preservation. While State Space Models (SSMs) like Mamba show potential for sequence modeling, existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Hangyu Ji

Point cloud completion is a fundamental task in 3D vision. A persistent challenge in this field is simultaneously preserving fine-grained details present in the input while ensuring the global structural integrity of the completed shape.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Lirui Zhang , Zhengkai Zhao , Zhi Zuo , Pan Gao , Jie Qin

This paper proposes a Mamba-assisted neural network framework incorporating self-attention mechanism to achieve improved channel estimation with low complexity for orthogonal frequency-division multiplexing (OFDM) waveforms, particularly…

Machine Learning · Computer Science 2026-01-27 Dianxin Luan , Chengsi Liang , Jie Huang , Zheng Lin , Kaitao Meng , John Thompson , Cheng-Xiang Wang

Domain Adaptive Object Detection (DAOD) aims to transfer detectors from a labeled source domain to an unlabeled target domain. Existing DAOD methods employ multi-granularity feature alignment to learn domain-invariant representations.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Haochen Li , Rui Zhang , Hantao Yao , Xin Zhang , Yifan Hao , Shaohui Peng , Yongwei Zhao , Ling Li

Ground-based cloud image segmentation is a critical research domain for photovoltaic power forecasting. Current deep learning approaches primarily focus on encoder-decoder architectural refinements. However, existing methodologies exhibit…

Machine Learning · Computer Science 2026-02-17 Penghui Niu , Jiashuai She , Taotao Cai , Yajuan Zhang , Ping Zhang , Junhua Gu , Jianxin Li

Transformer, a deep neural network architecture, has long dominated the field of natural language processing and beyond. Nevertheless, the recent introduction of Mamba challenges its supremacy, sparks considerable interest among…

Computation and Language · Computer Science 2024-06-25 Yuchen Zou , Yineng Chen , Zuchao Li , Lefei Zhang , Hai Zhao

The typical Selective State-Space Model (SSM) used in Mamba addresses several limitations of Transformers, such as the quadratic computational complexity with respect to sequence length and the significant memory requirements during…

Computation and Language · Computer Science 2025-10-24 Shengkun Tang , Liqun Ma , Haonan Li , Mingjie Sun , Zhiqiang Shen

Transformer-based methods for 3D human pose estimation face significant computational challenges due to the quadratic growth of self-attention mechanism complexity with sequence length. Recently, the Mamba model has substantially reduced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zenghao Zheng , Lianping Yang , Jinshan Pan , Hegui Zhu

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

Effectively modeling global context information in hyperspectral image (HSI) denoising is crucial, but prevailing methods using convolution or transformers still face localized or computational efficiency limitations. Inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yang Liu , Jiahua Xiao , Xiang Song , Yu Guo , Peilin Jiang , Haiwei Yang , Fei Wang

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Longhui Zheng , Qiming Xia , Xiaolu Chen , Zhaoliang Liu , Chenglu Wen

State space models (SSMs), such as Mamba, have emerged as an efficient alternative to transformers for long-context sequence modeling. However, despite their growing adoption, SSMs lack the interpretability tools that have been crucial for…

Computation and Language · Computer Science 2025-02-26 Hugo Pitorro , Marcos Treviso

In recent years, Transformers-based models have made significant progress in the field of image restoration by leveraging their inherent ability to capture complex contextual features. Recently, Mamba models have made a splash in the field…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Juan Wen , Weiyan Hou , Luc Van Gool , Radu Timofte

Prior efforts in light-weight model development mainly centered on CNN and Transformer-based designs yet faced persistent challenges. CNNs adept at local feature extraction compromise resolution while Transformers offer global reach but…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Xiaohuan Pei , Tao Huang , Chang Xu

In image fusion tasks, images from different sources possess distinct characteristics. This has driven the development of numerous methods to explore better ways of fusing them while preserving their respective characteristics.Mamba, as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zihan Cao , Xiao Wu , Liang-Jian Deng , Yu Zhong

In recent years, point cloud analysis methods based on the Transformer architecture have made significant progress, particularly in the context of multimedia applications such as 3D modeling, virtual reality, and autonomous systems.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qiang Zheng , Chao Zhang , Jian Sun

Linear State Space Models (SSMs) offer remarkable performance gains in efficient sequence modeling, with constant inference-time computation and memory complexity. Recent advances, such as Mamba, further enhance SSMs with input-dependent…

Machine Learning · Computer Science 2025-06-24 Zheng Zhan , Liliang Ren , Shuohang Wang , Liyuan Liu , Yang Liu , Yeyun Gong , Yanzhi Wang , Yelong Shen