English
Related papers

Related papers: Point Mamba: A Novel Point Cloud Backbone Based on…

200 papers

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Guanyiman Fu , Fengchao Xiong , Jianfeng Lu , Jun Zhou

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

Machine Learning · Computer Science 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

State-space models (SSMs) have emerged as an efficient strategy for building powerful language models, avoiding the quadratic complexity of computing attention in transformers. Despite their promise, the interpretability and steerability of…

Machine Learning · Computer Science 2026-05-22 Vamshi Sunku Mohan , Kaustubh Gupta , Aneesha Das , Chandan Singh

We propose Samba ASR,the first state of the art Automatic Speech Recognition(ASR)model leveraging the novel Mamba architecture as both encoder and decoder,built on the foundation of state space models(SSMs).Unlike transformerbased ASR…

Computation and Language · Computer Science 2025-01-09 Syed Abdul Gaffar Shakhadri , Kruthika KR , Kartik Basavaraj Angadi

Recent works have demonstrated that attention-based transformer and large language model (LLM) architectures can achieve strong channel state prediction (CSP) performance by capturing long-range temporal dependencies across channel state…

Information Theory · Computer Science 2026-04-27 Aladin Djuhera , Haris Gacanin , Holger Boche

Two-view correspondence learning aims to discern true and false correspondences between image pairs by recognizing their underlying different information. Previous methods either treat the information equally or require the explicit storage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiang Fang , Shihua Zhang , Hao Zhang , Tao Lu , Huabing Zhou , Jiayi Ma

State Space Models (SSMs) are emerging as a compelling alternative to Transformers because of their consistent memory usage and high performance. Despite this, scaling up SSMs on cloud services or limited-resource devices is challenging due…

Machine Learning · Computer Science 2025-11-07 Hung-Yueh Chiang , Chi-Chih Chang , Natalia Frumkin , Kai-Chiang Wu , Mohamed S. Abdelfattah , Diana Marculescu

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational complexity results in…

Machine Learning · Computer Science 2024-07-23 Shusen Ma , Yu Kang , Peng Bai , Yun-Bo Zhao

The advent of single-cell multi-omics technologies has enabled the simultaneous profiling of diverse omics layers within individual cells. Integrating such multimodal data provides unprecedented insights into cellular identity, regulatory…

Cell Behavior · Quantitative Biology 2025-06-27 Zhen Yuan , Shaoqing Jiao , Yihang Xiao , Jiajie Peng

Accurate 3D point cloud registration underpins reliable image-guided colonoscopy, directly affecting lesion localization, margin assessment, and navigation safety. However, biological tissue exhibits repetitive textures and locally…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Linzhe Jiang , Jiayuan Huang , Sophia Bano , Matthew J. Clarkson , Zhehua Mao , Mobarak I. Hoque

Infrared image super-resolution demands long-range dependency modeling and multi-scale feature extraction to address challenges such as homogeneous backgrounds, weak edges, and sparse textures. While Mamba-based state-space models (SSMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yongsong Huang , Tomo Miyazaki , Xiaofeng Liu , Shinichiro Omachi

Deep learning-based point cloud modeling has been widely investigated as an indispensable component of general shape analysis. Recently, transformer and state space model (SSM) have shown promising capacities in point cloud learning.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Guoqing Zhang , Jingyun Yang , Yang Li

Efficiently modeling large 2D contexts is essential for various fields including Giga-Pixel Whole Slide Imaging (WSI) and remote sensing. Transformer-based models offer high parallelism but face challenges due to their quadratic complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jingwei Zhang , Anh Tien Nguyen , Xi Han , Vincent Quoc-Huy Trinh , Hong Qin , Dimitris Samaras , Mahdi S. Hosseini

Handling sparse and unstructured geometric data, such as point clouds or event-based vision, is a pressing challenge in the field of machine vision. Recently, sequence models such as Transformers and state-space models entered the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Mark Schöne , Yash Bhisikar , Karan Bania , Khaleelulla Khan Nazeer , Christian Mayr , Anand Subramoney , David Kappel

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

Mesh saliency enhances the adaptability of 3D vision by identifying and emphasizing regions that naturally attract visual attention. To investigate the interaction between geometric structure and texture in shaping visual attention, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Kaiwei Zhang , Dandan Zhu , Xiongkuo Min , Guangtao Zhai

Diffusion models currently demonstrate impressive performance over various generative tasks. Recent work on image diffusion highlights the strong capabilities of Mamba (state space models) due to its efficient handling of long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jiaxu Liu , Li Li , Hubert P. H. Shum , Toby P. Breckon

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

Sound · Computer Science 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

Accurate building segmentation and height estimation from single-view RGB satellite imagery are fundamental for urban analytics, yet remain ill-posed due to structural variability and the high computational cost of global context modeling.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Sinan U. Ulu , A. Enes Doruk , I. Can Yagmur , Bahadir K. Gunturk , Oguz Hanoglu , Hasan F. Ates

Land cover analysis using hyperspectral images (HSI) remains an open problem due to their low spatial resolution and complex spectral information. Recent studies are primarily dedicated to designing Transformer-based architectures for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Guanchun Wang , Xiangrong Zhang , Zelin Peng , Tianyang Zhang , Licheng Jiao