中文
相关论文

相关论文: StruMamba3D: Exploring Structural Mamba for Self-s…

200 篇论文

Despite the prevalence of images and texts in machine learning, tabular data remains widely used across various domains. Existing deep learning models, such as convolutional neural networks and transformers, perform well however demand…

机器学习 · 计算机科学 2024-06-26 Md Atik Ahamed , Qiang Cheng

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

We present Schr\"odinger Bridge Mamba (SBM), a novel model for efficient speech enhancement by integrating the Schr\"odinger Bridge (SB) training paradigm and the Mamba architecture. Experiments of joint denoising and dereverberation tasks…

声音 · 计算机科学 2026-03-06 Jing Yang , Sirui Wang , Chao Wu , Lei Guo , Fan Fan

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but…

图像与视频处理 · 电气工程与系统科学 2024-08-06 Guanyiman Fu , Fengchao Xiong , Jianfeng Lu , Jun Zhou

Mamba has garnered widespread attention due to its flexible design and efficient hardware performance to process 1D sequences based on the state space model (SSM). Recent studies have attempted to apply Mamba to the visual domain by…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Chengkun Wang , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

Event cameras draw inspiration from biological systems, boasting low latency and high dynamic range while consuming minimal power. The most current approach to processing Event Cloud often involves converting it into frame-based…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Hongwei Ren , Yue Zhou , Jiadong Zhu , Haotian Fu , Yulong Huang , Xiaopeng Lin , Yuetong Fang , Fei Ma , Hao Yu , Bojun Cheng

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

音频与语音处理 · 电气工程与系统科学 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

机器学习 · 计算机科学 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

State Space Model (SSM)-based machine learning architectures have recently gained significant attention for processing sequential data. Mamba, a recent sequence-to-sequence SSM, offers competitive accuracy with superior computational…

机器学习 · 计算机科学 2025-08-15 Jiyong Kim , Jaeho Lee , Jiahao Lin , Alish Kanani , Miao Sun , Umit Y. Ogras , Jaehyun Park

Sequential recommendation methods are crucial in modern recommender systems for their remarkable capability to understand a user's changing interests based on past interactions. However, a significant challenge faced by current methods…

信息检索 · 计算机科学 2025-01-17 Haohao Qu , Yifeng Zhang , Liangbo Ning , Wenqi Fan , Qing Li

In the field of biomedical image analysis, the quest for architectures capable of effectively capturing long-range dependencies is paramount, especially when dealing with 3D image segmentation, classification, and landmark detection.…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Haifan Gong , Luoyao Kang , Yitao Wang , Xiang Wan , Haofeng Li

This paper explores the capability of Mamba, a recently proposed architecture based on state space models (SSMs), as a competitive alternative to Transformer-based models. In the speech domain, well-designed Transformer-based models, such…

声音 · 计算机科学 2024-06-25 Koichi Miyazaki , Yoshiki Masuyama , Masato Murata

Spatial-Temporal Graph (STG) data is characterized as dynamic, heterogenous, and non-stationary, leading to the continuous challenge of spatial-temporal graph learning. In the past few years, various GNN-based methods have been proposed to…

机器学习 · 计算机科学 2024-05-21 Lincan Li , Hanchen Wang , Wenjie Zhang , Adelle Coster

Self-supervised Learning (SSL) has become a powerful paradigm for representation learning without manual annotations. However, most existing frameworks focus on global alignment and struggle to capture the hierarchical, multi-scale lesion…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Abdullah Al Mamun , Miaohua Zhang , David Ahmedt-Aristizabal , Zeeshan Hayder , Mohammad Awrangjeb

State-space language models such as Mamba match Transformer quality while permitting linear complexity inference, yet still comprise billions of parameters that hinder deployment. Existing one-shot pruning methods are tailored to attention…

机器学习 · 计算机科学 2025-06-12 Kaiwen Tuo , Huan Wang

State space models (SSMs) have emerged as a powerful paradigm for efficient single-image super-resolution (SR) due to their linear complexity and long-range modeling capabilities. However, existing Mamba-based methods typically rely on…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Wenbin Zou , Yawen Cui , Yi Wang , Lap-Pui Chau , Liang Chen , Jinshan Pan , Huiping Zhuang , Guanbin Li

State-Space Models (SSMs), and particularly Mamba, have recently emerged as a promising alternative to Transformers. Mamba introduces input selectivity to its SSM layer (S6) and incorporates convolution and gating into its block definition.…

机器学习 · 计算机科学 2025-06-16 Ningyuan Huang , Miguel Sarabia , Abhinav Moudgil , Pau Rodriguez , Luca Zappella , Federico Danieli