中文
相关论文

相关论文: MemoryMamba: Memory-Augmented State Space Model fo…

200 篇论文

The essence of multi-modal fusion lies in exploiting the complementary information inherent in diverse modalities. However, prevalent fusion methods rely on traditional neural architectures and are inadequately equipped to capture the…

人工智能 · 计算机科学 2025-06-19 Wenbing Li , Hang Zhou , Junqing Yu , Zikai Song , Wei Yang

The growing demand for efficient long-sequence modeling on edge devices has propelled widespread adoption of State Space Models (SSMs) like Mamba, due to their superior computational efficiency and scalability. As its autoregressive…

硬件体系结构 · 计算机科学 2025-09-25 Linfeng Zhong , Songqiang Xu , Huifeng Wen , Tong Xie , Qingyu Guo , Yuan Wang , Meng Li

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

机器学习 · 计算机科学 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Surgical phase recognition is crucial for enhancing the efficiency and safety of computer-assisted interventions. One of the fundamental challenges involves modeling the long-distance temporal relationships present in surgical videos.…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Rui Cao , Jiangliu Wang , Yun-Hui Liu

Due to the long-range modeling ability and linear complexity property, Mamba has attracted considerable attention in point cloud analysis. Despite some interesting progress, related work still suffers from imperfect point cloud…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Kanglin Qu , Pan Gao , Qun Dai , Zhanzhi Ye , Rui Ye , Yuanhao Sun

In recent years, visually-rich document understanding has attracted increasing attention. Transformer-based pre-trained models have become the mainstream approach, yielding significant performance gains in this field. However, the…

计算与语言 · 计算机科学 2025-02-11 Pengfei Hu , Zhenrong Zhang , Jiefeng Ma , Shuhang Liu , Jun Du , Jianshu Zhang

Recent advancements in recurrent architectures, such as Mamba and RWKV, have showcased strong language capabilities. Unlike transformer-based models, these architectures encode all contextual information into a fixed-size state, leading to…

计算与语言 · 计算机科学 2026-01-14 Yingfa Chen , Xinrong Zhang , Shengding Hu , Xu Han , Zhiyuan Liu , Maosong Sun

Self-supervised Learning (SSL) has become a powerful paradigm for representation learning without manual annotations. However, most existing frameworks focus on global alignment and struggle to capture the hierarchical, multi-scale lesion…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Abdullah Al Mamun , Miaohua Zhang , David Ahmedt-Aristizabal , Zeeshan Hayder , Mohammad Awrangjeb

State space models (SSMs), particularly Mamba, have shown promise in NLP tasks and are increasingly applied to vision tasks. However, most Mamba-based vision models focus on network architecture and scan paths, with little attention to the…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yujie Zhu , Xinyi Zhang , Yekai Lu , Guang Yang , Faming Fang , Guixu Zhang

We introduce a novel state-space model (SSM)-based framework for skeleton-based human action recognition, with an anatomically-guided architecture that improves state-of-the-art performance in both clinical diagnostics and general action…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Niki Martinel , Mariano Serrao , Christian Micheloni

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Mamba-based architectures have shown to be a promising new direction for deep learning models owing to their competitive performance and sub-quadratic deployment speed. However, current Mamba multi-modal large language models (MLLM) are…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Yifei Xing , Xiangyuan Lan , Ruiping Wang , Dongmei Jiang , Wenjun Huang , Qingfang Zheng , Yaowei Wang

State Space Model (SSM)-based machine learning architectures have recently gained significant attention for processing sequential data. Mamba, a recent sequence-to-sequence SSM, offers competitive accuracy with superior computational…

机器学习 · 计算机科学 2025-08-15 Jiyong Kim , Jaeho Lee , Jiahao Lin , Alish Kanani , Miao Sun , Umit Y. Ogras , Jaehyun Park

State space models (SSMs) have emerged as an efficient alternative to transformer-based models, offering linear complexity that scales better than transformers. One of the latest advances in SSMs, Mamba, introduces a selective scan…

机器学习 · 计算机科学 2025-03-03 Junpeng Wang , Chin-Chia Michael Yeh , Uday Singh Saini , Mahashweta Das

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Ali Youssef

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

声音 · 计算机科学 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

Video anomaly detection (VAD) methods are mostly CNN-based or Transformer-based, achieving impressive results, but the focus on detection accuracy often comes at the expense of inference speed. The emergence of state space models in…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Jiahao Lyu , Minghua Zhao , Jing Hu , Xuewen Huang , Yifei Chen , Shuangli Du

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

机器学习 · 计算机科学 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

Transformers have proven effective in language modeling but are limited by high computational and memory demands that grow quadratically with input sequence length. State space models (SSMs) offer a promising alternative by reducing…

硬件体系结构 · 计算机科学 2025-08-06 Dongho Yoon , Gungyu Lee , Jaewon Chang , Yunjae Lee , Dongjae Lee , Minsoo Rhu

Recently, the state space model (SSM) represented by Mamba has shown remarkable performance in long-term sequence modeling tasks, including speech enhancement. However, due to substantial differences in sub-band features, applying the same…

声音 · 计算机科学 2025-02-25 Jizhen Li , Weiping Tu , Yuhong Yang , Xinmeng Xu , Yiqun Zhang , Yanzhen Ren