中文
相关论文

相关论文: Surface Vision Mamba: Leveraging Bidirectional Sta…

200 篇论文

The diffusion model has long been plagued by scalability and quadratic complexity issues, especially within transformer-based structures. In this study, we aim to leverage the long sequence modeling capability of a State-Space Model called…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Vincent Tao Hu , Stefan Andreas Baumann , Ming Gui , Olga Grebenkova , Pingchuan Ma , Johannes Schusterbauer , Björn Ommer

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

计算机视觉与模式识别 · 计算机科学 2025-07-28 Rui Pan , Ruiying Lu

Accurate Autism Spectrum Disorder (ASD) diagnosis is vital for early intervention. This study presents a hybrid deep learning framework combining Vision Transformers (ViT) and Vision Mamba to detect ASD using eye-tracking data. The model…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Wafaa Kasri , Yassine Himeur , Abigail Copiaco , Wathiq Mansoor , Ammar Albanna , Valsamma Eapen

State Space Models (SSMs) have recently emerged as an alternative to Vision Transformers (ViTs) due to their unique ability of modeling global relationships with linear complexity. SSMs are specifically designed to capture spatially…

State-space models (SSMs), such as Mamba (Gu & Dao, 2023), have been proposed as alternatives to Transformer networks in language modeling, by incorporating gating, convolutions, and input-dependent token selection to mitigate the quadratic…

Medical video segmentation gains increasing attention in clinical practice due to the redundant dynamic references in video frames. However, traditional convolutional neural networks have a limited receptive field and transformer-based…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Yijun Yang , Zhaohu Xing , Lequan Yu , Chunwang Huang , Huazhu Fu , Lei Zhu

In complex auditory environments, the human auditory system possesses the remarkable ability to focus on a specific speaker while disregarding others. In this study, a new model named SWIM, a short-window convolution neural network (CNN)…

音频与语音处理 · 电气工程与系统科学 2024-11-28 Ziyang Zhang , Andrew Thwaites , Alexandra Woolgar , Brian Moore , Chao Zhang

The Mamba model, utilizing a structured state-space model (SSM), offers linear time complexity and demonstrates significant potential. Vision Mamba (ViM) extends this framework to vision tasks by incorporating a bidirectional SSM and patch…

图像与视频处理 · 电气工程与系统科学 2025-02-14 Bo-Yun Shi , Yi-Cheng Lo , An-Yeu , Wu , Yi-Min Tsai

High-resolution remotely sensed images pose a challenge for commonly used semantic segmentation methods such as Convolutional Neural Network (CNN) and Vision Transformer (ViT). CNN-based methods struggle with handling such high-resolution…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Qinfeng Zhu , Yuanzhi Cai , Yuan Fang , Yihan Yang , Cheng Chen , Lei Fan , Anh Nguyen

We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Chenhongyi Yang , Zehui Chen , Miguel Espinosa , Linus Ericsson , Zhenyu Wang , Jiaming Liu , Elliot J. Crowley

Background: High-resolution MRI is critical for diagnosis, but long acquisition times limit clinical use. Super-resolution (SR) can enhance resolution post-scan, yet existing deep learning methods face fidelity-efficiency trade-offs.…

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

Despite the significant achievements of Vision Transformers (ViTs) in various vision tasks, they are constrained by the quadratic complexity. Recently, State Space Models (SSMs) have garnered widespread attention due to their global…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Yuheng Shi , Minjing Dong , Chang Xu

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

Transformers have proven effective in language modeling but are limited by high computational and memory demands that grow quadratically with input sequence length. State space models (SSMs) offer a promising alternative by reducing…

硬件体系结构 · 计算机科学 2025-08-06 Dongho Yoon , Gungyu Lee , Jaewon Chang , Yunjae Lee , Dongjae Lee , Minsoo Rhu

State space models have shown significant promise in Natural Language Processing (NLP) and, more recently, computer vision. This paper introduces a new methodology leveraging Mamba and Masked Autoencoder networks for point cloud data in…

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but…

图像与视频处理 · 电气工程与系统科学 2024-08-06 Guanyiman Fu , Fengchao Xiong , Jianfeng Lu , Jun Zhou

Mamba-based vision models have gained extensive attention as a result of being computationally more efficient than attention-based models. However, spatial redundancy still exists in these models, represented by token and block redundancy.…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Mengxuan Wu , Zekai Li , Zhiyuan Liang , Moyang Li , Xuanlei Zhao , Samir Khaki , Zheng Zhu , Xiaojiang Peng , Konstantinos N. Plataniotis , Kai Wang , Wangbo Zhao , Yang You

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu