中文
相关论文

相关论文: Progressive Split Mamba: Effective State Space Mod…

200 篇论文

Infrared image super-resolution demands long-range dependency modeling and multi-scale feature extraction to address challenges such as homogeneous backgrounds, weak edges, and sparse textures. While Mamba-based state-space models (SSMs)…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yongsong Huang , Tomo Miyazaki , Xiaofeng Liu , Shinichiro Omachi

State Space Models (SSMs) with selective scan (Mamba) have been adapted into efficient vision models. Mamba, unlike Vision Transformers, achieves linear complexity for token interactions through a recurrent hidden state process. This…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Saarthak Kapse , Robin Betz , Srinivasan Sivanandan

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Chenhongyi Yang , Zehui Chen , Miguel Espinosa , Linus Ericsson , Zhenyu Wang , Jiaming Liu , Elliot J. Crowley

Mainstream approaches to spectral reconstruction (SR) primarily focus on designing Convolution- and Transformer-based architectures. However, CNN methods often face challenges in handling long-range dependencies, whereas Transformers are…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Xinying Wang , Zhixiong Huang , Sifan Zhang , Jiawen Zhu , Paolo Gamba , Lin Feng

Deep unfolding methods have made impressive progress in restoring 3D hyperspectral images (HSIs) from 2D measurements through convolution neural networks or Transformers in spectral compressive imaging. However, they cannot efficiently…

图像与视频处理 · 电气工程与系统科学 2024-06-04 Jiahua Dong , Hui Yin , Hongliu Li , Wenbo Li , Yulun Zhang , Salman Khan , Fahad Shahbaz Khan

The advent of Transformer and Mamba-based architectures has significantly advanced 3D medical image segmentation by enabling global contextual modeling, a capability traditionally limited in Convolutional Neural Networks (CNNs). However,…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Duy D. Nguyen , Phat T. Tran-Truong

Mamba, a State Space Model (SSM), has recently shown competitive performance to Convolutional Neural Networks (CNNs) and Transformers in Natural Language Processing and general sequence modeling. Various attempts have been made to adapt…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Trung Dinh Quoc Dang , Huy Hoang Nguyen , Aleksei Tiulpin

Semantic segmentation, as a basic tool for intelligent interpretation of remote sensing images, plays a vital role in many Earth Observation (EO) applications. Nowadays, accurate semantic segmentation of remote sensing images remains a…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Libo Wang , Dongxu Li , Sijun Dong , Xiaoliang Meng , Xiaokang Zhang , Danfeng Hong

Depth map super-resolution technology aims to improve the spatial resolution of low-resolution depth maps and effectively restore high-frequency detail information. Traditional convolutional neural network has limitations in dealing with…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Chenggang Guo , Hao Xu , XianMing Wan

Recent years have seen significant advancements in image restoration, largely attributed to the development of modern deep neural networks, such as CNNs and Transformers. However, existing restoration backbones often face the dilemma…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Hang Guo , Jinmin Li , Tao Dai , Zhihao Ouyang , Xudong Ren , Shu-Tao Xia

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

机器学习 · 计算机科学 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Recent years have witnessed significant advancements in light field image super-resolution (LFSR) owing to the progress of modern neural networks. However, these methods often face challenges in capturing long-range dependencies (CNN-based)…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Wang xia , Yao Lu , Shunzhou Wang , Ziqi Wang , Peiqi Xia , Tianfei Zhou

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

机器学习 · 计算机科学 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

Recent advancements in transformers, specifically self-attention mechanisms, have significantly improved hyperspectral image (HSI) classification. However, these models often suffer from inefficiencies, as their computational complexity…

Domain generalization~(DG) aims at solving distribution shift problems in various scenes. Existing approaches are based on Convolution Neural Networks (CNNs) or Vision Transformers (ViTs), which suffer from limited receptive fields or…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Shaocong Long , Qianyu Zhou , Xiangtai Li , Xuequan Lu , Chenhao Ying , Yuan Luo , Lizhuang Ma , Shuicheng Yan

Mamba, with its selective State Space Models (SSMs), offers a more computationally efficient solution than Transformers for long-range dependency modeling. However, there is still a debate about its effectiveness in high-resolution 3D…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Chaohan Wang , Yutong Xie , Qi Chen , Yuyin Zhou , Qi Wu

State-Space Models (SSMs) have emerged as an efficient alternative to transformers, yet existing visual SSMs retain deeply ingrained biases from their origins in natural language processing. In this paper, we address these limitations by…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Enis Baty , Alejandro Hernández Díaz , Rebecca Davidson , Chris Bridges , Simon Hadfield

Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by attending to all past inputs simultaneously. However, its…

机器学习 · 计算机科学 2025-11-04 Xiongxiao Xu , Canyu Chen , Yueqing Liang , Baixiang Huang , Guangji Bai , Liang Zhao , Kai Shu