中文
相关论文

相关论文: From Darkness to Detail: Frequency-Aware SSMs for …

200 篇论文

Diffusion models have achieved great success in image generation, with the backbone evolving from U-Net to Vision Transformers. However, the computational cost of Transformers is quadratic to the number of tokens, leading to significant…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Yao Teng , Yue Wu , Han Shi , Xuefei Ning , Guohao Dai , Yu Wang , Zhenguo Li , Xihui Liu

Transformers have become increasingly popular for image super-resolution (SR) tasks due to their strong global context modeling capabilities. However, their quadratic computational complexity necessitates the use of window-based attention…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Aman Urumbekov , Zheng Chen

Hyperspectral target detection (HTD) identifies objects of interest from complex backgrounds at the pixel level, playing a vital role in Earth observation. However, HTD faces challenges due to limited prior knowledge and spectral variation,…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Dunbin Shen , Xuanbing Zhu , Jiacheng Tian , Jianjun Liu , Zhenrong Du , Hongyu Wang , Xiaorui Ma

Face super-resolution (FSR) under limited computational budgets remains challenging. Existing methods often treat all facial pixels equally, leading to suboptimal resource allocation and degraded performance. CNNs are sensitive to…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Siyu Xu , Wenjie Li , Guangwei Gao , Jian Yang , Guo-Jun Qi , Chia-Wen Lin

State-space models (SSMs) have recently demonstrated competitive performance to transformers at large-scale language modeling benchmarks while achieving linear time and memory complexity as a function of sequence length. Mamba, a recently…

计算与语言 · 计算机科学 2024-02-06 Quentin Anthony , Yury Tokpanov , Paolo Glorioso , Beren Millidge

We propose an innovative enhancement to the Mamba framework by increasing the Hausdorff dimension of its scanning pattern through a novel Hilbert Selective Scan mechanism. This mechanism explores the feature space more effectively,…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Xinhua Wang , Caibo Feng , Xiangjun Fu , Chunxiao Liu

Convolutional neural networks have primarily led 3D medical image segmentation but may be limited by small receptive fields. Transformer models excel in capturing global relationships through self-attention but are challenged by high…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Ao Chang , Jiajun Zeng , Ruobing Huang , Dong Ni

Mamba-based vision models have gained extensive attention as a result of being computationally more efficient than attention-based models. However, spatial redundancy still exists in these models, represented by token and block redundancy.…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Mengxuan Wu , Zekai Li , Zhiyuan Liang , Moyang Li , Xuanlei Zhao , Samir Khaki , Zheng Zhu , Xiaojiang Peng , Konstantinos N. Plataniotis , Kai Wang , Wangbo Zhao , Yang You

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

Image shadow removal is a typical low-level vision task. Shadows cause local brightness shifts, which reduce the performance of downstream vision tasks. Currently, Transformer-based shadow removal methods suffer from quadratic computational…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Xiujin Zhu , Chee-Onn Chow , Joon Huang Chuah

We introduce LocoMamba, a vision-driven cross-modal DRL framework built on selective state-space models, specifically leveraging Mamba, that achieves near-linear-time sequence modeling, effectively captures long-range dependencies, and…

机器人学 · 计算机科学 2025-12-16 Yinuo Wang , Gavin Tao

The diffusion model has long been plagued by scalability and quadratic complexity issues, especially within transformer-based structures. In this study, we aim to leverage the long sequence modeling capability of a State-Space Model called…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Vincent Tao Hu , Stefan Andreas Baumann , Ming Gui , Olga Grebenkova , Pingchuan Ma , Johannes Schusterbauer , Björn Ommer

Mamba-based architectures have shown to be a promising new direction for deep learning models owing to their competitive performance and sub-quadratic deployment speed. However, current Mamba multi-modal large language models (MLLM) are…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Yifei Xing , Xiangyuan Lan , Ruiping Wang , Dongmei Jiang , Wenjun Huang , Qingfang Zheng , Yaowei Wang

In this paper, we reveal a novel haze-specific wavelet degradation prior observed through wavelet transform analysis, which shows that haze-related information predominantly resides in low-frequency components. Exploiting this insight, we…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Jie Sun , Heng Liu , Yongzhen Wang , Xiao-Ping Zhang , Mingqiang Wei

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

Traditionally for improving the segmentation performance of models, most approaches prefer to use adding more complex modules. And this is not suitable for the medical field, especially for mobile medical devices, where computationally…

图像与视频处理 · 电气工程与系统科学 2025-06-30 Renkai Wu , Yinghao Liu , Pengchen Liang , Qing Chang

Nighttime photography encounters escalating challenges in extremely low-light conditions, primarily attributable to the ultra-low signal-to-noise ratio. For real-world deployment, a practical solution must not only produce visually…

计算机视觉与模式识别 · 计算机科学 2024-01-11 Jiazhang Zheng , Lei Li , Qiuping Liao , Cheng Li , Li Li , Yangxing Liu

Deep learning techniques have revolutionized the infrared and visible image fusion (IVIF), showing remarkable efficacy on complex scenarios. However, current methods do not fully combine frequency domain features with global semantic…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Tianpei Zhang , Yiming Zhu , Jufeng Zhao , Guangmang Cui , Yuchen Zheng

Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) are the predominant modalities utilized in the field of medical imaging. Although MRI capture the complexity of anatomical structures with greater detail than CT, it entails a…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Zhenbin Wang , Lei Zhang , Lituan Wang , Zhenwei Zhang

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawbacks, including…