中文
相关论文

相关论文: Spatial-Frequency Enhanced Mamba for Multi-Modal I…

200 篇论文

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

人工智能 · 计算机科学 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Puskal Khadka , KC Santosh

Images corrupted by rain streaks often lose vital frequency information for perception, and image deraining aims to solve this issue which relies on global and local degradation modeling. Recent studies have witnessed the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Zou Zhen , Yu Hu , Zhao Feng

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawbacks, including…

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

Existing video camouflaged object detection (VCOD) methods primarily rely on spatial appearances for motion perception. However, the high foreground-background similarity in VCOD limits the discriminability of such features (e.g. color and…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Xin Li , Keren Fu , Qijun Zhao

Frequency information (e.g., Discrete Wavelet Transform and Fast Fourier Transform) has been widely applied to solve the issue of Low-Light Image Enhancement (LLIE). However, existing frequency-based models primarily operate in the simple…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Junhao Tan , Songwen Pei , Wei Qin , Bo Fu , Ximing Li , Libo Huang

Traffic image restoration under adverse weather conditions remains a critical challenge for intelligent transportation systems. Existing methods primarily focus on spatial-domain modeling but neglect frequency-domain priors. Although the…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Liwen Pan , Longguang Wang , Guangwei Gao , Jun Wang , Jun Shi , Juncheng Li

The Mamba architecture has been widely applied to various low-level vision tasks due to its exceptional adaptability and strong performance. Although the Mamba architecture has been adopted for spectral reconstruction, it still faces the…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Yuze Zhang , Lingjie Li , Qiuzhen Lin , Zhong Ming , Fei Yu , Victor C. M. Leung

The realm of Mamba for vision has been advanced in recent years to strike for the alternatives of Vision Transformers (ViTs) that suffer from the quadratic complexity. While the recurrent scanning mechanism of Mamba offers computational…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Masakazu Yoshimura , Teruaki Hayashi , Yuki Hoshino , Wei-Yao Wang , Takeshi Ohashi

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano

Multispectral and Hyperspectral Image Fusion (MHIF) aims to reconstruct high-resolution images by integrating low-resolution hyperspectral images (LRHSI) and high-resolution multispectral images (HRMSI). However, existing methods face…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Baisong Li

Background: High-resolution MRI is critical for diagnosis, but long acquisition times limit clinical use. Super-resolution (SR) can enhance resolution post-scan, yet existing deep learning methods face fidelity-efficiency trade-offs.…

Multimodal medical image fusion (MMIF) extracts the most meaningful information from multiple source images, enabling a more comprehensive and accurate diagnosis. Achieving high-quality fusion results requires a careful balance of…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Dan He , Weisheng Li , Guofen Wang , Yuping Huang , Shiqiang Liu

Micro-gesture recognition (MGR) targets the identification of subtle and fine-grained human motions and requires accurate modeling of both long-range and local spatiotemporal dependencies. While CNNs are effective at capturing local…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Deng Li , Jun Shao , Bohao Xing , Rong Gao , Bihan Wen , Heikki Kälviäinen , Xin Liu

Image restoration endeavors to reconstruct a high-quality, detail-rich image from a degraded counterpart, which is a pivotal process in photography and various computer vision systems. In real-world scenarios, different types of degradation…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Yuhong He , Long Peng , Qiaosi Yi , Chen Wu , Lu Wang

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu

Burst image super-resolution (BISR) aims to enhance the resolution of a keyframe by leveraging information from multiple low-resolution images captured in quick succession. In the deep learning era, BISR methods have evolved from fully…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Ozan Unal , Steven Marty , Dengxin Dai

Diffusion models have achieved great success in image generation, with the backbone evolving from U-Net to Vision Transformers. However, the computational cost of Transformers is quadratic to the number of tokens, leading to significant…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Yao Teng , Yue Wu , Han Shi , Xuefei Ning , Guohao Dai , Yu Wang , Zhenguo Li , Xihui Liu