中文
相关论文

相关论文: MSD-KMamba: Bidirectional Spatial-Aware Multi-Moda…

200 篇论文

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

图像与视频处理 · 电气工程与系统科学 2024-06-11 Zhongping Ji

We introduce a novel state-space architecture for diffusion models, effectively harnessing spatial and frequency information to enhance the inductive bias towards local features in input images for image generation tasks. While state-space…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Hao Phung , Quan Dao , Trung Dao , Hoang Phan , Dimitris Metaxas , Anh Tran

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

Since the era of deep learning, convolutional neural networks (CNNs) and vision transformers (ViTs) have been extensively studied and widely used in medical image classification tasks. Unfortunately, CNN's limitations in modeling long-range…

图像与视频处理 · 电气工程与系统科学 2024-10-01 Yubiao Yue , Zhenzhang Li

Convolutional Neural Networks (CNNs) and Transformers have been the most popular architectures for biomedical image segmentation, but both of them have limited ability to handle long-range dependencies because of inherent locality or…

图像与视频处理 · 电气工程与系统科学 2024-01-10 Jun Ma , Feifei Li , Bo Wang

Deep learning models often require specially designed architectures to process data of different dimensions, such as 1D time series, 2D images, and 3D volumetric data. Existing bidirectional models mainly focus on sequential data, making it…

机器学习 · 计算机科学 2024-11-26 Hao Liu

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

图像与视频处理 · 电气工程与系统科学 2024-03-15 Mingya Zhang , Yue Yu , Limei Gu , Tingsheng Lin , Xianping Tao

Accurate organ and lesion segmentation is a critical prerequisite for computer-aided diagnosis. Convolutional Neural Networks (CNNs), constrained by their local receptive fields, often struggle to capture complex global anatomical…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Haodong Chen , Xianfei Han , Qwen

Linear RNN architectures, like Mamba, can be competitive with Transformer models in language modeling while having advantageous deployment characteristics. Given the focus on training large-scale Transformer models, we consider the…

机器学习 · 计算机科学 2025-06-30 Junxiong Wang , Daniele Paliotta , Avner May , Alexander M. Rush , Tri Dao

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

Recently, Mamba-based methods have demonstrated impressive performance in point cloud representation learning by leveraging State Space Model (SSM) with the efficient context modeling ability and linear complexity. However, these methods…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Chuxin Wang , Yixin Zha , Wenfei Yang , Tianzhu Zhang

Due to the success of CNN-based and Transformer-based models in various computer vision tasks, recent works study the applicability of CNN-Transformer hybrid architecture models in 3D multi-modality medical segmentation tasks. Introducing…

图像与视频处理 · 电气工程与系统科学 2025-04-15 Yonghao Huang , Leiting Chen , Chuan Zhou

Vision foundation models (VFMs) such as DINO have led to a paradigm shift in 2D camera-based perception towards extracting generalized features to support many downstream tasks. Recent works introduce self-supervised cross-modal knowledge…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Hariprasath Govindarajan , Maciej K. Wozniak , Marvin Klingner , Camille Maurice , B Ravi Kiran , Senthil Yogamani

Accurate segmentation of 3D medical images such as MRI and CT is essential for clinical diagnosis and treatment planning. Foundation models like the Segment Anything Model (SAM) provide powerful general-purpose representations but struggle…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Mohammadreza Gholipour Shahraki , Mehdi Rezaeian , Mohammad Ghasemzadeh

Recently Mamba-based methods have shown promise in abdominal organ segmentation. However, existing approaches neglect cross-channel anatomical semantic collaboration and lack explicit boundary-aware feature fusion mechanisms. To address…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Yuyang Zheng , Mingda Zhang , Jianglong Qin , Qi Mo , Jingdan Pan , Haozhe Hu , Hongyi Huang

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

计算机视觉与模式识别 · 计算机科学 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

There is no doubt that advanced artificial intelligence models and high quality data are the keys to success in developing computational pathology tools. Although the overall volume of pathology data keeps increasing, a lack of quality data…

图像与视频处理 · 电气工程与系统科学 2024-12-12 Trinh Thi Le Vuong , Jin Tae Kwak

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

声音 · 计算机科学 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Multi-modality image fusion (MMIF) aims to integrate complementary information from different modalities into a single fused image to represent the imaging scene and facilitate downstream visual tasks comprehensively. In recent years,…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Zhe Li , Haiwei Pan , Kejia Zhang , Yuhua Wang , Fengming Yu

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

计算机视觉与模式识别 · 计算机科学 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu