中文
相关论文

相关论文: A Tri-attention Fusion Guided Multi-modal Segmenta…

200 篇论文

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

Deep learning has made important contributions to the development of medical image segmentation. Convolutional neural networks, as a crucial branch, have attracted strong attention from researchers. Through the tireless efforts of numerous…

图像与视频处理 · 电气工程与系统科学 2024-05-02 Zhaojin Fu , Zheng Chen , Jinjiang Li , Lu Ren

Incomplete multi-modal medical image segmentation faces critical challenges from modality imbalance, including imbalanced modality missing rates and heterogeneous modality contributions. Due to their reliance on idealized assumptions of…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Libin Lan , Hongxing Li , Zunhui Xia , Yudong Zhang

Effective deep feature extraction via feature-level fusion is crucial for multimodal object detection. However, previous studies often involve complex training processes that integrate modality-specific features by stacking multiple…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Lei Hao , Lina Xu , Chang Liu , Yanni Dong

Objective: Magnetic resonance imaging (MRI) has been widely used for the analysis and diagnosis of brain diseases. Accurate and automatic brain tumor segmentation is of paramount importance for radiation treatment. However, low tissue…

图像与视频处理 · 电气工程与系统科学 2022-04-18 Jiangyun Li , Hong Yu , Chen Chen , Meng Ding , Sen Zha

Learning modality-fused representations and processing unaligned multimodal sequences are meaningful and challenging in multimodal emotion recognition. Existing approaches use directional pairwise attention or a message hub to fuse…

计算机视觉与模式识别 · 计算机科学 2021-12-06 Ziwang Fu , Feng Liu , Hanyang Wang , Siyuan Shen , Jiahao Zhang , Jiayin Qi , Xiangling Fu , Aimin Zhou

Recently, multi-modality scene perception tasks, e.g., image fusion and scene understanding, have attracted widespread attention for intelligent vision systems. However, early efforts always consider boosting a single task unilaterally and…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Zhu Liu , Jinyuan Liu , Guanyao Wu , Long Ma , Xin Fan , Risheng Liu

The fusion technique is the key to the multimodal emotion recognition task. Recently, cross-modal attention-based fusion methods have demonstrated high performance and strong robustness. However, cross-modal attention suffers from redundant…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Feng Liu , Ziwang Fu , Yunlong Wang , Qijian Zheng

The Transformer structures have been widely used in computer vision and have recently made an impact in the area of medical image registration. However, the use of Transformer in most registration networks is straightforward. These networks…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Haiqiao Wang , Dong Ni , Yi Wang

Learning effective fusion of multi-modality features is at the heart of visual question answering. We propose a novel method of dynamically fusing multi-modal features with intra- and inter-modality information flow, which alternatively…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Gao Peng , Zhengkai Jiang , Haoxuan You , Pan Lu , Steven Hoi , Xiaogang Wang , Hongsheng Li

To improve the prediction of cancer survival using whole-slide images and transcriptomics data, it is crucial to capture both modality-shared and modality-specific information. However, multimodal frameworks often entangle these…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Sanne Abeln , Wilson Silva

Recent medical image segmentation models are mostly hybrid, which integrate self-attention and convolution layers into the non-isomorphic architecture. However, one potential drawback of these approaches is that they failed to provide an…

图像与视频处理 · 电气工程与系统科学 2022-10-28 Jiansen Guo , Hong-Yu Zhou , Liansheng Wang , Yizhou Yu

Medical image segmentation remains particularly challenging for complex and low-contrast anatomical structures. In this paper, we introduce the U-Transformer network, which combines a U-shaped architecture for image segmentation with self-…

图像与视频处理 · 电气工程与系统科学 2021-03-15 Olivier Petit , Nicolas Thome , Clément Rambour , Luc Soler

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

图像与视频处理 · 电气工程与系统科学 2024-04-01 Abdul Rehman Khan , Asifullah Khan

In this paper, we present a novel neural network using multi scale feature fusion at various scales for accurate and efficient semantic image segmentation. We used ResNet based feature extractor, dilated convolutional layers in downsampling…

计算机视觉与模式识别 · 计算机科学 2020-10-02 Abhinav Sagar , RajKumar Soundrapandiyan

How to effectively fuse cross-modal information is the key problem for RGB-D salient object detection. Early fusion and the result fusion schemes fuse RGB and depth information at the input and output stages, respectively, hence incur the…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Nian Liu , Ni Zhang , Ling Shao , Junwei Han

Segmentation is a fundamental task in medical image analysis. However, most existing methods focus on primary region extraction and ignore edge information, which is useful for obtaining accurate segmentation. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2019-07-26 Zhijie Zhang , Huazhu Fu , Hang Dai , Jianbing Shen , Yanwei Pang , Ling Shao

Nucleus image segmentation is a crucial step in the analysis, pathological diagnosis, and classification, which heavily relies on the quality of nucleus segmentation. However, the complexity of issues such as variations in nucleus size,…

图像与视频处理 · 电气工程与系统科学 2023-08-11 Junzhou Chen , Qian Huang , Yulin Chen , Linyi Qian , Chengyuan Yu

Multimodal positron emission tomography-computed tomography (PET-CT) is used routinely in the assessment of cancer. PET-CT combines the high sensitivity for tumor detection with PET and anatomical information from CT. Tumor segmentation is…

图像与视频处理 · 电气工程与系统科学 2022-06-13 Xiaohang Fu , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim