English
Related papers

Related papers: Mind the Gap: Promoting Missing Modality Brain Tum…

200 papers

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Deep learning (DL) models for segmenting various anatomical structures have achieved great success via a static DL model that is trained in a single source domain. Yet, the static DL model is likely to perform poorly in a continually…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaofeng Liu , Helen A. Shih , Fangxu Xing , Emiliano Santarnecchi , Georges El Fakhri , Jonghye Woo

Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods by learning the distribution of healthy images and identifying anomalies as outliers. In presence of an additional dataset of unlabelled data…

Machine Learning · Computer Science 2020-07-27 Alexandra-Ioana Albu , Alina Enescu , Luigi Malagò

Decoding visual features from EEG signals is a central challenge in neuroscience, with cross-modal alignment as the dominant approach. We argue that the relationship between visual and brain modalities is fundamentally asymmetric,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Lukun Wu , Jie Li , Ziqi Ren , Kaifan Zhang , Xinbo Gao

In this paper, we propose a novel learning based method for automated segmentation of brain tumor in multimodal MRI images, which incorporates two sets of machine -learned and hand crafted features. Fully convolutional networks (FCN) forms…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Mohammadreza Soltaninejad , Lei Zhang , Tryphon Lambrou , Guang Yang , Nigel Allinson , Xujiong Ye

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua

Background: Brain tumor segmentation has a significant impact on the diagnosis and treatment of brain tumors. Accurate brain tumor segmentation remains challenging due to their irregular shapes, vague boundaries, and high variability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhanyuan Jia , Ni Yao , Danyang Sun , Chuang Han , Yanting Li , Jiaofen Nan , Fubao Zhu , Chen Zhao , Weihua Zhou

Precise segmentation of a lesion area is important for optimizing its treatment. Deep learning makes it possible to detect and segment a lesion field using annotated data. However, obtaining precisely annotated data is very challenging in…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Ling Huang , Su Ruan , Thierry Denoeux

Vision-language models (VLMs) allow to embed texts and images in a shared representation space. However, it has been shown that these models are subject to a modality gap phenomenon meaning there exists a clear separation between the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 François Role , Sébastien Meyer , Victor Amblard

Integrating high-level semantically correlated contents and low-level anatomical features is of central importance in medical image segmentation. Towards this end, recent deep learning-based medical segmentation methods have shown great…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chenyu You , Weicheng Dai , Yifei Min , Lawrence Staib , James S. Duncan

Accurate brain tumor diagnosis relies on the assessment of multiple Magnetic Resonance Imaging (MRI) sequences. However, in clinical practice, the acquisition of certain sequences may be affected by factors like motion artifacts or contrast…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Moinak Bhattacharya , Saumya Gupta , Annie Singh , Chao Chen , Gagandeep Singh , Prateek Prasanna

This work introduces a novel framework for brain tumor segmentation leveraging pre-trained GANs and Unet architectures. By combining a global anomaly detection module with a refined mask generation network, the proposed model accurately…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Qifei Cui , Xinyu Lu

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

Brain cancer can be very fatal, but chances of survival increase through early detection and treatment. Doctors use Magnetic Resonance Imaging (MRI) to detect and locate tumors in the brain, and very carefully analyze scans to segment brain…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Ryan Sherman

Automatic image segmentation becomes very crucial for tumor detection in medical image processing.In general, manual and semi automatic segmentation techniques require more time and knowledge. However these drawbacks had overcome by…

Computer Vision and Pattern Recognition · Computer Science 2016-03-09 D. Anithadevi , K. Perumal

Brain tumor detection can make the difference between life and death. Recently, deep learning-based brain tumor detection techniques have gained attention due to their higher performance. However, obtaining the expected performance of such…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Wessam M. Salama , Ahmed Shokry

Missing modalities present a fundamental challenge in multimodal models, often causing catastrophic performance degradation. Our observations suggest that this fragility stems from an imbalanced learning process, where the model develops an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Siqi Lu , Wanying Xu , Yongbin Zheng , Wenting Luan , Peng Sun , Jianhang Yao

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

Magnetic Resonance Imaging (MRI) is an important diagnostic tool for precise detection of various pathologies. Magnetic Resonance (MR) is more preferred than Computed Tomography (CT) due to the high resolution in MR images which help in…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Pranay Manocha , Snehal Bhasme , Tanvi Gupta , BK Panigrahi , Tapan K. Gandhi

Despite the recent success of deep learning methods at achieving new state-of-the-art accuracy for medical image segmentation, some major limitations are still restricting their deployment into clinics. One major limitation of deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-30 Lucas Fidon