中文
相关论文

相关论文: Mind the Gap: Promoting Missing Modality Brain Tum…

200 篇论文

Traditional brain lesion segmentation models for multi-modal MRI are typically tailored to specific pathologies, relying on datasets with predefined modalities. Adapting to new MRI modalities or pathologies often requires training separate…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Yousef Sadegheih , Pratibha Kumari , Dorit Merhof

Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from…

图像与视频处理 · 电气工程与系统科学 2022-01-10 Dingwen Zhang , Guohai Huang , Qiang Zhang , Jungong Han , Junwei Han , Yizhou Yu

The field of computer vision is undergoing a paradigm shift toward large-scale foundation model pre-training via self-supervised learning (SSL). Leveraging large volumes of unlabeled brain MRI data, such models can learn anatomical priors…

图像与视频处理 · 电气工程与系统科学 2026-01-15 Petros Koutsouvelis , Matej Gazda , Leroy Volmer , Sina Amirrajab , Kamil Barbierik , Branislav Setlak , Jakub Gazda , Peter Drotar

Multimodal MRI offers complementary information for brain tumor segmentation, but clinical scans often lack one or more modalities, which degrades segmentation performance. In this paper, we propose UniME (Uni-Encoder Meets Multi-Encoders),…

计算机视觉与模式识别 · 计算机科学 2026-04-27 Peibo Song , Xiaotian Xue , Jinshuo Zhang , Zihao Wang , Jinhua Liu , Shujun Fu , Fangxun Bao , Si Yong Yeo

Deep learning methods for brain tumor segmentation are typically trained in an ad hoc fashion on all available data. Brain tumors are tremendously heterogeneous in image appearance and labeled training data is limited. We argue that…

图像与视频处理 · 电气工程与系统科学 2019-07-31 Raphael Meier , Michael Rebsamen , Urspeter Knecht , Mauricio Reyes , Roland Wiest , Richard McKinley

In this work, we propose a multi-modal Convolutional Neural Network (CNN) approach for brain tumor segmentation. We investigate how to combine different modalities efficiently in the CNN framework.We adapt various fusion methods, which are…

计算机视觉与模式识别 · 计算机科学 2018-09-21 Mehmet Aygün , Yusuf Hüseyin Şahin , Gözde Ünal

In multimodal learning, CLIP has emerged as the de-facto approach for mapping different modalities into a shared latent space by bringing semantically similar representations closer while pushing apart dissimilar ones. However, CLIP-based…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Eleonora Grassucci , Giordano Cicchetti , Danilo Comminiello

Brain MRI scans are often found in four modalities, consisting of T1-weighted with and without contrast enhancement (T1ce and T1w), T2-weighted imaging (T2w), and Flair. Leveraging complementary information from these different modalities…

图像与视频处理 · 电气工程与系统科学 2025-09-22 Bhavesh Sandbhor , Bheeshm Sharma , Balamurugan Palaniappan

Brain tumor is one of the most high-risk cancers which causes the 5-year survival rate of only about 36%. Accurate diagnosis of brain tumor is critical for the treatment planning. However, complete data are not always available in clinical…

图像与视频处理 · 电气工程与系统科学 2021-05-28 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Ophthalmologists typically require multimodal data sources to improve diagnostic accuracy in clinical decisions. However, due to medical device shortages, low-quality data and data privacy concerns, missing data modalities are common in…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Chengzhi Liu , Zile Huang , Zhe Chen , Feilong Tang , Yu Tian , Zhongxing Xu , Zihong Luo , Yalin Zheng , Yanda Meng

Purpose: In this paper, we investigate a framework for interactive brain tumor segmentation which, at its core, treats the problem of interactive brain tumor segmentation as a machine learning problem. Methods: This method has an advantage…

计算机视觉与模式识别 · 计算机科学 2016-05-20 Mohammad Havaei , Hugo Larochelle , Philippe Poulin , Pierre-Marc Jodoin

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

Medical multi-modal learning is critical for integrating information from a large set of diverse modalities. However, when leveraging a high number of modalities in real clinical applications, it is often impractical to obtain full-modality…

机器学习 · 计算机科学 2026-03-03 Chenwei Wu , Zitao Shuai , Liyue Shen

Medical image segmentation of tumors and organs at risk is a time-consuming yet critical process in the clinic that utilizes multi-modality imaging (e.g, different acquisitions, data types, and sequences) to increase segmentation precision.…

图像与视频处理 · 电气工程与系统科学 2023-06-07 Qisheng He , Nicholas Summerfield , Ming Dong , Carri Glide-Hurst

Segmentation of tumors in brain MRI images is a challenging task, where most recent methods demand large volumes of data with pixel-level annotations, which are generally costly to obtain. In contrast, image-level annotations, where only…

图像与视频处理 · 电气工程与系统科学 2019-11-07 Sergey Pavlov , Alexey Artemov , Maksim Sharaev , Alexander Bernstein , Evgeny Burnaev

Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is…

图像与视频处理 · 电气工程与系统科学 2023-08-29 Aditya Kasliwal , Sankarshanaa Sagaram , Laven Srivastava , Pratinav Seth , Adil Khan

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

图像与视频处理 · 电气工程与系统科学 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Automated brain tumor segmentation methods have become well-established and reached performance levels offering clear clinical utility. These methods typically rely on four input magnetic resonance imaging (MRI) modalities: T1-weighted…

The problem of missing modalities is both critical and non-trivial to be handled in multi-modal models. It is common for multi-modal tasks that certain modalities contribute more compared to other modalities, and if those important…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Hu Wang , Congbo Ma , Jianpeng Zhang , Yuan Zhang , Jodie Avery , Louise Hull , Gustavo Carneiro

Multi-modal magnetic resonance imaging (MRI) is a crucial method for analyzing the human brain. It is usually used for diagnosing diseases and for making valuable decisions regarding the treatments - for instance, checking for gliomas in…

图像与视频处理 · 电气工程与系统科学 2021-05-26 Ashwin Nalwade , Jackie Kisa