English
Related papers

Related papers: Mind the Gap: Promoting Missing Modality Brain Tum…

200 papers

Accurate survival prediction from multimodal medical data is essential for precision oncology, yet clinical deployment faces a persistent challenge: modalities are frequently incomplete due to cost constraints, technical limitations, or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kyungwon Kim , Dosik Hwang

Existing methods for multimodal MRI segmentation with missing modalities typically assume that all MRI modalities are available during training. However, in clinical practice, some modalities may be missing due to the sequential nature of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Junze Wang , Lei Fan , Weipeng Jing , Donglin Di , Yang Song , Sidong Liu , Cong Cong

Glioma is the most common and aggressive brain tumor. Magnetic resonance imaging (MRI) plays a vital role to evaluate tumors for the arrangement of tumor surgery and the treatment of subsequent procedures. However, the manual segmentation…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Wenbo Zhang , Guang Yang , He Huang , Weiji Yang , Xiaomei Xu , Yongkai Liu , Xiaobo Lai

Magnetic Resonance (MR) images of different modalities can provide complementary information for clinical diagnosis, but whole modalities are often costly to access. Most existing methods only focus on synthesizing missing images between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Bingyu Xin , Yifan Hu , Yefeng Zheng , Hongen Liao

Brain lesion segmentation from multi-modal MRI often assumes fixed modality sets or predefined pathologies, making existing models difficult to adapt across cohorts and imaging protocols. Continual learning (CL) offers a natural solution…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Yousef Sadegheih , Dorit Merhof , Pratibha Kumari

Medical segmentation is performed to determine the bounds of regions of interest (ROI) prior to surgery. By allowing the study of growth, structure, and behaviour of the ROI in the planning phase, critical information can be obtained,…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Bao Nguyen , Adam Feldman , Sarath Bethapudi , Andrew Jennings , Chris G. Willcocks

The accurate diagnosis and segmentation of tumors in contrast-enhanced Computed Tomography (CT) are fundamentally driven by the distinctive hemodynamic profiles of contrast agents over time. However, in real-world clinical practice,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zishuo Wan , Qinqin Kang , Na Li , Yi Huang , Qianru Zhang , Le Lu , Yun Bian , Dawei Ding , Ke Yan

Despite the promising performance of convolutional neural networks (CNNs) in brain tumor diagnosis from magnetic resonance imaging (MRI), their integration into the clinical workflow has been limited. That is mainly due to the fact that the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Sara Ketabi , Matthias W. Wagner , Cynthia Hawkins , Uri Tabori , Birgit Betina Ertl-Wagner , Farzad Khalvati

Cross-modality recognition has many important applications in science, law enforcement and entertainment. Popular methods to bridge the modality gap include reducing the distributional differences of representations of different modalities,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xin Niu , Enyi Li , Jinchao Liu , Yan Wang , Margarita Osadchy , Yongchun Fang

Brain lesion segmentation plays an essential role in neurological research and diagnosis. As brain lesions can be caused by various pathological alterations, different types of brain lesions tend to manifest with different characteristics…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Xinru Zhang , Ni Ou , Berke Doga Basaran , Marco Visentin , Mengyun Qiao , Renyang Gu , Cheng Ouyang , Yaou Liu , Paul M. Matthew , Chuyang Ye , Wenjia Bai

A U-Net based deep learning architecture is designed to segment brain tumors as they appear on various MRI modalities. Special emphasis is lent to the non-enhancing tumor compartment. The latter has not been considered anymore in recent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 T. Schaffer , A. Brawanski , S. Wein , A. M. Tomé , E. W. Lang

One of the most important tasks in medical image processing is the brain's whole tumor segmentation. It assists in quicker clinical assessment and early detection of brain tumors, which is crucial for lifesaving treatment procedures of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Apurva Pandya , Catherine Samuel , Nisargkumar Patel , Vaibhavkumar Patel , Thangarajah Akilan

Motion artifacts caused by prolonged acquisition time are a significant challenge in Magnetic Resonance Imaging (MRI), hindering accurate tissue segmentation. These artifacts appear as blurred images that mimic tissue-like appearances,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Sunyoung Jung , Yoonseok Choi , Mohammed A. Al-masni , Minyoung Jung , Dong-Hyun Kim

Multimodal learning is susceptible to modality missing, which poses a major obstacle for its practical applications and, thus, invigorates increasing research interest. In this paper, we investigate two challenging problems: 1) when…

Machine Learning · Computer Science 2023-12-19 Jun Sun , Xinxin Zhang , Shoukang Han , Yu-ping Ruan , Taihao Li

Image segmentation some of the challenging issues on brain magnetic resonance image tumor segmentation caused by the weak correlation between magnetic resonance imaging intensity and anatomical meaning.With the objective of utilizing more…

Computer Vision and Pattern Recognition · Computer Science 2014-03-25 Narkhede Sachin G. , Vaishali Khairnar , Sujata Kadu

A key feature of magnetic resonance (MR) imaging is its ability to manipulate how the intrinsic tissue parameters of the anatomy ultimately contribute to the contrast properties of the final, acquired image. This flexibility, however, can…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Dzung L. Pham , Snehashis Roy

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Automation of brain tumors in 3D magnetic resonance images (MRIs) is key to assess the diagnostic and treatment of the disease. In recent years, convolutional neural networks (CNNs) have shown improved results in the task. However, high…

Image and Video Processing · Electrical Eng. & Systems 2020-09-28 Laura Mora Ballestar , Veronica Vilaplana

Multimodal emotion recognition leverages complementary information across modalities to gain performance. However, we cannot guarantee that the data of all modalities are always present in practice. In the studies to predict the missing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Haolin Zuo , Rui Liu , Jinming Zhao , Guanglai Gao , Haizhou Li

Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianyi Wang , Jianan Fan , Dingxin Zhang , Dongnan Liu , Yong Xia , Heng Huang , Weidong Cai