English
Related papers

Related papers: No Modality Left Behind: Adapting to Missing Modal…

200 papers

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

Artificial Intelligence · Computer Science 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

Multi-modal semantic segmentation (MMSS) faces significant challenges in real-world applications due to incomplete, degraded, or missing sensor data. While current MMSS methods typically use self-distillation with modality dropout to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jiaqi Tan , Xu Zheng , Yang Liu

Automatic segmentation of the prostate cancer from the multi-modal magnetic resonance images is of critical importance for the initial staging and prognosis of patients. However, how to use the multi-modal image features more efficiently is…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 Guokai Zhang , Xiaoang Shen , Ye Luo , Jihao Luo , Zeju Wang , Weigang Wang , Binghui Zhao , Jianwei Lu

Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Aditya Kasliwal , Sankarshanaa Sagaram , Laven Srivastava , Pratinav Seth , Adil Khan

This paper presents the second-placed solution for task 8 and the participation solution for task 7 of BraTS 2024. The adoption of automated brain analysis algorithms to support clinical practice is increasing. However, many of these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 André Ferreira , Gijs Luijten , Behrus Puladi , Jens Kleesiek , Victor Alves , Jan Egger

This work introduces a novel framework for brain tumor segmentation leveraging pre-trained GANs and Unet architectures. By combining a global anomaly detection module with a refined mask generation network, the proposed model accurately…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Qifei Cui , Xinyu Lu

Predicting clinical outcomes from brain networks in large-scale neuroimaging cohorts such as the Adolescent Brain Cognitive Development (ABCD) study requires effectively integrating functional connectivity (FC) and structural connectivity…

Computational Engineering, Finance, and Science · Computer Science 2026-02-11 Zhenyu Lei , Aiying Zhang , Song Wang , Han Fan , Jundong Li

Segmentation models are important tools for the detection and analysis of lesions in brain MRI. Depending on the type of brain pathology that is imaged, MRI scanners can acquire multiple, different image modalities (contrasts). Most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Anthony P. Addison , Felix Wagner , Wentian Xu , Natalie Voets , Konstantinos Kamnitsas

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Multi-modal magnetic resonance (MR) imaging provides great potential for diagnosing and analyzing brain gliomas. In clinical scenarios, common MR sequences such as T1, T2 and FLAIR can be obtained simultaneously in a single scanning…

Image and Video Processing · Electrical Eng. & Systems 2022-03-10 Ziqi Huang , Li Lin , Pujin Cheng , Linkai Peng , Xiaoying Tang

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

Accurate brain tumor segmentation is crucial for neuro-oncology diagnosis and treatment planning. Deep learning methods have made significant progress, but automatic segmentation still faces challenges, including tumor morphological…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Mingda Zhang

Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Tianyi Ren , Ethan Honey , Harshitha Rebala , Abhishek Sharma , Agamdeep Chopra , Mehmet Kurt

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Brain tumor is one of the most high-risk cancers which causes the 5-year survival rate of only about 36%. Accurate diagnosis of brain tumor is critical for the treatment planning. However, complete data are not always available in clinical…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Robust and generalizable segmentation of brain tumors on multi-parametric magnetic resonance imaging (MRI) remains difficult because tumor types differ widely. The BraTS 2025 Lighthouse Challenge benchmarks segmentation methods on diverse…

Deep learning achieved great progress recently, however, it is not easy or efficient to further improve its performance by increasing the size of the model. Multi-modal learning can mitigate this challenge by introducing richer and more…

Artificial Intelligence · Computer Science 2025-10-07 Cairong Zhao , Yufeng Jin , Zifan Song , Haonan Chen , Duoqian Miao , Guosheng Hu

Multimodal learning has been demonstrated to enhance performance across various clinical tasks, owing to the diverse perspectives offered by different modalities of data. However, existing multimodal segmentation methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-02-04 Shiyun Chen , Li Lin , Pujin Cheng , ZhiCheng Jin , JianJian Chen , HaiDong Zhu , Kenneth K. Y. Wong , Xiaoying Tang

Deep learning models have achieved significant results across various computer vision tasks. However, due to the large number of parameters in these models, deploying them in real-time scenarios is a critical challenge, specifically in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Amir M. Mansourian , Arya Jalali , Rozhan Ahmadi , Shohreh Kasaei

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal