中文
相关论文

相关论文: No Modality Left Behind: Adapting to Missing Modal…

200 篇论文

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

人工智能 · 计算机科学 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

Multi-modal semantic segmentation (MMSS) faces significant challenges in real-world applications due to incomplete, degraded, or missing sensor data. While current MMSS methods typically use self-distillation with modality dropout to…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Jiaqi Tan , Xu Zheng , Yang Liu

Automatic segmentation of the prostate cancer from the multi-modal magnetic resonance images is of critical importance for the initial staging and prognosis of patients. However, how to use the multi-modal image features more efficiently is…

图像与视频处理 · 电气工程与系统科学 2020-11-10 Guokai Zhang , Xiaoang Shen , Ye Luo , Jihao Luo , Zeju Wang , Weigang Wang , Binghui Zhao , Jianwei Lu

Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is…

图像与视频处理 · 电气工程与系统科学 2023-08-29 Aditya Kasliwal , Sankarshanaa Sagaram , Laven Srivastava , Pratinav Seth , Adil Khan

This paper presents the second-placed solution for task 8 and the participation solution for task 7 of BraTS 2024. The adoption of automated brain analysis algorithms to support clinical practice is increasing. However, many of these…

计算机视觉与模式识别 · 计算机科学 2024-12-03 André Ferreira , Gijs Luijten , Behrus Puladi , Jens Kleesiek , Victor Alves , Jan Egger

This work introduces a novel framework for brain tumor segmentation leveraging pre-trained GANs and Unet architectures. By combining a global anomaly detection module with a refined mask generation network, the proposed model accurately…

图像与视频处理 · 电气工程与系统科学 2025-06-27 Qifei Cui , Xinyu Lu

Predicting clinical outcomes from brain networks in large-scale neuroimaging cohorts such as the Adolescent Brain Cognitive Development (ABCD) study requires effectively integrating functional connectivity (FC) and structural connectivity…

计算工程、金融与科学 · 计算机科学 2026-02-11 Zhenyu Lei , Aiying Zhang , Song Wang , Han Fan , Jundong Li

Segmentation models are important tools for the detection and analysis of lesions in brain MRI. Depending on the type of brain pathology that is imaged, MRI scanners can acquire multiple, different image modalities (contrasts). Most…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Anthony P. Addison , Felix Wagner , Wentian Xu , Natalie Voets , Konstantinos Kamnitsas

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Multi-modal magnetic resonance (MR) imaging provides great potential for diagnosing and analyzing brain gliomas. In clinical scenarios, common MR sequences such as T1, T2 and FLAIR can be obtained simultaneously in a single scanning…

图像与视频处理 · 电气工程与系统科学 2022-03-10 Ziqi Huang , Li Lin , Pujin Cheng , Linkai Peng , Xiaoying Tang

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

图像与视频处理 · 电气工程与系统科学 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

Accurate brain tumor segmentation is crucial for neuro-oncology diagnosis and treatment planning. Deep learning methods have made significant progress, but automatic segmentation still faces challenges, including tumor morphological…

图像与视频处理 · 电气工程与系统科学 2025-10-21 Mingda Zhang

Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been…

图像与视频处理 · 电气工程与系统科学 2024-02-13 Tianyi Ren , Ethan Honey , Harshitha Rebala , Abhishek Sharma , Agamdeep Chopra , Mehmet Kurt

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

机器学习 · 计算机科学 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Brain tumor is one of the most high-risk cancers which causes the 5-year survival rate of only about 36%. Accurate diagnosis of brain tumor is critical for the treatment planning. However, complete data are not always available in clinical…

图像与视频处理 · 电气工程与系统科学 2021-05-28 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Robust and generalizable segmentation of brain tumors on multi-parametric magnetic resonance imaging (MRI) remains difficult because tumor types differ widely. The BraTS 2025 Lighthouse Challenge benchmarks segmentation methods on diverse…

Deep learning achieved great progress recently, however, it is not easy or efficient to further improve its performance by increasing the size of the model. Multi-modal learning can mitigate this challenge by introducing richer and more…

人工智能 · 计算机科学 2025-10-07 Cairong Zhao , Yufeng Jin , Zifan Song , Haonan Chen , Duoqian Miao , Guosheng Hu

Multimodal learning has been demonstrated to enhance performance across various clinical tasks, owing to the diverse perspectives offered by different modalities of data. However, existing multimodal segmentation methods rely on…

图像与视频处理 · 电气工程与系统科学 2026-02-04 Shiyun Chen , Li Lin , Pujin Cheng , ZhiCheng Jin , JianJian Chen , HaiDong Zhu , Kenneth K. Y. Wong , Xiaoying Tang

Deep learning models have achieved significant results across various computer vision tasks. However, due to the large number of parameters in these models, deploying them in real-time scenarios is a critical challenge, specifically in…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Amir M. Mansourian , Arya Jalali , Rozhan Ahmadi , Shohreh Kasaei

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

人工智能 · 计算机科学 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal