English
Related papers

Related papers: A Unified Conditional Disentanglement Framework fo…

200 papers

We propose a segmentation framework that uses deep neural networks and introduce two innovations. First, we describe a biophysics-based domain adaptation method. Second, we propose an automatic method to segment white and gray matter, and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Amir Gholami , Shashank Subramanian , Varun Shenoy , Naveen Himthani , Xiangyu Yue , Sicheng Zhao , Peter Jin , George Biros , Kurt Keutzer

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

In clinical practice, the robustness of deep learning models for multimodal brain tumor segmentation is severely compromised by incomplete MRI data. This vulnerability stems primarily from modality bias, where models exploit spurious…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Bo Liu , Yulong Zou , Jin Hong

Multimodal MRI is essential for brain tumor segmentation, yet missing modalities in clinical practice cause existing methods to exhibit >40% performance variance across modality combinations, rendering them clinically unreliable. We propose…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Chengxiang Guo , Jian Wang , Junhua Fei , Xiao Li , Chunling Chen , Yun Jin

Multimodal learning aims to build models that can process and relate information from multiple modalities. Despite years of development in this field, it still remains challenging to design a unified network for processing various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yiyuan Zhang , Kaixiong Gong , Kaipeng Zhang , Hongsheng Li , Yu Qiao , Wanli Ouyang , Xiangyu Yue

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ceausescu Ciprian-Mihai , Anghelina Ion-Marian , Alexe Dumitru-Bogdan

This study presents a unified Attention U-Net architecture trained jointly on MRI (BraTS 2021) and CT (LIDC-IDRI) datasets to investigate the generalizability of a single model across diverse imaging modalities and anatomical sites. Our…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Nishan Rai , Pushpa R. Dahal

Multi-modal magnetic resonance imaging (MRI) is essential for providing complementary information about brain anatomy and pathology, leading to more accurate diagnoses. However, obtaining high-quality multi-modal MRI in a clinical setting…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Minjoo Lim , Bogyeong Kang , Tae-Eui Kam

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Recent progress in multi-modal conditioned face synthesis has enabled the creation of visually striking and accurately aligned facial images. Yet, current methods still face issues with scalability, limited flexibility, and a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jingjing Ren , Cheng Xu , Haoyu Chen , Xinran Qin , Lei Zhu

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Magnetic Resonance (MR) images of different modalities can provide complementary information for clinical diagnosis, but whole modalities are often costly to access. Most existing methods only focus on synthesizing missing images between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Bingyu Xin , Yifan Hu , Yefeng Zheng , Hongen Liao

Automated brain tumor segmentation methods have become well-established and reached performance levels offering clear clinical utility. These methods typically rely on four input magnetic resonance imaging (MRI) modalities: T1-weighted…

Brain Tumor Segmentation from magnetic resonance imaging (MRI) is a critical technique for early diagnosis. However, rather than having complete four modalities as in BraTS dataset, it is common to have missing modalities in clinical…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yan Shen , Mingchen Gao

Traditional brain lesion segmentation models for multi-modal MRI are typically tailored to specific pathologies, relying on datasets with predefined modalities. Adapting to new MRI modalities or pathologies often requires training separate…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Yousef Sadegheih , Pratibha Kumari , Dorit Merhof

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ning Jiang , Gongshu Wang , Tianyi Yan

Deformable image registration plays a fundamental role in medical image analysis by enabling spatial alignment of anatomical structures across subjects. While recent deep learning-based approaches have significantly improved computational…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jiaqi Shang , Haojin Wu , Yinyi Lai , Zongyu Li , Chenghao Zhang , Jia Guo

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao