English
Related papers

Related papers: Robust Divergence Learning for Missing-Modality Se…

200 papers

Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative impact on the model…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hao Wang , Shengda Luo , Guosheng Hu , Jianguo Zhang

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Kai Xuan , Lei Xiang , Xiaoqian Huang , Lichi Zhang , Shu Liao , Dinggang Shen , Qian Wang

Medical imaging is a cornerstone of therapy and diagnosis in modern medicine. However, the choice of imaging modality for a particular theranostic task typically involves trade-offs between the feasibility of using a particular modality…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Mayur Mallya , Ghassan Hamarneh

Medical image segmentation being a substantial component of image processing plays a significant role to analyze gross anatomy, to locate an infirmity and to plan the surgical procedures. Segmentation of brain Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Mustansar Fiaz , Kamran Ali , Abdul Rehman , M. Junaid Gul , Soon Ki Jung

Diffusion probabilistic models (DPMs) have exhibited significant effectiveness in computer vision tasks, particularly in image generation. However, their notable performance heavily relies on labelled datasets, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Keqiang Fan , Xiaohao Cai , Mahesan Niranjan

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Brain tumor segmentation (BTS) in magnetic resonance image (MRI) is crucial for brain tumor diagnosis, cancer management and research purposes. With the great success of the ten-year BraTS challenges as well as the advances of CNN and…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Jianwei Lin , Jiatai Lin , Cheng Lu , Hao Chen , Huan Lin , Bingchao Zhao , Zhenwei Shi , Bingjiang Qiu , Xipeng Pan , Zeyan Xu , Biao Huang , Changhong Liang , Guoqiang Han , Zaiyi Liu , Chu Han

Report-supervised (RSuper) learning seeks to alleviate the need for dense tumor voxel labels with constraints derived from radiology reports (e.g., volumes, counts, sizes, locations). In MRI studies of brain tumors, however, we often…

Image and Video Processing · Electrical Eng. & Systems 2026-02-25 Yubin Ge , Yongsong Huang , Xiaofeng Liu

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

With the increasing amounts of high-dimensional heterogeneous data to be processed, multi-modality feature selection has become an important research direction in medical image analysis. Traditional methods usually depict the data structure…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Yuang Shi , Chen Zu , Mei Hong , Luping Zhou , Lei Wang , Xi Wu , Jiliu Zhou , Daoqiang Zhang , Yan Wang

In this paper, we propose SimMLM, a simple yet powerful framework for multimodal learning with missing modalities. Unlike existing approaches that rely on sophisticated network architectures or complex data imputation techniques, SimMLM…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sijie Li , Chen Chen , Jungong Han

Segmenting a structural magnetic resonance imaging (MRI) scan is an important pre-processing step for analytic procedures and subsequent inferences about longitudinal tissue changes. Manual segmentation defines the current gold standard in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Alex Fedorov , Jeremy Johnson , Eswar Damaraju , Alexei Ozerin , Vince Calhoun , Sergey Plis

Imaging with multiple modalities or multiple channels is becoming increasingly important for our modern society. A key tool for understanding and early diagnosis of cancer and dementia is PET-MR, a combined positron emission tomography and…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Matthias J. Ehrhardt

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

The diagnosis and segmentation of tumors using any medical diagnostic tool can be challenging due to the varying nature of this pathology. Magnetic Reso- nance Imaging (MRI) is an established diagnostic tool for various diseases and…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Tanvi Gupta , Pranay Manocha , Tapan K. Gandhi , RK Gupta , BK Panigrahi

Segmentation of regions of interest (ROIs) for identifying abnormalities is a leading problem in medical imaging. Using machine learning for this problem generally requires manually annotated ground-truth segmentations, demanding extensive…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Jay J. Yoo , Khashayar Namdar , Matthias W. Wagner , Liana Nobre , Uri Tabori , Cynthia Hawkins , Birgit B. Ertl-Wagner , Farzad Khalvati

Multi-modal Magnetic Resonance Imaging (MRI) is imperative for accurate brain tumor segmentation, offering indispensable complementary information. Nonetheless, the absence of modalities poses significant challenges in achieving precise…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Zheyu Zhang , Xinzhao Liu , Zheng Chen , Yueyi Zhang , Huanjing Yue , Yunwei Ou , Xiaoyan Sun

Advances in computing technology have allowed researchers across many fields of endeavor to collect and maintain vast amounts of observational statistical data such as clinical data, biological patient data, data regarding access of web…

Computer Vision and Pattern Recognition · Computer Science 2014-01-24 Narkhede Sachin G , Vaishali Khairnar