English
Related papers

Related papers: Hetero-Modal Variational Encoder-Decoder for Joint…

200 papers

Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of…

Artificial Intelligence · Computer Science 2026-05-19 Sha Tao , Jiao Pan , Yu Guo , Chao Yao

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Missing data is a common problem in machine learning and in retrospective imaging research it is often encountered in the form of missing imaging modalities. We propose to take into account missing modalities in the design and training of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karin van Garderen , Marion Smits , Stefan Klein

Missing input sequences are common in medical imaging data, posing a challenge for deep learning models reliant on complete input data. In this work, inspired by MultiMAE [2], we develop a masked autoencoder (MAE) paradigm for multi-modal,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Ayhan Can Erdur , Christian Beischl , Daniel Scholz , Jiazhen Pan , Benedikt Wiestler , Daniel Rueckert , Jan C Peeken

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, some FL participants may possess only a subset…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qian Dai , Xian Wu , Yefeng Zheng , Liansheng Wang

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Masked Autoencoders (MAEs) have been shown to be effective in pre-training Vision Transformers (ViTs) for natural and medical image analysis problems. By reconstructing missing pixel/voxel information in visible patches, a ViT encoder can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Pengfei Gu , Huimin Li , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Multimodal variational autoencoders have demonstrated their ability to learn the relationships between different modalities by mapping them into a latent representation. Their design and capacity to perform any-to-any conditional and…

Machine Learning · Computer Science 2025-02-04 Daniel Wesego , Pedram Rooshenas

Accurate segmentation of brain tumors from magnetic resonance imaging (MRI) is clinically relevant in diagnoses, prognoses and surgery treatment, which requires multiple modalities to provide complementary morphological and physiopathologic…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Yixin Wang , Yang Zhang , Yang Liu , Zihao Lin , Jiang Tian , Cheng Zhong , Zhongchao Shi , Jianping Fan , Zhiqiang He

Accurate brain tumour segmentation is a crucial step towards improving disease diagnosis and proper treatment planning. In this paper, we propose a deep-learning based method to segment a brain tumour into its subregions: whole tumour,…

Image and Video Processing · Electrical Eng. & Systems 2020-09-17 Mina Ghaffari , Arcot Sowmya , Ruth Oliver

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

This work is motivated by multimodality breast cancer imaging data, which is quite challenging in that the signals of discrete tumor-associated microvesicles (TMVs) are randomly distributed with heterogeneous patterns. This imposes a…

Machine Learning · Statistics 2019-03-22 Xiwei Tang , Xuan Bi , Annie Qu

Brain tumor segmentation is an active research area due to the difficulty in delineating highly complex shaped and textured tumors as well as the failure of the commonly used U-Net architectures. The combination of different neural…

Image and Video Processing · Electrical Eng. & Systems 2023-08-02 Lanhong Yao , Zheyuan Zhang , Ulas Bagci

Modern vision backbones for 3D medical imaging typically process dense voxel grids through parameter-heavy encoder-decoder structures, a design that allocates a significant portion of its parameters to spatial reconstruction rather than…

Magnetic Resonance Imaging (MRI) is a widely used imaging technique to assess brain tumor. Accurately segmenting brain tumor from MR images is the key to clinical diagnostics and treatment planning. In addition, multi-modal MR images can…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained on manually segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Pawel Mlynarski , Hervé Delingette , Antonio Criminisi , Nicholas Ayache

Accurately predicting the survival rate of cancer patients is crucial for aiding clinicians in planning appropriate treatment, reducing cancer-related medical expenses, and significantly enhancing patients' quality of life. Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Liangrui Pan , Yijun Peng , Yan Li , Xiang Wang , Wenjuan Liu , Liwen Xu , Qingchun Liang , Shaoliang Peng

In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Chengyin Li , Hui Zhu , Rafi Ibn Sultan , Hassan Bagher Ebadian , Prashant Khanduri , Chetty Indrin , Kundan Thind , Dongxiao Zhu

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Zecheng Liu , Jia Wei , Rui Li