English
Related papers

Related papers: Modality-Aware and Shift Mixer for Multi-modal Bra…

200 papers

We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Reuben Dorent , Samuel Joutard , Marc Modat , Sébastien Ourselin , Tom Vercauteren

Medical image segmentation continues to advance rapidly, yet rigorous comparison between methods remains challenging due to a lack of standardized and customizable tooling. In this work, we present the current state of the Medical Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Adrian Celaya , Tucker Netherton , Dawid Schellingerhout , Caroline Chung , Beatrice Riviere , David Fuentes

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Accurate brain tumor segmentation using multiparametric MRI is critical for effective treatment planning. However, in clinical settings, complete acquisition of all MRI sequences is not always possible. The absence of certain MRI modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Danish Ali , Ajmal Mian , Naveed Akhtar , Ghulam Mubashar Hassan

Multi-modal magnetic resonance imaging (MRI) is a crucial method for analyzing the human brain. It is usually used for diagnosing diseases and for making valuable decisions regarding the treatments - for instance, checking for gliomas in…

Image and Video Processing · Electrical Eng. & Systems 2021-05-26 Ashwin Nalwade , Jackie Kisa

Accurate segmentation of brain tumors from magnetic resonance imaging (MRI) is clinically relevant in diagnoses, prognoses and surgery treatment, which requires multiple modalities to provide complementary morphological and physiopathologic…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Yixin Wang , Yang Zhang , Yang Liu , Zihao Lin , Jiang Tian , Cheng Zhong , Zhongchao Shi , Jianping Fan , Zhiqiang He

Multimodal 3D MRI brain tumor segmentation is a pivotal step in radiotherapy target delineation, surgical planning and post-treatment assessment. Existing methods often assume artifact-free MRI images. However, inevitable patient motion…

Image and Video Processing · Electrical Eng. & Systems 2026-05-18 Yuchun Wang , Xiaosong Li , Gefei Liang , Yang Liu

Multi-modal medical image fusion is traditionally optimized for human visual perception, aiming to maximize generic contrast and structural fidelity. However, when these visually pleasing fused images are deployed in automated clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Magnetic resonance imaging (MRI) is commonly used for brain tumor segmentation, which is critical for patient evaluation and treatment planning. To reduce the labor and expertise required for labeling, weakly-supervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yu-Jen Chen , Xinrong Hu , Yiyu Shi , Tsung-Yi Ho

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

Automation of brain tumor segmentation in 3D magnetic resonance images (MRIs) is key to assess the diagnostic and treatment of the disease. In recent years, convolutional neural networks (CNNs) have shown improved results in the task.…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Laura Mora Ballestar , Veronica Vilaplana

Multi-modal brain images from MRI scans are widely used in clinical diagnosis to provide complementary information from different modalities. However, obtaining fully paired multi-modal images in practice is challenging due to various…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Chuan Huang , Jia Wei , Rui Li

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

The segmentation of brain tumors in multimodal MRIs is one of the most challenging tasks in medical image analysis. The recent state of the art algorithms solving this task is based on machine learning approaches and deep learning in…

Image and Video Processing · Electrical Eng. & Systems 2020-02-11 Dmitrii Lachinov , Elena Shipunova , Vadim Turlapov

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Accelerated multi-modal magnetic resonance (MR) imaging is a new and effective solution for fast MR imaging, providing superior performance in restoring the target modality from its undersampled counterpart with guidance from an auxiliary…

Image and Video Processing · Electrical Eng. & Systems 2022-05-12 Chun-Mei Feng , Yunlu Yan , Geng Chen , Yong Xu , Ling Shao , Huazhu Fu

Positron emission tomography (PET) combined with computed tomography (CT) imaging is routinely used in cancer diagnosis and prognosis by providing complementary information. Automatically segmenting tumors in PET/CT images can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-29 Jinpeng Lu , Jingyun Chen , Linghan Cai , Songhan Jiang , Yongbing Zhang

Deep learning methods for brain tumor segmentation are typically trained in an ad hoc fashion on all available data. Brain tumors are tremendously heterogeneous in image appearance and labeled training data is limited. We argue that…

Image and Video Processing · Electrical Eng. & Systems 2019-07-31 Raphael Meier , Michael Rebsamen , Urspeter Knecht , Mauricio Reyes , Roland Wiest , Richard McKinley

Multi-modality image fusion and segmentation play a vital role in autonomous driving and robotic operation. Early efforts focus on boosting the performance for only one task, \emph{e.g.,} fusion or segmentation, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jinyuan Liu , Zhu Liu , Guanyao Wu , Long Ma , Risheng Liu , Wei Zhong , Zhongxuan Luo , Xin Fan

Multi-modal ophthalmic image classification plays a key role in diagnosing eye diseases, as it integrates information from different sources to complement their respective performances. However, recent improvements have mainly focused on…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Ke Zou , Tian Lin , Zongbo Han , Meng Wang , Xuedong Yuan , Haoyu Chen , Changqing Zhang , Xiaojing Shen , Huazhu Fu