English
Related papers

Related papers: Modality-aware Mutual Learning for Multi-modal Med…

200 papers

We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Reuben Dorent , Samuel Joutard , Marc Modat , Sébastien Ourselin , Tom Vercauteren

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Liver cancer has a high incidence rate, but primary healthcare settings often lack experienced doctors. Advances in large models and AI technologies offer potential assistance. This work aims to address limitations in liver cancer diagnosis…

Medical Physics · Physics 2024-06-27 Xuzhou Wu , Guangxin Li , Xing Wang , Zeyu Xu , Yingni Wang , Jianming Xian , Xueyu Wang , Gong Li , Kehong Yuan

The liver is one of the most critical metabolic organs in vertebrates due to its vital functions in the human body, such as detoxification of the blood from waste products and medications. Liver diseases due to liver tumors are one of the…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Khaled Humady , Yasmeen Al-Saeed , Nabila Eladawi , Ahmed Elgarayhi , Mohammed Elmogy , Mohammed Sallah

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer in adults, and the most common cause of death of people suffering from cirrhosis. The segmentation of liver lesions in CT images allows assessment of tumor load,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Nadja Gruber , Stephan Antholzer , Werner Jaschke , Christian Kremser , Markus Haltmeier

Computed tomography (CT) and clinical numeric data are essential modalities for cancer evaluation, but building large-scale multimodal training datasets for developing medical foundation models remains challenging due to the structural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Daeun Jung , Jaehyeok Jang , Sooyoung Jang , Yu Rang Park

Medical imaging is the most important tool for detecting complications in the inner body of medicine. Nowadays, with the development of image processing technology as well as changing the size of photos to higher resolution images in the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Mahmoudreza Moghimhanjani , Ali Taghavirashidizadeh

Cancer is one of the leading causes of death worldwide, making the development of rapid, minimally invasive, label-free and scalable diagnostic strategies a major challenge in modern oncology. In this context, spectroscopic liquid biopsy…

Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shenghao Zhu , Yifei Chen , Weihong Chen , Yuanhan Wang , Chang Liu , Shuo Jiang , Feiwei Qin , Changmiao Wang

Given the high incidence and effective treatment options for liver diseases, they are of great socioeconomic importance. One of the most common methods for analyzing CT and MRI images for diagnosis and follow-up treatment is liver…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Tobias Bernecker , Annette Peters , Christopher L. Schlett , Fabian Bamberg , Fabian Theis , Daniel Rueckert , Jakob Weiß , Shadi Albarqouni

Accurate segmentation of laryngo-pharyngeal tumors is crucial for precise diagnosis and effective treatment planning. However, traditional single-modality imaging methods often fall short of capturing the complex anatomical and pathological…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Junhao Wu , Yun Li , Junhao Li , Jingliang Bian , Xiaomao Fan , Wenbin Lei , Ruxin Wang

Breast cancer remains the most commonly diagnosed malignancy among women in the developed world. Early detection through mammography screening plays a pivotal role in reducing mortality rates. While computer-aided diagnosis (CAD) systems…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

The diagnosis and segmentation of tumors using any medical diagnostic tool can be challenging due to the varying nature of this pathology. Magnetic Reso- nance Imaging (MRI) is an established diagnostic tool for various diseases and…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Tanvi Gupta , Pranay Manocha , Tapan K. Gandhi , RK Gupta , BK Panigrahi

Liver vessel segmentation in magnetic resonance imaging data is important for the computational analysis of vascular remodelling, associated with a wide spectrum of diffuse liver diseases. Existing approaches rely on contrast enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Daniel Sobotka , Alexander Herold , Matthias Perkonigg , Lucian Beer , Nina Bastati , Alina Sablatnig , Ahmed Ba-Ssalamah , Georg Langs

Within this thesis we propose a platform for combining Augmented Reality (AR) hardware with machine learning in a user-oriented pipeline, offering to the medical staff an intuitive 3D visualization of volumetric Computed Tomography (CT) and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Lucian Trestioreanu

Multi-contrast magnetic resonance imaging (MRI) plays a vital role in brain tumor segmentation and diagnosis by leveraging complementary information from different contrasts. Each contrast highlights specific tumor characteristics, enabling…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Zhenxuan Zhang , Hongjie Wu , Jiahao Huang , Baihong Xie , Zhifan Gao , Junxian Du , Pete Lally , Guang Yang