English
Related papers

Related papers: Multimodal Information Fusion for Glaucoma and DR …

200 papers

Multimodal visual information fusion aims to integrate the multi-sensor data into a single image which contains more complementary information and less redundant features. However the complementary information is hard to extract, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Hui Li , Xiao-Jun Wu

The analysis of fundus images is critical for the early detection and diagnosis of retinal diseases such as Diabetic Retinopathy (DR), Glaucoma, and Age-related Macular Degeneration (AMD). Traditional diagnostic workflows, however, often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Faisal Ahmed

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Farshad G. Veshki , Nora Ouzir , Sergiy A. Vorobyov , Esa Ollila

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Multimodal medical image fusion plays a crucial role in medical diagnosis by integrating complementary information from different modalities to enhance image readability and clinical applicability. However, existing methods mainly follow…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haozhe Xiang , Han Zhang , Yu Cheng , Xiongwen Quan , Wanwan Huang

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Color fundus photography and Optical Coherence Tomography (OCT) are the two most cost-effective tools for glaucoma screening. Both two modalities of images have prominent biomarkers to indicate glaucoma suspected. Clinically, it is often…

Glaucoma is one of the ophthalmic diseases that may cause blindness, for which early detection and treatment are very important. Fundus images and optical coherence tomography (OCT) images are both widely-used modalities in diagnosing…

Image and Video Processing · Electrical Eng. & Systems 2022-01-26 Zhiyuan Cai , Li Lin , Huaqing He , Xiaoying Tang

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Meng Zhou , Xiaolan Xu , Yuxuan Zhang

This study aimed to enhance disease classification accuracy from retinal fundus images by integrating fine-grained image features and global textual context using a novel multimodal deep learning architecture. Existing multimodal large…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jason Jordan , Mohammadreza Akbari Lor , Peter Koulen , Mei-Ling Shyu , Shu-Ching Chen

Medical image fusion combines the complementary information of multimodal medical images to assist medical professionals in the clinical diagnosis of patients' disorders and provide guidance during preoperative and intra-operative…

Image and Video Processing · Electrical Eng. & Systems 2023-10-19 Payal Wankhede , Manisha Das , Deep Gupta , Petia Radeva , Ashwini M Bakde

Multimodal fusion frameworks, which integrate diverse medical imaging modalities (e.g., MRI, CT), have shown great potential in applications such as skin cancer detection, dementia diagnosis, and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 J. Dhar , M. K. Pandey , D. Chakladar , M. Haghighat , A. Alavi , S. Mistry , N. Zaidi

Medical patient data is always multimodal. Images, text, age, gender, histopathological data are only few examples for different modalities in this context. Processing and integrating this multimodal data with deep learning based methods is…

Artificial Intelligence · Computer Science 2025-09-11 Christian Gapp , Elias Tappeiner , Martin Welk , Rainer Schubert

Glaucoma is a leading cause of irreversible blindness, but early detection can significantly improve treatment outcomes. Traditional diagnostic methods are often invasive and require specialized equipment. In this work, we present a deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Rishiraj Paul Chowdhury , Nirmit Shekar Karkera

This study introduces the Hybrid Multi-modal VGG (HM-VGG) model, a cutting-edge deep learning approach for the early diagnosis of glaucoma. The HM-VGG model utilizes an attention mechanism to process Visual Field (VF) data, enabling the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Junliang Du , Yiru Cang , Tong Zhou , Jiacheng Hu , Weijie He

Optical Coherence Tomography (OCT) is a novel and effective screening tool for ophthalmic examination. Since collecting OCT images is relatively more expensive than fundus photographs, existing methods use multi-modal learning to complement…

Image and Video Processing · Electrical Eng. & Systems 2023-08-02 Lehan Wang , Weihang Dai , Mei Jin , Chubin Ou , Xiaomeng Li

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Background/Objectives: Age-related macular degeneration, glaucoma, diabetic retinopathy (DR), diabetic macular edema, and pathological myopia affect hundreds of millions of people worldwide. Early screening for these diseases is essential,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-18 Ananya Raghu , Anisha Raghu , Alice S. Tang , Yannis M. Paulus , Tyson N. Kim , Tomiko T. Oskotsky

This paper proposes a novel multimodal fusion approach, aiming to produce best possible decisions by integrating information coming from multiple media. While most of the past multimodal approaches either work by projecting the features of…

Artificial Intelligence · Computer Science 2018-08-23 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie