English
Related papers

Related papers: Multi-Modal Multi-Instance Learning for Retinal Di…

200 papers

Our research is motivated by the urgent global issue of a large population affected by retinal diseases, which are evenly distributed but underserved by specialized medical expertise, particularly in non-urban areas. Our primary objective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Deependra Singh , Saksham Agarwal , Subhankar Mishra

Lesion appearance is a crucial clue for medical providers to distinguish referable diabetic retinopathy (rDR) from non-referable DR. Most existing large-scale DR datasets contain only image-level labels rather than pixel-based annotations.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-13 Wenhui Zhu , Peijie Qiu , Natasha Lepore , Oana M. Dumitrascu , Yalin Wang

Multiple instance learning (MIL) is a powerful approach to classify whole slide images (WSIs) for diagnostic pathology. A fundamental challenge of MIL on WSI classification is to discover the \textit{critical instances} that trigger the bag…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhikang Wang , Yue Bi , Tong Pan , Xiaoyu Wang , Chris Bain , Richard Bassed , Seiya Imoto , Jianhua Yao , Jiangning Song

Diabetic macular ischemia (DMI), marked by the loss of retinal capillaries in the macular area, contributes to vision impairment in patients with diabetes. Although color fundus photographs (CFPs), combined with artificial intelligence…

Image and Video Processing · Electrical Eng. & Systems 2025-02-26 Qinghua He , Hongyang Jiang , Danqi Fang , Dawei Yang , Truong X. Nguyen , Anran Ran , Clement C. Tham , Simon K. H. Szeto , Sobha Sivaprasad , Carol Y. Cheung

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

This paper addresses the emerging task of recognizing multiple retinal diseases from wide-field (WF) and ultra-wide-field (UWF) fundus images. For an effective use of existing large amount of labeled color fundus photo (CFP) data and the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-25 Qijie Wei , Jingyuan Yang , Bo Wang , Jinrui Wang , Jianchun Zhao , Xinyu Zhao , Sheng Yang , Niranchana Manivannan , Youxin Chen , Dayong Ding , Jing Zhou , Xirong Li

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations. Often, this approach directly applies "natural image…

In many medical imaging tasks, convolutional neural networks (CNNs) efficiently extract local features hierarchically. More recently, vision transformers (ViTs) have gained popularity, using self-attention mechanisms to capture global…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Kerol Djoumessi , Samuel Ofosu Mensah , Philipp Berens

The scarcity of high-quality, labelled retinal imaging data, which presents a significant challenge in the development of machine learning models for ophthalmology, hinders progress in the field. Existing methods for synthesising Colour…

Image and Video Processing · Electrical Eng. & Systems 2025-07-18 Junzhi Ning , Cheng Tang , Kaijing Zhou , Diping Song , Lihao Liu , Ming Hu , Wei Li , Huihui Xu , Yanzhou Su , Tianbin Li , Jiyao Liu , Jin Ye , Sheng Zhang , Yuanfeng Ji , Junjun He

Recent advancements in deep learning have shown significant potential for classifying retinal diseases using color fundus images. However, existing works predominantly rely exclusively on image data, lack interpretability in their…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Deval Mehta , Yiwen Jiang , Catherine L Jan , Mingguang He , Kshitij Jadhav , Zongyuan Ge

Face recognition has been widely studied due to its importance in different applications; however, most of the proposed methods fail when face images are occluded or captured under illumination and pose variations. Recently several low-rank…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Homa Foroughi , Moein Shakeri , Nilanjan Ray , Hong Zhang

Retinal optical coherence tomography (OCT) images provide crucial insights into the health of the posterior ocular segment. Therefore, the advancement of automated image analysis methods is imperative to equip clinicians and researchers…

Image and Video Processing · Electrical Eng. & Systems 2024-02-16 Jiahao Wang , Hong Peng , Shengchao Chen , Sufen Ren

Diabetic Retinopathy (DR) is a non-negligible eye disease among patients with Diabetes Mellitus, and automatic retinal image analysis algorithm for the DR screening is in high demand. Considering the resolution of retinal image is very…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Kang Zhou , Zaiwang Gu , Wen Liu , Weixin Luo , Jun Cheng , Shenghua Gao , Jiang Liu

Automatic clinical diagnosis of retinal diseases has emerged as a promising approach to facilitate discovery in areas with limited access to specialists. We propose a novel visual-assisted diagnosis hybrid model based on the support vector…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 C. -H. Huck Yang , Jia-Hong Huang , Fangyu Liu , Fang-Yi Chiu , Mengya Gao , Weifeng Lyu , I-Hung Lin M. D. , Jesper Tegner

In clinical practice, crossmodal information including medical images and tabular data is essential for disease diagnosis. There exists a significant modality gap between these data types, which obstructs advancements in crossmodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

Diabetic Retinopathy (DR) is a leading cause of vision loss globally. Yet despite its prevalence, the majority of affected people lack access to the specialized ophthalmologists and equipment required for assessing their condition. This can…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Alexandros Papadopoulos , Fotis Topouzis , Anastasios Delopoulos

Migraine, a prevalent neurological disorder, has been associated with various ocular manifestations suggestive of neuronal and microvascular deficits. However, there is limited understanding of the extent to which retinal imaging may…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Feilong Tang , Matt Trinh , Annita Duong , Angelica Ly , Fiona Stapleton , Zhe Chen , Zongyuan Ge , Imran Razzak

Early detection of retinal diseases is one of the most important means of preventing partial or permanent blindness in patients. In this research, a novel multi-label classification system is proposed for the detection of multiple retinal…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 M. A. Rodriguez , H. AlMarzouqi , P. Liatsis

A new multi-attention based method for solving the MIL problem (MAMIL), which takes into account the neighboring patches or instances of each analyzed patch in a bag, is proposed. In the method, one of the attention modules takes into…

Machine Learning · Computer Science 2021-12-14 Andrei V. Konstantinov , Lev V. Utkin