English
Related papers

Related papers: Multi-Modal Multi-Instance Learning for Retinal Di…

200 papers

Multimodal ophthalmic imaging-based diagnosis integrates color fundus image with optical coherence tomography (OCT) to provide a comprehensive view of ocular pathologies. However, the uneven global distribution of healthcare resources often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qinkai Yu , Jianyang Xie , Yitian Zhao , Cheng Chen , Lijun Zhang , Liming Chen , Jun Cheng , Lu Liu , Yalin Zheng , Yanda Meng

Multi-Instance Learning(MIL) aims to learn the mapping between a bag of instances and the bag-level label. Therefore, the relationships among instances are very important for learning the mapping. In this paper, we propose an MIL algorithm…

Machine Learning · Computer Science 2021-02-04 Yangling Ma , Zhouwang Yang

Ophthalmic image segmentation serves as a critical foundation for ocular disease diagnosis. Although fully convolutional neural networks (CNNs) are commonly employed for segmentation, they are constrained by inductive biases and face…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Zunjie Xiao , Xiaoqing Zhang , Risa Higashita , Jiang Liu

Deep neural networks (DNNs) have promoted the development of computer aided diagnosis (CAD) systems for fundus diseases, helping ophthalmologists reduce missed diagnosis and misdiagnosis rate. However, the majority of CAD systems are…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Hongyang Jiang , Jingqi Huang , Chen Tang , Xiaoqing Zhang , Mengdi Gao , Jiang Liu

Ophthalmic diseases pose a significant global health burden. However, traditional diagnostic methods and existing monocular image-based deep learning approaches often overlook the pathological correlations between the two eyes. In practical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Guohao Huo , Zibo Lin , Zitong Wang , Ruiting Dai , Hao Tang

In this work, we propose Many-MobileNet, an efficient model fusion strategy for retinal disease classification using lightweight CNN architecture. Our method addresses key challenges such as overfitting and limited dataset variability by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Hao Wang , Wenhui Zhu , Xuanzhao Dong , Yanxi Chen , Xin Li , Peijie Qiu , Xiwen Chen , Vamsi Krishna Vasa , Yujian Xiong , Oana M. Dumitrascu , Abolfazl Razi , Yalin Wang

Age-related macular degeneration (AMD) is the most common cause of blindness in developed countries, especially in people over 60 years of age. The workload of specialists and the healthcare system in this field has increased in recent…

Image and Video Processing · Electrical Eng. & Systems 2022-02-07 Saman Sotoudeh-Paima , Ata Jodeiri , Fedra Hajizadeh , Hamid Soltanian-Zadeh

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Retinal lesions play a vital role in the accurate classification of retinal abnormalities. Many researchers have proposed deep lesion-aware screening systems that analyze and grade the progression of retinopathy. However, to the best of our…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Taimur Hassan , Muhammad Usman Akram , Naoufel Werghi

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Ophthalmological imaging utilizes different imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography. Multiple images with different modalities or acquisition times are…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Aline Sindel , Bettina Hohberger , Sebastian Fassihi Dehcordi , Christian Mardin , Robert Lämmer , Andreas Maier , Vincent Christlein

Diabetic retinopathy (DR) is a leading cause of preventable blindness worldwide, demanding accurate automated diagnostic systems. While general-domain vision-language models like Contrastive Language-Image Pre-Training (CLIP) perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Argha Kamal Samanta , Harshika Goyal , Vasudha Joshi , Tushar Mungle , Pabitra Mitra

Multispectral image pairs can provide the combined information, making object detection applications more reliable and robust in the open world. To fully exploit the different modalities, we present a simple yet effective cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Fang Qingyun , Han Dapeng , Wang Zhaokui

Deep learning for medical image classification faces three major challenges: 1) the number of annotated medical images for training are usually small; 2) regions of interest (ROIs) are relatively small with unclear boundaries in the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Shaohua Li , Yong Liu , Xiuchao Sui , Cheng Chen , Gabriel Tjio , Daniel Shu Wei Ting , Rick Siow Mong Goh

Retinopathy represents a group of retinal diseases that, if not treated timely, can cause severe visual impairments or even blindness. Many researchers have developed autonomous systems to recognize retinopathy via fundus and optical…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Taimur Hassan , Bilal Hassan , Muhammad Usman Akram , Shahrukh Hashmi , Abdel Hakim Taguri , Naoufel Werghi

Treatment approaches for colorectal cancer (CRC) are highly dependent on the molecular subtype, as immunotherapy has shown efficacy in cases with microsatellite instability (MSI) but is ineffective for the microsatellite stable (MSS)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Hadar Hezi , Matan Gelber , Alexander Balabanov , Yosef E. Maruvka , Moti Freiman

Multiple instance learning (MIL) has been increasingly used in the classification of histopathology whole slide images (WSIs). However, MIL approaches for this specific classification problem still face unique challenges, particularly those…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Hongrun Zhang , Yanda Meng , Yitian Zhao , Yihong Qiao , Xiaoyun Yang , Sarah E. Coupland , Yalin Zheng

Objective Reticular pseudodrusen (RPD), a key feature of age-related macular degeneration (AMD), are poorly detected by human experts on standard color fundus photography (CFP) and typically require advanced imaging modalities such as…

The whole slide image (WSI) classification is often formulated as a multiple instance learning (MIL) problem. Since the positive tissue is only a small fraction of the gigapixel WSI, existing MIL methods intuitively focus on identifying…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenhao Tang , Sheng Huang , Xiaoxian Zhang , Fengtao Zhou , Yi Zhang , Bo Liu

The classification of medical images is a pivotal aspect of disease diagnosis, often enhanced by deep learning techniques. However, traditional approaches typically focus on unimodal medical image data, neglecting the integration of diverse…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jun-En Ding , Chien-Chin Hsu , Chi-Hsiang Chu , Shuqiang Wang , Feng Liu