English
Related papers

Related papers: Multi-Modal Multi-Instance Learning for Retinal Di…

200 papers

Optical coherence tomography (OCT) is a commonly-used method of extracting high resolution retinal information. Moreover there is an increasing demand for the automated retinal layer segmentation which facilitates the retinal disease…

Image and Video Processing · Electrical Eng. & Systems 2020-09-30 Zeyu Fu , Yang Sun , Xiangyu Zhang , Scott Stainton , Shaun Barney , Jeffry Hogg , William Innes , Satnam Dlay

Artificial intelligence (AI) has become a fundamental tool for assisting clinicians in analyzing ophthalmic images, such as optical coherence tomography (OCT). However, developing AI models often requires extensive annotation, and existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 José Morano , Botond Fazekas , Emese Sükei , Ronald Fecso , Taha Emre , Markus Gumpinger , Georg Faustmann , Marzieh Oghbaie , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

In ophthalmology, the study of the retinal microcirculation is a key issue in the analysis of many ocular and systemic diseases, like hypertension or diabetes. This motivates the research on improving the retinal vasculature segmentation.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-23 José Morano , Álvaro S. Hervella , Noelia Barreira , Jorge Novo , José Rouco

Digitizing pathological images into gigapixel Whole Slide Images (WSIs) has opened new avenues for Computational Pathology (CPath). As positive tissue comprises only a small fraction of gigapixel WSIs, existing Multiple Instance Learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Wenhao Tang , Sheng Huang , Heng Fang , Fengtao Zhou , Bo Liu , Qingshan Liu

Stroke is a major public health problem, affecting millions worldwide. Deep learning has recently demonstrated promise for enhancing the diagnosis and risk prediction of stroke. However, existing methods rely on costly medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2025-12-17 Saeed Shurrab , Aadim Nepal , Terrence J. Lee-St. John , Nicola G. Ghazi , Bartlomiej Piechowski-Jozwiak , Farah E. Shamout

Recent advances in prototypical learning have shown remarkable potential to provide useful decision interpretations associating activation maps and predictions with class-specific training prototypes. Such prototypical learning has been…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Chong Wang , Fengbei Liu , Yuanhong Chen , Helen Frazer , Gustavo Carneiro

Radiologists must utilize multiple modal images for tumor segmentation and diagnosis due to the limitations of medical imaging and the diversity of tumor signals. This leads to the development of multimodal learning in segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Chuyun Shen , Wenhao Li , Haoqing Chen , Xiaoling Wang , Fengping Zhu , Yuxin Li , Xiangfeng Wang , Bo Jin

In the application of Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) classification, attention mechanisms often focus on a subset of discriminative instances, which are closely linked to overfitting. To mitigate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yunlong Zhang , Honglin Li , Yuxuan Sun , Sunyi Zheng , Chenglu Zhu , Lin Yang

We identify two major limitations in the existing studies on retinal vessel segmentation: (1) Most existing works are restricted to one modality, i.e., the Color Fundus (CF). However, multi-modality retinal images are used every day in the…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Bo Wen , Anna Heinke , Akshay Agnihotri , Dirk-Uwe Bartsch , William Freeman , Truong Nguyen , Cheolhong An

Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients) without sharing the local data of the clients. Most of the existing FL methods assume that the data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Accurate diagnosis of glaucoma is challenging, as early-stage changes are subtle and often lack clear structural or appearance cues. Most existing approaches rely on a single modality, such as fundus or optical coherence tomography (OCT),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhiwei Wang , Yuxing Li , Meilu Zhu , Defeng He , Edmund Y. Lam

Optical coherence tomography (OCT) imaging is a well-known technology for visualizing retinal layers and helps ophthalmologists to detect possible diseases. Accurate and early diagnosis of common retinal diseases can prevent the patients…

Image and Video Processing · Electrical Eng. & Systems 2022-03-04 Mohammad Rahimzadeh , Mahmoud Reza Mohammadi

Preventable or undiagnosed visual impairment and blindness affect billion of people worldwide. Automated multi-disease detection models offer great potential to address this problem via clinical decision support in diagnosis. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2021-03-30 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

The development of multi-label deep learning models for retinal disease classification is often hindered by the scarcity of large, expertly annotated clinical datasets due to patient privacy concerns and high costs. The recent release of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Jerry Cao-Xue , Tien Comlekoglu , Keyi Xue , Guanliang Wang , Jiang Li , Gordon Laurie

Multimodal information is frequently available in medical tasks. By combining information from multiple sources, clinicians are able to make more accurate judgments. In recent years, multiple imaging techniques have been used in clinical…

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Despite the revolutionary impact of AI and the development of locally trained algorithms, achieving widespread generalized learning from multi-modal data in medical AI remains a significant challenge. This gap hinders the practical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Fatema-E Jannat , Sina Gholami , Minhaj Nur Alam , Hamed Tabkhi

Deep learning has emerged as the predominant solution for classifying medical images. We intend to apply these developments to the ultra-widefield (UWF) retinal imaging dataset. Since UWF images can accurately diagnose various retina…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Siwon Kim , Wooyung Yun , Jeongbin Oh , Soomok Lee