English
Related papers

Related papers: Multi-Modal Multi-Instance Learning for Retinal Di…

200 papers

Diabetic retinopathy (DR) results in vision loss if not treated early. A computer-aided diagnosis (CAD) system based on retinal fundus images is an efficient and effective method for early DR diagnosis and assisting experts. A…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Norah Asiri , Muhammad Hussain , Fadwa Al Adel , Nazih Alzaidi

Multiple Instance learning (MIL) models have been extensively used in pathology to predict biomarkers and risk-stratify patients from gigapixel-sized images. Machine learning problems in medical imaging often deal with rare diseases, making…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Dinkar Juyal , Siddhant Shingi , Syed Ashar Javed , Harshith Padigela , Chintan Shah , Anand Sampat , Archit Khosla , John Abel , Amaro Taylor-Weiner

We present VisionFM, a foundation model pre-trained with 3.4 million ophthalmic images from 560,457 individuals, covering a broad range of ophthalmic diseases, modalities, imaging devices, and demography. After pre-training, VisionFM…

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Purpose: The integration of multimodal imaging into operating rooms paves the way for comprehensive surgical scene understanding. In ophthalmic surgery, by now, two complementary imaging modalities are available: operating microscope (OPMI)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Nikolo Rohrmoser , Ghazal Ghazaei , Michael Sommersperger , Nassir Navab

Glaucoma is one of the leading causes of blindness worldwide and Optical Coherence Tomography (OCT) is the quintessential imaging technique for its detection. Unlike most of the state-of-the-art studies focused on glaucoma detection, in…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Gabriel García , Rocío del Amor , Adrián Colomer , Rafael Verdú-Monedero , Juan Morales-Sánchez , Valery Naranjo

In the medical domain, acquiring large datasets poses significant challenges due to privacy concerns. Nonetheless, the development of a robust deep-learning model for retinal disease diagnosis necessitates a substantial dataset for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Fatema-E- Jannat , Sina Gholami , Jennifer I. Lim , Theodore Leng , Minhaj Nur Alam , Hamed Tabkhi

Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

Foundation models are large-scale versatile systems trained on vast quantities of diverse data to learn generalizable representations. Their adaptability with minimal fine-tuning makes them particularly promising for medical imaging, where…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Lucie Berger , Mathieu Lamard , Philippe Zhang , Laurent Borderie , Alexandre Le Guilcher , Pascale Massin , Béatrice Cochener , Gwenolé Quellec , Sarah Matta

The application of Artificial Intelligence in the medical market brings up increasing concerns but aids in more timely diagnosis of silent progressing diseases like Diabetic Retinopathy. In order to diagnose Diabetic Retinopathy (DR),…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 Sharan Subramanian , Leilani H. Gilpin

While multimodal data integrating diverse imaging and clinical tabular records is crucial for accurate medical diagnosis, the arbitrary absence of specific modalities is prevalent in clinical practice, severely degrading the performance of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Tianling Liu , Lequan Yu , Tong Han , Liang Wan

Optical coherence tomography (OCT) is a prevalent imaging technique for retina. However, it is affected by multiplicative speckle noise that can degrade the visibility of essential anatomical structures, including blood vessels and tissue…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 Dewei Hu , Joseph D. Malone , Yigit Atay , Yuankai K. Tao , Ipek Oguz

The computer-aided analysis of medical scans is a longstanding goal in the medical imaging field. Currently, deep learning has became a dominant methodology for supporting pathologists and radiologist. Deep learning algorithms have been…

Machine Learning · Computer Science 2017-12-06 Jakub M. Tomczak , Maximilian Ilse , Max Welling

Diseases are currently managed by grading systems, where patients are stratified by grading systems into stages that indicate patient risk and guide clinical management. However, these broad categories typically lack prognostic value, and…

Automatic diagnosis techniques have evolved to identify age-related macular degeneration (AMD) by employing single modality Fundus images or optical coherence tomography (OCT). To classify ocular diseases, fundus and OCT images are the most…

Image and Video Processing · Electrical Eng. & Systems 2024-09-04 Pragya Gupta , Subhamoy Mandal , Debashree Guha , Debjani Chakraborty

Retinal foundation models aim to learn generalizable representations from diverse retinal images, facilitating label-efficient model adaptation across various ophthalmic tasks. Despite their success, current retinal foundation models are…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Kai Yu , Yang Zhou , Yang Bai , Zhi Da Soh , Xinxing Xu , Rick Siow Mong Goh , Ching-Yu Cheng , Yong Liu

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

Attention-based learning for fine-grained image recognition remains a challenging task, where most of the existing methods treat each object part in isolation, while neglecting the correlations among them. In addition, the multi-stage or…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Ming Sun , Yuchen Yuan , Feng Zhou , Errui Ding

Multiple instance learning (MIL)-based framework has become the mainstream for processing the whole slide image (WSI) with giga-pixel size and hierarchical image context in digital pathology. However, these methods heavily depend on a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Jiangbo Shi , Chen Li , Tieliang Gong , Yefeng Zheng , Huazhu Fu

Recently, multimodal deep learning, which integrates histopathology slides and molecular biomarkers, has achieved a promising performance in glioma grading. Despite great progress, due to the intra-modality complexity and inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Li Pan , Yupei Zhang , Qiushi Yang , Tan Li , Xiaohan Xing , Maximus C. F. Yeung , Zhen Chen