中文
相关论文

相关论文: Multi-Modal Multi-Instance Learning for Retinal Di…

200 篇论文

Accurate grading of Conjunctival Melanocytic Intraepithelial Lesions (CMIL) is essential for treatment and melanoma prediction but remains difficult due to subtle morphological cues and interrelated diagnostic criteria. We introduce…

The availability of handy multi-modal (i.e., RGB-D) sensors has brought about a surge of face anti-spoofing research. However, the current multi-modal face presentation attack detection (PAD) has two defects: (1) The framework based on…

计算机视觉与模式识别 · 计算机科学 2023-05-08 Ajian Liu , Zichang Tan , Zitong Yu , Chenxu Zhao , Jun Wan , Yanyan Liang , Zhen Lei , Du Zhang , Stan Z. Li , Guodong Guo

Diabetic Retinopathy (DR) is a leading cause of vision loss worldwide, requiring early detection to preserve sight. Limited access to physicians often leaves DR undiagnosed. To address this, AI models utilize lesion segmentation for…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Shivum Telang

Current deep learning models are mostly task specific and lack a user-friendly interface to operate. We present Meta-EyeFM, a multi-function foundation model that integrates a large language model (LLM) with vision foundation models (VFMs)…

Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation models hold significant promise for addressing these…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Danli Shi , Weiyi Zhang , Jiancheng Yang , Siyu Huang , Xiaolan Chen , Mayinuer Yusufu , Kai Jin , Shan Lin , Shunming Liu , Qing Zhang , Mingguang He

In the realm of digital pathology, multi-magnification Multiple Instance Learning (multi-mag MIL) has proven effective in leveraging the hierarchical structure of Whole Slide Images (WSIs) to reduce information loss and redundant data.…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Yujian Liu , Ruoxuan Wu , Xinjie Shen , Zihuang Lu , Lingyu Liang , Haiyu Zhou , Shipu Xu , Shaoai Cai , Shidang Xu

Melanoma is considered to be the deadliest variant of skin cancer causing around 75\% of total skin cancer deaths. To diagnose Melanoma, clinicians assess and compare multiple skin lesions of the same patient concurrently to gather…

计算机视觉与模式识别 · 计算机科学 2023-03-08 Md Awsafur Rahman , Bishmoy Paul , Tanvir Mahmud , Shaikh Anowarul Fattah

Purpose: Deep learning methods have shown promising results in the segmentation, and detection of diseases in medical images. However, most methods are trained and tested on data from a single source, modality, organ, or disease type,…

图像与视频处理 · 电气工程与系统科学 2025-08-20 Nchongmaje Ndipenocha , Alina Mirona , Kezhi Wanga , Yongmin Li

Cross-modality fusing complementary information of multispectral remote sensing image pairs can improve the perception ability of detection algorithms, making them more robust and reliable for a wider range of applications, such as…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Qingyun Fang , Zhaokui Wang

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

Mean Deviation (MD) is a critical metric for assessing visual field loss in ophthalmology. While previous work has focused solely on predicting MD from Optical Coherence Tomography (OCT), it is intuitive to assume that combining OCT with…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Haojie Yin , Chengcheng Feng , Tianyi Liu , Tianqi Zhang , Kaizhu Huang

In the real world, medical datasets often exhibit a long-tailed data distribution (i.e., a few classes occupy most of the data, while most classes have rarely few samples), which results in a challenging imbalance learning scenario. For…

计算机视觉与模式识别 · 计算机科学 2021-04-23 Lie Ju , Xin Wang , Lin Wang , Tongliang Liu , Xin Zhao , Tom Drummond , Dwarikanath Mahapatra , Zongyuan Ge

Whole-slide image classification represents a key challenge in computational pathology and medicine. Attention-based multiple instance learning (MIL) has emerged as an effective approach for this problem. However, the effect of attention…

Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called…

机器学习 · 计算机科学 2024-02-09 Pramit Saha , Divyanshu Mishra , Felix Wagner , Konstantinos Kamnitsas , J. Alison Noble

Significant advancements in AI-driven multimodal medical image diagnosis have led to substantial improvements in ophthalmic disease identification in recent years. However, acquiring paired multimodal ophthalmic images remains prohibitively…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Daniel Zapp , Kai Huang , Nassir Navab , M. Ali Nasseri

We propose a Multi-Instance-Learning (MIL) approach for weakly-supervised learning problems, where a training set is formed by bags (sets of feature vectors or instances) and only labels at bag-level are provided. Specifically, we consider…

计算机视觉与模式识别 · 计算机科学 2018-07-04 Adria Ruiz , Ognjen Rudovic , Xavier Binefa , Maja Pantic

Accurately segmenting blood vessels in retinal fundus images is crucial in the early screening, diagnosing, and evaluating some ocular diseases, yet it poses a nontrivial uncertainty for the segmentation task due to various factors such as…

图像与视频处理 · 电气工程与系统科学 2023-06-29 Yuanyuan Peng , Pengpeng Luan , Zixu Zhang

The dynamic environment of laboratories and clinics, with streams of data arriving on a daily basis, requires regular updates of trained machine learning models for consistent performance. Continual learning is supposed to help train models…

机器学习 · 计算机科学 2025-08-12 Zahra Ebrahimi , Raheleh Salehi , Nassir Navab , Carsten Marr , Ario Sadafi

The growing burden of myopia and retinal diseases necessitates more accessible and efficient eye screening solutions. This study presents a compact, dual-function optical device that integrates fundus photography and refractive error…

图像与视频处理 · 电气工程与系统科学 2025-04-29 Boyuan Peng , Jiaju Chen , Yiwei Zhang , Cuiyi Peng , Junyang Li , Jiaming Deng , Peiwu Qin

The detection of induced pluripotent stem cell (iPSC) colonies often needs the precise extraction of the colony features. However, existing computerized systems relied on segmentation of contours by preprocessing for classifying the colony…

图像与视频处理 · 电气工程与系统科学 2022-03-10 Novanto Yudistira , Muthu Subash Kavitha , Jeny Rajan , Takio Kurita