English
Related papers

Related papers: Deep Learning with HM-VGG: AI Strategies for Multi…

200 papers

Observing retinal fundus images by an ophthalmologist is a major diagnosis approach for glaucoma. However, it is still difficult to distinguish the features of the lesion solely through manual observations, especially, in glaucoma early…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Peng Liu , Ruogu Fang

Recently, deep learning has been adopted to the glaucoma classification task with performance comparable to that of human experts. However, a well trained deep learning model demands a large quantity of properly labeled data, which is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Junde Wu , Shuang Yu , Wenting Chen , Kai Ma , Rao Fu , Hanruo Liu , Xiaoguang Di , Yefeng Zheng

Deep learning models have great potential in medical imaging, including orthodontics and skeletal maturity assessment. However, applying a model to data different from its training set can lead to unreliable predictions that may impact…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Omid Halimi Milani , Amanda Nikho , Lauren Mills , Marouane Tliba , Ahmet Enis Cetin , Mohammed H. Elnagar

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Purpose: The optic nerve head (ONH) undergoes complex and deep 3D morphological changes during the development and progression of glaucoma. Optical coherence tomography (OCT) is the current gold standard to visualize and quantify these…

Image and Video Processing · Electrical Eng. & Systems 2022-04-21 Fabian A. Braeu , Alexandre H. Thiéry , Tin A. Tun , Aiste Kadziauskiene , George Barbastathis , Tin Aung , Michaël J. A. Girard

Objective: To validate and compare the performance of eight available deep learning architectures in grading the severity of glaucoma based on color fundus images. Materials and Methods: We retrospectively collected a dataset of 5978 fundus…

Computer Vision and Pattern Recognition · Computer Science 2018-11-01 Yi Zhen , Lei Wang , Han Liu , Jian Zhang , Jiantao Pu

Although unprecedented sensitivity and specificity values are reported, recent glaucoma detection deep learning models lack in decision transparency. Here, we propose a methodology that advances explainable deep learning in the field of…

Image and Video Processing · Electrical Eng. & Systems 2021-10-06 Ruben Hemelings , Bart Elen , João Barbosa-Breda , Matthew B. Blaschko , Patrick De Boever , Ingeborg Stalmans

Recent advancements in multi-view action recognition have largely relied on Transformer-based models. While effective and adaptable, these models often require substantial computational resources, especially in scenarios with multiple views…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yuhui Lin , Jiaxuan Lu , Yue Yong , Jiahao Zhang

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

Transformer-based deep learning models have demonstrated exceptional performance in medical imaging by leveraging attention mechanisms for feature representation and interpretability. However, these models are prone to learning spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shelley Zixin Shu , Haozhe Luo , Alexander Poellinger , Mauricio Reyes

Glaucoma is one of the leading causes of blindness worldwide and Optical Coherence Tomography (OCT) is the quintessential imaging technique for its detection. Unlike most of the state-of-the-art studies focused on glaucoma detection, in…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Gabriel García , Rocío del Amor , Adrián Colomer , Rafael Verdú-Monedero , Juan Morales-Sánchez , Valery Naranjo

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kexin Yu , Zihan Xu , Jialei Xie , Carter Adams

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bidur Khanal , Sandesh Pokhrel , Sanjay Bhandari , Ramesh Rana , Nikesh Shrestha , Ram Bahadur Gurung , Cristian Linte , Angus Watson , Yash Raj Shrestha , Binod Bhattarai

Retrieving visual and textual information from medical literature and hospital records can enhance diagnostic accuracy for clinical image interpretation. However, multimodal retrieval-augmented diagnosis is highly challenging. We explore a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Nir Mazor , Tom Hope

Glaucoma is a severe blinding disease, for which automatic detection methods are urgently needed to alleviate the scarcity of ophthalmologists. Many works have proposed to employ deep learning methods that involve the segmentation of optic…

Image and Video Processing · Electrical Eng. & Systems 2022-09-26 Yanni Wang , Gang Yang , Dayong Ding , Jianchun Zao

In recent years, deep learning models have been applied to neuroimaging data for early diagnosis of Alzheimer's disease (AD). Structural magnetic resonance imaging (sMRI) and positron emission tomography (PET) images provide structural and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Yanteng Zhanga , Xiaohai He , Yi Hao Chan , Qizhi Teng , Jagath C. Rajapakse

Background: This study proposes a Vision-Language Model (VLM) leveraging the SIGLIP encoder and Gemma-3b transformer decoder to enhance automated chronic tuberculosis (TB) screening. By integrating chest X-ray images with clinical data, the…

This paper proposes a novel multimodal deep learning framework integrating bidirectional LSTM, multi-head attention mechanism, and variational mode decomposition (BiLSTM-AM-VMD) for early liver cancer diagnosis. Using heterogeneous data…

Machine Learning · Computer Science 2025-09-03 Cheng Cheng , Zeping Chen , Xavier Wang

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas