English
Related papers

Related papers: Enhancing Chest X-ray Classification through Knowl…

200 papers

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Deep Convolutional Neural Networks have consistently proven to achieve state-of-the-art results on a lot of imaging tasks over the past years' majority of which comprise of high-quality data. However, it is important to work on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Snigdha Agarwal , Neelam Sinha

Early detection and rapid intervention of lung cancer are crucial. Nonetheless, ensuring an accurate diagnosis is challenging, as physicians' ability to interpret chest X-rays varies significantly depending on their experience and degree of…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Hyeonjin Choi , Jinse Kim , Dong-yeon Yoo , Ju-sung Sun , Jung-won Lee

Automatic radiology report generation has been an attracting research problem towards computer-aided diagnosis to alleviate the workload of doctors in recent years. Deep learning techniques for natural image captioning are successfully…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Yixiao Zhang , Xiaosong Wang , Ziyue Xu , Qihang Yu , Alan Yuille , Daguang Xu

Deep Learning (DL) approaches have gained prominence in medical imaging for disease diagnosis. Chest X-ray (CXR) classification has emerged as an effective method for detecting various diseases. Among these methodologies, Chest X-ray (CXR)…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Sree Rama Vamsidhar S , Bhargava Satya , Rama Krishna Gorthi

CLIP and BiomedCLIP are examples of vision-language foundation models and offer strong cross-modal embeddings; however, they are not optimized for fine-grained medical retrieval tasks, such as retrieving clinically relevant radiology…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Zhaohui Liang , Sivaramakrishnan Rajaraman , Niccolo Marini , Zhiyun Xue , Sameer Antani

We propose a two-stage multimodal framework that enhances disease classification and region-aware radiology report generation from chest X-rays, leveraging the MIMIC-Eye dataset. In the first stage, we introduce a gaze-guided contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Tanjim Islam Riju , Shuchismita Anwar , Saman Sarker Joy , Farig Sadeque , Swakkhar Shatabda

Interpretation is critical for disease diagnosis, but existing models struggle to balance predictive accuracy with human-understandable rationales. While large language models (LLMs) offer strong reasoning abilities, their clinical use is…

Computation and Language · Computer Science 2025-07-15 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Yida Xu , Yunya Song , Xian Yang

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks

Artificial intelligence (AI) is disrupting the medical field as advances in modern technology allow common household computers to learn anatomical and pathological features that distinguish between healthy and disease with the accuracy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Alexandrea K. Ramnarine

Contrastive Language-Image Pre-training (CLIP) has demonstrated outstanding performance in global image understanding and zero-shot transfer through large-scale text-image alignment. However, the core of medical image analysis often lies in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiahui Peng , He Yao , Jingwen Li , Yanzhou Su , Sibo Ju , Yujie Lu , Jin Ye , Hongchun Lu , Xue Li , Lincheng Jiang , Min Zhu , Junlong Cheng

This study investigates the effects of including patients' clinical information on the performance of deep learning (DL) classifiers for disease location in chest X-ray images. Although current classifiers achieve high performance using…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Chihcheng Hsieh , Isabel Blanco Nobre , Sandra Costa Sousa , Chun Ouyang , Margot Brereton , Jacinto C. Nascimento , Joaquim Jorge , Catarina Moreira

With the advance of deep learning, much progress has been made in building powerful artificial intelligence (AI) systems for automatic Chest X-ray (CXR) analysis. Most existing AI models are trained to be a binary classifier with the aim of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangyu Peng , Kai Wang , Jianfei Yang , Yingying Zhu , Yang You

In this work, we present a novel approach to multi-label chest X-ray (CXR) image classification that enhances clinical interpretability while maintaining a streamlined, single-model, single-run training pipeline. Leveraging the CheXpert…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Mehrdad Asadi , Komi Sodoké , Ian J. Gerard , Marta Kersten-Oertel

Identifying labels that did not appear during training, known as multi-label zero-shot learning, is a non-trivial task in computer vision. To this end, recent studies have attempted to explore the multi-modal knowledge of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Xuelin Zhu , Jian Liu , Dongqi Tang , Jiawei Ge , Weijia Liu , Bo Liu , Jiuxin Cao

Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Shir Gur , Natalia Neverova , Chris Stauffer , Ser-Nam Lim , Douwe Kiela , Austin Reiter

The classification of medical images is a pivotal aspect of disease diagnosis, often enhanced by deep learning techniques. However, traditional approaches typically focus on unimodal medical image data, neglecting the integration of diverse…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jun-En Ding , Chien-Chin Hsu , Chi-Hsiang Chu , Shuqiang Wang , Feng Liu

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Public datasets of Chest X-Rays (CXRs) have long been a popular benchmark for developing machine learning (ML) computer vision models in healthcare. However, the reported strong average-case performance of these models do not necessarily…

Machine Learning · Computer Science 2026-02-10 Andrew Wang , Jiashuo Zhang , Michael Oberst

Deep learning technologies have already demonstrated a high potential to build diagnosis support systems from medical imaging data, such as Chest X-Ray images. However, the shortage of labeled data in the medical field represents one key…

Image and Video Processing · Electrical Eng. & Systems 2023-01-26 Iván de Andrés Tamé , Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo