English
Related papers

Related papers: Explaining Chest X-ray Pathology Models using Text…

200 papers

Explanations for Convolutional Neural Networks (CNNs) based on relevance of input pixels might be too unspecific to evaluate which and how input features impact model decisions. Especially in complex real-world domains like biology, the…

Machine Learning · Computer Science 2024-08-07 Bettina Finzel , Patrick Hilme , Johannes Rabold , Ute Schmid

BACKGROUND AND OBJECTIVES: The multiple chest x-ray datasets released in the last years have ground-truth labels intended for different computer vision tasks, suggesting that performance in automated chest-xray interpretation might improve…

Optical Character Recognition (OCR) is increasingly regarded as a foundational capability for modern vision-language models (VLMs), enabling them not only to read text in images but also to support downstream reasoning in real-world visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Longwei Xu , Feng Feng , Shaojie Zhang , Xin Chen , Hang Li , Anan Du , Hailong Yu , Pei Fu , Zhenbo Luo , Jian Luan

The automatic detection of critical findings in chest X-rays (CXR), such as pneumothorax, is important for assisting radiologists in their clinical workflow like triaging time-sensitive cases and screening for incidental findings. While…

Machine Learning · Computer Science 2020-01-27 Evan Schwab , André Gooßen , Hrishikesh Deshpande , Axel Saalbach

Analysis of chest CT scans can be used in detecting parts of lungs that are affected by infectious diseases such as COVID-19.Determining the volume of lungs affected by lesions is essential for formulating treatment recommendations and…

Visual question answering (VQA) in medical imaging aims to support clinical diagnosis by automatically interpreting complex imaging data in response to natural language queries. Existing studies typically rely on distinct visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yuanhe Tian , Chen Su , Junwen Duan , Yan Song

Medical Visual Question Answering (Med-VQA) combines computer vision and natural language processing to automatically answer clinical inquiries about medical images. However, current Med-VQA datasets exhibit two significant limitations: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bo Liu , Ke Zou , Liming Zhan , Zexin Lu , Xiaoyu Dong , Yidi Chen , Chengqiang Xie , Jiannong Cao , Xiao-Ming Wu , Huazhu Fu

In recent years, deep learning models have been extensively applied to biological data across various modalities. Discriminative deep learning models have excelled at classifying images into categories (e.g., healthy versus diseased,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Anis Bourou , Saranga Kingkor Mahanta , Thomas Boyer , Valérie Mezger , Auguste Genovesio

Chest X-rays (CXRs) are the most widely used medical imaging modality and play a pivotal role in diagnosing diseases. However, as 2D projection images, CXRs are limited by structural superposition, which constrains their effectiveness in…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Zefan Yang , Xinrui Song , Xuanang Xu , Yongyi Shi , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Pulmonary diseases rank prominently among the principal causes of death worldwide. Curing them will require, among other things, a better understanding of the complex 3D tree-shaped structures within the pulmonary system, such as airways,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Kangxian Xie , Jiancheng Yang , Donglai Wei , Ziqiao Weng , Pascal Fua

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

Automated multi-label chest X-rays (CXR) image classification has achieved substantial progress in clinical diagnosis via utilizing sophisticated deep learning approaches. However, most deep models have high computational demands, which…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Chakkrit Termritthikun , Ayaz Umer , Suwichaya Suwanwimolkul , Feng Xia , Ivan Lee

Chest X-rays or chest radiography (CXR), commonly used for medical diagnostics, typically enables limited imaging compared to computed tomography (CT) scans, which offer more detailed and accurate three-dimensional data, particularly…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Noa Cahan , Eyal Klang , Galit Aviram , Yiftach Barash , Eli Konen , Raja Giryes , Hayit Greenspan

The recent development of data-driven AI promises to automate medical diagnosis; however, most AI functions as 'black boxes' to physicians with limited computational knowledge. Using medical imaging as a point of departure, we conducted…

Human-Computer Interaction · Computer Science 2020-01-22 Yao Xie , Melody Chen , David Kao , Ge Gao , Xiang 'Anthony' Chen

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

In recent times, the use of chest Computed Tomography (CT) images for detecting coronavirus infections has gained significant attention, owing to their ability to reveal bilateral changes in affected individuals. However, classifying…

Image and Video Processing · Electrical Eng. & Systems 2023-10-27 Amir Ali

Deep learning-based medical image classification techniques are rapidly advancing in medical image analysis, making it crucial to develop accurate and trustworthy models that can be efficiently deployed across diverse clinical scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hangzhou He , Jiachen Tang , Lei Zhu , Kaiwen Li , Yanye Lu

Patients undergoing chest X-rays (CXR) often endure multiple lung diseases. When evaluating a patient's condition, due to the complex pathologies, subtle texture changes of different lung lesions in images, and patient condition…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Mengliang Zhang , Xinyue Hu , Lin Gu , Liangchen Liu , Kazuma Kobayashi , Tatsuya Harada , Ronald M. Summers , Yingying Zhu