English
Related papers

Related papers: CXR-LanIC: Language-Grounded Interpretable Classif…

200 papers

Radiology is essential to modern healthcare, yet rising demand and staffing shortages continue to pose major challenges. Recent advances in artificial intelligence have the potential to support radiologists and help address these…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Phillip Sloan , Edwin Simpson , Majid Mirmehdi

In this work, we present an approach, which we call Embeddings for Language/Image-aligned X-Rays, or ELIXR, that leverages a language-aligned image encoder combined or grafted onto a fixed LLM, PaLM 2, to perform a broad range of chest…

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Breast cancer detection through mammography interpretation remains difficult because of the minimal nature of abnormalities that experts need to identify alongside the variable interpretations between readers. The potential of CNNs for…

Image and Video Processing · Electrical Eng. & Systems 2025-08-11 Ojonugwa Oluwafemi Ejiga Peter , Daniel Emakporuena , Bamidele Dayo Tunde , Maryam Abdulkarim , Abdullahi Bn Umar

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

We propose DeepMiner, a framework to discover interpretable representations in deep neural networks and to build explanations for medical predictions. By probing convolutional neural networks (CNNs) trained to classify cancer in mammograms,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jimmy Wu , Bolei Zhou , Diondra Peck , Scott Hsieh , Vandana Dialani , Lester Mackey , Genevieve Patterson

Medical artificial intelligence (AI) is revolutionizing the interpretation of chest X-ray (CXR) images by providing robust tools for disease diagnosis. However, the effectiveness of these AI models is often limited by their reliance on…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Lijian Xu , Ziyu Ni , Hao Sun , Hongsheng Li , Shaoting Zhang

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Recent advances in reasoning-enhanced large language models (LLMs) and multimodal LLMs (MLLMs) have significantly improved performance in complex tasks, yet medical AI models often overlook the structured reasoning processes inherent in…

Artificial Intelligence · Computer Science 2025-05-22 Ziqing Fan , Cheng Liang , Chaoyi Wu , Ya Zhang , Yanfeng Wang , Weidi Xie

Amid the coronavirus disease(COVID-19) pandemic, humanity experiences a rapid increase in infection numbers across the world. Challenge hospitals are faced with, in the fight against the virus, is the effective screening of incoming…

Image and Video Processing · Electrical Eng. & Systems 2020-06-09 Md. Rezaul Karim , Till Döhmen , Dietrich Rebholz-Schuhmann , Stefan Decker , Michael Cochez , Oya Beyan

Deep learning models show significant potential for advancing AI-assisted medical diagnostics, particularly in detecting lung cancer through medical image modalities such as chest X-rays. However, the black-box nature of these models poses…

Machine Learning · Computer Science 2025-03-31 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

The clinical adoption of artificial intelligence (AI) in medical diagnostics is critically hampered by its black-box nature, which prevents clinicians from verifying the rationale behind automated decisions. To overcome this fundamental…

In this era of pandemic, the future of healthcare industry has never been more exciting. Artificial intelligence and machine learning (AI & ML) present opportunities to develop solutions that cater for very specific needs within the…

Image and Video Processing · Electrical Eng. & Systems 2022-11-29 Aravind Sasidharan Pillai

Clinical deployment of chest radiograph classifiers requires models that can be updated as new datasets become available without retraining on previously observed data or degrading validated performance. We study a task-incremental…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muthu Subash Kavitha , Anas Zafar , Amgad Muneer , Jia Wu

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

A global shortage of radiologists has been exacerbated by the significant volume of chest X-ray workloads, particularly in primary care. Although multimodal large language models show promise, existing evaluations predominantly rely on…

The Deep learning (DL) models for diagnosing breast cancer from mammographic images often operate as "black boxes", making it difficult for healthcare professionals to trust and understand their decision-making processes. The study presents…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Maryam Ahmed , Tooba Bibi , Rizwan Ahmed Khan , Sidra Nasir

Accurate and rapid detection of COVID-19 pneumonia is crucial for optimal patient treatment. Chest X-Ray (CXR) is the first line imaging test for COVID-19 pneumonia diagnosis as it is fast, cheap and easily accessible. Inspired by the…

Image and Video Processing · Electrical Eng. & Systems 2023-02-20 Xin Zhang , Liangxiu Han , Tam Sobeih , Lianghao Han , Nina Dempsey , Symeon Lechareas , Ascanio Tridente , Haoming Chen , Stephen White

Deep learning shows promise for medical image analysis but lacks interpretability, hindering adoption in healthcare. Attribution techniques that explain model reasoning may increase trust in deep learning among clinical stakeholders. This…

Machine Learning · Computer Science 2023-08-08 Yusuf Brima , Marcellin Atemkeng

Automated diagnosis using deep neural networks in chest radiography can help radiologists detect life-threatening diseases. However, existing methods only provide predictions without accurate explanations, undermining the trustworthiness of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Eunji Kim , Siwon Kim , Minji Seo , Sungroh Yoon