English
Related papers

Related papers: Clinically-aligned Multi-modal Chest X-ray Classif…

200 papers

Multi-modal fusion approaches aim to integrate information from different data sources. Unlike natural datasets, such as in audio-visual applications, where samples consist of "paired" modalities, data in healthcare is often collected…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Nasir Hayat , Krzysztof J. Geras , Farah E. Shamout

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

Clinical classification of chest radiography is particularly challenging for standard machine learning algorithms due to its inherent long-tailed and multi-label nature. However, few attempts take into account the coupled challenges posed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Feng Hong , Tianjie Dai , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Chest X-Ray imaging is one of the most common radiological tools for detection of various pathologies related to the chest area and lung function. In a clinical setting, automated assessment of chest radiographs has the potential of…

Machine Learning · Computer Science 2022-10-31 David Biesner , Helen Schneider , Benjamin Wulff , Ulrike Attenberger , Rafet Sifa

CLIP and BiomedCLIP are examples of vision-language foundation models and offer strong cross-modal embeddings; however, they are not optimized for fine-grained medical retrieval tasks, such as retrieving clinically relevant radiology…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Zhaohui Liang , Sivaramakrishnan Rajaraman , Niccolo Marini , Zhiyun Xue , Sameer Antani

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Saurabh Agarwal , K. V. Arya , Yogesh Kumar Meena

The escalating demand for medical image interpretation underscores the critical need for advanced artificial intelligence solutions to enhance the efficiency and accuracy of radiological diagnoses. This paper introduces CXR-PathFinder, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Pimchanok Sukjai , Apiradee Boonmee

Modern diagnostic workflows are increasingly multimodal, integrating diverse data sources such as medical images, structured records, and physiological time series. Among these, electrocardiograms (ECGs) and chest X-rays (CXRs) are two of…

Machine Learning · Computer Science 2025-06-25 Vineet Punyamoorty , Aditya Malusare , Vaneet Aggarwal

Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Shengchao Chen , Sufen Ren , Guanjun Wang , Mengxing Huang , Chenyang Xue

Radiology reports are crucial for planning treatment strategies and facilitating effective doctor-patient communication. However, the manual creation of these reports places a significant burden on radiologists. While automatic radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Qiguang Miao , Kang Liu , Zhuoqi Ma , Yunan Li , Xiaolu Kang , Ruixuan Liu , Tianyi Liu , Kun Xie , Zhicheng Jiao

The rapid evolution of artificial intelligence, especially in large language models (LLMs), has significantly impacted various domains, including healthcare. In chest X-ray (CXR) analysis, previous studies have employed LLMs, but with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Soobum Kim , Byungmu Yoon , Jihun Hyun , Kyoyun Choi

The image captioning task is increasingly prevalent in artificial intelligence applications for medicine. One important application is clinical report generation from chest radiographs. The clinical writing of unstructured reports is time…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Edward Vendrow , Ethan Schonfeld

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

Machine Learning · Computer Science 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Building generalizable medical AI systems requires pretraining strategies that are data-efficient and domain-aware. Unlike internet-scale corpora, clinical datasets such as MIMIC-CXR offer limited image counts and scarce annotations, but…

Multimodal medical large language models have shown substantial progress in chest X-ray interpretation but continue to face challenges in spatial reasoning and anatomical understanding. Although existing grounding techniques improve overall…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Anees Ur Rehman Hashmi , Numan Saeed , Christoph Lippert

Intelligent analysis of medical imaging plays a crucial role in assisting clinical diagnosis, especially for identifying subtle pathological features. This paper introduces a novel multi-branch ConvNeXt architecture designed specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Irash Perera , Uthayasanker Thayasivam

As artificial intelligence (AI) becomes increasingly central to healthcare, the demand for explainable and trustworthy models is paramount. Current report generation systems for chest X-rays (CXR) often lack mechanisms for validating…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Sayeh Gholipour Picha , Dawood Al Chanti , Alice Caplier

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

Despite the reduction in turn-around times in radiology reports with the use of speech recognition software, persistent communication errors can significantly impact the interpretation of the radiology report. Pre-filling a radiology report…

Computation and Language · Computer Science 2023-10-11 Qingqing Zhu , Tejas Sudharshan Mathai , Pritam Mukherjee , Yifan Peng , Ronald M. Summers , Zhiyong Lu

The development of AI-based methods to analyze radiology reports could lead to significant advances in medical diagnosis, from improving diagnostic accuracy to enhancing efficiency and reducing workload. However, the lack of…

Computation and Language · Computer Science 2025-08-14 Yuyan Ge , Kwan Ho Ryan Chan , Pablo Messina , René Vidal