English
Related papers

Related papers: XrayGPT: Chest Radiographs Summarization using Med…

200 papers

Generating radiology reports is time-consuming and requires extensive expertise in practice. Therefore, reliable automatic radiology report generation is highly desired to alleviate the workload. Although deep learning techniques have been…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Jianbo Yuan , Haofu Liao , Rui Luo , Jiebo Luo

In the past year, there has been a growing trend in applying Large Language Models (LLMs) to the field of medicine, particularly with the advent of advanced language models such as ChatGPT developed by OpenAI. However, there is limited…

Computation and Language · Computer Science 2024-02-27 Fujian Jia , Xin Liu , Lixi Deng , Jiwen Gu , Chunchao Pu , Tunan Bai , Mengjiang Huang , Yuanzhi Lu , Kang Liu

Chest X-ray plays a central role in thoracic diagnosis, and its interpretation inherently requires multi-step, evidence-grounded reasoning. However, large vision-language models (LVLMs) often generate plausible responses that are not…

Artificial Intelligence · Computer Science 2026-03-25 Hyungyung Lee , Hangyul Yoon , Edward Choi

Recent advances in reasoning-enhanced large language models (LLMs) and multimodal LLMs (MLLMs) have significantly improved performance in complex tasks, yet medical AI models often overlook the structured reasoning processes inherent in…

Artificial Intelligence · Computer Science 2025-05-22 Ziqing Fan , Cheng Liang , Chaoyi Wu , Ya Zhang , Yanfeng Wang , Weidi Xie

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy

Large Language Models (LLMs) have brought huge improvements to Artificial Intelligence (AI), which can be applied to general-purpose tasks. However, their application to textual or spoken medical consultations is still an open research…

Artificial Intelligence · Computer Science 2026-05-27 Heriberto Cuayahuitl , Grace Jang

Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Aaron Nicolson , Jason Dowling , Bevan Koopman

The emergence of large-scale large language models, with GPT-4 as a prominent example, has significantly propelled the rapid advancement of artificial general intelligence and sparked the revolution of Artificial Intelligence 2.0. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yuan Hu , Jianlong Yuan , Congcong Wen , Xiaonan Lu , Xiang Li

The impression section of a radiology report summarizes important radiology findings and plays a critical role in communicating these findings to physicians. However, the preparation of these summaries is time-consuming and error-prone for…

We introduce ReXGroundingCT, the first publicly available dataset linking free-text findings to pixel-level 3D segmentations in chest CT scans. The dataset includes 3,142 non-contrast chest CT scans paired with standardized radiology…

Latent Diffusion Models have shown remarkable results in text-guided image synthesis in recent years. In the domain of natural (RGB) images, recent works have shown that such models can be adapted to various vision-language downstream tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Konstantinos Vilouras , Ilias Stogiannidis , Junyu Yan , Alison Q. O'Neil , Sotirios A. Tsaftaris

Artificial intelligence (AI) has gained significant attention in healthcare consultation due to its potential to improve clinical workflow and enhance medical communication. However, owing to the complex nature of medical information, large…

Computation and Language · Computer Science 2024-03-05 Xiaolan Chen , Ziwei Zhao , Weiyi Zhang , Pusheng Xu , Le Gao , Mingpu Xu , Yue Wu , Yinwen Li , Danli Shi , Mingguang He

Recent advances in training deep learning models have demonstrated the potential to provide accurate chest X-ray interpretation and increase access to radiology expertise. However, poor generalization due to data distribution shifts in…

Image and Video Processing · Electrical Eng. & Systems 2021-02-23 Pranav Rajpurkar , Anirudh Joshi , Anuj Pareek , Andrew Y. Ng , Matthew P. Lungren

Since the release of the original CheXpert paper five years ago, CheXpert has become one of the most widely used and cited clinical AI datasets. The emergence of vision language models has sparked an increase in demands for sharing reports…

Radiology report generation (RRG) models typically focus on individual exams, often overlooking the integration of historical visual or textual data, which is crucial for patient follow-ups. Traditional methods usually struggle with long…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Tengfei Liu , Jiapu Wang , Yongli Hu , Mingjie Li , Junfei Yi , Xiaojun Chang , Junbin Gao , Baocai Yin

Conversation agents powered by large language models are revolutionizing the way we interact with visual data. Recently, large vision-language models (LVLMs) have been extensively studied for both images and videos. However, these studies…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Juseong Jin , Chang Wook Jeong

Recently, the increasing demand for superior medical services has highlighted the discrepancies in the medical infrastructure. With big data, especially texts, forming the foundation of medical services, there is an exigent need for…

Computation and Language · Computer Science 2024-07-17 Yuanhe Tian , Ruyi Gan , Yan Song , Jiaxing Zhang , Yongdong Zhang

Generating lifelike human motions from descriptive texts has experienced remarkable research focus in the recent years, propelled by the emerging requirements of digital humans.Despite impressive advances, existing approaches are often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuan Wang , Di Huang , Yaqi Zhang , Wanli Ouyang , Jile Jiao , Xuetao Feng , Yan Zhou , Pengfei Wan , Shixiang Tang , Dan Xu

Automated radiology report generation (RRG) holds potential to reduce the workload of radiologists, and recent advances in multimodal large language models (MLLMs) have enabled multimodal chest X-ray (CXR) report generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi

Large language models(LLMs), with their powerful language generation and reasoning capabilities, have already achieved notable success in many domains, e.g., math and code generation. However, they often fall short when tackling real-life…

Artificial Intelligence · Computer Science 2025-06-03 Jie Feng , Tianhui Liu , Yuwei Du , Siqi Guo , Yuming Lin , Yong Li