English
Related papers

Related papers: Automated Radiology Report Generation Based on Top…

200 papers

Radiology Report Generation (RRG) has advanced considerably with the development of multimodal generative models. Despite the progress, the field still faces significant challenges in evaluation, as existing metrics lack robustness and…

Computation and Language · Computer Science 2025-05-20 Kun Zhao , Chenghao Xiao , Sixing Yan , Haoteng Tang , William K. Cheung , Noura Al Moubayed , Liang Zhan , Chenghua Lin

The automatic generation of medical reports utilizing Multimodal Large Language Models (MLLMs) frequently encounters challenges related to factual instability, which may manifest as the omission of findings or the incorporation of…

Computation and Language · Computer Science 2026-03-03 Cunyuan Yang , Dejuan Song , Xiaotao Pang , Qianqian Shen , Wenjie Nie , Yifan Huang , Lei Wu , Wei Han , Haishuai Wang , Jiajun Bu

Automatic chest X-ray report generation is an important area of research aimed at improving diagnostic accuracy and helping doctors make faster decisions. Current AI models are good at finding correlations (or patterns) in medical images.…

Machine Learning · Computer Science 2025-12-16 Satyam Kumar

Spoken question-answering (SQA) systems relying on automatic speech recognition (ASR) often struggle with accurately recognizing medical terminology. To this end, we propose MedSpeak, a novel knowledge graph-aided ASR error correction…

Computation and Language · Computer Science 2026-04-28 Yutong Song , Shiva Shrestha , Chenhan Lyu , Elahe Khatibi , Pengfei Zhang , Honghui Xu , Nikil Dutt , Amir Rahmani

Automated radiology report generation aims to expedite the tedious and error-prone reporting process for radiologists. While recent works have made progress, learning to align medical images and textual findings remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yaxiong Chen , Chuang Du , Chunlei Li , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

Radiology Report Generation (R2Gen) demonstrates how Multi-modal Large Language Models (MLLMs) can automate the creation of accurate and coherent radiological reports. Existing methods often hallucinate details in text-based reports that…

Computation and Language · Computer Science 2024-07-19 Manav Nitin Kapadnis , Sohan Patnaik , Abhilash Nandy , Sourjyadip Ray , Pawan Goyal , Debdoot Sheet

We propose a general pipeline to automate the extraction of labels from radiology reports using large language models, which we validate on spinal MRI reports. The efficacy of our labelling method is measured on five distinct conditions:…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Robin Y. Park , Rhydian Windsor , Amir Jamaludin , Andrew Zisserman

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. These systems have achieved promising…

Computation and Language · Computer Science 2022-10-25 Jean-Benoit Delbrouck , Pierre Chambon , Christian Bluethgen , Emily Tsai , Omar Almusa , Curtis P. Langlotz

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing report generation…

Computation and Language · Computer Science 2021-04-14 Yasuhide Miura , Yuhao Zhang , Emily Bao Tsai , Curtis P. Langlotz , Dan Jurafsky

Keyphrase generation is the task consisting in generating a set of words or phrases that highlight the main topics of a document. There are few datasets for keyphrase generation in the biomedical domain and they do not meet the expectations…

Computation and Language · Computer Science 2022-11-23 Mael Houbre , Florian Boudin , Beatrice Daille

Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains: these models often lack prior knowledge, resulting in the generation of synthetic…

Computation and Language · Computer Science 2023-06-06 Sanghwan Kim , Farhad Nooralahzadeh , Morteza Rohanian , Koji Fujimoto , Mizuho Nishio , Ryo Sakamoto , Fabio Rinaldi , Michael Krauthammer

In radiology, Artificial Intelligence (AI) has significantly advanced report generation, but automatic evaluation of these AI-produced reports remains challenging. Current metrics, such as Conventional Natural Language Generation (NLG) and…

Computation and Language · Computer Science 2024-02-20 Qingqing Zhu , Xiuying Chen , Qiao Jin , Benjamin Hou , Tejas Sudharshan Mathai , Pritam Mukherjee , Xin Gao , Ronald M Summers , Zhiyong Lu

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

The Impression section of a radiology report summarizes crucial radiology findings in natural language and plays a central role in communicating these findings to physicians. However, the process of generating impressions by summarizing…

Computation and Language · Computer Science 2018-10-10 Yuhao Zhang , Daisy Yi Ding , Tianpei Qian , Christopher D. Manning , Curtis P. Langlotz

X-ray image based medical report generation achieves significant progress in recent years with the help of the large language model, however, these models have not fully exploited the effective information in visual image regions, resulting…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Xiao Wang , Fuling Wang , Haowen Wang , Bo Jiang , Chuanfu Li , Yaowei Wang , Yonghong Tian , Jin Tang

For robot-assisted surgery, an accurate surgical report reflects clinical operations during surgery and helps document entry tasks, post-operative analysis and follow-up treatment. It is a challenging task due to many complex and diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Hongqiu Wang , Yueming Jin , Lei Zhu

Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP). Most previous methods solve this problem in an extractive manner, while recently, several…

Computation and Language · Computer Science 2019-01-17 Wang Chen , Yifan Gao , Jiani Zhang , Irwin King , Michael R. Lyu

The extraction of structured clinical information from free-text radiology reports in the form of radiology graphs has been demonstrated to be a valuable approach for evaluating the clinical correctness of report-generation methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yiheng Xiong , Jingsong Liu , Kamilia Zaripova , Sahand Sharifzadeh , Matthias Keicher , Nassir Navab

Large language models (LLMs) often generate outdated or inaccurate information based on static training datasets. Retrieval-augmented generation (RAG) mitigates this by integrating outside data sources. While previous RAG systems used…

Clinical decision-making is a fundamental stage in delivering appropriate care to patients. In recent years several decision-making systems designed to aid the clinician in this process have been developed. However, technical solutions…

Computation and Language · Computer Science 2023-10-10 Rakhilya Lee Mekhtieva , Brandon Forbes , Dalal Alrajeh , Brendan Delaney , Alessandra Russo