English
Related papers

Related papers: Interactive and Explainable Region-guided Radiolog…

200 papers

We propose a new automated evaluation metric for machine-generated radiology reports using the successful COMET architecture adapted for the radiology domain. We train and publish four medically-oriented model checkpoints, including one…

Computation and Language · Computer Science 2023-11-29 Amos Calamida , Farhad Nooralahzadeh , Morteza Rohanian , Koji Fujimoto , Mizuho Nishio , Michael Krauthammer

Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder-decoder…

Computation and Language · Computer Science 2021-09-28 An Yan , Zexue He , Xing Lu , Jiang Du , Eric Chang , Amilcare Gentili , Julian McAuley , Chun-Nan Hsu

AI models have shown promise in many medical imaging tasks. However, our ability to explain what signals these models have learned is severely lacking. Explanations are needed in order to increase the trust in AI-based models, and could…

Automatic generation of radiology reports holds crucial clinical value, as it can alleviate substantial workload on radiologists and remind less experienced ones of potential anomalies. Despite the remarkable performance of various image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qingqiu Li , Jilan Xu , Runtian Yuan , Mohan Chen , Yuejie Zhang , Rui Feng , Xiaobo Zhang , Shang Gao

Evaluating automatically generated radiology reports remains a fundamental challenge due to the lack of clinically grounded, interpretable, and fine-grained metrics. Existing methods either produce coarse overall scores or rely on opaque…

Computation and Language · Computer Science 2025-08-22 Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Automated radiology report generation (R2Gen) has advanced significantly, introducing challenges in accurate evaluation due to its complexity. Traditional metrics often fall short by relying on rigid word-matching or focusing only on…

Computation and Language · Computer Science 2025-02-14 Yunyi Liu , Yingshu Li , Zhanyu Wang , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

Background: Ultrasound is one of the preferred choices for early screening of dense breast cancer. Clinically, doctors have to manually write the screening report which is time-consuming and laborious, and it is easy to miss and miswrite.…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Shuang Ge , Qiongyu Ye , Wenquan Xie , Desheng Sun , Huabin Zhang , Xiaobo Zhou , Kehong Yuan

Radiological imaging is central to diagnosis, treatment planning, and clinical decision-making. Vision-language foundation models have spurred interest in automated radiology report generation (RRG), but safe deployment requires reliable…

Multimodal foundation models hold significant potential for automating radiology report generation, thereby assisting clinicians in diagnosing cardiac diseases. However, generated reports often suffer from serious factual inaccuracy. In…

Computation and Language · Computer Science 2025-02-07 Liwen Sun , James Zhao , Megan Han , Chenyan Xiong

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Automated radiology report generation from chest X-ray (CXR) images has the potential to improve clinical efficiency and reduce radiologists' workload. However, most datasets, including the publicly available MIMIC-CXR and CheXpert Plus,…

In medical reporting, the accuracy of radiological reports, whether generated by humans or machine learning algorithms, is critical. We tackle a new task in this paper: image-conditioned autocorrection of inaccuracies within these reports.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Arnold Caleb Asiimwe , Dídac Surís , Pranav Rajpurkar , Carl Vondrick

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

Medical imaging plays a significant role in clinical practice of medical diagnosis, where the text reports of the images are essential in understanding them and facilitating later treatments. By generating the reports automatically, it is…

Computation and Language · Computer Science 2022-04-29 Zhihong Chen , Yaling Shen , Yan Song , Xiang Wan

Chest Xray imaging is a widely used diagnostic tool in modern medicine, and its high utilization creates substantial workloads for radiologists. To alleviate this burden, vision language models are increasingly applied to automate Chest…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shaoyang Zhou , Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Large Language Models (LLMs) have enabled new ways to satisfy information needs. Although great strides have been made in applying them to settings like document ranking and short-form text generation, they still struggle to compose…

Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images. However, the subtle visual nuances and domain-specific terminology…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Kai Shu , Yuzhuo Jia , Ziyang Zhang , Jiechao Gao

Annually and globally, over three billion radiography examinations and computer tomography scans result in mostly unstructured radiology reports containing free text. Despite the potential benefits of structured reporting, its adoption is…

Computation and Language · Computer Science 2024-06-25 Daniel Reichenpfader , Jonas Knupp , André Sander , Kerstin Denecke

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

Multiagent Systems · Computer Science 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim