English
Related papers

Related papers: Auxiliary Signal-Guided Knowledge Encoder-Decoder …

200 papers

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

Computation and Language · Computer Science 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

The world faces a shortage of radiologists, leading to longer treatment times and increased stress, negatively impacting patient safety and workforce morale. Integrating artificial intelligence to interpret radiographic images and generate…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Marijn Borghouts

Generating long and semantic-coherent reports to describe medical images poses great challenges towards bridging visual and linguistic modalities, incorporating medical domain knowledge, and generating realistic and accurate descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Christy Y. Li , Xiaodan Liang , Zhiting Hu , Eric P. Xing

Vision-grounded medical report generation aims to produce clinically accurate descriptions of medical images, anchored in explicit visual evidence to improve interpretability and facilitate integration into clinical workflows. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Longzhen Yang , Zhangkai Ni , Ying Wen , Yihang Liu , Lianghua He , Heng Tao Shen

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

Radiology reporting generative AI holds significant potential to alleviate clinical workloads and streamline medical care. However, achieving high clinical accuracy is challenging, as radiological images often feature subtle lesions and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yijian Gao , Dominic Marshall , Xiaodan Xing , Junzhi Ning , Giorgos Papanastasiou , Guang Yang , Matthieu Komorowski

Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jun Li , Tongkun Su , Baoliang Zhao , Faqin Lv , Qiong Wang , Nassir Navab , Ying Hu , Zhongliang Jiang

The impression section of a radiology report summarizes the most prominent observation from the findings section and is the most important section for radiologists to communicate to physicians. Summarizing findings is time-consuming and can…

Computation and Language · Computer Science 2022-06-09 Jinpeng Hu , Zhuo Li , Zhihong Chen , Zhen Li , Xiang Wan , Tsung-Hui Chang

Despite the progress of radiology report generation (RRG), existing works face two challenges: 1) The performances in clinical efficacy are unsatisfactory, especially for lesion attributes description; 2) the generated text lacks…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Haibo Jin , Haoxuan Che , Sunan He , Hao Chen

Medical report generation, which aims to automatically generate a long and coherent report of a given medical image, has been receiving growing research interests. Existing approaches mainly adopt a supervised manner and heavily rely on…

Machine Learning · Computer Science 2021-11-16 Fenglin Liu , Chenyu You , Xian Wu , Shen Ge , Sheng Wang , Xu Sun

Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images. However, the subtle visual nuances and domain-specific terminology…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Kai Shu , Yuzhuo Jia , Ziyang Zhang , Jiechao Gao

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li

Reliable end-to-end clinical report generation has been a longstanding goal of medical ML research. The end goal for this process is to alleviate radiologists' workloads and provide second opinions to clinicians or patients. Thus, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Frederic Jonske , Constantin Seibold , Osman Alperen Koras , Fin Bahnsen , Marie Bauer , Amin Dada , Hamza Kalisch , Anton Schily , Jens Kleesiek

Generating radiology reports automatically reduces the workload of radiologists and helps the diagnoses of specific diseases. Many existing methods take this task as modality transfer process. However, since the key information related to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yitian Tao , Liyan Ma , Jing Yu , Han Zhang

The task of medical image recognition is notably complicated by the presence of varied and multiple pathological indications, presenting a unique challenge in multi-label classification with unseen labels. This complexity underlines the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Yaoqin Ye , Junjie Zhang , Hongwei Shi

Automated radiology report generation has the potential to improve radiology reporting and alleviate the workload of radiologists. However, the medical report generation task poses unique challenges due to the limited availability of…

Computation and Language · Computer Science 2023-12-27 Ruoqing Zhao , Xi Wang , Hongliang Dai , Pan Gao , Piji Li

Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jianmo Ni , Chun-Nan Hsu , Amilcare Gentili , Julian McAuley

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

Language models for American Sign Language (ASL) could make language technologies substantially more accessible to those who sign. To train models on tasks such as isolated sign recognition (ISR) and ASL-to-English translation, datasets…

Computation and Language · Computer Science 2024-11-07 Lee Kezar , Nidhi Munikote , Zian Zeng , Zed Sehyr , Naomi Caselli , Jesse Thomason

Conventionally, the radiologist prepares the diagnosis notes and shares them with the transcriptionist. Then the transcriptionist prepares a preliminary formatted report referring to the notes, and finally, the radiologist reviews the…

Computation and Language · Computer Science 2022-06-15 Kaveri Kale , Pushpak Bhattacharyya , Aditya Shetty , Milind Gune , Kush Shrivastava , Rustom Lawyer , Spriha Biswas