English
Related papers

Related papers: Can Prompt Learning Benefit Radiology Report Gener…

200 papers

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

We are witnessing a novel era of creativity where anyone can create digital content via prompt-based learning (known as prompt engineering). This paper investigates prompt engineering as a novel creative skill for creating AI art with…

Human-Computer Interaction · Computer Science 2024-07-08 Jonas Oppenlaender , Rhema Linder , Johanna Silvennoinen

Pretrained language models (PLMs) have made remarkable progress in text generation tasks via fine-tuning. While, it is challenging to fine-tune PLMs in a data-scarce situation. Therefore, it is non-trivial to develop a general and…

Computation and Language · Computer Science 2022-05-17 Junyi Li , Tianyi Tang , Jian-Yun Nie , Ji-Rong Wen , Wayne Xin Zhao

The objective of Radiology Report Generation (RRG) is to automatically generate coherent textual analyses of diseases based on radiological images, thereby alleviating the workload of radiologists. Current AI-based methods for RRG primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Tiancheng Gu , Kaicheng Yang , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai

Exploiting the power of pre-trained models, prompt-based approaches stand out compared to other continual learning solutions in effectively preventing catastrophic forgetting, even with very few learnable parameters and without the need for…

Machine Learning · Computer Science 2025-01-07 Minh Le , An Nguyen , Huy Nguyen , Trang Nguyen , Trang Pham , Linh Van Ngo , Nhat Ho

Medical imaging is crucial for diagnosing, monitoring, and treating medical conditions. The medical reports of radiology images are the primary medium through which medical professionals attest their findings, but their writing is time…

Computation and Language · Computer Science 2025-01-07 Iustin Sîrbu , Iulia-Renata Sîrbu , Jasmina Bogojeska , Traian Rebedea

The impression section of a radiology report summarizes important radiology findings and plays a critical role in communicating these findings to physicians. However, the preparation of these summaries is time-consuming and error-prone for…

Automated structured radiology report generation (SRRG) from chest X-ray images offers significant potential to reduce workload of radiologists by generating reports in structured formats that ensure clarity, consistency, and adherence to…

Machine Learning · Computer Science 2025-10-02 Seongjae Kang , Dong Bok Lee , Juho Jung , Dongseop Kim , Won Hwa Kim , Sunghoon Joo

Automatic generation of radiology reports holds crucial clinical value, as it can alleviate substantial workload on radiologists and remind less experienced ones of potential anomalies. Despite the remarkable performance of various image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qingqiu Li , Jilan Xu , Runtian Yuan , Mohan Chen , Yuejie Zhang , Rui Feng , Xiaobo Zhang , Shang Gao

Recently emerged prompt-based Recommendation Language Models (RLM) can solve multiple recommendation tasks uniformly. The RLMs make full use of the inherited knowledge learned from the abundant pre-training data to solve the downstream…

Information Retrieval · Computer Science 2024-02-02 Zelong Li , Jianchao Ji , Yingqiang Ge , Wenyue Hua , Yongfeng Zhang

Brain CT report generation is significant to aid physicians in diagnosing cranial diseases. Recent studies concentrate on handling the consistency between visual and textual pathological features to improve the coherence of report. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Chengxin Zheng , Junzhong Ji , Yanzhao Shi , Xiaodan Zhang , Liangqiong Qu

Radiology Report Generation (RRG) has advanced considerably with the development of multimodal generative models. Despite the progress, the field still faces significant challenges in evaluation, as existing metrics lack robustness and…

Computation and Language · Computer Science 2025-05-20 Kun Zhao , Chenghao Xiao , Sixing Yan , Haoteng Tang , William K. Cheung , Noura Al Moubayed , Liang Zhan , Chenghua Lin

Medical vision-language models (Med-VLMs) trained on large datasets of medical image-text pairs and later fine-tuned for specific tasks have emerged as a mainstream paradigm in medical image analysis. However, recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Noor Hussein , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

Providing user-understandable explanations to justify recommendations could help users better understand the recommended items, increase the system's ease of use, and gain users' trust. A typical approach to realize it is natural language…

Information Retrieval · Computer Science 2023-01-16 Lei Li , Yongfeng Zhang , Li Chen

Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder-decoder…

Computation and Language · Computer Science 2021-09-28 An Yan , Zexue He , Xing Lu , Jiang Du , Eric Chang , Amilcare Gentili , Julian McAuley , Chun-Nan Hsu

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Automatic chest X-ray report generation is an important area of research aimed at improving diagnostic accuracy and helping doctors make faster decisions. Current AI models are good at finding correlations (or patterns) in medical images.…

Machine Learning · Computer Science 2025-12-16 Satyam Kumar

Large language models (LLMs) have demonstrated impressive success in a wide range of natural language processing (NLP) tasks due to their extensive general knowledge of the world. Recent works discovered that the performance of LLMs is…

Computation and Language · Computer Science 2024-11-25 Yuze Liu , Tingjie Liu , Tiehua Zhang , Youhua Xia , Jinze Wang , Zhishu Shen , Jiong Jin , Fei Richard Yu

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

Computation and Language · Computer Science 2025-05-26 Abdullah Abdullah , Seong Tae Kim

Radiology report generation (RRG) has gained increasing research attention because of its huge potential to mitigate medical resource shortages and aid the process of disease decision making by radiologists. Recent advancements in RRG are…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jun Wang , Abhir Bhalerao , Terry Yin , Simon See , Yulan He