English
Related papers

Related papers: Image-aware Evaluation of Generated Medical Report…

200 papers

The core objective of image captioning is to achieve lossless semantic compression from visual signals into textual modalities. However, the reliance on manually curated reference texts for evaluation essentially forces models to mimic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Ziyun Chen , Fan Liu , Liang Yao , Chuanyi Zhang , Yuye Ma , Wei Zhou

Effectively aligning with human judgment when evaluating machine-generated image captions represents a complex yet intriguing challenge. Existing evaluation metrics like CIDEr or CLIP-Score fall short in this regard as they do not take into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains: these models often lack prior knowledge, resulting in the generation of synthetic…

Computation and Language · Computer Science 2023-06-06 Sanghwan Kim , Farhad Nooralahzadeh , Morteza Rohanian , Koji Fujimoto , Mizuho Nishio , Ryo Sakamoto , Fabio Rinaldi , Michael Krauthammer

Automated generation of clinically accurate radiology reports can improve patient care. Previous report generation methods that rely on image captioning models often generate incoherent and incorrect text due to their lack of relevant…

Radiological services are experiencing unprecedented demand, leading to increased interest in automating radiology report generation. Existing Vision-Language Models (VLMs) suffer from hallucinations, lack interpretability, and require…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Ahmed Abdulaal , Hugo Fry , Nina Montaña-Brown , Ayodeji Ijishakin , Jack Gao , Stephanie Hyland , Daniel C. Alexander , Daniel C. Castro

X-ray image-based medical report generation (MRG) is a pivotal area in artificial intelligence which can significantly reduce diagnostic burdens and patient wait times. Despite significant progress, we believe that the task has reached a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Xiao Wang , Fuling Wang , Yuehang Li , Qingchuan Ma , Shiao Wang , Bo Jiang , Chuanfu Li , Jin Tang

Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jianmo Ni , Chun-Nan Hsu , Amilcare Gentili , Julian McAuley

Radiology report generation (RRG) has shown great potential in assisting radiologists by automating the labor-intensive task of report writing. While recent advancements have improved the quality and coherence of generated reports, ensuring…

Artificial Intelligence · Computer Science 2025-03-18 Chenyu Wang , Weichao Zhou , Shantanu Ghosh , Kayhan Batmanghelich , Wenchao Li

Automatic radiology report generation is critical in clinics which can relieve experienced radiologists from the heavy workload and remind inexperienced radiologists of misdiagnosis or missed diagnose. Existing approaches mainly formulate…

Image and Video Processing · Electrical Eng. & Systems 2022-11-08 Shuxin Yang , Xian Wu , Shen Ge , Shaohua Kevin Zhou , Li Xiao

Automating report generation for medical imaging promises to reduce workload and assist diagnosis in clinical practice. Recent work has shown that deep learning models can successfully caption natural images. However, learning from medical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring , Ling Shao

Automatic medical report generation (MRG), which aims to produce detailed text reports from medical images, has emerged as a critical task in this domain. MRG systems can enhance radiological workflows by reducing the time and effort…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Siyou Li , Beining Xu , Yihao Luo , Dong Nie , Le Zhang

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

Large vision-language models (LVMs) hold a great promise for automating medical report generation, potentially reducing the burden of manual reporting. State-of-the-art (SOTA) research fine-tunes general LVMs with medical data to align…

Computation and Language · Computer Science 2025-04-07 Hao Wang , Shuchang Ye , Jinghao Lin , Usman Naseem , Jinman Kim

Medical Large language models achieve strong scores on standard benchmarks; however, the transfer of those results to safe and reliable performance in clinical workflows remains a challenge. This survey reframes evaluation through a…

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

Computation and Language · Computer Science 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

Diagnosis based on medical images, such as X-ray images, often involves manual annotation of anatomical keypoints. However, this process involves significant human efforts and can thus be a bottleneck in the diagnostic process. To fully…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinhee Kim , Taesung Kim , Taewoo Kim , Jaegul Choo , Dong-Wook Kim , Byungduk Ahn , In-Seok Song , Yoon-Ji Kim

In the rapidly advancing field of conditional image generation research, challenges such as limited explainability lie in effectively evaluating the performance and capabilities of various models. This paper introduces VIEScore, a Visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Max Ku , Dongfu Jiang , Cong Wei , Xiang Yue , Wenhu Chen

Medical image reporting (MIR) aims to generate structured clinical descriptions from radiological images. Existing methods struggle with fine-grained feature extraction, multimodal alignment, and generalization across diverse imaging types,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Amaan Izhar , Nurul Japar , Norisma Idris , Ting Dang

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

The world faces a shortage of radiologists, leading to longer treatment times and increased stress, negatively impacting patient safety and workforce morale. Integrating artificial intelligence to interpret radiographic images and generate…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Marijn Borghouts