中文
相关论文

相关论文: Image-aware Evaluation of Generated Medical Report…

200 篇论文

The core objective of image captioning is to achieve lossless semantic compression from visual signals into textual modalities. However, the reliance on manually curated reference texts for evaluation essentially forces models to mimic…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Ziyun Chen , Fan Liu , Liang Yao , Chuanyi Zhang , Yuye Ma , Wei Zhou

Effectively aligning with human judgment when evaluating machine-generated image captions represents a complex yet intriguing challenge. Existing evaluation metrics like CIDEr or CLIP-Score fall short in this regard as they do not take into…

计算机视觉与模式识别 · 计算机科学 2024-07-31 Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains: these models often lack prior knowledge, resulting in the generation of synthetic…

Automated generation of clinically accurate radiology reports can improve patient care. Previous report generation methods that rely on image captioning models often generate incoherent and incorrect text due to their lack of relevant…

Radiological services are experiencing unprecedented demand, leading to increased interest in automating radiology report generation. Existing Vision-Language Models (VLMs) suffer from hallucinations, lack interpretability, and require…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Ahmed Abdulaal , Hugo Fry , Nina Montaña-Brown , Ayodeji Ijishakin , Jack Gao , Stephanie Hyland , Daniel C. Alexander , Daniel C. Castro

X-ray image-based medical report generation (MRG) is a pivotal area in artificial intelligence which can significantly reduce diagnostic burdens and patient wait times. Despite significant progress, we believe that the task has reached a…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Xiao Wang , Fuling Wang , Yuehang Li , Qingchuan Ma , Shiao Wang , Bo Jiang , Chuanfu Li , Jin Tang

Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However,…

计算机视觉与模式识别 · 计算机科学 2020-10-07 Jianmo Ni , Chun-Nan Hsu , Amilcare Gentili , Julian McAuley

Radiology report generation (RRG) has shown great potential in assisting radiologists by automating the labor-intensive task of report writing. While recent advancements have improved the quality and coherence of generated reports, ensuring…

人工智能 · 计算机科学 2025-03-18 Chenyu Wang , Weichao Zhou , Shantanu Ghosh , Kayhan Batmanghelich , Wenchao Li

Automatic radiology report generation is critical in clinics which can relieve experienced radiologists from the heavy workload and remind inexperienced radiologists of misdiagnosis or missed diagnose. Existing approaches mainly formulate…

图像与视频处理 · 电气工程与系统科学 2022-11-08 Shuxin Yang , Xian Wu , Shen Ge , Shaohua Kevin Zhou , Li Xiao

Automating report generation for medical imaging promises to reduce workload and assist diagnosis in clinical practice. Recent work has shown that deep learning models can successfully caption natural images. However, learning from medical…

计算机视觉与模式识别 · 计算机科学 2021-07-16 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring , Ling Shao

Automatic medical report generation (MRG), which aims to produce detailed text reports from medical images, has emerged as a critical task in this domain. MRG systems can enhance radiological workflows by reducing the time and effort…

图像与视频处理 · 电气工程与系统科学 2024-10-14 Siyou Li , Beining Xu , Yihao Luo , Dong Nie , Le Zhang

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

计算机视觉与模式识别 · 计算机科学 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

Large vision-language models (LVMs) hold a great promise for automating medical report generation, potentially reducing the burden of manual reporting. State-of-the-art (SOTA) research fine-tunes general LVMs with medical data to align…

计算与语言 · 计算机科学 2025-04-07 Hao Wang , Shuchang Ye , Jinghao Lin , Usman Naseem , Jinman Kim

Medical Large language models achieve strong scores on standard benchmarks; however, the transfer of those results to safe and reliable performance in clinical workflows remains a challenge. This survey reframes evaluation through a…

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

计算与语言 · 计算机科学 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

Diagnosis based on medical images, such as X-ray images, often involves manual annotation of anatomical keypoints. However, this process involves significant human efforts and can thus be a bottleneck in the diagnostic process. To fully…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Jinhee Kim , Taesung Kim , Taewoo Kim , Jaegul Choo , Dong-Wook Kim , Byungduk Ahn , In-Seok Song , Yoon-Ji Kim

In the rapidly advancing field of conditional image generation research, challenges such as limited explainability lie in effectively evaluating the performance and capabilities of various models. This paper introduces VIEScore, a Visual…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Max Ku , Dongfu Jiang , Cong Wei , Xiang Yue , Wenhu Chen

Medical image reporting (MIR) aims to generate structured clinical descriptions from radiological images. Existing methods struggle with fine-grained feature extraction, multimodal alignment, and generalization across diverse imaging types,…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Amaan Izhar , Nurul Japar , Norisma Idris , Ting Dang

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

The world faces a shortage of radiologists, leading to longer treatment times and increased stress, negatively impacting patient safety and workforce morale. Integrating artificial intelligence to interpret radiographic images and generate…

图像与视频处理 · 电气工程与系统科学 2024-06-19 Marijn Borghouts