English
Related papers

Related papers: AutoRG-Brain: Grounded Report Generation for Brain…

200 papers

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

In clinical practice, radiology reporting is an essential yet complex, time-intensive, and error-prone task, particularly for 3D medical images. Existing automated approaches based on medical vision-language models primarily focus on…

Artificial Intelligence · Computer Science 2026-03-02 Yongrui Yu , Zhongzhen Huang , Linjie Mu , Shaoting Zhang , Xiaofan Zhang

Multimodal foundation models hold significant potential for automating radiology report generation, thereby assisting clinicians in diagnosing cardiac diseases. However, generated reports often suffer from serious factual inaccuracy. In…

Computation and Language · Computer Science 2025-02-07 Liwen Sun , James Zhao , Megan Han , Chenyan Xiong

The complexity of stacked imaging and the massive number of radiographs make writing radiology reports complex and inefficient. Even highly experienced radiologists struggle to maintain accuracy and consistency in interpreting radiographs…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jianfei Xu , Thanet Markchom , Huizhi Liang

Large Language Models (LLMs) have enabled new ways to satisfy information needs. Although great strides have been made in applying them to settings like document ranking and short-form text generation, they still struggle to compose…

Objective. Standard Magnetic Resonance Imaging (MRI) reconstruction pipelines discard phase information captured during acquisition, despite evidence that it encodes tissue properties relevant to tumor diagnosis. Current machine learning…

Image and Video Processing · Electrical Eng. & Systems 2026-04-17 Marco Schlimbach , Moritz Rempe , Jessica Mnischek , Lukas T. Rotkopf , Jens Weingarten , Jens Kleesiek , Kevin Kröninger

Vision-language models (VLMs) have shown potential for automated radiology report generation, yet existing approaches rely on global embedding compression of volumetric data, often leading to hallucinated findings and limited anatomical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Giuseppe A. Orlando , Paolo Papotti , Maria A. Zuluaga , Olivier Humbert , Marco Lorenzi

Registration is a fundamental task in medical image analysis which can be applied to several tasks including image segmentation, intra-operative tracking, multi-modal image alignment, and motion analysis. Popular registration tools such as…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Wentao Zhu , Andriy Myronenko , Ziyue Xu , Wenqi Li , Holger Roth , Yufang Huang , Fausto Milletari , Daguang Xu

Brain graphs (i.e, connectomes) constructed from medical scans such as magnetic resonance imaging (MRI) have become increasingly important tools to characterize the abnormal changes in the human brain. Due to the high acquisition cost and…

Machine Learning · Computer Science 2021-05-07 Alaa Bessadok , Mohamed Ali Mahjoub , Islem Rekik

Organ at risk (OAR) segmentation is a critical process in radiotherapy treatment planning such as head and neck tumors. Nevertheless, in clinical practice, radiation oncologists predominantly perform OAR segmentations manually on CT scans.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Zeyu Zhang , Xuyin Qi , Bowen Zhang , Biao Wu , Hien Le , Bora Jeong , Zhibin Liao , Yunxiang Liu , Johan Verjans , Minh-Son To , Richard Hartley

United States healthcare systems are struggling to meet the growing demand for neurological care, particularly in Alzheimer's disease and related dementias (ADRD). Generative AI built on language models (LLMs) now enables agentic AI systems…

Agentic Retrieval-Augmented Generation (Agentic RAG) has become a widely adopted paradigm for multi-hop question answering and complex knowledge reasoning, where retrieval and reasoning are interleaved at inference time. As reasoning…

Information Retrieval · Computer Science 2026-04-02 Shuguang Jiao , Chengkai Huang , Shuhan Qi , Xuan Wang , Yifan Li , Lina Yao

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

Labelling large datasets for training high-capacity neural networks is a major obstacle to the development of deep learning-based medical imaging applications. Here we present a transformer-based network for magnetic resonance imaging (MRI)…

Radiology report generation aims to produce computer-aided diagnoses to alleviate the workload of radiologists and has drawn increasing attention recently. However, previous deep learning methods tend to neglect the mutual influences…

Computation and Language · Computer Science 2022-01-12 Song Wang , Liyan Tang , Mingquan Lin , George Shih , Ying Ding , Yifan Peng

In recent years, automated radiology report generation has experienced significant growth. This paper introduces MRScore, an automatic evaluation metric tailored for radiology report generation by leveraging Large Language Models (LLMs).…

Computation and Language · Computer Science 2024-04-30 Yunyi Liu , Zhanyu Wang , Yingshu Li , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Li Zhang , Basu Jindal , Ahmed Alaa , Robert Weinreb , David Wilson , Eran Segal , James Zou , Pengtao Xie

Understanding the hidden mechanisms behind human's visual perception is a fundamental question in neuroscience. To that end, investigating into the neural responses of human mind activities, such as functional Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuankun Yang , Li Zhang , Ziyang Xie , Zhiyuan Yuan , Jianfeng Feng , Xiatian Zhu , Yu-Gang Jiang

We present brat (brain report alignment transformer), a multi-view representation learning framework for brain magnetic resonance imaging (MRI) trained on MRIs paired with clinical reports. Brain MRIs present unique challenges due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Maxime Kayser , Maksim Gridnev , Wanting Wang , Max Bain , Aneesh Rangnekar , Avijit Chatterjee , Aleksandr Petrov , Harini Veeraraghavan , Nathaniel C. Swinburne

Prediction the conversion to early-stage dementia is critical for mitigating its progression but remains challenging due to subtle cognitive impairments and structural brain changes. Traditional T1-weighted magnetic resonance imaging…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yilin Leng , Wenju Cui , Bai Chen , Xi Jiang , Shuangqing Chen , Jian Zheng