English
Related papers

Related papers: Interactive and Explainable Region-guided Radiolog…

200 papers

In response to the worldwide COVID-19 pandemic, advanced automated technologies have emerged as valuable tools to aid healthcare professionals in managing an increased workload by improving radiology report generation and prognostic…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Zhusi Zhong , Jie Li , John Sollee , Scott Collins , Harrison Bai , Paul Zhang , Terrence Healey , Michael Atalay , Xinbo Gao , Zhicheng Jiao

Beyond the common difficulties faced in the natural image captioning, medical report generation specifically requires the model to describe a medical image with a fine-grained and semantic-coherence paragraph that should satisfy both…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Mingjie Li , Fuyu Wang , Xiaojun Chang , Xiaodan Liang

Generative models have revolutionized Artificial Intelligence (AI), particularly in multimodal applications. However, adapting these models to the medical domain poses unique challenges due to the complexity of medical data and the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Daniele Molino , Francesco di Feola , Linlin Shen , Paolo Soda , Valerio Guarrasi

Automated radiology report generation (RRG) holds potential to reduce the workload of radiologists, and recent advances in multimodal large language models (MLLMs) have enabled multimodal chest X-ray (CXR) report generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi

A radiology report comprises presentation-style vocabulary, which ensures clarity and organization, and factual vocabulary, which provides accurate and objective descriptions based on observable findings. While manually writing these…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Kang Liu , Zhuoqi Ma , Mengmeng Liu , Zhicheng Jiao , Xiaolu Kang , Qiguang Miao , Kun Xie

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art methods has been a challenge due to the high…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Saurav Sengupta , Donald E. Brown

Chest X-Ray (CXR) images are commonly used for clinical screening and diagnosis. Automatically writing reports for these images can considerably lighten the workload of radiologists for summarizing descriptive findings and conclusive…

Computation and Language · Computer Science 2020-07-24 Baoyu Jing , Zeya Wang , Eric Xing

Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yingshu Li , Zhanyu Wang , Yunyi Liu , Lei Wang , Lingqiao Liu , Luping Zhou

Automatic medical report generation has the potential to support clinical diagnosis, reduce the workload of radiologists, and demonstrate potential for enhancing diagnostic consistency. However, current evaluation metrics often fail to…

Computation and Language · Computer Science 2025-08-06 Zhenxuan Zhang , Kinhei Lee , Peiyuan Jing , Weihang Deng , Huichi Zhou , Zihao Jin , Jiahao Huang , Zhifan Gao , Dominic C Marshall , Yingying Fang , Guang Yang

Counterfactual medical image generation have emerged as a critical tool for enhancing AI-driven systems in medical domain by answering "what-if" questions. However, existing approaches face two fundamental limitations: First, they fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hyungi Min , Taeseung You , Hangyeul Lee , Yeongjae Cho , Sungzoon Cho

The escalating demand for medical image interpretation underscores the critical need for advanced artificial intelligence solutions to enhance the efficiency and accuracy of radiological diagnoses. This paper introduces CXR-PathFinder, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Pimchanok Sukjai , Apiradee Boonmee

Radiology report generation (RRG) has gained increasing research attention because of its huge potential to mitigate medical resource shortages and aid the process of disease decision making by radiologists. Recent advancements in RRG are…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jun Wang , Abhir Bhalerao , Terry Yin , Simon See , Yulan He

Regional prompting, or compositional generation, which enables fine-grained spatial control, has gained increasing attention for its practicality in real-world applications. However, previous methods either introduce additional trainable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Zhennan Chen , Yajie Li , Haofan Wang , Zhibo Chen , Zhengkai Jiang , Jun Li , Qian Wang , Jian Yang , Ying Tai

Communication of follow-up recommendations when abnormalities are identified on imaging studies is prone to error. In this paper, we present a natural language processing approach based on deep learning to automatically identify clinically…

Computation and Language · Computer Science 2019-05-16 Wilson Lau , Thomas H Payne , Ozlem Uzuner , Meliha Yetisgen

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

Mammography report generation is a critical yet underexplored task in medical AI, characterized by challenges such as multiview image reasoning, high-resolution visual cues, and unstructured radiologic language. In this work, we introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Nak-Jun Sung , Donghyun Lee , Bo Hwa Choi , Chae Jung Park

Endoscopic procedures such as esophagogastroduodenoscopy (EGD) and colonoscopy play a critical role in diagnosing and managing gastrointestinal (GI) disorders. However, the documentation burden associated with these procedures place…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Evandros Kaklamanos , Kristjana Kristinsdottir , Jonathan Huang , Dustin Carlson , Rajesh Keswani , John Pandolfino , Mozziyar Etemadi

Chest X-ray is one of the most popular medical imaging modalities due to its accessibility and effectiveness. However, there is a chronic shortage of well-trained radiologists who can interpret these images and diagnose the patient's…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Otabek Nazarov , Mohammad Yaqub , Karthik Nandakumar

Computer-aided diagnosis systems hold great promise to aid radiologists and clinicians in radiological clinical practice and enhance diagnostic accuracy and efficiency. However, the conventional systems primarily focus on delivering…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Sheng Wang , Tianming Du , Katherine Fischer , Gregory E Tasian , Justin Ziemba , Joanie M Garratt , Hersh Sagreiya , Yong Fan

Generative modeling of anatomical structures plays a crucial role in virtual imaging trials, which allow researchers to perform studies without the costs and constraints inherent to in vivo and phantom studies. For clinical relevance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Bram de Wilde , Max T. Rietberg , Guillaume Lajoinie , Jelmer M. Wolterink