English
Related papers

Related papers: Medical Report Generation: A Hierarchical Task Str…

200 papers

Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable…

Computation and Language · Computer Science 2021-08-30 Hoang T. N. Nguyen , Dong Nie , Taivanbat Badamdorj , Yujie Liu , Yingying Zhu , Jason Truong , Li Cheng

Improving the resolution of magnetic resonance (MR) image data is critical to computer-aided diagnosis and brain function analysis. Higher resolution helps to capture more detailed content, but typically induces to lower signal-to-noise…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Chaowei Fang , Dingwen Zhang , Liang Wang , Yulun Zhang , Lechao Cheng , Junwei Han

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Cardiac Magnetic Resonance (CMR) imaging is a vital non-invasive tool for diagnosing heart diseases and evaluating cardiac health. However, the limited availability of large-scale, high-quality CMR datasets poses a major challenge to the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Ziyu Li , Yujian Hu , Zhengyao Ding , Yiheng Mao , Haitao Li , Fan Yi , Hongkun Zhang , Zhengxing Huang

Radiology reporting generative AI holds significant potential to alleviate clinical workloads and streamline medical care. However, achieving high clinical accuracy is challenging, as radiological images often feature subtle lesions and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yijian Gao , Dominic Marshall , Xiaodan Xing , Junzhi Ning , Giorgos Papanastasiou , Guang Yang , Matthieu Komorowski

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

Multiagent Systems · Computer Science 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim

This study presents Medical Vision Generalist (MVG), the first foundation model capable of handling various medical imaging tasks -- such as cross-modal synthesis, image segmentation, denoising, and inpainting -- within a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Sucheng Ren , Xiaoke Huang , Xianhang Li , Junfei Xiao , Jieru Mei , Zeyu Wang , Alan Yuille , Yuyin Zhou

Multi-modal image segmentation faces real-world deployment challenges from incomplete/corrupted modalities degrading performance. While existing methods address training-inference modality gaps via specialized per-combination models, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Xiaoqi Zhao , Youwei Pang , Chenyang Yu , Lihe Zhang , Huchuan Lu , Shijian Lu , Georges El Fakhri , Xiaofeng Liu

Radiology report generation (RRG) has gained increasing research attention because of its huge potential to mitigate medical resource shortages and aid the process of disease decision making by radiologists. Recent advancements in RRG are…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jun Wang , Abhir Bhalerao , Terry Yin , Simon See , Yulan He

Federated learning enables multiple hospitals to cooperatively learn a shared model without privacy disclosure. Existing methods often take a common assumption that the data from different hospitals have the same modalities. However, such a…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yunlu Yan , Hong Wang , Yawen Huang , Nanjun He , Lei Zhu , Yuexiang Li , Yong Xu , Yefeng Zheng

Recent advances in text-conditioned image generation diffusion models have begun paving the way for new opportunities in modern medical domain, in particular, generating Chest X-rays (CXRs) from diagnostic reports. Nonetheless, to further…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Woojung Han , Chanyoung Kim , Dayun Ju , Yumin Shim , Seong Jae Hwang

Deep learning models for medical image segmentation suffer significant performance drops due to distribution shifts, but the causal mechanisms behind these drops remain poorly understood. We extend causal attribution frameworks to…

Image and Video Processing · Electrical Eng. & Systems 2025-12-11 Pedro M. Gordaliza , Nataliia Molchanova , Jaume Banus , Thomas Sanchez , Meritxell Bach Cuadra

The complexity of stacked imaging and the massive number of radiographs make writing radiology reports complex and inefficient. Even highly experienced radiologists struggle to maintain accuracy and consistency in interpreting radiographs…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jianfei Xu , Thanet Markchom , Huizhi Liang

This work tackles the problem of generating a medical report for multi-image panels. We apply our solution to the Renal Direct Immunofluorescence (RDIF) assay which requires a pathologist to generate a report based on observations across…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Sam Maksoud , Arnold Wiliem , Kun Zhao , Teng Zhang , Lin Wu , Brian C. Lovell

Diagnosing hepatic diseases accurately and interpretably is critical, yet it remains challenging in real-world clinical settings. Existing AI approaches for clinical diagnosis often lack transparency, structured reasoning, and…

Artificial Intelligence · Computer Science 2026-03-06 Zheng Li , Jiayi Xu , Zhikai Hu , Hechang Chen , Lele Cong , Yunyun Wang , Shuchao Pang

Chest X-ray (CXR) radiology report generation (RRG) models have shown rapid progress on automated metrics, yet their clinical utility remains uncertain due to limited qualitative evaluation by radiologists. We present CXRMate-2, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Aaron Nicolson , Elizabeth J. Cooper , Hwan-Jin Yoon , Claire McCafferty , Ramya Krishnan , Michelle Craigie , Nivene Saad , Jason Dowling , Ian A. Scott , Bevan Koopman

Self-supervised learning is crucial for clinical imaging applications, given the lack of explicit labels in healthcare. However, conventional approaches that rely on precise vision-language alignment are not always feasible in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jielin Qiu , Peide Huang , Makiya Nakashima , Jaehyun Lee , Jiacheng Zhu , Wilson Tang , Pohao Chen , Christopher Nguyen , Byung-Hak Kim , Debbie Kwon , Douglas Weber , Ding Zhao , David Chen

Radiology Report Generation (RRG) aims to produce accurate and coherent diagnostics from medical images. Although large vision language models (LVLM) improve report fluency and accuracy, they exhibit hallucinations, generating plausible yet…

Computation and Language · Computer Science 2026-02-05 Ruixiao Yang , Yuanhe Tian , Xu Yang , Huiqi Li , Yan Song

Labeling training datasets has become a key barrier to building medical machine learning models. One strategy is to generate training labels programmatically, for example by applying natural language processing pipelines to text reports…