English
Related papers

Related papers: Designing a Robust Radiology Report Generation Sys…

200 papers

The automation of the medical evidence acquisition and diagnosis process has recently attracted increasing attention in order to reduce the workload of doctors and democratize access to medical care. However, most works proposed in the…

Computation and Language · Computer Science 2022-10-14 Arsene Fansi Tchango , Rishab Goel , Julien Martel , Zhi Wen , Gaetan Marceau Caron , Joumana Ghosn

Recently, vision-language representation learning has made remarkable advancements in building up medical foundation models, holding immense potential for transforming the landscape of clinical research and medical care. The underlying…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weijian Huang , Cheng Li , Hao Yang , Jiarun Liu , Yong Liang , Hairong Zheng , Shanshan Wang

Medical report generation from imaging data remains a challenging task in clinical practice. While large language models (LLMs) show great promise in addressing this challenge, their effective integration with medical imaging data still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Chunlei Li , Jingyang Hou , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

The reliability of Deep Learning systems depends on their accuracy but also on their robustness against adversarial perturbations to the input data. Several attacks and defenses have been proposed to improve the performance of Deep Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Laura Daza , Juan C. Pérez , Pablo Arbeláez

Medical errors are a major public health concern and a leading cause of death worldwide. Many healthcare centers and hospitals use reporting systems where medical practitioners write a preliminary medical report and the report is later…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Arman Cohan , Nazli Goharian , Ross Filice

The combination of tomographic imaging and deep learning, or machine learning in general, promises to empower not only image analysis but also image reconstruction. The latter aspect is considered in this perspective article with an…

Quantitative Methods · Quantitative Biology 2016-11-07 Ge Wang

Automated radiology report generation holds immense potential to alleviate the heavy workload of radiologists. Despite the formidable vision-language capabilities of recent Multimodal Large Language Models (MLLMs), their clinical deployment…

Artificial Intelligence · Computer Science 2026-03-17 Tuoshi Qi , Shenshen Bu , Yingfei Xiang , Zhiming Dai

In clinical diagnosis, diagnostic images that are obtained from the scanning devices serve as preliminary evidence for further investigation in the process of delivering quality healthcare. However, often the medical image may contain fault…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Karthik K , Sowmya Kamath S

Chest X-ray is one of the most popular medical imaging modalities due to its accessibility and effectiveness. However, there is a chronic shortage of well-trained radiologists who can interpret these images and diagnose the patient's…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Otabek Nazarov , Mohammad Yaqub , Karthik Nandakumar

Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the results is a sensitive…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Bernhard Stimpel , Christopher Syben , Franziska Schirrmacher , Philipp Hoelter , Arnd Dörfler , Andreas Maier

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

Computation and Language · Computer Science 2025-05-26 Abdullah Abdullah , Seong Tae Kim

Radiology reports for the same patient examination may contain clinically meaningful discrepancies arising from interpretation differences, reporting variability, or evolving assessments. Systematic analysis of such discrepancies is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhaoyi Sun , Minal Jagtiani , Wen-wai Yim , Fei Xia , Martin Gunn , Meliha Yetisgen , Asma Ben Abacha

In this work, we propose an AI-based method that intends to improve the conventional retinal disease treatment procedure and help ophthalmologists increase diagnosis efficiency and accuracy. The proposed method is composed of a deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Jia-Hong Huang , Chao-Han Huck Yang , Fangyu Liu , Meng Tian , Yi-Chieh Liu , Ting-Wei Wu , I-Hung Lin , Kang Wang , Hiromasa Morikawa , Hernghua Chang , Jesper Tegner , Marcel Worring

We introduce a radiology-focused visual language model designed to generate radiology reports from chest X-rays. Building on previous findings that large language models (LLMs) can acquire multimodal capabilities when aligned with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xi Zhang , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

Deep learning based image segmentation methods have achieved great success, even having human-level accuracy in some applications. However, due to the black box nature of deep learning, the best method may fail in some situations. Thus…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Leixin Zhou , Wenxiang Deng , Xiaodong Wu

Endoscopic procedures such as esophagogastroduodenoscopy (EGD) and colonoscopy play a critical role in diagnosing and managing gastrointestinal (GI) disorders. However, the documentation burden associated with these procedures place…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Evandros Kaklamanos , Kristjana Kristinsdottir , Jonathan Huang , Dustin Carlson , Rajesh Keswani , John Pandolfino , Mozziyar Etemadi

Neural rendering is a new image and video generation method based on deep learning. It combines the deep learning model with the physical knowledge of computer graphics, to obtain a controllable and realistic scene model, and realize the…

Graphics · Computer Science 2024-02-02 Xinkai Yan , Jieting Xu , Yuchi Huo , Hujun Bao

Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic images from hand-crafted scene representations. However, the…

Natural language processing (NLP) shows promise as a means to automate the labelling of hospital-scale neuroradiology magnetic resonance imaging (MRI) datasets for computer vision applications. To date, however, there has been no thorough…

Automated radiology report generation has gained increasing attention with the rise of deep learning and large language models. However, fully generative approaches often suffer from hallucinations and lack clinical grounding, limiting…

Quantitative Methods · Quantitative Biology 2026-05-01 Himadri S Samanta