English
Related papers

Related papers: KiUT: Knowledge-injected U-Transformer for Radiolo…

200 papers

Automated radiology report generation (RRG) aims to produce detailed textual reports from clinical imaging, such as computed tomography (CT) scans, to improve the accuracy and efficiency of diagnosis and provision of management advice. RRG…

Machine Learning · Computer Science 2025-07-03 Siyou Li , Pengyao Qin , Huanan Wu , Dong Nie , Arun J. Thirunavukarasu , Juntao Yu , Le Zhang

Beyond their primary diagnostic purpose, radiology reports have been an invaluable source of information in medical research. Given a corpus of radiology reports, researchers are often interested in identifying a subset of reports…

Computation and Language · Computer Science 2021-12-21 Tamara Katic , Martin Pavlovski , Danijela Sekulic , Slobodan Vucetic

This paper introduces an innovative approach to Medical Vision-Language Pre-training (Med-VLP) area in the specialized context of radiograph representation learning. While conventional methods frequently merge textual annotations into…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Hanqi Jiang , Xixuan Hao , Yuzhou Huang , Chong Ma , Jiaxun Zhang , Yi Pan , Ruimao Zhang

The multivariate, asynchronous nature of real-world clinical data, such as that generated in Intensive Care Units (ICUs), challenges traditional AI-based decision-support systems. These often assume data regularity and feature independence…

Machine Learning · Computer Science 2025-02-28 Ricardo Santos , André V. Carreiro , Xi Peng , Hugo Gamboa , Holger Fröhlich

For robot-assisted surgery, an accurate surgical report reflects clinical operations during surgery and helps document entry tasks, post-operative analysis and follow-up treatment. It is a challenging task due to many complex and diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Hongqiu Wang , Yueming Jin , Lei Zhu

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Recent advancements in artificial intelligence (AI) have precipitated significant breakthroughs in healthcare, particularly in refining diagnostic procedures. However, previous studies have often been constrained to limited functionalities.…

Artificial Intelligence · Computer Science 2024-07-08 Asma Alkhaldi , Raneem Alnajim , Layan Alabdullatef , Rawan Alyahya , Jun Chen , Deyao Zhu , Ahmed Alsinan , Mohamed Elhoseiny

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

The impression is crucial for the referring physicians to grasp key information since it is concluded from the findings and reasoning of radiologists. To alleviate the workload of radiologists and reduce repetitive human labor in impression…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jinpeng Hu , Zhihong Chen , Yang Liu , Xiang Wan , Tsung-Hui Chang

In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Constantin Seibold , Simon Reiß , Saquib Sarfraz , Matthias A. Fink , Victoria Mayer , Jan Sellner , Moon Sung Kim , Klaus H. Maier-Hein , Jens Kleesiek , Rainer Stiefelhagen

Automated Radiology report generation (RRG) aims at producing detailed descriptions of medical images, reducing radiologists' workload and improving access to high-quality diagnostic services. Existing encoder-decoder models only rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Quang Vinh Nguyen , Minh Duc Nguyen , Thanh Hoang Son Vo , Hyung-Jeong Yang , Soo-Hyung Kim

In the field of clinical medicine, computed tomography (CT) is an effective medical imaging modality for the diagnosis of various pathologies. Compared with X-ray images, CT images can provide more information, including multi-planar slices…

Image and Video Processing · Electrical Eng. & Systems 2024-03-08 Jing Hu , Qinrui Fan , Shu Hu , Siwei Lyu , Xi Wu , Xin Wang

Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper…

Artificial Intelligence · Computer Science 2026-03-03 Peiyuan Jing , Kinhei Lee , Zhenxuan Zhang , Huichi Zhou , Zhengqing Yuan , Zhifan Gao , Lei Zhu , Giorgos Papanastasiou , Yingying Fang , Guang Yang

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

Large language models have made significant strides in natural language processing, enabling innovative applications in molecular science by processing textual representations of molecules. However, most existing language models cannot…

Machine Learning · Computer Science 2024-02-07 Pengfei Liu , Yiming Ren , Jun Tao , Zhixiang Ren

Writing radiology reports from medical images requires a high level of domain expertise. It is time-consuming even for trained radiologists and can be error-prone for inexperienced radiologists. It would be appealing to automate this task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yuzhe Lu , Sungmin Hong , Yash Shah , Panpan Xu

Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Chong Ma , Lin Zhao , Yuzhong Chen , Lu Zhang , Zhenxiang Xiao , Haixing Dai , David Liu , Zihao Wu , Zhengliang Liu , Sheng Wang , Jiaxing Gao , Changhe Li , Xi Jiang , Tuo Zhang , Qian Wang , Dinggang Shen , Dajiang Zhu , Tianming Liu

Generating accurate and clinically meaningful radiology reports from chest X-ray images remains a significant challenge in medical AI. While recent vision-language models achieve strong results in general radiology report generation, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Nikolay Nechaev , Evgeniia Przhezdzetskaia , Dmitry Umerenkov , Dmitry V. Dylov

Despite tremendous progress in computer vision, there has not been an attempt for machine learning on very large-scale medical image databases. We present an interleaved text/image deep learning system to extract and mine the semantic…

Computer Vision and Pattern Recognition · Computer Science 2015-05-05 Hoo-Chang Shin , Le Lu , Lauren Kim , Ari Seff , Jianhua Yao , Ronald M. Summers

Obtaining automated preliminary read reports for common exams such as chest X-rays will expedite clinical workflows and improve operational efficiencies in hospitals. However, the quality of reports generated by current automated approaches…