English
Related papers

Related papers: Improving Chest X-Ray Report Generation by Leverag…

200 papers

The gold standard for COVID-19 is RT-PCR, testing facilities for which are limited and not always optimally distributed. Test results are delayed, which impacts treatment. Expert radiologists, one of whom is a co-author, are able to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Kartikeya Badola , Sameer Ambekar , Himanshu Pant , Sumit Soman , Anuradha Sural , Rajiv Narang , Suresh Chandra , Jayadeva

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a challenge due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Saurav Sengupta , Donald E. Brown

Developing a robust algorithm to diagnose and quantify the severity of COVID-19 using Chest X-ray (CXR) requires a large number of well-curated COVID-19 datasets, which is difficult to collect under the global COVID-19 pandemic. On the…

Image and Video Processing · Electrical Eng. & Systems 2021-04-16 Sangjoon Park , Gwanghyun Kim , Yujin Oh , Joon Beom Seo , Sang Min Lee , Jin Hwan Kim , Sungjun Moon , Jae-Kwang Lim , Jong Chul Ye

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

GenerateCT, the first approach to generating 3D medical imaging conditioned on free-form medical text prompts, incorporates a text encoder and three key components: a novel causal vision transformer for encoding 3D CT volumes, a text-image…

Despite the reduction in turn-around times in radiology reports with the use of speech recognition software, persistent communication errors can significantly impact the interpretation of the radiology report. Pre-filling a radiology report…

Computation and Language · Computer Science 2023-10-11 Qingqing Zhu , Tejas Sudharshan Mathai , Pritam Mukherjee , Yifan Peng , Ronald M. Summers , Zhiyong Lu

In order to bridge the gap between Deep Learning researchers and medical professionals we develop a very accessible free prototype system which can be used by medical professionals to understand the reality of Deep Learning tools for chest…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Joseph Paul Cohen , Paul Bertin , Vincent Frappier

Lung infections, particularly pneumonia, pose serious health risks that can escalate rapidly, especially during pandemics. Accurate AI-based severity prediction from medical imaging is essential to support timely clinical decisions and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Bouthaina Slika , Fadi Dornaika , Fares Bougourzi , Karim Hammoudi

Existing deep learning methods for radiology report generation enhance diagnostic efficiency but often overlook physician-informed medical priors. This leads to a suboptimal alignment between the structured explanations and disease…

Tissues and Organs · Quantitative Biology 2026-04-13 Aishik Konwer , Moinak Bhattacharya , Prateek Prasanna

A chest radiograph, commonly called chest x-ray (CxR), plays a vital role in the diagnosis of various lung diseases, such as lung cancer, tuberculosis, pneumonia, and many more. Automated segmentation of the lungs is an important step to…

Image and Video Processing · Electrical Eng. & Systems 2020-11-20 Anushikha Singh , Brejesh Lall , B. K. Panigrahi , Anjali Agrawal , Anurag Agrawal , DJ Christopher , Balamugesh Thangakunam

We propose a data collecting and annotation pipeline that extracts information from Vietnamese radiology reports to provide accurate labels for chest X-ray (CXR) images. This can benefit Vietnamese radiologists and clinicians by annotating…

Image and Video Processing · Electrical Eng. & Systems 2023-01-11 Thao T. B. Nguyen , Tam M. Vo , Thang V. Nguyen , Hieu H. Pham , Ha Q. Nguyen

Automated structured radiology report generation (SRRG) from chest X-ray images offers significant potential to reduce workload of radiologists by generating reports in structured formats that ensure clarity, consistency, and adherence to…

Machine Learning · Computer Science 2025-10-02 Seongjae Kang , Dong Bok Lee , Juho Jung , Dongseop Kim , Won Hwa Kim , Sunghoon Joo

The chest X-ray (CXR) is by far the most commonly performed radiological examination for screening and diagnosis of many cardiac and pulmonary diseases. There is an immense world-wide shortage of physicians capable of providing rapid and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jonathan Laserson , Christine Dan Lantsman , Michal Cohen-Sfady , Itamar Tamir , Eli Goz , Chen Brestel , Shir Bar , Maya Atar , Eldad Elnekave

Most of the existing chest X-ray datasets include labels from a list of findings without specifying their locations on the radiographs. This limits the development of machine learning algorithms for the detection and localization of chest…

IMACT-CXR is an interactive multi-agent conversational tutor that helps trainees interpret chest X-rays by unifying spatial annotation, gaze analysis, knowledge retrieval, and image-grounded reasoning in a single AutoGen-based workflow. The…

Artificial Intelligence · Computer Science 2026-04-17 Tuan-Anh Le , Anh Mai Vu , David Yang , Akash Awasthi , Hien Van Nguyen

Lung cancer is the leading cause of cancer death and early diagnosis is associated with a positive prognosis. Chest X-ray (CXR) provides an inexpensive imaging mode for lung cancer diagnosis. Suspicious nodules are difficult to distinguish…

Image and Video Processing · Electrical Eng. & Systems 2023-07-14 Michael James Horry , Subrata Chakraborty , Biswajeet Pradhan , Manoranjan Paul , Jing Zhu , Prabal Datta Barua , U. Rajendra Acharya , Fang Chen , Jianlong Zhou

GPT-4V's purported strong multimodal abilities raise interests in using it to automate radiology report writing, but there lacks thorough evaluations. In this work, we perform a systematic evaluation of GPT-4V in generating radiology…

Computers and Society · Computer Science 2024-11-18 Yuyang Jiang , Chacha Chen , Dang Nguyen , Benjamin M. Mervak , Chenhao Tan

One of the critical tools for early detection and subsequent evaluation of the incidence of lung diseases is chest radiography. This study presents a real-world implementation of a convolutional neural network (CNN) based Carebot Covid app…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Daniel Kvak , Marian Bendik , Anna Chromcova

The development of AI-based methods to analyze radiology reports could lead to significant advances in medical diagnosis, from improving diagnostic accuracy to enhancing efficiency and reducing workload. However, the lack of…

Computation and Language · Computer Science 2025-08-14 Yuyan Ge , Kwan Ho Ryan Chan , Pablo Messina , René Vidal

The automatic generation of radiology reports has emerged as a promising solution to reduce a time-consuming task and accurately capture critical disease-relevant findings in X-ray images. Previous approaches for radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Sang-Jun Park , Keun-Soo Heo , Dong-Hee Shin , Young-Han Son , Ji-Hye Oh , Tae-Eui Kam