English
Related papers

Related papers: Lesion Guided Explainable Few Weak-shot Medical Re…

200 papers

Medical image interpretation is central to most clinical applications such as disease diagnosis, treatment planning, and prognostication. In clinical practice, radiologists examine medical images and manually compile their findings into…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nurbanu Aksoy , Nishant Ravikumar , Alejandro F Frangi

Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images. However, the subtle visual nuances and domain-specific terminology…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Kai Shu , Yuzhuo Jia , Ziyang Zhang , Jiechao Gao

Automated radiology report generation aims to generate radiology reports that contain rich, fine-grained descriptions of radiology imaging. Compared with image captioning in the natural image domain, medical images are very similar to each…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhao Wang

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

Computation and Language · Computer Science 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

We propose a novel convolutional neural network for lesion detection from weak labels. Only a single, global label per image - the lesion count - is needed for training. We train a regression network with a fully convolutional architecture…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Florian Dubost , Gerda Bortsova , Hieab Adams , Arfan Ikram , Wiro Niessen , Meike Vernooij , Marleen De Bruijne

Automated CT report generation plays a crucial role in improving diagnostic accuracy and clinical workflow efficiency. However, existing methods lack interpretability and impede patient-clinician understanding, while their static nature…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Yannian Gu , Wenhui Lei , Hanyu Chen , Xiaofan Zhang , Shaoting Zhang

We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Dwarikanath Mahapatra

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Deep learning has achieved remarkable success in medical image analysis, however its adoption in clinical practice is limited by a lack of interpretability. These models often make correct predictions without explaining their reasoning.…

Image and Video Processing · Electrical Eng. & Systems 2025-10-03 Jhonatan Contreras , Thomas Bocklitz

Few-shot learning often involves metric learning-based classifiers, which predict the image label by comparing the distance between the extracted feature vector and class representations. However, applying global pooling in the backend of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Inyong Koo , Minki Jeong , Changick Kim

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Medical imaging is an essential tool for diagnosing and treating diseases. However, lacking medical images can lead to inaccurate diagnoses and ineffective treatments. Generative models offer a promising solution for addressing medical…

Image and Video Processing · Electrical Eng. & Systems 2024-01-02 M. AbdulRazek , G. Khoriba , M. Belal

Concept-based models naturally lend themselves to the development of inherently interpretable skin lesion diagnosis, as medical experts make decisions based on a set of visual patterns of the lesion. Nevertheless, the development of these…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Cristiano Patrício , Luís F. Teixeira , João C. Neves

Automated radiology report generation has the potential to improve radiology reporting and alleviate the workload of radiologists. However, the medical report generation task poses unique challenges due to the limited availability of…

Computation and Language · Computer Science 2023-12-27 Ruoqing Zhao , Xi Wang , Hongliang Dai , Pan Gao , Piji Li

Medical report generation from X-ray images is a challenging task, particularly in an unpaired setting where paired image-report data is unavailable for training. To address this challenge, we propose a novel model that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Most advances in medical lesion detection network are limited to subtle modification on the conventional detection network designed for natural images. However, there exists a vast domain gap between medical images and natural images where…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Chenhan Jiang , Shaoju Wang , Hang Xu , Xiaodan Liang , Nong Xiao

Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Li Zhang , Basu Jindal , Ahmed Alaa , Robert Weinreb , David Wilson , Eran Segal , James Zou , Pengtao Xie

Automated radiology reporting holds immense clinical potential in alleviating the burdensome workload of radiologists and mitigating diagnostic bias. Recently, retrieval-based report generation methods have garnered increasing attention due…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Junting Zhao , Yang Zhou , Zhihao Chen , Huazhu Fu , Liang Wan

Recent advancements in deep learning have shown significant potential for classifying retinal diseases using color fundus images. However, existing works predominantly rely exclusively on image data, lack interpretability in their…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Deval Mehta , Yiwen Jiang , Catherine L Jan , Mingguang He , Kshitij Jadhav , Zongyuan Ge

Medicine, by its nature, is a multifaceted domain that requires the synthesis of information across various modalities. Medical generative vision-language models (VLMs) make a first step in this direction and promise many exciting clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Michael Moor , Qian Huang , Shirley Wu , Michihiro Yasunaga , Cyril Zakka , Yash Dalmia , Eduardo Pontes Reis , Pranav Rajpurkar , Jure Leskovec