English
Related papers

Related papers: Uterine Ultrasound Image Captioning Using Deep Lea…

200 papers

We propose a selective learning method using meta-learning and deep reinforcement learning for medical image interpretation in the setting of limited labeling resources. Our method, MedSelect, consists of a trainable deep learning selector…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Akshay Smit , Damir Vrabac , Yujie He , Andrew Y. Ng , Andrew L. Beam , Pranav Rajpurkar

Confounding information in the form of text or markings embedded in medical images can severely affect the training of diagnostic deep learning algorithms. However, data collected for clinical purposes often have such markings embedded in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Kamil Mikolaj , Manxi Lin , Zahra Bashir , Morten Bo Søndergaard Svendsen , Martin Tolsgaard , Anders Nymark , Aasa Feragen

Medical image captioning automatically generates a medical description to describe the content of a given medical image. A traditional medical image captioning model creates a medical description only based on a single medical image input.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Jia-Hong Huang , Ting-Wei Wu , Marcel Worring

Image captioning applied to biomedical images can assist and accelerate the diagnosis process followed by clinicians. This article is the first survey of biomedical image captioning, discussing datasets, evaluation measures, and state of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Vasiliki Kougia , John Pavlopoulos , Ion Androutsopoulos

Ultrasound (US) image segmentation embraced its significant improvement in deep learning era. However, the lack of sharp boundaries in US images still remains an inherent challenge for segmentation. Previous methods often resort to global…

Image and Video Processing · Electrical Eng. & Systems 2020-10-13 Haoming Li , Xin Yang , Jiamin Liang , Wenlong Shi , Chaoyu Chen , Haoran Dou , Rui Li , Rui Gao , Guangquan Zhou , Jinghui Fang , Xiaowen Liang , Ruobing Huang , Alejandro Frangi , Zhiyi Chen , Dong Ni

Image Captioning is a task that combines computer vision and natural language processing, where it aims to generate descriptive legends for images. It is a two-fold process relying on accurate image understanding and correct language…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ahmed Elhagry , Karima Kadaoui

Image captioning is the task of automatically generating sentences that describe an input image in the best way possible. The most successful techniques for automatically generating image captions have recently used attentive deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Zanyar Zohourianshahzadi , Jugal K. Kalita

Deep neural networks exhibit limited generalizability across images with different entangled domain features and categorical features. Learning generalizable features that can form universal categorical decision boundaries across domains is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Qingjie Meng , Jacqueline Matthew , Veronika A. Zimmer , Alberto Gomez , David F. A. Lloyd , Daniel Rueckert , Bernhard Kainz

Ultrasound images are widespread in medical diagnosis for muscle-skeletal, cardiac, and obstetrical diseases, due to the efficiency and non-invasiveness of the acquisition methodology. However, ultrasound acquisition introduces noise in the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-24 Simone Cammarasana , Paolo Nicolardi , Giuseppe Patanè

We present a lesion-aware image captioning framework for ulcerative colitis (UC). The model integrates ResNet embeddings, Grad-CAM heatmaps, and CBAM-enhanced attention with a T5 decoder. Clinical metadata (MES score 0-3, vascular pattern,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Alexis Ivan Lopez Escamilla , Gilberto Ochoa , Sharib Al

Since its renaissance, deep learning has been widely used in various medical imaging tasks and has achieved remarkable success in many medical imaging applications, thereby propelling us into the so-called artificial intelligence (AI) era.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 S. Kevin Zhou , Hayit Greenspan , Christos Davatzikos , James S. Duncan , Bram van Ginneken , Anant Madabhushi , Jerry L. Prince , Daniel Rueckert , Ronald M. Summers

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

Diagnostic Captioning (DC) concerns the automatic generation of a diagnostic text from a set of medical images of a patient collected during an examination. DC can assist inexperienced physicians, reducing clinical errors. It can also help…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 John Pavlopoulos , Vasiliki Kougia , Ion Androutsopoulos , Dimitris Papamichail

Ultrasound imaging is a commonly used modality for several diagnostic and therapeutic procedures. However, the diagnosis by ultrasound relies heavily on the quality of images assessed manually by sonographers, which diminishes the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-10 Deepak Raina , Dimitrios Ntentia , SH Chandrashekhara , Richard Voyles , Subir Kumar Saha

Masked autoencoder (MAE) has attracted unprecedented attention and achieves remarkable performance in many vision tasks. It reconstructs random masked image patches (known as proxy task) during pretraining and learns meaningful semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Qingbo Kang , Jun Gao , Kang Li , Qicheng Lao

Deep learning methods have proven extremely effective at performing a variety of medical image analysis tasks. With their potential use in clinical routine, their lack of transparency has however been one of their few weak points, raising…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Minh H. Vu , Tommy Löfstedt , Tufve Nyholm , Raphael Sznitman

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xuxin Chen , Ximin Wang , Ke Zhang , Kar-Ming Fung , Theresa C. Thai , Kathleen Moore , Robert S. Mannel , Hong Liu , Bin Zheng , Yuchen Qiu

Well-annotated medical datasets enable deep neural networks (DNNs) to gain strong power in extracting lesion-related features. Building such large and well-designed medical datasets is costly due to the need for high-level expertise. Model…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Yixiong Chen , Chunhui Zhang , Chris H. Q. Ding , Li Liu

Ultrasound imaging is widely used in medical diagnosis, especially for fetal health assessment. However, the availability of high-quality annotated ultrasound images is limited, which restricts the training of machine learning models. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yueying Tian , Elif Ucurum , Xudong Han , Rupert Young , Chris Chatwin , Philip Birch

This article presents a novel approach to keyframe detection in ultrasound videos, with a particular focus on fetal brain imaging. The proposed model is a composite neural network architecture that combines a Convolutional Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Aleksander Zamojski , Kacper Jarczak , Radoslaw Roszczyk