English
Related papers

Related papers: A Survey on Biomedical Image Captioning

200 papers

Authors of biomedical publications often use gel images to report experimental results such as protein-protein interactions or protein expressions under different conditions. Gel images offer a way to concisely communicate such findings,…

Information Retrieval · Computer Science 2012-09-10 Tobias Kuhn , Michael Krauthammer

Medical image analysis is a vibrant research area that offers doctors and medical practitioners invaluable insight and the ability to accurately diagnose and monitor disease. Machine learning provides an additional boost for this area.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Athanasios Vlontzos , Daniel Rueckert , Bernhard Kainz

Purpose: Our study presents an enhanced approach to medical image caption generation by integrating concept detection into attention mechanisms. Method: This method utilizes sophisticated models to identify critical concepts within medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Nhi Ngoc-Yen Nguyen , Le-Huy Tu , Dieu-Phuong Nguyen , Nhat-Tan Do , Minh Triet Thai , Bao-Thien Nguyen-Tat

Deep neural networks have achieved great successes on the image captioning task. However, most of the existing models depend heavily on paired image-sentence datasets, which are very expensive to acquire. In this paper, we make the first…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yang Feng , Lin Ma , Wei Liu , Jiebo Luo

Authors of biomedical publications use gel images to report experimental results such as protein-protein interactions or protein expressions under different conditions. Gel images offer a concise way to communicate such findings, not all of…

Information Retrieval · Computer Science 2014-03-06 Tobias Kuhn , Mate Levente Nagy , ThaiBinh Luong , Michael Krauthammer

Benefiting from advances in machine vision and natural language processing techniques, current image captioning systems are able to generate detailed visual descriptions. For the most part, these descriptions represent an objective…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris

Image Captioning is a current research task to describe the image content using the objects and their relationships in the scene. To tackle this task, two important research areas converge, artificial vision, and natural language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Othón González-Chávez , Guillermo Ruiz , Daniela Moctezuma , Tania A. Ramirez-delReal

Medical image classification is crucial for diagnosis and treatment, benefiting significantly from advancements in artificial intelligence. The paper reviews recent progress in the field, focusing on three levels of solutions: basic,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Loan Dao , Ngoc Quoc Ly

Digital image analysis has made a big advance in many areas of enterprise applications including medicine, industry, and entertainment by assisting the extraction of semantic information from digital images. However, its large computational…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Elham Sagheb Hossein Pour

Crafting effective captions for figures is important. Readers heavily depend on these captions to grasp the figure's message. However, despite a well-developed set of AI technologies for figures and captions, these have rarely been tested…

Human-Computer Interaction · Computer Science 2024-03-27 Ting-Yao Hsu , Chieh-Yang Huang , Shih-Hong Huang , Ryan Rossi , Sungchul Kim , Tong Yu , C. Lee Giles , Ting-Hao K. Huang

This work introduces panoptic captioning, a novel task striving to seek the minimum text equivalent of images, which has broad potential applications. We take the first step towards panoptic captioning by formulating it as a task of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Kun-Yu Lin , Hongjun Wang , Weining Ren , Kai Han

An important topic in medical research is the process of improving the images obtained from medical devices. As a consequence, there is also a need to improve medical image resolution and analysis. Another issue in this field is the large…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Elena-Simona Apostol , Ciprian-Octavian Truică

Cancer is a leading cause of death in many countries. An early diagnosis of cancer based on biomedical imaging ensures effective treatment and a better prognosis. However, biomedical imaging presents challenges to both clinical institutions…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Hosein Barzekar , Yash Patel , Ling Tong , Zeyun Yu

Attention mechanisms have attracted considerable interest in image captioning because of its powerful performance. Existing attention-based models use feedback information from the caption generator as guidance to determine which of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Zhihao Zhu , Zhan Xue , Zejian Yuan

Biomedical image analysis algorithm validation depends on high-quality annotation of reference datasets, for which labeling instructions are key. Despite their importance, their optimization remains largely unexplored. Here, we present the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Tim Rädsch , Annika Reinke , Vivienn Weru , Minu D. Tizabi , Nicholas Schreck , A. Emre Kavur , Bünyamin Pekdemir , Tobias Roß , Annette Kopp-Schneider , Lena Maier-Hein

In the field of image classification, existing methods often struggle with biased or ambiguous data, a prevalent issue in real-world scenarios. Current strategies, including semi-supervised learning and class blending, offer partial…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Lars Schmarje , Vasco Grossmann , Claudius Zelenka , Johannes Brünger , Reinhard Koch

Image captioning models generally lack the capability to take into account user interest, and usually default to global descriptions that try to balance readability, informativeness, and information overload. On the other hand, VQA models…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Edwin G. Ng , Bo Pang , Piyush Sharma , Radu Soricut

Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Xin Jin , Le Wu , Geng Zhao , Xiaodong Li , Xiaokun Zhang , Shiming Ge , Dongqing Zou , Bin Zhou , Xinghui Zhou

Dense captioning is a newly emerging computer vision topic for understanding images with dense language descriptions. The goal is to densely detect visual concepts (e.g., objects, object parts, and interactions between them) from images,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Linjie Yang , Kevin Tang , Jianchao Yang , Li-Jia Li

In recent years, AI systems in the medical domain have advanced significantly. However, despite outperforming humans, they are rarely used in practice since it is often not clear how they make their decisions. Optimal explanation and…

Human-Computer Interaction · Computer Science 2026-05-06 Julia Wagner , Tim Schlippe