English
Related papers

Related papers: Transformers in Medicine: Improving Vision-Languag…

200 papers

Image captioning model is a cross-modality knowledge discovery task, which targets at automatically describing an image with an informative and coherent sentence. To generate the captions, the previous encoder-decoder frameworks directly…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ziwei Wang , Yadan Luo , Zi Huang

This paper introduces an innovative approach to Medical Vision-Language Pre-training (Med-VLP) area in the specialized context of radiograph representation learning. While conventional methods frequently merge textual annotations into…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Hanqi Jiang , Xixuan Hao , Yuzhou Huang , Chong Ma , Jiaxun Zhang , Yi Pan , Ruimao Zhang

Visual captioning aims to generate textual descriptions given images or videos. Traditionally, image captioning models are trained on human annotated datasets such as Flickr30k and MS-COCO, which are limited in size and diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Marimuthu Kalimuthu , Aditya Mogadala , Marius Mosbach , Dietrich Klakow

Large Language Models (LLMs), known for their versatility in textual data, are increasingly being explored for their potential to enhance medical image segmentation, a crucial task for accurate diagnostic imaging. This study explores…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Gurucharan Marthi Krishna Kumar , Aman Chadha , Janine Mendola , Amir Shmuel

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Purpose: Our study presents an enhanced approach to medical image caption generation by integrating concept detection into attention mechanisms. Method: This method utilizes sophisticated models to identify critical concepts within medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Nhi Ngoc-Yen Nguyen , Le-Huy Tu , Dieu-Phuong Nguyen , Nhat-Tan Do , Minh Triet Thai , Bao-Thien Nguyen-Tat

Images in the medical domain are fundamentally different from the general domain images. Consequently, it is infeasible to directly employ general domain Visual Question Answering (VQA) models for the medical domain. Additionally, medical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yash Khare , Viraj Bagal , Minesh Mathew , Adithi Devi , U Deva Priyakumar , CV Jawahar

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Medical imaging has significantly revolutionized medical diagnostics and treatment planning, progressing from early X-ray usage to sophisticated methods like MRIs, CT scans, and ultrasounds. This paper investigates the use of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Abdennour Boulesnane , Boutheina Mokhtari , Oumnia Rana Segueni , Slimane Segueni

Transformer, a model comprising attention-based encoder-decoder architecture, have gained prevalence in the field of natural language processing (NLP) and recently influenced the computer vision (CV) space. The similarities between computer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Emerald U. Henry , Onyeka Emebob , Conrad Asotie Omonhinmin

Deep learning has been widely used in medical image segmentation and other aspects. However, the performance of existing medical image segmentation models has been limited by the challenge of obtaining sufficient high-quality labeled data…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Zihan Li , Yunxiang Li , Qingde Li , Puyang Wang , Dazhou Guo , Le Lu , Dakai Jin , You Zhang , Qingqi Hong

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Andrew Kean Gao

Medical image captioning via vision-language models has shown promising potential for clinical diagnosis assistance. However, generating contextually relevant descriptions with accurate modality recognition remains challenging. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yining Zhao , Ali Braytee , Mukesh Prasad

Image segmentation is often ambiguous at the level of individual image patches and requires contextual information to reach label consensus. In this paper we introduce Segmenter, a transformer model for semantic segmentation. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Robin Strudel , Ricardo Garcia , Ivan Laptev , Cordelia Schmid

Change captioning tasks aim to detect changes in image pairs observed before and after a scene change and generate a natural language description of the changes. Existing change captioning studies have mainly focused on a single…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Yue Qiu , Shintaro Yamamoto , Kodai Nakashima , Ryota Suzuki , Kenji Iwata , Hirokatsu Kataoka , Yutaka Satoh

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Qingzhong Wang , Antoni B. Chan

Image captioning is shown to be able to achieve a better performance by using scene graphs to represent the relations of objects in the image. The current captioning encoders generally use a Graph Convolutional Net (GCN) to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Xuewen Yang , Yingru Liu , Xin Wang

We introduce a novel contextual embedding model med-gte-hybrid that was derived from the gte-large sentence transformer to extract information from unstructured clinical narratives. Our model tuning strategy for med-gte-hybrid combines…

Computation and Language · Computer Science 2025-12-02 Aditya Kumar , Simon Rauch , Mario Cypko , Oliver Amft

Automatically generating medical reports for retinal images is one of the promising ways to help ophthalmologists reduce their workload and improve work efficiency. In this work, we propose a new context-driven encoding network to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jia-Hong Huang , Ting-Wei Wu , Chao-Han Huck Yang , Marcel Worring

Real-time image captioning, along with adequate precision, is the main challenge of this research field. The present work, Multiple Transformers for Self-Attention Mechanism (MTSM), utilizes multiple transformers to address these problems.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Farrukh Olimov , Shikha Dubey , Labina Shrestha , Tran Trung Tin , Moongu Jeon