中文
相关论文

相关论文: MuVAM: A Multi-View Attention-based Model for Medi…

200 篇论文

Medical Visual Question Answering (Med-VQA) answers clinical questions using medical images, aiding diagnosis. Designing the MedVQA system holds profound importance in assisting clinical diagnosis and enhancing diagnostic accuracy. Building…

计算机视觉与模式识别 · 计算机科学 2025-04-11 Junkai Zhang , Bin Li , Shoujun Zhou , Yue Du

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid

Recently, the Visual Question Answering (VQA) task has gained increasing attention in artificial intelligence. Existing VQA methods mainly adopt the visual attention mechanism to associate the input question with corresponding image regions…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Pan Lu , Hongsheng Li , Wei Zhang , Jianyong Wang , Xiaogang Wang

Medical visual question answering (Med-VQA) is a machine learning task that aims to create a system that can answer natural language questions based on given medical images. Although there has been rapid progress on the general VQA task,…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Louisa Canepa , Sonit Singh , Arcot Sowmya

Medical visual question answering (VQA) is a challenging task that requires answering clinical questions of a given medical image, by taking consider of both visual and language information. However, due to the small scale of training data…

计算机视觉与模式识别 · 计算机科学 2023-07-12 Pengfei Li , Gang Liu , Jinlong He , Zixu Zhao , Shenjun Zhong

Visual Question Answering (VQA) has been primarily studied through the lens of the English language. Yet, tackling VQA in other languages in the same manner would require a considerable amount of resources. In this paper, we propose…

Medical Visual Question Answering (VQA) is an important challenge, as it would lead to faster and more accurate diagnoses and treatment decisions. Most existing methods approach it as a multi-class classification problem, which restricts…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Tom van Sonsbeek , Mohammad Mahdi Derakhshani , Ivona Najdenkoska , Cees G. M. Snoek , Marcel Worring

Medical Visual Question Answering (MedVQA) has attracted growing interest at the intersection of medical image understanding and natural language processing for clinical applications. By interpreting medical images and providing precise…

图像与视频处理 · 电气工程与系统科学 2025-05-13 Zhilin Zhang , Jie Wang , Zhanghao Qin , Ruiqi Zhu , Xiaoliang Gong

Medical visual question answering (VQA) is a challenging multimodal task, where Vision-Language Pre-training (VLP) models can effectively improve the generalization performance. However, most methods in the medical field treat VQA as an…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Jiawei Chen , Dingkang Yang , Yue Jiang , Yuxuan Lei , Lihua Zhang

Visual question answering (VQA) in medical imaging aims to support clinical diagnosis by automatically interpreting complex imaging data in response to natural language queries. Existing studies typically rely on distinct visual and textual…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yuanhe Tian , Chen Su , Junwen Duan , Yan Song

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Question categorization and expert retrieval methods have been crucial for information organization and accessibility in community question & answering (CQA) platforms. Research in this area, however, has dealt with only the text modality.…

计算与语言 · 计算机科学 2019-05-28 Avikalp Srivastava , Hsin Wen Liu , Sumio Fujita

Learning to answer visual questions is a challenging task since the multi-modal inputs are within two feature spaces. Moreover, reasoning in visual question answering requires the model to understand both image and question, and align them…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Peixi Xiong , Yilin Shen , Hongxia Jin

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both the visual content of images and the textual content of questions. The approaches used to represent the images and questions in a…

计算机视觉与模式识别 · 计算机科学 2017-08-07 Zhou Yu , Jun Yu , Jianping Fan , Dacheng Tao

Multimodal models integrating speech and vision hold significant potential for advancing human-computer interaction, particularly in Speech-Based Visual Question Answering (SBVQA) where spoken questions about images require direct…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Bingxin Li

Medical Visual Question Answering (MedVQA) aims to answer medical questions according to medical images. However, the complexity of medical data leads to confounders that are difficult to observe, so bias between images and questions is…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Zibo Xu , Qiang Li , Weizhi Nie , Weijie Wang , Anan Liu

Accurate diagnosis of ophthalmic diseases relies heavily on the interpretation of multimodal ophthalmic images, a process often time-consuming and expertise-dependent. Visual Question Answering (VQA) presents a potential interdisciplinary…

图像与视频处理 · 电气工程与系统科学 2024-10-23 Xiaolan Chen , Ruoyu Chen , Pusheng Xu , Weiyi Zhang , Xianwen Shang , Mingguang He , Danli Shi

A key solution to visual question answering (VQA) exists in how to fuse visual and language features extracted from an input image and question. We show that an attention mechanism that enables dense, bi-directional interactions between the…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani