中文
相关论文

相关论文: Hierarchical Deep Multi-modal Network for Medical …

200 篇论文

Visual Question Answering (VQA) becomes one of the most active research problems in the medical imaging domain. A well-known VQA challenge is the intrinsic diversity between the image and text modalities, and in the medical VQA task, there…

计算机视觉与模式识别 · 计算机科学 2023-02-28 Yuan Zhou , Jing Mei , Yiqin Yu , Tanveer Syeda-Mahmood

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

Visual question answering (VQA) in medical imaging aims to support clinical diagnosis by automatically interpreting complex imaging data in response to natural language queries. Existing studies typically rely on distinct visual and textual…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yuanhe Tian , Chen Su , Junwen Duan , Yan Song

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang

Artificial intelligence has advanced in Medical Visual Question Answering (Med-VQA), but prevalent research tends to focus on the accuracy of the answers, often overlooking the reasoning paths and interpretability, which are crucial in…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Jiaxiang Liu , Yuan Wang , Jiawei Du , Joey Tianyi Zhou , Zuozhu Liu

Most existing approaches to Visual Question Answering (VQA) answer questions directly, however, people usually decompose a complex question into a sequence of simple sub questions and finally obtain the answer to the original question after…

计算与语言 · 计算机科学 2022-04-05 Ruonan Wang , Yuxi Qian , Fangxiang Feng , Xiaojie Wang , Huixing Jiang

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

计算机视觉与模式识别 · 计算机科学 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

计算机视觉与模式识别 · 计算机科学 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

There is a key problem in the medical visual question answering task that how to effectively realize the feature fusion of language and medical images with limited datasets. In order to better utilize multi-scale information of medical…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Shanshan Song , Jiangyun Li , Jing Wang , Yuanxiu Cai , Wenkai Dong

Visual Question Answering (VQA) in the medical domain presents a unique, interdisciplinary challenge, combining fields such as Computer Vision, Natural Language Processing, and Knowledge Representation. Despite its importance, research in…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Abhishek Narayanan , Rushabh Musthyala , Rahul Sankar , Anirudh Prasad Nistala , Pranav Singh , Jacopo Cirrone

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

计算机视觉与模式识别 · 计算机科学 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

Medical Visual Question Answering (MedVQA) presents a significant opportunity to enhance diagnostic accuracy and healthcare delivery by leveraging artificial intelligence to interpret and answer questions based on medical images. In this…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Xiaoman Zhang , Chaoyi Wu , Ziheng Zhao , Weixiong Lin , Ya Zhang , Yanfeng Wang , Weidi Xie

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

计算机视觉与模式识别 · 计算机科学 2017-09-15 Kushal Kafle , Christopher Kanan

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Yeyun Zou , Qiyu Xie

Recently, the Visual Question Answering (VQA) task has gained increasing attention in artificial intelligence. Existing VQA methods mainly adopt the visual attention mechanism to associate the input question with corresponding image regions…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Pan Lu , Hongsheng Li , Wei Zhang , Jianyong Wang , Xiaogang Wang

In the domain of video question answering (VideoQA), the impact of question types on VQA systems, despite its critical importance, has been relatively under-explored to date. However, the richness of question types directly determines the…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Zhixian He , Pengcheng Zhao , Fuwei Zhang , Shujin Lin

Knowledge-based Visual Question Answering (KB-VQA) requires models to answer questions by integrating visual information with external knowledge. However, retrieved knowledge is often noisy, partially irrelevant, or misaligned with the…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Xianwei Mao , Kai Ye , Sheng Zhou , Nan Zhang , Haikuan Huang , Bin Li , Jiajun Bu

This paper studies the task of Visual Question Answering (VQA), which is topical in Multimedia community recently. Particularly, we explore two critical research problems existed in VQA: (1) efficiently fusing the visual and textual…

计算机视觉与模式识别 · 计算机科学 2020-09-07 Yanze Wu , Qiang Sun , Jianqi Ma , Bin Li , Yanwei Fu , Yao Peng , Xiangyang Xue