中文
相关论文

相关论文: Tell-and-Answer: Towards Explainable Visual Questi…

200 篇论文

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

计算机视觉与模式识别 · 计算机科学 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

Acquiring high-quality knowledge is a central focus in Knowledge-Based Visual Question Answering (KB-VQA). Recent methods use large language models (LLMs) as knowledge engines for answering. These methods generally employ image captions as…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Yan Zhang , Jiaqing Lin , Miao Zhang , Kui Xiao , Xiaoju Hou , Yue Zhao , Zhifei Li

Logical connectives and their implications on the meaning of a natural language sentence are a fundamental aspect of understanding. In this paper, we investigate whether visual question answering (VQA) systems trained to answer a question…

计算机视觉与模式识别 · 计算机科学 2020-07-17 Tejas Gokhale , Pratyay Banerjee , Chitta Baral , Yezhou Yang

The intersection of medical Visual Question Answering (Med-VQA) is a challenging research topic with advantages including patient engagement and clinical expert involvement for second opinions. However, existing Med-VQA methods based on…

机器学习 · 计算机科学 2024-06-24 Lin Fan , Xun Gong , Cenyang Zheng , Yafei Ou

We describe a method for visual question answering which is capable of reasoning about contents of an image on the basis of information extracted from a large-scale knowledge base. The method not only answers natural language questions…

计算机视觉与模式识别 · 计算机科学 2015-11-13 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

Recent insights on language and vision with neural networks have been successfully applied to simple single-image visual question answering. However, to tackle real-life question answering problems on multimedia collections such as personal…

计算机视觉与模式识别 · 计算机科学 2019-06-04 Junwei Liang , Lu Jiang , Liangliang Cao , Li-Jia Li , Alexander Hauptmann

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

人工智能 · 计算机科学 2016-08-30 Danna Gurari , Kristen Grauman

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visual impairments learn…

计算与语言 · 计算机科学 2022-10-28 Yang Trista Cao , Kyle Seelman , Kyungjun Lee , Hal Daumé

Visual Question Answering (VQA) research seeks to create AI systems to answer natural language questions in images, yet VQA methods often yield overly simplistic and short answers. This paper aims to advance the field by introducing Visual…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Jialu Li , Manish Kumar Thota , Ruslan Gokhman , Radek Holik , Youshan Zhang

Given an image and an associated textual question, the purpose of Knowledge-Based Visual Question Answering (KB-VQA) is to provide a correct answer to the question with the aid of external knowledge bases. Prior KB-VQA models are usually…

机器学习 · 计算机科学 2023-10-13 Jingru Gan , Xinzhe Han , Shuhui Wang , Qingming Huang

Visual Question Answering (VQA) is the task of answering natural-language questions about images. We introduce the novel problem of determining the relevance of questions to images in VQA. Current VQA models do not reason about whether a…

计算机视觉与模式识别 · 计算机科学 2016-09-27 Arijit Ray , Gordon Christie , Mohit Bansal , Dhruv Batra , Devi Parikh

Infographics are documents designed to effectively communicate information using a combination of textual, graphical and visual elements. In this work, we explore the automatic understanding of infographic images by using Visual Question…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Minesh Mathew , Viraj Bagal , Rubèn Pérez Tito , Dimosthenis Karatzas , Ernest Valveny , C. V Jawahar

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

机器学习 · 计算机科学 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

Audio-visual question answering (AVQA) requires reference to video content and auditory information, followed by correlating the question to predict the most precise answer. Although mining deeper layers of audio-visual information to…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Qilang Ye , Zitong Yu , Xin Liu

We describe a very simple bag-of-words baseline for visual question answering. This baseline concatenates the word features from the question and CNN features from the image to predict the answer. When evaluated on the challenging VQA…

计算机视觉与模式识别 · 计算机科学 2015-12-16 Bolei Zhou , Yuandong Tian , Sainbayar Sukhbaatar , Arthur Szlam , Rob Fergus

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

计算机视觉与模式识别 · 计算机科学 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

Visual Question Answering (VQA) is the task of answering a question about an image and requires processing multimodal input and reasoning to obtain the answer. Modular solutions that use declarative representations within the reasoning…

人工智能 · 计算机科学 2024-10-15 Thomas Eiter , Jan Hadl , Nelson Higuera , Johannes Oetsch