中文
相关论文

相关论文: Visual Question Answering for Cultural Heritage

200 篇论文

One of the most intriguing features of the Visual Question Answering (VQA) challenge is the unpredictability of the questions. Extracting the information required to answer them demands a variety of image operations from detection and…

计算机视觉与模式识别 · 计算机科学 2016-12-19 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel

This paper introduces two ongoing projects where audio augmented reality is implemented as a means of engaging museum and gallery visitors with audio archive material and associated objects, artworks and artefacts. It outlines some of the…

人机交互 · 计算机科学 2024-12-13 Laurence Cliffe , James Mansell , Joanne Cormac , Chris Greenhalgh , Adrian Hazzard

This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge. VQA is a task of significant importance for research in artificial intelligence, given its multimodal…

计算机视觉与模式识别 · 计算机科学 2017-08-10 Damien Teney , Peter Anderson , Xiaodong He , Anton van den Hengel

Knowledge-based visual question answering (VQA) requires answering questions with external knowledge in addition to the content of images. One dataset that is mostly used in evaluating knowledge-based VQA is OK-VQA, but it lacks a gold…

计算与语言 · 计算机科学 2021-09-10 Man Luo , Yankai Zeng , Pratyay Banerjee , Chitta Baral

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

Question categorization and expert retrieval methods have been crucial for information organization and accessibility in community question & answering (CQA) platforms. Research in this area, however, has dealt with only the text modality.…

计算与语言 · 计算机科学 2019-05-28 Avikalp Srivastava , Hsin Wen Liu , Sumio Fujita

The complex compositional structure of language makes problems at the intersection of vision and language challenging. But language also provides a strong prior that can result in good superficial performance, without the underlying models…

计算与语言 · 计算机科学 2016-04-20 Peng Zhang , Yash Goyal , Douglas Summers-Stay , Dhruv Batra , Devi Parikh

We consider the problem of Visual Question Answering (VQA). Given an image and a free-form, open-ended, question, expressed in natural language, the goal of VQA system is to provide accurate answer to this question with respect to the…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Tanzila Rahman , Shih-Han Chou , Leonid Sigal , Giuseppe Carenini

The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Dustin Schwenk , Apoorv Khandelwal , Christopher Clark , Kenneth Marino , Roozbeh Mottaghi

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

Recently, Visual Question Answering (VQA) has emerged as one of the most significant tasks in multimodal learning as it requires understanding both visual and textual modalities. Existing methods mainly rely on extracting image and question…

计算机视觉与模式识别 · 计算机科学 2018-07-23 Pan Lu , Lei Ji , Wei Zhang , Nan Duan , Ming Zhou , Jianyong Wang

In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this concept by adding…

计算与语言 · 计算机科学 2024-06-17 Manas Jhalani , Annervaz K M , Pushpak Bhattacharyya

We propose the inverse problem of Visual question answering (iVQA), and explore its suitability as a benchmark for visuo-linguistic understanding. The iVQA task is to generate a question that corresponds to a given image and answer pair.…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Embodied Question Answering (EQA) is a recently proposed task, where an agent is placed in a rich 3D environment and must act based solely on its egocentric input to answer a given question. The desired outcome is that the agent learns to…

计算机视觉与模式识别 · 计算机科学 2019-08-15 Cătălina Cangea , Eugene Belilovsky , Pietro Liò , Aaron Courville

Problems at the intersection of language and vision, like visual question answering, have recently been gaining a lot of attention in the field of multi-modal machine learning as computer vision research moves beyond traditional recognition…

计算与语言 · 计算机科学 2018-09-25 Khyathi Raghavi Chandu , Mary Arpita Pyreddy , Matthieu Felix , Narendra Nath Joshi

AI systems' ability to explain their reasoning is critical to their utility and trustworthiness. Deep neural networks have enabled significant progress on many challenging problems such as visual question answering (VQA). However, most of…

计算与语言 · 计算机科学 2019-06-05 Jialin Wu , Raymond J. Mooney

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

Vision and language understanding has emerged as a subject undergoing intense study in Artificial Intelligence. Among many tasks in this line of research, visual question answering (VQA) has been one of the most successful ones, where the…

计算机视觉与模式识别 · 计算机科学 2017-12-05 Yunseok Jang , Yale Song , Youngjae Yu , Youngjin Kim , Gunhee Kim

Visual Question Answering (VQA) has emerged as one of the most challenging tasks in artificial intelligence due to its multi-modal nature. However, most existing VQA methods are incapable of handling Knowledge-based Visual Question…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Chengxiang Yin , Zhengping Che , Kun Wu , Zhiyuan Xu , Jian Tang