中文
相关论文

相关论文: IQA: Visual Question Answering in Interactive Envi…

200 篇论文

We tackle the challenge of Visual Question Answering in multi-image setting for the ISVQA dataset. Traditional VQA tasks have focused on a single-image setting where the target answer is generated from a single image. Image set VQA,…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Abhinav Khattar , Aviral Joshi , Har Simrat Singh , Pulkit Goel , Rohit Prakash Barnwal

We introduce the MovieQA dataset which aims to evaluate automatic story comprehension from both video and text. The dataset consists of 14,944 questions about 408 movies with high semantic diversity. The questions range from simpler "Who"…

计算机视觉与模式识别 · 计算机科学 2016-09-22 Makarand Tapaswi , Yukun Zhu , Rainer Stiefelhagen , Antonio Torralba , Raquel Urtasun , Sanja Fidler

Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and the integration of…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Aviral Agrawal , Carlos Mateo Samudio Lezcano , Iqui Balam Heredia-Marin , Prabhdeep Singh Sethi

The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Dustin Schwenk , Apoorv Khandelwal , Christopher Clark , Kenneth Marino , Roozbeh Mottaghi

We present a new AI task -- Embodied Question Answering (EmbodiedQA) -- where an agent is spawned at a random location in a 3D environment and asked a question ("What color is the car?"). In order to answer, the agent must first…

计算机视觉与模式识别 · 计算机科学 2017-12-04 Abhishek Das , Samyak Datta , Georgia Gkioxari , Stefan Lee , Devi Parikh , Dhruv Batra

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

The intelligent question answering (IQA) system can accurately capture users' search intention by understanding the natural language questions, searching relevant content efficiently from a massive knowledge-base, and returning the answer…

人工智能 · 计算机科学 2021-06-17 Yachen Tang , Haiyun Han , Xianmao Yu , Jing Zhao , Guangyi Liu , Longfei Wei

Visual question answering is an important task in both natural language and vision understanding. However, in most of the public visual question answering datasets such as VQA, CLEVR, the questions are human generated that specific to the…

计算与语言 · 计算机科学 2022-08-08 Bingning Wang , Feiyang Lv , Ting Yao , Yiming Yuan , Jin Ma , Yu Luo , Haijin Liang

Audio question answering (AQA), acting as a widely used proxy task to explore scene understanding, has got more attention. The AQA is challenging for it requires comprehensive temporal reasoning from different scales' events of an audio…

声音 · 计算机科学 2023-05-30 Guangyao Li , Yixin Xu , Di Hu

We introduce the task of acoustic question answering (AQA) in the area of acoustic reasoning. In this task an agent learns to answer questions on the basis of acoustic context. In order to promote research in this area, we propose a data…

计算与语言 · 计算机科学 2018-11-27 Jerome Abdelnour , Giampiero Salvi , Jean Rouat

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Damien Teney , Anton van den Hengel

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

计算机视觉与模式识别 · 计算机科学 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

音频与语音处理 · 电气工程与系统科学 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

Typical active learning strategies are designed for tasks, such as classification, with the assumption that the output space is mutually exclusive. The assumption that these tasks always have exactly one correct answer has resulted in the…

计算机视觉与模式识别 · 计算机科学 2019-12-10 Khaled Jedoui , Ranjay Krishna , Michael Bernstein , Li Fei-Fei

Medical Visual Question Answering~(VQA) is a combination of medical artificial intelligence and popular VQA challenges. Given a medical image and a clinically relevant question in natural language, the medical VQA system is expected to…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Zhihong Lin , Donghao Zhang , Qingyi Tao , Danli Shi , Gholamreza Haffari , Qi Wu , Mingguang He , Zongyuan Ge

Agricultural visual question answering is essential for providing farmers and researchers with accurate and timely knowledge. However, many existing approaches are predominantly developed for evidence-constrained settings such as text-only…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yan Ke , Xin Yu , Heming Du , Scott Chapman , Helen Huang

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria