中文
相关论文

相关论文: Visual Question Answering on 360{\deg} Images

200 篇论文

Visual Question Answering (VQA) is an increasingly popular topic in deep learning research, requiring coordination of natural language processing and computer vision modules into a single architecture. We build upon the model which placed…

计算与语言 · 计算机科学 2018-03-22 Jasdeep Singh , Vincent Ying , Alex Nutkiewicz

The Earth's surface is continually changing, and identifying changes plays an important role in urban planning and sustainability. Although change detection techniques have been successfully developed for many years, these techniques are…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Zhenghang Yuan , Lichao Mou , Zhitong Xiong , Xiaoxiang Zhu

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both visual content of images and textual content of questions. To support the VQA task, we need to find good solutions for the following…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Zhou Yu , Jun Yu , Chenchao Xiang , Jianping Fan , Dacheng Tao

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Answering open-ended questions is an essential capability for any intelligent agent. One of the most interesting recent open-ended question answering challenges is Visual Question Answering (VQA) which attempts to evaluate a system's visual…

计算与语言 · 计算机科学 2016-10-25 Omid Bakhshandeh , Trung Bui , Zhe Lin , Walter Chang

Despite significant progress in Visual Question Answering over the years, robustness of today's VQA models leave much to be desired. We introduce a new evaluation protocol and associated dataset (VQA-Rephrasings) and show that…

计算机视觉与模式识别 · 计算机科学 2019-02-18 Meet Shah , Xinlei Chen , Marcus Rohrbach , Devi Parikh

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

计算与语言 · 计算机科学 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Visual question answering (VQA) has traditionally been treated as a single-step task where each question receives the same amount of effort, unlike natural human question-answering strategies. We explore a question decomposition strategy…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Zaid Khan , Vijay Kumar BG , Samuel Schulter , Manmohan Chandraker , Yun Fu

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Visual Question Answering (VQA) presents a unique challenge by requiring models to understand and reason about visual content to answer questions accurately. Existing VQA models often struggle with biases introduced by the training data,…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Zhifei Li , Feng Qiu , Yiran Wang , Yujing Xia , Kui Xiao , Miao Zhang , Yan Zhang

Recently, the Visual Question Answering (VQA) task has gained increasing attention in artificial intelligence. Existing VQA methods mainly adopt the visual attention mechanism to associate the input question with corresponding image regions…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Pan Lu , Hongsheng Li , Wei Zhang , Jianyong Wang , Xiaogang Wang

Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of answering…

计算机视觉与模式识别 · 计算机科学 2017-12-05 Guohao Li , Hang Su , Wenwu Zhu

We present a method that learns to answer visual questions by selecting image regions relevant to the text-based query. Our method exhibits significant improvements in answering questions such as "what color," where it is necessary to…

计算机视觉与模式识别 · 计算机科学 2016-01-12 Kevin J. Shih , Saurabh Singh , Derek Hoiem

Typical active learning strategies are designed for tasks, such as classification, with the assumption that the output space is mutually exclusive. The assumption that these tasks always have exactly one correct answer has resulted in the…

计算机视觉与模式识别 · 计算机科学 2019-12-10 Khaled Jedoui , Ranjay Krishna , Michael Bernstein , Li Fei-Fei

Visual question answering is a multimodal task that requires the joint comprehension of visual and textual information. However, integrating visual and textual semantics solely through attention layers is insufficient to comprehensively…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Peize Li , Qingyi Si , Peng Fu , Zheng Lin , Yan Wang

Existing Visual Question Answering (VQA) models have explored various visual relationships between objects in the image to answer complex questions, which inevitably introduces irrelevant information brought by inaccurate object detection…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Yuxi Qian , Yuncong Hu , Ruonan Wang , Fangxiang Feng , Xiaojie Wang

Visual attention in Visual Question Answering (VQA) targets at locating the right image regions regarding the answer prediction, offering a powerful technique to promote multi-modal understanding. However, recent studies have pointed out…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Yibing Liu , Yangyang Guo , Jianhua Yin , Xuemeng Song , Weifeng Liu , Liqiang Nie

Recently, Visual Question Answering (VQA) has emerged as one of the most significant tasks in multimodal learning as it requires understanding both visual and textual modalities. Existing methods mainly rely on extracting image and question…

计算机视觉与模式识别 · 计算机科学 2018-07-23 Pan Lu , Lei Ji , Wei Zhang , Nan Duan , Ming Zhou , Jianyong Wang

Visual Question Answering (VQA) requires AI models to comprehend data in two domains, vision and text. Current state-of-the-art models use learned attention mechanisms to extract relevant information from the input domains to answer a…

人工智能 · 计算机科学 2019-03-27 Ahmed Osman , Wojciech Samek