中文
相关论文

相关论文: Visual Grounding Methods for VQA are Working for t…

200 篇论文

Generalization in Visual Question Answering (VQA) requires models to answer questions about images with contexts beyond the training distribution. Existing attempts primarily refine unimodal aspects, overlooking enhancements in multimodal…

人工智能 · 计算机科学 2023-10-10 Trang Nguyen , Naoaki Okazaki

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

计算机视觉与模式识别 · 计算机科学 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Visual Question Answering (VQA) attracts much attention from both industry and academia. As a multi-modality task, it is challenging since it requires not only visual and textual understanding, but also the ability to align cross-modality…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Peixi Xiong , Quanzeng You , Pei Yu , Zicheng Liu , Ying Wu

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

计算机视觉与模式识别 · 计算机科学 2017-11-23 Damien Teney , Anton van den Hengel

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Damien Teney , Anton van den Hengel

Since its appearance, Visual Question Answering (VQA, i.e. answering a question posed over an image), has always been treated as a classification problem over a set of predefined answers. Despite its convenience, this classification…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Corentin Kervadec , Grigory Antipov , Moez Baccouche , Christian Wolf

The Visual Question Answering (VQA) system offers a user-friendly interface and enables human-computer interaction. However, VQA models commonly face the challenge of language bias, resulting from the learned superficial correlation between…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

计算机视觉与模式识别 · 计算机科学 2017-09-15 Kushal Kafle , Christopher Kanan

Visual attention in Visual Question Answering (VQA) targets at locating the right image regions regarding the answer prediction, offering a powerful technique to promote multi-modal understanding. However, recent studies have pointed out…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Yibing Liu , Yangyang Guo , Jianhua Yin , Xuemeng Song , Weifeng Liu , Liqiang Nie

Visual Grounding (VG) in VQA refers to a model's proclivity to infer answers based on question-relevant image regions. Conceptually, VG identifies as an axiomatic requirement of the VQA task. In practice, however, DNN-based VQA models are…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Daniel Reich , Tanja Schultz

In this paper, we propose a method to obtain robust explanations for visual question answering(VQA) that correlate well with the answers. Our model explains the answers obtained through a VQA model by providing visual and textual…

计算机视觉与模式识别 · 计算机科学 2020-01-24 Badri N. Patro , Shivansh Pate , Vinay P. Namboodiri

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Metrics for Visual Grounding (VG) in Visual Question Answering (VQA) systems primarily aim to measure a system's reliance on relevant parts of the image when inferring an answer to the given question. Lack of VG has been a common problem…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Daniel Reich , Felix Putze , Tanja Schultz

Video Question Answering (VideoQA) is the task of answering questions about a video. At its core is understanding the alignments between visual scenes in video and linguistic semantics in question to yield the answer. In leading VideoQA…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Yicong Li , Xiang Wang , Junbin Xiao , Wei Ji , Tat-Seng Chua

Generalization beyond in-domain experience to out-of-distribution data is of paramount significance in the AI domain. Of late, state-of-the-art Visual Question Answering (VQA) models have shown impressive performance on in-domain data,…

人工智能 · 计算机科学 2023-09-06 Daowan Peng , Wei Wei , Xian-Ling Mao , Yuanyuan Fu , Dangyang Chen

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

计算与语言 · 计算机科学 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

Visual question answering (VQA) has traditionally been treated as a single-step task where each question receives the same amount of effort, unlike natural human question-answering strategies. We explore a question decomposition strategy…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Zaid Khan , Vijay Kumar BG , Samuel Schulter , Manmohan Chandraker , Yun Fu

Despite considerable recent progress in Visual Question Answering (VQA) models, inconsistent or contradictory answers continue to cast doubt on their true reasoning capabilities. However, most proposed methods use indirect strategies or…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

人工智能 · 计算机科学 2016-08-30 Danna Gurari , Kristen Grauman

Models for Visual Question Answering (VQA) are notorious for their tendency to rely on dataset biases, as the large and unbalanced diversity of questions and concepts involved and tends to prevent models from learning to reason, leading…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Corentin Kervadec , Grigory Antipov , Moez Baccouche , Christian Wolf