中文
相关论文

相关论文: Beyond Question-Based Biases: Assessing Multimodal…

200 篇论文

Multi-modal reasoning in visual question answering (VQA) has witnessed rapid progress recently. However, most reasoning models heavily rely on shortcuts learned from training data, which prevents their usage in challenging real-world…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Qi Zheng , Chaoyue Wang , Daqing Liu , Dadong Wang , Dacheng Tao

Vision-and-language tasks have increasingly drawn more attention as a means to evaluate human-like reasoning in machine learning models. A popular task in the field is visual question answering (VQA), which aims to answer questions about…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Yusuke Hirota , Yuta Nakashima , Noa Garcia

Visual Question Answering (VQA) models are prone to learn the shortcut solution formed by dataset biases rather than the intended solution. To evaluate the VQA models' reasoning ability beyond shortcut learning, the VQA-CP v2 dataset…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Qingyi Si , Fandong Meng , Mingyu Zheng , Zheng Lin , Yuanxin Liu , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Yeyun Zou , Qiyu Xie

Visual question answering (VQA) is a challenging task, which has attracted more and more attention in the field of computer vision and natural language processing. However, the current visual question answering has the problem of language…

计算机视觉与模式识别 · 计算机科学 2021-11-17 Desen Yuan

Though beneficial for encouraging the Visual Question Answering (VQA) models to discover the underlying knowledge by exploiting the input-output correlation beyond image and text contexts, the existing knowledge VQA datasets are mostly…

计算机视觉与模式识别 · 计算机科学 2020-12-15 Qingxing Cao , Bailin Li , Xiaodan Liang , Keze Wang , Liang Lin

Visual question answering (or VQA) is a new and exciting problem that combines natural language processing and computer vision techniques. We present a survey of the various datasets and models that have been used to tackle this task. The…

计算与语言 · 计算机科学 2017-05-12 Akshay Kumar Gupta

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

计算机视觉与模式识别 · 计算机科学 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

To increase the generalization capability of VQA systems, many recent studies have tried to de-bias spurious language or vision associations that shortcut the question or image to the answer. Despite these efforts, the literature fails to…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Ali Vosoughi , Shijian Deng , Songyang Zhang , Yapeng Tian , Chenliang Xu , Jiebo Luo

Visual Question Answering (VQA) models employ attention mechanisms to discover image locations that are most relevant for answering a specific question. For this purpose, several multimodal fusion strategies have been proposed, ranging from…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Moshiur R Farazi , Salman H Khan , Nick Barnes

Since its inception, Visual Question Answering (VQA) is notoriously known as a task, where models are prone to exploit biases in datasets to find shortcuts instead of performing high-level reasoning. Classical methods address this by…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Corentin Kervadec , Theo Jaunet , Grigory Antipov , Moez Baccouche , Romain Vuillemot , Christian Wolf

Most Visual Question Answering (VQA) models suffer from the language prior problem, which is caused by inherent data biases. Specifically, VQA models tend to answer questions (e.g., what color is the banana?) based on the high-frequency…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Xi Zhu , Zhendong Mao , Chunxiao Liu , Peng Zhang , Bin Wang , Yongdong Zhang

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

计算机视觉与模式识别 · 计算机科学 2017-09-26 Supriya Pandhre , Shagun Sodhani

Models for Visual Question Answering (VQA) are notorious for their tendency to rely on dataset biases, as the large and unbalanced diversity of questions and concepts involved and tends to prevent models from learning to reason, leading…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Corentin Kervadec , Grigory Antipov , Moez Baccouche , Christian Wolf

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

计算与语言 · 计算机科学 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

Visual question answering (VQA) models respond to open-ended natural language questions about images. While VQA is an increasingly popular area of research, it is unclear to what extent current VQA architectures learn key semantic…

计算机视觉与模式识别 · 计算机科学 2018-07-25 Gabriel Grand , Aron Szanto , Yoon Kim , Alexander Rush

Visual Question Answering (VQA) is the task of answering questions about an image. Some VQA models often exploit unimodal biases to provide the correct answer without using the image information. As a result, they suffer from a huge drop in…

计算机视觉与模式识别 · 计算机科学 2020-03-24 Remi Cadene , Corentin Dancette , Hedi Ben-younes , Matthieu Cord , Devi Parikh

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

计算机视觉与模式识别 · 计算机科学 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten
‹ 上一页 1 2 3 10 下一页 ›