English
Related papers

Related papers: Loss re-scaling VQA: Revisiting the LanguagePrior …

200 papers

Despite the great progress of Visual Question Answering (VQA), current VQA models heavily rely on the superficial correlation between the question type and its corresponding frequent answers (i.e., language priors) to make predictions,…

Computation and Language · Computer Science 2022-09-20 Yike Wu , Yu Zhao , Shiwan Zhao , Ying Zhang , Xiaojie Yuan , Guoqing Zhao , Ning Jiang

A number of studies point out that current Visual Question Answering (VQA) models are severely affected by the language prior problem, which refers to blindly making predictions based on the language shortcut. Some efforts have been devoted…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Yangyang Guo , Liqiang Nie , Zhiyong Cheng , Feng Ji , Ji Zhang , Alberto Del Bimbo

Several studies have recently pointed that existing Visual Question Answering (VQA) models heavily suffer from the language prior problem, which refers to capturing superficial statistical correlations between the question type and the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Yudong Han , Liqiang Nie , Jianhua Yin , Jianlong Wu , Yan Yan

Most existing Visual Question Answering (VQA) systems tend to overly rely on language bias and hence fail to reason from the visual clue. To address this issue, we propose a novel Language-Prior Feedback (LPF) objective function, to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Zujie Liang , Haifeng Hu , Jiaying Zhu

Most Visual Question Answering (VQA) models suffer from the language prior problem, which is caused by inherent data biases. Specifically, VQA models tend to answer questions (e.g., what color is the banana?) based on the high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Xi Zhu , Zhendong Mao , Chunxiao Liu , Peng Zhang , Bin Wang , Yongdong Zhang

Benefiting from the advancement of computer vision, natural language processing and information retrieval techniques, visual question answering (VQA), which aims to answer questions about an image or a video, has received lots of attentions…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yangyang Guo , Zhiyong Cheng , Liqiang Nie , Yibing Liu , Yinglong Wang , Mohan Kankanhalli

Visual question answering (VQA) is a challenging task, which has attracted more and more attention in the field of computer vision and natural language processing. However, the current visual question answering has the problem of language…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Desen Yuan

To increase the generalization capability of VQA systems, many recent studies have tried to de-bias spurious language or vision associations that shortcut the question or image to the answer. Despite these efforts, the literature fails to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Ali Vosoughi , Shijian Deng , Songyang Zhang , Yapeng Tian , Chenliang Xu , Jiebo Luo

While several benefits were realized for multilingual vision-language pretrained models, recent benchmarks across various tasks and languages showed poor cross-lingual generalisation when multilingually pre-trained vision-language models…

Computation and Language · Computer Science 2022-12-01 Farhad Nooralahzadeh , Rico Sennrich

Problems at the intersection of vision and language are of significant importance both as challenging research questions and for the rich set of applications they enable. However, inherent structure in our world and bias in our language…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Yash Goyal , Tejas Khot , Douglas Summers-Stay , Dhruv Batra , Devi Parikh

Since its appearance, Visual Question Answering (VQA, i.e. answering a question posed over an image), has always been treated as a classification problem over a set of predefined answers. Despite its convenience, this classification…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Corentin Kervadec , Grigory Antipov , Moez Baccouche , Christian Wolf

A number of studies have found that today's Visual Question Answering (VQA) models are heavily driven by superficial correlations in the training data and lack sufficient image grounding. To encourage development of models geared towards…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh , Aniruddha Kembhavi

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

Computation and Language · Computer Science 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

In recent years, visual question answering (VQA) has become topical. The premise of VQA's significance as a benchmark in AI, is that both the image and textual question need to be well understood and mutually grounded in order to infer the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Modern Visual Question Answering (VQA) models have been shown to rely heavily on superficial correlations between question and answer words learned during training such as overwhelmingly reporting the type of room as kitchen or the sport…

Computer Vision and Pattern Recognition · Computer Science 2018-11-12 Sainandan Ramakrishnan , Aishwarya Agrawal , Stefan Lee

Visual Question Answering (VQA) is a challenging multimodal task to answer questions about an image. Many works concentrate on how to reduce language bias which makes models answer questions ignoring visual content and language context.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Chao Yang , Su Feng , Dongsheng Li , Huawei Shen , Guoqing Wang , Bin Jiang

VQA models may tend to rely on language bias as a shortcut and thus fail to sufficiently learn the multi-modal knowledge from both vision and language. Recent debiasing methods proposed to exclude the language prior during inference.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yulei Niu , Kaihua Tang , Hanwang Zhang , Zhiwu Lu , Xian-Sheng Hua , Ji-Rong Wen

Medical Visual Question Answering (VQA) is an important challenge, as it would lead to faster and more accurate diagnoses and treatment decisions. Most existing methods approach it as a multi-class classification problem, which restricts…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Tom van Sonsbeek , Mohammad Mahdi Derakhshani , Ivona Najdenkoska , Cees G. M. Snoek , Marcel Worring

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Damien Teney , Anton van den Hengel
‹ Prev 1 2 3 10 Next ›