English
Related papers

Related papers: FVQA 2.0: Introducing Adversarial Samples into Fac…

200 papers

Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial…

Computation and Language · Computer Science 2024-08-13 Gulsum Yigit , Mehmet Fatih Amasyali

Generating natural language questions from visual scenes, known as Visual Question Generation (VQG), has been explored in the recent past where large amounts of meticulously labeled data provide the training corpus. However, in practice, it…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Anurag Roy , David Johnson Ekka , Saptarshi Ghosh , Abir Das

Visual Question Answering (VQA) has benefited from increasingly sophisticated models, but has not enjoyed the same level of engagement in terms of data creation. In this paper, we propose a method that automatically derives VQA examples at…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Soravit Changpinyo , Doron Kukliansky , Idan Szpektor , Xi Chen , Nan Ding , Radu Soricut

Visual Question Answering (VQA) is the task of answering questions about an image. Some VQA models often exploit unimodal biases to provide the correct answer without using the image information. As a result, they suffer from a huge drop in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Remi Cadene , Corentin Dancette , Hedi Ben-younes , Matthieu Cord , Devi Parikh

Text-VQA aims at answering questions that require understanding the textual cues in an image. Despite the great progress of existing Text-VQA methods, their performance suffers from insufficient human-labeled question-answer (QA) pairs.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jun Wang , Mingfei Gao , Yuqian Hu , Ramprasaath R. Selvaraju , Chetan Ramaiah , Ran Xu , Joseph F. JaJa , Larry S. Davis

We introduce CausalVQA, a benchmark dataset for video question answering (VQA) composed of question-answer pairs that probe models' understanding of causality in the physical world. Existing VQA benchmarks either tend to focus on surface…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Aaron Foss , Chloe Evans , Sasha Mitts , Koustuv Sinha , Ammar Rizvi , Justine T. Kao

Methods for teaching machines to answer visual questions have made significant progress in recent years, but current methods still lack important human capabilities, including integrating new visual classes and concepts in a modular manner,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Ben-Zion Vatashsky , Shimon Ullman

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

Standard accuracy metrics indicate that reading comprehension systems are making rapid progress, but the extent to which these systems truly understand language remains unclear. To reward systems with real language understanding abilities,…

Computation and Language · Computer Science 2017-07-25 Robin Jia , Percy Liang

Extractive reading comprehension systems can often locate the correct answer to a question in a context document, but they also tend to make unreliable guesses on questions for which the correct answer is not stated in the context. Existing…

Computation and Language · Computer Science 2018-06-12 Pranav Rajpurkar , Robin Jia , Percy Liang

Visual Question Answering (VQA) is a challenging task of natural language processing (NLP) and computer vision (CV), attracting significant attention from researchers. English is a resource-rich language that has witnessed various…

Computation and Language · Computer Science 2024-04-18 Ngan Luu-Thuy Nguyen , Nghia Hieu Nguyen , Duong T. D Vo , Khanh Quoc Tran , Kiet Van Nguyen

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Aditya Kane , V Manushree , Sahil Khose

In recent years, people have increasingly used AI to help them with their problems by asking questions on different topics. One of these topics can be software-related and programming questions. In this work, we focus on the questions which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Motahhare Mirzaei , Mohammad Javad Pirhadi , Sauleh Eetemadi

Visual question answering (VQA) has the potential to make the Internet more accessible in an interactive way, allowing people who cannot see images to ask questions about them. However, multiple studies have shown that people who are blind…

Computation and Language · Computer Science 2023-08-31 Nandita Naik , Christopher Potts , Elisa Kreiss

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

Computation and Language · Computer Science 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen

Scientific visual question answering poses significant challenges for vision-language models due to the complexity of scientific figures and their multimodal context. Traditional approaches treat the figure and accompanying text (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Belal Shoer , Yova Kementchedjhieva

Over the last twenty years, significant progress has been made in designing and implementing Question Answering (QA) systems. However, addressing complex questions, the answers to which are spread across multiple documents, remains a…

Computation and Language · Computer Science 2026-02-26 Sourav Saha , Dwaipayan Roy , Mandar Mitra

We study the problem of visual question answering (VQA) in images by exploiting supervised domain adaptation, where there is a large amount of labeled data in the source domain but only limited labeled data in the target domain with the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Yiming Xu , Lin Chen , Zhongwei Cheng , Lixin Duan , Jiebo Luo

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Xiao Lin , Devi Parikh

We introduce LEAF-QA, a comprehensive dataset of $250,000$ densely annotated figures/charts, constructed from real-world open data sources, along with ~2 million question-answer (QA) pairs querying the structure and semantics of these…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Ritwick Chaudhry , Sumit Shekhar , Utkarsh Gupta , Pranav Maneriker , Prann Bansal , Ajay Joshi