English
Related papers

Related papers: QADiver: Interactive Framework for Diagnosing QA M…

200 papers

We introduce CausalVQA, a benchmark dataset for video question answering (VQA) composed of question-answer pairs that probe models' understanding of causality in the physical world. Existing VQA benchmarks either tend to focus on surface…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Aaron Foss , Chloe Evans , Sasha Mitts , Koustuv Sinha , Ammar Rizvi , Justine T. Kao

With the rapid development of mobile intelligent assistant technologies, multi-modal AI assistants have become essential interfaces for daily user interactions. However, current evaluation methods face challenges including high manual…

Artificial Intelligence · Computer Science 2025-10-22 Meiping Wang , Jian Zhong , Rongduo Han , Liming Kang , Zhengkun Shi , Xiao Liang , Xing Lin , Nan Gao , Haining Zhang

Recent advances in the field of language modeling have improved the state-of-the-art in question answering (QA) and question generation (QG). However, the development of modern neural models, their benchmarks, and datasets for training them…

Computation and Language · Computer Science 2022-11-28 Ilmari Kylliäinen , Roman Yangarber

Question answering (QA) is the task of answering questions posed in natural language with free-form natural language answers extracted from a given passage. In the OpenQA variant, only a question text is given, and the system must retrieve…

Computation and Language · Computer Science 2024-11-21 Emrah Budur , Rıza Özçelik , Dilara Soylu , Omar Khattab , Tunga Güngör , Christopher Potts

Modern QA systems entail retrieval-augmented generation (RAG) for accurate and trustworthy responses. However, the inherent gap between user queries and relevant documents hinders precise matching. We introduce QAEncoder, a training-free…

Computation and Language · Computer Science 2025-07-03 Zhengren Wang , Qinhan Yu , Shida Wei , Zhiyu Li , Feiyu Xiong , Xiaoxing Wang , Simin Niu , Hao Liang , Wentao Zhang

Most existing works in visual question answering (VQA) are dedicated to improving the accuracy of predicted answers, while disregarding the explanations. We argue that the explanation for an answer is of the same or even more importance…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Qing Li , Qingyi Tao , Shafiq Joty , Jianfei Cai , Jiebo Luo

The rise of powerful multimodal LLMs has enhanced the viability of building web agents which can, with increasing levels of autonomy, assist users to retrieve information and complete tasks on various human-computer interfaces. It is hence…

Information Retrieval · Computer Science 2024-09-26 Maria Wang , Srinivas Sunkara , Gilles Baechler , Jason Lin , Yun Zhu , Fedir Zubach , Lei Shu , Jindong Chen

Current end-to-end machine reading and question answering (Q\&A) models are primarily based on recurrent neural networks (RNNs) with attention. Despite their success, these models are often slow for both training and inference due to the…

Computation and Language · Computer Science 2018-04-26 Adams Wei Yu , David Dohan , Minh-Thang Luong , Rui Zhao , Kai Chen , Mohammad Norouzi , Quoc V. Le

Audio Question Answering (AQA) constitutes a pivotal task in which machines analyze both audio signals and natural language questions to produce precise natural language answers. The significance of possessing high-quality, diverse, and…

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

Computation and Language · Computer Science 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Non-extractive commonsense QA remains a challenging AI task, as it requires systems to reason about, synthesize, and gather disparate pieces of information, in order to generate responses to queries. Recent approaches on such tasks show…

Computation and Language · Computer Science 2019-11-01 Kaixin Ma , Jonathan Francis , Quanyang Lu , Eric Nyberg , Alessandro Oltramari

Video question answering (Video QA) presents a powerful testbed for human-like intelligent behaviors. The task demands new capabilities to integrate video processing, language understanding, binding abstract linguistic concepts to concrete…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Long Hoang Dang , Thao Minh Le , Vuong Le , Truyen Tran

We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA systems need to answer…

Computation and Language · Computer Science 2024-02-29 Jungo Kasai , Keisuke Sakaguchi , Yoichi Takahashi , Ronan Le Bras , Akari Asai , Xinyan Yu , Dragomir Radev , Noah A. Smith , Yejin Choi , Kentaro Inui

In this paper, we propose a recent and under-researched paradigm for the task of event detection (ED) by casting it as a question-answering (QA) problem with the possibility of multiple answers and the support of entities. The extraction of…

Computation and Language · Computer Science 2021-04-15 Emanuela Boros , Jose G. Moreno , Antoine Doucet

Question Answering (QA) systems have traditionally relied on structured text data, but the rapid growth of multimedia content (images, audio, video, and structured metadata) has introduced new challenges and opportunities for…

Information Retrieval · Computer Science 2025-10-24 Rahul Raja , Arpita Vats

Open-domain question answering (Open-QA) is a common task for evaluating large language models (LLMs). However, current Open-QA evaluations are criticized for the ambiguity in questions and the lack of semantic understanding in evaluators.…

Computation and Language · Computer Science 2024-05-28 Peiran Yao , Denilson Barbosa

Audio-Visual Question Answering (AVQA) requires not only question-based multimodal reasoning but also precise temporal grounding to capture subtle dynamics for accurate prediction. However, existing methods mainly use question information…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Hongyeob Kim , Inyoung Jung , Dayoon Suh , Youjia Zhang , Sangmin Lee , Sungeun Hong

Question and answer generation (QAG) consists of generating a set of question-answer pairs given a context (e.g. a paragraph). This task has a variety of applications, such as data augmentation for question answering (QA) models,…

Computation and Language · Computer Science 2023-05-29 Asahi Ushio , Fernando Alva-Manchego , Jose Camacho-Collados