English
Related papers

Related papers: Modern Question Answering Datasets and Benchmarks:…

200 papers

Question answering (QA) system aims at retrieving precise information from a large collection of documents against a query. This paper describes the architecture of a Natural Language Question Answering (NLQA) system for a specific domain…

Computation and Language · Computer Science 2013-11-14 Athira P. M. , Sreeja M. , P. C. Reghu Raj

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

Computer Vision and Pattern Recognition · Computer Science 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

We present a unified dataset for document Question-Answering (QA), which is obtained combining several public datasets related to Document AI and visually rich document understanding (VRDU). Our main contribution is twofold: on the one hand…

Computation and Language · Computer Science 2025-12-12 Simone Giovannini , Fabio Coppini , Andrea Gemelli , Simone Marinai

Humans observe and interact with the world to acquire knowledge. However, most existing machine reading comprehension (MRC) tasks miss the interactive, information-seeking component of comprehension. Such tasks present models with static…

Computation and Language · Computer Science 2019-08-30 Xingdi Yuan , Marc-Alexandre Cote , Jie Fu , Zhouhan Lin , Christopher Pal , Yoshua Bengio , Adam Trischler

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros

Question answering (QA) is an important aspect of open-domain conversational agents, garnering specific research focus in the conversational QA (ConvQA) subtask. One notable limitation of recent ConvQA efforts is the response being answer…

Computation and Language · Computer Science 2020-12-18 Ashutosh Baheti , Alan Ritter , Kevin Small

Question answering(QA) is one of the most challenging yet widely investigated problems in Natural Language Processing (NLP). Question-answering (QA) systems try to produce answers for given questions. These answers can be generated from…

Computation and Language · Computer Science 2025-08-06 Kholoud Alsubhi , Amani Jamal , Areej Alhothali

Natural Question Answering (QA) datasets play a crucial role in evaluating the capabilities of large language models (LLMs), ensuring their effectiveness in real-world applications. Despite the numerous QA datasets that have been developed…

Existing question answering (QA) datasets fail to train QA systems to perform complex reasoning and provide explanations for answers. We introduce HotpotQA, a new dataset with 113k Wikipedia-based question-answer pairs with four key…

Computation and Language · Computer Science 2018-09-26 Zhilin Yang , Peng Qi , Saizheng Zhang , Yoshua Bengio , William W. Cohen , Ruslan Salakhutdinov , Christopher D. Manning

Over the last twenty years, significant progress has been made in designing and implementing Question Answering (QA) systems. However, addressing complex questions, the answers to which are spread across multiple documents, remains a…

Computation and Language · Computer Science 2026-02-26 Sourav Saha , Dwaipayan Roy , Mandar Mitra

Question processing is a fundamental step in a question answering (QA) application, and its quality impacts the performance of QA application. The major challenging issue in processing question is how to extract semantic of natural language…

Computation and Language · Computer Science 2017-09-28 Omar Al-Harbi , Shaidah Jusoh , Norita Md Norwawi

While conversing with chatbots, humans typically tend to ask many questions, a significant portion of which can be answered by referring to large-scale knowledge graphs (KG). While Question Answering (QA) and dialog systems have been…

Computation and Language · Computer Science 2018-10-05 Amrita Saha , Vardaan Pahuja , Mitesh M. Khapra , Karthik Sankaranarayanan , Sarath Chandar

In this paper, we present the mQA model, which is able to answer questions about the content of an image. The answer can be a sentence, a phrase or a single word. Our model contains four components: a Long Short-Term Memory (LSTM) to…

Computer Vision and Pattern Recognition · Computer Science 2015-11-04 Haoyuan Gao , Junhua Mao , Jie Zhou , Zhiheng Huang , Lei Wang , Wei Xu

The vast majority of cybersecurity information is unstructured text, including critical data within databases such as CVE, NVD, CWE, CAPEC, and the MITRE ATT&CK Framework. These databases are invaluable for analyzing attack patterns and…

Cryptography and Security · Computer Science 2024-12-24 Tanjim Bin Faruk

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

In recent years, there have been amazing advances in deep learning methods for machine reading. In machine reading, the machine reader has to extract the answer from the given ground truth paragraph. Recently, the state-of-the-art machine…

Computation and Language · Computer Science 2018-04-13 Phu Mon Htut , Samuel R. Bowman , Kyunghyun Cho

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Question Answering (QA) is a challenging topic since it requires tackling the various difficulties of natural language understanding. Since evaluation is important not only for identifying the strong and weak points of the various…

Computation and Language · Computer Science 2021-02-09 Katerina Papantoniou , Yannis Tzitzikas

This paper proposes the creation of a Swahili Question Answering (QA) benchmark dataset, aimed at addressing the underrepresentation of Swahili in natural language processing (NLP). Drawing from established benchmarks like SQuAD, GLUE,…

Computation and Language · Computer Science 2024-10-21 Alfred Malengo Kondoro

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel