English
Related papers

Related papers: Know What You Don't Know: Unanswerable Questions f…

200 papers

While models have reached superhuman performance on popular question answering (QA) datasets such as SQuAD, they have yet to outperform humans on the task of question answering itself. In this paper, we investigate if models are learning…

Computation and Language · Computer Science 2021-09-14 Priyanka Sen , Amir Saffari

SberQuAD -- a large scale analog of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community. We fill this gap by providing a description, a thorough analysis, and…

Computation and Language · Computer Science 2020-11-02 Pavel Efimov , Andrey Chertok , Leonid Boytsov , Pavel Braslavski

We propose a deep-learning system -- for the SQuAD2.0 task -- that finds, or indicates the lack of, a correct answer to a question in a context paragraph. Our goal is to learn an ensemble of heterogeneous SQuAD2.0 models that, when blended…

Computation and Language · Computer Science 2020-04-16 Mohamed El-Geish

Recently, multilingual question answering became a crucial research topic, and it is receiving increased interest in the NLP community. However, the unavailability of large-scale datasets makes it challenging to train multilingual QA…

Computation and Language · Computer Science 2019-12-13 Casimiro Pio Carrino , Marta R. Costa-jussà , José A. R. Fonollosa

Machine Reading Comprehension (MRC) holds a pivotal role in shaping Medical Question Answering Systems (QAS) and transforming the landscape of accessing and applying medical information. However, the inherent challenges in the medical…

Computation and Language · Computer Science 2024-04-19 Jimenez Eladio , Hao Wu

This paper introduces UQA, a novel dataset for question answering and text comprehension in Urdu, a low-resource language with over 70 million native speakers. UQA is generated by translating the Stanford Question Answering Dataset…

Computation and Language · Computer Science 2024-07-24 Samee Arif , Sualeha Farid , Awais Athar , Agha Ali Raza

The widely used Fact-based Visual Question Answering (FVQA) dataset contains visually-grounded questions that require information retrieval using common sense knowledge graphs to answer. It has been observed that the original dataset is…

Computation and Language · Computer Science 2023-03-21 Weizhe Lin , Zhilin Wang , Bill Byrne

The latest work for Question and Answer problems is to use the Stanford Parse Tree. We build on prior work and develop a new method to handle the Question and Answer problem with the Deep Contextualized Transformer to manage some aberrant…

Computation and Language · Computer Science 2024-06-12 Haozheng Luo , Ningwei Liu , Charles Feng

Recent work in semantic parsing for question answering has focused on long and complicated questions, many of which would seem unnatural if asked in a normal conversation between two humans. In an effort to explore a conversational QA…

Computation and Language · Computer Science 2016-11-07 Mohit Iyyer , Wen-tau Yih , Ming-Wei Chang

Commonsense knowledge is critical in human reading comprehension. While machine comprehension has made significant progress in recent years, the ability in handling commonsense knowledge remains limited. Synonyms are one of the most widely…

Computation and Language · Computer Science 2020-10-27 Gongqi Lin , Yuan Miao , Xiaoyong Yang , Wenwu Ou , Lizhen Cui , Wei Guo , Chunyan Miao

Question-answering (QA) models have advanced significantly in machine reading comprehension but often exhibit biases that hinder their performance, particularly with complex queries in adversarial conditions. This study evaluates the…

Computation and Language · Computer Science 2026-01-21 Yuefeng Wang , ChangJae Lee

Prior work has uncovered a set of common problems in state-of-the-art context-based question answering (QA) systems: a lack of attention to the context when the latter conflicts with a model's parametric knowledge, little robustness to…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Lawrence E Hunter , Katharina von der Wense

Question Answering (QA) systems are becoming the inspiring model for the future of search engines. While recently, underlying datasets for QA systems have been promoted from unstructured datasets to structured datasets with highly…

Information Retrieval · Computer Science 2016-02-17 Saeedeh Shekarpour , Denis Lukovnikov , Ashwini Jaya Kumar , Kemele Endris , Kuldeep Singh , Harsh Thakkar , Christoph Lange

It is challenging to automatically evaluate the answer of a QA model at inference time. Although many models provide confidence scores, and simple heuristics can go a long way towards indicating answer correctness, such measures are heavily…

Computation and Language · Computer Science 2020-10-08 Lukas Muttenthaler , Isabelle Augenstein , Johannes Bjerva

Obtaining training data for Question Answering (QA) is time-consuming and resource-intensive, and existing QA datasets are only available for limited domains and languages. In this work, we explore to what extent high quality training data…

Computation and Language · Computer Science 2020-05-05 Patrick Lewis , Ludovic Denoyer , Sebastian Riedel

We present SQuAI (https://squai.scads.ai/), a scalable and trustworthy multi-agent retrieval-augmented generation (RAG) framework for scientific question answering (QA) with large language models (LLMs). SQuAI addresses key limitations of…

Information Retrieval · Computer Science 2025-10-20 Ines Besrour , Jingbo He , Tobias Schreieder , Michael Färber

We describe a Question Answering (QA) dataset that contains complex questions with conditional answers, i.e. the answers are only applicable when certain conditions apply. We call this dataset ConditionalQA. In addition to conditional…

Computation and Language · Computer Science 2021-10-14 Haitian Sun , William W. Cohen , Ruslan Salakhutdinov

Despite recent progress on conversational systems, they still do not perform smoothly and coherently when faced with ambiguous requests. When questions are unclear, conversational systems should have the ability to ask clarifying questions,…

Information Retrieval · Computer Science 2022-08-10 Negar Arabzadeh , Mahsa Seifikar , Charles L. A. Clarke

A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question/answer pairs. To improve the…

Computation and Language · Computer Science 2021-04-27 Timo Möller , Julian Risch , Malte Pietsch

The widespread availability of Question Answering (QA) datasets in English has greatly facilitated the advancement of the Natural Language Processing (NLP) field. However, the scarcity of such resources for minority languages, such as…

Computation and Language · Computer Science 2024-06-05 Aitor García-Pablos , Naiara Perez , Montse Cuadros , Jaione Bengoetxea