English
Related papers

Related papers: Know What You Don't Know: Unanswerable Questions f…

200 papers

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

Computation and Language · Computer Science 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti

The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically…

Computation and Language · Computer Science 2024-03-05 Rustam Abdumalikov , Pasquale Minervini , Yova Kementchedjhieva

We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence…

Computation and Language · Computer Science 2017-05-16 Mandar Joshi , Eunsol Choi , Daniel S. Weld , Luke Zettlemoyer

Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are…

Computation and Language · Computer Science 2021-06-08 Akari Asai , Eunsol Choi

We present QuAC, a dataset for Question Answering in Context that contains 14K information-seeking QA dialogs (100K questions in total). The dialogs involve two crowd workers: (1) a student who poses a sequence of freeform questions to…

Computation and Language · Computer Science 2018-08-29 Eunsol Choi , He He , Mohit Iyyer , Mark Yatskar , Wen-tau Yih , Yejin Choi , Percy Liang , Luke Zettlemoyer

We present two new large-scale datasets aimed at evaluating systems designed to comprehend a natural language query and extract its answer from a large corpus of text. The Quasar-S dataset consists of 37000 cloze-style (fill-in-the-gap)…

Computation and Language · Computer Science 2017-08-10 Bhuwan Dhingra , Kathryn Mazaitis , William W. Cohen

Answers to the same question may change depending on the extra-linguistic contexts (when and where the question was asked). To study this challenge, we introduce SituatedQA, an open-retrieval QA dataset where systems must produce the…

Computation and Language · Computer Science 2021-09-14 Michael J. Q. Zhang , Eunsol Choi

The last several years have seen intensive interest in exploring neural-network-based models for machine comprehension (MC) and question answering (QA). In this paper, we approach the problems by closely modelling questions in a neural…

Computation and Language · Computer Science 2017-03-28 Junbei Zhang , Xiaodan Zhu , Qian Chen , Lirong Dai , Si Wei , Hui Jiang

If a question cannot be answered with the available information, robust systems for question answering (QA) should know _not_ to answer. One way to build QA models that do this is with additional training data comprised of unanswerable…

Computation and Language · Computer Science 2023-10-31 Vagrant Gautam , Miaoran Zhang , Dietrich Klakow

Spoken question answering (SQA) systems are critical for digital assistants and other real-world use cases, but evaluating their performance is a challenge due to the importance of human-spoken questions. This study presents a new…

Computation and Language · Computer Science 2024-02-28 Yijing Wu , SaiKrishna Rallabandi , Ravisutha Srinivasamurthy , Parag Pravin Dakle , Alolika Gon , Preethi Raghavan

When answering natural language questions over knowledge bases, missing facts, incomplete schema and limited scope naturally lead to many questions being unanswerable. While answerability has been explored in other QA settings, it has not…

Computation and Language · Computer Science 2023-06-27 Mayur Patidar , Prayushi Faldu , Avinash Singh , Lovekesh Vig , Indrajit Bhattacharya , Mausam

Question Answering (QA) is a task in which a machine understands a given document and a question to find an answer. Despite impressive progress in the NLP area, QA is still a challenging problem, especially for non-English languages due to…

Computation and Language · Computer Science 2022-02-04 ByungHoon So , Kyuhong Byun , Kyungwon Kang , Seongjin Cho

The full power of human language-based communication cannot be realized without negation. All human languages have some form of negation. Despite this, negation remains a challenging phenomenon for current natural language understanding…

Computation and Language · Computer Science 2022-11-02 Abhilasha Ravichander , Matt Gardner , Ana Marasović

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

Computation and Language · Computer Science 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

Nowadays, the Internet represents a vast informational space, growing exponentially and the problem of search for relevant data becomes essential as never before. The algorithm proposed in the article allows to perform natural language…

Computation and Language · Computer Science 2018-04-03 A. Artemov , A. Sergeev , A. Khasenevich , A. Yuzhakov , M. Chugunov

In recent years, low-resource Machine Reading Comprehension (MRC) has made significant progress, with models getting remarkable performance on various language datasets. However, none of these models have been customized for the Urdu…

Computation and Language · Computer Science 2021-11-04 Samreen Kazi , Shakeel Khoja

Recent advances in the field of language modeling have improved state-of-the-art results on many Natural Language Processing tasks. Among them, Reading Comprehension has made significant progress over the past few years. However, most…

Computation and Language · Computer Science 2020-05-26 Martin d'Hoffschmidt , Wacim Belblidia , Tom Brendlé , Quentin Heinrich , Maxime Vidal

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

Neural models for question answering (QA) over documents have achieved significant performance improvements. Although effective, these models do not scale to large corpora due to their complex modeling of interactions between the document…

Computation and Language · Computer Science 2018-05-22 Sewon Min , Victor Zhong , Richard Socher , Caiming Xiong

Disfluencies is an under-studied topic in NLP, even though it is ubiquitous in human conversation. This is largely due to the lack of datasets containing disfluencies. In this paper, we present a new challenge question answering dataset,…

Computation and Language · Computer Science 2021-06-09 Aditya Gupta , Jiacheng Xu , Shyam Upadhyay , Diyi Yang , Manaal Faruqui